cuda-inference

Tag

Cards List
#cuda-inference

The bear can dance: Qwen 3.8 27B on one 3090 for 3 weeks

Reddit r/LocalLLaMA ↗ · 2026-09-20

An experiment demonstrated that a quantized Qwen 3.8 27B model, running locally on a single RTX 3090 GPU, autonomously pursued optimizing CUDA inference for over three weeks, producing functional kernels and benchmarks while maintaining coherent long-term goal-following.

0 favorites 0 likes
← Back to home

Submit Feedback