cache-tuning

Tag

Cards List
#cache-tuning

Qwen3.6 27B on a 5090, 6.4k sample tok/s distribution after tuning MTP/cache settings

Reddit r/LocalLLaMA · 3d ago

Running Qwen3.6 27B on an RTX 5090, achieving 6.4k tokens per second after tuning MTP and cache settings, demonstrating optimization techniques for inference.

0 favorites 0 likes
← Back to home

Submit Feedback