NInfer day0 support for Qwen3.8 27b: ~200 tok/s generation, with tons of engine improvments

Reddit r/LocalLLaMA Tools

Summary

NInfer adds day-0 support for the Qwen3.8-27B model, achieving around 200 tokens per second on a single RTX 5090 with speculative decoding, and includes engine improvements like concurrent requests and kernel optimizations.

Qwen3.8-27B is finally here, and NInfer already has Day-0 support! Weights: https://huggingface.co/neroued/Qwen3.8-27B-NInfer Just update to the latest source and give it a try. On a single RTX 5090, NInfer can still reach around 200 tok/s generation with speculative decoding. NInfer has also improved a lot since my last post. Now NInfer supports up to 8 concurrent requests, with a shared paged KV cache pool, each request can still use the full context length. I aslo implemented ReplaySSM for GDN + speculative decoding, which greatly reduces the recurrent-state memory overhead under concurrency, and this is also something vllm does not yet fully supported. There have also been many cuda kernel optimizations, as well as usage of PDL to further reduce latency. Feedback and bug reports are always welcome, I'll try to fix issues as soon as possible!
Original Article

Similar Articles

Ternary Qwen3.6 27B Tested on 3090!

Reddit r/LocalLLaMA

User tests ternary quantized Qwen3.6 27B on an RTX 3090, achieving 60 tk/s with two slots and 100k KV cache using 21GB VRAM, with good quality and stable tool calls.