NInfer RTX 4090 for Qwen 3.8 27B update - up to 250-350K tokens context in VRAM

Reddit r/LocalLLaMA Tools

Summary

The author has updated their NInfer fork with rk2v4-e8 quantization for the KV cache, enabling up to 250-350K tokens context on a single RTX 4090 without system RAM spill and with optimizations for faster generation speeds.

I've made some improvements to my fork of NInfer, adding rk2v4-e8 quant option for the KV cache, which can reach up to 250-350K tokens of context window depending on the configuration like vision, MTP, etc, on my single RTX 4090 without spilling over into system RAM. On lower context window runs, I also made some optimizations to reach about 80-160 tokens / second generation speeds for repetitive workloads like code, math, etc. Let me know if there are any obvious runtime issues, so far it seemed to survive the chaotic workloads I threw at it. Hopefully the mods won't nuke it in favor of the megathread this time, it gets lost pretty quickly there. Sources: https://github.com/UDPSendToFailed/ninfer-4090
Original Article

Similar Articles