Software developers appreciation post

Reddit r/LocalLLaMA Tools
open-source vllm context-window oom-fix gratitude qwen 5090

Summary

A user expresses gratitude to open source developers, highlighting vllm's recent major releases that fixed OOM issues, allowing doubling of context window size to 240k on a 5090 with Qwen 27B.

Im on the bus to work and just felt like i dont see enough grattitude for the men, women, children, and people who contribute thier time and effort on open projects. Just last night i saw ive been sleeping while vllm developers are releasing 3 new major releases, and not only that, the issues with OOM caused by preallocations and tuning seem to be gone!!!amazing!! Just fixing that bug has allowed me to double my context window size 120k to 240k with qwen27b on 5090. So this is just a reminder to support open source developers, infrastructure, and update your software. When we work honestly in the open, software gets better to use over time, not worse. Its never easy and can be very emotionally difficult for all involved ( contributors feeling like they are not welcome even tho they are just trying to help, and maintainers burned out by everyone acting like the maintainer owes them something ) So all in all remember to have respect and grattitude, because open software really does keep the world turning. I hope to see more as my generation starts saving/aging thier way out of the rat race.
Original Article

Similar Articles

Qwen3.6 27B more dumb in vLLM compared to llama.cpp

Reddit r/LocalLLaMA

A user reports that the Qwen3.6-27B model performs better and more reliably with llama.cpp than with vLLM, citing tool call errors and 'lobotomized' behavior in vLLM despite extensive configuration.