Tag
A user expresses gratitude to open source developers, highlighting vllm's recent major releases that fixed OOM issues, allowing doubling of context window size to 240k on a 5090 with Qwen 27B.