@RedHat_AI: Michael Goin (@mgoin_) walks through @vllm_project v0.20.0. 752 commits. 320 contributors. 123 new. DeepSeek V4, TurboQ…
Summary
Michael Goin reviews the vLLM v0.20.0 release, highlighting 752 commits and new features like DeepSeek V4 support, TurboQuant, and PyTorch 2.11 integration.
View Cached Full Text
Cached at: 05/11/26, 06:36 AM
Michael Goin (@mgoin_) walks through @vllm_project v0.20.0.
752 commits. 320 contributors. 123 new. 🚀 🎉
DeepSeek V4, TurboQuant 2-bit KV cache, MXFP4 for MoE on Blackwell, FA4 as MLA prefill default, @PyTorch 2.11 + CUDA 13.0, Transformers V5, and a lot more.
~8 minutes. https://t.co/Tdg1hIW4yk
Similar Articles
@vllm_project: vLLM v0.21.0 is out! 367 commits from 202 contributors (49 new). Highlights: KV Offload + HMA, spec decode with thinkin…
vLLM v0.21.0 has been released with KV Offload + HMA, speculative decoding with thinking budget for reasoning models, TOKENSPEED_MLA on Blackwell for DSR1/Kimi K2.5, Mooncake distributed KV, DeepSeek V4 pipeline parallelism, and a C++20 + Transformers v5 baseline.
vllm-project/vllm v0.21.0rc1
vLLM v0.21.0rc1 is a pre-release update for the high-performance LLM inference and serving library, featuring optimizations for throughput, quantization, and hardware support.
vllm-project/vllm v0.20.0
vLLM v0.20.0 is released, an open-source library for high-throughput LLM inference and serving, featuring PagedAttention and support for various hardware architectures.
@dbreunig: Big release with RLM improvements, optimization chaining, the start of LiteLLM decoupling, and 24 first-time contributo…
Major open-source release featuring RLM improvements, optimization chaining, and initial LiteLLM decoupling with 24 new contributors.
@mudler_it: LocalAI ( @LocalAI_API ) 4.2.0 is out, just few numbers and facts: - +392 commits ( we squash these ) - +11 Backends: v…
LocalAI 4.2.0 is released, featuring over 392 commits, 11 new backends including voice and face recognition, improved support for sglang and VLLM, and contributions from over 16 new developers.