@Prince_Canuma: Gemma 4 + = brrr Next MLX-VLM release will be packed with improvements! Here is an initial preview of Eagle3 speculativ…
Summary
Next MLX-VLM release includes improvements with a preview of Eagle3 speculative decoding for Gemma 4 models.
View Cached Full Text
Cached at: 05/13/26, 10:26 PM
Gemma 4 + 🦅 = brrr
Next MLX-VLM release will be packed with improvements!
Here is an initial preview of Eagle3 speculative decoding.
@googlegemma @RedHat_AI https://t.co/B9Ysi9VkK4
Similar Articles
Gemma4-12B-QAT Uncensored Balanced is out with MTP (~60% speed boost)!
Release of Gemma4-12B-QAT Uncensored Balanced, a fine-tuned uncensored model with a multi-token-prediction draft head for ~60% faster speculative decoding, optimized for llama.cpp and offering vision support.
New Gemma 4 MTP on MLX?
Google released Multi Token Prediction drafters for Gemma 4 to accelerate inference via speculative decoding, but support for MLX is currently unconfirmed or unavailable.
vllm-project/vllm v0.19.1rc0: [Misc] Clean up Gemma4 implementation (#38872)
vLLM v0.19.1rc0 release includes cleanup of Gemma4 implementation as part of routine maintenance and optimization of the popular open-source LLM inference and serving library.
ExLlamaV3 Major Updates!
ExLlamaV3 has released a series of major updates including Gemma 4 support, improved caching efficiency, and the new DFlash technology for significantly faster inference speeds across various model categories.
More Gemma 4 models incoming
Google announces that more Gemma 4 models are coming, potentially including a 120B parameter model.