@lmstudio: Batching for vision models is now available in Beta with our latest MLX engine update The updated engine also brings ma…
Summary
LM Studio announces a beta update to its MLX engine, introducing batching for vision models and improved caching for faster inference.
View Cached Full Text
Cached at: 05/14/26, 06:42 PM
Batching for vision models is now available in Beta with our latest MLX engine update 👾
The updated engine also brings major improvements to caching for faster inference overall.
Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1. https://t.co/2SwoD52p6u
Similar Articles
@lmcache: 𝐋𝐌𝐂𝐚𝐜𝐡𝐞 𝐯𝟎.𝟓.𝟏 𝐢𝐬 𝐡𝐞𝐫𝐞! Release highlights: Model support — MiniMax M3 layer grouping via EngineKVForm…
LMCache v0.5.1 is released with new model support for MiniMax M3, new backends including AMD hipFile and XPU Docker, warm-prefetch across tiers, Device-DAX L1 split, hidden-state caching, and operator automation for vLLM integration.
@jun_song: The new engine for MLX is in its final stages of development. Just ran GLM-5.2 on a single MacBook (116GB) hitting 41.8…
Jun Song announces the final development stage of a new MLX engine, achieving 41.8 tok/s on a MacBook with a 256k context window and only ~4% quality loss, representing a significant performance improvement.
ExLlamaV3 Major Updates!
ExLlamaV3 has released a series of major updates including Gemma 4 support, improved caching efficiency, and the new DFlash technology for significantly faster inference speeds across various model categories.
@pcuenq: GLM 5.2 has just been released Here it's already running with MLX on two Mac Studios (M3 Ultra). This is comparable to …
GLM 5.2, an open-weight AI model comparable to top closed models, has been released and is now running on MLX on two Mac Studios (M3 Ultra).
Best local model for vision - 2nd benchmark update - 21 Jun 2026
This post presents the second update of a benchmark for local vision language models, comparing 23 models across 30 images with revised settings, and provides performance recommendations for different VRAM tiers. Key findings include that thinking mode hurts vision performance and that MoE models underperform dense models for perception tasks.