Llama.cpp B9406 MTP mmproj fix
Summary
Llama.cpp release B9406 fixes a crash (GGML_ASSERT) when using MTP with MoE vision models like Qwen3.6-35B-A3B.
Similar Articles
MTP released for Qwen3.8-Flash-Next-GGUF
MTP has been released for the Qwen3.8-Flash-Next-GGUF model, providing detailed instructions on integration with inference tools like llama.cpp, vLLM, and Ollama for deployment.
@victormustar: llama.cpp with MTP support makes local models fast enough to use as daily drivers Qwen3.6-27B dense generation (on A10G…
llama.cpp adds MTP support for Qwen3.6 models, boosting generation speed by 78% on A10G hardware, making local models viable as daily drivers.
llama.cpp v0.6.0 released with MTP speculative decoding for Qwen4Exp and lots more
llama.cpp v0.6.0 获得正式发布，新增对 Qwen4Exp 的 MTP（Multi-Token Prediction）推测解码支持以及大量其他改进。
qwen4exp fixes in llama.cpp
This article reports recent bug fixes and updates in llama.cpp for the Qwen Flash Next model, advising users to update their builds frequently.
llama.cpp MTP speculative simplified for July 2026 big wins on dense models, underwhelming on MoE
An analysis of native MTP speculative decoding in llama.cpp shows significant speedups (1.4x-2.2x) for dense models like Qwen3.6-27B, but underwhelming results on MoE architectures, where gains are minimal due to already low per-step overhead.