Latest LM Studio update killed MTP performance
Summary
A user reports that the latest LM Studio update (0.4.17) eliminated the multi-token prediction speed boost, reverting to previous performance on an RTX 5090 setup.
Similar Articles
@lmstudio: MTP is available in LM Studio 0.4.14. Sound on.
LM Studio 0.4.14 introduces MTP (Multi-Turn Prompt) support, enhancing its local AI model capabilities.
LM Studio finally added support for MTP Speculative Decoding
LM Studio has added support for MTP speculative decoding in its latest beta update, improving inference speed for local LLMs.
Testing llama.cpp MTP support on Qwen3.6 - RTX 5090
A technical test of llama.cpp's new Multi-Token Prediction (MTP) support using Qwen3.6 models on an RTX 5090, comparing performance with and without MTP across different prompts and GGUF quantizations.
MTP (Multi-Token Prediction): 2x Faster Token Generation on AMD Strix Halo & Radeon 9700 AI Pro
MTP (Multi-Token Prediction) can accelerate LLM inference by 2x, especially for coding agents. This video demonstrates performance improvements with Qwen 3.6 on AMD Strix Halo and Dual Radeon 9700.
MTP+GGML_CUDA_ENABLE_UNIFIED_MEMORY=1 - llama.cpp
A user benchmarks token generation speed on llama.cpp with the GGML_CUDA_ENABLE_UNIFIED_MEMORY=1 flag, comparing performance with and without MTP (Multi-Token Prediction). Results show a significant speedup from 49 tok/s to 64 tok/s when MTP is enabled on an RTX5090 with a Qwen3.6-27B model.