MTPLX V1: The Swift App For Running & Creating MLX MTP Models (2x TPS Qwen 3.6 27B)

Hey Everyone! Around a month ago I brought native MTP to MLX with MTPLX V0.1. The CLI brought Qwen 3.6 27B from 28tps --> 63tps but was quite barebones. So after a ton of great feedback from this sub, I rebuilt it. **MTPLX V1 is now a native Mac app** (Swift) that bundles the whole engine and runs your models entirely on-device. One DMG, \~55MB, everything included. The CLI's all still there too. https://reddit.com/link/1u3iikl/video/4q72098mgr6h1/player What's actually new? **Forge:** the one I'm most excited about. The biggest complaint on the v0.1 post was that almost no MLX quants ship with their MTP heads, so there was basically nothing to run it on other than my own models. Forge fixes that: paste a Hugging Face link, it converts the model to MLX with the MTP heads wired up, then measures the *real* speedup on your own machine before you commit. **One-click serving:** Easy built in OpenCode, Hermes & Pi support, and any open api or anroptic api endpoint is also supported. **Built-in chat + live dashboard:** native performant streaming chat, plus a dashboard with the decode gauge, acceptance-by-depth, and the verify waterfall in real time, so you can actually watch what the speculative loop is doing. Built in benchmarking: for the fun of it, AIME 2026 is built into the app to check accuracy across models. One click run. **Smaller Macs:** V0.1 was honestly a bit of an M5 Max flex. v1 adds Qwen 3.5 9B and Gemma 4 (plus Qwen 3.6 MoE) so people on older or smaller machines can get in on it. Engine Upgrades: RAM+SSD KV cache so sessions survive restarts and restore near-instantly, kV cache quantisation, smart fan mode (ramps only on requests), continuous batching (AR only), bug fixes. The core is unchanged it's **mathematically exact at any temperature**. Leviathan–Chen rejection sampling with residual correction, verified at logits diff = 0.0 against plain autoregressive, at real temperature. Same output you'd get without MTP, just over 2x the speed. Not greedy-only like the other Apple Silicon spec-decode projects. Still open source, still solo-built. Apple Silicon only (macOS 14+). Site: [https://mtplx.com](https://mtplx.com) GitHub: [https://github.com/youssofal/MTPLX](https://github.com/youssofal/MTPLX) Would love feedback, bug reports and PRs. And if you publish MLX quants please keep the MTP heads in (or just run the repo through Forge). The more MTP-head models floating around, the better this gets for everyone. Thanks again to everyone here who pushed me on v0.1!