@AlexJonesax: Qwen3.6-27b absolutely flying on a M5Max with MTP enabled & oMLX inference.
Summary
A community report highlights high inference performance for the Qwen3.6-27b model on M5Max hardware using oMLX optimization.
View Cached Full Text
Cached at: 05/11/26, 12:43 PM
Qwen3.6-27b absolutely flying on a M5Max with MTP enabled & oMLX inference. https://t.co/pc52oqga78
Similar Articles
MLX engine comparison… and oMLX is the top choice.
A blog post comparing MLX inference engines, concluding oMLX as the top choice, with benchmarks on M5 Max 64GB using Qwen3.6-35B-A3B-4bit.
@Youssofal_: 72+ TPS on Qwen 3.6 27B on a Macbook pro M5 max. MTPLX V2 out now! The fastest way to run models on MLX.
MTPLX V2 is released, claiming 72+ tokens per second on Qwen 3.6 27B running on a Macbook Pro M5 Max via MLX.
I added native MTP to exo for Qwen3.6 MLX models; here are the exactness and speed results
Added native multi-token prediction (MTP) support to the exo local inference tool for Qwen3.6 MLX models, achieving up to 2x speedup on 27B models on an M5 Max laptop while maintaining exactness.
Qwen3.6 27B on a 5090, 6.4k sample tok/s distribution after tuning MTP/cache settings
Running Qwen3.6 27B on an RTX 5090, achieving 6.4k tokens per second after tuning MTP and cache settings, demonstrating optimization techniques for inference.
@alexocheema: Running Qwen3.6 35B (vision) on 2 x M5 Max MacBook Pro with RDMA over Thunderbolt 5. It describes the image and identif…
A demo shows Qwen3.6 35B vision model running across two M5 Max MacBook Pros connected via RDMA over Thunderbolt 5, achieving near-instant responses with prefix caching. The model correctly identifies Apple Park but misidentifies a person in the image.