@AlexJonesax: Qwen3.6-27b absolutely flying on a M5Max with MTP enabled & oMLX inference.
Summary
A community report highlights high inference performance for the Qwen3.6-27b model on M5Max hardware using oMLX optimization.
View Cached Full Text
Cached at: 05/11/26, 12:43 PM
Qwen3.6-27b absolutely flying on a M5Max with MTP enabled & oMLX inference. https://t.co/pc52oqga78
Similar Articles
Running Qwen 3.6 35B MoE (Q4_K_M) on a Zeus (Xiaomi 12 Pro, 12GB RAM)
Demonstrates running the Qwen 3.6 35B MoE model in Q4_K_M quantization on a Xiaomi 12 Pro with 12GB RAM, showing local AI inference on a mobile device.
MLX engine comparison… and oMLX is the top choice.
A blog post comparing MLX inference engines, concluding oMLX as the top choice, with benchmarks on M5 Max 64GB using Qwen3.6-35B-A3B-4bit.
Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro
Inco Splash is an open-source inference engine optimized for Apple silicon, offering significant speed improvements for running AI models like Qwen3.8-27B on M-series MacBooks.
@Youssofal_: 72+ TPS on Qwen 3.6 27B on a Macbook pro M5 max. MTPLX V2 out now! The fastest way to run models on MLX.
MTPLX V2 is released, claiming 72+ tokens per second on Qwen 3.6 27B running on a Macbook Pro M5 Max via MLX.
Qwen3.8-27B Q8_0 on Strix Halo is seriously impressive
The author tested the Qwen3.8-27B Q8_0 AI model on a ROG Flow Z13 with Ryzen AI Max+ 395, achieving impressive local inference performance in generating a flight simulator using Lemonade Server and llama.cpp with speculative decoding.