Tag
A hands-on benchmark comparing four local LLM inference engines (oMLX 0.7.0, Rapid-MLX 0.15.5, Splash 1.2.1, MTPLX 2.12.2) on a 36 GB M3 Max MacBook Pro, finding Rapid-MLX fastest on Qwen3.6-35B-A3B (~110 tok/s) and Splash fastest on dense Qwen3.8-27B (~31.7 tok/s via speculative decoding).
A guide on running DeepSeek 4 flash on a Mac M3 Max with 96GB RAM using Antirez's ds4 engine and SSD streaming, achieving ~12 tokens/second inference speed.