Qwen3.8-27B is now up to ~3× faster on Apple Silicon with mlx-dspark
Summary
mlx-dspark v0.10.0 adds support for Qwen3.8-27B on Apple Silicon, providing up to 3x faster inference through speculative decoding with lossless verification.
Similar Articles
Qwen3.6-35B-A3B-Abliterated-Heretic-MLX-4bit
The user reviews a quantized and fine-tuned version of the Qwen3.6-35B model optimized for Apple Silicon via MLX, praising its speed, intelligence, and lack of safety disclaimers.
Meta's Muse Glimmer 30B now runs up to ~3.3x faster on Mac with mlx-dspark
A developer reports running Meta's Muse Glimmer 30B up to ~3.3x faster on Apple Silicon using speculative decoding in mlx-dspark, with byte-identical output and no quality tradeoff.
@_ARahim_: DeepSeek's DSpark speculative-decoding drafters, benchmarked on a Mac Native on Apple Silicon (MLX), lossless; identica…
mlx-dspark brings DeepSeek's DSpark and z-lab's DFlash speculative decoding drafters to Apple Silicon via MLX, enabling lossless speedup (~1.4–1.6×, up to 2× on code/math) and an OpenAI-compatible API for local inference.
Qwen3.6-27B speculative decoding gets better on heavier quants
Qwen3.6-27B model shows improved speculative decoding performance when using heavier quantization levels, enhancing inference efficiency.
@neural_avb: I am working on porting SAM models and harness into Apple silicon. Already seeing 1.25x inference speed increase on mlx…
Porting SAM 2.1 models to Apple silicon with MLX, achieving 1.25x inference speed increase on the small model, with quantized versions planned.