Perplexity open-sourced their Mac inference server for Qwen 3.6
Summary
Perplexity has open-sourced a Mac inference server optimized for the Qwen 3.6 model to achieve best performance on Apple Silicon.
Similar Articles
@LinusEkenstam: Quite a big deal. 1.35x faster inference than MLX-LM 1.23x faster at prefill having the hybrid option to pick from insi…
Perplexity has open-sourced Lily, a local inference engine optimized for Qwen3.6-35B-A3B on Apple Silicon, achieving 1.35x faster inference than MLX-LM.
Qwen3.8-27B is now up to ~3× faster on Apple Silicon with mlx-dspark
mlx-dspark v0.10.0 adds support for Qwen3.8-27B on Apple Silicon, providing up to 3x faster inference through speculative decoding with lossless verification.
Run Qwen3.8 27B locally: real numbers from my Mac Studio
The article provides real-world performance benchmarks for running the Qwen3.8 27B AI model locally on a Mac Studio, comparing it to its predecessor and discussing hardware requirements and quantization effects.
@LinusEkenstam: Local model in Perplexity Just in time for the Apple event next week, Perplexity once again shows the pathway forward f…
Perplexity introduces hybrid compute for its Mac app, enabling local model inference for sensitive data while offloading to the cloud, marking a trend towards transparent local AI usage.
Running Qwen3.5-122B on Mac Studio 96GB: Fixed 3 bugs that made long-context inference usable
Fixed three bugs in a qMLX fork for running Qwen3.5-122B on Mac Studio, reducing prefill time from minutes to sub-seconds for long-context inference; open-sourced the fork and benchmark script.