I've created the fastest local AI engine for Apple Silicon. Optimised for agentic use.

Reddit r/LocalLLaMA 05/08/26, 02:27 AM Tools

apple-silicon local-ai coding-agents open-source mlx performance

Summary

The author announces the release of 'lightning-mlx', a local AI engine optimized for Apple Silicon that achieves high token speeds for coding agents and tool-calling workflows.

https://preview.redd.it/p0rqofxvrtzg1.png?width=1460&format=png&auto=webp&s=8ce5b18b4ddaad9b71f71fd8eb623839fc9c6c8b For weeks I've been working on creating the fastest local AI engine for Apple Silicon... And I finally did! It's optimized for agentic use. focused specifically on coding agents, tool calling, and short-turn workflows. Repo: [https://github.com/samuelfaj/lightning-mlx](https://github.com/samuelfaj/lightning-mlx) A few results from my Macbook Max M5 (128gb): * Qwen3.6-27B **40.67 tok/s** * Qwen3.6-35B-A3B **220.86 tok/s** I’d appreciate feedback on: 1. Better benchmark designs for local coding agents 2. Whether the MTPLX preset defaults make sense 3. Other Apple Silicon setups I should test

Original Article

Similar Articles

@jianchen1799: Local models can now handle agentic workloads. Local inference engines need to catch up. Today we’re releasing Splash: …

X AI KOLs Timeline

Inco AI releases Splash, an open-source inference engine optimized for Apple silicon, claiming up to 3× faster decode speeds for local model serving, enabling agentic workloads on devices like M5 Max MacBook Pro.

Optimizing On-Device Inference for Apple Silicon (20 minute read)

TLDR AI

Apple's Lily engine optimizes on-device LLM inference for Apple silicon by leveraging unified memory and hardware, outperforming MLX-LM, and is tuned for the Qwen3.6-35B-A3B model's architecture.

@awnihannun: Three MLX videos dropped at WWDC: Running agents locally by @angeloskath https://youtube.com/watch?v=wykPErJ8M-8… Distr…

X AI KOLs Following

Three MLX videos from WWDC demonstrate running AI agents entirely locally on Apple Silicon using the MLX stack, including local inference, tool calling, and distributed inference across Macs, enabling no-cloud, offline AI workflows.

@ddalcu: What a crazy last 4 days for local AI... insane... https://github.com/ddalcu/mlx-serve/releases/tag/v26.8.2… @liquidai …

X AI KOLs Timeline

A developer updates MLX-Serve, a fast local inference server for Apple Silicon, to support recent models like LiquidAI 2.6B, MiniMax H3 video generation, and DeepSeek V4 Flash, with AntLing 3.0-flash coming soon.

Local

Product Hunt

A new product called Local offers zero-friction local AI capabilities for Mac users, enabling easy on-device AI processing.