@Michaelzsguo: So you bought the 128GB MacBook Pro. Now the question is not, “Which local model gets the highest TPS?” It is: which se…
Summary
This thread recommends a local AI coding stack for the 128GB MacBook Pro, using Qwen 3.6 model with MLX server and specific configurations for reliable coding assistance.
View Cached Full Text
Cached at: 05/17/26, 08:24 PM
So you bought the 128GB MacBook Pro.
Now the question is not, “Which local model gets the highest TPS?”
It is: which setup can I actually trust to get the job done?
This is the local coding stack I’d start with: Qwen 3.6, dense 27B, Q6 quant, MLX server, 8192 output tokens, 20GB prompt cache, and deterministic decoding.
If Anthropic’s success story tells us anything, it is that once you figure out coding, you can expand into almost anything else.
Local models stop being a hobby when they can finish the patch.
spot on! it’s very subjective thing. even I can do a benchmark like this (I did that one on A100, maybe I should do it on my mac too)
totally. my codex-qwen works fine, though a little slower. I really think we will only get better from here.
try the same but probably slightly smaller prompt cache say 8GB. please let us know how it works.
Similar Articles
Is it worth getting 128GB MacBook Pro? Will it ever be comparable to today’s frontier models for coding?
A developer questions whether a high-RAM MacBook Pro for local AI models could match cloud frontier models like Claude for coding, considering long-term costs.
@remilouf: Following @julien_c’s tweet I bought a MacBook Pro with 128B unified memory, and started running Qwen3.6 as my daily dr…
The author shares their experience running the Qwen3.6 model on a MacBook Pro with 128GB of unified memory, praising Apple's hardware efficiency for local AI inference.
Localmaxxing (3 minute read)
The article analyzes the viability of running AI inference locally on a MacBook Pro, comparing a local Qwen 35B model against the cloud-based Claude Opus 4.5. It concludes that local models are 2x faster for routine tasks, making them a practical choice for half of daily workloads despite a slight capability gap.
@julien_c: and is Apple Silicon the King of Local AI?
Discussion on whether Apple Silicon is the best hardware for running local AI models, referencing a linked article or thread.
@Xudong07452910: A hot comment section on Hacker News: Qwen 3.6 27B is the ideal choice for local development. Key findings: dense parameter model, native support for 256k context, running Q8_0 quantized version at 30 tokens/…
Qwen 3.6 27B is a dense 27B model that achieves impressive performance on local hardware with 256k context, running at 30 tokens/s on MacBook Max M5 and 50 tokens/s on RTX 5090, and is considered by some as the first local model with true general intelligence.