@antirez: DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters.
Summary
DeepSeek v4 PRO, a 1.6 trillion parameter model, is running via SSD streaming on a 128GB MacBook m5 max, demonstrating local inference of a massive model.
View Cached Full Text
Cached at: 06/05/26, 09:10 AM
DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters. https://t.co/rokyvu16Ut
Similar Articles
DeepSeek-V4-Flash 284B on 5.3GB of memory
A developer showcases Mference, a new inference engine that runs MoE models like DeepSeek-V4-Flash on just ~5.3GB of memory by streaming experts from SSD, with a native Mac app and OpenAI-compatible server.
You can run Deepseek 4 flash on mac (M3 Max, 96gb)
A guide on running DeepSeek 4 flash on a Mac M3 Max with 96GB RAM using Antirez's ds4 engine and SSD streaming, achieving ~12 tokens/second inference speed.
@antirez: I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit qua…
Antirez reports that DeepSeek v4 PRO runs well on a Mac Studio M3 Ultra with 512GB RAM using 2-bit quantization, achieving 130 t/s prefill and 13 t/s generation.
@svpino: DeepSeek-V4-Flash running at 5.71 token/s on a Mac M5 Pro. Every day, we get better models running on consumer hardware…
The tweet highlights DeepSeek-V4-Flash running at 5.71 tokens per second on a Mac M5 Pro, emphasizing advancements in local AI inference on consumer hardware, with a mention of Tencent's open-source Palm-Infra for Apple Silicon optimization.
I have (even faster) DeepSeek V4 Pro at home
A user reports successfully running the DeepSeek V4 Pro model locally using ktransformers and sharing detailed benchmark results across various context depths, demonstrating improved inference speeds.