@ivanfioravanti: For anyone wandering what does it mean to run ds4-agent locally on an M5 Max using DeepSeek V4 Flash q2-imatrix gguf mo…
Summary
A demo of running ds4-agent locally on an M5 Max with DeepSeek V4 Flash q2-imatrix gguf model, showing self-updating capabilities and integration with HF_HOME for gguf models.
View Cached Full Text
Cached at: 05/24/26, 12:17 AM
For anyone wandering what does it mean to run ds4-agent locally on an M5 Max using DeepSeek V4 Flash q2-imatrix gguf model.
Here’s a video of ds4 updating itself, adding a way to leverage HF_HOME for gguf models.
Future of Local AI is bright! https://t.co/CIceef3LWq
Similar Articles
@BrianRoemmele: Another day and another full frontier model running on your computer. Been teething DeepSeek V4 Flash on over 60 employ…
Brian Roemmele reports that DeepSeek V4 Flash (304B, 1M context) now runs locally on Apple Silicon via the ds4 engine, sharing GGUF quantized builds with a fresh imatrix. The Hugging Face repo provides installation instructions and notes that these files are ds4-specific, not for llama.cpp.
@antirez: Cool use case
A user reports that running Hermes Agent as a game master using DeepSeek V4 Flash locally on M3 Ultra yields nearly identical quality to the online version.
@MiaAI_lab: Btw it looks like running the new DeepSeek v4 Flash through the Hermes agent is the way to go. The output files are bet…
The tweet suggests that running DeepSeek v4 Flash through the Hermes agent yields better output files than any other harness tested.
@mishig25: M3 Max users really got local AGI before GTA VI
M3 Max users really got local AGI before GTA VI https://t.co/AfaFukk6jR --- # antirez/deepseek-v4-gguf · Hugging Face Source: [https://huggingface.co/antirez/deepseek-v4-gguf](https://huggingface.co/antirez/deepseek-v4-gguf) ## [https://huggingface.co/antirez/deepseek-v4-gguf#deepseek-v4-flash--gguf-for-ds4](https://huggingface.co/antirez/deepseek-v4-gguf#deepseek-v4-flash--gguf-for-ds4)DeepSeek V4 Flash — GGUF for ds4 This quants are specific for the DS4 inference engine\. They may work with ot
antirez/deepseek-v4-gguf
Antirez released GGUF quantizations of DeepSeek V4 Flash specifically tailored for the DS4 inference engine, providing optimized configurations for different RAM sizes and enabling local execution of the large MoE model.