Bartowski has delivered DS4 GGUF
Summary
Bartowski has released a GGUF quantized version of DeepSeek-V4-Flash, inviting comparison with Antirez's version.
Similar Articles
Antirez Deepseek 4.1 flash gguf on HF
Antirez has uploaded the quantized gguf version of Deepseek 4.1 flash model to Hugging Face, with partial availability and questions on usage.
antirez/deepseek-v4-gguf
Antirez released GGUF quantizations of DeepSeek V4 Flash specifically tailored for the DS4 inference engine, providing optimized configurations for different RAM sizes and enabling local execution of the large MoE model.
Deepseek V4 Flash 2, 3 and 4 bits GGUFs
GGUF quantizations of DeepSeek V4 Flash in 2-bit, 3-bit, and 4-bit precisions, made available on Hugging Face for local inference with tools like llama.cpp and Ollama.
unsloth/DeepSeek-V4-Flash-0731-GGUF
Unsloth teases the upcoming release of DeepSeek V4 Flash GGUF quantized model on Hugging Face.
Introducing DeepSeek-V4.1-Flash-1017 Dynamic v3.1 Unsloth GGUFs
Unsloth 发布 DeepSeek-V4.1-Flash-1017 Dynamic V3.1 (preview) GGUF 量化模型，宣称在 7 项基准上精度保持优于 ISTA 的 GSQ-RCO GGUFs，并公开了无法复现对方 AIME25 100% 精度恢复声明的对比结果。