Is DeepSeek v4 (Flash) really extremely cheap to run? If yes, how?
Summary
The user asks why DeepSeek v4 Flash (284B parameters) is so cheap to run compared to smaller models like Qwen 27B, questioning if it's due to pricing dumping or architectural differences. The answer likely involves its MoE architecture and efficient inference techniques.
Similar Articles
Deepseek v4 Flash is pretty amazing, about to buy a $25k computer
The author praises DeepSeek V4 Flash for enabling high-performance local LLM deployment, leading to a $25k hardware purchase to serve clients with strict data privacy needs.
Deepseek price hike - Flash was the one genuinely cheap model that didn't suck. That's the part that worries me about V4.
Deepseek has raised prices for its Flash model, which was previously the only genuinely cheap and capable option. This price change raises concerns about the upcoming V4 model.
@ciruai: Testing DeepSeek v4 Flash on the AMD Ryzen AI Max+ 395 Strix Halo with 128GB RAM. Getting ~15 TPS over a decently long …
Testing DeepSeek v4 Flash on the AMD Ryzen AI Max+ 395 with 128GB RAM achieves ~15 TPS for a 284B MoE model (13B active) locally, costing $3,000 versus $25,000+ for a datacenter setup, highlighting the feasibility of running large models on consumer hardware.
Deepseek V4 Flash running on RTX 5090 MoE
User shares optimization benchmarks for DeepSeek-V4-Flash (Q2_K) running on an RTX 5090 using a fork of llama.cpp, achieving 21.3 tokens/s generation and 1 million context size.
deepseek-ai/DeepSeek-V4-Pro-DSpark
DeepSeek releases preview versions of its V4 series, including DeepSeek-V4-Pro (1.6T parameters, 49B activated) and DeepSeek-V4-Flash (284B parameters, 13B activated), both supporting a one-million-token context and featuring hybrid attention, manifold-constrained hyper-connections, and a Muon optimizer.