Is DeepSeek v4 (Flash) really extremely cheap to run? If yes, how?

Reddit r/LocalLLaMA Models

Summary

The user asks why DeepSeek v4 Flash (284B parameters) is so cheap to run compared to smaller models like Qwen 27B, questioning if it's due to pricing dumping or architectural differences. The answer likely involves its MoE architecture and efficient inference techniques.

Hi. I don't have a GPU. So my biggest "local LLM" experience has been running ~26B models with single-digits tps values. However, the "serving economy" of DSv4 models look like a riddle to me. The Flash model has 284B parameters, but providers (e.g. OpenRouter) charge so little for it it's ridiculous. It's for example cheaper than 27B Qwen, A tenth of its (total) size! How is it viable? Are the providers just doing dumping here? Or is DSv4 architecture somehow different in making it extremely cheaper to serve? Those of you who have had the equipment to host DSv4, is there something making it different? Thanks
Original Article

Similar Articles

deepseek-ai/DeepSeek-V4-Flash-0731

Simon Willison's Blog

DeepSeek released DeepSeek-V4-Flash-0731, a 304B parameter model with enhanced agentic capabilities, priced at $0.14/M input and $0.27/M output, punching above its weight and ranking as the best value-per-intelligence model according to Artificial Analysis.