@LotusDecoder: DeepSeek-V4.1-Flash-0910 decode 400 token/s 😋 Would deploying this to my home DGX spark also achieve this speed?
Summary
A user on X/Twitter asks if deploying the DeepSeek-V4.1-Flash-0910 model on a home DGX Spark could achieve a decode speed of 400 tokens per second.
Similar Articles
@MiaAI_lab: DeepSeek v4 Flash has just been upgraded for your 2x DGX Sparks. 66.6 tokens per sec and up to 153.7 with 6 concurrent …
MiaAI Lab released an upgraded recipe for serving DeepSeek V4 Flash on two DGX Spark nodes using vLLM with DSpark speculative decoding and NVFP4 KV-cache, achieving up to 153.7 tokens per second with six concurrent sessions.
Deepseek V4 flash performance on DGX Spark
A Reddit user shares their experience running DeepSeek V4 Flash on a dual-ASUS GX10 DGX Spark setup, detailing performance metrics, configuration, and power consumption, with throughput benchmarks across various context lengths.
A 124B emitted 15,128 tokens in a single response on one DGX Spark, decode went 35.62 → 35.68 tok/s across the whole thing
An observation of Ling-3.0-flash (124B) on one DGX Spark generating 15,128 tokens in a single response with stable decode throughput around 35.6 tok/s, highlighting long-context decoding performance.
@RayFernando1337: How is DeepSeek v4.1 Flash this fast on 2 DGX Sparks??? This is a national security risk.
一位用户惊叹 DeepSeek v4.1 Flash 在 2 台 DGX Spark 上运行速度极快，并称其构成国家安全风险，凸显中国开源模型在紧凑硬件上的高效推理能力引发关注。
@ViC305: 18 HOURS LATER: DeepSeek-V4.1-Flash is now quantized to 4.75 bpw EXL3 for a 4× DGX Spark TP4 target. The weights are DO…
DeepSeek-V4.1-Flash has been quantized to 4.75 bpw EXL3 for deployment on 4× DGX Spark, optimizing memory usage and enabling efficient local inference with plans for validation and further optimization.