@Ex0byt: Update: the road to GLM-5.2: we're getting there, folks! non-quantized, non-pruned DeepSeek-v4-Flash. 11tok/s on a sing…
Summary
Update on running a non-quantized DeepSeek-v4-Flash model at 11 tok/s on a single DGX Spark using sglang inference and a custom mega-kernel, progressing towards GLM-5.2.
View Cached Full Text
Cached at: 06/24/26, 12:23 PM
Update: the road to GLM-5.2: we’re getting there, folks! non-quantized, non-pruned DeepSeek-v4-Flash. 11tok/s on a single DGX Spark. sglang inference + custom mega-kernel. Pure beauty. https://t.co/vRpHIFHqOO
Similar Articles
Optimised DSv4-Flash for 2x GH200: 10,000 tok/s PP, >300 tok/s TG on SGLang
A detailed benchmark of DeepSeek V4 Flash on a dual GH200 workstation, comparing SGLang and vLLM at 1M context with DSpark speculative decoding, finding SGLang faster at ~317 vs ~276 tok/s.
@ViC305: 18 HOURS LATER: DeepSeek-V4.1-Flash is now quantized to 4.75 bpw EXL3 for a 4× DGX Spark TP4 target. The weights are DO…
DeepSeek-V4.1-Flash has been quantized to 4.75 bpw EXL3 for deployment on 4× DGX Spark, optimizing memory usage and enabling efficient local inference with plans for validation and further optimization.
For dual DGX spark users; GLM 5.3 flash got a 50%+ performance boost
A dual-DGX-Spark user reports that a new GLM 5.3 Flash recipe delivers a 50-90% decode speed boost, making it faster than DeepSeek v4.0 Flash while offering better reasoning quality on local hardware.
@MiaAI_lab: GLM 5.3 Flash on 2x DGX Sparks Look at the tok/s at the top :) This is prose. Releasing soon
GLM 5.3 Flash is an upcoming AI model that showcases high token-per-second performance on 2x DGX Spark systems, with an imminent release.
Benched a 124B on one DGX Spark for a week and published all of it — 38.7 tok/s on the fastest path he found, 2.4x DeepSeek V4 Flash on the same box
An independent benchmark by sudoingX shows the Ling-3.0-flash model runs at 38.7 tok/s on a single DGX Spark with official INT4 quantization, 2.4x faster than DeepSeek V4 Flash on the same hardware, after a correction clarifying the quants do work.