Tag
Running the DeepSeek-V4-Flash-Vision-Exp 285B MoE model on 10-12x RTX 3090 GPUs achieves over 60-120 tok/s decode speeds with vision and tool support, fully documented for reproducibility.
SGLang now integrates DSpark, a confidence-driven speculative decoding method that verifies only confident draft tokens, improving inference efficiency under load.