Updated benchmark: Deepseek V4 Flash on SlopCodeBench (local)

Reddit r/LocalLLaMA Models
deepseek benchmark local-inference quantization coding-llm

Summary

A user shares updated benchmark results for DeepSeek V4 Flash on SlopCodeBench using local quants (antirez imatrix quant) with the pi harness, showing improved performance over previous runs but still slower than the hosted API.

Howdy - I posted a benchmark here - https://www.reddit.com/r/LocalLLaMA/comments/1vbtiy7/deepseek_v4_flash_on_slopcodebench/ This was using the hosted API - since then I've been playing around with quants Here is the lastest benchmark - https://github.com/michaelasper/benchmarks/blob/main/deepseek-v4-flash-0731-pi-on-slop-code-bench.md This uses antirez q2-q4 imatrix quant - i switched from opencode to pi Very interesting results! Much slower on a macbook m5 max than the hosted API, but switching the harness made up for some of the intelligence lost Compared with the other reported runs Reported run Serving Harness Strict Isolated Core DeepSeek V4 Flash 0731 (run B) local quant (antirez, higher cap) pi 0.84.0 5/17 (29.4%) 6/17 10/17 Opus 5 hosted API Claude Code 4/17 (23.5%) — — DeepSeek V4 Flash hosted API OpenCode 1.18.10 3/17 (17.6%) 6/17 11/17 Opus 4.8 hosted API Claude Code 1/17 (5.9%) — — Sonnet 5 hosted API Claude Code 1/17 (5.9%) — — DeepSeek V4 Flash 0731 (run A) local quant (unsloth, misconfigured cap) pi 0.84.0 1/17 (5.9%) 1/17 2/17
Original Article

Similar Articles

Deepseek V4 Flash running on RTX 5090 MoE

Reddit r/LocalLLaMA

User shares optimization benchmarks for DeepSeek-V4-Flash (Q2_K) running on an RTX 5090 using a fork of llama.cpp, achieving 21.3 tokens/s generation and 1 million context size.

ISTA DeepSeek-V4.1-Flash-1017 GSQ-RCO quants comparison

Reddit r/LocalLLaMA

ISTA disputes Unsloth's published quantization comparisons for DeepSeek-V4.1-Flash-1017, arguing the performance gap comes from a 32K vs 128K reasoning-token budget rather than any hidden hyperparameter tuning, and invites independent reproduction of their benchmarks.