Hy4-Flash is great and finally some model is competing with DSv4-Vision-Exp and Qwen3.8-27B-Uncensored !

Reddit r/LocalLLaMA Models

Summary

A local LLM enthusiast reports that Hy4-Flash (Q3_K GGUF quant) is performing strongly on their benchmark, competing with DSv4-Vision-Exp and surpassing Qwen3.8-27B-Uncensored, while sharing llama-server config and performance numbers on a 2xRTX3090 setup.

Upd UTC+0 01:24: with more evaluations, Qwen3.8-27B Uncensored is left behind. It is going to be my goto model, I guess. Despite being slower, it finishes answers with less tokens. I've ran it on my benchmark, it is far from finished, but it is on the way on topping it: https://beta.locallm.top/home?apples_to_apples=1&include_unavailable=0&template_limit=15 My 2xRTX3090 + 128 GB DDR4 RAM presets file excerpt (used in llama-server router mode): [Hy4-Flash-Q3] load-on-startup = true hf = AngelSlim/Hy4-flash-GGUF:Q3_K ctx-size = 131072 ctk = q8_0 ctv = q8_0 no-mmproj-offload = true fit = off cmoe = true moe-cache-mib = 33768 load-mode = none Which translates into llama-server command ./build/bin/llama-server -hf AngelSlim/Hy4-flash-GGUF:Q3_K --ctx-size 131072 -ctk q8_0 -ctv q8_0 --no-mmproj-offload -cmoe --moe-cache-mib 33768 -load-mode none If you wonder what is the --moe-cache-mib 33768, then it is expert streaming (llama.cpp feature inspired by Strata I guess). I get PP ~60-65 tps, TG ~ 20-24 tps. Nov 19 00:56:05 builder llama-server[1270042]: [54519] 397.49.817.617 I slot print_timing: id 0 | task 442246 | prompt processing, n_tokens = 4091, progress = 1.00, t = 63.38 s / 64.54 tokens per second Nov 19 00:56:10 builder llama-server[1270042]: [54519] 397.54.518.918 I slot print_timing: id 0 | task 442246 | n_gen = 100, tg = 21.95 t/s, tg_3s = 22.18 t/s I am using https://huggingface.co/AngelSlim/Hy4-flash-GGUF Q3_K quant and llama.cpp PR https://github.com/ggml-org/llama.cpp/pull/32517 , it rebased on the master fine.
Original Article

Similar Articles

I don't get the qwen 3.8 flash next hype

Reddit r/LocalLLaMA

A community member reports that Qwen 3.8 Flash Next (UD-Q4_K_XL on 4x RTX 3090s) underperforms the Qwen 3.8 27B Q8 in a Tetris-building coding task, producing bugs and failing to deliver a playable .exe in Strata despite faster generation speeds, challenging the hype around the smaller model.

Hy4-flash first impression: it's got AMAZING coding taste

Reddit r/LocalLLaMA

A developer shares early first impressions of the Hy4-flash model for Python coding, praising its clean, well-organized output and sensible design choices compared to DeepSeek 1017 and Qwen3.8-Flash, while noting extremely low OpenRouter usage costs.