Strata is the shit

Reddit r/LocalLLaMA Tools
inference llama.cpp performance quantization gpu local-llm

Summary

用户分享使用 Strata 替换 llama.cpp 运行 Qwen 3.8 Flash Next 后，解码速度从 70-80 tk/s 提升至 150 tk/s，并顺带测试了 DeepSeek v4.1flash 2.25bit 量化在多 GPU 上的表现。

Have been using qwen 3.8 flash next with llamaserver. Was getting 70-80tk/s decode and was happy. Then read about strata and decided to give it a try. Decode shot up to 150 tk/s. Not sure what magic it's using? You should give it a try if you are still running qwen flash next on llamacpp. Also the tried DeepSeek v4.1flash 2.25bit and it's 70tk/s decode. Unsloth 6 bit quant 160k context 1 pro 6000 + 2 x 3090 256G ddr4
Original Article

Similar Articles

Strata + Qwen 3.8 Flash Next: fast, but what's it costing in quality?

Reddit r/LocalLLaMA

一位用户质疑 Strata 的高性能宣传：虽然 tokens per second 和针尖测试数据亮眼，但其剪枝专家（pruned experts）与量化是否牺牲实际输出质量尚未经过验证，建议用 llama.cpp 上的相同 GGUF 来对照测试。

Strata performance finetuning - try it out

Reddit r/LocalLLaMA

一位用户分享了对本地 LLM 推理工具 Strata 的深度性能调优经验，通过调整 --pcie-frac、--pool-workers、--trim-stage-weights、--pipeline-windows 等参数并在双 RTX 3060 上优化 GPU 优先级，实现了约 35 tps 到 60+ tps 的解码速度提升。

Strata with Qwen3.8 Flash Next UD-Q4_K_XL

Reddit r/LocalLLaMA

A user reports strong single-request decode speeds running Qwen3.8-Flash-Next in Unsloth's UD-Q4_K_XL quant on Strata with an RTX PRO 6000, showing roughly 2x faster throughput than vLLM on the same GPU across prose, counting, coding, and reasoning tasks.

@MinLiBuilds: https://x.com/MinLiBuilds/status/2107988055101685781

X AI KOLs Timeline

The author shares a complete guide for deploying Qwen3.8-Flash-Next (125B-A6B) on 12GB VRAM (RTX 5070) with Strata, achieving nearly 100 tok/s, and lets Ant Group's newly released Ling-3.1-flash Agent handle the entire workflow from scratch — machine check, download, installation, troubleshooting, and benchmarking.