Ling 3.0 Flash on Strix Halo

Reddit r/LocalLLaMA Models

Summary

Tweet reports that Ling 3.0 Flash on AMD Strix Halo is significantly faster than Qwen-122b using ROCm-optimized formats, but notes tool calls are broken in certain harnesses.

vLLM ROCm/HiP, 4 bit compressed-tensors (int4) Not a fair comparison, but Qwen-122b on the most optimized format possible I have run (rocmFP4) does not touch Ling in speed. https://x.com/ciruai/status/2085996633267777554?s=46 Tool call is broken in certain harnesses. It works well with pi-type harnesses (omp, feynman). Has anyone noticed this?
Original Article

Similar Articles

Strix Halo ROCm + MTP Notes (May 2026)

Reddit r/LocalLLaMA

Technical benchmark comparing ROCm and Vulkan backends for LLM inference on Strix Halo hardware after MTP merged into llama.cpp, revealing ROCm suffers severe performance drops at full context while Vulkan remains stable.