Tag
A user tested how far the AMD Radeon R9700 Pro's power limit can be lowered (100W-300W) while running llama.cpp with ROCm, finding performance stays near-linear down to 180W and throughput only drops below 140W, allowing much quieter fan operation.
AMD publishes an AI Playbook guiding developers through running LLMs like gpt-oss-20b and qwen3.5-4B locally with PyTorch and ROCm, including memory configuration on Windows and Linux and building a document summarizer.
AMD Loom, an experimental inference stack with runtime, kernel compiler and server, added Radeon 9700 support and was benchmarked on 48 LLMs, showing an average 42% speedup over llama.cpp in prefill and decode.
A developer compares running Qwen3.8-Flash-Next locally (UD-Q4_K_XL on llama-server with ROCm) against Claude Opus in Claude Code for reviewing a real Swift commit: Qwen produced 8 findings with zero false positives and caught 2 issues Claude missed, but missed 5 others, making it a solid private first-pass reviewer rather than a final authority.
AMD released the ROCm HRX Loom SDK v0.1, a specialized compiler and IR stack that targets AMD CPUs, GPUs, and NPUs, with support for AMDGPU HSA, SPIR-V/Vulkan, and emerging x86/WebAssembly backends.
作者将 adaptive KV streaming 从 CUDA 移植到 ROCm/HIP,并结合 RDNA 4 内核优化,使 Qwen3-27B (IQ4_XS) 能在单张 16GB RX 9070 XT 上以完整 262k 上下文运行,MTP 解码达到 80+ t/s。项目包含大量内核级优化与功耗调优结果,已发布到 GitHub 分支。
一位用户分享了对新发布的 LiquidAI LFM2.5-24B-A2B 模型的实测体验,称其在 llama.cpp + ROCm 上可达约 95 tps,Q8 量化占 30GB 显存并支持 128k 上下文,在 Pi Agent 工作流中表现稳定可靠。
rdna35-perf branch of strix-llama.cpp 为 Strix Halo (Radeon 8060S) 带来新的 RDNA3.5 flash attention 与 GEMM 内核优化,prompt processing 比 Vulkan 快 21–54%,在 128k 长上下文下比原版 ROCm 最快达 2.7 倍,且输出质量与原版 ROCm 基本一致。
Developer helped speed up ROCmFPX, a llama.cpp fork, on AMD Strix Halo (Ryzen AI Max+ 395), achieving major prefill and decode speedups with 16 merged PRs and improved quantization accuracy.
ROCmFPX 的 llama.cpp 下游项目更新了投机解码的草稿词表实现,改为按序列存储候选集并默认启用(16384 行),将候选行数从 248K 降至 16K,令牌生成速度提升约 11.4%(35.14/35.31 → 39.18/39.32 tok/s)。
MTP 投机解码的草稿 LM head 原本每步都要读取 1.27 GB 的 BF16 权重,现改为 Q4_0 量化草稿头(验证与正常解码仍用 BF16),实现约 10.6% 的 token/s 提升,且 greedy 输出 md5 完全一致。相关改动已在 ROCmFPX 的 PR #49 中提交。
ROCmFPX 的融合 HC norm 内核通过在寄存器中直接写出 Q8_1 副本,省去了 MMQ 重复量化 335MB 数据的开销,在 2.3%–3.6% 的 pp8192 性能提升下保持位级一致。
ROCmFPX's gated delta net prefill kernel was optimized to process 16-token chunks via RDNA3 WMMA instead of one token at a time, cutting latency from 772µs to 610µs per 512-token call and improving prompt-processing throughput by ~2-4% across configurations, with Strix Halo testing ongoing.
ROCmFPX 更新了融合 HC norm 的匹配器,使其能识别 qwen4exp 将 REPEAT/MUL/ADD 合并为单一 op 的组合,从而将 HC 内核每 2048 token 耗时从 416 ms 降至 175 ms。相关修复还解决了导致 llama-perplexity 崩溃的 xn 别名问题,并在 BF16 拷贝路径上移除了变慢的 Q8_0 MMB down proj。
ROCmFPX 解决了预填充阶段 MMQ 阻塞问题,通过寄存器路径将 Q4_0_ROCMI4 权重反量化为 BF16 WMMA GEMM,在 Qwen3.8 Flash Next HC-Q8 上实现 ub 512 约 13%、ub 1024 约 23% 的吞吐提升,稀疏专家处理时间从约 2.3 秒降至 1.8 秒。
ROCmFPX 修复了在 AMD Strix Halo (gfx1151, ROCm 7.2.1) 上统一内存与 HIP 图捕获导致 top_k 中 hipMemcpy2DAsync 未执行、使 Qwen3.8 Flash Next logits 静默变为垃圾的问题,修复后 KLD 从约 8 降至 0.005,top-1 准确率恢复到 97% 以上且基准速度不受影响。
GNU Guix 正式将 AMD 的 HIP 与 ROCm 生态作为一等公民支持,使在 Guix 中进行 AMD GPU 计算栈的功能化打包与部署更加顺畅。
AMD 发布 ROCm 10.1,重点突破数据搬运瓶颈,通过 AMD Infinity Storage (hipFile)、HIP 运行时的 NUMA 感知内存分配以及 ROCm CLI 和 AMD Skills 等开发者工具提升 GPU 数据传输与训练推理效率。
Yamz Labs released Kyojin, a ROCm inference engine built on ExLlamaV3 for AMD Strix Halo, enabling two ~300B-class MoE models (GLM-5.3-Flash and MiMo-V2.6-Flash) to each fit and run on a single 128 GB mini PC, with EXL3 quantized weights hitting up to 580 tok/s prefill and 44 tok/s speculative decode.
AMD's Ryzen AI Developer Platform OS has been updated to ROCm 10.0 with Linux 7.2, advancing its open software stack for AI development on Ryzen AI hardware.