AA-AgentPerf: Vera Rubin leads on inference energy efficiency

Reddit r/singularity News

Summary

Artificial Analysis 的 AA-AgentPerf 基准通过回放真实编码 agent 轨迹测试推理硬件能效,结果显示 NVIDIA Vera Rubin 在几乎所有速度档位上均居前沿首位,领先于 DeepSeek V4 Flash/Pro、Kimi K3 和 GLM-5.2/5.3 等模型的测试配置。

Artificial Analysis's AA-AgentPerf benchmarks inference hardware by replaying real coding-agent trajectories, which include long contexts, tool-call pauses and heavy KV-cache reuse. It plots total server throughput per megawatt of GPU-only power against p25 per-request output speed. Across all four tested models (DeepSeek V4.1 Flash, DeepSeek V4 Pro 0813, Kimi K3 and GLM-5.2/5.3), NVIDIA's Vera Rubin sits on top of the frontier at nearly every speed.
Original Article

Similar Articles

AA-AgentPerf-Local: Benchmarking local AI agents on laptops and workstations

Reddit r/LocalLLaMA

Artificial Analysis open-sources AA-AgentPerf-Local, an inference benchmarking tool that replays real agent trajectories to measure how fast agentic AI runs on laptops and workstations, with initial results for NVIDIA DGX Spark, RTX 5090, AMD Ryzen AI Halo, and MacBook Pro M5 Pro.