We built an open-source GPU profiler you point an AI agent at, instead of reading traces yourself
Summary
This article introduces an open-source GPU profiler that serves metrics in JSON format, allowing AI agents to automate performance tuning for CUDA-based AI engines like vLLM and SGLang without manual trace analysis.
Similar Articles
AA-AgentPerf-Local: Benchmarking local AI agents on laptops and workstations
Artificial Analysis open-sources AA-AgentPerf-Local, an inference benchmarking tool that replays real agent trajectories to measure how fast agentic AI runs on laptops and workstations, with initial results for NVIDIA DGX Spark, RTX 5090, AMD Ryzen AI Halo, and MacBook Pro M5 Pro.
@ariG23498: Made a simple utility to share your GPU profile traces. `uvx trace-tuil <local traces> -b <hf bucket name>`
A simple utility to share GPU profile traces using a command-line tool, designed for developers working with GPU profiling.
Optimizing CUDA like a Human: Micro-Profiling Tools as Expert Surrogates for LLM-Based GPU Kernel Optimization
KernelPro is a closed-loop multi-agent system that uses LLMs and micro-profiling tools to automatically optimize GPU kernel code, achieving geomean speedups of 2.42×/4.69×/5.30× on KernelBench and demonstrating a measured 11.6% energy reduction at matched speed.
An AI agent just beat NVIDIA's FlashMLA baseline by 9.8% on B200, without seeing its source code
OpenBMB's ForgeKernel agent autonomously optimized a GPU kernel against NVIDIA's FlashMLA black-box baseline over 22 hours, achieving a 9.8% speedup on B200, and is open-sourcing 27 optimized operators along with the ForgeKernel harness.
Open Source Profiler for Voice Agents - Understanding from inside
An open source profiler designed for voice agents to provide insights into internal operations and performance.