@_akhaliq: GPU Forecasters Language Models as Selective Surrogates for Kernel Runtime Optimization
Summary
This paper proposes using language models as selective surrogates to optimize GPU kernel runtime, demonstrating a novel approach to performance forecasting.
View Cached Full Text
Cached at: 06/02/26, 07:38 PM
GPU Forecasters
Language Models as Selective Surrogates for Kernel Runtime Optimization https://t.co/s2r0lFWz9r
Similar Articles
@akshay_pachaar: https://x.com/akshay_pachaar/status/2094490705024676272
This article explains static, dynamic, and continuous batching strategies for serving large language models on GPUs, detailing their trade-offs and how they optimize throughput and reduce idle time.
@levidiamode: 163/365 of GPU Programming Looking at a few different agentic GPU kernel optimization systems today. The two I'm most i…
A tweet discussing two agentic GPU kernel optimization systems: Auto GPU Kernel by @dogacel0 and Kernel Design Agents from @songhan_mit's lab, both winners at the MLSys Sparse Attention FlashInfer competition. The thread highlights different approaches using subagents and Claude skills for GPU programming.
@liao_lucas: https://x.com/liao_lucas/status/2097149853499588971
This article provides an introduction to GPU kernels in the context of AI inference and performance engineering, explaining their definition, how they are used, and the advantages of custom kernels for optimization.
Toward Better HIP Kernel Generation for AMD GPUs: Synthetic Data, Multi-Agent Search, and Reinforcement Learning
Explores synthetic data generation, multi-agent optimization, and reinforcement learning to improve language models' ability to generate high-performance HIP kernels for AMD GPUs, demonstrating improvements in compilation and correctness rates on MI350X.
@akshay_pachaar: https://x.com/akshay_pachaar/status/2084992645966016757
A technical guide demonstrating how to serve five specialized small models (SLM, OCR, NER, reranker, object detector) on a single GPU using open-source tools, covering memory management, batching, and the Superlinked Inference Engine.