@PatrickToulme: This exercise makes me believe the future of DSLs and compilers is very much agentic. Programming languages and DSLs bu…
Summary
Claude Fable used the pyptx DSL to write a FlashAttention forward kernel for NVIDIA B200 that achieves near-parity performance with the hand-tuned CUTLASS kernel, demonstrating the potential for AI agents in compiler and DSL design.
View Cached Full Text
Cached at: 07/07/26, 11:39 PM
This exercise makes me believe the future of DSLs and compilers is very much agentic. Programming languages and DSLs built for humans are not necessary for agents. Agents can handle programming languages at the bare metal level that humans are not capable of writing.
The important of proper harness engineering is also demonstrated in this task.
Patrick C Toulme (@PatrickToulme): Claude Fable wrote a FlashAttention forward kernel in pyptx DSL for the NVIDIA B200 (Blackwell) that runs at 0.92–0.99× of FlashAttention-4, the hand-tuned CUTLASS kernel — parity on two sequence lengths, ~1350 TFLOPS bf16.
It’s written in pyptx, my Python DSL that emits raw
Similar Articles
@ekzhang1: me looking at people like this guy who write real gpu kernels :)
AI model Claude was used to write a FlashAttention forward kernel using the pyptx DSL, achieving near-parity performance with hand-tuned FlashAttention-4 on NVIDIA B200 hardware.
@charles_irl: Rewriting parallelism is a big move and it'd be nice to make it even faster than we can do with CuTe DSL. FA4 is a very…
Discussion about rewriting parallelism to improve kernel performance using CuTe DSL and tile programming models for the FA4 (FlashAttention 4) kernel.
@levidiamode: 163/365 of GPU Programming Looking at a few different agentic GPU kernel optimization systems today. The two I'm most i…
A tweet discussing two agentic GPU kernel optimization systems: Auto GPU Kernel by @dogacel0 and Kernel Design Agents from @songhan_mit's lab, both winners at the MLSys Sparse Attention FlashInfer competition. The thread highlights different approaches using subagents and Claude skills for GPU programming.
@hamzaelshafie: New in-depth blog post: "Dissecting ThunderKittens: Anatomy of a Compact DSL for High-Performance AI Kernels" This post…
A detailed blog post dissecting ThunderKittens, a compact DSL for high-performance AI kernels, including a bottom-up analysis of its abstractions and a benchmark implementing a non-causal attention prefill kernel that outperforms FlashAttention-2 by ~1.55x and matches FlashAttention-3.
Retire the Abstractions
Hazy Research argues that AI agents are making CUDA DSLs obsolete by generating target-optimized kernel code directly from vague prompts, suggesting abstractions may retire.