@ariG23498: I was fascinated when I first heard about kernel fusion from @cHHillee's blog post "Making Deep Learning Go Brrrr From …
Summary
The author shares excitement about kernel fusion and demonstrates using HuggingFace's kernels project to profile a GeGLU FFN fused Liger kernel, noting the profile's beauty.
View Cached Full Text
Cached at: 06/16/26, 11:43 PM
I was fascinated when I first heard about kernel fusion from @cHHillee’s blog post “Making Deep Learning Go Brrrr From First Principles” (yes, I am a big fan of this post).
I am still a novice in kernel programming so could not build a fused kernel myself. The kernels project from @huggingface came to the rescue. I could choose from the 100s of kernels on the Hub and profile it.
In the blog, we use the GeGLU FFN fused Liger kernel, and the profile is beautiful.
Similar Articles
@ariG23498: I have always admired @stevhliu's work. I consider his technical writeups to be among the best there is. In the latest …
A thread highlighting a technical blog series on how Hugging Face's transformers library loads models efficiently, covering meta device, safetensors, CUDA caching, and more.
@RisingSayak: The kernels project at Hugging Face has been growing! We want it to be the go-to place for kernel devs and kernel users…
Hugging Face's kernels project is expanding and seeking contributors for agentic kernel development to provide real optimization value to models.
🤗 Kernels: Major Updates
Hugging Face introduces major updates to its Kernels project, including a new repository type on the Hub, improved security with trusted publishers and kernel signing, revamped CLIs, expanded framework/backend support, and a foundation for agentic kernel development.
@googlegemma: “Agentic kernel optimization is the future of on-device inference” @xenovacom used Fable 5 to write kernels that pushed…
Xenova used Fable 5 to write optimized kernels achieving 255 tokens per second for Gemma 4 on WebGPU with M4, demonstrating agentic kernel optimization for on-device inference.
A hackable compiler to generate efficient fused GPU kernels for AI models [P]
The author presents a custom, hackable ML compiler written in Python that lowers LLMs to optimized CUDA kernels through a multi-stage IR pipeline, achieving performance competitive with or superior to PyTorch on specific operations. The article details the compiler's optimization passes, lowering rules, and CLI usage for generating efficient fused GPU kernels.