@TheAhmadOsman: You wanna learn how do these AI kernels work? Start here
Summary
Tweet by @TheAhmadOsman pointing to a resource for learning how AI kernels work.
Similar Articles
@liao_lucas: https://x.com/liao_lucas/status/2097149853499588971
This article provides an introduction to GPU kernels in the context of AI inference and performance engineering, explaining their definition, how they are used, and the advantages of custom kernels for optimization.
@TheAhmadOsman: You don’t “run a model” You run Kernels The model is just a graph The Inference Engine is scheduler / optimizer / execu…
The tweet explains that running AI models is really about running optimized kernels, and that inference engines and their kernel implementations are critical for performance, not just the model or hardware.
@amitiitbhu: Just published: How do CUDA Kernels work? Read here:
This article explains how CUDA Kernels work on GPUs, covering the basics of CUDA, GPU architecture, threads, blocks, and their role in AI and machine learning.
@TheAhmadOsman: How to go about learning all of this? 1st: Start with the serving engine view - vLLM: PagedAttention, continuous batchi…
A detailed guide on learning AI inference engine internals, covering serving engines like vLLM and SGLang, low-level GPU kernel programming with Triton and CUTLASS, and a sequence of mini-projects to build hands-on expertise.
@RisingSayak: Found a faster kernel? You shouldn’t need to rewrite your model to use it. With Kernels, you can choose which kernel ru…
This Twitter thread introduces Hugging Face's Kernels, a tool that allows users to select and replace optimized kernel implementations for supported layers in AI models without rewriting the entire model.