@aryanvs_: to the untrained eye, this may look like noise. but in here lies months of work trying to write a compiler the best par…
Summary
A developer shares months of work building a compiler that outperforms cuBLAS for matrix multiplication on an A100 GPU, with visualizations.
View Cached Full Text
Cached at: 06/29/26, 12:21 AM
to the untrained eye, this may look like noise. but in here lies months of work trying to write a compiler
the best part about writing one is that you get to outperform cublas and also enjoy making cool visualizations of the same tricks hidden away in there 😍
a100 matmul: https://t.co/lhyyOHtPJX
Similar Articles
@akshay_pachaar: https://x.com/akshay_pachaar/status/2087928032904523980
An educational thread explaining how GPUs work, focusing on the memory-compute asymmetry that dominates LLM serving performance, and demonstrating how techniques like quantization, speculative decoding, and continuous batching follow from that fundamental constraint.
@charles_irl: https://x.com/charles_irl/status/2071606346844442871
This article explains the entire process of compiling and launching a CUDA kernel, from source code to hardware execution, using a simple vector addition example and detailing the role of nvcc, PTX, SASS, and ioctls.
@sumitdotml: week 25, 2026: cpu tensor core basics (add/mul, reduce, stride, 2d matmul, etc.) in c, reading some arcee
The author shares progress on building a CPU-only tensor library in C, covering basics like add/mul, reduce, strides, and 2D matmul, along with insights from reading Arcee's technical blogs on foundation models.
A hackable compiler to generate efficient fused GPU kernels for AI models [P]
The author presents a custom, hackable ML compiler written in Python that lowers LLMs to optimized CUDA kernels through a multi-stage IR pipeline, achieving performance competitive with or superior to PyTorch on specific operations. The article details the compiler's optimization passes, lowering rules, and CLI usage for generating efficient fused GPU kernels.
@vikhyatk: Got sick of hand-tuning GPU kernels, so we built a compiler. Photon 2.0 compiles Moondream, Qwen 3.5, and Gemma 4 into …
Photon 2.0 is a new inference engine and compiler that compiles models like Moondream, Qwen 3.5, and Gemma 4 into megakernels, claiming up to 2.3x throughput over vLLM and SGLang for physical AI workloads.