@ariG23498: It is profiling time! In Part 2 we cover: > trace a Linear layer > talk about mul + add vs linear > gemm epilogues (my …
Summary
Announces Part 2 of a profiling tutorial covering linear layer tracing, gemm epilogues, MLP tracing, and comparisons of torch compile vs Liger kernels, with a link to the full content.
View Cached Full Text
Cached at: 06/12/26, 06:56 AM
It is profiling time! ⏰
In Part 2 we cover: > trace a Linear layer > talk about mul + add vs linear > gemm epilogues (my favourite part) > trace MLP > torch compile vs liger kernels > use hugging face kernels
Bookmark this for a fun weekend read! 😎 https://t.co/ZRqcO3AF1K
Similar Articles
Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP
This blog post continues the profiling in PyTorch series, exploring nn.Linear, MLP blocks, and fusion techniques using Triton kernels to optimize performance.
@ariG23498: This man can write! Pair this understanding with profiling (shameless plug to my series) and you are golden! http://hf.…
A beginner-friendly guide to using torch.profiler in PyTorch for profiling and optimizing deep learning workloads, covering trace reading, CUDA analysis, and torch.compile integration.
Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler
A beginner-friendly guide to using PyTorch's torch.profiler for profiling and optimizing neural network operations, starting with matrix multiplication and bias addition. It explains how to read profiler traces and understand CPU/GPU interactions.
@RisingSayak: I realized that what I cannot profile, I cannot optimize. This is why I embarked on a little project in Diffusers, to t…
Sayak Paul describes a project to profile and optimize Diffusers pipelines using torch.compile, and announces a tutorial series by Ari G. on the topic.
@ariG23498: There are two official torch tutorials that link to the "Profiling in PyTorch" sereis! https://docs.pytorch.org/tutoria…
Two official PyTorch tutorials linking to the 'Profiling in PyTorch' series are highlighted, providing guidance on using the PyTorch profiler API for performance debugging.