Tag
PyTorch 2.14 introduces significant updates including NVGEMM for CUTLASS kernels in Inductor, a new nccl2 backend for distributed computing, first-class fault tolerance, and native linear algebra on Apple Silicon.
PyTorch 2.14 introduces updates to Inductor, PyTorch Distributed, dynamic shapes, Apple Silicon support, and more, with a live Q&A and PyTorchCon announcement.
The article explains the torch.compile stack in PyTorch, detailing steps from API to Dynamo, FX graph, ATen ops, and Torch Inductor for JIT compilation.