Tag
PyTorch Conference North America 2026 announced its keynote lineup, featuring leaders from Meta, NVIDIA, Google Cloud, and other AI organizations, to take place in San Jose on October 20–21, 2026.
PyTorch Foundation announces keynote speaker Matt Collier for PyTorchCon North America on October 20-21 in San Jose, sharing the foundation's vision for open-source AI and the PyTorch ecosystem.
NVIDIA and PyTorch explain how kernel fusion in CUDA improves GPU memory bandwidth by combining multiple operations into a single kernel, reducing round-trips through global memory and kernel launch overhead.
PyTorch Conference North America (Oct 20-21, San Jose) will feature an Applications Track showcasing how developers use PyTorch across LLMs, multimodal AI, robotics, scientific computing, and production deployments. The event also includes tracks on core PyTorch, inference, kernel engineering, and responsible AI.
This tutorial covers how to use a transformer model from training to inference, focusing on autoregressive generation, prefill vs. decode phases, and key-value caching for efficient inference.
This paper introduces DFSC, a PyTorch environment built around a Mittag-Leffler Spectral Layer (MLSL) that enables error-controlled, differentiable fractional propagation in hybrid neural models. It separates known fractional dynamics from data-driven corrections, supports batched/dense/sparse operator paths, and provides certified error bounds in certain regimes.
TAGTorch is an open-source PyTorch library that unifies tools for topology, algebra, and geometry-aware machine learning, covering preprocessing, architectures, training techniques, and model analysis.
Documentation reference for MSLK 1.3.0, a library of fused GPU kernels for transformer workloads including attention, quantization, GEMM, and MoE routing, supporting CUDA and ROCm with PyTorch integration.
PyTorch 2.13 release brings FlexAttention to Apple Silicon with up to 12x speedups and 4x peak memory reduction for large-vocabulary models via fused LinearCrossEntropyLoss, alongside updates to distributed training, compilation, and on-device inference.
Netron is an open-source visualizer for neural network, deep learning, and machine learning model files, supporting formats like ONNX, PyTorch, TensorFlow, and more via browser, desktop, or Python.
Google Cloud and RadixArk are partnering to bring the SGLang open-source inference framework to Google Cloud TPUs, initially via SGL-JAX and later with SGL-torchtpu for PyTorch-native support, enabling developers to run production workloads seamlessly across GPUs and TPUs.
Meta's FBTriton is a downstream fork of OpenAI's Triton compiler that enables rapid development of GPU optimizations like TLX and autoWS while staying synced upstream. This blog details its continuous upstream ingestion strategy, hierarchical L1/L2/L3 validation framework, and the practical challenges of balancing innovation with production stability.
Kernel Forge is an open-source agent harness that uses LLMs and Monte Carlo Tree Search to automatically generate and optimize CUDA kernels for any unmodified PyTorch model, achieving up to 2.83× speedup on softmax in Gemma 4 E2B.
The PyTorch team discusses the concept of PyTorch serving as both a reference language and an implementation language for deep learning, emphasizing its role in verifying optimized kernel implementations and the potential for LLMs to generate explicit forward-backward code.
Molt is an open-source, PyTorch-native agentic RL framework from NVIDIA NeMo, designed for scalable, fully-async training of large multimodal agent models using Ray, vLLM, and NVIDIA AutoModel.
Perplexity AI announces the Bumblebee Pipeline, a tool for big data and AI workflows, shared by prominent AI influencer gp_pulipaka.
Second edition of Modern Computer Vision with PyTorch book, covering fundamentals to advanced topics like generative AI and diffusion models.
The PyTorch Foundation has expanded to host six open-source AI projects (PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors) to provide vendor-neutral governance across the full AI lifecycle, addressing enterprise challenges in inference, safety, and scalability.
Promotion for the fourth edition of 'Python Machine Learning By Example' by Yuxi (Hayden) Liu, covering best practices and advanced ML techniques with TensorFlow, PyTorch, and scikit-learn.
Presents MKEvolve, a modular multi-agent framework that iteratively co-evolves modular decomposition and LLM-generated kernels for hardware accelerators, achieving improved correctness and speedup over direct synthesis while reducing token usage.