Tag
NVIDIA demonstrates how quantization-aware distillation (QAD) using NVIDIA Model Optimizer improves the Nemotron 3.5 Lightning model, reducing memory usage and increasing throughput while preserving accuracy for agentic benchmarks.
This paper introduces DataKernelBench, a benchmark for evaluating LLMs on optimizing GPU kernels for database queries, achieving speedups over baseline methods like torch.compile.
The inaugural PyTorch Day Japan event is announced, to be hosted by PyTorch Foundation, Hugging Face, IBM, and Mitsubishi Electric in Tokyo on December 10, featuring technical talks on AI training, inference, and responsible AI.
TRANSIT is a runtime that makes unified virtual memory practical for large-scale LLM training, reducing GPU usage by up to 50% without code changes, and will be presented at PyTorch Conference North America.
The keynote lineup for KubeCon, CloudNativeCon, OpenInfraSummit, and PyTorchCon China in Shanghai has been announced, featuring speakers from organizations like The Linux Foundation and NVIDIA.
TimesFM 3.0 is a pretrained time-series foundation model by Google Research, released on Hugging Face with PyTorch weights for time-series forecasting tasks.
The PyTorch Conference North America has announced its keynote lineup, highlighting four main directions for the open-source ecosystem, including strengthening the core and expanding multi-hardware support, with speakers from major tech organizations.
PyTorch provides a native fine-tuning library with Day-0 Hugging Face checkpoint support for Alibaba's open-weight Qwen3.8-2.4T-A95B model, enabling efficient training and deployment on NVIDIA systems with configurable reasoning.
Edward Yang will be a keynote speaker at PyTorchCon North America, discussing the evolution and future of PyTorch. The event is set for October 20-21 in San Jose, CA.
AI coding agents write runtime adapters to bridge gaps between new model architectures and software stacks, enabling thousands of HuggingFace models to run on the IBM Spyre accelerator with day-one support.
This paper integrates SmoothQuant into PyTorch's native stack for efficient INT8 inference of small NLP models on Intel Xeon CPUs, achieving up to 5.8× speedup with negligible accuracy loss.
An experiment training three from-scratch LLMs with the same GRPO recipe yielded inconsistent results, with GRPO degrading performance in some models, particularly the middle-sized one, and no clear relationship to scale.
The paper introduces an algebra-generic and differentiable evaluation engine for linear temporal logic, implemented in a PyTorch library called telos, to handle soft-valued systems in AI.
A YouTube creator returns after a hiatus to teach building a distributed training framework from first principles, focusing on advanced AI topics like DeepSeek, MoE, and MLA, with an emphasis on developing problem-solving skills and self-confidence.
The tweet discusses the approach of writing model code without using autograd and torch.nn module abstractions, emphasizing manual backward propagation and direct matrix computations.
torch-preflight is a new linter for PyTorch code that catches common GPU-wasting bugs without executing code or requiring a GPU, plus estimates VRAM usage to check if a training run fits before paying for an instance.
AMD upstreamed optimizations to PyTorch/TorchTitan and TorchAO for FP8 training on AMD Instinct GPUs, achieving up to 13.4% throughput gains on Llama3-8B and recovering 89% of FP8 quantization overhead on DeepSeek-V3 via fused Triton kernels.
PyTorchCon North America announces Joelle Pineau, Chief AI Officer at Cohere, as a keynote speaker. The event takes place October 20-21 in San Jose, CA, focusing on advancing AI through open research and collaboration.
PyTorch announces its Certified Associate (PTCA) program, a certification aimed at early-stage practitioners to validate hands-on AI engineering skills in model design, training, and deployment.
Meta introduced Muse Glimmer, an open-weight 30B-parameter model distilled from Muse Spark for on-device agentic workflows, with ExecuTorch now supporting running it on NVIDIA GPUs and Apple silicon.