nccl

Tag

Cards List
#nccl

@PyTorch: Bring your questions about PyTorch 2.15 to our live Q&A this Thursday, November 5, at 11 AM PT. Tristan Rice (@rice_fry…

X AI KOLs Timeline ↗ · 2026-11-02 Cached

PyTorch announced a live Q&A webinar for the PyTorch 2.15 release, where Meta engineers will walk through new capabilities including the rewritten NCCL backend, NIXL one-sided transports, finer FSDP2/pipelining memory control, and faster NVFP4/FP8 decoding on NVIDIA Blackwell and Apple Silicon.

0 favorites 0 likes
#nccl

Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL

Hugging Face Blog ↗ · 2026-09-10 Cached

This article describes a method to train LoRA adapters using AsyncGRPOTrainer and sync them via Storage Buckets across separate Hugging Face Jobs, eliminating the need for NCCL communication.

0 favorites 0 likes
#nccl

NVIDIA Exemplar Cloud: Lessons for Unlocking Full Performance on AI Infrastructure (12 minute read)

TLDR AI ↗ · 2026-07-31 Cached

NVIDIA shares debugging lessons from its Exemplar Cloud program, detailing how configuration issues in SMMU power management, NUMA placement, NCCL queue-pair concurrency, and hardware defects cause 8-12% training throughput gaps on AI clusters, and how to diagnose and fix them.

0 favorites 0 likes
← Back to home

Submit Feedback