Tag
An open-source reference kit for NVIDIA V100 SXM2 pinouts and NVLink interconnects, providing 800 canonical contacts, connection tables, and KiCad starter designs for two- and four-GPU configurations as groundwork for an open carrier board.
SkyPilot 的博客介绍其平台如何通过拓扑感知的任务放置、原地故障恢复和集群自动碎片整理,让多节点 AI 训练任务在 Grace Blackwell NVL72 机架内保持 rack-locality,从而在相同机架上获得多出 27% 的可用 GPU。
NVIDIA Vera Rubin NVL72 racks are beginning delivery, promising 4x efficiency, 2x speed, and doubled NVLink bandwidth, though questions remain about production adoption by Claude or GPT and how they compare to Google's custom chips.
Tests NVLink on dual RTX 3090s for AI inference and training, finding significant speedups for tensor parallel prompt processing (30%) and FSDP training (3x), but minimal effect on token generation or layer split inference.
Explains the communication model for multi-GPU systems, covering the trade-off between latency and bandwidth, and compares MST and Ring algorithms for collective operations like broadcast.
A correction clarifies that the RTX Spark does not have 600GB/s bandwidth; that figure is actually the NvLink speed, as shown in Computex slides.
A user details their modding and benchmarking of an AMD Strix Halo system with dual RTX 3090 eGPUs and NVLink, finding improvements in LLM inference speed for dense models, especially with vLLM, and discusses power efficiency trade-offs.
A benchmark analysis of Qwen 3.6 27B MTP on 4x RTX 3090 GPUs, demonstrating that using NVLink for tensor parallelism yields significant throughput improvements (up to +53%) over PCIe configurations.