nccl2

PyTorch 2.14 release introduces fault tolerance as a first-class c10d concept with in-place process-group reconfiguration, alongside features like NVGEMM kernels, a new nccl2 backend, and native linear algebra for Apple Silicon.