Tag
HyperParallel is a PyTorch-based distributed acceleration library optimized for Ascend SuperPoD, demonstrating higher training throughput than standard PyTorch FSDP2 with Muon while maintaining loss convergence, as showcased in a demo at #PyTorchCon China.