Tag
At PyTorchCon 2026, Zhipeng Wang of Google shared DeepSpeed technical advances for large-scale model training, including AutoSP automatic sequence parallelism, Muon optimizer support, and AutoTP/AutoEP for Hugging Face models, alongside ongoing open-source community collaboration.