Tag
Highlights a paper introducing ZeRO (Zero Redundancy Optimizer), a memory optimization system for efficiently training extremely large models on limited GPU memory.