sequence-parallel

Tag

Cards List
#sequence-parallel

Training Variable Long Sequences with Data-Centric Parallel

arXiv cs.AI ↗ · 2026-08-11 Cached

Introduces Data-Centric Parallel (DCP), a method for training deep learning models on variable long sequences by dynamically adjusting runtime settings per batch, achieving up to 2.88x speedup on 32 H200 GPUs with only 10 lines of code integration.

0 favorites 0 likes
#sequence-parallel

LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation

Hugging Face Daily Papers ↗ · 2026-05-18 Cached

LongLive-2.0 introduces an NVFP4-based parallel infrastructure for long video generation, achieving up to 2.15x training speedup and 1.84x inference speedup with a 5B model reaching 45.7 FPS.

0 favorites 0 likes
← Back to home

Submit Feedback