Paper page - Training Video Foundation Models with NVIDIA NeMo

Source: https://huggingface.co/papers/2503.12964 Published on Mar 17, 2025

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

A scalable open-source pipeline using NVIDIA NeMo for training and inference of Video Foundation Models addresses challenges in generating high-quality videos.

Video Foundation Models(VFMs) have recently been used to simulate the real world to train physical AI systems and develop creative visual experiences. However, there are significant challenges in training large-scale, high qualityVFMs that can generate high-quality videos. We present a scalable, open-sourceVFMtraining pipeline withNVIDIA NeMo, providing accelerated video dataset curation,multimodal data loading, and parallelizedvideo diffusion modeltraining and inference. We also provide a comprehensiveperformance analysishighlighting best practices for efficientVFMtraining and inference.

View arXiv pageView PDFGitHub17.6kAdd to collection

Get this paper in your agent:

hf papers read 2503\.12964

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2503.12964 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2503.12964 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2503.12964 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.