Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence
Summary
LingBot-Video presents a DiT-based video pretraining framework with Mixture-of-Experts architecture, specialized data augmentation, and multi-dimensional reward system for embodied intelligence applications.
View Cached Full Text
Cached at: 07/09/26, 07:51 AM
Paper page - Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence
Source: https://huggingface.co/papers/2607.07675 Published on Jul 8
#2 Paper of the day Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
LingBot-Video presents a DiT-based video pretraining framework with Mixture-of-Experts architecture, specialized data augmentation, and multi-dimensional reward system for embodied intelligence applications.
Despite the recent promise in robot control, video generative models suffer from a domain mismatch due to their primary focus on content creation. For example, their design inherently prioritizes visual fidelity and creativity over computational efficiency and physical realism. In this work, we present LingBot-Video, aDiT-based video pretrainingparadigm specifically tailored forembodied intelligence. From the architecture perspective, we adopt theMixture-of-Experts(MoE), instead of dense, framework to achieve a better trade-off between modeling capacity and inference efficiency, and manage to scale it up from scratch. From the data perspective, we construct adata profiling enginethat augments standard internet videos with extensiverobot-oriented footage, encompassing manipulation, navigation, and egocentric perspectives, to equip the base model with an intrinsic understanding of actions and world dynamics. From the training perspective, we develop amulti-dimensional reward systemto enforce the alignment regardingphysical rationalityandtask completion, going beyond standard criteria such as aesthetics, prompt-following, and motion consistency. Comprehensive evaluations validate its performance and efficiency as a video foundation model. We contribute LingBot-Video as the inaugural large-scale, open-source MoE video foundation model to the community, in a pioneering effort to bridge digital creativity and physical actuation.
View arXiv pageView PDFProject pageGitHub77Add to collection
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2607.07675 in a model README.md to link it from this page.
Datasets citing this paper1
#### cy0307/awesome-egocentric-atlas Viewer• Updatedabout 1 hour ago • 816 • 1.21k • 5
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2607.07675 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
@heyshrutimishra: New video model just dropped. But this one isn't built for cinematic video. LingBot-Video is designed for embodied inte…
LingBot-Video, a 30B-parameter video model with sparse MoE, designed for embodied intelligence, is open-sourced. It outperforms existing models on RBench, trained on 70K+ hours of embodied data.
LingBot-Video: sparse-MoE video diffusion transformer (13B total, 1.4B active) post-trained as an action-conditioned world model[R]
LingBot-Video is a 13B sparse-MoE video diffusion transformer (1.4B active) post-trained with RL as an action-conditioned world model, open-sourced with weights and code. It includes a physical-plausibility reward graded by a VLM and frames itself as a policy evaluator and action planner, though closed-loop robot results are absent.
HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining
This paper finds that egocentric human video, when processed with a filtering and labeling pipeline, can outperform teleoperated real-robot data for pretraining embodied foundation models, achieving lower validation loss and higher success rates on real-robot tasks.
EMO: Pretraining Mixture of Experts for Emergent Modularity
EMO is a Mixture-of-Experts model that enables modular deployment by grouping similar domain tokens with shared experts, achieving performance comparable to standard MoEs while allowing significant expert pruning (25% experts retain 99% performance) without performance degradation.
LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing
LoomVideo introduces a 5B-parameter unified architecture for video generation and editing that reduces computational overhead using novel conditioning mechanisms and multi-modal alignment, achieving competitive performance and faster inference.