LingBot-Video: sparse-MoE video diffusion transformer (13B total, 1.4B active) post-trained as an action-conditioned world model[R]

Reddit r/MachineLearning Papers

Summary

LingBot-Video is a 13B sparse-MoE video diffusion transformer (1.4B active) post-trained with RL as an action-conditioned world model, open-sourced with weights and code. It includes a physical-plausibility reward graded by a VLM and frames itself as a policy evaluator and action planner, though closed-loop robot results are absent.

Single-stream diffusion transformer with a DeepSeek-V3-style sparse MoE (128 experts, top-8 routing, 1.4B active of 13B total). Six-reward RL post-training including a physical-plausibility reward, plus an action-to-video mode that predicts robot rollouts from action and hand-pose conditions. Weights, code, and a Diffusers/SGLang stack are open under the LingBot-Video name. Two things I would push on, and would genuinely like this sub's read: The physical-plausibility reward is graded by a VLM from sampled frames. Is a VLM a defensible judge of physics, or is that Goodhart waiting to happen? (They do add real-video negatives to fight reward hacking.) It is framed as a policy evaluator and action planner, but every result is video-frame quality with no closed-loop robot numbers. Where is the line between a video generator and a world model? On RBench it posts the top average, though the reasoning-heavy dimensions still go to a closed model, and it is only second on general T2V in their own eval. Please tear it apart. Paper, code, and weights: https://technology.robbyant.com/lingbot-video , https://github.com/robbyant/lingbot-video , https://huggingface.co/robbyant/lingbot-video
Original Article

Similar Articles

robbyant/lingbot-video-moe-30b-a3b

Hugging Face Models Trending

LingBot-Video is the first open-source large-scale MoE video generation model for embodied intelligence, featuring efficient MoE architecture, massive embodied data training, and multi-reward system for high aesthetics, physical rationality, and task completion.