world-models

Tag

Cards List
#world-models

NVIDIA's Cosmos Framework (6 minute read)

TLDR AI ↗ · 2026-11-03 Cached

NVIDIA introduces Cosmos Framework, an open, modular platform for training, post-training, optimizing, and deploying world foundation models for physical AI, covering RL pipelines like DPO, GRPO, PPO, and serving via Cosmos NIM microservices.

0 favorites 0 likes
#world-models

Agentic World Modeling for Agent Test-time Scaling without Environment Replica

arXiv cs.AI ↗ · 2026-11-02 Cached

论文提出 Agentic World Modeling(AWM),通过只读接口与真实环境交互式获取证据来模拟动作结果,实现无需环境副本的并行 agent 测试时扩展,在 τ-bench、AppWorld 和 OfficeBench 上显著优于单次模拟与训练式世界模型基线。

0 favorites 0 likes
#world-models

Beyond Plausible Prediction: Safety Sufficiency in Web World Models

arXiv cs.AI ↗ · 2026-11-02 Cached

The paper introduces SafeWebWorld, a benchmark for evaluating 'safety sufficiency' in web world models, showing that plausible prediction, evidence preservation, and latent authorization recovery are each insufficient to establish robust EXECUTE/ASK/BLOCK authorization decisions.

0 favorites 0 likes
#world-models

SPT-Flow: One Integration, Many Futures in Continuous-Time World Models

arXiv cs.LG ↗ · 2026-11-02 Cached

SPT-Flow 提出一种连续时间世界模型的训练方法:每条轨迹采样一个隐变量,并将自由运行的 ODE 展开与多个读出时刻的演示状态对齐,从而克服监督捷径问题。在 LIBERO 上,该方法相对 ODEWorld 基线在中段与最终帧的 best-of-10 PSNR 分别提升 2.0 和 2.4 dB,平均 LPIPS 降低 23%。

0 favorites 0 likes
#world-models

Before We Adapt: The Zero-Shot Generalization Bottleneck in Continual World Models

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper frames continual reinforcement learning with a contextual MDP that splits context into behavioral and physical components, and studies zero-shot reuse of world models in FourRooms tasks with Dyna-Q and TD-MPC, finding that physical-context changes substantially degrade reuse depending on the observation representation. It identifies representation generalization as a key bottleneck for reliable world-model reuse in continual RL.

0 favorites 0 likes
#world-models

Density-Guided Bootstrap Boundaries for Latent World-Model Reinforcement Learning

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper introduces density-guided bootstrap boundaries, an adaptive mechanism for controlling imagined-return depth in latent world-model RL, proving contraction of the gated Bellman operator and showing improved sample efficiency within DreamerV3 across continuous-control and Atari tasks.

0 favorites 0 likes
#world-models

@heyshrutimishra: Yann LeCun was right & nobody in this industry wants to say it out loud. 109 million parameters beat 72 billion. He has…

X AI KOLs Timeline ↗ · 2026-11-01 Cached

A new paper by Randall Balestriero and Yann LeCun argues that paired-view training (e.g., image-caption pairs), not sheer scale or next-word prediction, is what produces unified world representations—showing a 109M-parameter model outperforming a 72B language model in representational alignment.

0 favorites 0 likes
#world-models

@HuggingPapers: Top Research Papers This Week: From World Models to Streaming Video Agents From robot policies that learn by rewinding …

X AI KOLs Following ↗ · 2026-11-01 Cached

Hugging Face weekly roundup of top research papers covering world models, streaming video agents, robot policies, and efficient diffusion VLMs, highlighting works like Rollback, Hy-Nomas, OmniShowcase, PDRVLA, and StreamVibe.

0 favorites 0 likes
#world-models

@han_junlin: I joined @amilabs ~a month ago as an MTS, working on world model pre-training and capability emergence. There has never…

X AI KOLs Timeline ↗ · 2026-10-31 Cached

Han Junlin announces joining AMI Labs as an MTS to work on world model pre-training and capability emergence, expressing excitement about building AI for the real world with a scaling mindset.

0 favorites 0 likes
#world-models

CausalWAM: Learning the Causes of Actions in World Action Models

Hugging Face Daily Papers ↗ · 2026-10-30 Cached

CausalWAM proposes adding a sparse routing path to a pretrained World Action Model's action head so that generated actions depend only on action-relevant latent variables, with provable identification of causal structure up to permutation without temporal independence assumptions. Experiments on synthetic data and real robots show improved closed-loop success efficiency.

0 favorites 0 likes
#world-models

Ex-Palantir execs launch Dream with $17M from a16z to build AI world models for construction

TechCrunch AI ↗ · 2026-10-29 Cached

Ex-Palantir executives Andy Alder and Arjun Mather launched Dream, a startup building AI world models for building design and engineering, with $17 million in seed funding led by Andreessen Horowitz. The company's 'structural cognition' model, trained on over 100 million square feet of building permit data, is already deployed across 10 projects in Texas and California.

0 favorites 0 likes
#world-models

Video Generation Meets Agent Harness: Agentic Video Generation, Agentic World Modeling and Recursive Self-Improvement

Hugging Face Daily Papers ↗ · 2026-10-29 Cached

A report examining the intersection of video generation and agent harnesses, covering agentic video generation, agentic world modeling, and recursive self-improvement for autonomous multi-shot video production.

0 favorites 0 likes
#world-models

@roboflow: Today we’re announcing that we’ve partnered with NVIDIA and joined the Cosmos Coalition, a global initiative among lead…

X AI KOLs Following ↗ · 2026-10-28 Cached

Roboflow announced a partnership with NVIDIA and joined the Cosmos Coalition as a premiere provider of multi-modal data and post-training capabilities to advance frontier world model research for the physical economy.

0 favorites 0 likes
#world-models

@benbye: I trained a 750K-parameter world-model agent on my M5 Pro to play video games! Presenting NanoDreamer: a tiny Dreamer-i…

X AI KOLs Timeline ↗ · 2026-10-28 Cached

Benjamin Bai unveils NanoDreamer, a 750K-parameter Dreamer-inspired world-model and actor-critic agent trained entirely on a MacBook M5 Pro, complete with his own autograd engine, tensor library, and transformer, playing all 5 MinAtar games from imagination.

0 favorites 0 likes
#world-models

@_akhaliq: Representing the Unseen Rethinking Visual Imagination for Spatial Reasoning paper: https://huggingface.co/papers/2610.3…

X AI KOLs Timeline ↗ · 2026-10-28 Cached

The paper introduces ImagiRep, a simulator-grounded benchmark showing that spatial reasoning benefits from diverse representations beyond RGB, and proposes GEARS, a lightweight test-time strategy for adaptively selecting representations to improve reasoning about unobserved states.

0 favorites 0 likes
#world-models

DeepMind unveils Genie 4 world model promising more realistic physics and humans

Ars Technica ↗ · 2026-10-27 Cached

Google DeepMind 发布 Genie 4 世界模型,利用 Gemini 3.8 Flash 作为引导智能体,在物理模拟、人物表现和音频支持上较 Genie 3 全面提升,可实时生成可交互的虚拟世界。DeepMind 认为世界模型是通往 AGI 的关键一步,可用于机器人训练环境与创意原型设计。

0 favorites 0 likes
#world-models

Does LeWorldModel Preserve Local Action Geometry?

arXiv cs.LG ↗ · 2026-10-27 Cached

This NeurReps workshop extended abstract evaluates whether pretrained LeWorldModel preserves local action geometry, measuring action sensitivity via Gram matrices across perturbation scales on Reacher and OGBench Cube, finding significant directional discrepancies at small scales and recommending scale-specific evaluation.

0 favorites 0 likes
#world-models

Rollback: Experience Backtracking in World Models for Policy Improvement

Hugging Face Daily Papers ↗ · 2026-10-26 Cached

Rollback 提出了一种利用世界模型回溯到过去的决策点、探索反事实动作并生成细粒度动作级监督的策略改进范式,同时通过真实机器人反馈持续优化世界模型动力学,在三项真实任务上显著提升了机器人策略成功率。

0 favorites 0 likes
#world-models

World-in-Context: Interactive Video World Modeling with In-Context Conditioning

Papers with Code Trending ↗ · 2026-10-23 Cached

World-in-Context introduces an interactive video world modeling framework that unifies view, action, and camera controls as explicit tokens within a shared self-attention space via In-Context Conditioning, along with Interaction-Transport RoPE for temporal continuity. Its 5B model matches the navigation performance of the 22B EchoWM on WBench while achieving a 93.8% perspective-switching success rate versus 18.8% for existing 5B baselines.

0 favorites 0 likes
#world-models

@kyutai_labs: Many world models borrow their video autoencoder from text-to-video generators, and with it, a noticeable lag on every …

X AI KOLs Timeline ↗ · 2026-10-22 Cached

Kyutai Labs releases CADRE, open causal diffusion representation autoencoders that remove the latency typically inherited from text-to-video generators, enabling real-time world models to react faster on a single GPU.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback