τ_0-VLA: a Hierarchical Robot Foundation Model with World-Model-Guided Test-Time Computation
Summary
A hierarchical vision-language-action model improves long-horizon robot manipulation by using world-model-guided test-time search to scale computation for high-level subtask decisions.
View Cached Full Text
Cached at: 08/21/26, 04:10 PM
Paper page - τ_0-VLA: a Hierarchical Robot Foundation Model with World-Model-Guided Test-Time Computation
Source: https://huggingface.co/papers/2608.16885 Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
A hierarchical vision-language-action model improves long-horizon robot manipulation by using world-model-guided test-time search to scale computation for high-level subtask decisions.
Long-horizon robot manipulation requires a robot to both execute individual skills reliably and sequence them coherently over extended tasks. Most hierarchicalvision-language-action(VLA) models make each such decision with a single forward pass, leaving no mechanism to allocate additional computation to difficult or consequential choices. We introduce τ_0-VLA, a hierarchical robot foundation model that formulates high-levelsubtask generationas a compute-scalable inference problem throughworld-model-guided test-time computation. At each inference step, the high-level policy usesexecution memoryto generate a subtask and, when needed, searches over alternatives before committing to its output. Alow-level policythen executes the generated subtask across multiple robot embodiments. The policy is trained on 40,115 hours of heterogeneous real-world data withmultimodal co-training. Across in-domain and distribution-shifted settings, allocating additional test-time computation substantially improves next-subtask prediction accuracy, and these gains translate into higher closed-loop success on long-horizon robot manipulation tasks.
View arXiv pageView PDFProject pageGitHubAdd to collection
Get this paper in your agent:
hf papers read 2608\.16885
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper1
#### sii-research/tau-0-vla Robotics• 3B• Updated3 days ago • 196 • 3
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2608.16885 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2608.16885 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation System
HiVLA introduces a hierarchical vision-language-action framework that decouples semantic planning from motor control using a diffusion transformer action expert for improved robotic manipulation. The system combines a VLM planner for task decomposition and visual grounding with a specialized DiT action expert using cascaded cross-attention, outperforming end-to-end baselines particularly in long-horizon tasks and fine-grained manipulation.
SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
SmolVLA is a compact vision-language-action model that achieves competitive robotic control performance at reduced computational cost, enabling deployment on consumer-grade hardware. It introduces asynchronous inference and leverages community-collected datasets.
Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stack
HyVLA-0.5 is an end-to-end robotic learning system that integrates data collection, model design, pre-training, fine-tuning, and reinforcement learning for real-world deployment.
InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization
InternVLA-A1.5 integrates pretrained vision-language models with future prediction in latent space to enable efficient robot manipulation with compositional generalization and long-horizon execution, achieving state-of-the-art results on simulation benchmarks.
VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies
VisualThink-VLA introduces a visual intermediate reasoning framework for vision-language-action policies that preserves spatial precision and dramatically reduces latency compared to text-based reasoning, achieving sub-second inference and state-of-the-art success rates on robot manipulation benchmarks.