VLA-Precision: Asymmetric Co-Bootstrapping for Efficient Real-World Online RL of Vision-Language-Action Models

Hugging Face Daily Papers Papers
vision-language-action online-rl real-world-robotics efficiency ai-framework

Summary

VLA-Precision introduces an efficient real-world online reinforcement learning framework using Asymmetric Co-Bootstrapping to improve Vision-Language-Action models, achieving high success rates in precision tasks.

Pretrained vision-language-action (VLA) models enable broad manipulation but remain unreliable in tasks demanding precision and repeatability. Applying real-world online reinforcement learning (RL) to VLA post-training enables autonomous trial-and-error improvement beyond demonstrations alone, but exposes two bottlenecks: 1) unreliable value signals can induce policy drift; 2) large-VLA overhead constrains throughput and sample efficiency. To address these challenges, we present VLA-Precision, an efficient real-world online RL framework featuring the Asymmetric Co-Bootstrapping (ACoB) algorithm and the ACoB-Stream architecture. Specifically, ACoB establishes asymmetric co-bootstrapping across timescales: early intervention-guided behavioral learning rapidly improves policy performance while enhancing online experience quality. As autonomous experience accumulates, global return propagation and local preference ranking progressively calibrate value estimates, yielding relative action advantages for reference-regularized policy improvement while suppressing drift. To enable ACoB on large VLAs, we develop ACoB-Stream, a closed-loop experience--policy architecture that establishes invariant-state decoupling and on-demand streaming as design principles, delivering up to 10.9times improvements in throughput and computational efficiency. Extensive evaluations on nine high-precision chemistry tasks across four categories and four robot embodiments show that VLA-Precision achieves 98.3\% mean success rate in 45.8 min/task, with 27.6 s episodes running at 1.2times and 1.8times the speeds of VLA and RL baselines. Resources are available at https://vla-precision.github.io.
Original Article
View Cached Full Text

Cached at: 09/28/26, 12:04 PM

Paper page - VLA-Precision: Asymmetric Co-Bootstrapping for Efficient Real-World Online RL of Vision-Language-Action Models

Source: https://huggingface.co/papers/2609.04355 Authors:

,

,

,

,

,

,

,

,

,

Abstract

Pretrainedvision-language-action(VLA)modelsenablebroadmanipulationbutremainunreliableintasksdemandingprecisionandrepeatability.Applyingreal-worldonlinereinforcementlearning(RL)toVLApost-trainingenablesautonomoustrial-and-errorimprovementbeyonddemonstrationsalone,butexposestwobottlenecks:1)unreliablevaluesignalscaninducepolicydrift;2)large-VLAoverheadconstrainsthroughputandsampleefficiency.Toaddressthesechallenges,wepresentVLA-Precision,anefficientreal-worldonlineRLframeworkfeaturingtheAsymmetricCo-Bootstrapping(ACoB)algorithmandtheACoB-Streamarchitecture.Specifically,ACoBestablishesasymmetricco-bootstrappingacrosstimescales:earlyintervention-guidedbehaviorallearningrapidlyimprovespolicyperformancewhileenhancingonlineexperiencequality.Asautonomousexperienceaccumulates,globalreturnpropagationandlocalpreferencerankingprogressivelycalibratevalueestimates,yieldingrelativeactionadvantagesforreference-regularizedpolicyimprovementwhilesuppressingdrift.ToenableACoBonlargeVLAs,wedevelopACoB-Stream,aclosed-loopexperience--policyarchitecturethatestablishesinvariant-statedecouplingandon-demandstreamingasdesignprinciples,deliveringupto10.9timesimprovementsinthroughputandcomputationalefficiency.Extensiveevaluationsonninehigh-precisionchemistrytasksacrossfourcategoriesandfourrobotembodimentsshowthatVLA-Precisionachieves98.3\%meansuccessratein45.8min/task,with27.6sepisodesrunningat1.2timesand1.8timesthespeedsofVLAandRLbaselines.Resourcesareavailableathttps://vla-precision.github.io.

View arXiv pageView PDFProject pageGitHub81Add to collection

Get this paper in your agent:

hf papers read 2609\.04355

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.04355 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.04355 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.04355 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Hierarchical Advantage Weighting for Online RL Fine-Tuning of VLAs from Sparse Episode Outcomes

Hugging Face Daily Papers

This paper proposes Hierarchical Advantage-Weighted Behavior Cloning (HABC) for fine-tuning Vision-Language-Action (VLA) policies using online reinforcement learning with sparse binary episode outcomes. HABC separates viability and efficiency objectives via adaptive critic heads and intervention-aware credit assignment, significantly improving success rates on contact-rich bimanual manipulation tasks.

From Foundation to Application: Improving VLA Models in Practice

Papers with Code Trending

This paper presents LingBot-VLA 2.0, which enhances VLA foundation models for robotics by improving generalization across tasks and embodiments, expanding action space to whole-body degrees of freedom, and incorporating predictive dynamics modeling for better temporal reasoning.