CoDance: Learning Reactive and Compliant Human-Humanoid Interaction from Video
Summary
CoDance 提出一个从单个双人舞蹈视频中学习反应式、柔顺的人机交互框架,通过多连杆柔顺性增强将运动学演示转化为力感知训练数据,使人形机器人能在物理演示中与人类伙伴完成持续双手舞蹈并灵活调整步态。
View Cached Full Text
Cached at: 10/08/26, 03:58 PM
Paper page - CoDance: Learning Reactive and Compliant Human-Humanoid Interaction from Video
Source: https://huggingface.co/papers/2610.05324
Abstract
Partneredhuman-humanoidinteractioncoupleslocomotionwithcontinuousphysicalcontact.Ahumanoidneedstocoordinatewithaperson’smotionwhilerespondingtointeractionforcesandmaintainingstableandnaturalmovement.WepresentCoDance,aframeworkforlearningreactiveandcomplianthuman-humanoidinteractionfromvideo.Westudypartnereddancingasachallenginginstantiation,whereahumanoidcoordinatesitsfootstepswithamovingpartnerandmaintainscontinuoustwo-handcontact.Givenasinglevideooftwohumandancers,CoDanceretargetstheirmotionsintoarobotreferenceandamovingpartner.Weintroduceamulti-linkcomplianceaugmentationthattransformsthekinematicdemonstrationintoforce-awaretrainingdatabyadaptingtherobotreferenceunderstructuredforcesatbothhands.Policiestrainedonthisdatafollowtheobservedpartnerwhilepreservingthedemonstratedlocomotionstyleandrespondingcompliantlytophysicalinteraction.Insimulation,thepoliciesadapttheirfootstepstochangesinthepartnerandreproduceapproximately80%ofthewristdisplacementencodedbytheaugmenteddemonstrations.Onaphysicalhumanoid,CoDanceenablessustainedtwo-handdancingwithahumanpartnerincludingrepeatedtransitionsbetweenforwardandbackwardmotions.
View arXiv pageView PDFProject pageGitHub5Add to collection
Get this paper in your agent:
hf papers read 2610\.05324
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2610.05324 in a model README.md to link it from this page.
Datasets citing this paper1
#### GeneralRoboticsLab/CoDance Updatedabout 1 hour ago • 28
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2610.05324 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
CoDA: Co-Evolution of Data Engines and Action Policies
CoDA 提出一种仿真数据引擎与机器人动作策略协同演进的框架,通过共享失败与学习进展记忆、视觉语言诊断以及 Text2potential 分阶段势能奖励,将机器人操作任务的分布外成功率从 5.3% 提升至 27.6%,并在 LIBERO-Pro 上取得显著改善。
DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation
DeVI introduces a framework that turns text-conditioned synthetic videos into physically plausible dexterous robot control via a hybrid 3D-2D tracking reward, enabling zero-shot generalization to unseen objects.
CoInteract: Physically-Consistent Human-Object Interaction Video Synthesis via Spatially-Structured Co-Generation
CoInteract introduces an end-to-end Diffusion Transformer framework that jointly models RGB appearance and HOI geometry to generate physically-plausible human-object interaction videos with stable hands/faces and zero inference overhead.
InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation
InterMimicGen 提出一个自我进化的运动模仿框架,通过数据飞轮将稀疏的人-物交互动作捕捉数据转化为持续扩展的、可执行的人形机器人全身 loco-manipulation 动作资源,并实现向真实机器人的迁移。
Learning Transferable World-Action Models from Task-Paired Human Videos
该论文提出WATCH,一种跨视频预训练方法,通过任务配对的人类演示学习可迁移的世界-动作模型,无需人-机器人配对数据;在机器人后训练后将MimicDroid的上下文内成功率从40.9%提升至68.3%(Cosmos Policy)以及从59.8%提升至77.7%(Cosmos 3)。