'Touch dreaming' helps humanoid robots handle five tricky tasks with 90.9% higher success

Reddit r/singularity Papers

Summary

Researchers from CMU and Bosch Center for AI introduced the Humanoid Transformer with Touch Dreaming (HTD) model, which uses tactile signal prediction to improve humanoid robot manipulation, achieving a 90.9% higher average success rate over the ACT baseline across five real-world tasks.

https://arxiv.org/abs/2604.13015 https://humanoid-touch-dream.github.io/ Researchers at Carnegie Mellon University (CMU) and the Bosch Center for AI recently developed a new artificial intelligence (AI)-based system that could improve the ability of humanoid robots to perform dexterous whole-body manipulation in contact-rich real-world settings. Their proposed AI model, dubbed Humanoid Transformer with Touch Dreaming (HTD), was introduced in a paper published on the arXiv pre-print server. "Across five real-world tasks, namely insert-T, book organization, towel folding, cat litter scooping, and tea serving, HTD achieved a 90.9% relative improvement in average success rate over the stronger ACT baseline. "Our ablations also showed that simply adding touch as an extra input is not enough. Predicting tactile signals in latent space was more effective than predicting raw tactile signals directly, yielding a 30% relative gain in success rate over raw tactile dreaming."
Original Article

Similar Articles

tencent/HY-Embodied-0.5

Hugging Face Models Trending

Tencent releases HY-Embodied-0.5, a suite of foundation models designed for embodied AI agents featuring a Mixture-of-Transformers (MoT) architecture with efficient 2B and powerful 32B variants for real-world robot control and spatial-temporal reasoning.