@GZinMetaverse: For the past 3 months, I've been heads down building and extending our multimodal data capture rig for Physical AI trai…
Summary
The author has built and extended a multimodal data capture rig for Physical AI training, featuring synchronized RGB, depth, 3D hand reconstruction, and tactile pressure data, and has deployed it globally.
View Cached Full Text
Cached at: 09/02/26, 08:02 PM
For the past 3 months, I’ve been heads down building and extending our multimodal data capture rig for Physical AI training.
What you’re seeing here is a single synchronized capture from our system — RGB, depth (stereo IR camera) feed; real-time 3D hand reconstruction, and a 23×20 tactile pressure grid from sensor gloves, all aligned and timestamped together.
Getting here took a lot of unglamorous iteration. We reworked the pipeline to deliver clean, gap-free depth at scale after identifying early depth frame drops caused by data throughput bottlenecks in our capture box. We built per-channel calibration models that convert raw resistance signals from our flex sensor gloves into accurate, drift-corrected force values — solving the creep behavior that made a steady grip falsely appear to fade over time.
Even though we’ve stayed quiet on socials, word of mouth spread — our rigs have already been deployed in data factories, manufacturing lines, and homes across the US, Europe, China, and Southeast Asia by our customers and ourselves.
In the next few days, I’ll be sharing more about how we’re tackling rights-cleared data capture from the hardware level, and our closed-loop data-model flywheel — using model evaluation results to identify gaps and guide what data our customers need. More soon, stay tuned…
Similar Articles
@RemiCadene: Pretty cool!
Preload (YC F26) announced synchronized egocentric video, EMG, and tactile data collection for robot manipulation, VLAs, and world models, offering end-to-end robotic data collection at scale.
@svpino: Nice way to generate training data for building robotic models: 1. Go to this platform and define the experience your m…
Maxinsights announced a $30M seed round led by Peak XV Partners for a platform that captures real-world human work via camera-wearing operators to generate organized training datasets for robotic models. Two new products were also announced alongside the funding.
@VraserX: Figure is collecting roughly 35 minutes of human physical experience every second and has committed $3.5B of compute to…
Figure is collecting vast amounts of physical experience data and committing significant compute to Helix, underscoring the shift towards data and compute-driven competition in humanoid robotics AI.
@macrodata_labs: Everyone is betting on Egocentric data to scale robotics But turning that footage into training data requires recoverin…
Macrodata Labs releases a research blog on scaling robotics with egocentric video data by recovering 3D hand motion signals using only open-source models.
ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine
Introduces ACE-Data-0, a large-scale embodied AI dataset with 150 hours of synchronized multimodal human demonstrations across 200 task categories, captured by the Ambient Capture Engine (ACE) in real home environments. Includes a hierarchical benchmark exposing gaps in current methods under contact, occlusion, and long horizons.