4D Human-Scene Reconstruction from Low-Overlap Captures

Hugging Face Daily Papers Papers

Summary

Proposes StudioRecon, a method for 4D human-scene reconstruction from low-overlap camera captures, using separate priors for backgrounds (video diffusion) and humans (SMPL), with a recursive enhancement module. Accepted to SIGGRAPH 2026, outperforming prior methods by +1.5 to +5.0 dB PSNR.

Existing volumetric capture of dynamic human performance achieves high fidelity with dense camera arrays. However, in real-world scenarios, only a handful of low-overlap cameras are available, which degrades the output quality and leaves large areas unobserved. Recent 4D reconstruction methods have focused on low-overlap settings, yet they still produce noticeable artifacts in under-observed regions. Video diffusion models have emerged as another option, but they show geometrically inconsistent results for humans. To address these limitations, we propose StudioRecon, a pipeline that reconstructs 4D human scenes from sparse, low-overlap cameras by decoupling background and humans. We densify background supervision by synthesizing hundreds of camera-controlled novel views with a video diffusion model. We also robustly initialize deformable Gaussian humans with cross-view identity association and triangulated multi-view keypoint fitting. Finally, our recursive enhancement module with motion-adaptive consistency injection harmonizes the composed output, thereby further avoiding remaining artifacts. We achieve state-of-the-art novel view synthesis across four real-world datasets and demonstrate applications such as novel trajectory rendering and human replacement.
Original Article
View Cached Full Text

Cached at: 07/14/26, 04:12 AM

Paper page - 4D Human-Scene Reconstruction from Low-Overlap Captures

Source: https://huggingface.co/papers/2607.09125 Four cameras around a room, roughly 90° apart, with barely any overlap between neighboring views. COLMAP doesn’t even register them. That’s the setting we went after.

Our insight: backgrounds and humans want different priors, so we stop making one model solve both.

🎬 Video diffusion densifies the background, turning 4 real views into hundreds. 🧍 SMPL constrains the humans, where video diffusion falls apart under motion. ✨ A recursive enhancement module harmonizes the two, without per-frame flicker.

Across 8 scenes from EgoHumans, Harmony4D, Mobile Stage, and SelfCap, StudioRecon outperforms prior methods on every scene: +1.5 to +5.0 dB PSNR over the best baseline, with LPIPS reduced by 33 to 74%.

Accepted to SIGGRAPH Conference Papers ’26. First two authors contributed equally.

Similar Articles

ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video

Hugging Face Daily Papers

ReViV is a unified framework for holistic egocentric 4D reconstruction that simultaneously reconstructs viewer (body, hand, gaze) and view (depth, camera trajectory) dynamics from a single monocular RGB video using a Masked Generative Egocentric Transformer, achieving state-of-the-art accuracy and efficiency.