4D Human-Scene Reconstruction from Low-Overlap Captures
Summary
Proposes StudioRecon, a method for 4D human-scene reconstruction from low-overlap camera captures, using separate priors for backgrounds (video diffusion) and humans (SMPL), with a recursive enhancement module. Accepted to SIGGRAPH 2026, outperforming prior methods by +1.5 to +5.0 dB PSNR.
View Cached Full Text
Cached at: 07/14/26, 04:12 AM
Paper page - 4D Human-Scene Reconstruction from Low-Overlap Captures
Source: https://huggingface.co/papers/2607.09125 Four cameras around a room, roughly 90° apart, with barely any overlap between neighboring views. COLMAP doesn’t even register them. That’s the setting we went after.
Our insight: backgrounds and humans want different priors, so we stop making one model solve both.
🎬 Video diffusion densifies the background, turning 4 real views into hundreds. 🧍 SMPL constrains the humans, where video diffusion falls apart under motion. ✨ A recursive enhancement module harmonizes the two, without per-frame flicker.
Across 8 scenes from EgoHumans, Harmony4D, Mobile Stage, and SelfCap, StudioRecon outperforms prior methods on every scene: +1.5 to +5.0 dB PSNR over the best baseline, with LPIPS reduced by 33 to 74%.
Accepted to SIGGRAPH Conference Papers ’26. First two authors contributed equally.
Similar Articles
4DAnyone: Create Anyone in 4D from a Casual Monocular Video
4DAnyone reconstructs 4D humans from monocular video by generating multiview-consistent videos and lifting them into 4D Gaussian Splatting, using reference and target context designs to address scaling bottlenecks.
Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild
Lift4D is a test-time optimization framework that reconstructs complete 4D geometry, appearance, and deformation of dynamic objects from a single monocular in-the-wild video, improving over prior methods on challenging sequences with occlusions and non-rigid motion.
GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction
GenRecon introduces a method for 3D scene reconstruction that integrates generative 3D priors with multi-view image conditioning, achieving high-fidelity, editable mesh reconstructions of indoor environments and outperforming existing methods by 16%.
AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Model
AnyRecon proposes a scalable framework for 3D reconstruction from arbitrary sparse inputs using a video diffusion model with persistent scene memory and geometry-aware conditioning.
Beyond Pixels: From Video Priors to 4D Worlds
This paper introduces Latent-to-4D, a method for direct 4D scene generation from video diffusion latents without retraining across generators, achieving better geometry and temporal stability than cascaded approaches.