4D Human-Scene Reconstruction from Low-Overlap Captures
Summary
Proposes StudioRecon, a method for 4D human-scene reconstruction from low-overlap camera captures, using separate priors for backgrounds (video diffusion) and humans (SMPL), with a recursive enhancement module. Accepted to SIGGRAPH 2026, outperforming prior methods by +1.5 to +5.0 dB PSNR.
View Cached Full Text
Cached at: 07/14/26, 04:12 AM
Paper page - 4D Human-Scene Reconstruction from Low-Overlap Captures
Source: https://huggingface.co/papers/2607.09125 Four cameras around a room, roughly 90° apart, with barely any overlap between neighboring views. COLMAP doesn’t even register them. That’s the setting we went after.
Our insight: backgrounds and humans want different priors, so we stop making one model solve both.
🎬 Video diffusion densifies the background, turning 4 real views into hundreds. 🧍 SMPL constrains the humans, where video diffusion falls apart under motion. ✨ A recursive enhancement module harmonizes the two, without per-frame flicker.
Across 8 scenes from EgoHumans, Harmony4D, Mobile Stage, and SelfCap, StudioRecon outperforms prior methods on every scene: +1.5 to +5.0 dB PSNR over the best baseline, with LPIPS reduced by 33 to 74%.
Accepted to SIGGRAPH Conference Papers ’26. First two authors contributed equally.
Similar Articles
Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild
Lift4D is a test-time optimization framework that reconstructs complete 4D geometry, appearance, and deformation of dynamic objects from a single monocular in-the-wild video, improving over prior methods on challenging sequences with occlusions and non-rigid motion.
GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction
GenRecon introduces a method for 3D scene reconstruction that integrates generative 3D priors with multi-view image conditioning, achieving high-fidelity, editable mesh reconstructions of indoor environments and outperforming existing methods by 16%.
AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Model
AnyRecon proposes a scalable framework for 3D reconstruction from arbitrary sparse inputs using a video diffusion model with persistent scene memory and geometry-aware conditioning.
VideoMDM: Towards 3D Human Motion Generation From 2D Supervision
VideoMDM trains 3D human motion priors from 2D poses using a diffusion framework with 2D reprojection loss and 3D motion regularizers, achieving near-3D supervised performance without requiring 3D ground truth.
ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video
ReViV is a unified framework for holistic egocentric 4D reconstruction that simultaneously reconstructs viewer (body, hand, gaze) and view (depth, camera trajectory) dynamics from a single monocular RGB video using a Masked Generative Egocentric Transformer, achieving state-of-the-art accuracy and efficiency.