Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction

Papers with Code Trending Papers

Summary

ABot-Recon enables real-time 3D reconstruction of large-scale environments from continuous video streams by using a fixed local context, achieving high efficiency and low memory usage.

Streaming 3D reconstruction from extremely long videos requires estimating camera motion and scene geometry online under bounded memory and computation. Early streaming models achieve causal, bounded-cost inference using finite context buffers or compact recurrent states, yet their estimates often deteriorate as sequences grow. Recent methods improve long-horizon stability by coupling short-range context with persistent or multi-level long-range memory. We pursue a different route: we keep the learned temporal state strictly local and formulate predictions whose targets remain independent of sequence length. We present ABot-Recon, a simple streaming model that caches KV features from only the preceding 11 frames. It predicts a point map in the current camera coordinate system together with an adjacent-frame relative pose. These predictions remain equivariant under changes of reference frame, and global poses and geometry are recovered through sequential composition. To reduce accumulated drift, a lightweight temporal refiner improves relative rotations using recent visual and motion context, while a composition-aware pose loss supervises multi-step pose composition. Extensive evaluations on challenging long-sequence benchmarks demonstrate the superior long-horizon performance of our local-context approach. On Oxford Spires, ABot-Recon achieves an ATE of 4.35 m and an RPE-R of 0.12^circ, reducing both errors by approximately 40\% relative to the best prior results.
Original Article
View Cached Full Text

Cached at: 09/01/26, 12:41 PM

Paper page - Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction

Source: https://huggingface.co/papers/2608.27529 ABot-Recon turns a single continuous video into a globally consistent 3D reconstruction in real time. Whether walking around a building with a phone, driving through city streets with a dashcam, or flying a drone over a campus, it reconstructs long video streams using only a fixed 12-frame local context, composing current-frame geometry and adjacent relative poses without persistent learned long-range memory. It scales to 10,000 + frame sequences at 24.45 FPS with only 6.71 GB of GPU memory, enabling efficient real-time 3D reconstruction of large-scale environments.

teaser

Similar Articles

robbyant/lingbot-map

Hugging Face Models Trending

LingBot-Map is a feed-forward 3D foundation model for streaming 3D reconstruction that uses a Geometric Context Transformer architecture, achieving state-of-the-art performance with efficient ~20 FPS inference on long sequences exceeding 10,000 frames.

HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction

Hugging Face Daily Papers

HorizonStream introduces a long-horizon attention mechanism for streaming 3D reconstruction that explicitly models geometric propagation via an evidence influence kernel, achieving stable, scalable reconstruction with constant memory and linear time complexity, and generalizing to sequences over 10,000 frames.