Tag
Stream3D-VLM is an online 3D vision-language model that enables real-time spatial understanding from streaming video by incrementally integrating geometry priors and using geometry-adaptive voxel compression, outperforming existing models on 3D spatial understanding tasks.
PanoWorld introduces spherical spatial cross-attention for panoramic reasoning, addressing limitations of MLLMs in 360-degree spatial understanding. It builds a large-scale pipeline for geometry-aware supervision and proposes a diagnostic benchmark, achieving state-of-the-art results on multiple benchmarks.