cross-view-learning

Imagine3D-LLM proposes teaching multimodal LLMs to imagine a compact 3D representation of a scene (decoded from learnable summary tokens as 3D Gaussian Splatting via photometric reconstruction loss) before answering multi-view spatial reasoning questions, outperforming prior 3D-aware MLLM approaches on multiple benchmarks.