GeoStack: A Framework for Quasi-Abelian Knowledge Composition in VLMs
Summary
GeoStack introduces a geometric framework to compose independently trained domain experts in Vision-Language Models without catastrophic forgetting, achieving constant-time inference and a 10x reduction in geometric error.
View Cached Full Text
Cached at: 05/08/26, 06:28 PM
Paper page - GeoStack: A Framework for Quasi-Abelian Knowledge Composition in VLMs
Source: https://huggingface.co/papers/2605.06477
https://huggingface.co/login?next=%2Fpapers%2F2605.06477- 
Abstract
GeoStack is a modular framework that composes domain experts in Vision-Language Models while preserving foundational knowledge and enabling constant-time inference through geometric constraints on adapter manifolds.
We address the challenge of knowledge composition inVision-Language Models(VLMs), where accumulating expertise across multiple domains or tasks typically leads tocatastrophic forgetting. We introduce GeoStack (Geometric Stacking), a modular framework that allows independently traineddomain expertsto be composed into a unified model. By imposing geometric and structural constraints on theadapter manifold, GeoStack ensures the foundational knowledge of the base model is preserved. Furthermore, we mathematically demonstrate aweight-folding propertythat achieves constant-time inference complexity (O(1)), regardless of the number of integrated experts. Experimental results acrossmulti-domain adaptationandclass-incremental learningshow that GeoStack provides an efficient mechanism for long-term knowledge composition while significantly mitigatingcatastrophic forgetting. Code is available at https://github.com/QuantitativeImagingLaboratory/GeoStack.
View arXiv pageView PDFProject pageGitHub0Add to collection
Community
Paper submitter
How many domain experts can you stack before a VLM collapses? 🧱
GeoStack introduces a geometric framework to compose independently trained experts into a single model with zero added inference cost. By using a perturbation prior and orthogonality constraints, it achieves a 10x reduction in geometric error compared to standard adapters.
If you’re looking for a way to build specialized VLMs that don’t forget their foundational knowledge, check this out!
Upload images, audio, and videos by dragging in the text input, pasting, orclicking here.
Tap or paste here to upload images
https://huggingface.co/login?next=%2Fpapers%2F2605.06477-
Get this paper in your agent:
hf papers read 2605\.06477
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.06477 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.06477 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.06477 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models
GeoVR enhances multimodal large language models with 3D awareness by restructuring their semantic latent space through geometric knowledge distillation from 3D foundation models using multiple geometric targets.
Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
This paper proposes GASP, a framework that injects geometric priors into vision-language models via deep supervision with contrastive and depth consistency losses, achieving significant improvements on 3D spatial reasoning benchmarks without using 3D VQA data.
Stream3D-VLM: Online 3D Spatial Understanding with Incremental Geometry Priors
Stream3D-VLM is an online 3D vision-language model that enables real-time spatial understanding from streaming video by incrementally integrating geometry priors and using geometry-adaptive voxel compression, outperforming existing models on 3D spatial understanding tasks.
Geo-Spatial Concept Probing of Large Language Models: Abstraction, Compositionality, and Grounding
This paper introduces a concept-centric benchmark to probe LLMs' understanding of geo-spatial concepts like direction, distance, and topology, testing abstraction, compositionality, and grounding across various model architectures and scales. Findings reveal clear limitations in current LLMs' conceptual understanding.
MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaverse
MetaSpatial is a reinforcement learning framework that enhances 3D spatial reasoning in vision-language models, enabling coherent and physically plausible 3D scene generation without hard-coded optimizations.