@perdactor: 1/ Meet Argus-Retriever: the first late-interaction visual doc retriever where the document representation adapts to th…
Summary
Argus-Retriever is a new late-interaction visual document retriever that adapts document representation to the query, achieving SOTA performance on ViDoRe benchmarks with a smaller index.
View Cached Full Text
Cached at: 06/08/26, 07:18 AM
1/👁️ Meet Argus-Retriever: the first late-interaction visual doc retriever where the document representation adapts to the query: D(q).
- 86.0 NDCG@5 on ViDoRe V1+V2 (SOTA open model)
- 📦 1024-dim head, 4.5× smaller index
Sumit (@_reachsumit): Argus-Retriever: Vision-LLM Late-Interaction Retrieval with Region-Aware Query-Conditioned MoE for Visual Document Retrieval
Introduces a query-conditioned late-interaction visual document retriever.
📝 https://t.co/oB5oa4bgKc 👨🏽💻
1/ Meet Argus-Retriever: the first late-interaction visual doc retriever where the document representation adapts to the query: D(q).
- 86.0 NDCG@5 on ViDoRe V1+V2 (SOTA open model)
- 1024-dim head, 4.5× smaller index
2/ The idea: a region-aware Mixture-of-Experts inside the document encoder. A router reads each region’s content, its 2D position, and a pooled query context z_q, then mixes 4 latent experts (+1 shared). The page is now encoded differently per query → D(q). Still MaxSim.
Similar Articles
VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents
This paper presents VLD-RAG, an agentic multimodal retrieval-augmented generation framework for question answering over long, visually-rich documents. It uses a page-preserving index and a verifier-guided agent workflow to improve cross-page evidence retrieval and reasoning, outperforming prior vision-based baselines on benchmarks like LongDocURL and MMLongBench-Doc.
@Julian_a42f9a: Late-interaction retrieval models are widely used for their strong performance, but their representations can be utiliz…
A new paper shows that late-interaction retrieval model representations can effectively replace raw document text in RAG tasks, extending their utility beyond retrieval.
@mixedbreadai: https://x.com/mixedbreadai/status/2071678747439505816
Mixedbread AI introduces asymmetric quantization for late interaction retrieval, achieving 32x storage reduction with minimal quality loss by storing document vectors as binary signs while keeping query vectors high-precision, making late interaction practical for billion-scale production systems.
RAGOCR: Optical Compression of Retrieval-Augmented Text via Visual Representation
RAGOCR is a novel framework that compresses retrieved documents into compact visual representations conditioned on the input query, using query-aware dynamic resolution to balance compression rate and information fidelity. Experiments show it surpasses naive RAG by over 15% accuracy while using only one-eighth the input tokens.
Help with a Local Document RAG System (Storage + Ingestion + Query + Highlighting)
A detailed technical query about building a local document RAG system covering storage, ingestion, query, and highlighting, seeking advice on vector databases, GraphRAG feasibility, and document highlighting implementations.