@zhuofengli96475: DCI just hit #1 on Hugging Face Daily Papers! Try it Now! @HuggingPapers https://huggingface.co/papers/2605.05242…
Summary
DCI (Direct Corpus Interaction) proposes using simple terminal tools like grep and bash for agentic search, outperforming traditional retrieval methods without embeddings or vector indexes.
View Cached Full Text
Cached at: 05/16/26, 09:24 PM
🚀 DCI just hit #1 on Hugging Face Daily Papers! Try it Now! @HuggingPapers
https://t.co/h1CWuCtuQz https://t.co/8K2O7zZ7vq
Paper page - Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interaction
Source: https://huggingface.co/papers/2605.05242 Published on May 3
#2 Paper of the day Authors:
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
Direct corpus interaction enables more effective agentic search by allowing agents to query raw text directly, outperforming traditional retrieval methods in complex tasks.
Modernretrieval systems, whether lexical or semantic, expose a corpus through a fixed similarity interface that compresses access into a single top-k retrieval step before reasoning. This abstraction is efficient, but foragentic search, it becomes a bottleneck: exact lexical constraints, sparse clue conjunctions, local context checks, and multi-step hypothesis refinement are difficult to implement by calling a conventional off-the-shelf retriever, and evidence filtered out early cannot be recovered by stronger downstream reasoning. Agentic tasks further exacerbate this limitation because they require agents to orchestrate multiple steps, including discovering intermediate entities, combining weak clues, and revising the plan after observing partial evidence. To tackle the limitation, we studydirect corpus interaction(DCI), where an agent searches the raw corpus directly with general-purposeterminal tools(e.g., grep, file reads, shell commands, lightweight scripts), without any embedding model, vector index, or retrieval API. This approach requires no offline indexing and adapts naturally to evolving local corpora. AcrossIR benchmarksand end-to-endagentic searchtasks, this simple setup substantially outperforms strong sparse, dense, andrerankingbaselines on several BRIGHT andBEIR datasets, and attains strong accuracy onBrowseComp-Plusandmulti-hop QAwithout relying on any conventional semantic retriever. Our results indicate that as language agents become stronger, retrieval quality depends not only on reasoning ability but also on the resolution of the interface through which the model interacts with the corpus, with which DCI opens a broader interface-design space foragentic search.
View arXiv pageView PDFGitHub207Add to collection
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.05242 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.05242 in a dataset README.md to link it from this page.
Spaces citing this paper2
Collections including this paper5
Browse 5 collections that include this paper
Zhuofeng Li (@zhuofengli96475): 🔥 Introducing Direct Corpus Interaction (DCI)! The best retriever for agentic search is no retriever.
🚀 We replaced the entire agentic search pipeline — embedding model, vector index, top-k retrieval — with only
grepandbash. 🔧📄 Paper: https://t.co/h1CWuCtuQz
DCI
Similar Articles
Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interaction
The paper introduces Direct Corpus Interaction (DCI), a novel approach allowing AI agents to query raw text directly using standard terminal tools instead of traditional embedding-based retrieval. By bypassing fixed similarity interfaces and offline indexing, DCI significantly outperforms conventional sparse, dense, and reranking baselines across multiple IR and agentic search benchmarks.
Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion
This paper introduces DR-DCI, a retriever-steered framework for scaling direct corpus interaction by dynamically expanding a local workspace, achieving improved accuracy and efficiency in agentic search over large corpora.
@johnsonshi86: https://x.com/johnsonshi86/status/2072112215097024961
Describes DR-DCI, an optimization that combines RAG with bash commands on a virtual filesystem to enable agents to perform precise corpus retrieval, and discusses scaling to distributed systems for inference providers.
@dair_ai: https://x.com/dair_ai/status/2056018543850754283
A roundup of the top AI papers from May 11-17, covering Lighthouse Attention for long-context pretraining, a comparison of grep vs embedding retrieval for coding agents, and mechanistic interpretability work revealing a geometric calculator in LLMs.
Reviving PapersWithCode (by Hugging Face) [P]
Niels from Hugging Face announces the revival of PapersWithCode as paperswithcode.co, a platform that parses high-impact AI papers at scale and automatically generates leaderboards and benchmarks, incorporating features like trending papers, domain categorization, and external paper support.