@jerryjliu0: Real question: what is the actual latest state-of-the-art for file search and retrieval? - Actual grep over filesystem …
Summary
Jerry Liu asks about the current state-of-the-art for file search and retrieval, listing options from grep to hybrid search over a database.
View Cached Full Text
Cached at: 05/19/26, 12:39 AM
Real question: what is the actual latest state-of-the-art for file search and retrieval?
- Actual grep over filesystem
- Virtualized grep / BM25 over a db (what @mintlify did)
- Vector search over a db
- Hybrid search over a db
- SQL
- none of the above
- some of the above?
Similar Articles
@jerryjliu0: There’s an open question on whether grep is all you need for agentic search. This recent paper by @PwCUS (Sen et al.) s…
Recent paper investigates whether grep outperforms vector search for agentic retrieval, finding grep yields higher accuracy in conversational memory tests, but limitations around enterprise document corpora are noted.
@jerryjliu0: We've built the following document retrieval endpoints into LlamaParse: * Hybrid search (grep + vector search) * File g…
LlamaParse introduces new document retrieval endpoints including hybrid search, file grep, file find, and file read, aiming to improve agentic retrieval quality over unstructured documents.
@omarsar0: // Is Grep All You Need? // Pay attention to this on, AI devs. (bookmark it) They find that grep-style text search, whe…
A research paper from PwC finds that grep-style text search, when properly integrated into agent harnesses, can match or beat embedding-based retrieval for coding-agent tasks, suggesting vector databases may not be essential for many use cases.
@garrytan: Lots of retrieval systems seem to give you keyword matching and graph retrieval in a raw format This plus graph travers…
Garry Tan highlights a retrieval system that uniquely combines keyword matching, graph traversal, and gap analysis, an approach not seen elsewhere.
@HowToPrompt__: The entire vector database industry just got destroyed by A free tool from 1974. For the last two years, every company …
Researchers report that the classic grep command outperforms modern vector databases in retrieval tasks for autonomous AI agents, challenging the prevailing RAG infrastructure approach.