Tag
A critique of current memory solutions for AI agents, arguing that RAG wrappers and similar approaches fail to address core issues of model bias and context bloat.
Benchmarks vector search libraries (Faiss, Scann, Usearch) for speed, memory, and accuracy across dataset sizes from 500 to 1 million samples, with results and code available.
Laurie Voss of Arize will speak at QDrant's Vector Space Day conference on June 11 in San Francisco, covering retrieval metrics, golden datasets, LLM-as-judge, and continuous evals for CI pipelines.
A practical advice thread recommending to start RAG projects with text search (BM25) instead of defaulting to vector search, to reduce complexity; vector search should be added only when semantic gaps become apparent.
Proposes DIVE, a compression adapter for embedding dimensionality reduction that uses self-limiting gradient updates and head-wise NT-Xent contrastive loss to prevent overfitting on small datasets, outperforming existing methods on BEIR benchmarks.
llm_wiki v0.4.11 released, adds local API Server supporting Agent integration, unified search backend, new knowledge graph search feature, Star count exceeds 8k.
Jerry Liu asks about the current state-of-the-art for file search and retrieval, listing options from grep to hybrid search over a database.
A new open-source tool called Writ uses a hybrid retrieval pipeline with BM25, ONNX vectors, and Neo4j graph traversals to provide context rules for AI coding agents, reducing token bloat by 726x and enforcing plan approval via bash hooks.
Recent paper investigates whether grep outperforms vector search for agentic retrieval, finding grep yields higher accuracy in conversational memory tests, but limitations around enterprise document corpora are noted.
This paper discusses and compares agentic search with vector search approaches.
Jina AI has released jina-embeddings-v5-omni, a universal embedding model supporting text, images, audio, and video with back-compatible indexing capabilities.
Papel is a new research-focused social platform that leverages AI-powered vector search and on-device RAG to help researchers discover, discuss, and quiz themselves on academic papers. It offers personalized feeds, local AI chat via Apple Intelligence or MLX, and gamified learning features.
HelixDB is a new open-source database built in Rust that combines vector, graph, and other data models into a single engine, backed by Y Combinator. It aims to replace separate vector, graph, and application databases for AI stacks, offering native vector search, graph traversal, and MCP support.
Blockify is a new open-source RAG framework that replaces naive chunking with a patented 'IdeaBlocks' pipeline, claiming 40x corpus size reduction, 3x token efficiency, and 2.3x vector search accuracy improvements. It transforms enterprise documents into structured XML knowledge units for more coherent LLM retrieval.
A keynote recording argues that late interaction retrieval (e.g., ColBERT-style) is the most promising direction in AI-scale information retrieval research, contending that single-vector dense retrieval is fundamentally flawed and that the IR community must raise its ambitions significantly. The talk introduces the LIMIT benchmark as evidence of dense retrieval's generalization failures and calls for a paradigm shift by 2030.
turbovec is a Rust vector index with Python bindings implementing Google's TurboQuant algorithm, offering efficient vector search with online ingest, faster-than-FAISS performance, and filtered search capabilities.