Tag
The author benchmarks classic vector RAG against Google's new Open Knowledge Format (OKF) and a hybrid approach using a local stack (Ollama, ChromaDB), finding hybrid retrieval answers more questions correctly but at higher token cost, while highlighting specific failure modes.
Turbopuffer announces beta support for late interaction, enabling models like ColBERT to represent text as token-level vectors, combining a fast single-vector ANN first pass with exact late interaction reranking to improve recall.
Alibaba Cloud's OBI tool enables root-causing wrong AI answers in under 60 seconds without code changes by capturing the full AI execution path at the kernel layer.
The author describes their journey building an Enterprise Knowledge Graph Agentic RAG system, combining semantic retrieval, BM25 lexical search, and knowledge graph traversal, emphasizing that production AI requires multiple retrieval strategies.
This article discusses five chunking strategies for RAG systems, highlighting the tradeoffs between retrieval precision and reasoning context, and emphasizing that proper chunking is crucial for effective retrieval.
This guide explains HyDE (Hypothetical Document Embeddings), a technique that improves RAG retrieval by generating and embedding a hypothetical answer before searching the knowledge base, and provides a Python implementation with production guardrails.
Notion shares how it scaled its vector search infrastructure by 10x while reducing costs by 90% over two years, detailing their architecture evolution from launch to handling millions of workspaces.
Slater is a low-memory graph database for read-heavy workloads that serves large graphs from disk using a fixed cache budget, enabling query of hundreds of millions of nodes and billions of edges from just a few hundred MB of RAM, with standard Bolt protocol compatibility and live writes.
A tweet by Gergely Orosz highlights that Simon Eskildsen, founder of turbopuffer, kept a blog from 2010–2014, and shares a comprehensive list of recent talks and podcasts about turbopuffer and vector search.
Google open-sourced a vector index that compresses 31GB of AI memory to 4GB, fitting 10 million documents and searching faster than FAISS, with zero training or GPU required.
A summary of research comparing agent-memory solutions from Cognee, Graphiti, and Neo4j, which all use knowledge graphs and vector search with LLM-based data extraction.
Wire, a platform for AI agent context containers, is migrating from Cloudflare Durable Objects to a custom runtime on Fly Machines due to structural limits: vector index separation, compute-data colocation, placement flexibility, and lack of self-hosting. The new architecture improves latency and enables dedicated capacity.
Firn is an open-source, multi-tenant vector and full-text search engine backed by object storage like AWS S3, providing a tiered storage architecture with RAM and NVMe caching for performance. It achieves sub-second cold queries with IVF_PQ indexes and microsecond warm hits via result caching.
BaryGraph introduces a novel knowledge graph where every relationship is a first-class embedded document (BaryEdge) rather than an edge between nodes, enabling recursive abstraction triads that surface structural bridges between distant concepts. The preprint includes benchmarks showing structural metrics correlate with human similarity judgments better than cosine similarity alone.
The article discusses the performance of MongoDB's vector search capabilities, likely comparing it to other solutions or highlighting improvements for AI workloads.
Manticore Search 27.1.5 introduces a new ONNX Runtime backend for embeddings that achieves ~14x faster performance than the previous SentenceTransformers/Candle path, with throughput ranging from 70-230 docs/sec compared to 5-11 docs/sec, and no API changes required.
Manticore's KNN search gets up to 29% faster with 2-pass HNSW, batched distances, compile-time distance specialization, and AVX-512 support.
NVIDIA and AWS announce new EC2 G7 instances with NVIDIA RTX PRO 4500 Blackwell GPUs and GPU-accelerated vector search in Amazon OpenSearch Serverless, enabling enterprises to deploy AI at production scale with improved performance and reduced operational complexity.
Fluree DB is an open-source, temporal graph database with git-like branching, integrated vector/text/geo search, fine-grained access control, and support for SPARQL, JSON-LD, and Open Cypher. It is optimized for AI agent memory and achieves high performance on billion-scale graphs.
Mixedbread announces that users can now bring their own cloud bucket, enabling zero-retention indexing and search with late-interaction models.