embeddings

Witchcraft is an open-source re-implementation of Stanford's XTR-Warp semantic search engine in Rust, using SQLite for fast local search. It includes Pickbrain CLI for indexing code session transcripts and equipping AI agents with global memory.

Papr Graph offers graph-native vector embeddings, upgrading traditional embeddings with graph-based capabilities.

IBM releases Granite Embedding Multilingual R2, a family of open-source multilingual embedding models under Apache 2.0, featuring a compact 97M model that achieves best-in-class sub-100M retrieval quality and a 311M model with Matryoshka embeddings, both supporting 32K context and 200+ languages.

This paper introduces Layer-wise Representation Dynamics (LRD), a framework with three measurement families to analyze how hidden states change across layers in language models. Applied to 31 models on 30 MTEB tasks, LRD reveals architectural differences and enables label-free model selection and inference-time layer pruning.

This paper introduces a new embedding model designed to capture preferential similarity rather than just semantic similarity, improving preference prediction for collective decision-making systems.

The author shares benchmark results for memweave, a Python library for agent memory, achieving 98% Recall@5 on LongMemEval-S using only local embeddings without LLM calls. The post details the methodology and compares performance against mempalace, highlighting stable retrieval across different question types.

This paper critiques the 'Proxy Presumption' in NLP, where geometric embedding properties are incorrectly equated with social constructs. It introduces the Construct Validity Protocol and Counterfactual Neutralization methods to ensure rigorous validation of social measures derived from semantic embeddings.

This article introduces ProtSent, a contrastive fine-tuning framework for protein language models that improves embedding quality for downstream tasks like remote homology detection and structural retrieval.

Introduces MulTaBench, a benchmark of 40 datasets for multimodal tabular learning with text and image modalities, demonstrating that task-specific embedding tuning improves performance over frozen pretrained embeddings, particularly when modalities provide complementary predictive signals.

This post highlights the Johnson–Lindenstrauss Lemma, explaining its importance for ML engineers in understanding dimensionality reduction, random projections, and embedding efficiency.

Caliby is an open-sourced embedded vector database co-developed by Sea-Land AI and MIT's Michael Stonebraker team, offering high-performance vector retrieval (4x faster than pgvector) with HNSW, DiskANN, and IVF+PQ indexes, designed specifically for AI Agent and RAG use cases with a simple pip install.

The article provides a comprehensive technical overview of how AI agent memory works, distinguishing between working and long-term memory mechanisms, and discussing strategies for context management, embedding-based retrieval, and data lifecycle governance.

This paper introduces TabEmbed, a generalist embedding model for tabular data that unifies classification and retrieval tasks, along with TabBench, a new benchmark for evaluating tabular understanding.

User notes irony after asking Google's Gemini to summarize a blog post about Google's new Embedding 2 announcement.

Google releases Gemini Embedding 2 for general availability, offering a single model that embeds text, images, video, audio, and PDFs into one unified space across 100+ languages without needing audio transcription.

HornetDev team published a post on tuning approximate-nearest-neighbor search at 100M scale, covering embedding bias, graph connectivity, and quantization limits.

Zelma, a GPT-4 powered research assistant developed by Dr. Emily Oster and her team at Brown University in partnership with Novy, makes standardized test data accessible to parents, teachers, administrators, and policymakers by allowing natural language queries about student performance across districts and demographics.

OpenAI introduces a new embeddings API endpoint that converts text and code into numerical vector representations for semantic search, clustering, and classification tasks. The models achieve state-of-the-art results on standard benchmarks including a 20% relative improvement in code search performance.

OpenAI presents a contrastive pre-training approach for generating high-quality text and code embeddings at scale without supervision, achieving state-of-the-art results on linear-probe classification, semantic search, and code search benchmarks.

This article provides an in-depth comparison of the advantages and disadvantages of BM25 lexical search and embedding semantic search in RAG retrieval, offers a practical framework for selecting retrieval methods based on query type and system trade-offs, and emphasizes the importance of treating RAG as a system rather than a simple component.