embeddings

This paper presents the first application of program embeddings from LLMCompiler, an LLM pretrained on IR code, to program analysis and optimization tasks, achieving a 1.54% error rate in algorithm classification and competitive accuracy on heterogeneous device mapping.

A technical post explaining why RAG fails for multi-hop queries and presenting a 9-step roadmap for building context graphs, where entities are nodes and relationships are edges, with a minimal 150-line engine.

The paper presents a unified geometric framework for understanding differentiable embeddings like t-SNE and UMAP, showing that existing diagnostics derive from a single object and proposing new curvature-based and integral-path trust measures.

A Google DeepMind paper argues that single-vector embeddings in RAG systems have a hard mathematical limit, proving vector databases cannot fully capture complex document relationships. They introduce the LIMIT stress-test dataset to show state-of-the-art models fail on structured queries.

An educational article from MachineLearningMastery covering seven chunking strategies for RAG pipelines, from fixed-size token chunking to advanced semantic and hierarchical approaches, with guidance on when to use each.

InsightEmb is a contrastive embedding framework for agentic insight retrieval that learns progress-oriented retrieval geometry from mathematical reasoning data alone, improving retrieval for LLM agents without environment-specific training.

The author built a pipeline that transcribes 66k podcast episodes, extracts and clusters over 700k ideas into a 2D semantic map for tracking investment narratives, and filters out AI-generated content.

Dylan Castillo compares Matryoshka Representation Learning (MRL) with Principal Component Analysis (PCA) for reducing embedding dimensions, running experiments across eight BEIR datasets to evaluate retrieval quality versus vector size reduction.

UEmbed is a decoder-only multimodal embedding model that produces both sparse and dense representations in a single forward pass, released at 2B, 4B, and 9B scales. It outperforms existing public-data-trained multimodal embedding models on MMEB-v2 and remains competitive on BEIR.

Notion shares how it scaled its vector search infrastructure by 10x while reducing costs by 90% over two years, detailing their architecture evolution from launch to handling millions of workspaces.

A resource containing 933 legally structured chunks of the EU AI Act along with BGE-M3 embeddings, packaged in a single SQLite file for easy use in retrieval-augmented generation systems.

Memvid is an open-source tool that packages agent memory into mp4 files, offering significant performance improvements over traditional RAG pipelines and vector databases.

This paper analyzes the early training collapse phenomenon in deep neural models for click-through rate prediction and proposes mitigation strategies such as sparse feature removal and value filtering, demonstrating improvements on large-scale industrial datasets.

A tool that converts Obsidian vault notes into embeddings and renders a real-time 3D network visualization, revealing thinking topology and hidden gaps.

The author argues that for users who already subscribe to LLM services like ChatGPT Pro, running local embedding and reranker models for a memory system is more practical than running local LLMs, and details their GBrain-based setup.

The paper introduces Riemannian Mean Pooling (RMP), a method that aggregates token embeddings from pre-trained language models using Riemannian geometry via pullback metrics, showing improved performance over Euclidean pooling on sentence classification tasks.

A researcher reports a surprising 50-point accuracy gap between frozen SigLIP2 (92%) and DINOv2 (41%) embeddings on a fine-grained car classification task using k-NN, seeking insight on whether a linear probe would close the gap or if DINOv2 is unsuited for retrieval.

This study investigates whether contextualized embeddings from a large language model predict spoken word duration and pitch contours for Mandarin monosyllabic words, demonstrating above-chance prediction and the ability to back-transform normalized f0 contours to ms time scale.

Manticore Search 27.1.5 introduces a new ONNX Runtime backend for embeddings that achieves ~14x faster performance than the previous SentenceTransformers/Candle path, with throughput ranging from 70-230 docs/sec compared to 5-11 docs/sec, and no API changes required.

Introduces ALEE, a framework that uses Abstract Meaning Representations to generate English minimal pairs with controlled semantic shifts and translates them for evaluating text embeddings across 275+ languages, revealing persistent gaps in cross-lingual semantic representation.