embeddings

This article critiques Retrieval-Augmented Generation (RAG) systems, demonstrating through experiments that embeddings fail to capture contextual details like contradictions, leading to hallucinations, and emphasizes the essential role of strong underlying models for accurate AI responses.

The paper proposes a zero-inference prospective term for personal memory retrieval that boosts memory items linked to future commitments without query-time computation. It shows improved recall on a synthetic task set and positions this as part of a layered architecture for proactive AI assistants.

The paper introduces Ovis-Embedding, a state-of-the-art omni-modal embedding model that uses a shared backbone to encode text, image, video, and audio in a common representation space, achieving top performance on benchmarks like MMEB-v3 and MVEB.

The tweet notes that Sentence Transformers models for search have gained popularity on Hugging Face, and expresses hope for a resurgence of encoders with zero-shot capabilities.

MongoDB Atlas introduces auto-embedding, enabling databases to generate and manage embeddings internally for semantic search, eliminating the need for external services and improving data synchronization.

Memorable introduces a method to optimize memory in AI agents using embeddings instead of tokens, enabling procedural memory that persists across multiple runs.

Manticore Search introduces automatic document chunking for vector search, improving recall for long documents by splitting them into chunks and embedding each chunk.

This paper develops a vector logic for formal semantics, characterizing when compressed vector representations allow exact linear or affine readouts of truth conditions, with experiments on GloVe and word2vec embeddings.

Antfly has rewritten their search-and-inference database from Go to pure Zig for improved performance and zero dependencies. The article details their technical decisions, first principles, and implementations of vector search algorithms.

The paper introduces ePID, a scalable pipeline using supervised embeddings to compute partial information decomposition for symptom networks, enabling the separation of redundant and synergistic information in mental health data.

The author proposes creating a 3D visualization room to explore NLP embedding models, inspired by lectures from @chrmanning.

A LinkedIn paper reveals that agent memory is not automatically portable across model swaps, with fixed-schema memory being more stable than free-form notes, and emphasizes the need for memory compatibility tests during upgrades.

This paper introduces a hybrid candidate generation approach for vacation rental recommendations, combining collaborative filtering and graph neural networks to improve recall by 14.8% over baseline methods.

Introduces Generative Late-Interaction Embeddings (GLIE) for compressing visual document retrieval vectors, improving accuracy under storage constraints by regenerating full embeddings on demand.

This paper investigates the link between autoencoder parameters and data statistics, proposing that parameters can function as a vector representation of data, supported by theoretical analysis and experiments on CIFAR-10 and FashionMNIST.

The paper proposes a lightweight, model-agnostic method to enhance language models with geo-spatial awareness by augmenting embeddings with location data, improving spatial alignment while maintaining standard NLP performance.

This paper introduces a method using Wasserstein barycenters to reconstruct language model embedding fields for predicting peer-misalignment penalties in spatial factor models, outperforming conventional weighting schemes.

A framework using distribution-valued firm characteristics and language-model embeddings provides portfolio risk bounds without cross-asset covariance estimates, demonstrating low-variance allocations with Qwen3-Embedding-8B representations.

This paper proposes LitEm, a neural regression model that enables transductive knowledge graph embedding models to predict numerical attributes, achieving strong benchmark results and introducing a co-training framework for improved performance.

Engrams are an architectural innovation that uses N-gram tables to offload memorization from transformer models, allowing smaller models to reason better by freeing up parameters for computation.