embeddings

An open-source persistent memory layer for AI coding agents that stores and retrieves project decisions and context using Postgres and pgvector, aiming to reduce context window size and improve agent consistency.

This article presents a practical method to equip OpenClaw agents with local semantic memory search using Microsoft's Harrier embedding model, enabling efficient retrieval of relevant text chunks without external services.

This paper presents a unified framework for latent communication in LLM-based multi-agent systems, categorizing methods by what information is communicated, sender-receiver alignment, and fusion technique, and reviews eighteen representative methods from 2024-2026.

Educational article explaining FAISS, a library for billion-scale similarity search, covering vector embeddings, nearest neighbor search, and techniques like IVF and Product Quantization for efficient retrieval.

SEA-Embedding presents a fully open and reproducible text embedding pipeline for Southeast Asian languages, trained solely on public data, achieving state-of-the-art results on the SEA-BED benchmark.

Single-vector embedding models can be used to extract sparse latent terms, and BM25 can turn this vocabulary into a strong retriever.

This paper demonstrates that text-to-image diffusion transformer models primarily rely on token merging and word order from text encoders rather than full contextual embeddings, suggesting that the image model itself decodes complex linguistic structures.

A developer recounts debugging RAG systems, discovering that fixed-size chunking breaks sentence boundaries, vector search fails for exact identifiers (solved with BM25), and stale indexes cause confident wrong answers.

This paper investigates whether compact, task-specific bi-encoders fine-tuned on synthetic data from large language models can outperform general-purpose embeddings for clinical code retrieval in non-English languages, achieving state-of-the-art results on Spanish benchmarks CodiESP and DISTEMIST.

Analyzes the overlooked issue of stale embeddings in AI coding tools at enterprise scale, where clean demo environments hide the problem of repository graph drift and technical debt accumulation.

New arXiv paper announces the largest multilingual food model, trained on 4.1M recipes across 7 languages with 1,790 ingredients, compressed into 2MB.

This paper proposes a data-driven framework using embeddings from multilingual LLMs to detect lexical gaps between languages, achieving high accuracy in Korean-English pairs.

Precomputed embedding vectors for the Nemotron-Personas dataset using Qwen 0.6B, enabling semantic search and clustering of synthetic personas via a web demo.

An educational thread explaining 11 key lessons for understanding and building LLM architectures from scratch, covering tokens, embeddings, attention, positional encoding, data quality, and common misconceptions.

Tested chunking and embeddings across three production websites for RAG retrieval, finding that a yield score (ratio of high/medium chunks) predicts corpus quality and reranking effectiveness.

This article critiques AI memory systems for being append-only by default, leading to conflicting signals and poor knowledge management over time, questioning if anyone is addressing this beyond relying on better embeddings.

This paper introduces novel methods for generating high-quality embeddings for Horn logic reasoning using triplet loss, including techniques for balanced training example generation and hard example emphasis, which improve the efficiency of downstream logical reasoning.

Researchers at OpenCollider demonstrated that context engineering techniques can boost originality, and now GBrain uses embeddings to help users find contrarian ideas with its 'brainstorm' and 'brainstorm with lsd mode' features.

This paper introduces a knowledge-based approach using knowledge graph embeddings to automatically assess big data quality by predicting missing edges between context representations and quality rules, outperforming traditional matching methods.

A critical observation about AI memory systems: trust scores tied to embedding models break when the model is swapped, and recalibration becomes meaningless because the embeddings change. The author questions whether anyone has solved this without rebuilding trust logic.