Tag
The paper introduces Memorilla, a memory system that compresses an entire document collection into 16 query-dependent memory tokens for frozen LLMs, outperforming full-context inference on FactKG (84.33% vs 80.43%) while using 108x fewer tokens and beating baselines like Mem0 and MemoRAG across five of eight benchmarks.
Fudan University 等机构提出 AiO-Mem,将记忆智能体的搜索、写入和停止操作统一到共享证据状态与奖励空间中,通过过程奖励模型与 PA-DAPO 优化记忆策略,在长上下文记忆基准上持续提升答案准确性。
NVIDIA 发布 Nemotron-3.5-Embed-1B-BF16 多模态嵌入模型,支持文本、图像及图文混合输入的文档检索,覆盖 34 种语言文本检索和 18 种语言图像检索,可用于语义搜索和 RAG 工作流,采用 OpenMDW-1.1 许可并允许商用。
Tavily 推出与 Grok Bot 的集成插件,用户可在 Grok 中直接获得实时网络搜索、内容提取和深度研究能力,无需在工具间切换。
该论文提出一套区分「记忆依赖性、实用性和内容收益」的评估框架,指出仅通过置零记忆或与无文档模型比较,无法真正证明压缩记忆中的内容带来了性能提升,并在九个系统和 TriviaQA 等基准上进行了实证验证。
FinGREAT 评估开放权重 LLM 在金融图引导检索与关系分类任务上的表现,利用 11 节点 11 边的复式记账图谱分析 1300 份 SEC 10-K 文件,并引入包含 483 段人工标注的关系分类基准,最强开源与闭源模型准确率分别为 84.1% 和 92.8%。
Airbnb researchers present a case study showing that a portable agent skill—a natural-language instruction, lightweight tools, and an LLM-generated Wikipedia-style navigation layer over documents—can replace complex RAG pipelines, achieving 99.2% procedural equivalence to human-approved ground truth in customer support workflow generation, though at ~10x higher latency.
有人将谷歌的 EmbeddingGemma 2 改造为语音识别模型,通过在冻结参数的嵌入模型上训练轻量级 Reader,把语音转写从生成问题变成检索问题,在 M3 MacBook Air 上实现 288× 实时速度(1 小时音频约 13 秒转写),WER 约 5%,可能重塑端侧 STT 市场。
论文提出 Copy-Paste Language Models(CPLMs),在传统语言建模头之外加入轻量 Copy-Paste 头以增强模型的上下文复制能力,在 135M 到 1.7B 参数规模的预训练中验证了训练效率、下游性能及长上下文检索的提升,且开销极小。
Maxime Rivest 推荐使用开放、免费且快速的科学检索方式来为 AI agent 的回答提供事实依据,认为这种做法明显更好且应更早普及。
The author describes building sift-light, an evidence-first local search layer for coding agents that prioritizes exact search and verifiable sources over plausible semantic guesses, with new visual retrieval for images and scanned PDFs on Apple Silicon.
提出 T2Mem 框架,将记忆构建延迟到推理阶段,随推理过程渐进式构建面向查询的记忆,在 LoCoMo 和 LongMemEval 上超越强基线并显著降低记忆构建开销。
The paper proposes T-Mem, a temporal-structure-based memory framework for LLM agents in long-horizon multi-party conversations, using Temporal Evidence Discovery and Temporal Memory Structuring to recover locally concentrated evidence and reconstruct event progressions as an evidence forest, outperforming existing memory frameworks on two benchmarks.
本文提出 CQG-Single 与 CQG-AR 两种连续查询范式,消除基于 Semantic ID 的生成式推荐中有限宽度 beam search 带来的可达性约束,并在多个数据集上超越 TIGER 风格基线。
The paper introduces NoteBank, a training-free sparse episodic memory that augments linear attention models by archiving selected text and replaying it through native computation, boosting Gated DeltaNet's long-context retrieval accuracy on RULER from 1.7% to 70.3% at one million tokens with negligible FLOPs overhead.
Meta 的 IdeaScientist 论文将科研构思拆解为缺口发现、创新与报告撰写三个角色并分别用强化学习训练,基于 Qwen3.6-27B 在 2.77M 理念语料库上检索,超越最强开源 autoresearch 基线 14.0%,并优于 Claude Code SDK 与 Codex SDK 方案最多 5.9%。
该论文在统一可控的基准框架下系统评估了多模态嵌入学习中的各类对比训练策略,发现大多数策略相比标准对齐基线仅有边际收益甚至带来负面影响,并提出结合难负样本挖掘、假负样本缓解与难批次构建的协同训练方案,在MMEB上以Qwen2-VL-2B平均提升6.0%。
UltraBERT revisits bidirectional encoder pre-training design choices, showing performance saturation beyond a few trillion tokens, masking-ratio trade-offs between classification and retrieval, and proposes a dual-LM-head distillation approach achieving state-of-the-art on GLUE (91.0) and BEIR (47.7).
作者批评把整站页面粗暴灌入向量库的做法,主张先爬取发现 URL、再用简单路径过滤大幅缩减索引规模,因为智能体有任务和 token 预算,无法容忍大量噪声内容。
Meta AI introduces MetaEncoder, which fine-tunes a pre-trained Muse-Glimmer 30B decoder into an instruction-following decision-making encoder using unidirectional contrastive learning, evaluating it across 11 benchmarks and 190 tasks for multimodal closed-set and open-set decision making.