Tag
This paper introduces a retrieval-admissibility verification framework for long-term agent memory that classifies memory-query pairs as admissible, inadmissible, or unresolved, showing that recall and answer accuracy alone fail to detect policy or context violations. A post-hoc reanalysis of RHELM and MemOps benchmarks shows improved top-20 anchor recall and major reductions in similarity evaluations.
本文提出一套面向生成式AI工作负载的生产级内容提取系统,包含选择性OCR路由、稀缺优先的标注策展引擎、结构感知的父子分块器与只读检索评估器,在180篇文档语料上达到97.4/100的抽取评分与hit@10 92.8%的检索命中率,并总结出三条设计原则。
Hindsight 是 Vectorize 开源的 Agent 记忆系统,超越简单的聊天记录检索,通过 Retain/Recall/Reflect 三个动作让 Agent 从过往经验中形成新判断,支持 Claude Code、Codex、Cursor 等并内置 MCP Server。
Docker 与 GitHub 上的 docker-agent 开源项目发布了一款 Docker CLI 插件,可通过声明式 YAML 配置构建、运行和分享 AI 智能体,支持多智能体编排、MCP 工具生态、RAG 检索以及多模型供应商。
Google DeepMind released EmbeddingGemma 2, an open multimodal embedding model (740M params) that maps text, images, video, and audio into a unified 768-d vector space, designed for on-device search, RAG, and classification with Matryoshka truncation for reduced storage costs.
A deep retrospective on three years of LLM technical evolution: long-context handling shifted from RAG to prefix caching and million-token context windows; the Transformer still wins over linear-complexity architectures thanks to the hardware ecosystem of GPU tensor cores; inference costs were democratized through quantization, distillation, and task-based routing; agents moved toward pragmatic engineering paths like progressive disclosure, command-line sandboxes, and test feedback loops; and hallucination remains unsolved.
Zilliz has open-sourced DeepSearcher, an Apache-2.0 deep research framework combining LLMs, vector databases like Milvus, and agents to let companies run private, on-prem research over their own knowledge bases instead of sending data to online AI services.
A Rust-based text chunking library claiming ~20x speedups over LangChain, LlamaIndex, and similar Python solutions, with multiple chunking strategies, a native PDF loader, and parallel batch processing. Benchmark tables show Recursive chunking at ~2,264 MB/s and end-to-end PDF pipelines ~15x faster than pypdf-based baselines.
A survey of 300 tech and AI executives finds that only about 34% of agentic AI projects reach production, with data fragmentation and missing organizational context as key bottlenecks — pointing to knowledge layers, RAG, and knowledge graphs as the priority investments to connect agents to enterprise data.
HARPO is a reinforcement learning framework from Huawei Technologies that jointly optimizes hallucination mitigation and creative writing via a Hallucination-Aware Generative Reward Model, a selective activation mechanism, and a data curriculum, reducing hallucination rates while boosting creative-writing quality on Qwen models.
Introduces the Multilingual Distractor Interference (MDI) protocol showing that foreign-language distractor sentences cause LLMs to switch output scripts (e.g., Devanagari) or trigger abstention, inflating exact-match hallucination metrics — Llama-3.1-8B's apparent 0.710 hallucination rate drops to 0.470 once script-switched but semantically correct answers are accounted for.
The paper benchmarks email assistants across five communication-style axes and four English dialect variants, finding that indirect and formal requests degrade retrieval and cause agents to omit required actions rather than make unsupported ones, even when relevant evidence is successfully retrieved.
A systematic study comparing fine-tuning versus RAG-based approaches for LM-based world modeling across five environments, finding fine-tuning often wins (15/20 settings) but RAG is more data-efficient, and proposing a hybrid system combining parametric dynamics with retrieval over an actively maintained memory store that outperforms both.
This paper presents CourseChat, an on-premises multi-course RAG tutoring system for undergraduate business education, sharing six isolated courses across two edge AI hosts running Ollama-served local LLMs. Model bake-offs show that 8B/12B/7B models pass classroom speed gates while larger ones fail, supporting a hardware-software co-design approach rather than assuming bigger models are optimal.
JetBrains developers share field notes on building a production-grade RAG pipeline for semantic code search (Air Context), covering parsing, chunking, and vectorization as Part 1 of a series aimed at giving LLM coding agents precise, citable evidence from large codebases.
A practitioner outlines 15 must-build projects for AI Evals Engineers, covering trajectory grading, shadow routing, calibrated LLM-as-a-Judge, CI/CD regression gates, adversarial RAG testing, DPO fine-tuning flywheels, statistical significance, agent red-teaming, drift monitoring, cost-quality dashboards, counterfactual replay debugging, synthetic edge-case generation, context-window eviction tests, dataset contamination checks, and public eval methodology teardowns.
The author strongly recommends an article for anyone building AI applications, automation, and Forward Deployed Engineer roles, outlining the complete AI engineering stack: Python → FastAPI → LLM API → Tool Calling → RAG → Workflow → Agent → Eval → Deployment.
A practitioner compares three memory architectures for long-running agents — full conversation history, vector-store-only retrieval, and a hybrid of structured episodic logs plus vector retrieval — concluding the hybrid approach works best and flagging memory conflicts during mid-task belief updates as a key open problem.
awesome-jev 的定期巡检新增 3 条条目(555 → 558):llama.cpp 新增 System One 决策模型运行时支持、Databricks 推出 ai_decide AI Function 作为结构化决策 API,以及一个基于 Jev 官方文档的实际 RAG 测试案例。
该推文盘点了 10 个用于让 AI 智能体为其输出提供可验证证据的开源 GitHub 项目,涵盖科学文献检索(OpenScholar、PaperQA2)、文档解析(Docling)、网络爬取(Crawl4AI)、RAG(RAGFlow、GraphRAG、LightRAG)、深度研究(Open Deep Research)以及事实核查与评估(DeepEval、Ragas),并重点展示了 Allen AI 的 OpenScholar 代码库。