Tag
A practitioner ran a four-agent RAG panel experiment and documented three unexpected failure modes: irrelevant-but-supportive citations, agents citing their own generated notes, and fixed top-K retrieval forcing filler citations. The post shares fixes in progress and asks the community how they measure real RAG improvement.
本文提出一套面向生成式AI工作负载的生产级内容提取系统，包含选择性OCR路由、稀缺优先的标注策展引擎、结构感知的父子分块器与只读检索评估器，在180篇文档语料上达到97.4/100的抽取评分与hit@10 92.8%的检索命中率，并总结出三条设计原则。
A case study of an LLM coding agent implementing a multi-component data system, analyzing defects and evaluating retrieval strategies on HotpotQA, highlighting gaps in automated versus empirical testing.