Tag
MemScope 是一个由中国科学院提出的框架,通过工具使用的 Patch Agent 检查原始执行轨迹、运行时内存状态和现有架构代码,实现对智能体记忆架构的证据驱动、局部化原位进化,在 GAIA、xBench 和 ALFWorld 上均取得显著提升。
Arize Phoenix announces updates including faster trace analysis with natural-language filters and an expanded REST API for managing retention assignments and model providers.
Phoenix has a built-in Pixie assistant that helps users quickly filter out silent failure traces where agent spans have errors but model responses are normal, greatly improving trace reading efficiency.
HALO is an open-source desktop app that uses reinforcement learning from model-based (RLM) techniques to debug and optimize AI agent traces locally, providing analysis and actionable recommendations.
Braintrust's Topics feature uses LLM summarization to make production agent traces tractable for clustering and classification at scale, inspired by Anthropic's Clio approach.
This paper investigates a critical disconnect in trace-based knowledge distillation for LLMs, revealing that semantically correct Chain-of-Thought traces are not reliably correlated with correct final answers and that traces optimized for model performance are often least interpretable to end users.