Tag
该论文提出层级分数后验恢复方法(HSPR),通过结合历史响应模式与自适应任务选择,仅用小子集即可高效估计软件代理在完整基准测试上的分数,在SWE-bench系列任务库上取得最低的平均与最大绝对误差。
ProgramBench is a benchmark for agents to reproduce real software behavior from scratch. Factory is announced as the most advanced reverse-engineering system with breakthroughs in model-agnostic long-horizon agents.
This paper introduces DreamBench-SWE, a benchmark for evaluating memory hygiene in multi-session software agents, and reports experimental results showing its ability to discriminate memory configurations and characterize performance.
RESOURCE2SKILL is a framework that distills executable agent skills from multimodal resources like tutorial videos, code repositories, articles, and artifacts into a hierarchical SkillWiki, improving agent performance by 11.9 percentage points over no-skill agents.