Tag
The paper presents CANDID, an execution-control framework that repurposes parallel test-time scaling into sparse, candidate-driven interventions to improve the reliability of local computer-use agents, featuring loop-recovery filtering and a unanimous DONE gating policy evaluated on OSWorld.
OpenAI announced major updates to ChatGPT for Healthcare, including advances in computer-use agents that carry out multi-step tasks across existing healthcare software, improved trusted clinical search with better medical evidence citations, and 20+ new healthcare plugins.
OpenAI shares new results for computer-use agents in healthcare, reporting GPT-6 Astra scored 99% safety on clinical EHR tasks and 94.3% on Stanford's HealthAdminBench, and announces deployments with partners like Abridge, Ambience, Cigna Healthcare, and CVS Health.
A Google and University of Hong Kong paper proposes VeriCUA, which verifies computer-use agent tasks by checking saved files and app state instead of trusting the agent's own completion report, cutting false positives to 5.4% versus 24.8% for a VLM judge.
CUA-Master 提出嵌套双环递归改进框架,通过开放世界语料、自催化任务合成与反馈引导的快照回滚重试机制持续提升计算机使用代理(CUA)性能,其 27B 模型在 OSWorld Verified 等基准上取得竞争力表现。
Microsoft Mage Team presents Mage-VL-Cowork, a full training recipe (data synthesis from evolved harnesses, multi-stage SFT, and online hybrid RL) for learning hybrid computer use, with the 4B model achieving strong results on OSWorld-Verified relative to its size.
NorthCUA technical report presents an integrated system that scales computer-use agents via an Experience Flywheel, recursive self-improvement, staged learning, and reinforcement learning, achieving state-of-the-art open-source results on GUI grounding, desktop execution, and web interaction with its Nano, Mini, and Pro model family.
Microsoft releases Mage-VL-Cowork, a compact 4B vision-language model that combines GUI interaction and terminal/code execution in a single policy, achieving 66.0% on OSWorld-Verified — the best result at the 4B scale — via a five-stage curriculum and online RL.
A post exploring a new class of inexpensive IP-based KVM controllers that integrate with local or frontier vision-capable LLMs via MCP, letting AI drive target computers through HDMI capture and HID keyboard/mouse emulation without installing any software on the target machine. Several options like Sipeed NanoKVM Pro, Radxa Linkr, and Violoop are highlighted for use cases like legacy industrial systems and locked-down corporate endpoints.
iPrefBench is a user-centric benchmark evaluating whether personal mobile-use agents can infer missing preferences from activity history or ask for clarification in an executable iOS environment with a simulated user. Evaluation of 7 frontier agents shows a large gap: high action completion (up to 91.6%) but low full task success (up to 47.7%), with agents especially struggling to request necessary ask-only information.
介绍 Simular 的 Agent S4 论文:通过元智能体从任务轨迹中自动构建并进化计算机操作接口,使开源 Qwen3.8-27B 模型在 OSWorld V2 上达到 21.3%,超越 GPT-5.5 和 Claude Opus 4.8,且成本仅为后者的极小部分。
ReTrace is a scalable evaluation framework for systematically studying recovery behavior in computer-use agents, formalizing Transition-Consistent Recovery via goal-oriented action replay after controlled error injection. The study finds that ideal recovery unlocks latent task completion capabilities, current agents fail to exploit their recovery potential, and accurate model-based recovery yields measurable end-to-end gains.
The paper introduces Agent S4, an autonomous system that evolves computer-use interfaces from task experience, achieving state-of-the-art open-source performance on OSWorld V2 (21.3%) and outperforming GPT-5.5 and Claude Opus 4.8 at a fraction of the cost.
论文提出 MAGE 框架,利用用户手册作为可扩展的程序性知识来源,同时改进计算机使用代理(CUA)的推理与训练,在六个应用上提升了任务成功率并减少了对人工标注数据的依赖。
WildAWM 提出一个可扩展的流水线,用于合成可控的计算机使用环境与任务来训练通用智能体,支持 GUI、MCP 和 CLI 交互,并在 8 个分布外基准上取得显著提升。
论文提出 PersonaCUABench,通过 74 个任务和 44 个不同用户画像来评估计算机使用代理(CUA),发现相比原始指令,任务完成率平均下降 36%,表明 CUA 在满足真实用户的个性化需求和约束方面仍存在显著不足。
LEASH 是一个免训练框架,利用隐层不确定性在弱模型与强模型之间按需切换,并在交接后通过影子观察者持续监督强代理,在 OSWorld 上以更低推理成本达到与 Claude Opus 5 相当的成功率。
OpenGCUA introduces an open generalist computer-use agent stack combining visual and programmatic interfaces, code execution, and harness-to-model decision transfer, improving task scores across eight models on OSWorld-v2 while reducing steps per task by 53%.
Work2Skill 提出一个框架,通过 WorkRecorder 收集人类 GUI 操作演示,构建 WorkDemo-350 多模态数据集,并用智能体式技能归纳方法从人类经验中提炼可复用的智能体技能,在 MyPCBench 和 OSWorld-Verified 上显著提升了多种执行模型的任务表现。
AgentHorizon introduces a benchmark of 1,373 computer-use tasks with human-recorded trajectories to evaluate agentic judges on long-horizon, multi-application tasks. The study finds GPT-5.5 achieves 80.9% balanced accuracy as the best agentic judge, and reveals that tool use helps some models but hurts open-weight models.