computer-use-agents

Tag

Cards List
#computer-use-agents

CANDID: Candidate-Driven Intervention for Disciplined Execution in Local Computer-Use Agents

arXiv cs.CL ↗ · 2d ago Cached

The paper presents CANDID, an execution-control framework that repurposes parallel test-time scaling into sparse, candidate-driven interventions to improve the reliability of local computer-use agents, featuring loop-recovery filtering and a unanimous DONE gating policy evaluated on OSWorld.

0 favorites 0 likes
#computer-use-agents

More ways to move care forward with ChatGPT for Healthcare

OpenAI Blog ↗ · 6d ago Cached

OpenAI announced major updates to ChatGPT for Healthcare, including advances in computer-use agents that carry out multi-step tasks across existing healthcare software, improved trusted clinical search with better medical evidence citations, and 20+ new healthcare plugins.

0 favorites 0 likes
#computer-use-agents

Advancing computer-use agents for healthcare teams

OpenAI Blog ↗ · 6d ago Cached

OpenAI shares new results for computer-use agents in healthcare, reporting GPT-6 Astra scored 99% safety on clinical EHR tasks and 94.3% on Stanford's HealthAdminBench, and announces deployments with partners like Abridge, Ambience, Cigna Healthcare, and CVS Health.

0 favorites 0 likes
#computer-use-agents

@rohanpaul_ai: New Google and University of Hong Kong paper argues that when AI agents use computers, their own “task done” message sh…

X AI KOLs Following ↗ · 2026-11-03 Cached

A Google and University of Hong Kong paper proposes VeriCUA, which verifies computer-use agent tasks by checking saved files and app state instead of trusting the agent's own completion report, cutting false positives to 5.4% versus 24.8% for a VLM judge.

0 favorites 0 likes
#computer-use-agents

CUA-Master: Scaling Computer-use Agents through Open-World Recursive Improvements

Hugging Face Daily Papers ↗ · 2026-11-02 Cached

CUA-Master 提出嵌套双环递归改进框架,通过开放世界语料、自催化任务合成与反馈引导的快照回滚重试机制持续提升计算机使用代理(CUA)性能,其 27B 模型在 OSWorld Verified 等基准上取得竞争力表现。

0 favorites 0 likes
#computer-use-agents

Mage-VL-Cowork: A Full Training Recipe to Learn Hybrid Computer Use From Evolved Harnesses

arXiv cs.CL ↗ · 2026-11-02 Cached

Microsoft Mage Team presents Mage-VL-Cowork, a full training recipe (data synthesis from evolved harnesses, multi-stage SFT, and online hybrid RL) for learning hybrid computer use, with the 4B model achieving strong results on OSWorld-Verified relative to its size.

0 favorites 0 likes
#computer-use-agents

NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at Scale

Hugging Face Daily Papers ↗ · 2026-11-01 Cached

NorthCUA technical report presents an integrated system that scales computer-use agents via an Experience Flywheel, recursive self-improvement, staged learning, and reinforcement learning, achieving state-of-the-art open-source results on GUI grounding, desktop execution, and web interaction with its Nano, Mini, and Pro model family.

0 favorites 0 likes
#computer-use-agents

microsoft/Mage-VL-Cowork · Hugging Face

Reddit r/LocalLLaMA ↗ · 2026-10-31 Cached

Microsoft releases Mage-VL-Cowork, a compact 4B vision-language model that combines GUI interaction and terminal/code execution in a single policy, achieving 66.0% on OSWorld-Verified — the best result at the 4B scale — via a five-stage curriculum and online RL.

0 favorites 0 likes
#computer-use-agents

Local LLM Agent-driven physical KVM controllers are now available and have some interesting use cases:

Reddit r/LocalLLaMA ↗ · 2026-10-28

A post exploring a new class of inexpensive IP-based KVM controllers that integrate with local or frontier vision-capable LLMs via MCP, letting AI drive target computers through HDMI capture and HID keyboard/mouse emulation without installing any software on the target machine. Several options like Sipeed NanoKVM Pro, Radxa Linkr, and Violoop are highlighted for use cases like legacy industrial systems and locked-down corporate endpoints.

0 favorites 0 likes
#computer-use-agents

iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents

Hugging Face Daily Papers ↗ · 2026-10-26 Cached

iPrefBench is a user-centric benchmark evaluating whether personal mobile-use agents can infer missing preferences from activity history or ask for clarification in an executable iOS environment with a simulated user. Evaluation of 7 frontier agents shows a large gap: high action completion (up to 91.6%) but low full task success (up to 47.7%), with agents especially struggling to request necessary ask-only information.

0 favorites 0 likes
#computer-use-agents

@dair_ai: Banger paper on evolving agent interfaces. Pay close attention to this new trend if you build with agents. Like optimiz…

X AI KOLs Following ↗ · 2026-10-21 Cached

介绍 Simular 的 Agent S4 论文:通过元智能体从任务轨迹中自动构建并进化计算机操作接口,使开源 Qwen3.8-27B 模型在 OSWorld V2 上达到 21.3%,超越 GPT-5.5 和 Claude Opus 4.8,且成本仅为后者的极小部分。

0 favorites 0 likes
#computer-use-agents

Lost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action Replay

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

ReTrace is a scalable evaluation framework for systematically studying recovery behavior in computer-use agents, formalizing Transition-Consistent Recovery via goal-oriented action replay after controlled error injection. The study finds that ideal recovery unlocks latent task completion capabilities, current agents fail to exploit their recovery potential, and accurate model-based recovery yields measurable end-to-end gains.

0 favorites 0 likes
#computer-use-agents

Evolving Agent Interfaces

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

The paper introduces Agent S4, an autonomous system that evolves computer-use interfaces from task experience, achieving state-of-the-art open-source performance on OSWorld V2 (21.3%) and outperforming GPT-5.5 and Claude Opus 4.8 at a fraction of the cost.

0 favorites 0 likes
#computer-use-agents

Adaptation of Computer Use Agents to New Software with User Manuals

arXiv cs.AI ↗ · 2026-10-19 Cached

论文提出 MAGE 框架,利用用户手册作为可扩展的程序性知识来源,同时改进计算机使用代理(CUA)的推理与训练,在六个应用上提升了任务成功率并减少了对人工标注数据的依赖。

0 favorites 0 likes
#computer-use-agents

Agent World Model in the Wild: Computer-Use Agent Environment Synthesis

Hugging Face Daily Papers ↗ · 2026-10-19 Cached

WildAWM 提出一个可扩展的流水线,用于合成可控的计算机使用环境与任务来训练通用智能体,支持 GUI、MCP 和 CLI 交互,并在 8 个分布外基准上取得显著提升。

0 favorites 0 likes
#computer-use-agents

PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas

Hugging Face Daily Papers ↗ · 2026-10-16 Cached

论文提出 PersonaCUABench,通过 74 个任务和 44 个不同用户画像来评估计算机使用代理(CUA),发现相比原始指令,任务完成率平均下降 36%,表明 CUA 在满足真实用户的个性化需求和约束方面仍存在显著不足。

0 favorites 0 likes
#computer-use-agents

LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

LEASH 是一个免训练框架,利用隐层不确定性在弱模型与强模型之间按需切换,并在交接后通过影子观察者持续监督强代理,在 OSWorld 上以更低推理成本达到与 Claude Opus 5 相当的成功率。

0 favorites 0 likes
#computer-use-agents

OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

OpenGCUA introduces an open generalist computer-use agent stack combining visual and programmatic interfaces, code execution, and harness-to-model decision transfer, improving task scores across eight models on OSWorld-v2 while reducing steps per task by 53%.

0 favorites 0 likes
#computer-use-agents

Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction

arXiv cs.AI ↗ · 2026-10-12 Cached

Work2Skill 提出一个框架,通过 WorkRecorder 收集人类 GUI 操作演示,构建 WorkDemo-350 多模态数据集,并用智能体式技能归纳方法从人类经验中提炼可复用的智能体技能,在 MyPCBench 和 OSWorld-Verified 上显著提升了多种执行模型的任务表现。

0 favorites 0 likes
#computer-use-agents

AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks

arXiv cs.AI ↗ · 2026-10-09 Cached

AgentHorizon introduces a benchmark of 1,373 computer-use tasks with human-recorded trajectories to evaluate agentic judges on long-horizon, multi-application tasks. The study finds GPT-5.5 achieves 80.9% balanced accuracy as the best agentic judge, and reveals that tool use helps some models but hurts open-weight models.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback