Tag
WebArena-Pro introduces a heterogeneous, multimodal, reproducible benchmark with 300 tasks across 20 self-hosted web applications, extending web-agent evaluation to audio and video observations alongside text and vision, with Codex + GPT 6.1 Sol and Claude Code + Claude Opus 5.5 leading at 62.3%.
An interview with Tiny Fish co-founder and CPO Shua Jang covering the evolution from AgentQL to web agents, the role of Google's ADK as harness, a self-built data flywheel with a 3B-parameter web-native model, and why trust and accountable agent identity are the biggest competitive frontier.
The paper introduces SafeWebWorld, a benchmark for evaluating 'safety sufficiency' in web world models, showing that plausible prediction, evidence preservation, and latent authorization recovery are each insufficient to establish robust EXECUTE/ASK/BLOCK authorization decisions.
Browser Use 发布 BU Ultrafast,号称全球最快最便宜的网页代理:任务在 3 秒内完成,中位任务耗时 14.4 秒,25 个任务总成本仅 $0.126,现已在其云端全面上线。
WebAnything presents a fully automated framework that reconstructs source-grounded, reusable web agent environments from real URLs, building 244 website artifacts supporting 12,984 tasks and showing that fine-tuning Qwen3.5-9B on its interaction trajectories improves web agent success rates across multiple benchmarks.
The author built 5dive, an open-source server-side browser runtime for AI agents, and benchmarked it against OpenClaw, Hermes, and Claude in Chrome on 100 live website tasks from Online-Mind2Web plus 4 controlled tasks — finding similar pass rates among the top setups but major differences in speed and cost, with 5dive (pi) being the cheapest at $0.65 total.
Browser-Use partnered with Carnegie Mellon researchers to release Odysseys2, a hard long-horizon live web-agent benchmark built from real user tasks, where the best SOTA agent completes only 47/100 tasks.
SkillShift-Bench introduces the first benchmark for evaluating web agent skill learning under controlled open-environment shifts (contextual, perceptual, and execution), revealing systematic robustness degradation and proposing a test-time adaptation method to improve shifted skill execution without relearning.
WebAnything 是一个全自动框架,能从真实 URL 重建可复用、源绑定的 Web 环境,用于可扩展的智能体训练与评估。在 244 个网站环境上微调 Qwen3.5-9B,在 REAL、Odysseys 与 WebArena-Verified 基准上取得显著成功率提升。
HaMo is a Harness-Model collaborative framework that combines rapid retrieval of strategy-level experience cards with gradual parametric adaptation to improve long-horizon web agents' retention and cross-task execution, outperforming harness-only and model-only approaches under domain shifts.
AgentProofBench introduces a benchmark for reusable verification in web agents, linking frozen acceptance rules to execution traces across 97 tasks and 79 families on four web services, establishing baselines for program-gate correctness and reuse using DeepSeek Flash/Pro.
The paper introduces LoWAgent, a low-resource multilingual benchmark evaluating web agents across English, Hindi, Bengali, Urdu, and Amharic on six localized websites with 3,000 tasks, finding notable performance drops for low-resource languages—especially open-source models—and showing that post-training on benchmark traces improves agentic performance.
论文提出 WebMix,一种利用混合超网络在部署时组合已有低秩适配器(LoRA)的网页智能体适配方法,无需在目标界面上重新训练即可实现跨域和跨版本迁移,并在 TimeWarp 与 WebArena-Lite-v2 上取得显著提升。
研究团队提出 MisVisAgentBench,首个配对可执行基准,用于评估误导性图表对 Web Agent 执行的影响。在 13 个视觉-语言 Web Agent 上,替换为误导图表后平均任务成功率下降超过 34 个百分点,且失败大多沿着被误导的操作分支发生。
AMBER is a framework that lets web agents jointly learn to reason, act, and write to an append-only memory trained end-to-end with RL from outcome rewards, improving success on WebArena Lite over overwrite-based memory without curated SFT data.
Salesforce AI Research 提出 CLIFT,一种基于一致性自验证的网页智能体训练与测试时扩展方法,使 31B 开源 Gemma-4 智能体在 WebArena Infinity 上达到 74.6%,超越使用浏览器的 Gemini 3 Flash,并且在部署时无需调用前沿模型评判器。
CLIFT 利用共形自验证(conformal self-verification)将稀疏的judge反馈转化为可复用的训练奖励与无需外部judge的测试时轨迹选择,在WebArena Infinity、VisualWebArena和Online Mind2Web上取得了开源web agent的最优表现。
This paper proposes action-conditioned bisimulation over an empirical predictive state graph to decide when GUI agent memories of two web pages should be merged, improving success on MiniWoB++ over memoryless baselines without any training.
The tweet announces Browser Use Ultrafast, a cloud-based web agent tool that is 10x faster and cheaper, enabling tasks like flight comparison for $0.004 in under 20 seconds.
The paper introduces KNOWS, a benchmark for evaluating web agents on complex, long-horizon tasks that involve synthesizing and organizing knowledge into artifacts, revealing that current agents struggle with visual steps and long-horizon reasoning.