ClawBench: Can AI agents complete everyday online tasks?
Summary
ClawBench is a benchmark for evaluating AI agents on everyday online tasks. This V2 update brings improvements or new tasks.
Similar Articles
EnterpriseClawBench: Benchmarking Agents from Real Workplace Sessions
EnterpriseClawBench presents a benchmark for enterprise agents based on real-world workplace sessions, offering 852 reproducible tasks and comprehensive evaluation metrics beyond single performance scores.
ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
ResearchClawBench is a benchmark for evaluating end-to-end autonomous scientific research across 40 tasks from 10 domains, revealing that current AI agents and LLMs achieve low re-discovery accuracy, with Claude Code averaging 21.5 and Claude-Opus-4.7 averaging 20.7 out of a possible score.
Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
Introduces Claw-Anything, a benchmark that evaluates always-on personal AI assistants on comprehensive user activity contexts spanning extended timeframes, multiple services, and diverse device interactions. Experiments show that even GPT-5.5 achieves only 34.5% pass@1, highlighting a significant gap between current agent capabilities and the demands of always-on assistance.
ClawProBench: Trace-Aware Evaluation of AI Agents with Runtime Coverage and Frozen Workplace-Style Holdouts
ClawProBench introduces a trace-aware benchmark for evaluating AI agents, emphasizing runtime execution and safety to reveal limitations in final-answer rankings.
UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
UniClawBench introduces a capability-driven benchmark for evaluating proactive agents in dynamic, real-world environments using live Docker containers and a closed-loop evaluation strategy with multiple agent roles.