Paper page - Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User’s Digital World

Source: https://huggingface.co/papers/2605.26086 Authors:

,

,

,

,

,

,

,

,

,

Abstract

Claw-Anything benchmark evaluates large language model agents on comprehensive user activity contexts spanning extended timeframes, multiple services, and diverse device interactions to assess true always-on personal assistance capabilities.

Large language model agentsare increasingly envisioned as always-onpersonal assistantswith access to anything relevant in the user’s digital world. Yet current systems operate over only narrow slices of that world, limiting context-sensitive reasoning and effective assistance. Existing benchmarks similarly provide only partial user state and therefore fail to capture performance in such a broad, always-on setting. To address this gap, we introduce Claw-Anything, a benchmark that expands agent context along three dimensions: long-horizon activity histories, interdependent backend services, and integrated GUI and CLI interaction across multiple devices. To instantiate this setting, we simulate months ofuser activitythroughmulti-round event injection, producing complex world states and realistic noise, including irrelevant events and conflicting signals. Agents must reason over rich contextual environments while remaining robust to such noise. This expanded scope also enables the evaluation ofproactive assistance, requiring agents to anticipate user needs and deliver timely recommendations. Experiments show that GPT-5.5 achieves only 34.5%pass@1, substantially below prior benchmarks, underscoring a gap between current agent capabilities and the demands of always-on personal assistance. Alongside the benchmark, we release anautomated data-generation pipelinethat yields 2,000 training environments and improves the base model by 23.7%, demonstrating its utility of scalable data infrastructure.

View arXiv pageView PDFGitHub4Add to collection

Get this paper in your agent:

hf papers read 2605\.26086

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2605.26086 in a model README.md to link it from this page.

Datasets citing this paper1

#### LiberCoders/Claw-Anything Viewer• Updated4 minutes ago • 2.22k • 2

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2605.26086 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.