Tag
The paper introduces Agent-Computer Observation Interfaces (AOI), a model-agnostic perception layer that decouples continuous, adaptive observation from discrete actions for computer-use agents. AOI achieves significant performance gains (+17 to +48 percentage points) on dynamic browser tasks without retraining, with the key insight that narrating captured frames into persistent text is the primary driver of improvement.