vlm-as-judge

Tag

Cards List
#vlm-as-judge

Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation

arXiv cs.AI · 2026-08-24 Cached

The paper introduces CRATE, a two-stage framework using step-level consequence reasoning to evaluate mobile agents, achieving high F1-scores on benchmarks like AndroidWorld and MobileRisk.

0 favorites 0 likes
← Back to home

Submit Feedback