VISTA: View-Consistent Self-Verified Training for GUI Grounding
Summary
VISTA introduces a view-consistent self-verified training method for GUI grounding that improves GRPO-based coordinate prediction by using multiple target-preserving views, achieving consistent accuracy gains across benchmarks.
View Cached Full Text
Cached at: 06/15/26, 09:06 AM
Paper page - VISTA: View-Consistent Self-Verified Training for GUI Grounding
Source: https://huggingface.co/papers/2606.14579 VISTA introduces View-Consistent Self-Verified Training for GUI grounding, addressing a key limitation of applying GRPO to coordinate prediction: rollouts from a single screenshot view often collapse into all-success or all-failure groups, providing weak relative advantages.
Our approach builds each GRPO comparison group from multiple target-preserving views of the same GUI instance. These views are generated by crops that keep the target element visible while exactly remapping its bounding box, enabling comparisons across semantically equivalent but geometrically different inputs. VISTA also adds a self-verified cross-view anchor to stabilize short coordinate generation without turning RL into unconditional imitation.
Across five GUI-grounding benchmarks and multiple Qwen backbones, VISTA consistently improves accuracy. On ScreenSpot-Pro, it improves Qwen3-VL 4B/8B/30B-A3B from 55.5/52.7/53.7 to 63.4/65.8/67.0. Code, project page, and open checkpoints are available:
Code:https://github.com/ZJUSCL/VISTA Project page:https://zjuscl.github.io/VISTA/ Models:https://huggingface.co/inclusionAI/VISTA-9Bandhttps://huggingface.co/inclusionAI/VISTA-4B
Similar Articles
DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
DRS-GUI proposes a training-free dynamic region search framework for GUI grounding, using a lightweight UI Perceptor with human-like perceptual actions and Monte Carlo Tree Search to progressively locate instruction-relevant elements. Experiments show a 14% improvement on ScreenSpot-Pro for both general and GUI-specific MLLMs.
Trust the Right Teacher: Quality-Aware Self-Distillation for GUI Grounding
Proposes quality-aware self-distillation for GUI grounding, improving coordinate-token teacher signals via correctness-aware gating and probability scaling to enhance vision-language model performance.
GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning
提出 ScreenRef 高质量 GUI grounding 数据集(586K 截图、633K 指代表达实例)和 Distillation-to-Reinforcement Learning(D2RL)训练方法,训练出 GroundGUI-8B,在 ScreenSpot-V2 等多个基准上取得 8B 级模型中的领先性能。
GUI-Primitives: Diagnosing Spatial Reasoning Failures in Vision-Language GUI Grounding
The paper introduces GUI-Primitives, a benchmark of 994 contrastive instruction pairs to diagnose spatial reasoning failures in vision-language models for GUI grounding, revealing that most failures stem from candidate localization rather than relation understanding.
VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations
VIEScore2 introduces a unified evaluator for image generation and editing that predicts quality scores and defect locations on an NxN grid in a single model pass, using GRPO post-training with cell-level localization rewards. It outperforms general-purpose VLMs such as Gemini-3-Flash, achieving 0.601 overall SRCC and top-three results on five of six defect-localization benchmarks.