Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning

Hugging Face Daily Papers Papers

Summary

TRACE is a taxonomy-guided environment with 1,000 visual reasoning tasks across 11 domains. Training Qwen2.5-VL-3B and Qwen2.5-VL-7B on 64,000 TRACE instances improves their macro-average performance across 24 external benchmarks by 3.51 and 4.06 percentage points respectively.

Reinforcement learning with verifiable rewards (RLVR) has substantially improved language-model reasoning, yet its extension to vision-language models remains constrained by the lack of training data that are simultaneously broad, exactly verifiable, and reproducible. We introduce Trace, a taxonomy-guided environment for multidomain visual reasoning. Trace factorizes task construction into a scene grammar and an executable task program, separating visual realization from answer computation. A shared semantic state determines the rendered image, prompt, typed answer, verifier state, and replayable instance trace. The resulting environment comprises 1,000 tasks over 277 scene grammars and 11 visual domains, with controlled semantic and visual variation. RLVR on 64,000 Trace instances improves the macro-average across 24 external benchmarks by 3.51 percentage points for Qwen2.5-VL-3B and 4.06 points for Qwen2.5-VL-7B, providing evidence that broad procedural training can transfer beyond the generated task distributions. Project page: https://maveryn.github.io/trace/.
Original Article
View Cached Full Text

Cached at: 07/24/26, 05:08 AM

Paper page - Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning

Source: https://huggingface.co/papers/2607.19790 We introduce TRACE, a taxonomy-guided environment containing 1,000 deterministic visual-reasoning tasks across 11 domains.

Training Qwen2.5-VL-3B and Qwen2.5-VL-7B on 64,000 TRACE instances improves their macro-average performance across 24 external benchmarks by 3.51 and 4.06 percentage points, respectively.

We release the full research stack, including the task generator, dataset, trained checkpoints, training and evaluation code, and run artifacts.

💻 Code:https://github.com/maveryn/trace 📄 Paper:https://huggingface.co/papers/2607.19790 🌐 Project page:https://maveryn.github.io/trace/ 🤗 Hugging Face collection:https://huggingface.co/collections/maveryn/trace

Contributions are welcome—please feel free to open an issue or submit a pull request!

Similar Articles

WILDTRACE: Benchmarking Natural Evidence Trails in Long-Context Reasoning

arXiv cs.CL

WildTrace is a benchmark of 481 tasks using naturally occurring evidence trails from long documents like technical reports and narratives. It evaluates 18 frontier systems and shows that even the best (75.3%) struggles with reasoning-intensive geometries such as counterfactual branching and causal attribution.