VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis
Summary
VGenST-Bench is a benchmark that uses generative models to actively synthesize controlled spatio-temporal reasoning scenarios, with a multi-agent pipeline and human quality control, to evaluate multimodal large language models.
View Cached Full Text
Cached at: 05/25/26, 06:36 AM
Paper page - VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis
Source: https://huggingface.co/papers/2605.22570
Abstract
VGenST-Bench presents a video benchmark using generative models for active synthesis of controlled spatio-temporal reasoning scenarios with human quality control.
Spatio-temporal reasoningis a core capability forMultimodal Large Language Models(MLLMs) operating in the real world. As such, evaluating it precisely has become an essential challenge. However, existingspatio-temporal reasoningbenchmark datasets primarily rely on static image sets or passively curated video data, which limits the evaluation of fine-grained reasoning capabilities. In this paper, we introduce VGenST-Bench, avideo benchmarkthat employsgenerative modelsto actively synthesize highly controlled and diverse evaluation scenarios. To construct VGenST-Bench, we propose amulti-agent pipelineincorporating a human quality control stage, ensuring the quality of all generated videos and QA pairs. We establish a comprehensive 3x2x2video taxonomy, encompassing Spatial Scale, Perspective, and Scene Dynamics to span diverse scenarios. Furthermore, we design ahierarchical task suitethat decouples low-level visual perception from high-levelspatio-temporal reasoning. By shifting the paradigm from passive curation to active synthesis, VGenST-Bench enables fine-grained diagnosis of spatio-temporal understanding in MLLMs.
View arXiv pageView PDFProject pageGitHub4Add to collection
Get this paper in your agent:
hf papers read 2605\.22570
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.22570 in a model README.md to link it from this page.
Datasets citing this paper1
#### zino1/VGenST-Bench Viewer• Updated3 days ago • 11k • 35
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.22570 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
VGI-BENCH: Probing Visual Intelligence in Video Generation Models
VGI-Bench evaluates visual reasoning in video generation models through 27 tasks, revealing limited reliability and self-correction in current systems.
Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains
Introduces Sci-VBench, a benchmark for evaluating knowledge- and reasoning-intensive video generation across scientific domains, finding that visual realism has not translated into reliable scientific and causal correctness.
A Very Big Video Reasoning Suite
This paper introduces the Very Big Video Reasoning (VBVR) dataset and benchmark, a large-scale resource with over one million video clips across 200 reasoning tasks, enabling systematic study of spatiotemporal reasoning and showing early signs of emergent generalization.
GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?
GST-Bench is a new VQA benchmark for evaluating global spatial awareness in video understanding, testing whether VLMs can build coherent global scene representations from long-horizon egocentric video. Evaluation of 22 state-of-the-art VLMs shows a large gap versus humans, with the best model scoring 42.68 vs 79.08.
VideoGen-Agent: Reinforcing Video Generation Agents
The paper presents VideoGen-Agent, a reinforcement learning-based multimodal agent that coordinates tools for video generation, significantly improving performance on the new VABench benchmark.