CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning

Hugging Face Daily Papers Papers

Summary

CURV proposes a curriculum learning framework that enhances chart question answering by developing intrinsic visual grounded reasoning in multimodal LLMs, achieving significant improvements on real-world benchmarks.

Chart question answering (CQA) requires multimodal large language models (MLLMs) to integrate visual comprehension with logical reasoning, yet current models struggle with accurate visual grounding and coherent reasoning chains. While extrinsic chain-of-thought prompting and visual cues significantly improve performance, current MLLMs lack intrinsic visual grounded reasoning capabilities, leading to inaccurate perception and reasoning disconnected from visual evidence. To address these limitations, we propose CURV, a curriculum learning framework that develops intrinsic visual reasoning capabilities by reformulating CQA as multi-step visual grounded reasoning, where each step coordinates logical reasoning with dynamic visual grounding through spatial attention concentration. To assist model learning, we further introduce CCQA, a three-level curriculum dataset with scalable synthetic generation across diverse chart types and reasoning patterns. Our curriculum systematically progresses from basic single-operation reasoning to complex multi-chart compositional tasks. Experiments demonstrate that CURV achieves up to uparrow20.50% improvements over baselines and is generalizable to real-world benchmarks (up to uparrow12.30%) and out-of-domain multimodal reasoning tasks (up to uparrow10.20%), validating the effectiveness of internalizing visual reasoning with dynamic grounding for enhanced chart understanding capabilities. Code is available at: https://xhguo7.github.io/CURV/.
Original Article
View Cached Full Text

Cached at: 08/05/26, 05:46 PM

Paper page - CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning

Source: https://huggingface.co/papers/2608.02833

Abstract

Chartquestionanswering(CQA)requiresmultimodallargelanguagemodels(MLLMs)tointegratevisualcomprehensionwithlogicalreasoning,yetcurrentmodelsstrugglewithaccuratevisualgroundingandcoherentreasoningchains.Whileextrinsicchain-of-thoughtpromptingandvisualcuessignificantlyimproveperformance,currentMLLMslackintrinsicvisualgroundedreasoningcapabilities,leadingtoinaccurateperceptionandreasoningdisconnectedfromvisualevidence.Toaddresstheselimitations,weproposeCURV,acurriculumlearningframeworkthatdevelopsintrinsicvisualreasoningcapabilitiesbyreformulatingCQAasmulti-stepvisualgroundedreasoning,whereeachstepcoordinateslogicalreasoningwithdynamicvisualgroundingthroughspatialattentionconcentration.Toassistmodellearning,wefurtherintroduceCCQA,athree-levelcurriculumdatasetwithscalablesyntheticgenerationacrossdiversecharttypesandreasoningpatterns.Ourcurriculumsystematicallyprogressesfrombasicsingle-operationreasoningtocomplexmulti-chartcompositionaltasks.ExperimentsdemonstratethatCURVachievesuptouparrow20.50%improvementsoverbaselinesandisgeneralizabletoreal-worldbenchmarks(uptouparrow12.30%)andout-of-domainmultimodalreasoningtasks(uptouparrow10.20%),validatingtheeffectivenessofinternalizingvisualreasoningwithdynamicgroundingforenhancedchartunderstandingcapabilities.Codeisavailableat:https://xhguo7.github.io/CURV/.

View arXiv pageView PDFProject pageGitHub0Add to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2608.02833 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2608.02833 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2608.02833 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning

Hugging Face Daily Papers

Introduces CLVR (Closed-Loop Visual Reasoning), a framework that reformulates text-to-image generation from a single-step process into a closed-loop, multi-step visual reasoning approach using a VLM controller and diffusion models, achieving improved performance on compositional prompts.

Reason Through the Latent! Making Latent Visual Reasoning Necessary

Hugging Face Daily Papers

The paper introduces Causal Visual Recurrent Reasoning (CVRR), a method that enforces recurrent hidden-state computation for visual reasoning, improving performance on benchmarks while distinguishing latent informativeness from actual predictive use.