DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing
Summary
DARS is a reinforcement learning framework for dual-level credit assignment in instruction-based image editing, improving performance by routing updates between planner and renderer modules through structured reasoning and adaptive curriculum.
View Cached Full Text
Cached at: 08/21/26, 10:18 AM
# DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing
Source: [https://arxiv.org/html/2608.20161](https://arxiv.org/html/2608.20161)
Haoxiang Cao1,2,§Jiajiong Cao2Xuanpu Zhang2,§Changqian Yu2,‡\\ddaggerChaoqun Wang1,†\\dagger 1South China Normal University2KlingAI Research
© none
Figure 1\.Two visually poor editing outcomes can require opposite cross\-module update emphases\.Case A: the planner captures the requested edit reasonably well, but the renderer fails to realize it, so this sample should place more corrective update weight on the renderer\.Case B: the sampled plan is a less useful intermediate for the instruction, and the renderer faithfully executes it, so this sample should place more corrective update weight on the planner\.DARSis designed to distinguish render\-dominant from plan\-dominant update needs through routing signals; when planner\-side emphasis is needed, its structured slots support finer within\-planner diagnosis\.Teaser showing two low\-scoring failure cases in a two\-stage image editing pipeline that require opposite cross\-module credit\-assignment decisions: one should emphasize renderer correction, while the other should emphasize planner correction\.###### Abstract\.
Instruction\-based image editing uses a planner\-renderer pipeline: a vision\-language model \(VLM\) first converts the instruction into an edit plan, and a diffusion model then executes that plan\. Training such systems with only final\-image rewards is inefficient because a poor edit does not reveal whether additional optimization should place more emphasis on the planner or the renderer, and even planner\-dominant cases remain difficult to localize within a free\-form reasoning trace\. We presentDARS, a reinforcement learning framework for dual\-level credit assignment in this two\-stage setting\. Across modules, multi\-plan multi\-render rollouts estimate between\-plan and within\-plan reward variability for soft module routing, while mean rewards across rollouts provide hardness estimates for an adaptive curriculum\. Within the planner, a four\-field structured reasoning output enables a prefix\-gated reward and token\-level advantage reweighting, turning outcome\-level feedback into localized supervision\. Experiments on five benchmarks show thatDARSoutperforms a Joint RL baseline with the same backbone, data, reward model, and rollout budget, with the largest gains on reasoning\-intensive edits\.
## 1\.Introduction
Many image editing systems\([38](https://arxiv.org/html/2608.20161#bib.bib4);[16](https://arxiv.org/html/2608.20161#bib.bib5);[31](https://arxiv.org/html/2608.20161#bib.bib7);[15](https://arxiv.org/html/2608.20161#bib.bib2);[24](https://arxiv.org/html/2608.20161#bib.bib10)\)adopt a planner\-renderer pipeline: a vision\-language model \(VLM\)\([29](https://arxiv.org/html/2608.20161#bib.bib16);[25](https://arxiv.org/html/2608.20161#bib.bib17);[1](https://arxiv.org/html/2608.20161#bib.bib19)\)interprets the instruction and produces an edit plan, and a diffusion model\([14](https://arxiv.org/html/2608.20161#bib.bib14);[33](https://arxiv.org/html/2608.20161#bib.bib1);[21](https://arxiv.org/html/2608.20161#bib.bib15);[18](https://arxiv.org/html/2608.20161#bib.bib18)\)renders the image conditioned on that plan\. This decomposition improves controllability, but also turns joint optimization into a dual\-level credit\-assignment problem\. Across modules, as illustrated in Figure[1](https://arxiv.org/html/2608.20161#acmlabel1), a poor image does not reveal whether the current sample would benefit more from planner\-side or renderer\-side corrective emphasis\. Within the planner, even when planner\-side updates are the more useful direction, the same outcome\-level feedback still does not reveal which part of the plan should be corrected\.
The difficulty comes from the fact that the two modules fail in different ways\. The planner is an autoregressive language model\([26](https://arxiv.org/html/2608.20161#bib.bib20)\), so its errors are typically semantic or compositional\. The renderer is a diffusion\-based generator\([9](https://arxiv.org/html/2608.20161#bib.bib21)\), so its failures appear as visual artifacts, preservation damage, or incomplete execution\. A single post\-render score\([34](https://arxiv.org/html/2608.20161#bib.bib22);[20](https://arxiv.org/html/2608.20161#bib.bib23)\)collapses these qualitatively different errors into the same feedback, making credit assignment ambiguous\. Existing RL\([11](https://arxiv.org/html/2608.20161#bib.bib3);[24](https://arxiv.org/html/2608.20161#bib.bib10);[32](https://arxiv.org/html/2608.20161#bib.bib11);[16](https://arxiv.org/html/2608.20161#bib.bib5)\)strategies, therefore, either optimize one module at a time, leaving the other bottleneck untouched, or update both modules uniformly from the same reward\. In either case, a low\-scoring edit still does not indicate whether additional optimization should focus more on planning or on rendering\.
This makes credit assignment\([10](https://arxiv.org/html/2608.20161#bib.bib24)\)under\-specified at two levels\. First, different samples should not contribute equally to planner and renderer updates\. Second, even when the planner is the main bottleneck, outcome\-level feedback still does not say which part of the plan is wrong: the requested modification, the preservation constraint, the scene\-level objective, or the execution hint\.
To address this dual\-level credit\-assignment problem, we presentDARS, a joint\-RL framework for planner\-renderer image editing\. We sample multiple plans and multiple renderings per plan, then use the resulting reward statistics in two different ways: between\-plan and within\-plan variability determine how much extra update weight is routed to the planner or renderer, while mean rewards across rollouts provide a hardness estimate for adaptive curriculum scheduling\([2](https://arxiv.org/html/2608.20161#bib.bib38)\)\. On the planner side, we replace an opaque free\-form trace with a four\-field structured reasoning output \(*Modify*,*Preserve*,*Overall*,*Tips*\), so the same rendered outcomes can support within\-planner credit assignment through slot\-level rewards and token\-level advantage reweighting \(Figure[2](https://arxiv.org/html/2608.20161#acmlabel2)\)\.
Figure 2\.Free\-form vs\. structured planner output\. With a free\-form planner trace, post\-render feedback remains attached to a single opaque text sequence, making within\-planner credit assignment difficult\. Our four\-field structured answer \(*Modify*,*Preserve*,*Overall*,*Tips*\) exposes semantically distinct slots, so the same rendered rollouts can be diagnosed field by field and converted into slot\-wise planner credit signals\.A double\-column comparison of free\-form planner output and a structured four\-field planner answer, showing that structured outputs enable field\-wise diagnosis and within\-planner credit assignment from the same rendered outcomes\.In summary, our contributions are:
- •We formulate joint RL for planner\-renderer image editing as a dual\-level credit\-assignment problem, spanning cross\-module update allocation and within\-planner reasoning diagnosis\.
- •We propose a rollout variance decomposition that separates across\-plan from within\-plan variability for cross\-module routing, together with a rollout\-reward hardness estimate for adaptive curriculum scheduling\.
- •We introduce a four\-field structured reasoning output for the planner together with a prefix\-gated reward and token\-level advantage reweighting, enabling localized planner optimization from post\-render feedback\.
Experiments on five benchmarks show thatDARSis especially effective on reasoning\-intensive edits\([40](https://arxiv.org/html/2608.20161#bib.bib25);[35](https://arxiv.org/html/2608.20161#bib.bib26)\), and ablations indicate that cross\-module routing and structured planner supervision contribute complementary gains\.
## 2\.Related Work
#### Instruction\-based image editing\.
Instruction\-based image editing\([33](https://arxiv.org/html/2608.20161#bib.bib1);[21](https://arxiv.org/html/2608.20161#bib.bib15);[14](https://arxiv.org/html/2608.20161#bib.bib14);[13](https://arxiv.org/html/2608.20161#bib.bib27);[22](https://arxiv.org/html/2608.20161#bib.bib39);[8](https://arxiv.org/html/2608.20161#bib.bib40);[3](https://arxiv.org/html/2608.20161#bib.bib41)\)aims to modify a source image according to a natural\-language instruction while preserving irrelevant content\. Recent work increasingly augments editing with explicit reasoning or planning\. RePlan\([24](https://arxiv.org/html/2608.20161#bib.bib10)\)introduces region\-aware planning for complex edits, while ReasonEdit\([38](https://arxiv.org/html/2608.20161#bib.bib4)\)and UniReason 1\.0\([30](https://arxiv.org/html/2608.20161#bib.bib6)\)strengthen editing with richer semantic and world\-knowledge reasoning\. Step1X\-Edit\-v1p2\([38](https://arxiv.org/html/2608.20161#bib.bib4)\), ThinkRL\-Edit\([15](https://arxiv.org/html/2608.20161#bib.bib2)\), and EditThinker\([16](https://arxiv.org/html/2608.20161#bib.bib5)\)further show that multi\-round reflection can improve editing fidelity, and ThinkGen\([11](https://arxiv.org/html/2608.20161#bib.bib3)\)demonstrates the benefit of explicit intermediate reasoning in a coupled reasoning\-generation pipeline\. Taken together, these methods establish the value of introducing a planner\-like stage before generation\. Their main emphasis, however, is on designing stronger intermediate reasoning or refinement procedures\. Our focus is different: we study how to optimize an already existing planner\-renderer pipeline once a structured intermediate stage has been introduced\.
#### RL for two\-stage planning\-based editing\.
Reinforcement learning has recently been used to improve instruction faithfulness and multimodal alignment in image generation\([17](https://arxiv.org/html/2608.20161#bib.bib13);[42](https://arxiv.org/html/2608.20161#bib.bib28);[41](https://arxiv.org/html/2608.20161#bib.bib30);[36](https://arxiv.org/html/2608.20161#bib.bib29)\)and editing\. PromptRL\([31](https://arxiv.org/html/2608.20161#bib.bib7)\)studies reward\-based optimization for flow\-based generation\. In two\-stage editing pipelines, existing RL methods differ mainly in which module is optimized: ThinkRL\-Edit\([15](https://arxiv.org/html/2608.20161#bib.bib2)\)focuses on the generation side by tuning the diffusion model and text encoder under reflective plans, EditThinker\([16](https://arxiv.org/html/2608.20161#bib.bib5)\)concentrates optimization on the VLM reasoning module, and ThinkGen\([11](https://arxiv.org/html/2608.20161#bib.bib3)\)alternates updates between the reasoning model and the generator\. Once editing is organized as an explicit prompt\-rewriting, planning, or reasoning stage followed by visual execution, the optimization problem becomes inherently two\-stage: one module produces an intermediate textual plan, and another realizes it in the image space\. In this setting, existing RL strategies largely follow three patterns: \(i\)*stage\-wise or alternating*optimization, which separates planner and renderer updates; \(ii\)*single\-module*optimization, which freezes one component and tunes the other; and \(iii\)*uniform joint*optimization, which updates both modules from the same outcome\-level reward\. The first two reduce the opportunity for coordinated co\-improvement, while the third leaves the learning signal underspecified because a low final score does not reveal which module should receive more optimization emphasis\. Our method is most closely related to the third line of work, but differs in explicitly addressing this module\-allocation problem through rollout\-derived routing while retaining joint training\.
#### Curriculum learning and structured reasoning\.
Curriculum learning\([4](https://arxiv.org/html/2608.20161#bib.bib31);[5](https://arxiv.org/html/2608.20161#bib.bib32)\)improves optimization by ordering or weighting training samples according to difficulty\. Standard curriculum designs, however, treat hardness as a one\-dimensional property of each sample\. In two\-stage image editing, this abstraction is incomplete: two samples with similar difficulty may still differ in whether their uncertainty is primarily plan\-dominant or render\-dominant, suggesting that sample scheduling alone is insufficient without module\-aware weighting\. On the reasoning side, PromptEnhancer\([32](https://arxiv.org/html/2608.20161#bib.bib11)\), ThinkGen\([11](https://arxiv.org/html/2608.20161#bib.bib3)\), and EditThinker\([16](https://arxiv.org/html/2608.20161#bib.bib5)\)show the value of richer intermediate text, but free\-form reasoning traces remain difficult to evaluate locally after rendering\. They often depend on engineered cold\-start formats or expert\-designed prompting recipes\([12](https://arxiv.org/html/2608.20161#bib.bib42)\), which makes them harder to scale and optimize consistently under RL\. Our method occupies a different point in this design space: instead of relying on long free\-form traces, we use a compact four\-field schema that remains close to the planner’s native generation format while exposing semantically aligned slots for post\-render reward decomposition and token\-level credit assignment\.
## 3\.Preliminary
### 3\.1\.Problem Setup
The input is𝐱=\(Isrc,c\)\\mathbf\{x\}=\(I\_\{\\mathrm\{src\}\},c\), whereIsrcI\_\{\\mathrm\{src\}\}is the source image andccis the editing instruction\. A VLM*planner*qθ\(𝐞∣𝐱\)q\_\{\\theta\}\(\\mathbf\{e\}\\mid\\mathbf\{x\}\)with parametersθ\\thetapredicts a structured edit plan
\(1\)𝐞=\(emod,epre,eovr,etip\),\\mathbf\{e\}=\\left\(e^\{\\mathrm\{mod\}\},e^\{\\mathrm\{pre\}\},e^\{\\mathrm\{ovr\}\},e^\{\\mathrm\{tip\}\}\\right\),specifying modifications, preservation constraints, the scene objective, and execution hints\. A conditional image generator \(*renderer*\)pϕ\(𝐲∣Isrc,𝐞\)p\_\{\\phi\}\(\\mathbf\{y\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\)with parametersϕ\\phiproduces the image𝐲\\mathbf\{y\}\. The renderer receives the source image and the structured plan; the raw instructionccis not separately passed to it\. For reward computation, Gemini 3 Pro is used once before RL training to generate and cache a slot\-aligned checklist𝐂\(𝐱\)=\(Cmod,Cpre,Covr,Ctip\)\\mathbf\{C\}\(\\mathbf\{x\}\)=\\left\(C^\{\\mathrm\{mod\}\},C^\{\\mathrm\{pre\}\},C^\{\\mathrm\{ovr\}\},C^\{\\mathrm\{tip\}\}\\right\)from the source image and raw instruction\. During RL training, Qwen3\-VL\-32B performs all online planner\-side and renderer\-side Yes/No scoring for the sampled rollouts\. Each checklist field enumerates verifiable requirements for the corresponding planner slot\.
The reward model produces two module\-targeted scores from each rendered outcome\. The*renderer reward*Rrend\(𝐱,𝐞,𝐲,𝐂\)R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\},\\mathbf\{y\};\\mathbf\{C\}\)measures checklist satisfaction by the edited image\. The*planner reward*Rplan\(𝐱,𝐞,𝐲,𝐂\)R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\},\\mathbf\{y\};\\mathbf\{C\}\)evaluates whether each structured slot is semantically appropriate and supported by the realized edit, so plan quality is assessed in the execution context\. A shared reward
\(2\)Rshare=ηplanRplan\+ηrendRrendR\_\{\\mathrm\{share\}\}=\\eta\_\{\\mathrm\{plan\}\}R\_\{\\mathrm\{plan\}\}\+\\eta\_\{\\mathrm\{rend\}\}R\_\{\\mathrm\{rend\}\}uses fixed mixing weightsηplan,ηrend≥0\\eta\_\{\\mathrm\{plan\}\},\\eta\_\{\\mathrm\{rend\}\}\\geq 0for routing and curriculum estimation, whileRplanR\_\{\\mathrm\{plan\}\}andRrendR\_\{\\mathrm\{rend\}\}remain the optimization targets\. All in\-house ablations use the same reward model, so their differences reflect the proposed credit\-assignment and planner\-structure choices under a fixed reward pipeline\. The central challenge is credit assignment: for a given sample, \(i\) which update path should receive a stronger learning signal, and \(ii\) which parts of the planner output, if any, should be corrected\.
### 3\.2\.Policy Optimization Background
GRPO\([28](https://arxiv.org/html/2608.20161#bib.bib12)\)samplesGGcandidate outputs per input and uses group\-relative advantages with clipped surrogate and KL regularization\.Flow\-GRPO\([17](https://arxiv.org/html/2608.20161#bib.bib13)\)extends this to diffusion\-flow generators\([19](https://arxiv.org/html/2608.20161#bib.bib33);[6](https://arxiv.org/html/2608.20161#bib.bib34)\)by defining the policy ratio at each denoising step\. Both are used off\-the\-shelf; our contribution lies in the rollout\-derived signals that weight their updates\.
Figure 3\.Framework ofDARS\. The structured planner produces a four\-field answer; multiple plans and renderings per plan are sampled\. Mean rewards across rollouts yield hardness estimates for adaptive curriculum scheduling, while reward variability is decomposed into across\-plan and within\-plan components to produce module\-routing signals for module\-specific weighting\. Prefix gating further provides slot\-wise planner credit signals for finer within\-planner diagnosis\.Framework diagram of DARS showing the structured planner, multi\-plan multi\-render rollouts, rollout variance decomposition, adaptive curriculum, soft module routing, and slot\-wise planner optimization\.
## 4\.Method
DARSaddresses credit assignment at two levels in two\-stage image editing pipelines: across modules and within the planner\. The framework contains three coupled components:
1. \(1\)*Structured reasoning and slot\-wise planner credit assignment*\(Section[4\.1](https://arxiv.org/html/2608.20161#S4.SS1)\): the planner outputs a four\-field answer enabling a prefix\-gated reward and finer diagnostics;
2. \(2\)*Rollout variance decomposition for cross\-module credit assignment*\(Section[4\.2](https://arxiv.org/html/2608.20161#S4.SS2)\): multi\-plan and multi\-render rollouts produce variance\-based statistics that distinguish across\-plan variability from within\-plan rollout variability;
3. \(3\)*Adaptive curriculum and soft module routing*\(Section[4\.3](https://arxiv.org/html/2608.20161#S4.SS3)\): a rollout\-derived hardness score controls sample weighting, while decomposed variability guides how extra update weight is assigned across modules\.
The underlying principle is to separate three questions that end\-to\-end editing RL conflates:*which module should receive extra corrective emphasis*\(cross\-module credit assignment via module routing\),*how planner errors should be diagnosed more finely*\(structured reasoning with slot\-wise planner credit assignment\), and*which samples are currently most informative*\(adaptive curriculum\)\. Figure[3](https://arxiv.org/html/2608.20161#acmlabel3)provides an overview\.
### 4\.1\.Structured Reasoning and Slot\-Wise Planner Credit Assignment
#### Structured reasoning output\.
Open\-ended planner reasoning is difficult to optimize under sparse editing rewards because feedback arrives only after image generation\. Following Section[3](https://arxiv.org/html/2608.20161#S3), we represent the planner output as a four\-field structured answer𝐞=\(emod,epre,eovr,etip\)\\mathbf\{e\}=\\left\(e^\{\\mathrm\{mod\}\},e^\{\\mathrm\{pre\}\},e^\{\\mathrm\{ovr\}\},e^\{\\mathrm\{tip\}\}\\right\)\. Each field has a task\-specific role:emode^\{\\mathrm\{mod\}\}\(*Modify*\) states what should change;epree^\{\\mathrm\{pre\}\}\(*Preserve*\) states what must remain unchanged;eovre^\{\\mathrm\{ovr\}\}\(*Overall*\) captures scene\-level coherence;etipe^\{\\mathrm\{tip\}\}\(*Tips*\) provides short execution hints for the renderer\. Each field remains free\-form natural language, preserving the VLM backbone’s expressiveness while providing semantic anchoring for reward decomposition\. For every training input, a slot\-aligned checklist𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)serves as the shared evaluation anchor for both module rewards\.
#### Prefix\-gated reward\.
With structured planner outputs, feedback can be decomposed at the slot level\. For each fieldj∈\{mod,pre,ovr,tip\}j\\in\\\{\\mathrm\{mod\},\\mathrm\{pre\},\\mathrm\{ovr\},\\mathrm\{tip\}\\\}, the reward model inspects the slot texte\(j\)e^\{\(j\)\}, the source image and instruction, the edited image𝐲\\mathbf\{y\}, and the corresponding checklist fieldC\(j\)C^\{\(j\)\}\. Encoding*Yes*as11and*No*as00, the slot scores\(j\)∈\[0,1\]s^\{\(j\)\}\\in\[0,1\]is the unweighted fraction of Yes judgments over all questions inC\(j\)C^\{\(j\)\}\. It measures semantic adequacy, specificity, and whether the realized edit supports that field as executable guidance\. These scores are*planner\-side post\-render diagnostics*: they assess plan quality through realized renderings, so a textually plausible but unexecutable plan does not receive high reward\. Averaging each plan’s score overKKindependent renderings reduces renderer noise\.
The four fields admit a natural*causal ordering*: modification intent \(emode^\{\\mathrm\{mod\}\}\) is fundamental; preservation constraints \(epree^\{\\mathrm\{pre\}\}\) are meaningful only if modification is correct; the overall objective \(eovre^\{\\mathrm\{ovr\}\}\) synthesizes both; tips \(etipe^\{\\mathrm\{tip\}\}\) are useful only when preceding fields are sound\. We encode this by prefix gating\. For a realized plan–rendering pair\(𝐞i,𝐲i,k\)\(\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\}\), letσi,k\(j\)=𝕀\[si,k\(j\)≥δj\]\\sigma\_\{i,k\}^\{\(j\)\}=\\mathbb\{I\}\\bigl\[s\_\{i,k\}^\{\(j\)\}\\geq\\delta\_\{j\}\\bigr\], whereδj\\delta\_\{j\}is the slot threshold andλj≥0\\lambda\_\{j\}\\geq 0weights slotjj\. The per\-render planner reward is
\(3\)Rplan\(𝐱,𝐞i,𝐲i,k,𝐂\)=∑j=14λj⋅si,k\(j\)⋅∏l=1j−1σi,k\(l\),R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\)=\\sum\_\{j=1\}^\{4\}\\lambda\_\{j\}\\cdot s\_\{i,k\}^\{\(j\)\}\\cdot\\prod\_\{l=1\}^\{j\-1\}\\sigma\_\{i,k\}^\{\(l\)\},where slots are ordered asj=1:mod,2:pre,3:ovr,4:tipj=1\{:\}\\mathrm\{mod\},\\;2\{:\}\\mathrm\{pre\},\\;3\{:\}\\mathrm\{ovr\},\\;4\{:\}\\mathrm\{tip\}\. We use the empty\-product convention∏l=10\(⋅\)=1\\prod\_\{l=1\}^\{0\}\(\\cdot\)=1, so the Modify term is always ungated\. Prefix gating activates later\-slot rewards only after earlier slots are correct, encouraging the planner to fix fundamental mistakes first\.
The renderer reward focuses on execution quality:
\(4\)Rrend\(𝐱,𝐞,𝐲,𝐂\)=∑j=14γju\(j\),R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\},\\mathbf\{y\};\\mathbf\{C\}\)=\\sum\_\{j=1\}^\{4\}\\gamma\_\{j\}u^\{\(j\)\},whereu\(j\)∈\[0,1\]u^\{\(j\)\}\\in\[0,1\]is analogously the unweighted fraction of renderer\-side Yes judgments over all questions inC\(j\)C^\{\(j\)\}, andγj≥0\\gamma\_\{j\}\\geq 0is the corresponding renderer\-side weight\. The shared reward is
\(5\)Rshare\(𝐱,𝐞,𝐲\)=ηplanRplan\+ηrendRrend\.R\_\{\\mathrm\{share\}\}\(\\mathbf\{x\},\\mathbf\{e\},\\mathbf\{y\}\)=\\eta\_\{\\mathrm\{plan\}\}R\_\{\\mathrm\{plan\}\}\+\\eta\_\{\\mathrm\{rend\}\}R\_\{\\mathrm\{rend\}\}\.
#### Token\-level advantage reweighting\.
For each plan𝐞i\\mathbf\{e\}\_\{i\}and rendering𝐲i,k\\mathbf\{y\}\_\{i,k\}, the reward model returns per\-render slot scoressi,k\(j\)s\_\{i,k\}^\{\(j\)\}, which enter the per\-render prefix rewardRplanR\_\{\\mathrm\{plan\}\}via Eq\.[3](https://arxiv.org/html/2608.20161#S4.E3)\. The plan\-level rewardriplanr\_\{i\}^\{\\mathrm\{plan\}\}averages the resulting per\-render rewards acrossKKrenderings\. For token\-level advantage modulation, the slot scores are likewise averaged:s¯i\(j\)=1K∑k=1Ksi,k\(j\)\\bar\{s\}\_\{i\}^\{\(j\)\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}s\_\{i,k\}^\{\(j\)\}\. Tokens in slotjjthen use
\(6\)A^i,jplan=A^iplan⋅∏l=1j−1σ¯i\(l\)⋅\{s¯i\(j\),A^iplan≥0,1−s¯i\(j\),A^iplan<0,\\hat\{A\}\_\{i,j\}^\{\\mathrm\{plan\}\}=\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}\\cdot\\prod\_\{l=1\}^\{j\-1\}\\bar\{\\sigma\}\_\{i\}^\{\(l\)\}\\cdot\\begin\{cases\}\\bar\{s\}\_\{i\}^\{\(j\)\},&\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}\\geq 0,\\\\ 1\-\\bar\{s\}\_\{i\}^\{\(j\)\},&\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}<0,\\end\{cases\}whereA^iplan\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}is the group\-relative plan\-level advantage andσ¯i\(l\)=𝕀\[s¯i\(l\)≥δl\]\\bar\{\\sigma\}\_\{i\}^\{\(l\)\}=\\mathbb\{I\}\[\\bar\{s\}\_\{i\}^\{\(l\)\}\\geq\\delta\_\{l\}\]is an analogous prefix gate computed from rendering\-averaged slot scores\. It uses the same threshold form and causal ordering as Eq\.[3](https://arxiv.org/html/2608.20161#S4.E3), but is distinct from the per\-render gatesσi,k\(l\)\\sigma\_\{i,k\}^\{\(l\)\}\. This sign\-aware modulation prevents low\-quality slots from inheriting the positive credit of an otherwise good plan, while assigning stronger negative updates to the slots most associated with poor overall plan performance\. The prefix gate∏l<jσ¯i\(l\)\\prod\_\{l<j\}\\bar\{\\sigma\}\_\{i\}^\{\(l\)\}ensures that downstream slots receive gradient only when all upstream slots pass their quality thresholds, maintaining the same causal dependency enforced in the reward \(Eq\.[3](https://arxiv.org/html/2608.20161#S4.E3)\) through to the token\-level update\.
### 4\.2\.Rollout Variance Decomposition for Cross\-Module Credit Assignment
For a fixed input𝐱\\mathbf\{x\}, let𝐞∼qθ\(⋅∣𝐱\)\\mathbf\{e\}\\sim q\_\{\\theta\}\(\\cdot\\mid\\mathbf\{x\}\)and𝐲∼pϕ\(⋅∣Isrc,𝐞\)\\mathbf\{y\}\\sim p\_\{\\phi\}\(\\cdot\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\)\. We decompose the variance ofRshareR\_\{\\mathrm\{share\}\}:
\(7\)Uplan\(𝐱\)\\displaystyle U\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)=Var𝐞\(𝔼𝐲\|Isrc,𝐞\[Rshare\]\),\\displaystyle=\\operatorname\{Var\}\_\{\\mathbf\{e\}\}\\Bigl\(\\mathbb\{E\}\_\{\\mathbf\{y\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\}\[R\_\{\\mathrm\{share\}\}\]\\Bigr\),\(8\)Urend\(𝐱\)\\displaystyle U\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\)=𝔼𝐞\[Var𝐲\|Isrc,𝐞\(Rshare\)\]\.\\displaystyle=\\mathbb\{E\}\_\{\\mathbf\{e\}\}\\Bigl\[\\operatorname\{Var\}\_\{\\mathbf\{y\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\}\(R\_\{\\mathrm\{share\}\}\)\\Bigr\]\.By the law of total variance,Var\(Rshare∣𝐱\)=Uplan\(𝐱\)\+Urend\(𝐱\)\\operatorname\{Var\}\(R\_\{\\mathrm\{share\}\}\\mid\\mathbf\{x\}\)=U\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)\+U\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\)\. The first term measures how much the expected reward changes across plans; the second measures reward fluctuation under a fixed plan\. Large across\-plan variability suggests that selecting or improving the plan could materially change the outcome; large within\-plan variability suggests that outcome quality remains unstable even after the plan is fixed\. Since the edited image varies across renderer rollouts and bothRplanR\_\{\\mathrm\{plan\}\}andRrendR\_\{\\mathrm\{rend\}\}are derived from that realized image, within\-plan variability is induced by renderer stochasticity but can propagate into both module\-targeted scores\. We use these quantities as rollout\-level cross\-module credit\-assignment signals for*where additional optimization is currently most actionable*; accordingly,UplanU\_\{\\mathrm\{plan\}\}andUrendU\_\{\\mathrm\{rend\}\}are referred to as plan\-dominant and render\-dominant variability\.
For each sample, we drawMMplans andKKrenderings per plan, yielding rewardsri,ksharer\_\{i,k\}^\{\\mathrm\{share\}\}\. The per\-plan mean isr¯i=1K∑kri,kshare\\bar\{r\}\_\{i\}=\\frac\{1\}\{K\}\\sum\_\{k\}r\_\{i,k\}^\{\\mathrm\{share\}\}and the grand mean isr¯=1M∑ir¯i\\bar\{r\}=\\frac\{1\}\{M\}\\sum\_\{i\}\\bar\{r\}\_\{i\}\. We compute:
\(9\)swithin2\(𝐱\)\\displaystyle s\_\{\\mathrm\{within\}\}^\{2\}\(\\mathbf\{x\}\)=1M∑i=1M1K−1∑k=1K\(ri,kshare−r¯i\)2,\\displaystyle=\\frac\{1\}\{M\}\\sum\_\{i=1\}^\{M\}\\frac\{1\}\{K\-1\}\\sum\_\{k=1\}^\{K\}\\bigl\(r\_\{i,k\}^\{\\mathrm\{share\}\}\-\\bar\{r\}\_\{i\}\\bigr\)^\{2\},\(10\)sbetween2\(𝐱\)\\displaystyle s\_\{\\mathrm\{between\}\}^\{2\}\(\\mathbf\{x\}\)=1M−1∑i=1M\(r¯i−r¯\)2\.\\displaystyle=\\frac\{1\}\{M\-1\}\\sum\_\{i=1\}^\{M\}\\bigl\(\\bar\{r\}\_\{i\}\-\\bar\{r\}\\bigr\)^\{2\}\.The within\-plan estimate isU^rend=swithin2\\widehat\{U\}\_\{\\mathrm\{rend\}\}=s\_\{\\mathrm\{within\}\}^\{2\}, and the across\-plan estimate corrects for finite\-KKnoise:
\(11\)U^plan\(𝐱\)=max\(0,sbetween2−1Kswithin2\)\.\\widehat\{U\}\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)=\\max\\left\(0,\\;s\_\{\\mathrm\{between\}\}^\{2\}\-\\tfrac\{1\}\{K\}s\_\{\\mathrm\{within\}\}^\{2\}\\right\)\.TheM×KM\\times Krollouts are shared with policy optimization, so variance estimation requires no extra renderer budget\.
### 4\.3\.Adaptive Curriculum and Soft Module Routing
Hardness determines*when*a sample should contribute strongly; rollout\-variance signals determine*where*additional module emphasis should be assigned\.
#### Curriculum scheduling\.
The rollout\-based hardness estimate isH^\(𝐱\)=−1MK∑i,kri,kshare\\widehat\{H\}\(\\mathbf\{x\}\)=\-\\frac\{1\}\{MK\}\\sum\_\{i,k\}r\_\{i,k\}^\{\\mathrm\{share\}\}\(larger = harder\)\. After normalization, the resulting hardnessH~\(𝐱\)\\widetilde\{H\}\(\\mathbf\{x\}\)is compared against a step\-dependent boundaryκ\(n\)\\kappa\(n\)that increases with training stepnnvia the empirical quantile ofH~\\widetilde\{H\}in a running buffer\. The curriculum weight is
\(12\)wcur\(𝐱,n\)=sigmoid\(κ\(n\)−H~\(𝐱\)τc\)\.w\_\{\\mathrm\{cur\}\}\(\\mathbf\{x\},n\)=\\operatorname\{sigmoid\}\\left\(\\frac\{\\kappa\(n\)\-\\widetilde\{H\}\(\\mathbf\{x\}\)\}\{\\tau\_\{\\mathrm\{c\}\}\}\\right\)\.Hereτc\\tau\_\{\\mathrm\{c\}\}is a temperature parameter controlling how sharply the curriculum weight transitions around the current boundaryκ\(n\)\\kappa\(n\)\. Early in training, simpler samples receive large weights; as the model improves,κ\(n\)\\kappa\(n\)rises to progressively expose harder samples\.
#### Cross\-module credit assignment\.
We use the relative magnitude of the variance signals:
\(13\)α\(𝐱\)=U^plan\+εUU^plan\+U^rend\+2εU,ω\(𝐱\)=1−α\(𝐱\)\.\\alpha\(\\mathbf\{x\}\)=\\frac\{\\widehat\{U\}\_\{\\mathrm\{plan\}\}\+\\varepsilon\_\{U\}\}\{\\widehat\{U\}\_\{\\mathrm\{plan\}\}\+\\widehat\{U\}\_\{\\mathrm\{rend\}\}\+2\\varepsilon\_\{U\}\},\\quad\\omega\(\\mathbf\{x\}\)=1\-\\alpha\(\\mathbf\{x\}\)\.HereεU\>0\\varepsilon\_\{U\}\>0is the routing smoothing constant\. This soft routing acts as a residual reweighting on top of the shared curriculum weight: every sample still updates both modules, while the variance signals control the extra module\-specific weight\. Curriculum determines*when*a sample receives larger weight; module routing determines*where additional weight is placed*\. We validate these routing weights through both agreement with GPT\-5 pseudo\-labels \(Section[5\.5](https://arxiv.org/html/2608.20161#S5.SS5)\) and downstream ablation \(Section[5\.4](https://arxiv.org/html/2608.20161#S5.SS4)\)\.
#### How curriculum and credit assignment interact\.
The two mechanisms play complementary roles over time\. Early in training, the curriculum boundaryκ\(n\)\\kappa\(n\)is low, so easier samples receive most of the weight; for these samples, module routing fine\-tunes which module gets emphasis\. As training progresses andκ\(n\)\\kappa\(n\)rises, harder samples with heterogeneous variance are admitted\. Module routing then becomes more important, because these newly admitted samples do not benefit equally from additional updates to both modules\. If a sample has high hardness but near\-zero total variance, curriculum still controls its admission while module routing contributes little differential emphasis; optimization is then driven mainly by the two task rewardsRplanR\_\{\\mathrm\{plan\}\}andRrendR\_\{\\mathrm\{rend\}\}\.
Table 1\.Main comparison across five benchmarks\. All entries are official*overall*scores \(higher is better; compare within columns\)\. PICA\-Bench reports “simple / detailed” prompt scores\. We highlight Qwen\-Image\-Edit\-2511\-based methods separately and include a controlled*Joint RL \+ Adaptive Curriculum*baseline matchingDARSin backbone, data, reward model, and rollout budget\.MethodKRIS\-BenchRISE\-BenchImgEdit\-BenchGEdit\-Bench\-ENPICA\-BenchOther baselinesThinkGen\([11](https://arxiv.org/html/2608.20161#bib.bib3)\)59\.5710\.563\.977\.1660\.82/65\.09UniREdit\([7](https://arxiv.org/html/2608.20161#bib.bib8)\)61\.0213\.333\.706\.4760\.40/66\.55PromptRL\([31](https://arxiv.org/html/2608.20161#bib.bib7)\)61\.2410\.003\.876\.7451\.02/60\.38Step1X\-Edit\-v1p2\([38](https://arxiv.org/html/2608.20161#bib.bib4)\)62\.5811\.674\.007\.4756\.15/60\.55UniReason 1\.0\([30](https://arxiv.org/html/2608.20161#bib.bib6)\)63\.2615\.004\.066\.5257\.30/61\.62ThinkRL\-Edit\([15](https://arxiv.org/html/2608.20161#bib.bib2)\)66\.0414\.444\.196\.4855\.13/55\.84PhysicEdit\([39](https://arxiv.org/html/2608.20161#bib.bib9)\)66\.7818\.894\.057\.3761\.48/68\.96EditThinker\([16](https://arxiv.org/html/2608.20161#bib.bib5)\)68\.8018\.334\.317\.5959\.64/67\.19Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-2511\([33](https://arxiv.org/html/2608.20161#bib.bib1)\)64\.4217\.504\.366\.9763\.20/72\.27RePlan\([24](https://arxiv.org/html/2608.20161#bib.bib10)\)55\.729\.723\.446\.4352\.00/54\.92PromptEnhancerV2\([32](https://arxiv.org/html/2608.20161#bib.bib11)\)71\.5418\.904\.187\.5961\.90/70\.77Joint RL \+ Adpt\. Curriculum \(ctrl\.\)72\.1525\.704\.207\.8363\.55/72\.22DARS80\.7227\.504\.397\.8664\.19/72\.75
### 4\.4\.Joint Optimization
The planner and renderer operate in different output spaces and are optimized with different policy\-gradient objectives: text\-GRPO\([28](https://arxiv.org/html/2608.20161#bib.bib12)\)for the planner and flow\-GRPO\([17](https://arxiv.org/html/2608.20161#bib.bib13)\)for the renderer\. The key modification relative to standard GRPO is that each module’s objective is weighted by the curriculum factorwcur\(𝐱,n\)w\_\{\\mathrm\{cur\}\}\(\\mathbf\{x\},n\)plus a residual module\-routing emphasis\. Every sample contributes a base update to both modules, scaled by its curriculum weight; module routing only adds module\-specific weight according to the surrogate decomposition\.
For planner optimization, each plan𝐞i\\mathbf\{e\}\_\{i\}receives a renderer\-averaged rewardriplan=1K∑kRplan\(𝐱,𝐞i,𝐲i,k,𝐂\)r\_\{i\}^\{\\mathrm\{plan\}\}=\\frac\{1\}\{K\}\\sum\_\{k\}R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\), from whichA^iplan\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}is computed\. Tokens in slotjjthen use the sign\-aware slot\-weighted advantage from Eq\.[6](https://arxiv.org/html/2608.20161#S4.E6): positive plan\-level advantages reinforce high\-scoring slots, while negative plan\-level advantages concentrate corrective updates on low\-scoring slots\. For renderer optimization, each rendered sample keeps its own rewardri,krend=Rrend\(𝐱,𝐞i,𝐲i,k,𝐂\)r\_\{i,k\}^\{\\mathrm\{rend\}\}=R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\)\. The objectives are:
\(14\)𝒥plan\(θ\)\\displaystyle\\mathcal\{J\}\_\{\\mathrm\{plan\}\}\(\\theta\)=𝔼𝐱\[wcur\(1\+ρα\)ℒGRPOplan\(θ,𝐱\)\],\\displaystyle=\\mathbb\{E\}\_\{\\mathbf\{x\}\}\\Bigl\[w\_\{\\mathrm\{cur\}\}\\,\\bigl\(1\+\\rho\\,\\alpha\\bigr\)\\,\\mathcal\{L\}\_\{\\mathrm\{GRPO\}\}^\{\\mathrm\{plan\}\}\(\\theta;\\mathbf\{x\}\)\\Bigr\],\(15\)𝒥rend\(ϕ\)\\displaystyle\\mathcal\{J\}\_\{\\mathrm\{rend\}\}\(\\phi\)=𝔼𝐱,𝐞\[wcur\(1\+ρω\)ℒflow\-GRPOrend\(ϕ,𝐱,𝐞\)\],\\displaystyle=\\mathbb\{E\}\_\{\\mathbf\{x\},\\mathbf\{e\}\}\\Bigl\[w\_\{\\mathrm\{cur\}\}\\,\\bigl\(1\+\\rho\\,\\omega\\bigr\)\\,\\mathcal\{L\}\_\{\\mathrm\{flow\\text\{\-\}GRPO\}\}^\{\\mathrm\{rend\}\}\(\\phi;\\mathbf\{x\},\\mathbf\{e\}\)\\Bigr\],whereρ≥0\\rho\\geq 0controls the strength of module routing\.ℒGRPOplan\\mathcal\{L\}\_\{\\mathrm\{GRPO\}\}^\{\\mathrm\{plan\}\}is the standard clipped surrogate with KL regularization, applied at the token level usingA^i,jplan\\hat\{A\}\_\{i,j\}^\{\\mathrm\{plan\}\}for tokens in slotjj, andℒflow\-GRPOrend\\mathcal\{L\}\_\{\\mathrm\{flow\\text\{\-\}GRPO\}\}^\{\\mathrm\{rend\}\}uses per\-render advantages from\{ri,krend\}\\\{r\_\{i,k\}^\{\\mathrm\{rend\}\}\\\}\. The final objective is𝒥=𝒥plan\+𝒥rend\\mathcal\{J\}=\\mathcal\{J\}\_\{\\mathrm\{plan\}\}\+\\mathcal\{J\}\_\{\\mathrm\{rend\}\}\. The routing weights are estimated fromRshareR\_\{\\mathrm\{share\}\}, while each module’s policy gradient uses its own reward \(RplanR\_\{\\mathrm\{plan\}\}orRrendR\_\{\\mathrm\{rend\}\}\)\. Module routing, therefore, modulates*how much*each module is updated without changing*what*it learns\. Full expanded expressions are in the supplementary\.
## 5\.Experiments
Figure 4\.Qualitative comparison on reasoning\-intensive editing tasks requiring temporal, spatial, logical, physical, and world\-knowledge reasoning, often in combination\. Compared with baseline methods,DARSachieves the strongest overall performance, producing more faithful edits with better preservation and stronger scene\-level consistency\.Qualitative comparison figure for DARS, comparing source images, user instructions, baseline outputs, and DARS outputs across relatively simple, abstract, and physically constrained editing scenarios\.### 5\.1\.Experimental Setup
#### Training\.
We trainDARSon 10K examples \(5K from the RL split of THINKEDIT\-140K\([16](https://arxiv.org/html/2608.20161#bib.bib5)\)and 5K from UniREdit\-Data\-100K\([7](https://arxiv.org/html/2608.20161#bib.bib8)\)\)\. The planner is initialized from Qwen3\-VL\-4B\-Instruct, and the renderer from Qwen\-Image\-Edit\-2511\. We useM=4M\{=\}4plans andK=4K\{=\}4renderings per plan \(M×K=16M\\times K=16rollouts per input\)\. The learning rate is2×10−62\\times 10^\{\-6\}, the global batch size is256256, the KL penalty coefficient\([27](https://arxiv.org/html/2608.20161#bib.bib37)\)is10−310^\{\-3\}, and the maximum image resolution is1024×10241024\\times 1024\. The offline checklist generator \(Gemini 3 Pro\) and the online reward judge \(Qwen3\-VL\-32B\) are fixed acrossDARSand all in\-house ablations, so differences reflect the proposed credit\-assignment and planner\-structure choices under a fixed reward pipeline\. The controlled baseline andDARSuse the same rollout budget on identical hardware;DARSadds lightweight rollout statistics and slot\-wise scoring on top of that shared budget\. We evaluate on five complementary benchmarks spanning reasoning\-intensive editing, general\-purpose instruction following, preservation\-sensitive localized editing, and physics\-aware realism: KRIS\-Bench\([35](https://arxiv.org/html/2608.20161#bib.bib26)\), RISE\-Bench\([40](https://arxiv.org/html/2608.20161#bib.bib25)\), ImgEdit\-Bench\([37](https://arxiv.org/html/2608.20161#bib.bib35)\), GEdit\-Bench\-EN\([18](https://arxiv.org/html/2608.20161#bib.bib18)\), and PICA\-Bench\([23](https://arxiv.org/html/2608.20161#bib.bib36)\)\. All reported numbers are official overall scores, and the higher the number, the better\. Benchmark results are obtained using each benchmark’s official evaluation code and are fully independent of the training reward model\.
#### Baselines\.
We compare against 11 methods spanning multi\-round reflection editors \(ThinkRL\-Edit\([15](https://arxiv.org/html/2608.20161#bib.bib2)\), Step1X\-Edit\-v1p2\([38](https://arxiv.org/html/2608.20161#bib.bib4)\), and EditThinker\([16](https://arxiv.org/html/2608.20161#bib.bib5)\)\), reasoning\- or planning\-based editors \(ThinkGen\([11](https://arxiv.org/html/2608.20161#bib.bib3)\), RePlan\([24](https://arxiv.org/html/2608.20161#bib.bib10)\), UniREdit\([7](https://arxiv.org/html/2608.20161#bib.bib8)\), and UniReason 1\.0\([30](https://arxiv.org/html/2608.20161#bib.bib6)\), which includes a single reflection step\), reward\-optimized or prompt\-enhancement methods \(PromptRL\([31](https://arxiv.org/html/2608.20161#bib.bib7)\)and PromptEnhancerV2\([32](https://arxiv.org/html/2608.20161#bib.bib11)\)\), a physics\-specialized baseline \(PhysicEdit\([39](https://arxiv.org/html/2608.20161#bib.bib9)\)\), and a strong end\-to\-end editor \(Qwen\-Image\-Edit\-2511\([33](https://arxiv.org/html/2608.20161#bib.bib1)\)\)\. We further include a controlled*Joint RL \+ Adaptive Curriculum*baseline that matchesDARSin backbone, data, reward model, rollout budget, and adaptive curriculum, while replacingDARS’s structured reasoning planner and dual\-level credit assignment with free\-form reasoning\. Detailed architecture descriptions are in the supplementary\.
### 5\.2\.Main Results
Table[1](https://arxiv.org/html/2608.20161#S4.T1)shows that the fullDARSsystem attains the best score on all five benchmark regimes\. Against previously reported methods, the gains are consistent across evaluation criteria\. Against the in\-house controlled baseline with matched backbone, data, reward model, rollout budget, and adaptive curriculum,DARSimproves by\+8\.57\+8\.57on KRIS\-Bench,\+1\.80\+1\.80on RISE\-Bench,\+0\.19\+0\.19on ImgEdit\-Bench,\+0\.03\+0\.03on GEdit\-Bench\-EN, and\+0\.64/\+0\.53\+0\.64/\+0\.53on PICA\-Bench\. The strongest gains appear on KRIS\-Bench and RISE\-Bench, consistent withDARS’s focus on planner\-renderer credit assignment for reasoning\-intensive edits\.
### 5\.3\.Qualitative Results
Figure[4](https://arxiv.org/html/2608.20161#acmlabel4)comparesDARSagainst reasoning\-oriented editing methods\. We include Qwen\-Image\-Edit\-2511 as a baseline without explicit reasoning, together with instruction\-rewriting or planning baselines: UniReason 1\.0 based on the unified multimodal model Bagel, PromptRL as a VLM\-diffusion joint\-RL method, EditThinker with up to five rounds of reflective prompt revision, RePlan with region\-aware reasoning, PhysicEdit specialized by physics\-grounded data tuning, and PromptEnhancerV2, a strong 32B prompt\-enhancement model combining expert\-designed rules with end\-to\-end RL\. Across the Figure[4](https://arxiv.org/html/2608.20161#acmlabel4)examples,DARSdelivers the strongest visual quality, achieving the best balance of instruction faithfulness, preservation, scene coherence, and reasoning consistency\.
### 5\.4\.Ablation Studies
Unless otherwise stated, ablations are reported on RISE\-Bench and GEdit\-Bench\-EN\. All variants useDARSwithout auxiliary heuristics\. Free\-form joint RL without a curriculum diverged, whereas the structured reasoning planner remained trainable without it, albeit with worse performance\. The ablations below, therefore, use the structured reasoning planner unless explicitly labeled otherwise\.
#### Curriculum and routing \(Table[2](https://arxiv.org/html/2608.20161#S5.T2)\)\.
Adaptive curriculum consistently outperforms static and no\-curriculum baselines, confirming that dynamic hardness re\-estimation is critical as model competence evolves\. Notably, No Curriculum still converges under the structured reasoning planner, whereas free\-form joint RL without a curriculum diverges , suggesting that the four\-field structure provides implicit training stabilization\. For routing, soft continuous weighting outperforms both uniform and hard\-threshold alternatives, consistent with mixed but asymmetric variance patterns in many editing failures\. The configuration comparison shows that the fullDARSimproves over both the prompt\-only baseline \(23\.80, no RL\) and the controlled free\-form Joint RL baseline \(25\.70\), confirming gains over structured prompting alone and over a matched free\-form joint\-RL setup\.
#### Planner structure and reward \(Table[3](https://arxiv.org/html/2608.20161#S5.T3)\)\.
A monotonic trend runs from free\-form reasoning to the full four\-field answer, with each field providing gains: removing*Preserve*causes a drop on GEdit\-Bench\-EN, consistent with its emphasis on localized editing and non\-target preservation; removing*Overall*produces a larger drop on the reasoning\-heavy RISE\-Bench, indicating that scene\-level coherence is important for complex edits; removing*Tips*yields the smallest consistent degradation, suggesting that execution guidance is helpful once higher\-level semantics are in place\. These results support distinct slot roles and slot\-wise advantage reweighting unavailable under free\-form reasoning\. For reward composition, the prefix\-gated reward outperforms flat averaging and weighted summation\. Flat averaging treats all fields as independent and equally important, failing to reflect the causal structure of editing plans\. Weighted summation improves over flat averaging but underperforms because it does not enforce dependency between upstream and downstream fields\. The prefix\-gated reward yields the best results by ensuring that later fields are only rewarded once earlier fields are reliable, reducing the incentive to compensate for upstream errors by overproducing downstream text\.
Table 2\.Ablation on curriculum and routing strategies\.VariantRISEGEditCurriculumNo Curriculum18\.896\.87Static Curriculum24\.567\.15Adaptive Curriculum27\.507\.86RoutingNo Routing20\.057\.12Hard Routing24\.867\.49Soft Routing \(Ours\)27\.507\.86ConfigurationStructured Prompt Only \(No RL\)23\.807\.10Free\-form Joint RL \+ Adpt\.25\.707\.83Full DARS27\.507\.86Table 3\.Ablation on planner structure and reward composition\.VariantRISEGEditPlanner structureFree\-form Reasoning23\.946\.98Modify Only25\.217\.11Without Preserve26\.087\.34Without Overall26\.427\.51Without Tips26\.877\.69Full Structured Answer27\.507\.86Reward compositionFlat Average24\.927\.28Weighted Sum26\.317\.57Prefix\-Gated \(Ours\)27\.507\.86
### 5\.5\.Validating the Uncertainty Signals
The modeling claim ofDARSis that rollout statistics provide informative routing signals for cross\-module optimization\. We validate whether the plan\-dominant and render\-dominant routing scores align with GPT\-5 pseudo\-labels of dominant failure patterns\.
#### Protocol\.
For each evaluation case, we construct the sameM×KM\\times Krollout bank used byDARSand computeU^plan\\widehat\{U\}\_\{\\mathrm\{plan\}\},U^rend\\widehat\{U\}\_\{\\mathrm\{rend\}\}, andα\\alphafrom that rollout bank\. Separately, we sample five realized triplets from the same case and ask GPT\-5 to assign each one a pseudo\-label among*planner\-dominant*,*renderer\-dominant*, or*mixed*; the majority vote becomes the case\-level pseudo\-label\. GPT\-5 sees only the source image, structured plan, and edited image for each triplet, not the rollout statistics or reward\-model outputs used byDARS\. Metrics are reported for pairwise one\-vs\-one discrimination tasks, with AUROC computed in the corresponding binary setting\.
Table 4\.Routing\-signal discrimination against majority\-voted GPT\-5 pseudo\-labels\.SettingAccuracyMacro\-F1AUROCPlanner vs\. Renderer86\.085\.80\.930Planner vs\. Mixed84\.784\.10\.918Renderer vs\. Mixed85\.384\.90\.923Table[4](https://arxiv.org/html/2608.20161#S5.T4)shows AUROC above 0\.91 in all pairwise discriminations, indicating that the rollout statistics track GPT\-5 pseudo\-labels of dominant failure patterns well\. Combined with the ablation result that soft routing outperforms both hard routing and no routing \(Table[2](https://arxiv.org/html/2608.20161#S5.T2)\), this provides evidence that the routing signal captures failure\-mode differences and improves update allocation\.
## 6\.Limitations
DARSrequiresM×KM\\times Krollouts per training example, so the total cost remains higher than single\-path updates even though these rollouts are shared with policy optimization\. The variance\-based routing and post\-render planner scores depend on the reward model, and planner\-renderer interactions can be harder to disentangle when both modules fail simultaneously\. Adapting the framework to video editing or multi\-turn settings is left for future work\.
## 7\.Conclusion
We presentDARS, which formulates joint RL in two\-stage planner\-renderer image editing pipelines as a dual\-level credit\-assignment problem\. Rollout variance decomposition provides routing signals for cross\-module updates; hardness\-derived scores drive adaptive curriculum scheduling; and a structured four\-field planner with prefix gating enables slot\-wise diagnostics\.DARSattains the best results across five benchmarks, with the largest gains on reasoning\-intensive tasks\.
###### Acknowledgements\.
This work was supported by KlingAI Research\. We thank Shenhui Zhang, Jiahao Guo, and Bao Tang for their valuable discussions\.
## References
- S\. Bai, K\. Chen, X\. Liu, J\. Wang, W\. Ge, S\. Song, K\. Dang, P\. Wang, S\. Wang, J\. Tang, H\. Zhong, Y\. Zhu, M\. Yang, Z\. Li, J\. Wan, P\. Wang, W\. Ding, Z\. Fu, Y\. Xu, J\. Ye, X\. Zhang, T\. Xie, Z\. Cheng, H\. Zhang, Z\. Yang, H\. Xu, and J\. LinQwen2\.5\-vl technical report\.CoRRabs/2502\.13923\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1)\.
- Bengioet al\.\(2009\)Y\. Bengio, J\. Louradour, R\. Collobert, and J\. WestonCurriculum learning\.InProceedings of the 26th Annual International Conference on Machine Learning,ICML ’09,New York, NY, USA,pp\. 41–48\.External Links:ISBN 9781605585161Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p4.1)\.
- Brookset al\.\(2023\)T\. Brooks, A\. Holynski, and A\. A\. EfrosInstructPix2Pix: learning to follow image editing instructions\.InIEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17\-24, 2023,pp\. 18392–18402\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1)\.
- Croitoruet al\.\(2025\)F\. Croitoru, V\. Hondru, R\. T\. Ionescu, N\. Sebe, and M\. ShahCurriculum direct preference optimization for diffusion and consistency models\.InIEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA, June 11\-15, 2025,pp\. 2824–2834\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px3.p1.1)\.
- Croitoruet al\.\(2026\)F\. Croitoru, V\. Hondru, R\. T\. Ionescu, N\. Sebe, and M\. ShahCurriculum\-dpo\+\+: direct preference optimization via data and model curricula for text\-to\-image generation\.CoRRabs/2602\.13055\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px3.p1.1)\.
- Esseret al\.\(2024\)P\. Esser, S\. Kulal, A\. Blattmann, R\. Entezari, J\. Müller, H\. Saini, Y\. Levi, D\. Lorenz, A\. Sauer, F\. Boesel, D\. Podell, T\. Dockhorn, Z\. English, and R\. RombachScaling rectified flow transformers for high\-resolution image synthesis\.InForty\-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21\-27, 2024,Proceedings of Machine Learning Research,pp\. 12606–12633\.Cited by:[§3\.2](https://arxiv.org/html/2608.20161#S3.SS2.p1.1)\.
- Hanet al\.\(2025\)F\. Han, Y\. Wang, C\. Li, Z\. Liang, D\. Wang, Y\. Jiao, Z\. Wei, C\. Gong, C\. Jin, J\. Chen, and J\. WangUniREditBench: A unified reasoning\-based image editing benchmark\.CoRRabs/2511\.01295\.Cited by:[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.4.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Hertzet al\.\(2023\)A\. Hertz, R\. Mokady, J\. Tenenbaum, K\. Aberman, Y\. Pritch, and D\. Cohen\-OrPrompt\-to\-prompt image editing with cross\-attention control\.InThe Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1\-5, 2023,Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1)\.
- Hoet al\.\(2020\)J\. Ho, A\. Jain, and P\. AbbeelDenoising diffusion probabilistic models\.InAdvances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6\-12, 2020, virtual,Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p2.1)\.
- Jianget al\.\(2025\)G\. Jiang, W\. Feng, G\. Quan, C\. Hao, Y\. Zhang, G\. Liu, and H\. WangVCRL: variance\-based curriculum reinforcement learning for large language models\.CoRRabs/2509\.19803\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p3.1)\.
- Jiaoet al\.\(2025\)S\. Jiao, Y\. Lin, Y\. Zhong, Q\. She, W\. Zhou, X\. Lan, Z\. Huang, F\. Yu, Y\. Yu, Y\. Zhao, Y\. Zhao, and Y\. WeiThinkGen: generalized thinking for visual generation\.CoRRabs/2512\.23568\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p2.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px3.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.3.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Khotet al\.\(2023\)T\. Khot, H\. Trivedi, M\. Finlayson, Y\. Fu, K\. Richardson, P\. Clark, and A\. SabharwalDecomposed prompting: A modular approach for solving complex tasks\.InThe Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1\-5, 2023,Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px3.p1.1)\.
- Labset al\.\(2025\)B\. F\. Labs, S\. Batifol, A\. Blattmann, F\. Boesel, S\. Consul, C\. Diagne, T\. Dockhorn, J\. English, Z\. English, P\. Esser, S\. Kulal, K\. Lacey, Y\. Levi, C\. Li, D\. Lorenz, J\. Müller, D\. Podell, R\. Rombach, H\. Saini, A\. Sauer, and L\. SmithFLUX\.1 kontext: flow matching for in\-context image generation and editing in latent space\.CoRRabs/2506\.15742\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1)\.
- Labs \(2025\)B\. F\. LabsFLUX\.2: Frontier Visual Intelligence\.Note:[https://bfl\.ai/blog/flux\-2](https://bfl.ai/blog/flux-2)Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2026\)H\. Li, L\. Jiang, Q\. Yan, Y\. Song, H\. Kang, Z\. Liu, X\. Lu, B\. Wu, and D\. CaiThinkRL\-edit: thinking in reinforcement learning for reasoning\-centric image editing\.CoRRabs/2601\.03467\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.8.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Liet al\.\(2025\)H\. Li, M\. Zhang, D\. Zheng, Z\. Guo, Y\. Jia, K\. Feng, H\. Yu, Y\. Liu, Y\. Feng, P\. Pei, X\. Cai, L\. Huang, H\. Li, and S\. LiuEditThinker: unlocking iterative reasoning for any image editor\.CoRRabs/2512\.05965\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§1](https://arxiv.org/html/2608.20161#S1.p2.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px3.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.10.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Liuet al\.\(2025a\)J\. Liu, G\. Liu, J\. Liang, Y\. Li, J\. Liu, X\. Wang, P\. Wan, D\. Zhang, and W\. OuyangFlow\-grpo: training flow matching models via online RL\.CoRRabs/2505\.05470\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1),[§3\.2](https://arxiv.org/html/2608.20161#S3.SS2.p1.1),[§4\.4](https://arxiv.org/html/2608.20161#S4.SS4.p1.1)\.
- Liuet al\.\(2025b\)S\. Liu, Y\. Han, P\. Xing, F\. Yin, R\. Wang, W\. Cheng, J\. Liao, Y\. Wang, H\. Fu, C\. Han, G\. Li, Y\. Peng, Q\. Sun, J\. Wu, Y\. Cai, Z\. Ge, R\. Ming, L\. Xia, X\. Zeng, Y\. Zhu, B\. Jiao, X\. Zhang, G\. Yu, and D\. JiangStep1X\-edit: A practical framework for general image editing\.CoRRabs/2504\.17761\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1)\.
- Liuet al\.\(2023\)X\. Liu, C\. Gong, and Q\. LiuFlow straight and fast: learning to generate and transfer data with rectified flow\.InThe Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1\-5, 2023,Cited by:[§3\.2](https://arxiv.org/html/2608.20161#S3.SS2.p1.1)\.
- Luoet al\.\(2025\)X\. Luo, J\. Wang, C\. Wu, S\. Xiao, X\. Jiang, D\. Lian, J\. Zhang, D\. Li, and Z\. LiuEditScore: unlocking online RL for image editing via high\-fidelity reward modeling\.CoRRabs/2509\.23909\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p2.1)\.
- Maet al\.\(2025\)H\. Ma, H\. Tan, J\. Huang, J\. Wu, J\. He, L\. Gao, S\. Xiao, X\. Wei, X\. Ma, X\. Cai, Y\. Guan, and J\. HuLongCat\-image technical report\.CoRRabs/2512\.07584\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1)\.
- Menget al\.\(2022\)C\. Meng, Y\. He, Y\. Song, J\. Song, J\. Wu, J\. Zhu, and S\. ErmonSDEdit: guided image synthesis and editing with stochastic differential equations\.InThe Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25\-29, 2022,Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1)\.
- Puet al\.\(2025\)Y\. Pu, L\. Zhuo, S\. Han, J\. Xing, K\. Zhu, S\. Cao, B\. Fu, S\. Liu, H\. Li, Y\. Qiao, W\. Zhang, X\. Chen, and Y\. LiuPICABench: how far are we from physically realistic image editing?\.CoRRabs/2510\.17681\.Cited by:[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1)\.
- Quet al\.\(2025\)T\. Qu, L\. Ke, X\. Zhan, L\. Tang, Y\. Liu, B\. Peng, B\. Yu, D\. Yu, and J\. JiaRePlan: reasoning\-guided region planning for complex instruction\-based image editing\.CoRRabs/2512\.16864\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§1](https://arxiv.org/html/2608.20161#S1.p2.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.13.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Qwen Team \(2026\)Qwen TeamQwen3\.5: towards native multimodal agents\.External Links:[Link](https://qwen.ai/blog?id=qwen3.5)Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1)\.
- Radfordet al\.\(2018\)A\. Radford, K\. Narasimhan, T\. Salimans, I\. Sutskever,et al\.Improving language understanding by generative pre\-training\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p2.1)\.
- Schulmanet al\.\(2017\)J\. Schulman, F\. Wolski, P\. Dhariwal, A\. Radford, and O\. KlimovProximal policy optimization algorithms\.CoRRabs/1707\.06347\.Cited by:[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1)\.
- Shaoet al\.\(2024\)Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, M\. Zhang, Y\. K\. Li, Y\. Wu, and D\. GuoDeepSeekMath: pushing the limits of mathematical reasoning in open language models\.CoRRabs/2402\.03300\.Cited by:[§3\.2](https://arxiv.org/html/2608.20161#S3.SS2.p1.1),[§4\.4](https://arxiv.org/html/2608.20161#S4.SS4.p1.1)\.
- Team \(2025\)Q\. TeamQwen3\-vl technical report\.CoRRabs/2511\.21631\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1)\.
- Wanget al\.\(2026a\)D\. Wang, C\. Ma, F\. Han, S\. Wu, W\. Song, Y\. Wang, Z\. Zhang, T\. Wang, S\. Wang, Z\. Wei, and J\. WangUniReason 1\.0: A unified reasoning framework for world knowledge aligned image generation and editing\.CoRRabs/2602\.02437\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.7.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Wanget al\.\(2026b\)F\. Wang, H\. Zhang, M\. Gharbi, H\. Li, and T\. ParkPromptRL: prompt matters in RL for flow\-based image generation\.CoRRabs/2602\.01382\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.5.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Wanget al\.\(2025\)L\. Wang, X\. Xing, Y\. Cheng, Z\. Zhao, D\. Li, T\. Hang, J\. Tao, Q\. Wang, R\. Li, C\. Chen, X\. Li, M\. Wu, X\. Deng, S\. Gu, C\. Wang, and Q\. LuPromptEnhancer: A simple approach to enhance text\-to\-image models via chain\-of\-thought prompt rewriting\.CoRRabs/2509\.04545\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p2.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px3.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.14.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Wuet al\.\(2025a\)C\. Wu, J\. Li, J\. Zhou, J\. Lin, K\. Gao, K\. Yan, S\. Yin, S\. Bai, X\. Xu, Y\. Chen, Y\. Chen, Z\. Tang, Z\. Zhang, Z\. Wang, A\. Yang, B\. Yu, C\. Cheng, D\. Liu, D\. Li, H\. Zhang, H\. Meng, H\. Wei, J\. Ni, K\. Chen, K\. Cao, L\. Peng, L\. Qu, M\. Wu, P\. Wang, S\. Yu, T\. Wen, W\. Feng, X\. Xu, Y\. Wang, Y\. Zhang, Y\. Zhu, Y\. Wu, Y\. Cai, and Z\. LiuQwen\-image technical report\.CoRRabs/2508\.02324\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.12.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Wuet al\.\(2025b\)K\. Wu, S\. Jiang, M\. Ku, P\. Nie, M\. Liu, and W\. ChenEditReward: A human\-aligned reward model for instruction\-guided image editing\.CoRRabs/2509\.26346\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p2.1)\.
- Wuet al\.\(2025c\)Y\. Wu, Z\. Li, X\. Hu, X\. Ye, X\. Zeng, G\. Yu, W\. Zhu, B\. Schiele, M\. Yang, and X\. YangKRIS\-bench: benchmarking next\-level intelligent image editing models\.CoRRabs/2505\.16707\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p5.2),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1)\.
- Xueet al\.\(2025\)Z\. Xue, J\. Wu, Y\. Gao, F\. Kong, L\. Zhu, M\. Chen, Z\. Liu, W\. Liu, Q\. Guo, W\. Huang, and P\. LuoDanceGRPO: unleashing GRPO on visual generation\.CoRRabs/2505\.07818\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1)\.
- Yeet al\.\(2025\)Y\. Ye, X\. He, Z\. Li, B\. Lin, S\. Yuan, Z\. Yan, B\. Hou, and L\. YuanImgEdit: A unified image editing dataset and benchmark\.CoRRabs/2505\.20275\.Cited by:[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1)\.
- Yinet al\.\(2025\)F\. Yin, S\. Liu, Y\. Han, Z\. Wang, P\. Xing, R\. Wang, W\. Cheng, Y\. Wang, A\. Li, Z\. Yin, P\. Chen, X\. Zhang, D\. Jiang, X\. Zeng, and G\. YuReasonEdit: towards reasoning\-enhanced image editing models\.CoRRabs/2511\.22625\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p1.1),[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px1.p1.1),[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.6.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Zhaoet al\.\(2026\)L\. Zhao, L\. Zhuo, S\. Paul, H\. Li, and M\. ElhoseinyFrom statics to dynamics: physics\-aware image editing with latent transition priors\.CoRRabs/2602\.21778\.Cited by:[Table 1](https://arxiv.org/html/2608.20161#S4.T1.8.9.1),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px2.p1.1)\.
- Zhaoet al\.\(2025\)X\. Zhao, P\. Zhang, K\. Tang, H\. Li, Z\. Zhang, G\. Zhai, J\. Yan, H\. Yang, X\. Yang, and H\. DuanEnvisioning beyond the pixels: benchmarking reasoning\-informed visual editing\.CoRRabs/2504\.02826\.Cited by:[§1](https://arxiv.org/html/2608.20161#S1.p5.2),[§5\.1](https://arxiv.org/html/2608.20161#S5.SS1.SSS0.Px1.p1.1)\.
- Zhenget al\.\(2025\)K\. Zheng, H\. Chen, H\. Ye, H\. Wang, Q\. Zhang, K\. Jiang, H\. Su, S\. Ermon, J\. Zhu, and M\. LiuDiffusionNFT: online diffusion reinforcement with forward process\.CoRRabs/2509\.16117\.Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1)\.
- Zhuet al\.\(2025\)H\. Zhu, T\. Xiao, and V\. G\. HonavarDSPO: direct score preference optimization for diffusion model alignment\.InThe Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24\-28, 2025,Cited by:[§2](https://arxiv.org/html/2608.20161#S2.SS0.SSS0.Px2.p1.1)\.
Supplementary Material forDARS: Dual\-Level Credit Assignment
RL with Structured Reasoning for Instruction\-Based Image
Editing
## 0\. Contents and Index
Contents
List of Figures
List of Tables
## 1\.Additional Methodological Details
### 1\.1\.Expanded Optimization Objectives
This subsection expands the compact objectives in the main paper into the exact rollout\-level forms used during optimization\. Definitions of the reward signals and the high\-level design motivation remain in the main text; here we focus only on how the offline cached checklist, online planner\-generated four\-slot plans, old\-policy rollouts, and token\- or step\-level surrogates are instantiated in training\. Throughout this subsection,iiindexes sampled plans,kkrenderings,jjstructured slots,ttplanner tokens, andmmdenoising\-trajectory positions\.
#### Planner objective\.
For each input𝐱\\mathbf\{x\}, we sample a group ofGp=MG\_\{\\mathrm\{p\}\}=Mcandidate plans from the behavior policy:
\(S1\)𝐞i∼qθold\(⋅∣𝐱\),i=1,…,Gp\.\\mathbf\{e\}\_\{i\}\\sim q\_\{\\theta\_\{\\mathrm\{old\}\}\}\(\\cdot\\mid\\mathbf\{x\}\),\\qquad i=1,\\ldots,G\_\{\\mathrm\{p\}\}\.For each sampled plan𝐞i\\mathbf\{e\}\_\{i\}, we generateKKpaired renderings𝐲i,k∼pϕold\(⋅∣Isrc,𝐞i\)\\mathbf\{y\}\_\{i,k\}\\sim p\_\{\\phi\_\{\\mathrm\{old\}\}\}\(\\cdot\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\_\{i\}\)\. The planner reward for theii\-th sampled plan is the planner reward averaged over its rendered outcomes:
\(S2\)riplan=1K∑k=1KRplan\(𝐱,𝐞i,𝐲i,k,𝐂\),r\_\{i\}^\{\\mathrm\{plan\}\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\),where the checklist𝐂=𝐂\(𝐱\)\\mathbf\{C\}=\\mathbf\{C\}\(\\mathbf\{x\}\)is pre\-generated once offline before RL training from the source image and instruction, and then shared across all rollouts of the same sample\. The group\-relative advantage is
\(S3\)A^iplan=riplan−mean\(\{ri′plan\}i′=1Gp\)std\(\{ri′plan\}i′=1Gp\)\+εA\.\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}=\\frac\{r\_\{i\}^\{\\mathrm\{plan\}\}\-\\operatorname\{mean\}\\left\(\\\{r\_\{i^\{\\prime\}\}^\{\\mathrm\{plan\}\}\\\}\_\{i^\{\\prime\}=1\}^\{G\_\{\\mathrm\{p\}\}\}\\right\)\}\{\\operatorname\{std\}\\left\(\\\{r\_\{i^\{\\prime\}\}^\{\\mathrm\{plan\}\}\\\}\_\{i^\{\\prime\}=1\}^\{G\_\{\\mathrm\{p\}\}\}\\right\)\+\\varepsilon\_\{A\}\}\.HereεA\>0\\varepsilon\_\{A\}\>0is the advantage\-normalization stabilizer shared by the planner and renderer objectives\. Letsi,k\(j\)s\_\{i,k\}^\{\(j\)\}denote the score of slotjjunder rendering𝐲i,k\\mathbf\{y\}\_\{i,k\}, and define the rendering\-averaged slot score and reweighted token\-level advantage as
\(S4\)s¯i\(j\)=1K∑k=1Ksi,k\(j\),A^i,jplan=A^iplan⋅∏l=1j−1σ¯i\(l\)⋅\{s¯i\(j\),A^iplan≥0,1−s¯i\(j\),A^iplan<0,\\bar\{s\}\_\{i\}^\{\(j\)\}=\\tfrac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}s\_\{i,k\}^\{\(j\)\},\\qquad\\hat\{A\}\_\{i,j\}^\{\\mathrm\{plan\}\}=\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}\\cdot\\prod\_\{l=1\}^\{j\-1\}\\bar\{\\sigma\}\_\{i\}^\{\(l\)\}\\cdot\\begin\{cases\}\\bar\{s\}\_\{i\}^\{\(j\)\},&\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}\\geq 0,\\\\ 1\-\\bar\{s\}\_\{i\}^\{\(j\)\},&\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}<0,\\end\{cases\}whereσ¯i\(l\)=𝕀\[s¯i\(l\)≥δl\]\\bar\{\\sigma\}\_\{i\}^\{\(l\)\}=\\mathbb\{I\}\[\\bar\{s\}\_\{i\}^\{\(l\)\}\\geq\\delta\_\{l\}\]is an analogous prefix gate computed from rendering\-averaged slot scores\. It has the same threshold form and causal ordering as the per\-render gate in the main paper, but is distinct fromσi,k\(l\)\\sigma\_\{i,k\}^\{\(l\)\}\. This sign\-aware modulation prevents low\-quality slots from inheriting positive credit from an otherwise good plan, while assigning stronger negative updates to the slots most associated with poor overall plan performance\. Since the planner is autoregressive, the GRPO ratio is defined at the token level\. For thett\-th token in𝐞i\\mathbf\{e\}\_\{i\}:
\(S5\)ϱi,tplan\(θ\)=qθ\(ei,t∣𝐱,ei,<t\)qθold\(ei,t∣𝐱,ei,<t\)\.\\varrho\_\{i,t\}^\{\\mathrm\{plan\}\}\(\\theta\)=\\frac\{q\_\{\\theta\}\(e\_\{i,t\}\\mid\\mathbf\{x\},e\_\{i,<t\}\)\}\{q\_\{\\theta\_\{\\mathrm\{old\}\}\}\(e\_\{i,t\}\\mid\\mathbf\{x\},e\_\{i,<t\}\)\}\.Letslot\(t\)\\operatorname\{slot\}\(t\)denote the structured slot containing tokentt, as determined by the enclosing ordered tag pair; the opening and closing tag tokens are assigned to that same slot\. The token\-level surrogate uses the sign\-aware slot\-weighted advantageA^i,slot\(t\)plan\\hat\{A\}\_\{i,\\operatorname\{slot\}\(t\)\}^\{\\mathrm\{plan\}\}instead of a uniform plan\-level advantage\. The full planner objective is:
\(S6\)𝒥plan\(θ\)\\displaystyle\\mathcal\{J\}\_\{\\mathrm\{plan\}\}\(\\theta\)=𝔼𝐱\[wcur\(𝐱,n\)\(1\+ρα\(𝐱\)\)1Gp∑i=1Gp1\|𝐞i\|∑t=1\|𝐞i\|\\displaystyle=\\mathbb\{E\}\_\{\\mathbf\{x\}\}\\Biggl\[w\_\{\\mathrm\{cur\}\}\(\\mathbf\{x\},n\)\\,\\bigl\(1\+\\rho\\,\\alpha\(\\mathbf\{x\}\)\\bigr\)\\,\\frac\{1\}\{G\_\{\\mathrm\{p\}\}\}\\sum\_\{i=1\}^\{G\_\{\\mathrm\{p\}\}\}\\frac\{1\}\{\|\\mathbf\{e\}\_\{i\}\|\}\\sum\_\{t=1\}^\{\|\\mathbf\{e\}\_\{i\}\|\}\(min\(ϱi,tplan\(θ\)A^i,slot\(t\)plan,\\displaystyle\\Bigl\(\\min\\bigl\(\\varrho\_\{i,t\}^\{\\mathrm\{plan\}\}\(\\theta\)\\,\\hat\{A\}\_\{i,\\operatorname\{slot\}\(t\)\}^\{\\mathrm\{plan\}\},OPENclip\(ϱi,tplan\(θ\),1−ϵp,1\+ϵp\)A^i,slot\(t\)plan\)\\displaystyle\\operatorname\{clip\}\\bigl\(\\varrho\_\{i,t\}^\{\\mathrm\{plan\}\}\(\\theta\),1\-\\epsilon\_\{\\mathrm\{p\}\},1\+\\epsilon\_\{\\mathrm\{p\}\}\\bigr\)\\,\\hat\{A\}\_\{i,\\operatorname\{slot\}\(t\)\}^\{\\mathrm\{plan\}\}\\bigr\)−βpDKL\(qθ∥qref\)\)\]\.\\displaystyle\-\\beta\_\{\\mathrm\{p\}\}\\,D\_\{\\mathrm\{KL\}\}\(q\_\{\\theta\}\\,\\\|\\,q\_\{\\mathrm\{ref\}\}\)\\Bigr\)\\Biggr\]\.
#### Renderer objective\.
Using the same sampled plans\{𝐞i\}i=1M\\\{\\mathbf\{e\}\_\{i\}\\\}\_\{i=1\}^\{M\}from the planner rollout bank, we sampleKKrenderer rollouts for each fixed pair\(𝐱,𝐞i\)\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\}\)from the old diffusion\-flow policy\. Let𝐲i,k\\mathbf\{y\}\_\{i,k\}denote the decoded image from thekk\-th rollout under plan𝐞i\\mathbf\{e\}\_\{i\}\. The renderer\-side reward is
\(S7\)ri,krend=Rrend\(𝐱,𝐞i,𝐲i,k,𝐂\),r\_\{i,k\}^\{\\mathrm\{rend\}\}=R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\),where again𝐂=𝐂\(𝐱\)\\mathbf\{C\}=\\mathbf\{C\}\(\\mathbf\{x\}\)is fixed for all rollouts of the same input\. The renderer\-side group\-relative advantage is computed separately within each fixed plan:
\(S8\)A^i,krend=ri,krend−mean\(\{ri,k′rend\}k′=1K\)std\(\{ri,k′rend\}k′=1K\)\+εA\.\\hat\{A\}\_\{i,k\}^\{\\mathrm\{rend\}\}=\\frac\{r\_\{i,k\}^\{\\mathrm\{rend\}\}\-\\operatorname\{mean\}\\left\(\\\{r\_\{i,k^\{\\prime\}\}^\{\\mathrm\{rend\}\}\\\}\_\{k^\{\\prime\}=1\}^\{K\}\\right\)\}\{\\operatorname\{std\}\\left\(\\\{r\_\{i,k^\{\\prime\}\}^\{\\mathrm\{rend\}\}\\\}\_\{k^\{\\prime\}=1\}^\{K\}\\right\)\+\\varepsilon\_\{A\}\}\.For flow\-GRPO, letmmindex the complete ordered denoising trajectory,τm\\tau\_\{m\}its diffusion time, andzi,k,mz\_\{i,k,m\}the corresponding latent state\. Hereτm−1\\tau\_\{m\-1\}is the adjacent lower\-noise time afterτm\\tau\_\{m\}, with latent statezi,k,m−1z\_\{i,k,m\-1\}; the optimized indices form a subset𝒮\\mathcal\{S\}of this trajectory\. The ratio is
\(S9\)ϱi,k,mflow\(ϕ\)=pϕ\(zi,k,m−1∣Isrc,𝐞i,zi,k,m,τm\)pϕold\(zi,k,m−1∣Isrc,𝐞i,zi,k,m,τm\)\.\\varrho\_\{i,k,m\}^\{\\mathrm\{flow\}\}\(\\phi\)=\\frac\{p\_\{\\phi\}\(z\_\{i,k,m\-1\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\_\{i\},z\_\{i,k,m\},\\tau\_\{m\}\)\}\{p\_\{\\phi\_\{\\mathrm\{old\}\}\}\(z\_\{i,k,m\-1\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\_\{i\},z\_\{i,k,m\},\\tau\_\{m\}\)\}\.The full renderer objective is:
\(S10\)𝒥rend\(ϕ\)\\displaystyle\\mathcal\{J\}\_\{\\mathrm\{rend\}\}\(\\phi\)=𝔼𝐱\[wcur\(𝐱,n\)\(1\+ρω\(𝐱\)\)1M∑i=1M1K∑k=1K1\|𝒮\|∑m∈𝒮\\displaystyle=\\mathbb\{E\}\_\{\\mathbf\{x\}\}\\Biggl\[w\_\{\\mathrm\{cur\}\}\(\\mathbf\{x\},n\)\\,\\bigl\(1\+\\rho\\,\\omega\(\\mathbf\{x\}\)\\bigr\)\\,\\frac\{1\}\{M\}\\sum\_\{i=1\}^\{M\}\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}\\frac\{1\}\{\|\\mathcal\{S\}\|\}\\sum\_\{m\\in\\mathcal\{S\}\}\(min\(ϱi,k,mflow\(ϕ\)A^i,krend,clip\(ϱi,k,mflow\(ϕ\),1−ϵr,1\+ϵr\)A^i,krend\)CLOSE\\displaystyle\\Bigl\(\\min\\bigl\(\\varrho\_\{i,k,m\}^\{\\mathrm\{flow\}\}\(\\phi\)\\,\\hat\{A\}\_\{i,k\}^\{\\mathrm\{rend\}\},\\operatorname\{clip\}\(\\varrho\_\{i,k,m\}^\{\\mathrm\{flow\}\}\(\\phi\),1\-\\epsilon\_\{\\mathrm\{r\}\},1\+\\epsilon\_\{\\mathrm\{r\}\}\)\\,\\hat\{A\}\_\{i,k\}^\{\\mathrm\{rend\}\}\\bigr\)−βrDKL\(pϕ∥pref\)\)\]\.\\displaystyle\-\\beta\_\{\\mathrm\{r\}\}\\,D\_\{\\mathrm\{KL\}\}\(p\_\{\\phi\}\\,\\\|\\,p\_\{\\mathrm\{ref\}\}\)\\Bigr\)\\Biggr\]\.
### 1\.2\.Variance\-Based Cross\-Module Credit Assignment
The main paper introduces the plan\-dominant and render\-dominant variability terms\. Here, we record only the estimator used in training\. For a fixed input𝐱=\(Isrc,c\)\\mathbf\{x\}=\(I\_\{\\mathrm\{src\}\},c\), let𝐞∼qθ\(⋅∣𝐱\)\\mathbf\{e\}\\sim q\_\{\\theta\}\(\\cdot\\mid\\mathbf\{x\}\)and𝐲∼pϕ\(⋅∣Isrc,𝐞\)\\mathbf\{y\}\\sim p\_\{\\phi\}\(\\cdot\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\)\. We decompose the shared\-reward variance as
\(S11\)Uplan\(𝐱\)\\displaystyle U\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)=Var𝐞\(𝔼𝐲\|Isrc,𝐞\[Rshare\]\),\\displaystyle=\\operatorname\{Var\}\_\{\\mathbf\{e\}\}\\Bigl\(\\mathbb\{E\}\_\{\\mathbf\{y\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\}\[R\_\{\\mathrm\{share\}\}\]\\Bigr\),\(S12\)Urend\(𝐱\)\\displaystyle U\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\)=𝔼𝐞\[Var𝐲\|Isrc,𝐞\(Rshare\)\]\.\\displaystyle=\\mathbb\{E\}\_\{\\mathbf\{e\}\}\\Bigl\[\\operatorname\{Var\}\_\{\\mathbf\{y\}\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\}\(R\_\{\\mathrm\{share\}\}\)\\Bigr\]\.By the law of total variance,
\(S13\)Var\(Rshare∣𝐱\)=Uplan\(𝐱\)\+Urend\(𝐱\)\.\\operatorname\{Var\}\(R\_\{\\mathrm\{share\}\}\\mid\\mathbf\{x\}\)=U\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)\+U\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\)\.For each training sample, the sameM×KM\\times Krollout bank already used for reward computation is reused to estimate these two terms\. Letri,ksharer\_\{i,k\}^\{\\mathrm\{share\}\}be the shared reward of thekk\-th rendering under theii\-th sampled plan,r¯i=1K∑k=1Kri,kshare\\bar\{r\}\_\{i\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}r\_\{i,k\}^\{\\mathrm\{share\}\}the per\-plan mean, andr¯=1M∑i=1Mr¯i\\bar\{r\}=\\frac\{1\}\{M\}\\sum\_\{i=1\}^\{M\}\\bar\{r\}\_\{i\}the grand mean\. We compute
\(S14\)swithin2\(𝐱\)\\displaystyle s\_\{\\mathrm\{within\}\}^\{2\}\(\\mathbf\{x\}\)=1M∑i=1M1K−1∑k=1K\(ri,kshare−r¯i\)2,\\displaystyle=\\frac\{1\}\{M\}\\sum\_\{i=1\}^\{M\}\\frac\{1\}\{K\-1\}\\sum\_\{k=1\}^\{K\}\\bigl\(r\_\{i,k\}^\{\\mathrm\{share\}\}\-\\bar\{r\}\_\{i\}\\bigr\)^\{2\},\(S15\)sbetween2\(𝐱\)\\displaystyle s\_\{\\mathrm\{between\}\}^\{2\}\(\\mathbf\{x\}\)=1M−1∑i=1M\(r¯i−r¯\)2\.\\displaystyle=\\frac\{1\}\{M\-1\}\\sum\_\{i=1\}^\{M\}\\bigl\(\\bar\{r\}\_\{i\}\-\\bar\{r\}\\bigr\)^\{2\}\.The within\-plan Monte Carlo estimate is
\(S16\)U^rend\(𝐱\)=swithin2\(𝐱\),\\widehat\{U\}\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\)=s\_\{\\mathrm\{within\}\}^\{2\}\(\\mathbf\{x\}\),and the across\-plan estimate subtracts the renderer\-noise term induced by averaging onlyKKrenderings per plan:
\(S17\)U^plan\(𝐱\)=max\(0,sbetween2\(𝐱\)−1Kswithin2\(𝐱\)\)\.\\widehat\{U\}\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)=\\max\\left\(0,\\;s\_\{\\mathrm\{between\}\}^\{2\}\(\\mathbf\{x\}\)\-\\tfrac\{1\}\{K\}s\_\{\\mathrm\{within\}\}^\{2\}\(\\mathbf\{x\}\)\\right\)\.Themax\(0,⋅\)\\max\(0,\\cdot\)truncation avoids negative across\-plan estimates caused by finite\-sample noise\. No additional renderer calls are introduced: the same rollout bank feeds reward estimation, curriculum weighting, routing, and policy optimization\.
### 1\.3\.Adaptive Curriculum and Soft Module Routing
This subsection records the rollout statistics used to instantiate the main\-paper curriculum and routing definitions as per\-sample training weights\.
#### Curriculum scheduling\.
The rollout\-based hardness estimate is
\(S18\)H^\(𝐱\)=−1MK∑i=1M∑k=1Kri,kshare,\\widehat\{H\}\(\\mathbf\{x\}\)=\-\\frac\{1\}\{MK\}\\sum\_\{i=1\}^\{M\}\\sum\_\{k=1\}^\{K\}r\_\{i,k\}^\{\\mathrm\{share\}\},where larger values indicate harder samples\. In implementation,H^\(𝐱\)\\widehat\{H\}\(\\mathbf\{x\}\)is normalized toH~\(𝐱\)\\widetilde\{H\}\(\\mathbf\{x\}\)using the running hardness statistics maintained over recent training batches, and the curriculum boundaryκ\(n\)\\kappa\(n\)is taken as an empirical quantile of that same buffer at stepnn\. The curriculum weight is
\(S19\)wcur\(𝐱,n\)=sigmoid\(κ\(n\)−H~\(𝐱\)τc\)\.w\_\{\\mathrm\{cur\}\}\(\\mathbf\{x\},n\)=\\operatorname\{sigmoid\}\\left\(\\frac\{\\kappa\(n\)\-\\widetilde\{H\}\(\\mathbf\{x\}\)\}\{\\tau\_\{\\mathrm\{c\}\}\}\\right\)\.Hereτc\\tau\_\{\\mathrm\{c\}\}controls how sharply the weight changes around the current boundary\. This makes the curriculum update depend only on rollout hardness, not on which module is currently more variable\.
#### Soft module routing\.
We use the relative magnitude of the variance signals to define
\(S20\)α\(𝐱\)=U^plan\(𝐱\)\+εUU^plan\(𝐱\)\+U^rend\(𝐱\)\+2εU,ω\(𝐱\)=1−α\(𝐱\),\\alpha\(\\mathbf\{x\}\)=\\frac\{\\widehat\{U\}\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)\+\\varepsilon\_\{U\}\}\{\\widehat\{U\}\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\)\+\\widehat\{U\}\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\)\+2\\varepsilon\_\{U\}\},\\qquad\\omega\(\\mathbf\{x\}\)=1\-\\alpha\(\\mathbf\{x\}\),whereεU\>0\\varepsilon\_\{U\}\>0is the routing smoothing constant\. Routing is applied only as a residual multiplier on top of the shared curriculum factor, so every admitted sample still updates both modules\. The variance decomposition only decides where the extra module\-specific emphasis should go; it is not used as a hard assignment rule\.
### 1\.4\.Overall Training Procedure
Algorithm[1](https://arxiv.org/html/2608.20161#alg1)summarizes one training iteration ofDARS\. A single sharedM×KM\\times Krollout bank is reused throughout the iteration: it first produces module\-specific rewards, then yields planner\-side and renderer\-side advantages, and finally supplies the variance, routing, and curriculum statistics used to weight the two objectives\. This reuse is important operationally because it keeps checklist loading, reward estimation, and module\-specific optimization aligned to the same sampled evidence without introducing extra renderer calls beyond the rollout budget already used for policy optimization\.
Algorithm 1DARSTraining Algorithm1:Planner policy
qθq\_\{\\theta\}, renderer policy
pϕp\_\{\\phi\}, reference policies
qref,prefq\_\{\\mathrm\{ref\}\},p\_\{\\mathrm\{ref\}\}, objective hyperparameters
ϵp,ϵr,εA,εU,βp,βr,ρ\\epsilon\_\{\\mathrm\{p\}\},\\epsilon\_\{\\mathrm\{r\}\},\\varepsilon\_\{A\},\\varepsilon\_\{U\},\\beta\_\{\\mathrm\{p\}\},\\beta\_\{\\mathrm\{r\}\},\\rho, dataset
𝒟\\mathcal\{D\}, rollout counts
M,KM,K, training step
nn
2:Updated planner parameters
θ\\thetaand renderer parameters
ϕ\\phi
3:Refresh old policies:
qθold←qθq\_\{\\theta\_\{\\mathrm\{old\}\}\}\\leftarrow q\_\{\\theta\},
pϕold←pϕp\_\{\\phi\_\{\\mathrm\{old\}\}\}\\leftarrow p\_\{\\phi\}
4:Sample minibatch
ℬ∼𝒟\\mathcal\{B\}\\sim\\mathcal\{D\}
5:foreach input
𝐱∈ℬ\\mathbf\{x\}\\in\\mathcal\{B\}do
6:Load pre\-generated shared checklist
𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)
7:for
i=1i=1to
MMdo
8:Sample plan
𝐞i∼qθold\(⋅∣𝐱\)\\mathbf\{e\}\_\{i\}\\sim q\_\{\\theta\_\{\\mathrm\{old\}\}\}\(\\cdot\\mid\\mathbf\{x\}\)
9:for
k=1k=1to
KKdo
10:Sample rendering
𝐲i,k∼pϕold\(⋅∣Isrc,𝐞i\)\\mathbf\{y\}\_\{i,k\}\\sim p\_\{\\phi\_\{\\mathrm\{old\}\}\}\(\\cdot\\mid I\_\{\\mathrm\{src\}\},\\mathbf\{e\}\_\{i\}\)
11:Evaluate
Rplan\(𝐱,𝐞i,𝐲i,k,𝐂\)R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\),
Rrend\(𝐱,𝐞i,𝐲i,k,𝐂\)R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\), and
Rshare\(𝐱,𝐞i,𝐲i,k\)R\_\{\\mathrm\{share\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\}\)
12:endfor
13:endfor
14:Compute planner\-side rewards
\{riplan\}i=1M\\\{r\_\{i\}^\{\\mathrm\{plan\}\}\\\}\_\{i=1\}^\{M\}and group\-relative advantages
\{A^iplan\}i=1M\\\{\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\}\\\}\_\{i=1\}^\{M\}
15:Compute rendering\-averaged slot scores
s¯i\(j\)=1K∑k=1Ksi,k\(j\)\\bar\{s\}\_\{i\}^\{\(j\)\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}s\_\{i,k\}^\{\(j\)\}and prefix gates
σ¯i\(j\)=𝕀\[s¯i\(j\)≥δj\]\\bar\{\\sigma\}\_\{i\}^\{\(j\)\}=\\mathbb\{I\}\[\\bar\{s\}\_\{i\}^\{\(j\)\}\\geq\\delta\_\{j\}\]for all sampled plans and slots
16:Compute sign\-aware slot\-weighted token advantages
A^i,jplan\\hat\{A\}\_\{i,j\}^\{\\mathrm\{plan\}\}from
A^iplan\\hat\{A\}\_\{i\}^\{\\mathrm\{plan\}\},
s¯i\(j\)\\bar\{s\}\_\{i\}^\{\(j\)\}, and
σ¯i\(j\)\\bar\{\\sigma\}\_\{i\}^\{\(j\)\}
17:for
i=1i=1to
MMdo
18:Compute renderer\-side rewards
\{ri,krend\}k=1K\\\{r\_\{i,k\}^\{\\mathrm\{rend\}\}\\\}\_\{k=1\}^\{K\}and group\-relative advantages
\{A^i,krend\}k=1K\\\{\\hat\{A\}\_\{i,k\}^\{\\mathrm\{rend\}\}\\\}\_\{k=1\}^\{K\}over the
KKrenderings under the fixed plan
𝐞i\\mathbf\{e\}\_\{i\}
19:endfor
20:Estimate
U^plan\(𝐱\)\\widehat\{U\}\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\}\),
U^rend\(𝐱\)\\widehat\{U\}\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\}\), and raw hardness
H^\(𝐱\)\\widehat\{H\}\(\\mathbf\{x\}\)from the same
M×KM\\times Krollout bank
21:Update running hardness statistics, normalize
H^\(𝐱\)\\widehat\{H\}\(\\mathbf\{x\}\)to
H~\(𝐱\)\\widetilde\{H\}\(\\mathbf\{x\}\), and obtain the curriculum boundary
κ\(n\)\\kappa\(n\)from the running buffer
22:Compute routing weights
α\(𝐱\)\\alpha\(\\mathbf\{x\}\),
ω\(𝐱\)\\omega\(\\mathbf\{x\}\)and curriculum weight
wcur\(𝐱,n\)=sigmoid\(\(κ\(n\)−H~\(𝐱\)\)/τc\)w\_\{\\mathrm\{cur\}\}\(\\mathbf\{x\},n\)=\\operatorname\{sigmoid\}\(\(\\kappa\(n\)\-\\widetilde\{H\}\(\\mathbf\{x\}\)\)/\\tau\_\{\\mathrm\{c\}\}\)
23:Accumulate the sample contributions to
𝒥plan\(θ\)\\mathcal\{J\}\_\{\\mathrm\{plan\}\}\(\\theta\)and
𝒥rend\(ϕ\)\\mathcal\{J\}\_\{\\mathrm\{rend\}\}\(\\phi\)without resampling
24:endfor
25:Update
θ\\thetaby text\-GRPO using
𝒥plan\(θ\)\\mathcal\{J\}\_\{\\mathrm\{plan\}\}\(\\theta\)
26:Update
ϕ\\phiby flow\-GRPO using
𝒥rend\(ϕ\)\\mathcal\{J\}\_\{\\mathrm\{rend\}\}\(\\phi\)
## 2\.Structured Planning and Reward Design
### 2\.1\.Structured Planner Output Format
The main paper already motivates the four\-slot planner decomposition and the associated prefix\-gated dependency structure\. Here we record the operational slot semantics used throughout the supplementary examples and prompt templates:*Modify*specifies the requested visible change,*Preserve*specifies the important content that must remain unchanged,*Overall*specifies scene\-level coherence requirements, and*Tips*provides localized renderer\-facing execution details\. The online planner serializes these free\-form fields in the fixed order
<Modify\>\.\.\.</Modify\><Preserve\>\.\.\.</Preserve\> <Overall\>\.\.\.</Overall\><Tips\>\.\.\.</Tips\>\.
The matching tag boundaries determine the token\-to\-slot mappingslot\(t\)\\operatorname\{slot\}\(t\), with each tag pair assigned to its enclosed slot\. This is the same slot schema used by the online planner output, the offline checklist cache, the reward prompts, and the qualitative plan table\.
### 2\.2\.Shared Checklist Construction and Slot Alignment
The reward pipeline uses a single slot\-aligned checklist shared by planner reward, renderer reward, hardness estimation, and routing\. The implementation has three distinct stages\. First, during rollout, the current planner rewrites the raw instruction into a four\-slot plan𝐞\\mathbf\{e\}; Fig\.[S7](https://arxiv.org/html/2608.20161#acmlabel11)shows this planner\-side prompt\. Second, before RL starts, Gemini 3 Pro preprocesses the training set once and directly generates a cached checklist𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)from the source image and raw user instruction; Fig\.[S8](https://arxiv.org/html/2608.20161#acmlabel12)shows this offline checklist\-generation prompt\. Third, during RL training, Qwen3\-VL\-32B performs online Yes/No scoring by pairing the current rollout plan, the cached checklist, and the realized edited image\. Gemini 3 Pro is not called at rollout time\.
Operationally, Gemini 3 Pro directly produces the shared checklist𝐂\(𝐱\)=\(Cmod,Cpre,Covr,Ctip\)\\mathbf\{C\}\(\\mathbf\{x\}\)=\\left\(C^\{\\mathrm\{mod\}\},C^\{\\mathrm\{pre\}\},C^\{\\mathrm\{ovr\}\},C^\{\\mathrm\{tip\}\}\\right\)from the source image and raw instruction, with a question list for each slot role\. This preprocessing is run once before RL training, so the same cached𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)is reused across allM×KM\\times Krollouts of a sample\. At rollout time, the current planner separately produces its own four\-slot plan in the same slot schema\. The checklist, therefore, defines the shared evaluation target, while the rollout\-time plan provides the instance\-specific slot text being judged\.
Each checklist field is not copied from the planner output\. Instead, Gemini 3 Pro maps the source image and raw instruction directly into33–55binary verification questions per slot\. The conversion follows four implementation constraints: slot exclusivity, so each question belongs to exactly one slot; cross\-slot complementarity, so the same requirement is not repeated across slots; no cross\-slot leakage, so one slot does not silently test another slot’s responsibility; and post\-render verifiability, so every question can later be answered from the source image, the relevant slot text, and the realized edited image\. In practice,CmodC^\{\\mathrm\{mod\}\}targets the requested visible change,CpreC^\{\\mathrm\{pre\}\}targets unchanged content,CovrC^\{\\mathrm\{ovr\}\}targets global coherence and realism, andCtipC^\{\\mathrm\{tip\}\}targets localized implementation details\.
This slot alignment allows the same checklist to support both module\-specific rewards without changing the semantic target\. During RL training, Gemini 3 Pro is no longer used\. Qwen3\-VL\-32B performs all online checklist\-based scoring\. On the planner side, it judges whether each rollout\-time slot text was a useful plan for the observed edit under the matching checklist field\. On the renderer side, it judges whether the final rendered image actually satisfies that same checklist field\. The shared checklist, therefore, ties planner\-side diagnosis and renderer\-side execution scoring to the same pre\-generated per\-slot questions\.
The offline checklist generator also follows conservative default rules when the instruction under\-specifies the edit\. If the instruction is local, preservation questions default to protecting identity, pose, background, viewpoint, and other non\-target content unless the instruction explicitly asks to modify them\. If the instruction requires a background change, that requested change is moved into the Modify or Overall field and is not redundantly enforced as a preservation constraint\. Text\-editing requests add exact rendered\-text correctness to the relevant slot, while removal or inpainting requests add plausibility and local consistency checks so that filled regions remain compatible with surrounding texture, lighting, and geometry\.
The concrete prompt templates for these three stages are collected later in the template bank: planner rollout rewriting in Fig\.[S7](https://arxiv.org/html/2608.20161#acmlabel11), offline checklist generation in Fig\.[S8](https://arxiv.org/html/2608.20161#acmlabel12), and online scoring prompts in Figs\.[S9](https://arxiv.org/html/2608.20161#acmlabel13)–[S16](https://arxiv.org/html/2608.20161#acmlabel20)\.
### 2\.3\.Reward Instantiation in Practice
#### Question\-level aggregation\.
For input𝐱=\(Isrc,c\)\\mathbf\{x\}=\(I\_\{\\mathrm\{src\}\},c\), plan𝐞i\\mathbf\{e\}\_\{i\}, rendering𝐲i,k\\mathbf\{y\}\_\{i,k\}, slotjj, and questionq∈C\(j\)q\\in C^\{\(j\)\}, letai,k,qplan∈\{0,1\}a\_\{i,k,q\}^\{\\mathrm\{plan\}\}\\in\\\{0,1\\\}denote the planner\-side judgment and defineai,k,qrend=𝕀\[Judgerend\(Isrc,𝐲i,k,c,ei\(j\),q\)=Yes\]a\_\{i,k,q\}^\{\\mathrm\{rend\}\}=\\mathbb\{I\}\[\\operatorname\{Judge\}\_\{\\mathrm\{rend\}\}\(I\_\{\\mathrm\{src\}\},\\mathbf\{y\}\_\{i,k\},c,e\_\{i\}^\{\(j\)\},q\)=\\mathrm\{Yes\}\]\. We encode*Yes*as11and*No*as00\. All questions within a slot are weighted equally, giving the per\-render slot scores
\(S21\)si,k\(j\)=1\|C\(j\)\|∑q∈C\(j\)ai,k,qplan,ui,k\(j\)=1\|C\(j\)\|∑q∈C\(j\)ai,k,qrend\.s\_\{i,k\}^\{\(j\)\}=\\frac\{1\}\{\|C^\{\(j\)\}\|\}\\sum\_\{q\\in C^\{\(j\)\}\}a\_\{i,k,q\}^\{\\mathrm\{plan\}\},\\qquad u\_\{i,k\}^\{\(j\)\}=\\frac\{1\}\{\|C^\{\(j\)\}\|\}\\sum\_\{q\\in C^\{\(j\)\}\}a\_\{i,k,q\}^\{\\mathrm\{rend\}\}\.Thus,si,k\(j\)s\_\{i,k\}^\{\(j\)\}andui,k\(j\)u\_\{i,k\}^\{\(j\)\}are normalized Yes fractions in\[0,1\]\[0,1\], rather than additional continuous outputs from the judge\.
#### Planner\-side diagnostic\.
At scoring time, the shared checklist has already been generated offline by Gemini 3 Pro and loaded from cache, while the current planner policy has produced the rollout\-time four\-slot plan𝐞i\\mathbf\{e\}\_\{i\}\. Qwen3\-VL\-32B evaluates every question in each slot through single\-question Yes/No judgments conditioned on the slot text, the original input, the realized edited image𝐲i,k\\mathbf\{y\}\_\{i,k\}, and the aligned checklist fieldC\(j\)C^\{\(j\)\}\. The resultingsi,k\(j\)s\_\{i,k\}^\{\(j\)\}is a post\-render diagnostic of whether that slot functioned as a useful plan for the realized edit\. The corresponding prompt templates are shown in Figs\.[S9](https://arxiv.org/html/2608.20161#acmlabel13)–[S12](https://arxiv.org/html/2608.20161#acmlabel16)\. Define the per\-render gateσi,k\(j\)=𝕀\[si,k\(j\)≥δj\]\\sigma\_\{i,k\}^\{\(j\)\}=\\mathbb\{I\}\[s\_\{i,k\}^\{\(j\)\}\\geq\\delta\_\{j\}\]\. The per\-render planner reward is
\(S22\)Rplan\(𝐱,𝐞i,𝐲i,k,𝐂\)=∑j=14λj⋅si,k\(j\)⋅∏l=1j−1σi,k\(l\)\.R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\)=\\sum\_\{j=1\}^\{4\}\\lambda\_\{j\}\\cdot s\_\{i,k\}^\{\(j\)\}\\cdot\\prod\_\{l=1\}^\{j\-1\}\\sigma\_\{i,k\}^\{\(l\)\}\.We use\(λmod,λpre,λovr,λtip\)=\(0\.4,0\.2,0\.2,0\.2\)\(\\lambda\_\{\\mathrm\{mod\}\},\\lambda\_\{\\mathrm\{pre\}\},\\lambda\_\{\\mathrm\{ovr\}\},\\lambda\_\{\\mathrm\{tip\}\}\)=\(0\.4,0\.2,0\.2,0\.2\)andδj=0\.66\\delta\_\{j\}=0\.66for every slot\. After evaluating allKKrenderings under plan𝐞i\\mathbf\{e\}\_\{i\}, we compute
\(S23\)riplan=1K∑k=1KRplan\(𝐱,𝐞i,𝐲i,k,𝐂\),s¯i\(j\)=1K∑k=1Ksi,k\(j\)\.r\_\{i\}^\{\\mathrm\{plan\}\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\),\\qquad\\bar\{s\}\_\{i\}^\{\(j\)\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}s\_\{i,k\}^\{\(j\)\}\.The first quantity yields the plan\-level group\-relative advantage, while the second and its analogous averaged\-score gateσ¯i\(j\)=𝕀\[s¯i\(j\)≥δj\]\\bar\{\\sigma\}\_\{i\}^\{\(j\)\}=\\mathbb\{I\}\[\\bar\{s\}\_\{i\}^\{\(j\)\}\\geq\\delta\_\{j\}\]are used for the sign\-aware token\-level advantage in Section[1\.1](https://arxiv.org/html/2608.20161#S1.SS1)\.
#### Renderer\-side execution scoring\.
The renderer reward changes the target of judgment while retaining the same checklist fields\. For eachjjandq∈C\(j\)q\\in C^\{\(j\)\}, Qwen3\-VL\-32B is conditioned on\(Isrc,𝐲i,k,c,ei\(j\),q\)\(I\_\{\\mathrm\{src\}\},\\mathbf\{y\}\_\{i,k\},c,e\_\{i\}^\{\(j\)\},q\)\. The instruction and slot text specify the intended requirement; the judge scores whether the rendered image visibly satisfies it, not the quality of the slot text\. The resultingui,k\(j\)u\_\{i,k\}^\{\(j\)\}is the fraction of satisfied requirements in that slot\. The corresponding prompt templates are shown in Figs\.[S13](https://arxiv.org/html/2608.20161#acmlabel17)–[S16](https://arxiv.org/html/2608.20161#acmlabel20)\. The per\-render renderer reward is
\(S24\)ri,krend=Rrend\(𝐱,𝐞i,𝐲i,k,𝐂\)=∑j=14γjui,k\(j\)\.r\_\{i,k\}^\{\\mathrm\{rend\}\}=R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\)=\\sum\_\{j=1\}^\{4\}\\gamma\_\{j\}u\_\{i,k\}^\{\(j\)\}\.Here,γj\\gamma\_\{j\}controls the contribution of each slot to the final execution score\. TheKKrenderer rewards under each fixed plan remain separate when computing the renderer\-side group\-relative advantage; they are not averaged before normalization\.
#### Shared reward reuse\.
The shared reward used for hardness estimation and variance decomposition is
\(S25\)Rshare\(𝐱,𝐞i,𝐲i,k\)=ηplanRplan\(𝐱,𝐞i,𝐲i,k,𝐂\)\+ηrendRrend\(𝐱,𝐞i,𝐲i,k,𝐂\)\.R\_\{\\mathrm\{share\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\}\)=\\eta\_\{\\mathrm\{plan\}\}R\_\{\\mathrm\{plan\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\)\+\\eta\_\{\\mathrm\{rend\}\}R\_\{\\mathrm\{rend\}\}\(\\mathbf\{x\},\\mathbf\{e\}\_\{i\},\\mathbf\{y\}\_\{i,k\};\\mathbf\{C\}\)\.Its role is restricted to hardness estimation and variance decomposition; planner and renderer policy gradients still use their own module\-specific rewards\.
Panel A\. Input image𝐱\\mathbf\{x\}and raw instruction Raw instructioncc:replace the final “?” with the correct next number, while keeping the existing numbers, hexagons, and diagonal layout unchanged\.Ground\-truth target:the sequence follows prime numbers, so the correct completion is “19”\.
Panel B\. Checklist𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)and plan𝐞\\mathbf\{e\} ModifyCmodC^\{\\mathrm\{mod\}\} 1\. Is the final “?” replaced with a numeral?2\. Is the new numeral exactly “19”?3\. Does the edit correctly continue the prime pattern after 17?4\. Is the target of the change the last hexagon?PreserveCpreC^\{\\mathrm\{pre\}\} 1\. Are 5 and 7 unchanged?2\. Is 11 unchanged?3\. Is 13 unchanged?4\. Are all non\-target hexagons otherwise untouched?5\. Does the background remain white?OverallCovrC^\{\\mathrm\{ovr\}\} 1\. Is the six\-hexagon diagonal layout preserved?2\. Are size, spacing, and viewpoint consistent?3\. Does the final sequence remain globally coherent?4\. Is the result clean and artifact\-free?TipsCtipC^\{\\mathrm\{tip\}\} 1\. Is only the last hexagon edited?2\. Does the new digit match the original font style?3\. Does the stroke/outline style remain consistent?4\. Is the new digit centered with similar spacing?Structured plan𝐞\\mathbf\{e\}:𝐞=\(emod,epre,eovr,etip\)\\mathbf\{e\}=\(e^\{\\mathrm\{mod\}\},e^\{\\mathrm\{pre\}\},e^\{\\mathrm\{ovr\}\},e^\{\\mathrm\{tip\}\}\), where the four slots are Modify, Preserve, Overall, and Tips\.Scoring rule:slot scores\(j\)=\#Yes/\|C\(j\)\|s^\{\(j\)\}=\\\#\\mathrm\{Yes\}/\|C^\{\(j\)\}\|forj∈\{mod,pre,ovr,tip\}j\\in\\\{\\mathrm\{mod\},\\mathrm\{pre\},\\mathrm\{ovr\},\\mathrm\{tip\}\\\}\.Gate rule:slot gateσj=𝕀\[s\(j\)≥δj\]\\sigma\_\{j\}=\\mathbb\{I\}\[s^\{\(j\)\}\\geq\\delta\_\{j\}\]withδmod=δpre=δovr=δtip=0\.66\\delta\_\{\\mathrm\{mod\}\}=\\delta\_\{\\mathrm\{pre\}\}=\\delta\_\{\\mathrm\{ovr\}\}=\\delta\_\{\\mathrm\{tip\}\}=0\.66\.
Panel C\. Failure A: wrong Modify prompt Modifyemode^\{\\mathrm\{mod\}\}:Put 21 in the last hexagon to continue the sequence\. Preserveepree^\{\\mathrm\{pre\}\}:Keep the first five numbered hexagons and the white background unchanged\. Overalleovre^\{\\mathrm\{ovr\}\}:Preserve the diagonal layout and a smooth increasing pattern\. Tipsetipe^\{\\mathrm\{tip\}\}:Edit only the last hexagon and match the numeral style\.Checklist hits:ModifyCmod:2/4C^\{\\mathrm\{mod\}\}:2/4; PreserveCpre:5/5C^\{\\mathrm\{pre\}\}:5/5\. OverallCovr:3/4C^\{\\mathrm\{ovr\}\}:3/4; TipsCtip:4/4C^\{\\mathrm\{tip\}\}:4/4\.Scores:Modifysmod=0\.50s^\{\\mathrm\{mod\}\}=0\.50; Preservespre=1\.00s^\{\\mathrm\{pre\}\}=1\.00\. Overallsovr=0\.75s^\{\\mathrm\{ovr\}\}=0\.75; Tipsstip=1\.00s^\{\\mathrm\{tip\}\}=1\.00\.Gate:Modify gateσmod=0\\sigma\_\{\\mathrm\{mod\}\}=0⇒\\RightarrowPreserve, Overall, and Tips blocked\.Reward:Rplan\(A\)=0\.20R\_\{\\mathrm\{plan\}\}^\{\(\\mathrm\{A\}\)\}=0\.20\.
Panel D\. Failure B: weak Preserve prompt Modifyemode^\{\\mathrm\{mod\}\}:Put 19 in the last hexagon as the next prime after 17\. Preserveepree^\{\\mathrm\{pre\}\}:Keep the sequence readable, but nearby numerals or canvas tones may be adjusted if needed\. Overalleovre^\{\\mathrm\{ovr\}\}:Preserve the diagonal layout and a plausible completed sequence\. Tipsetipe^\{\\mathrm\{tip\}\}:Harmonize the final region with neighboring hexagons so the ending looks locally consistent\.Checklist hits:ModifyCmod:4/4C^\{\\mathrm\{mod\}\}:4/4; PreserveCpre:2/5C^\{\\mathrm\{pre\}\}:2/5\. OverallCovr:3/4C^\{\\mathrm\{ovr\}\}:3/4; TipsCtip:3/4C^\{\\mathrm\{tip\}\}:3/4\.Scores:Modifysmod=1\.00s^\{\\mathrm\{mod\}\}=1\.00; Preservespre=0\.40s^\{\\mathrm\{pre\}\}=0\.40\. Overallsovr=0\.75s^\{\\mathrm\{ovr\}\}=0\.75; Tipsstip=0\.75s^\{\\mathrm\{tip\}\}=0\.75\.Gate:Modify gateσmod=1\\sigma\_\{\\mathrm\{mod\}\}=1,Preserve gateσpre=0\\sigma\_\{\\mathrm\{pre\}\}=0⇒\\RightarrowOverall and Tips blocked\.Reward:Rplan\(B\)=0\.48R\_\{\\mathrm\{plan\}\}^\{\(\\mathrm\{B\}\)\}=0\.48\.
Panel E\. Success: precise four\-slot prompt Modifyemode^\{\\mathrm\{mod\}\}:Put 19 in the last hexagon as the next prime after 17\. Preserveepree^\{\\mathrm\{pre\}\}:Keep 5, 7, 11, 13, 17, and the white background unchanged\. Overalleovre^\{\\mathrm\{ovr\}\}:Preserve the prime progression, clean spacing, and original diagonal layout\. Tipsetipe^\{\\mathrm\{tip\}\}:Edit only the last hexagon and match the font, stroke, and centering\.Checklist hits:ModifyCmod:4/4C^\{\\mathrm\{mod\}\}:4/4; PreserveCpre:5/5C^\{\\mathrm\{pre\}\}:5/5\. OverallCovr:4/4C^\{\\mathrm\{ovr\}\}:4/4; TipsCtip:4/4C^\{\\mathrm\{tip\}\}:4/4\.Scores:Modifysmod=1\.00s^\{\\mathrm\{mod\}\}=1\.00; Preservespre=1\.00s^\{\\mathrm\{pre\}\}=1\.00\. Overallsovr=1\.00s^\{\\mathrm\{ovr\}\}=1\.00; Tipsstip=1\.00s^\{\\mathrm\{tip\}\}=1\.00\.Gate:Modify, Preserve, and Overall gates all pass\(σmod=σpre=σovr=1\)\(\\sigma\_\{\\mathrm\{mod\}\}=\\sigma\_\{\\mathrm\{pre\}\}=\\sigma\_\{\\mathrm\{ovr\}\}=1\)\.Reward:Rplan\(success\)=1\.00R\_\{\\mathrm\{plan\}\}^\{\(\\mathrm\{success\}\)\}=1\.00\.
Figure S1\.Five\-panel schematic of checklist\-based prefix\-gated planner reward on a sequence\-completion edit\.Panels A–B define the shared input, checklist, and structured plan; Panels C–E illustrate Failure A, Failure B, and Success under the same scoring and gating rules\. Detailed interpretation is provided in Sec\.[2\.4](https://arxiv.org/html/2608.20161#S2.SS4)\.A five\-panel schematic for prefix\-gated planner reward on a sequence\-completion editing example\. The first panel shows the source sequence and raw instruction\. The second panel lists the modify, preserve, overall, and tips checklists\. The remaining three panels show simulated Failure A, Failure B, and Success prompts, their edited sequences, checklist hit counts, scores, gate outcomes, and final rewards\.
### 2\.4\.Illustrative Prefix\-Gated Reward Example
We use a simple sequence\-completion edit to illustrate how prefix gating changes planner\-side credit assignment in practice\. The source imageIsrcI\_\{\\mathrm\{src\}\}contains a diagonal chain of hexagons labeled “5, 7, 11, 13, 17, ?”, and the raw instructionccis: “Replace the final question mark with the correct next number, while keeping the existing numbers, hexagons, and diagonal layout unchanged\.” Figure[S1](https://arxiv.org/html/2608.20161#acmlabel5)instantiates the same notation used in the main paper on this concrete case: Panels A–B define the input𝐱=\(Isrc,c\)\\mathbf\{x\}=\(I\_\{\\mathrm\{src\}\},c\), the structured planner output𝐞=\(emod,epre,eovr,etip\)\\mathbf\{e\}=\(e^\{\\mathrm\{mod\}\},e^\{\\mathrm\{pre\}\},e^\{\\mathrm\{ovr\}\},e^\{\\mathrm\{tip\}\}\), and the shared checklist𝐂\(𝐱\)=\(Cmod,Cpre,Covr,Ctip\)\\mathbf\{C\}\(\\mathbf\{x\}\)=\\left\(C^\{\\mathrm\{mod\}\},C^\{\\mathrm\{pre\}\},C^\{\\mathrm\{ovr\}\},C^\{\\mathrm\{tip\}\}\\right\); Panels C–E then show three realized planner outcomes, namely Failure A, Failure B, and Success\.
Consistent with the training definition in Eq\.[S21](https://arxiv.org/html/2608.20161#S2.E21), each slot score is computed from its own checklist ass\(j\)=\#Yes/\|C\(j\)\|,s^\{\(j\)\}=\\\#\\mathrm\{Yes\}/\|C^\{\(j\)\}\|,with normalized slot weights\(λmod,λpre,λovr,λtip\)=\(0\.4,0\.2,0\.2,0\.2\)\(\\lambda\_\{\\mathrm\{mod\}\},\\lambda\_\{\\mathrm\{pre\}\},\\lambda\_\{\\mathrm\{ovr\}\},\\lambda\_\{\\mathrm\{tip\}\}\)=\(0\.4,0\.2,0\.2,0\.2\)and a uniform activation thresholdδmod=δpre=δovr=δtip=0\.66\.\\delta\_\{\\mathrm\{mod\}\}=\\delta\_\{\\mathrm\{pre\}\}=\\delta\_\{\\mathrm\{ovr\}\}=\\delta\_\{\\mathrm\{tip\}\}=0\.66\.The planner\-side reward for a realized outcome is then
\(S26\)Rplan=λmodsmod\+λprespreσmod\+λovrsovrσmodσpre\+λtipstipσmodσpreσovr,R\_\{\\mathrm\{plan\}\}=\\lambda\_\{\\mathrm\{mod\}\}s^\{\\mathrm\{mod\}\}\+\\lambda\_\{\\mathrm\{pre\}\}s^\{\\mathrm\{pre\}\}\\sigma\_\{\\mathrm\{mod\}\}\+\\lambda\_\{\\mathrm\{ovr\}\}s^\{\\mathrm\{ovr\}\}\\sigma\_\{\\mathrm\{mod\}\}\\sigma\_\{\\mathrm\{pre\}\}\+\\lambda\_\{\\mathrm\{tip\}\}s^\{\\mathrm\{tip\}\}\\sigma\_\{\\mathrm\{mod\}\}\\sigma\_\{\\mathrm\{pre\}\}\\sigma\_\{\\mathrm\{ovr\}\},
whereσj=𝕀\[s\(j\)≥δj\]\\sigma\_\{j\}=\\mathbb\{I\}\[s^\{\(j\)\}\\geq\\delta\_\{j\}\]\. The question\-level aggregation, slot weights, activation threshold, and prefix\-gating rule are identical to those used in training\.
Failure A in Panel C shows the clearest advantage of prefix gating\. The enhanced plan is locally neat in Preserve, Overall, and Tips, but the core Modify slot is wrong becauseemode^\{\\mathrm\{mod\}\}proposes 21 instead of 19\. The corresponding Modify score is thereforesmod=2/4=0\.50<0\.66s^\{\\mathrm\{mod\}\}=2/4=0\.50<0\.66, soσmod=0\\sigma\_\{\\mathrm\{mod\}\}=0\. As a result, the prefix gate closes immediately after Modify, and the planner reward becomes
\(S27\)Rplan\(A\)\\displaystyle R\_\{\\mathrm\{plan\}\}^\{\(\\mathrm\{A\}\)\}=0\.4⋅0\.50\+0\.2⋅1\.00⋅0\+0\.2⋅0\.75⋅0\+0\.2⋅1\.00⋅0\\displaystyle=0\.4\\cdot 0\.50\+0\.2\\cdot 1\.00\\cdot 0\+0\.2\\cdot 0\.75\\cdot 0\+0\.2\\cdot 1\.00\\cdot 0=0\.20\.\\displaystyle=0\.20\.Even though the rendered result still satisfies all five Preserve checks and most downstream checks, those later slots receive no additional credit once the causally prior Modify requirement fails\. By contrast, an ungated weighted sum would still produce 0\.75 because the strong downstream slots would partially compensate for the incorrect core reasoning\.
Failure B in Panel D illustrates a different error pattern\. Here the Modify slot is correct, sosmod=4/4=1\.00s^\{\\mathrm\{mod\}\}=4/4=1\.00andσmod=1\\sigma\_\{\\mathrm\{mod\}\}=1\. However, the weak Preserve slotepree^\{\\mathrm\{pre\}\}allows collateral changes near the target, and the rendered result changes the original “13” into “17” while also darkening the background\. This drops the Preserve score tospre=2/5=0\.40<0\.66s^\{\\mathrm\{pre\}\}=2/5=0\.40<0\.66, soσpre=0\\sigma\_\{\\mathrm\{pre\}\}=0\. Thus, the reward still keeps the correct Modify credit, but blocks Overall and Tips from contributing:
\(S28\)Rplan\(B\)\\displaystyle R\_\{\\mathrm\{plan\}\}^\{\(\\mathrm\{B\}\)\}=0\.4⋅1\.00\+0\.2⋅0\.40\+0\.2⋅0\.75⋅0\+0\.2⋅0\.75⋅0\\displaystyle=0\.4\\cdot 1\.00\+0\.2\\cdot 0\.40\+0\.2\\cdot 0\.75\\cdot 0\+0\.2\\cdot 0\.75\\cdot 0=0\.48\.\\displaystyle=0\.48\.Again, the ungated weighted sum would be much higher \(0\.78\) because the later slots would still receive credit despite the failed preservation constraint\.
Finally, Panel E shows the successful case\. Here, all four slot texts align with the intended edit, and the realized image satisfies every checklist item across Modify, Preserve, Overall, and Tips\. Therefore, all gates remain active, and the final planner reward is maximal:
\(S29\)Rplan\(success\)\\displaystyle R\_\{\\mathrm\{plan\}\}^\{\(\\mathrm\{success\}\)\}=0\.4⋅1\.00\+0\.2⋅1\.00\+0\.2⋅1\.00\+0\.2⋅1\.00\\displaystyle=0\.4\\cdot 1\.00\+0\.2\\cdot 1\.00\+0\.2\\cdot 1\.00\+0\.2\\cdot 1\.00=1\.00\.\\displaystyle=1\.00\.Taken together, the three cases in Fig\.[S1](https://arxiv.org/html/2608.20161#acmlabel5)make the intended credit\-assignment behavior explicit\. Prefix gating does not simply average slot quality; instead, it follows the causal dependency structure of the four\-slot plan\. Modify must first specify the correct edit target, Preserve must then protect non\-target content, and only after those upstream requirements are reliable, do Overall and Tips receive effective reward\. This is precisely the behavior that the prefix\-gated reward is designed to enforce during planner optimization\.
## 3\.Experimental Setup Details
### 3\.1\.Training Setup and Hyperparameters
The main paper reports the shared training setup\. Here we list only the policy\-specific optimization settings needed to reproduceDARS; all shared quantities remain exactly as in the main text\.
Table S1\.Training recipe summary\.CategoryHyperparameterValueVLMPolicyBase modelQwen3\-VL\-4B\-InstructOptimizerAdamWLearning rate2×10−62\\times 10^\{\-6\}Plans per input \(MM\)4Total rollouts per input \(M×KM\\times K\)16Global update batch size256KL penalty \(β\\beta\)1×10−31\\times 10^\{\-3\}Max context / response length20,480 tokens / 4,096 tokensDiffusionPolicyBase modelQwen\-Image\-Edit\-2511Fine\-tuning methodLoRALoRA rank / scaling factor \(αLoRA\\alpha\_\{\\mathrm\{LoRA\}\}\)64 / 128OptimizerAdamWLearning rate2×10−62\\times 10^\{\-6\}Weight decay1×10−41\\times 10^\{\-4\}Flow\-GRPO clip range \(ϵr\\epsilon\_\{\\mathrm\{r\}\}\)1×10−41\\times 10^\{\-4\}Renderings per plan \(KK\)4SDE training timesteps\{1,2,3\}\\\{1,2,3\\\}EMA decay / update interval0\.9 / 4 stepsMax image resolution1024×10241024\\times 1024Inference steps \(train / eval\)10 / 40Guidance scale4\.0The planner uses a standard AdamW text\-policy update to rewrite the raw instruction online into a four\-slot plan, while the renderer uses LoRA\-based flow\-GRPO with DiT\-specific sampling controls\. Relative to the controlled Joint RL baseline,DARSadds shared\-rollout bookkeeping and slot\-wise scoring without additional renderer calls\.
### 3\.2\.Controlled Baseline and Evaluation Protocol
The controlled*Joint RL \+ Adaptive Curriculum*baseline matchesDARSin backbones, training data, offline checklist cache, online reward judge, rollout budget, hardware, and adaptive curriculum\. It differs only in replacing the structured four\-slot planner and dual\-level credit assignment with a free\-form planner trace\.
All benchmark results are obtained from the official evaluation code and are independent of the training\-time reward pipeline\. Gemini 3 Pro and Qwen3\-VL\-32B are used only for checklist construction and training\-time scoring, not for the final reported benchmark metrics\. Across all in\-house variants, we report the official overall benchmark scores, with PICA\-Bench following its standard*simple*/*detailed*split\.
### 3\.3\.KRIS\-Bench Breakdown
Table[S2](https://arxiv.org/html/2608.20161#S3.T2)expands the main\-paper KRIS\-Bench result into its official factual\-, conceptual\-, and procedural\-knowledge groups, so performance differences can be inspected at the subgroup level rather than only through the overall score\. We also include the newly obtained fine\-grained breakdown for Qwen\-Image\-Edit\-2511 and update the best/second\-best markings accordingly\.
Table S2\.Fine\-grained KRIS\-Bench results\.We use the official GPT\-4\.1\-based evaluation protocol\. KRIS\-Bench evaluates edited results with four dimensions: visual consistency, visual quality, instruction following, and knowledge plausibility, where the last dimension is used only for knowledge\-intensive subsets such as Social Science, Natural Science, and Logical Reasoning\. The raw judge outputs are defined on a 1–5 scale, while the benchmark reports normalized percentage scores with maximum 100\. Higher is better for every metric\. All values are reported with two decimal places\.ModelFactual KnowledgeConceptual KnowledgeProcedural KnowledgeOverall↑\\uparrowAttributePerception↑\\uparrowSpatialPerception↑\\uparrowTemporalPerception↑\\uparrowAverageScore↑\\uparrowSocialScience↑\\uparrowNaturalScience↑\\uparrowAverageScore↑\\uparrowLogicalReasoning↑\\uparrowInstructionDecomposition↑\\uparrowAverageScore↑\\uparrowOther baselinesThinkGen64\.0355\.1756\.3159\.5766\.0063\.1963\.8638\.0464\.8349\.5259\.57UniREdit61\.1066\.7558\.4562\.4266\.2063\.0463\.8053\.0854\.6153\.7461\.02PromptRL67\.8564\.8379\.1769\.0458\.6557\.3957\.6951\.3867\.2958\.2461\.24Step1X\-Edit\-v1p269\.6764\.3380\.1870\.2163\.5060\.6261\.3249\.7562\.6755\.2962\.58UniReason 1\.064\.0368\.0871\.2866\.1366\.7567\.2667\.1350\.5053\.8951\.9563\.26ThinkRL\-Edit68\.1867\.7587\.5071\.2768\.8566\.4967\.0651\.6364\.9457\.3366\.04PhysicEdit67\.5274\.4284\.9171\.9267\.2568\.1067\.8948\.0071\.2857\.9866\.78EditThinker73\.6771\.7581\.5374\.5471\.8567\.9568\.8956\.0468\.2261\.2668\.80Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-251168\.8274\.7577\.7071\.6061\.7558\.4859\.2756\.2181\.8367\.1964\.42RePlan56\.8850\.0074\.7758\.2653\.4556\.2255\.5549\.5857\.1052\.7955\.72PromptEnhancerV271\.6775\.6782\.4374\.3371\.4070\.5970\.7956\.6386\.5069\.4371\.54DARS78\.2184\.3385\.3680\.7582\.9581\.2081\.6271\.0089\.3978\.8980\.72
### 3\.4\.RISE\-Bench Breakdown
Table[S3](https://arxiv.org/html/2608.20161#S3.T3)expands the main\-paper RISE\-Bench result into the four official reasoning categories of RISEBench\-360:*Temporal*,*Causal*,*Spatial*, and*Logical*\. This breakdown shows where gains come from across different reasoning types rather than only in the aggregate\.
Table S3\.Fine\-grained RISE\-Bench results\.We evaluate on RISEBench\-360, the 360\-sample version of the benchmark, using the official GPT\-4\.1\-based judging pipeline\. The benchmark scores each sample along instruction reasoning, appearance consistency, and visual plausibility, and counts a case as solved only when all applicable dimensions receive full marks\. The table therefore reports Accuracy \(%\), i\.e\., the task success rate, for each reasoning category and for the overall set\. Higher is better for every metric\.MethodTemporal↑\\uparrowCausal↑\\uparrowSpatial↑\\uparrowLogical↑\\uparrowOverall↑\\uparrowOther baselinesThinkGen15\.2916\.677\.003\.5210\.56UniREdit15\.2920\.0014\.003\.5313\.33PromptRL3\.538\.8923\.002\.3410\.00Step1X\-Edit\-v1p214\.1213\.3013\.005\.8811\.67UniReason 1\.016\.4727\.7813\.002\.3515\.00ThinkRL\-Edit14\.1120\.0017\.005\.8814\.44PhysicEdit15\.2927\.7822\.009\.4118\.89EditThinker18\.8218\.8927\.007\.0618\.33Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-251120\.8018\.2530\.674\.6517\.50RePlan10\.5912\.2211\.004\.709\.72PromptEnhancerV220\.0030\.0018\.007\.0618\.90DARS30\.5938\.8931\.008\.2427\.50
### 3\.5\.ImgEdit\-Bench Breakdown
Table[S4](https://arxiv.org/html/2608.20161#S3.T4)expands the main\-paper ImgEdit\-Bench result into its nine official edit\-operation groups, making it easier to see where different methods are strong or weak across common editing regimes rather than only in the aggregate\. All entries follow the benchmark’s official GPT\-4\.1\-based evaluation protocol\.
Table S4\.Fine\-grained ImgEdit\-Bench results\.The header enumerates the benchmark’s nine common editing tasks:*Add*,*Remove*,*Adjust*,*Replace*,*Style*,*Background*,*Action*,*Hybrid*, and*Extract*\. ImgEdit\-Bench evaluates each result with GPT\-4\.1 on a 1–5 scale from three perspectives: instruction following, editing quality, and detail preservation\. Instruction following measures understanding of the prompt and target concept; editing quality measures how accurately the target region is manipulated; and detail preservation measures fidelity on content that should remain unchanged\. Because instruction following is foundational and cannot be fully separated from the other two aspects, the editing\-quality and detail\-preservation scores are upper\-bounded by the instruction\-following score\. The table reports the average score for each edit category, and higher is better for every metric\.MethodAdd↑\\uparrowAdjust↑\\uparrowExtract↑\\uparrowReplace↑\\uparrowRemove↑\\uparrowBackground↑\\uparrowStyle↑\\uparrowHybrid↑\\uparrowAction↑\\uparrowOverall↑\\uparrowOther baselinesThinkGen4\.203\.963\.454\.353\.354\.224\.913\.454\.163\.97UniREdit4\.093\.532\.274\.273\.813\.834\.652\.464\.373\.70PromptRL4\.074\.192\.954\.233\.674\.094\.463\.044\.133\.87Step1X\-Edit\-v1p24\.284\.402\.294\.364\.173\.944\.743\.614\.234\.00UniReason 1\.04\.183\.782\.654\.504\.394\.014\.732\.784\.364\.06ThinkRL\-Edit4\.234\.183\.514\.714\.084\.094\.893\.594\.424\.19PhysicEdit2\.673\.922\.674\.574\.353\.974\.793\.334\.564\.05EditThinker4\.334\.173\.914\.664\.184\.294\.903\.654\.684\.31Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-25114\.554\.484\.214\.624\.294\.234\.903\.374\.634\.36RePlan4\.113\.782\.073\.413\.023\.854\.483\.073\.163\.44PromptEnhancerV24\.284\.403\.434\.434\.184\.274\.773\.614\.314\.18DARS4\.544\.474\.184\.634\.324\.244\.903\.614\.614\.39
### 3\.6\.GEdit\-Bench\-EN Breakdown
Table[S5](https://arxiv.org/html/2608.20161#S3.T5)expands the main\-paper GEdit\-Bench\-EN result into its official split\-wise metrics, so the relative behavior of different methods can be inspected separately on the*Intersection subset*and the*Full set*\. All numbers come from the official evaluation code\.
Table S5\.Fine\-grained GEdit\-Bench\-EN results\.The header uses the official benchmark notation:*G\_SC*denotes GPT\-4\.1\-based semantic consistency,*G\_PQ*denotes GPT\-4\.1\-based perceptual quality, and*G\_O*denotes the official overall score\. Semantic consistency evaluates how well the edited result follows the instruction, while perceptual quality evaluates image naturalness and artifact level; both use a 0–10 scale\. “Intersection subset” refers to the subset of test images for which all compared models return valid outputs, whereas “Full set” refers to the complete GEdit\-Bench\-EN test set\. All values are reported with two decimal places\.MethodIntersection subsetFull setG\_SC↑\\uparrowG\_PQ↑\\uparrowG\_O↑\\uparrowG\_SC↑\\uparrowG\_PQ↑\\uparrowG\_O↑\\uparrowOther baselinesThinkGen7\.497\.807\.227\.437\.767\.16UniREdit7\.316\.966\.677\.106\.896\.47PromptRL7\.327\.606\.907\.157\.586\.74Step1X\-Edit\-v1p28\.327\.897\.738\.057\.857\.47UniReason 1\.07\.187\.216\.627\.067\.206\.52ThinkRL\-Edit6\.848\.216\.636\.708\.166\.48PhysicEdit8\.087\.767\.547\.937\.667\.37EditThinker8\.207\.847\.648\.127\.887\.59Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-25117\.677\.687\.247\.657\.386\.97RePlan7\.037\.666\.556\.877\.626\.43PromptEnhancerV28\.337\.977\.798\.087\.967\.59DARS8\.578\.017\.988\.498\.007\.86
### 3\.7\.PICA\-Bench Simple\-Prompt Breakdown
Table[S6](https://arxiv.org/html/2608.20161#S3.T6)reports the fine\-grained PICA\-Bench results under the benchmark’s*simple prompt*setting, which we also refer to as the*superficial prompt*setting for clarity\. We list all official physical\-consistency categories:*LP*,*LSE*,*Reflection*,*Refraction*,*Deformation*,*Causality*,*GST*, and*LST*, together with the overall score\. As with the other supplementary benchmark tables, all values come from the official evaluation pipeline and are reported with two decimal places\.
Table S6\.Fine\-grained PICA\-Bench results under the simple\-prompt setting\.This setting corresponds to the superficial\-prompt protocol in PICA\-Bench and is evaluated by GPT\-4\.1 for instruction\-based image editing models\. All reported numbers are Accuracy \(%\)\. In the header, LP, LSE, GST, and LST denote Light Propagation, Light Source Effects, Global State Transition, and Local State Transition, respectively\.MethodLP↑\\uparrowLSE↑\\uparrowReflection↑\\uparrowRefraction↑\\uparrowDeformation↑\\uparrowCausality↑\\uparrowGST↑\\uparrowLST↑\\uparrowOverall↑\\uparrowOther baselinesThinkGen64\.3966\.3464\.5165\.4650\.0651\.2668\.3866\.3460\.82UniREdit61\.9966\.1767\.5054\.3853\.1152\.9065\.6856\.8360\.40PromptRL56\.0452\.2459\.2741\.3550\.4245\.6052\.9145\.6751\.02Step1X\-Edit\-v1p263\.5258\.1266\.6162\.4453\.4148\.7652\.6051\.8956\.15UniReason 1\.062\.1563\.2062\.7351\.3552\.5548\.8460\.2154\.7657\.30ThinkRL\-Edit60\.9656\.6861\.1841\.1656\.9246\.0759\.5352\.6655\.13PhysicEdit63\.1069\.2667\.3451\.9658\.3151\.4765\.7961\.5161\.48EditThinker63\.0559\.9865\.7553\.3555\.3450\.7664\.5060\.9859\.64Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-251163\.8969\.9171\.8662\.3357\.9350\.7067\.8961\.3463\.20RePlan52\.9951\.2949\.2948\.8852\.3343\.8261\.2652\.1552\.00PromptEnhancerV266\.8666\.1970\.8659\.5553\.7153\.0662\.9063\.3861\.90DARS62\.5267\.8572\.0464\.6264\.3753\.5965\.5066\.1664\.19
### 3\.8\.PICA\-Bench Explicit\-Prompt Breakdown
Table[S7](https://arxiv.org/html/2608.20161#S3.T7)reports the fine\-grained PICA\-Bench results under the benchmark’s*detailed prompt*setting, which corresponds to the*explicit prompt*protocol used in our evaluation pipeline\. We keep the same category layout as in Table[S6](https://arxiv.org/html/2608.20161#S3.T6):*LP*,*LSE*,*Reflection*,*Refraction*,*Deformation*,*Causality*,*GST*,*LST*, and the overall score\. All values come from the official evaluation pipeline and are reported with two decimal places\.
Table S7\.Fine\-grained PICA\-Bench results under the explicit\-prompt setting\.All reported numbers are Accuracy \(%\)\. All values are reported with two decimal places\.MethodLP↑\\uparrowLSE↑\\uparrowReflection↑\\uparrowRefraction↑\\uparrowDeformation↑\\uparrowCausality↑\\uparrowGST↑\\uparrowLST↑\\uparrowOverallScore↑\\uparrowOther baselinesThinkGen66\.1768\.2964\.8262\.6359\.4358\.5774\.4861\.1265\.09UniREdit64\.3466\.8067\.5059\.7763\.7262\.1772\.8168\.4166\.55PromptRL61\.2059\.6863\.6643\.0255\.1162\.8866\.9655\.5060\.38Step1X\-Edit\-v1p258\.9261\.6066\.0249\.1256\.6859\.3061\.3663\.9160\.55UniReason 1\.059\.3264\.8560\.0349\.7756\.4760\.8369\.2361\.0961\.62ThinkRL\-Edit57\.2055\.3957\.7737\.6348\.8954\.3962\.0658\.9455\.84PhysicEdit64\.3970\.1468\.3654\.1065\.9070\.2974\.6170\.7968\.96EditThinker66\.7964\.2068\.2148\.6760\.4967\.0374\.4271\.1967\.19Qwen\-Image\-Edit\-2511\-based methodsQwen\-Image\-Edit\-251167\.3675\.8273\.8759\.6766\.0271\.0778\.5873\.9972\.27RePlan46\.8456\.2755\.2551\.5749\.3549\.8762\.6660\.7754\.92PromptEnhancerV267\.4674\.0174\.0054\.2563\.3270\.3776\.2972\.6270\.77DARS67\.7974\.9775\.7960\.4664\.9270\.7978\.2173\.3272\.75
### 3\.9\.Baseline Architecture Overview
Table[S8](https://arxiv.org/html/2608.20161#S3.T8)summarizes the main backbone composition and dominant control mechanism of each baseline based on the released model descriptions and our implementation notes\.
Table S8\.Detailed baseline architecture summary\.MethodMain BackboneKey Structural CharacteristicsThinkRL\-EditQwen3\-VL\-30B\-A3B \+ Qwen\-Image\-EditChecklist\-style reward\-driven RL with explicit CoT planning and reflection before image\-to\-image diffusion editing\.ThinkGenQwen3\-VL\-8B\-Think \+ OmniGen2\-4B DiTAlternating GRPO between a reasoning VLM and a DiT generator\.Step1X\-Edit\-v1p2Qwen2\.5\-VL\-7B \+ Step1X\-EditMulti\-round reflection pipeline \(up to five rounds\) with coupled VLM and editor tuning\.RePlanQwen2\.5\-VL\-7B \+ Qwen\-Image\-Edit\-2511Region\-aware decomposition: an RL\-trained VLM predicts boxes and localized prompts for editing\.EditThinkerQwen3\-VL\-8B \+ Qwen\-Image\-EditUp to five rounds of reflection, with reasoning refinement concentrated on the VLM side\.UniReason 1\.0Bagel\-14BWorld\-knowledge\-aware prompt enhancement with reflection and consistency control\.PromptRLQwen2\.5\-VL\-3B \+ FLUX \.1\-Kontext\-12BJoint RL over the prompt\-side VLM and the image editor\.UniREditBagel\-14BUses large\-scale text reasoning data together with mixed real\-world and game\-world supervision for reasoning\-oriented editing\.PhysicEditPhysicEdit data \+ Qwen\-Image\-Edit\-2509Physically grounded reasoning with meta\-query\-based control for physics\-aware image editing\.PromptEnhancerV2 \- Img2Img EditQwen2\.5\-VL\-32B \+ Qwen\-Image\-Edit\-2511Prompt\-enhancement front\-end paired with a strong external image editor; the public description mainly exposes the front\-end/control structure rather than the full joint training recipe\.Qwen\-Image\-Edit\-2511Qwen\-Image\-Edit\-2511Strong native end\-to\-end image editing model used as a general\-purpose reference baseline\.
## 4\.Failure Attribution Validation Details
We sample 500 evaluation cases for the attribution study, with an even split between relatively simple and difficult edits \(250 each\), so the validation set covers both low\-difficulty and high\-difficulty failure modes\. For each case, GPT\-5 produces five independent failure\-attribution labels, and the final case\-level pseudo\-label is the majority vote\. The system prompt used for this annotation step is shown in Fig\.[S6](https://arxiv.org/html/2608.20161#acmlabel10)\.
The GPT\-5 annotator returns one of three raw labels:planner\_side,renderer\_side, orboth\. In the paper, these are reported respectively as*planner\-dominant*,*renderer\-dominant*, and*mixed*\. After obtaining these case\-level three\-way pseudo\-labels, we form three pairwise binary tasks by filtering the same 500\-case pool into*Planner vs\. Renderer*,*Planner vs\. Mixed*, and*Renderer vs\. Mixed*; we do not resample separately for the binary tasks, so the retained sample count in each setting is determined by the realized three\-way label frequencies in this shared evaluation pool\.
Accuracy and Macro\-F1 are computed within each resulting binary task, and AUROC is reported in the same one\-vs\.\-one setting rather than under a three\-way formulation\. GPT\-5 sees only the source image, the structured plan, and the edited image for each sampled triplet; it does not see rollout statistics, checklist\-based rewards, or slot scores\.
## 5\.Additional Qualitative Results
This section adds three complementary qualitative views: additional baseline comparisons, more reasoning\-intensive edits, and more general editing cases\.
#### Additional baseline comparisons\.
Figure[S2](https://arxiv.org/html/2608.20161#acmlabel6)adds side\-by\-side comparisons on challenging edits involving temporal prediction, logical diagram reasoning, path planning, object removal, and symbolic transformation\. These cases make it easier to inspect whereDARSpreserves the target semantics more reliably than the omitted baselines\.
Figure S2\.Additional baseline comparisons on challenging edits\.The figure adds side\-by\-side results for several baselines under the same evaluation setting\.Supplementary qualitative comparison figure showing additional baseline outputs on challenging image editing tasks, alongside DARS results for the same cases\.Figure S3\.Representative failure cases illustrating current limitations\.From left to right, the examples highlight failure modes on puzzle completion, dense final\-state reasoning in a mechanics\-style diagram, precise relative\-size control across multiple objects, and maze\-path drawing\. Together they show that the method remains weaker when the desired target is difficult to specify textually, when the edit depends on tightly coupled multi\-step reasoning, or when exact geometric control is required\.Failure\-case figure showing four representative limitations: incomplete puzzle completion, an incorrect lever final state, inaccurate size normalization across stacked lunch boxes, and an unstable maze solution path\.Figure S4\.Additional reasoning\-intensive editing examples\.The figure covers temporal, spatial, logical, physical, and knowledge\-intensive editing cases\.Supplementary qualitative figure with additional reasoning\-intensive image editing examples, showing source images, instructions, model outputs, and DARS results on more complex reasoning\-heavy tasks\.Table S9\.Actual four\-slot plan decompositions for representative qualitative cases\.Each row lists the raw user instruction together with its*Modify*,*Preserve*,*Overall*, and*Tips*fields in the same slot schema used throughout the paper\.IDRawModifyPreserveOverallTips1Draw what it will look like after 30 seconds in summer\.Show the dry leaf catching fire under the concentrated sunlight from the magnifying glass, with a small flame and a plume of grey smoke rising from the bright focal point on the leaf\.Preserve the surrounding green grass, the hand holding the magnifying glass, the position of the lens, and the overall sunny daylight illumination\.The scene should depict the early stage of combustion in a visually coherent and physically plausible way under strong summer sunlight\.Add a charred, blackened texture around the focal point and ensure the smoke and flame originate naturally from the concentrated light spot on the brown leaf\.2Draw what it will look like ten seconds later\.Edit the image to depict the scene ten seconds later by removing the suspended water droplets, the central splash pillar, and the concentric ripple rings\.Preserve the background mountains, the tree\-covered hills, the cloudy sky, the soft natural lighting, and the original lake setting\.The final image should look calm, smooth, and undisturbed, as if the splash event has fully settled into a serene static scene\.Maintain the original low camera angle, depth of field, and color grading, and ensure the reflections on the still water align naturally with the surrounding landscape\.3Draw what it will look like after 30 minutes\.Change the scene to show the pot after the milk has been boiling for 30 minutes, with messy frothy milk spills down the black pot and onto the gas stove grate, along with a reduced, thickened, overheated surface inside the pot\.Preserve the shape and material of the pot, the visible gas flame, the stove grate structure, the blurred background, and the original warm lighting and perspective\.The result should convey a realistic long\-boiling, overheating situation with coherent interactions between milk, pot, stove, steam, and smoke\.Add bubbly and browned residue along the inner rim, mix darker smoke with the steam, and make the spilled milk follow gravity and pool plausibly on the stove surfaces\.4The caterpillar wants to find the shortest path to the leaf\. Please mark the two shortest paths in the diagram\.Mark the two shortest surface paths from the orange caterpillar at the bottom front corner of the cube to the green leaf on the top face using two distinct overlaid lines\.Preserve the original blue cube, the green leaf, the orange caterpillar, and the white background exactly as they are\.The final image should look like a clean diagrammatic solution that remains geometrically consistent with the cube’s perspective\.Draw one path across the front\-left face and top face, and the other across the front\-right face and top face, rendering both lines clearly and aligned to the cube surface geometry\.5Move only two matchsticks on the left side of the equation to make the equation true\. Draw the final equation\.Transform the left side of the matchstick equation so the final result reads 3 \- 3 = 0 by changing the two left digits accordingly\.Preserve the minus sign, the equals sign, the digit 0 on the right, the white background, and the overall matchstick style\.The final image must show a coherent, mathematically correct, and well\-aligned matchstick equation\.Turn the 8 into a 3 by removing the two left vertical matches, turn the 7 into a 3 by adding a middle and bottom horizontal match, and match the existing dark match heads and rectangular shafts\.6Remove the water from the glass cup\.Remove the water from the glass cup so the glass interior appears empty and dry, and the tennis ball appears without liquid\-induced distortion\.Preserve the “HEAD ATP” text, the fuzzy tennis\-ball texture, the shape and material of the clear glass cup, and the bright cyan background\.The final result should look like a realistic dry glass container holding the ball naturally at the bottom under the same viewing conditions\.Eliminate optical refraction, magnification, and distortion from the ball, while maintaining the original lighting, shadows, and camera viewpoint\.7This is a rock\-paper\-scissors game\. Change one hand gesture so that the player who played rock wins\.Change the bottom hand gesture from paper to scissors so that the rock player wins the game\.Preserve the top\-left hand showing scissors and the right hand showing rock exactly as they are, along with the black\-and\-white cartoon drawing style\.The final image should remain a consistent rock\-paper\-scissors illustration with correct game logic and unchanged visual composition\.Redraw the bottom hand as a fist with the index and middle fingers extended in a V\-shape, matching the original line thickness and glove\-like cartoon design\.8Place the “O” in the appropriate spot on the tic\-tac\-toe board to win the game\.Add a red O mark to the top center square of the tic\-tac\-toe grid to complete the winning row\.Preserve the blue grid lines, the blue X marks, the existing red O marks, the lined notebook paper background, and the pause icon in the top\-right corner\.The final image should look like a consistent hand\-drawn tic\-tac\-toe board where the O player wins naturally\.Position the new red O in the top\-center cell, match the existing red ink color and rough sketch style, and keep the stroke thickness consistent with the other O marks\.9Add a 10% tip to the receipt in the image\.Add a new line below the total amount of $45\.00 labeled “Tip:” followed by “$4\.50”\.Preserve all existing receipt text, layout, spacing, and visual style\.The receipt should still look like a coherent and authentic printed receipt with the new tip line integrated naturally\.Format the new line using the same font, alignment, spacing, and typographic style as the rest of the receipt\.10Remove the facility used to protect the house\.Remove the lightning rod structure from the peak of the red tiled roof, including the vertical pole and its spherical components\.Preserve the red roof tiles, the concrete building structure, the windows, the large satellite dish on the right, and the original daylighting and perspective\.The final image should look like a realistic roof scene with no visible trace of the removed protection facility\.Seamlessly reconstruct the roof ridge and fill the removed area with surrounding sky so the roofline and sky gradient remain continuous and undisturbed\.11Complete the Rubik’s Cube\.Fill in the missing cubies to restore the puzzle into a complete 4x4x4 cube with solid cubic geometry\.Preserve all existing blue, orange, and white stickers, the black plastic body, and the purple patterned background\.The completed puzzle should look like a coherent, fully assembled cube with consistent structure, perspective, and material appearance\.Add the missing top\- and right\-face blocks with white stickers on top\-facing surfaces and orange stickers on right\-facing surfaces, aligning them perfectly with the existing grid lines and shading\.12Correct unreasonable parts of the socket in the image\.Correct the unrealistic and scattered arrangement of holes on the wall socket by replacing them with a standard, symmetrical, and functional outlet pattern centered on the plate\.Preserve the beige square faceplate, the outer frame, the light gray speckled wall background, and the overall lighting and texture\.The final socket should look like a realistic manufactured electrical outlet with a clean, balanced, and logically organized layout\.Use a recognized outlet configuration such as a standard 3\-pin or universal socket design, organize the holes into logical pairs or groups, and render their depth, shading, and geometry with precise plastic\-like realism\.Figure S5\.Additional general editing examples\.The figure covers localized modifications, preservation\-sensitive edits, semantic scene changes, extraction, and removal cases\.Supplementary qualitative figure with additional general image editing examples, complementing the reasoning\-intensive cases with more standard editing scenarios and DARS outputs\.
#### Additional reasoning\-intensive edits\.
Figure[S4](https://arxiv.org/html/2608.20161#acmlabel8)shows that the advantage ofDARSremains visible across several reasoning\-heavy regimes, including rule\-based game solving \(e\.g\., rock\-paper\-scissors and tic\-tac\-toe\), commonsense inference edits such as tip calculation and identifying the lightning rod as the protective facility to remove, and object completion or correction tasks involving missing or unreasonable structures\.
#### Additional general editing cases\.
Figure[S5](https://arxiv.org/html/2608.20161#acmlabel9)shows that the benefit ofDARSis not limited to explicitly puzzle\-like instructions\. Across more diverse general editing cases with richer object composition and more complex inter\-object relationships,DARSconsistently demonstrates strong fine\-grained control over local edits while preserving non\-target content\. These examples further suggest that the method maintains robust scene understanding and object\-level recognition even in visually complex images, enabling precise edits without sacrificing overall consistency\.
### 5\.1\.Structured Plans for Qualitative Cases
Table[S9](https://arxiv.org/html/2608.20161#S5.T9)lists the four\-slot decompositions for representative cases in Figs\.[S2](https://arxiv.org/html/2608.20161#acmlabel6)–[S5](https://arxiv.org/html/2608.20161#acmlabel9), so readers can directly inspect the semantic allocation across*Modify*,*Preserve*,*Overall*, and*Tips*\.
## 6\.Prompt Templates
We collect here the prompt templates used in three places in the pipeline\. Figure[S6](https://arxiv.org/html/2608.20161#acmlabel10)is used only in the GPT\-5 failure\-attribution validation study\. Figure[S7](https://arxiv.org/html/2608.20161#acmlabel11)is the planner\-side four\-slot rewriting prompt used during rollout to produce𝐞\\mathbf\{e\}\. Figure[S8](https://arxiv.org/html/2608.20161#acmlabel12)is the offline Gemini 3 Pro prompt used to generate the cached shared checklist𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)\. During RL itself, Qwen3\-VL\-32B is used only for online single\-question Yes/No scoring\.
#### Validation prompt\.
We first show the GPT\-5 prompt used only for the failure\-attribution validation study in Section[4](https://arxiv.org/html/2608.20161#S4a)\. It is not part of the training or preprocessing pipeline\.
You are a strict failure\-attribution evaluator for instruction\-based image editing\.
You will be given:
\- Source Image: Picture 1
\- Final Edited Image: Picture 2
\- User Edit Instruction
\- Enhanced Edit Instruction
Your task is to determine whether the main failure comes from:
1\.planner\_side
2\.renderer\_side
3\.both
Definitions:
planner\_side: Choose this when the enhanced instruction is itself inadequate as an editing plan\. This includes cases where the enhanced instruction is vague, incomplete, mislocalized, misbound to the wrong target, missing necessary preservation constraints, missing necessary global consistency constraints, missing necessary local implementation details, or otherwise fails to faithfully and operationally specify the user’s intent for the given source image\. In this case, the rendered failure can be reasonably explained primarily by planning/instruction deficiency\.
renderer\_side: Choose this when the enhanced instruction is already a sufficient and reasonable editing plan for the given source image, but the final rendered image fails to execute it correctly\. This includes cases where the rendered result misses the requested edit, applies it to the wrong target, causes unnecessary collateral changes, breaks realism or consistency, or otherwise fails despite the enhanced instruction being adequate\.
both: Choose this when both sides contribute materially to the failure\. This includes cases where the enhanced instruction is meaningfully flawed or insufficient, and the final rendered result also shows execution failures that cannot be explained only by the planning issue\. Usebothwhen there is substantial planner deficiency and substantial renderer deficiency at the same time\.
Core evaluation principle:
You must separate:
\- plan adequacy: whether the enhanced instruction is a faithful, grounded, and operational plan for the task, and
\- execution adequacy: whether the final rendered image successfully follows that plan\.
Decision procedure:
1\. Compare the original user instruction with the enhanced instruction\.
2\. Judge whether the enhanced instruction is a good plan for editing the source image\.
3\. Compare the final rendered image against the source image and the enhanced instruction\.
4\. Determine whether the observed failure is mainly due to bad planning, bad execution, or both\.
Important rules:
\- Judge the enhanced instruction relative to the source image, not in the abstract\.
\- Do not preferplanner\_sidemerely because the enhanced instruction could be even better; it must be materially inadequate\.
\- Do not preferrenderer\_sideif the enhanced instruction is clearly under\-specified or misleading in a way that would likely cause the failure\.
\- Usebothonly when both deficiencies are real and important\.
\- If the enhanced instruction is adequate and the image still fails, chooserenderer\_side\.
\- If the enhanced instruction is inadequate and the image failure is consistent with that planning failure, chooseplanner\_side\.
\- If the enhanced instruction is inadequate and the rendered image also introduces additional execution failures beyond that, chooseboth\.
Examples of planner\-side evidence:
\- wrong target identified
\- missing preservation constraint for important unchanged content
\- missing global consistency constraint when clearly needed
\- ambiguous local instruction that leaves critical placement or binding unspecified
\- rewritten instruction drifts from user intent
Examples of renderer\-side evidence:
\- requested edit missing or weak despite adequate instruction
\- correct target not edited
\- wrong region edited
\- identity, pose, background, or unrelated content altered unnecessarily
\- geometry, anatomy, lighting, perspective, or local realism broken despite adequate instruction
Output requirement:
Return exactly one label and nothing else\.
Allowed outputs:
planner\_side
renderer\_side
bothSystem Prompt for GPT\-5 Failure AttributionFigure S6\.System prompt used for GPT\-5 failure\-attribution annotation in the routing\-signal validation study\.The raw outputsplanner\_side,renderer\_side, andbothare mapped in the paper to*planner\-dominant*,*renderer\-dominant*, and*mixed*, respectively\.A boxed system prompt template for GPT\-5 failure attribution in instruction\-based image editing, defining planner\-side, renderer\-side, and both, together with decision rules and output constraints\.
#### Planner rollout and checklist\-generation prompts\.
We next show the two prompt families that create the semantic inputs to online scoring: the planner\-side four\-slot rewriting prompt used during rollout, and the Gemini 3 Pro prompt used before RL to generate the cached checklist target\.
You are an expert in writing prompts for instruction\-based image editing\. Given a source image and a user instruction, rewrite the instruction into a detailed, precise prompt for an image editing model\. Organize the rewritten prompt into four explicitly tagged fields that specify what should change, what must be preserved, where the edit applies, and how the result should remain consistent with the original image\.
\#\#\# I\. Editing Objectives
The rewritten prompt must faithfully reflect the user’s requested modification while preserving all unrelated content\.
1\.Edit Specificity: Clearly identify the target of the edit: object, person, attribute, region, text, background, style, pose, action, or layout\.
2\.Preservation of Unedited Content: Explicitly preserve all content not mentioned in the user’s instruction, including identity, composition, viewpoint, background, lighting, color harmony, structure, and scene context, unless the instruction requires changing them\.
3\.Localized and Grounded Editing: Describe the edit with precise grounding in the image, including spatial position, entity relationships, and attribute bindings\.
4\.Structural and Visual Consistency: Ensure the final result remains realistic and coherent in geometry, anatomy, perspective, shadows, reflections, texture, and occlusion\.
5\.Minimal Necessary Change: If the instruction is ambiguous, prefer the smallest valid edit that satisfies the user’s intent without introducing unnecessary changes\.
\#\#\# II\. Tagged Field Structure
The rewritten prompt must contain exactly four tagged fields, with one field for each slot\. Content within each field may use free\-form natural language\.
1\.Modify: State the main requested edit directly and clearly\.
2\.Preserve: Explicitly state the important elements that should remain unchanged\.
3\.Overall: Describe the desired image\-level coherence, including consistency in lighting, perspective, identity, style, and scene continuity\.
4\.Tips: Provide targeted implementation details about the edited subject or region, including attributes, actions, position, relations, and appearance\.
\#\#\# III\. Grammatical Rules
1\. Use clear, descriptive, and objective language\.
2\. Use present tense consistently\.
3\. Use precise spatial and relational expressions\.
4\. Use specific adjectives only when supported by the source image or user instruction\.
5\. Avoid vague expressions such as “make it better” unless the user explicitly requests them\.
6\. Prefer direct description over meta commentary\.
7\. Keep the rewritten prompt compact but sufficiently detailed for high\-quality editing\.
\#\#\# IV\. Editing\-Specific Rules
1\. Only provide the final rewritten editing prompt\. Do not use markdown format\.
2\. Do not explain your reasoning\.
3\. Do not mention “source image”, “input image”, “edited image”, “before”, or “after” unless necessary for disambiguation\.
4\. Do not add new objects, text, attributes, events, or background elements that are not required by the user’s instruction\.
5\. If the edit concerns only one entity among multiple entities, preserve the others and bind the edit to the correct target\.
6\. If the instruction changes a local attribute, preserve identity, pose, and other attributes unless explicitly asked otherwise\.
7\. If the instruction changes the background, preserve the main subject unless explicitly asked otherwise\.
8\. If the instruction removes an object, ensure the filled region is visually plausible and consistent with the surrounding scene\.
9\. If the instruction inserts or edits text, preserve the exact requested wording and format it as “rendered text”\.
10\. If the instruction does not request a style change, preserve the original image style, medium, camera viewpoint, and overall tone\.
11\. If the instruction requests a style transfer, preserve the scene semantics, object layout, and key subject identity unless explicitly asked otherwise\.
12\. If human hands, faces, bodies, or animal limbs are involved, ensure structural integrity and anatomical plausibility\.
13\. If reflections, mirrors, glass, water, or shadows are present, keep them physically consistent with the requested edit\.
14\. Output exactly four tagged fields, each appearing once, in the order Modify, Preserve, Overall, Tips\.
<Modify\>\.\.\.</Modify\><Preserve\>\.\.\.</Preserve\>
<Overall\>\.\.\.</Overall\><Tips\>\.\.\.</Tips\>
15\. Do not output any text outside these tags\.
Next, I will provide:
\- Source image:
\- User edit instruction:
Please provide the rewritten four\-slot editing prompt using the required tags:System Prompt for Planner Rollout Four\-Slot RewritingFigure S7\.Planner\-side prompt template used during rollout to rewrite a raw editing instruction into a four\-slot plan\.The resulting𝐞\\mathbf\{e\}is the planner output used by the renderer and by planner\-side reward scoring\.A boxed prompt template for rewriting image editing instructions into a four\-slot specification with sections on editing objectives, tagged\-field structure, grammatical rules, and editing\-specific rules\.You are an expert evaluator for instruction\-based image editing\.
Your task is to generate a single shared slot\-aligned checklist directly from the source image and user instruction\.
The four slots are:
1\. Modify
2\. Preserve
3\. Overall
4\. Tips
You will be given:
\- a source image,
\- and a user edit instruction\.
You must generate four lists of binary Yes/No verification questions:
\- modify
\- preserve
\- overall
\- tips
\#\#\# I\. Design Constraints
A\. Slot exclusivity: Each question must belong to exactly one slot\. Do not write a question that simultaneously checks multiple slots\.
B\. Cross\-slot complementarity: The four lists must be complementary rather than redundant\. Do not repeat the same semantic requirement across different slots using different wording\.
C\. No cross\-slot interference: A question in one slot must not depend on requirements that should be judged in another slot\. Modify checks the requested change, Preserve checks what remains unchanged, Overall checks global coherence, and Tips checks targeted local implementation details\.
D\. Post\-render verifiability: Every question must be answerable later by looking at the source image, the relevant slot text, and the final rendered image\.
E\. Strict binary evaluability: Each question must be clear, objective, and answerable with Yes or No\. “Yes” must always mean success\.
F\. Minimal\-change principle: If the instruction is ambiguous, prefer the smallest valid edit and avoid inventing unnecessary requirements\.
\#\#\# II\. Slot Definitions
Modify: the main requested edit, target binding, and intended visible change\.
Preserve: important content that should remain unchanged\.
Overall: image\-level coherence, realism, perspective, identity/style continuity, structural consistency, and physical plausibility when relevant\.
Tips: targeted local implementation details such as exact region, relative position, attribute binding, text rendering, fill plausibility, or local appearance constraints when relevant\.
\#\#\# III\. Checklist Construction Requirements
1\. Generate 3 to 5 questions per slot\.
2\. Questions must be concise\.
3\. Questions must be non\-redundant within each slot\.
4\. Questions must be non\-redundant across slots\.
5\. Do not include generic writing\-quality questions\.
6\. Do not ask about hidden reasoning or internal model behavior\.
7\. Do not ask about anything that cannot be visually checked after rendering\.
\#\#\# IV\. Output Format
Output ONLY a valid JSON object; three\-question example:
\{
"modify": \["Question 1?", "Question 2?", "Question 3?"\],
"preserve": \["Question 1?", "Question 2?", "Question 3?"\],
"overall": \["Question 1?", "Question 2?", "Question 3?"\],
"tips": \["Question 1?", "Question 2?", "Question 3?"\]
\}
Do not output markdown, explanations, notes, comments, or any extra text\.System Prompt for Shared Checklist GenerationFigure S8\.Prompt template used in the offline Gemini 3 Pro preprocessing stage to generate the shared slot\-aligned checklist𝐂\(𝐱\)\\mathbf\{C\}\(\\mathbf\{x\}\)from the source image and user instruction\.The template enforces slot exclusivity, cross\-slot complementarity, post\-render verifiability, and strict binary Yes/No evaluability so that the same pre\-generated checklist can be reused across planner reward, renderer reward, hardness estimation, and routing\.A boxed prompt template for generating a shared slot\-aligned checklist with four question lists for modify, preserve, overall, and tips, together with design constraints and JSON output requirements\.
#### Online reward\-scoring prompts\.
After the planner produces a rollout\-time four\-slot plan and the checklist is loaded from the offline cache, reward evaluation proceeds through single\-question prompts rather than a monolithic judgment\. Each API call evaluates exactly one checklist question for exactly one slot, using Qwen3\-VL\-32B as the online Yes/No judge during RL training\. The slot text in these prompts comes from the current planner’s rollout\-time rewrite, while the checklist question comes from the offline Gemini 3 Pro cache\.
Planner\-side prompts are post\-render diagnostics: they ask whether the current slot text functioned as a good plan for the observed edit under one checklist item\.
You are a strict planner\-side evaluator for the Modify slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the current Modify slot text functions as a good planning statement for the requested edit, after considering the final rendered result\. Evaluation target: \- Judge the quality of the current Modify slot as a plan\. \- Use the final rendered image only as post\-render evidence showing whether the slot was sufficiently specific, correctly bound, and operational\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Do not reward generic wording\. \- Answer “No” if the slot is vague, misbound, incomplete, or if the rendered result reveals that this Modify slot failed to specify the needed edit clearly enough\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Planner\-Side Modify Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Current Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Modify\-slot checklist question\. Decision rule: Answer Yes only if the Modify slot text clearly plans the requested visible change on the correct target, and the final rendered image does not reveal a planning failure for this requirement\. Answer No if: \- the slot text is vague, \- the target is misidentified, \- the edit is weakly specified, \- the slot omits a necessary binding, \- or the rendered result reveals that this Modify plan was inadequate\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Planner\-Side Modify Evaluation
Figure S9\.Planner\-side single\-question prompt for the*Modify*slot\.The prompt evaluates one checklist question as a post\-render diagnostic of whether the current Modify slot text functioned as an adequate plan\.Two boxed prompt templates for planner\-side Modify\-slot evaluation: a system prompt defining the judgment rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.You are a strict planner\-side evaluator for the Preserve slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the current Preserve slot text functions as a good preservation plan, after considering the final rendered result\. Evaluation target: \- Judge whether the Preserve slot explicitly and adequately protects important content that should remain unchanged\. \- Use the final rendered image as post\-render evidence of whether the preservation constraints were sufficient\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Answer “No” if the Preserve slot fails to explicitly protect important unchanged content, or if the rendered result reveals collateral changes that this slot should have constrained\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Planner\-Side Preserve Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Current Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Preserve\-slot checklist question\. Decision rule: Answer Yes only if the Preserve slot text explicitly protects the relevant unchanged content, and the final rendered image does not reveal a preservation failure for this requirement\. Answer No if: \- important unchanged content is not explicitly protected, \- the preservation scope is too weak or incomplete, \- the slot leaves room for unnecessary collateral edits, \- or the rendered result reveals preservation failures that this slot should have prevented\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Planner\-Side Preserve Evaluation
Figure S10\.Planner\-side single\-question prompt for the*Preserve*slot\.The prompt evaluates one checklist question as a post\-render diagnostic of whether the current Preserve slot text adequately protected unchanged content\.Two boxed prompt templates for planner\-side Preserve\-slot evaluation: a system prompt defining the preservation judgment rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.You are a strict planner\-side evaluator for the Overall slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the current Overall slot text functions as a good global\-coherence plan, after considering the final rendered result\. Evaluation target: \- Judge whether the Overall slot meaningfully constrains image\-level coherence, realism, continuity, and consistency\. \- Use the final rendered image as post\-render evidence showing whether the overall constraints were adequate\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Answer “No” if the Overall slot is generic, weak, non\-operational, or if the rendered result reveals global inconsistencies that this slot should have constrained\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Planner\-Side Overall Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Current Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Overall\-slot checklist question\. Decision rule: Answer Yes only if the Overall slot text meaningfully plans global coherence and consistency, and the final rendered image does not expose a failure that this slot should have constrained\. Answer No if: \- the slot is too generic, \- the global consistency requirement is weakly specified, \- the slot fails to constrain realism, continuity, or coherence where needed, \- or the rendered result reveals global inconsistency that this slot should have helped prevent\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Planner\-Side Overall Evaluation
Figure S11\.Planner\-side single\-question prompt for the*Overall*slot\.The prompt evaluates one checklist question as a post\-render diagnostic of whether the current Overall slot text adequately constrained global coherence\.Two boxed prompt templates for planner\-side Overall\-slot evaluation: a system prompt defining the coherence judgment rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.You are a strict planner\-side evaluator for the Tips slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the current Tips slot text functions as a good targeted implementation plan, after considering the final rendered result\. Evaluation target: \- Judge whether the Tips slot supplies useful local, grounded, implementation\-critical details\. \- Use the final rendered image as post\-render evidence showing whether these local details were necessary and adequately specified\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Answer “No” if the Tips slot is vague, generic, ungrounded, or if the rendered result reveals local failures that better Tips guidance should have constrained\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Planner\-Side Tips Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Current Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Tips\-slot checklist question\. Decision rule: Answer Yes only if the Tips slot text provides the local grounded detail needed for this requirement, and the final rendered image does not reveal that such detail was missing or inadequate\. Answer No if: \- the tip is vague or generic, \- the local target or relation is not grounded, \- the implementation detail is missing, \- the slot does not bind the detail to the correct region or entity, \- or the rendered result reveals a local failure that better Tips guidance should have prevented\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Planner\-Side Tips Evaluation
Figure S12\.Planner\-side single\-question prompt for the*Tips*slot\.The prompt evaluates one checklist question as a post\-render diagnostic of whether the current Tips slot text provided adequate local implementation guidance\.Two boxed prompt templates for planner\-side Tips\-slot evaluation: a system prompt defining the local\-guidance judgment rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.Renderer\-side prompts retain the raw instruction and relevant slot text as specification context but change the target: the judge scores whether the final rendered image visibly satisfies each checklist question, not whether the slot text is a good plan\.
You are a strict renderer\-side evaluator for the Modify slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the final rendered image successfully executes the required Modify\-slot condition\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Judge visible evidence only\. \- Use the source image as the reference image\. \- Use the user instruction and slot text only as the intended specification\. \- Answer “No” if the requested change is missing, weak, misplaced, incomplete, bound to the wrong target, or visually ambiguous\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Renderer\-Side Modify Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Relevant Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Modify\-slot checklist question from visible evidence\. Decision rule: Answer Yes only if Picture 2 clearly executes the requested visible modification specified by this requirement\. Answer No if: \- the edit is absent, \- too weak, \- applied to the wrong target, \- applied in the wrong way, \- or visually ambiguous\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Renderer\-Side Modify Evaluation
Figure S13\.Renderer\-side single\-question prompt for the*Modify*slot\.The prompt evaluates one checklist question as an execution\-scoring query over visible modification quality\.Two boxed prompt templates for renderer\-side Modify\-slot evaluation: a system prompt defining the execution\-scoring rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.You are a strict renderer\-side evaluator for the Preserve slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the final rendered image successfully preserves the required unchanged content\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Judge visible evidence only\. \- Use the source image as the preservation reference\. \- Answer “No” if there are unnecessary changes to content that should have remained unchanged, even if the main edit is otherwise correct\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Renderer\-Side Preserve Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Relevant Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Preserve\-slot checklist question from visible evidence\. Decision rule: Answer Yes only if the relevant content remains unchanged in Picture 2 relative to Picture 1\. Answer No if: \- identity changes unnecessarily, \- unrelated objects or regions are altered, \- composition, viewpoint, or background shifts without need, \- or other collateral changes violate this preservation requirement\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Renderer\-Side Preserve Evaluation
Figure S14\.Renderer\-side single\-question prompt for the*Preserve*slot\.The prompt evaluates one checklist question as an execution\-scoring query over whether unchanged content is actually preserved\.Two boxed prompt templates for renderer\-side Preserve\-slot evaluation: a system prompt defining the preservation scoring rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.You are a strict renderer\-side evaluator for the Overall slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the final rendered image satisfies the required global coherence and realism condition\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Judge visible evidence only\. \- Answer “No” if geometry, anatomy, perspective, lighting, texture continuity, style continuity, shadows, reflections, or scene logic fail in a way relevant to this question\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Renderer\-Side Overall Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Relevant Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Overall\-slot checklist question from visible evidence\. Decision rule: Answer Yes only if Picture 2 remains globally coherent and realistic for this requirement\. Answer No if: \- perspective breaks, \- lighting is inconsistent, \- identity or style continuity fails where relevant, \- anatomy or geometry is implausible, \- or overall scene continuity is broken\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Renderer\-Side Overall Evaluation
Figure S15\.Renderer\-side single\-question prompt for the*Overall*slot\.The prompt evaluates one checklist question as an execution\-scoring query over global coherence and realism\.Two boxed prompt templates for renderer\-side Overall\-slot evaluation: a system prompt defining the coherence scoring rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.You are a strict renderer\-side evaluator for the Tips slot in instruction\-based image editing\. You will judge exactly one checklist question in this API call\. Your task is to determine whether the final rendered image satisfies the required local implementation detail\. Rules: \- Judge only whether the current question is satisfied\. \- Do not apply any criterion that is not explicitly required by this question\. \- Do not turn this question into an overall evaluation of the whole result\. \- Judge visible evidence only\. \- Answer “No” if the local detail is missing, weak, misplaced, bound to the wrong entity, visually inconsistent, or only partially satisfied\. Output ONLY a valid JSON object\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \} Do not output anything else\.System Prompt for Renderer\-Side Tips Evaluation
Input: \- Source Image: Picture 1 \- Final Edited Image: Picture 2 \- User Edit Instruction: \{user\_instruction\} \- Relevant Slot Text: \{slot\_text\} \- Current Checklist Question: \{question\_text\} Task: Judge only this one Tips\-slot checklist question from visible evidence\. Decision rule: Answer Yes only if Picture 2 satisfies the required local implementation detail for this question\. Answer No if: \- the local target is wrong, \- the position or relation is wrong, \- the attribute binding is wrong, \- rendered text is incorrect, \- local appearance is inconsistent, \- or fill/inpainting behavior is not plausible when relevant\. Output JSON only\. Example for a Yes judgment: \{ "answer": "Yes", "brief\_reason": "Short factual reason\." \}User Prompt for Renderer\-Side Tips Evaluation
Figure S16\.Renderer\-side single\-question prompt for the*Tips*slot\.The prompt evaluates one checklist question as an execution\-scoring query over local implementation quality\.Two boxed prompt templates for renderer\-side Tips\-slot evaluation: a system prompt defining the local\-detail scoring rules and a user prompt providing the source image, rendered image, slot text, and checklist question\.
## 7\.Limitations
Despite the gains reported in the main paper and the supplementary visualizations above, the current framework still has several clear limitations\. One recurring difficulty arises when the desired output is hard to specify compactly in natural language and is more naturally described by a structured visual target\. This includes tasks such as maze solving, puzzle completion, or other diagrammatic edits where the model must infer and render a precise final configuration rather than only apply a local semantic modification\.
A second limitation appears in cases that require either very dense chained reasoning or very precise geometric control\. As shown in Fig\.[S3](https://arxiv.org/html/2608.20161#acmlabel7), representative failure modes include incomplete puzzle reconstruction, incorrect final\-state reasoning in mechanics\-style diagrams, inaccurate relative\-size normalization across multiple objects, and unstable path drawing in mazes\. These examples suggest that the current planner–renderer decomposition is still less reliable when the edit depends on long reasoning chains, diagram\-level state transitions, or exact multi\-object scale relationships\. Future progress will likely require stronger, structured intermediate representations, richer supervision for diagrammatic reasoning, and more explicit mechanisms for geometric control\.Similar Articles
Transferability for General Reasoning: An Automated Curriculum for Multi-Domain RLVR
This paper proposes Transfer-Aware Curriculum (TAC), a bandit-style online curriculum for multi-domain RLVR that prioritizes domains whose updates benefit other domains using gradient-geometry alignment. TAC improves macro-averaged accuracy on Qwen3-1.7B and Llama3.2-3B over fixed and learnability-only curricula.
DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning
This paper identifies that failures in visual reasoning often stem from breakdowns in dynamic cross-modal coordination between visual and textual evidence during chain-of-thought generation. It introduces DyCo-RL, a reinforcement learning framework that rewards effective cross-modal coordination, leading to improved reasoning performance.
R2D-RL: A RoboCup 2D Soccer Environment for Multi-Agent Reinforcement Learning
Introduces R2D-RL, a reinforcement learning environment that connects the RoboCup 2D Soccer Simulation server to Python-based MARL workflows via shared-memory communication, supporting full-field and scenario-based training with configurable opponents and reward shaping.
Reasoning or Memorization? Direction-Aware Diversity Exploration in LLM Reinforcement Learning
This paper introduces DiRL, a direction-aware reinforcement learning framework that distinguishes reasoning-driven diversity from memorization-driven diversity in LLM exploration. It extracts an internal reasoning-memorization direction from model representations and shapes rewards to prioritize reasoning-aligned exploration, showing improvements on math and general reasoning benchmarks.
UniDoc-RL: Coarse-to-Fine Visual RAG with Hierarchical Actions and Dense Rewards
UniDoc-RL presents a reinforcement learning framework for Large Vision-Language Models that optimizes retrieval, reranking, and visual reasoning through hierarchical decision-making and dense multi-reward supervision, achieving up to 17.7% improvements over prior RL-based methods on visual RAG tasks.