UniEvo-VL：用于多模态模型自我改进的在线自蒸馏训练方案

# UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement
Source: [https://arxiv.org/html/2609.38721](https://arxiv.org/html/2609.38721)
Fang Wu††thanks:Equal contribution\.Da Xing†11footnotemark:1Yanjie Huang∘11footnotemark:1Junxi Wang∘11footnotemark:1Ji WangAffiliation:University of Toronto,Hejia GengAffiliation:University of Oxford,Guancheng Wan∘Bowen ZuoAffiliation:UC, RiversideXiaomin LiAffiliation:MatrAIx,Shixiang Tang∘Xinyu XiangAffiliation:Stanford University,†Johns Hopkins University,∘Independent ResearcherZehong WangAffiliation:University of Notre Dame,Shiyi DuAffiliation:Carnegie Mellon University⋆UNC–Chapel HillPeng Xia⋆Shuangjia Zheng∘Yining HongAffiliation:Stanford University,†Johns Hopkins University,∘Independent ResearcherLi Erran Li∘Jure LeskovecAffiliation:Stanford University,†Johns Hopkins University,∘Independent ResearcherYejin ChoiAffiliation:Stanford University,†Johns Hopkins University,∘Independent Researcher

###### Abstract

Modern multimodal models bring generation and understanding into a single unified system, which enables them to provide and learn from their own feedback\. Motivated by this unified capacity, we introduce UniEvo\-VL, a self\-evolving framework for multimodal models to learn from this constructive self\-correction feedback during test\-time compute\. Instead of relying on a separate, often larger, teacher, we leverage their self\-critiques as privileged information and ask a single multimodal model to act as both teacher and student with different contexts\. The student only sees the vanilla question, while the teacher conditions on the privileged critique\. Then training minimizes the per\-state divergence between their denoising diffusion distributions over the student’s own sampling trajectories\. Experiments demonstrate that UniEvo\-VL improves the image generation capabilities of multimodal models, while maintaining their sensitivity to additional reflection information\. Specifically, we build on top of the open\-source Qwen\-image\-2512 and observe a significant performance gain from 0\.747 to 0\.808 on GenEval and from 32\.97 to 35\.53 on GenEval2 Soft\-TIFA\. Moreover, attempts with more powerful external critics \(e\.g\., GPT5\.6\-Luna\) show that multimodal models with strong judge capabilities can anticipate a higher self\-evolving ceiling\. Last but not least, mixed text\-rendering outcomes show that our self\-improvements may not be uniform across different tasks\. Our study aims to shed light on the current hot recursive self\-improvement research line to enhance the user experience when using multimodal models without external supervision or guidance\.

![Refer to caption](https://arxiv.org/html/2609.38721v1/unievo_yining_v2.png)Figure 1:From understanding to self\-evolution\.Generated drafts become training experience through visual critique and generator updates\. The conceptual loop motivates both self\-critique and an optional extension with a stronger external critic\.## 1Introduction

Unified multimodal models \(MMM\)\([Achiam et al\., 2023](https://arxiv.org/html/2609.38721#bib.bib3);[Team et al\., 2023](https://arxiv.org/html/2609.38721#bib.bib2)\)exhibit great capabilities in both visual generation and understanding\. This creates an unprecedented opportunity for them to self\-evolve without external supervision\. In particular, MMMs can identify discrepancies between their generated images and the given instructions, and use this self\-feedback for future improvements\. Inspired by this relationship, prior work proposes to self\-enhance MMMs by selecting self\-generated outputs for supervised fine\-tuning and preference optimization\([Han et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib11)\), or reconstructing self\-generated interactions into captioning, judgment, and reflection training tasks\([Han et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib12)\)\. Complementary approaches train models to refine images conditioned on explicit reflections\([Zhuo et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib16)\), or aggregate multimodal assessments into rewards for test\-time policy optimization\([Tan et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib13)\)\. However, these approaches do not directly distill corrective conditioning into the original\-prompt generation policy along its own sampling trajectories\. A critique such as “restore the missing object” describes a desired correction, but does not itself specify how the generator should change its intermediate denoising predictions\.

To bridge this gap, we introduceUniEvo\-VL, a novel self\-evolving framework that converts visual critique into supervision via*on\-policy self\-distillation*\(OPSD\)\([Li et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib14)\)\. Our mechanism is founded on a widely accepted hypothesis:*verification \- examining a solution or an answer \- is relatively easier than generation*\([Hübotter et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib15);[Zhao et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib9)\)\. Toward this goal, we integrate this self\-feedback into the vanilla question, producing a revised prompt to help the image generator address the detected failure\. Then this new prompt is regarded as privileged information, which only the teacher policy can observe and condition on\. This different context makes it possible to induce dense state\-wise supervision over the student’s sampling trajectories, where the student policy only sees the original prompt\. This allows the model to internalize corrective guidance without using corrected images as training targets or scalar rewards for policy optimization\.

We instantiate UniEvo\-VL with Qwen\-Image\([Wu and others, 2025](https://arxiv.org/html/2609.38721#bib.bib10)\), one well\-known open\-source flow\-based MMM family, on compositional image generation and visual text rendering tasks\. The results show that corrective guidance can translate into improved generation from the original prompt alone: direct\-generation performance increases from 0\.747 to 0\.808 on GenEval\([Ghosh et al\., 2023](https://arxiv.org/html/2609.38721#bib.bib1)\)and from 32\.97 to 35\.53 on GenEval2GenEval2\([Kamath et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib4)\)Soft\-TIFA in the corresponding configurations\. A paired GenEval evaluation further shows that the evolved generator continues to benefit from an additional reflection pass, suggesting that internalizing corrective experience and using feedback at inference time can be complementary\. Together, these findings demonstrate the potential of critique\-conditioned self\-distillation to retain compositional improvements\.

Our contributions are threefold:

- •Critique\-conditioned on\-policy self\-distillation\.We introduce UniEvo\-VL, which uses critique\-derived corrective conditioning to construct teacher predictions along the student’s own sampling trajectories\. The student learns from the original prompt alone, without corrected\-image targets or reward\-based policy optimization\.
- •Separating learned improvements from inference\-time correction\.We compare direct and reflection\-assisted generation before and after training, distinguishing gains retained in the initial model from the additional benefit of reflection through paired evaluation\.
- •Empirical validation and analysis\.We demonstrate improved compositional generation on GenEval and GenEval2, and investigate how critic choice and post\-revision verification affect learning across compositional generation and text rendering\.

![Refer to caption](https://arxiv.org/html/2609.38721v1/unievo_method_yining_v6_symbols.png)Figure 2:The UniEvo\-VL training loop\.A generated draft is inspected along semantic, text, and visual\-quality axes\. The resulting feedback is synthesized into a revised prompt, which acts as the privileged condition for the EMA teacher\. Transition matching updates the student’s generator LoRA; the critic is fixed\. At deployment, the evolved model uses the original prompt directly\.
## 2Method

### 2\.1Self\-Evolution Iteration between Generation and Understanding

##### Preliminary\.

Letℳ𝜽\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}be a multimodal model \(MMM\) with two different modes\. On the one hand, given a user language promptpp, the model can produce an imageIIfrom random noiseϵ∼𝒩⁡\(𝟎,𝑰\)\\boldsymbol\{\\epsilon\}\\sim\\mathcal\{N\}\(\\boldsymbol\{0\},\\boldsymbol\{I\}\)in the generation mode \(M𝜽genM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\)\. On the other hand, it can also assess any imageIIagainst the provided conditioning promptppin the understanding mode \(M𝜽undM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\):

I=ℳ𝜽gen​\(p,ϵ\),\(c,a\)=ℳ𝜽und​\(p,I\)\.I=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(p,\\boldsymbol\{\\epsilon\}\),\\qquad\(c,a\)=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,I\)\.\(1\)Here,ccdenotes the discrepancy between the generated imageIIand its conditioning promptpp\.a∈\{0,1\}a\\in\\\{0,1\\\}is a binary acceptance decision\. For a valid assessment,a=1a=1indicates that the imageIIhighly aligns withppand requires no further revision\. Meanwhile,a=0a=0indicates thatIIis flawed and requires revision\. As a remedy,ccprovides the corresponding corrective feedback\. In contrast, empty or unusable critic responses are treated as invalid assessments and will be removed\.

##### Teacher and student policies\.

The joint capability of image generation and understanding paves the road for our UniEvo\-VL\. It connects these two distinct modesM𝜽genM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}andM𝜽undM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}through*corrective conditioning*\. To achieve this goal, we introduce two roles in the self\-evolution loop by varying the conditioning context\. The student policy, denoted asℳ𝜽\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}, looks at solely the vanilla promptpp, while the reference teacher policy, an EMA version ofℳ𝜽\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}and denoted asℳ𝜽¯\\mathcal\{M\}\_\{\\bar\{\\boldsymbol\{\\theta\}\}\}, is allowed to access the privileged modification suggestioncc\.

To begin with, if an imageIIreceives a valid assessment witha=0a=0indicating additional correction, the understanding\-mode MMMM𝜽undM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}will considerccas the revision suggestion and update the prompt asp′p^\{\\prime\}\. The teacher policyℳ𝜽¯\\mathcal\{M\}\_\{\\bar\{\\boldsymbol\{\\theta\}\}\}uses this privileged promptp~\\widetilde\{p\}to naturally evaluate the student’s generation and provide distillation training targets\. The student policyℳ𝜽\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}learns to approach these targets without access to the privileged conditionp~\\widetilde\{p\}\.

### 2\.2Corrective Conditioning and Experience Acquisition

##### Prompt with privileged information\.

For each imageIIthat receives a valid assessment witha=0a=0, the understanding\-mode MMMM𝜽undM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}synthesizes a privileged promptp~\\widetilde\{p\}by incorporating the vanilla promptppand the corrective feedbackcc:

p~=M𝜽und​\(p,c\)\.\\widetilde\{p\}=M\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,c\)\.\(2\)The revised promptp~\\widetilde\{p\}restates the requested scene while explicitly addressing the discrepancies betweenIIandpp, identified incc\. For example, an initial promptpprequests two red cups, butM𝜽genM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}produces a three\-cup image\. The synthesis process in Equ\.[2](https://arxiv.org/html/2609.38721#S2.E2)is instructed to produce a revised promptp~\\widetilde\{p\}that emphasizes exactly two cups while preserving the specified color and scene context\.

##### Prompt filtering with post\-hoc evaluation\.

After the synthesis ofp~\\widetilde\{p\}by the understanding\-mode MMMM𝜽undM\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}, a naive and straightforward approach is to immediately leverage everyp~\\widetilde\{p\}for subsequent OPSD training\. Taking a step further, we introduce a*post\-revision verification*stage to determine the feasibility and quality of eachp~\\widetilde\{p\}\. Explicitly, we ask the student MMM to generate a new image asI′=ℳ𝜽gen​\(p~,ϵ\)I^\{\\prime\}=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\widetilde\{p\},\\boldsymbol\{\\epsilon\}\)based on the revised promptp~\\widetilde\{p\}and the same noiseϵ\\boldsymbol\{\\epsilon\}\. Then, this figureI′I^\{\\prime\}is fed into the understanding\-mode MMM againℳ𝜽und\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}for the second\-round assessment againstpp\. The revised promptp~\\widetilde\{p\}will only be selected as a valid training sample if this second\-round assessment is valid and acceptsI′I^\{\\prime\}\. This extra agreement indicates thatℳ𝜽und\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}judgesI′I^\{\\prime\}to satisfy the original promptppandI′I^\{\\prime\}has a better alignment withppthanII\. Notably, the re\-generatedI′I^\{\\prime\}is used only to determine the acceptance ofp~\\widetilde\{p\}and is not regarded as an objective during the subsequent training procedure\.

### 2\.3On\-Policy Self Distillation

##### On\-policy sampling from the student\.

After collecting several valid revised promptsp~\\widetilde\{p\}, we leverage the popular OPSD mechanism to distill the knowledge hidden inside the privileged information\([Agarwal et al\., 2024](https://arxiv.org/html/2609.38721#bib.bib7);[Zhao et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib9)\)\. To be specific, atkk\-th iteration with a triple item list\(p,p~,ϵ\)\(p,\\widetilde\{p\},\\boldsymbol\{\\epsilon\}\), we run aTT\-length diffusion denoising trajectoryτ=\{s0,…,sT\}\\tau=\\\{s\_\{0\},\.\.\.,s\_\{T\}\\\}using the student MMMℳ𝜽gen\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}based on the vanilla promptppand noiseϵ\\boldsymbol\{\\epsilon\}, wheresj∈ℝds\_\{j\}\\in\\mathbb\{R\}^\{d\}denotes the intermediate state in the latent representation space at thejj\-th step in that trajectory\.

Consequently, the student policyℳ𝜽gen\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}only observes the prompt statementpp, matching the inference\-time condition\. Instead, the teacher policy MMMℳ𝜽¯\\mathcal\{M\}\_\{\\bar\{\\boldsymbol\{\\theta\}\}\}conditions on privileged promptp′p^\{\\prime\}, which incorporates the modification suggestionccto prevent models from making the same mistakes again\.

##### Training objective\.

We instantiate a*transition divergence objective*that matches the teacher and student denoising distributions at each statesjs\_\{j\}\. Letℳ𝜽gen​\(si,p\):ℝd×𝒫→ℝd\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(s\_\{i\},p\):\\mathbb\{R\}^\{d\}\\times\\mathcal\{P\}\\rightarrow\\mathbb\{R\}^\{d\}parameterize the velocity field for either flow\-based image generation or the denoising score function for diffusion\-based algorithms\.

We force the student one\-step transitionℳ𝜽gen​\(sj,p\)\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(s\_\{j\},p\)to match the teacher policy’s transition targetℳ𝜽¯gen​\(sj,p~\)\\mathcal\{M\}\_\{\\bar\{\\boldsymbol\{\\theta\}\}\}^\{\\mathrm\{gen\}\}\(s\_\{j\},\\widetilde\{p\}\)\. The divergence metric elegantly simplifies into a scaled discrepancy strictly between them\([Fang et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib8);[Li et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib14)\), written as:

ℒ⁡\(𝜽\)=𝔼OPEN\(p,p~,ϵ\)∼𝒜k,τ∼ℳ𝜽gen​\(p,ϵ\)\),sj∼τ​D​\(ℳ𝜽gen​\(sg⁡\[sj\],p\),sg⁡\[ℳ𝜽¯gen​\(sg⁡\[sj\],p~\)\]\),\\mathcal\{L\}\(\\boldsymbol\{\\theta\}\)=\\mathbb\{E\}\_\{\(p,\\widetilde\{p\},\\boldsymbol\{\\epsilon\}\)\\sim\\mathcal\{A\}\_\{k\},\\tau\\sim\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(p,\\boldsymbol\{\\epsilon\}\)\),s\_\{j\}\\sim\\mathcal\{\\tau\}\}D\\\!\\left\(\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\operatorname\{sg\}\[s\_\{j\}\],p\),\\operatorname\{sg\}\\\!\\left\[\\mathcal\{M\}\_\{\\bar\{\\boldsymbol\{\\theta\}\}\}^\{\\mathrm\{gen\}\}\(\\operatorname\{sg\}\[s\_\{j\}\],\\widetilde\{p\}\)\\right\]\\right\),\(3\)Here,𝒜k\\mathcal\{A\}\_\{k\}denotes the finalized training set, andD⁡\(⋅,⋅\)D\(\\cdot,\\cdot\)measures the discrepancy between the student and teacher local predictions, such as KL\-divergence or Jensen\-Shannon \(JS\) divergence\.sg⁡\(⋅\)\\operatorname\{sg\}\(\\cdot\)stands for stop\-gradient backpropagation\. Generation, assessment, and synthesis operate without gradients, so gradients only flow to the student policy parameters𝜽\\boldsymbol\{\\theta\}while the teacherℳ𝜽¯gen\\mathcal\{M\}\_\{\\bar\{\\boldsymbol\{\\theta\}\}\}^\{\\mathrm\{gen\}\}acts as a fixed full\-distribution target\. Our flow\-based implementation uses squared distance \(i\.e\., mean squared error\) between deterministic latent transitions\.

1:Input:model

ℳθ\\mathcal\{M\}\_\{\\theta\}, prompts

𝒫\\mathcal\{P\}, verification

ν\\nu, update rule

ℛ\\mathcal\{R\}
2:

θ¯←θ\\bar\{\\theta\}\\leftarrow\\theta
3:for

k=0,1,…k=0,1,\\ldotsdo

4:

𝒜k←∅\\mathcal\{A\}\_\{k\}\\leftarrow\\varnothing
5:Corrective experience acquisition

6:for

p∈𝒫p\\in\\mathcal\{P\}do

7:

ϵ∼𝒩⁡\(0,I\)\\epsilon\\sim\\mathcal\{N\}\(0,I\)
8:

I←ℳθgen​\(p,ϵ\)I\\leftarrow\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{gen\}\}\(p,\\epsilon\)
9:

\(c,a\)←ℳθund​\(p,I\)\(c,a\)\\leftarrow\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{und\}\}\(p,I\)
10:if

ccvalid and

a=0a=0then

11:

p~←ℳθund​\(p,c\)\\tilde\{p\}\\leftarrow\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{und\}\}\(p,c\)
12:if

ν=1\\nu=1then

13:

I′←ℳθgen​\(p~,ϵ\)I^\{\\prime\}\\leftarrow\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{gen\}\}\(\\tilde\{p\},\\epsilon\)
14:

\(c′,a′\)←ℳθund​\(p,I′\)\(c^\{\\prime\},a^\{\\prime\}\)\\leftarrow\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{und\}\}\(p,I^\{\\prime\}\)
15:if

c′c^\{\\prime\}valid and

a′=1a^\{\\prime\}=1then

16:

𝒜k←𝒜k∪\{\(p,p~,ϵ\)\}\\mathcal\{A\}\_\{k\}\\leftarrow\\mathcal\{A\}\_\{k\}\\cup\\\{\(p,\\tilde\{p\},\\epsilon\)\\\}
17:endif

18:else

19:

𝒜k←𝒜k∪\{\(p,p~,ϵ\)\}\\mathcal\{A\}\_\{k\}\\leftarrow\\mathcal\{A\}\_\{k\}\\cup\\\{\(p,\\tilde\{p\},\\epsilon\)\\\}
20:endif

21:endif

22:endfor

23:On\-policy self\-distillation

24:for

\(p,p~,ϵ\)∈𝒜k\(p,\\tilde\{p\},\\epsilon\)\\in\\mathcal\{A\}\_\{k\}do

25:

τ←sg⁡\[ℳθgen​\(p,ϵ\)\]\\tau\\leftarrow\\operatorname\{sg\}\[\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{gen\}\}\(p,\\epsilon\)\]
26:forminibatch

B⊂τB\\subset\\taudo

27:

ℓB←1\|B\|​∑j∈BD⁡\(ℳθgen​\(sj,p\),sg⁡\[ℳθ¯gen​\(sj,p~\)\]\)\\ell\_\{B\}\\leftarrow\\frac\{1\}\{\|B\|\}\\sum\_\{j\\in B\}D\\\!\\left\(\\mathcal\{M\}\_\{\\theta\}^\{\\mathrm\{gen\}\}\(s\_\{j\},p\),\\operatorname\{sg\}\[\\mathcal\{M\}\_\{\\bar\{\\theta\}\}^\{\\mathrm\{gen\}\}\(s\_\{j\},\\tilde\{p\}\)\]\\right\)
28:

θ←θ−η​∇θℓB\\theta\\leftarrow\\theta\-\\eta\\nabla\_\{\\theta\}\\ell\_\{B\}
29:

θ¯←ℛ⁡\(θ¯,θ\)\\bar\{\\theta\}\\leftarrow\\mathcal\{R\}\(\\bar\{\\theta\},\\theta\)
30:endfor

31:endfor

32:endfor

33:return

ℳθ\\mathcal\{M\}\_\{\\theta\}

Algorithm 1UniEvo\-VL\.Critique\-conditioned on\-policy self\-distillation\.
##### Discussion\.

On\-policy sampling places supervision at statessj∈τs\_\{j\}\\in\\tauvisited by the current student\. The privileged promptp~\\widetilde\{p\}provides the teacher policy with corrective information, which in turn guides the student toward denoising paths that lead to the correct answer\. Equ\.[3](https://arxiv.org/html/2609.38721#S2.E3)thereby transfers this privileged correction into the student parameters𝜽\\boldsymbol\{\\theta\}, enabling direct inference using the original promptppwithout requiring any sort of revision or reflectioncc\.

Alg\.[2\.3](https://arxiv.org/html/2609.38721#S2.SS3.SSS0.Px2)summarizes the procedure\. The student MMMℳ𝜽gen\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}carries its updated parameters forward to subsequent requests, allowing corrective experience to accumulate across the request stream during test time\. The teacher’s parameters𝜽¯\\bar\{\\boldsymbol\{\\theta\}\}are held fixed for each minibatch iteration and refreshed according to a reference update ruleℛ\\mathcal\{R\}\. The update ruleℛ\\mathcal\{R\}and trajectory\-step selection principles are specified in Appendix[A](https://arxiv.org/html/2609.38721#A1)\.

## 3Experiments

### 3\.1Experimental Setup

##### Tasks and implementation\.

Qwen\-Image family incorporates Qwen\-VL farmily as conditioning encoders\. We therefore selected Qwen\-Image\-2512\([Wu and others, 2025](https://arxiv.org/html/2609.38721#bib.bib10)\)and a fixed Qwen\-VL\([Bai et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib6)\)feedback pipeline to examine an architecturally motivated generation–understanding setting\. During training, only generator LoRA\([Hu et al\., 2021](https://arxiv.org/html/2609.38721#bib.bib5)\)parameters are updated, separately for GenEval\([Ghosh et al\., 2023](https://arxiv.org/html/2609.38721#bib.bib1)\), GenEval2\([Kamath et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib4)\), and OCR text rendering\. We evaluate prompt filtering with and without post\-revision verification\. Section[3\.4\.2](https://arxiv.org/html/2609.38721#S3.SS4.SSS2)further investigates whether stronger external critique can yield greater improvements using GPT\-5\.6\-Luna\. Appendices[A](https://arxiv.org/html/2609.38721#A1), and[C](https://arxiv.org/html/2609.38721#A3)provide implementation and dataset details\. Training compute and acquisition overhead are discussed in Appendix[A\.4](https://arxiv.org/html/2609.38721#A1.SS4)\.

##### Evaluation\.

We report direct generation and inference with one critique opportunity separately, assessing outputs against the original prompts and pairing prompts and seeds within each experiment\. Metrics comprise native GenEval and OCR scores \(0–1\), GenEval2 Soft\-TIFA GM \(0–100\), Gemini atomic accuracy \(%\) for compositional tasks, and holistic Gemini task and HumanPref scores \(0–10\)\. HumanPref is an automated visual\-quality proxy\. Evaluation scores provide no training reward\. Appendix[D](https://arxiv.org/html/2609.38721#A4)specifies evaluation cohorts, metric definitions, and failure handling; checkpoint coverage is provided in the Supplementary Data\.

Figure 3:UniEvo\-VL with revision verification across training updates\.Solid curves show direct generation; dashed curves allow one inference\-time critique\. Lines connect evaluated checkpoints across runs;nncounts plotted points\.

### 3\.2Unified Direct\-Generation Results

Table 1:Performance of UniEvo\-VL\.Parentheses identify the critic; “\+ verification” denotes revision\-prompt filtering\. Base is averaged over different random seeds of the identical pretrained model\.Boldandunderlinedvalues indicate the best and second\-best for each dataset and metric\.Table[1](https://arxiv.org/html/2609.38721#S3.T1)compares image generation performance after OPSD\. The Qwen configuration with revision verification exceeds the reported Base on every listed metric across all three tasks, although different configurations lead on individual metrics\.

##### Compositional generation\.

On GenEval, both Qwen configurations score above Base on semantic correctness and automated visual quality\. The external\-critic experiment with GPT\-5\.6\-Luna achieves the highest native score, 0\.882, as well as the highest atomic accuracy and HumanPref rating\. Among the Qwen configurations, verified Qwen scores higher on native score and atomic accuracy, whereas unverified Qwen receives a higher HumanPref rating\. GenEval2 shows a broadly similar pattern: the external\-critic experiment with GPT\-5\.6\-Luna again achieves the highest native score, 35\.53, and atomic accuracy, while verified Qwen achieves the highest HumanPref rating\. Unverified Qwen scores above Base on atomic accuracy and HumanPref but slightly below it on native Soft\-TIFA\. Thus, the evaluations distinguish improvements in individual semantic checks, benchmark\-level correctness, and visual quality

##### Text rendering\.

The verified Qwen configuration also leads on OCR, reaching a native score of 0\.790 and the highest HumanPref rating\. The other configurations show mixed outcomes: unverified Qwen falls below Base on both measures, while Luna scores slightly higher on native text fidelity but lower on HumanPref\. The favorable OCR result therefore does not extend to every feedback configuration\.

### 3\.3Improvement and Preservation Across Prompt Difficulty

We examine where training improves generation and how it affects initially successful outputs\. Using historical 500\-prompt subsets for each task, we define Hard and Easy groups by baseline holistic task scores of 0–4 and 5–10, respectively\. Group membership remains fixed after training; evaluation details are provided in Appendix[D\.5](https://arxiv.org/html/2609.38721#A4.SS5)\.

Figure 4:Improvement and preservation on historical 500\-prompt subsets, where scale is normalized to 0–100\. The percentage\-point changes are subset\-specific, not full\-test\-set gains\.Figure[4](https://arxiv.org/html/2609.38721#S3.F4)shows that gains concentrate on prompts the base model initially struggles with across all three tasks\. Average performance on Easy prompts remains high, but decreases by 1–4 points on the normalized 0–100 scale\. Training therefore combines substantial recovery on initially low\-scoring prompts with small regressions on higher\-scoring ones\.

This concentration of gains is partly expected from our acquisition mechanism\. Drafts judged satisfactory by the critic are skipped, while valid corrective pairs from drafts requiring revision supply the training signal\. The resulting selection emphasizes current generation failures, creating more opportunities to learn corrective behavior than to reinforce already satisfactory outputs\. The observed difficulty pattern is consistent with this mechanism, although the evaluation groups are defined by baseline task scores rather than acquisition decisions\. Their different improvement headroom also prevents attributing the contrast to filtering alone\.

### 3\.4Understanding Self\-Evolution

#### 3\.4\.1Does Training Transfer the Benefit of Reflection?

Table[2](https://arxiv.org/html/2609.38721#S3.T2)compares the base model and UniEvo\-VL with direct generation or one reflection opportunity\. The evaluated UniEvo\-VL checkpoints use post\-revision verification during training; all outputs are scored against the original request\.

Table 2:Direct generation and reflection before and after training\.\(a\) Generation scores, where bold marks the highest score in each row\. \(b\) Training gain is the UniEvo\-VL score minus the base score under direct generation, while reflection gain is reflected minus direct within each model\. Gains use unrounded scores\. Native scores use 0–1 for GenEval/OCR and 0–100 for GenEval2\. Atomic uses percent \(gains in percentage points\), and HumanPref uses 0–10\.
##### OPSD improves inference\-time direct generation\.

Table[2](https://arxiv.org/html/2609.38721#S3.T2)shows that training improves direct generation on every reported metric across all three benchmarks\. On native scores, direct generation with UniEvo\-VL approaches the reflected base model on GenEval and exceeds it on OCR, while remaining below it on GenEval2\. Training therefore makes improvements available from the original prompt alone, although it does not consistently recover the performance achieved by applying reflection to the base model\.

##### Reflection remains useful after training\.

Reflection further improves the evolved model on every reported metric\. On GenEval, its native gain decreases from0\.0780\.078to0\.0300\.030, with similar reductions in atomic accuracy and HumanPref gains\. This pattern is consistent with partly overlapping benefits from training and reflection\. By contrast, reflection gains remain substantial on GenEval2 and change little on OCR\. Improved direct generation therefore need not be accompanied by a smaller reflection gap: training can improve the generator while leaving considerable benefit from additional feedback\.

##### Capability emerges beyond inference\-time reflection\.

Importantly, the retained training benefit cannot be explained solely by applying prompt revision at inference time\. Under the same one\-reflection protocol, UniEvo\-VL improves the native score over the reflected base model from0\.8260\.826to0\.8480\.848on GenEval, from42\.5242\.52to46\.2346\.23on GenEval2, and from0\.7830\.783to0\.8030\.803on OCR\. Thus, corrective training provides improvements that persist even when both models are given an additional opportunity for reflection, indicating acquired capability beyond inference\-only prompt revision\. The combined setting achieves the highest native scores on all three benchmarks, although GenEval HumanPref remains slightly higher for the reflected base model\.

#### 3\.4\.2How Does Critic Capacity Affect Self\-Evolution?

We examine how feedback choice affects compositional generation on GenEval and GenEval2, using acquisition without post\-revision verification and generation only at evaluation\. Table[3](https://arxiv.org/html/2609.38721#S3.T3)reports category scores and, where matched baselines are available, the gains retained after self\-evolution\.

Table 3:Compositional generation under different critics\.All entries are Gemini compositional\-fidelity ratings \(0–10\)\. \(a\) GenEval uses 553 prompts; Base denotes the Qwen\-VL experiment’s baseline\. \(b\) GenEval2 uses 800 prompts;Δ\\Deltais Evolved minus Base\. Bold indicates the highest score in each column of \(a\), and the higher Evolved score and largerΔ\\Deltawithin each row of \(b\), including ties\.\(a\) GenEval

\(b\) GenEval2

##### GenEval differences are largest in spatial composition\.

Qwen feedback improves position scores from 6\.85 to 8\.79 and counting from 7\.86 to 9\.29\. The historical Luna result reaches 9\.88 and 9\.58, respectively, with position showing the largest gap between evolved configurations\. Several other categories are already near saturation\.

##### GenEval2 reveals category\-dependent learning gains\.

Luna yields larger gains in two\-object composition and color: approximately\+1\.21\+1\.21and\+1\.02\+1\.02, versus\+0\.28\+0\.28and\+0\.37\+0\.37for Qwen\. For two objects, Luna starts lower \(7\.00 versus 7\.62\) but finishes higher \(8\.21 versus 7\.90\)\. Position and attribute scores improve only modestly under either configuration\. Native Soft\-TIFA GM \(0–100\) corroborates the overall pattern, increasing from 32\.97 to 35\.53 with Luna, versus 32\.86 to 32\.37 with Qwen\. The observed benefit of external feedback is skill\-dependent\. Luna achieves a higher overall GenEval endpoint and larger two\-object and color gains on GenEval2, while GenEval2 position and attribute scores show limited gains\. Category\-level analysis is therefore essential for identifying the capabilities a vision language model need to possess for steady improvement through self\-evolution\.

## 4Related Work

##### Understanding and reflection for image generation\.

Visual understanding helps models assess and improve their generated images\.[Han et al\. \(2025\)](https://arxiv.org/html/2609.38721#bib.bib11)use the understanding branch to score images and construct supervised fine\-tuning and preference data\. SRUM\([Jin et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib23)\)combines image\-level and object\-level self\-rewards for reward\-weighted training, while UniCorn\([Han et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib12)\)assigns proposer, solver, and judge roles to a unified model to generate training interactions\. ReflectionFlow\([Zhuo et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib16)\)learns from flawed\-image, reflection, and improved\-image triplets for iterative inference\-time refinement\. UniReason\([Wang et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib21)\)combines world\-knowledge reasoning before generation with visual refinement afterward through two\-stage supervised fine\-tuning on curated examples\. UniEvo\-VL transfers corrective feedback into direct generation from the original request and measures the additional benefit of reflection after training\.

##### Feedback\-driven optimization\.

Meta\-TTRL\([Tan et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib13)\)aggregates model\-generated rubric assessments into rewards for test\-time policy optimization\. Flow\-GRPO\([Liu et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib18)\)and DiffusionNFT\([Zheng et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib19)\)improve diffusion or flow generators through reward\-based updates\. DiffusionOPSD\([Zhou et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib20)\)converts image\-level reward gradients into detached clean\-output targets\. UniEvo\-VL also incorporates feedback into model parameters, but derives targets from teacher predictions conditioned on corrective text, requiring neither gradients through the critic nor a differentiable image reward\.

##### On\-policy distillation with privileged conditioning\.

OPD\([Agarwal et al\., 2024](https://arxiv.org/html/2609.38721#bib.bib7)\)trains a student on its own trajectories using teacher predictions\. SDPO\([Hübotter et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib15)\)distills feedback\-conditioned next\-token predictions into a language policy\. For diffusion models, DiffusionOPD\([Li et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib14)\)matches teacher–student transitions on student trajectories to consolidate independently trained, task\-specific teachers\. D\-OPSD\([Jiang et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib22)\)conditions a diffusion self\-teacher on the target image and text for supervised learning on student rollouts while preserving few\-step generation\. Dreaming in Flow\([Hao et al\., 2026](https://arxiv.org/html/2609.38721#bib.bib17)\)combines image\-grounded and repair\-enhanced flow targets with dream replay to jointly improve understanding and generation\. UniEvo\-VL derives privileged conditioning from critiques of its own generated images: the teacher receives a revised prompt, while the student receives the original request\. Their denoising predictions are matched along student trajectories without paired target images or an independently task\-trained generator teacher\. Only the generator is updated, with a fixed critic, to improve subsequent direct generation\.

## 5Conclusion

We introduced UniEvo\-VL, an approach to multimodal self\-evolution that uses on\-policy self\-distillation to turn the corrective content of visual critique into supervision for generation\. Paired evaluations on GenEval, GenEval2, and OCR show that training improves native scores both with and without reflection, with the combination of training and reflection performing best on these metrics\. Gains vary across training configurations, and regressions on initially easier prompts reveal limits to preservation\. These findings suggest a route to self\-evolution in which feedback\-guided generation supplies supervision and improves alongside the model’s unassisted capability\.

### AI use statement

We used generative AI tools to assist with manuscript drafting and editing, literature search and organization, and code and figure preparation\. The authors reviewed and revised AI\-assisted material and checked adopted code and factual claims before inclusion\. Language and multimodal models also serve as critics, prompt\-synthesis models, and automated evaluators in our experiments\. These experimental uses, including the model configurations, prompts, and evaluation procedures, are documented in the main text and appendices\. The authors take full responsibility for the final manuscript, implementation, reported results, and scientific conclusions\.

## Reproducibility Statement

The training objective and algorithm are described in Section 2 and Appendix A\. Appendix A also specifies the model configurations, training hyperparameters, sampling settings, random seeds, and computational requirements\. Dataset sources and construction are described in Appendix C, while Appendix D documents the evaluation cohorts, inference settings, metric definitions, and handling of failed evaluation requests\. Appendix G provides the critic and prompt\-synthesis templates used in the Qwen configuration with revision verification\.

## References

- Achiamet al\.\(2023\)J\. Achiam, S\. Adler, S\. Agarwal, L\. Ahmad, I\. Akkaya, F\. L\. Aleman, D\. Almeida, J\. Altenschmidt, S\. Altman, S\. Anadkat,et al\.Gpt\-4 technical report\.arXiv preprint arXiv:2303\.08774\.Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p1.1)\.
- Agarwalet al\.\(2024\)R\. Agarwal, N\. Vieillard, Y\. Zhou, P\. Stanczyk, S\. Ramos Garea, M\. Geist, and O\. BachemOn\-policy distillation of language models: learning from self\-generated mistakes\.InInternational Conference on Learning Representations,Vol\.2024,pp\. 21246–21263\.Cited by:[§2\.3](https://arxiv.org/html/2609.38721#S2.SS3.SSS0.Px1.p1.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px3.p1.1)\.
- Baiet al\.\(2025\)S\. Bai, Y\. Cai, R\. Chen, K\. Chen, X\. Chen, Z\. Cheng, L\. Deng, W\. Ding, C\. Gao, C\. Ge,et al\.Qwen3\-vl technical report\.arXiv preprint arXiv:2511\.21631\.Cited by:[§3\.1](https://arxiv.org/html/2609.38721#S3.SS1.SSS0.Px1.p1.1)\.
- Fanget al\.\(2026\)Z\. Fang, W\. Huang, Y\. Zeng, Y\. Zhao, S\. Chen, K\. Feng, Y\. Lin, L\. Chen, Z\. Chen, S\. Cao,et al\.Flow\-opd: on\-policy distillation for flow matching models\.arXiv preprint arXiv:2605\.08063\.Cited by:[§2\.3](https://arxiv.org/html/2609.38721#S2.SS3.SSS0.Px2.p2.1)\.
- Ghoshet al\.\(2023\)D\. Ghosh, H\. Hajishirzi, and L\. SchmidtGenEval: An Object\-Focused Framework for Evaluating Text\-to\-Image Alignment\.arXiv preprint arXiv:2310\.11513\.External Links:[Link](https://arxiv.org/abs/2310.11513)Cited by:[Appendix C](https://arxiv.org/html/2609.38721#A3.SS0.SSS0.Px1.p1.1),[§D\.2](https://arxiv.org/html/2609.38721#A4.SS2.SSS0.Px1.p1.1),[§1](https://arxiv.org/html/2609.38721#S1.p3.1),[§3\.1](https://arxiv.org/html/2609.38721#S3.SS1.SSS0.Px1.p1.1)\.
- Hanet al\.\(2026\)R\. Han, Z\. Fang, X\. Sun, Y\. Ma, Z\. Wang, Y\. Zeng, Z\. Chen, L\. Chen, W\. Huang, W\. Xu, Y\. Cao, and F\. ZhaoUniCorn: Towards Self\-Improving Unified Multimodal Models through Self\-Generated Supervision\.arXiv preprint arXiv:2601\.03193\.External Links:[Link](https://arxiv.org/abs/2601.03193)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p1.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px1.p1.1)\.
- Hanet al\.\(2025\)Y\. Han, H\. Chen, A\. Han, Z\. Wang, X\. Liu, Y\. Zhang, S\. Zhang, and D\. ZouTurning Internal Gap into Self\-Improvement: Promoting the Generation\-Understanding Unification in MLLMs\.arXiv preprint arXiv:2507\.16663\.External Links:[Link](https://arxiv.org/abs/2507.16663)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p1.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px1.p1.1)\.
- Haoet al\.\(2026\)K\. Hao, Y\. Liang, T\. Chen, R\. Li, H\. Huang, C\. Zhang, Y\. Gu, and X\. LiDreaming in Flow: Generative Grounding Feedback for Self\-Evolving Unified Multimodal Models\.arXiv preprint arXiv:2609\.08282\.External Links:[Link](https://arxiv.org/abs/2609.08282)Cited by:[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px3.p1.1)\.
- Huet al\.\(2021\)E\. J\. Hu, Y\. Shen, P\. Wallis, Z\. Allen\-Zhu, Y\. Li, S\. Wang, L\. Wang, and W\. ChenLora: low\-rank adaptation of large language models\.arXiv preprint arXiv:2106\.09685\.Cited by:[§3\.1](https://arxiv.org/html/2609.38721#S3.SS1.SSS0.Px1.p1.1)\.
- Hübotteret al\.\(2026\)J\. Hübotter, F\. Lübeck, L\. Behric, A\. Baumann, M\. Bagatella, D\. Marta, I\. Hakimi, I\. Shenfeld, T\. K\. Buening, C\. Guestrin, and A\. KrauseReinforcement Learning via Self\-Distillation\.arXiv preprint arXiv:2601\.20802\.External Links:[Link](https://arxiv.org/abs/2601.20802)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p2.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px3.p1.1)\.
- Jianget al\.\(2026\)D\. Jiang, X\. Jin, D\. Liu, Z\. Wang, M\. Zheng, R\. Du, X\. Yang, Q\. Wu, Z\. Li, P\. Gao, H\. Yang, and S\. HoiD\-OPSD: On\-Policy Self\-Distillation for Continuously Tuning Step\-Distilled Diffusion Models\.arXiv preprint arXiv:2605\.05204\.External Links:[Link](https://arxiv.org/abs/2605.05204)Cited by:[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px3.p1.1)\.
- Jinet al\.\(2025\)W\. Jin, Y\. Niu, J\. Liao, C\. Duan, A\. Li, S\. Gao, and X\. LiuSRUM: Fine\-Grained Self\-Rewarding for Unified Multimodal Models\.arXiv preprint arXiv:2510\.12784\.External Links:[Link](https://arxiv.org/abs/2510.12784)Cited by:[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px1.p1.1)\.
- Kamathet al\.\(2025\)A\. Kamath, K\. Chang, R\. Krishna, L\. Zettlemoyer, Y\. Hu, and M\. GhazvininejadGenEval 2: Addressing Benchmark Drift in Text\-to\-Image Evaluation\.arXiv preprint arXiv:2512\.16853\.External Links:[Link](https://arxiv.org/abs/2512.16853)Cited by:[Appendix C](https://arxiv.org/html/2609.38721#A3.SS0.SSS0.Px2.p1.1),[§D\.2](https://arxiv.org/html/2609.38721#A4.SS2.SSS0.Px2.p1.1),[§D\.2](https://arxiv.org/html/2609.38721#A4.SS2.SSS0.Px4.p1.1),[§D\.7](https://arxiv.org/html/2609.38721#A4.SS7.p1.1),[§1](https://arxiv.org/html/2609.38721#S1.p3.1),[§3\.1](https://arxiv.org/html/2609.38721#S3.SS1.SSS0.Px1.p1.1)\.
- Liet al\.\(2026\)Q\. Li, J\. Yu, K\. Jiang, Y\. Wei, Z\. Xing, P\. Li, R\. Chu, S\. Zhang, Y\. Liu, and Z\. WuDiffusionOPD: A Unified Perspective of On\-Policy Distillation in Diffusion Models\.arXiv preprint arXiv:2605\.15055\.External Links:[Link](https://arxiv.org/abs/2605.15055)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p2.1),[§2\.3](https://arxiv.org/html/2609.38721#S2.SS3.SSS0.Px2.p2.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px3.p1.1)\.
- Liuet al\.\(2025\)J\. Liu, G\. Liu, J\. Liang, Y\. Li, J\. Liu, X\. Wang, P\. Wan, D\. Zhang, and W\. OuyangFlow\-GRPO: Training Flow Matching Models via Online RL\.arXiv preprint arXiv:2505\.05470\.External Links:[Link](https://arxiv.org/abs/2505.05470)Cited by:[Appendix C](https://arxiv.org/html/2609.38721#A3.SS0.SSS0.Px3.p1.1),[§D\.2](https://arxiv.org/html/2609.38721#A4.SS2.SSS0.Px3.p1.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px2.p1.1)\.
- Tanet al\.\(2026\)L\. S\. Tan, J\. Chen, X\. Fu, L\. Ma, J\. Huang, J\. Shi, Y\. Li, and L\. WenMeta\-TTRL: A Metacognitive Framework for Self\-Improving Test\-Time Reinforcement Learning in Unified Multimodal Models\.arXiv preprint arXiv:2603\.15724\.External Links:[Link](https://arxiv.org/abs/2603.15724)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p1.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px2.p1.1)\.
- Teamet al\.\(2023\)G\. Team, R\. Anil, S\. Borgeaud, J\. Alayrac, J\. Yu, R\. Soricut, J\. Schalkwyk, A\. M\. Dai, A\. Hauth, K\. Millican,et al\.Gemini: a family of highly capable multimodal models\.arXiv preprint arXiv:2312\.11805\.Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p1.1)\.
- Wanget al\.\(2026\)D\. Wang, C\. Ma, F\. Han, S\. Wu, W\. Song, Y\. Wang, Z\. Zhang, T\. Wang, S\. Wang, Z\. Wei, and J\. WangUniReason 1\.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing\.arXiv preprint arXiv:2602\.02437\.External Links:[Link](https://arxiv.org/abs/2602.02437)Cited by:[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px1.p1.1)\.
- Wuet al\.\(2025\)C\. Wuet al\.Qwen\-Image Technical Report\.arXiv preprint arXiv:2508\.02324\.External Links:[Link](https://arxiv.org/abs/2508.02324)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p3.1),[§3\.1](https://arxiv.org/html/2609.38721#S3.SS1.SSS0.Px1.p1.1)\.
- Zhaoet al\.\(2026\)S\. Zhao, Z\. Xie, M\. Liu, J\. Huang, G\. Pang, F\. Chen, and A\. GroverSelf\-distilled reasoner: on\-policy self\-distillation for large language models\.arXiv preprint arXiv:2601\.18734\.Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p2.1),[§2\.3](https://arxiv.org/html/2609.38721#S2.SS3.SSS0.Px1.p1.1)\.
- Zhenget al\.\(2025\)K\. Zheng, H\. Chen, H\. Ye, H\. Wang, Q\. Zhang, K\. Jiang, H\. Su, S\. Ermon, J\. Zhu, and M\. LiuDiffusionNFT: Online Diffusion Reinforcement with Forward Process\.arXiv preprint arXiv:2509\.16117\.External Links:[Link](https://arxiv.org/abs/2509.16117)Cited by:[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px2.p1.1)\.
- Zhouet al\.\(2026\)W\. Zhou, X\. Zhu, L\. Kong, B\. Chen, L\. Zhang, Y\. Liang, X\. Hou, Y\. Tian, X\. Sun, Y\. Wang, L\. Li, S\. Wu, L\. Qu, F\. Li, W\. Liu, J\. McAuley, and T\. ChuaOn\-Policy Self\-Distillation in Diffusion Models\.arXiv preprint arXiv:2608\.24646\.External Links:[Link](https://arxiv.org/abs/2608.24646)Cited by:[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px2.p1.1)\.
- Zhuoet al\.\(2025\)L\. Zhuo, L\. Zhao, S\. Paul, Y\. Liao, R\. Zhang, Y\. Xin, P\. Gao, M\. Elhoseiny, and H\. LiFrom Reflection to Perfection: Scaling Inference\-Time Optimization for Text\-to\-Image Diffusion Models via Reflection Tuning\.arXiv preprint arXiv:2504\.16080\.External Links:[Link](https://arxiv.org/abs/2504.16080)Cited by:[§1](https://arxiv.org/html/2609.38721#S1.p1.1),[§4](https://arxiv.org/html/2609.38721#S4.SS0.SSS0.Px1.p1.1)\.

## Appendix AImplementation and Configuration

##### Choice of generation and understanding models

We select Qwen\-Image\-2512 and Qwen\-VL to study critique\-guided improvement in an architecturally motivated generation–understanding setting\. Qwen\-Image\-2512 already incorporates a Qwen2\.5\-VL conditioning encoder, making the Qwen\-VL family a natural choice for investigating how visual understanding can support improvements in image generation\. Our objective is to convert explicit corrective feedback into updates that improve generation from the original prompt, rather than use feedback only for inference\-time revision\. Some experiments without verification ablates using GPT\-5\.6\-Luna feedback\. Training updates only image\-generation LoRA parameters\. The base generation weights, text encoder, VAE, and feedback\-producing components remain fixed\.

### A\.1Flow\-based generation objective

We instantiate the local prediction in Section 2\.3 with a flow velocity\. Letsj∈ℝds\_\{j\}\\in\\mathbb\{R\}^\{d\}be the noisy latent at stepjjof the student trajectory, letσj\\sigma\_\{j\}be its noise level, and writeΔ​σj=σj\+1−σj\\Delta\\sigma\_\{j\}=\\sigma\_\{j\+1\}\-\\sigma\_\{j\}\. The notationℳ𝜽gen​\(p,ϵ\)\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(p,\\epsilon\)denotes complete image generation, whereasℳ𝜽gen​\(sj,p\)\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(s\_\{j\},p\)denotes a local velocity prediction, withσj\\sigma\_\{j\}implicit in the step index\. Specifically, the implementation uses classifier\-free guidance:

v𝜽\(g\)​\(z,σ,p\)\\displaystyle v\_\{\\boldsymbol\{\\theta\}\}^\{\(g\)\}\(z,\\sigma,p\)=v𝜽​\(z,σ,∅\)\+g⁡\[v𝜽​\(z,σ,p\)−v𝜽​\(z,σ,∅\)\],\\displaystyle=v\_\{\\boldsymbol\{\\theta\}\}\(z,\\sigma,\\varnothing\)\+g\\bigl\[v\_\{\\boldsymbol\{\\theta\}\}\(z,\\sigma,p\)\-v\_\{\\boldsymbol\{\\theta\}\}\(z,\\sigma,\\varnothing\)\\bigr\],\(4\)ℳ𝜽gen​\(sj,p\)\\displaystyle\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(s\_\{j\},p\)=v𝜽\(g\)\(sj,σj,p\),g=4,\\displaystyle=v\_\{\\boldsymbol\{\\theta\}\}^\{\(g\)\}\(s\_\{j\},\\sigma\_\{j\},p\),\\qquad g=4,wherev𝜽v\_\{\\boldsymbol\{\\theta\}\}is the unguided velocity predictor and∅\\varnothingdenotes empty text conditioning\. The same guidance rule is used for the student and reference predictions; these training predictions receive no additional norm rescaling\. The predicted next latent is

μθ,j​\(z,p\)=z\+Δ​σj​v𝜽\(g\)​\(z,σj,p\)\.\\mu\_\{\\theta,j\}\(z,p\)=z\+\\Delta\\sigma\_\{j\}\\,v\_\{\\boldsymbol\{\\theta\}\}^\{\(g\)\}\(z,\\sigma\_\{j\},p\)\.\(5\)
For each acquired triple\(p,p~,ϵ\)∈𝒜k\(p,\\widetilde\{p\},\\epsilon\)\\in\\mathcal\{A\}\_\{k\}, we collect the detached trajectoryτ=sg⁡\[Rollout𝜽⁡\(p,ϵ\)\]\\tau=\\operatorname\{sg\}\[\\operatorname\{Rollout\}\_\{\\boldsymbol\{\\theta\}\}\(p,\\epsilon\)\]under the original prompt\. Student and reference predictions use the same detached latent and noise level, with conditioningppandp~\\widetilde\{p\}, respectively\. The per\-transition loss is

ℓjflow​\(𝜽\)\\displaystyle\\ell\_\{j\}^\{\\mathrm\{flow\}\}\(\\boldsymbol\{\\theta\}\)=12​d​‖μθ,j​\(sg⁡\[sj\],p\)−sg⁡\[μθ¯,j​\(sg⁡\[sj\],p~\)\]‖22\\displaystyle=\\frac\{1\}\{2d\}\\left\\\|\\mu\_\{\\theta,j\}\(\\operatorname\{sg\}\[s\_\{j\}\],p\)\-\\operatorname\{sg\}\\\!\\left\[\\mu\_\{\\bar\{\\theta\},j\}\(\\operatorname\{sg\}\[s\_\{j\}\],\\widetilde\{p\}\)\\right\]\\right\\\|\_\{2\}^\{2\}\(6\)=\(Δ​σj\)22​d​‖ℳ𝜽gen​\(sg⁡\[sj\],p\)−sg⁡\[ℳθ¯gen​\(sg⁡\[sj\],p~\)\]‖22\.\\displaystyle=\\frac\{\(\\Delta\\sigma\_\{j\}\)^\{2\}\}\{2d\}\\left\\\|\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\operatorname\{sg\}\[s\_\{j\}\],p\)\-\\operatorname\{sg\}\\\!\\left\[\\mathcal\{M\}\_\{\\bar\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\operatorname\{sg\}\[s\_\{j\}\],\\widetilde\{p\}\)\\right\]\\right\\\|\_\{2\}^\{2\}\.The second equality follows because the shared latent cancels\. Thus, the flow instantiation of the main\-method discrepancy is𝒟j​\(u,w\)=\(Δ​σj\)2​‖u−w‖22/\(2​d\)\\mathcal\{D\}\_\{j\}\(u,w\)=\(\\Delta\\sigma\_\{j\}\)^\{2\}\\\|u\-w\\\|\_\{2\}^\{2\}/\(2d\)\. This is deterministic transition matching, equivalently velocity matching weighted by the squared sampler interval; it is not an exact stochastic\-policy KL or JS divergence\.

Let𝒥⊆\{0,…,T−1\}\\mathcal\{J\}\\subseteq\\\{0,\\ldots,T\-1\\\}denote the selected transition indices\. The objective is

ℒflow​\(𝜽\)=𝔼\(p,p~,ϵ\)∼𝒜k​\[1\|𝒥\|​∑j∈𝒥ℓjflow​\(𝜽\)\]\.\\mathcal\{L\}\_\{\\mathrm\{flow\}\}\(\\boldsymbol\{\\theta\}\)=\\mathbb\{E\}\_\{\(p,\\widetilde\{p\},\\epsilon\)\\sim\\mathcal\{A\}\_\{k\}\}\\left\[\\frac\{1\}\{\|\\mathcal\{J\}\|\}\\sum\_\{j\\in\\mathcal\{J\}\}\\ell\_\{j\}^\{\\mathrm\{flow\}\}\(\\boldsymbol\{\\theta\}\)\\right\]\.\(7\)For the reported 20\-step, noisy\-fraction\-0\.30\.3recipe,𝒥=\{0,…,5\}\\mathcal\{J\}=\\\{0,\\ldots,5\\\}selects the six highest\-noise transitions of the configured scheduler grid\. Gradients pass only through the student’s local predictions\. Draft generation, rollout collection, assessment, synthesis, and reference targets are detached\. Gradients are accumulated over the selected transitions and configured example batches; the EMA reference is updated after actual optimizer steps, as described in Appendix A\.2\. Draft generation and the corresponding training rollout reuse the acquired seed\. The regenerated imageI′I^\{\\prime\}is used only for verification in the verified OPSD variant and is not a training target for this loss\.

The general framework requires architecture\-compatible local predictions\. An autoregressive extension would need a separately defined loss on next\-token distributions at a shared prefix and vocabulary; our experiments validate only the flow instantiation above\.

### A\.2Acquisition and reference parameters

An initially accepted draft supplies no corrective pair and is skipped\. For a draft that receives valid corrective feedback, the synthesis module constructs a revised promptp~\\widetilde\{p\}from the original promptppand the critique\. Acquisition without post\-revision verification admits the resulting triple\(p,p~,ϵ\)\(p,\\widetilde\{p\},\\epsilon\)directly\.

Acquisition with post\-revision verification permits one revision\. We regenerate

I′=ℳθgen​\(p~,ϵ\)I^\{\\prime\}=\\mathcal\{M\}^\{\\mathrm\{gen\}\}\_\{\\theta\}\(\\widetilde\{p\},\\epsilon\)using the same generation seed as the initial draft, and assessI′I^\{\\prime\}against the*original*promptpp\. The triple\(p,p~,ϵ\)\(p,\\widetilde\{p\},\\epsilon\)is admitted for distillation only when this second assessment is valid and acceptsI′I^\{\\prime\}underpp\. Malformed feedback, invalid revisions, and revisions whose regenerated images remain unaccepted under the original request are discarded\.

The regenerated imageI′I^\{\\prime\}is used only for acquisition filtering and never serves as a distillation target\. During OPSD,p~\\widetilde\{p\}instead provides the privileged condition to the reference generator, while the student remains conditioned on the original promptpp\.

The reference generation adapter is updated after optimizer steps using EMA asθ¯←β​θ¯\+\(1−β\)​θ,\\bar\{\\theta\}\\leftarrow\\beta\\bar\{\\theta\}\+\(1\-\\beta\)\\theta,withβ=0\.999\\beta=0\.999in the main experiments\. The base generator weights remain shared and fixed, and all reference predictions are computed without gradients\. Appendix[A\.5](https://arxiv.org/html/2609.38721#A1.SS5)reports the EMA\-decay sweep\.

### A\.3Two Training Recipes

Tables[4](https://arxiv.org/html/2609.38721#A1.T4)and[5](https://arxiv.org/html/2609.38721#A1.T5)specify the training recipes without and with post\-revision verification, respectively\. The recipes differ in feedback backend, acquisition seeds, learning rate, and gradient accumulation\. Table[4](https://arxiv.org/html/2609.38721#A1.T4)includes the unverified Qwen counterparts on GenEval2 and OCR alongside the Luna configurations\. The GenEval configuration shown is the recorded recipe; checkpoint metadata do not independently encode the full launch configuration\.

Table 4:Training configuration for acquisition without post\-revision verification\.Table 5:Training configuration for acquisition with post\-revision verification on all three tasks\. Gradient accumulation operates over transition\-loss evaluations\.The configured feedback pipeline for acquisition with verification uses Qwen3\-VL\-8B\-Thinking for critique and Qwen3\-VL\-8B\-Instruct for synthesis\. Gemini\-2\.5\-Flash is used only for evaluation\.

##### Inference conditions\.

Direct and one\-critique evaluations both load the saved student adapter\. One\-critique inference retains an accepted draft and otherwise revises and regenerates it\. Every benchmark prompt is scored against its original request, without filtering the evaluation population by the training acceptance rule\. Equal critique budgets can incur different computation because accepted drafts require no regeneration\.

### A\.4Training Compute and Iteration Count

Optimizer updates measure learning progress but do not represent a fixed computational budget\. Each update follows image generation, visual critique, and acquisition filtering; with post\-revision verification, accepted examples additionally require regeneration and an additional round of critique\. When post\-revision verification is required, approximately 10–21% of acquisition attempts are accepted, corresponding to roughly five to ten attempts per accepted training pair\. Rejected candidates therefore contribute substantial overhead without increasing the update count\. Wall\-clock cost depends on difficulty of training dataset, generation cost, and critic latency\.

### A\.5Teacher Parameterization

Figure 5:EMA teacher decay on GenEval\.Task and HumanPref scores across three EMA decays\. Both metrics favor 0\.995 and 0\.999 over 0\.99, with 0\.995 achieving the highest scores in this sweep\.The main runs use an EMA teacher with decay 0\.999\. Figure[5](https://arxiv.org/html/2609.38721#A1.F5)shows that slower teacher updates perform better within the tested range\. Decreasing EMA further can slightly increase performance but risks becoming more unstable, as seen with 0\.99\. The benefit of other schedules, such as a time\-varying teacher schedule, remains unexplored\.

## Appendix BCritique Interface

The critic operates on the original prompt and the generated image\. Its feedback is separated into semantic, text, and quality axes before synthesis\. Semantic critique checks that requested objects exist with the correct number, attributes, and spatial relations\. Text critique checks that specified words are rendered faithfully\. Quality critique addresses visible defects in anatomy, geometry, layout, and rendering\. A synthesis stage converts these observations into a prompt that can stand alone as a generation request\.

The required behavior is to preserve the original intent, identify concrete failures, and express changes in terms that the generator can execute\. A request without a visible problem can returnKEEP\. A revision must not simply refer to “the previous image” because the teacher is conditioned on text during generation\. The following summary describes the interface; exact prompt templates are provided in the accompanying source file\.

> Input:the user’s original generation prompt and the current draft image\. Axis critique:inspect semantic constraints, requested text, or visual quality; identify visible errors relevant to that axis\. Synthesis:combine actionable corrections into a self\-contained generation prompt that preserves the user’s request\. No revision:emitKEEPwhen the generation should remain unchanged\.

##### Why prompt synthesis matters\.

Raw criticism often contains negative descriptions of the current output\. A generation model instead needs a coherent specification of the desired output\. The synthesis stage resolves this mismatch: it combines corrections and restates what should be present in the regenerated scene\. Teacher conditioning consequently carries both the original task and the information gained by inspecting the failure\. The student does not receive this additional context, making its successful imitation an actual transfer of the correction into the original\-prompt policy\.

##### Why match on student states?

Teacher\-generated images may occupy trajectories the student rarely visits\. Matching both models at the student’s noisy states supplies local guidance where the student currently needs it\. It also separates two questions: which correction the critic proposes, and how that correction changes the generator’s next transition\. Equation[3](https://arxiv.org/html/2609.38721#S2.E3)uses the latter as a dense supervision signal\. For deterministic flow sampling, this is anL2L\_\{2\}transition objective; no stochastic\-policy KL interpretation is required for the implementation used here\.

## Appendix CDatasets

We study compositional image generation with GenEval and GenEval2, and visual text rendering with an OCR prompt collection\. These tasks provide textual specifications for image generation\. Training uses generated drafts and corrective feedback, without paired target images\. Below, we describe the benchmark contents, their use in our experiments, and the HumanPref measure used to assess visual quality across tasks\. Appendix[D](https://arxiv.org/html/2609.38721#A4)specifies the shared evaluation protocol\.

##### GenEval\.

GenEval\([Ghosh et al\., 2023](https://arxiv.org/html/2609.38721#bib.bib1)\)evaluates whether a text\-to\-image model can translate explicit object\-level requirements into an image\. Its standard evaluation set contains 553 prompts across six categories: single object \(80\), two objects \(99\), counting \(80\), colors \(94\), position \(100\), and color attribute binding \(100\)\. The prompts use controlled combinations of object names, quantities, colors, and spatial relations, enabling errors to be attributed to specific compositional skills\. Attribute binding, for example, requires each requested color to be assigned to the correct object, rather than merely appearing somewhere in the image\. Training prompts are drawn from GenEval\-format training metadata\.

##### GenEval2\.

GenEval2\([Kamath et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib4)\)provides a harder compositional evaluation, introduced to address the saturation and evaluator drift observed on GenEval\. We additionally use its newer prompt suite to reduce reliance on the extensively reused GenEval benchmark and potential effects of benchmark\-specific optimization or data contamination\. Its prompts combine more simultaneous requirements, making successful generation more demanding\. The benchmark contains 800 prompts, with 100 prompts at each atomicity level from 3 to 10\. An*atom*is an individual semantic requirement, such as the presence of an object, an attribute assigned to it, a count, or a relation between objects;*atomicity*measures how many such requirements are combined in a prompt\. Its vocabulary covers 40 objects, 18 attributes, and nine relations, including spatial and action relations\. The released annotations support analysis by compositional complexity and by the skills needed to satisfy a prompt\. This makes GenEval2 useful for testing whether feedback helps the generator satisfy several interacting constraints\. Our training stream uses a separate compositional training collection, while the main holistic evaluation uses all 800 benchmark prompts with fixed prompt–seed assignments\.

##### OCR: Visual Text Rendering\.

The OCR task evaluates the ability to render specified text inside a generated image, following the visual text\-rendering setting used by Flow\-GRPO\([Liu et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib18)\)\. Each prompt describes a scene or surface and includes a quoted target string that should appear in the image\. Successful generation requires both readable lettering and faithful reproduction of the requested text within the described scene\. The source collection comprises approximately 20,000 training prompts and 1,018 test prompts\. Its scene\-conditioned requests cover contexts such as signs, posters, and product labels\.

## Appendix DEvaluation Definitions and Additional Results

We distinguish three scoring protocols: Gemini judgments of individual semantic checks, holistic Gemini ratings, and native benchmark metrics\. Using an official prompt set does not determine which evaluator produced the score\. All scores described here are evaluation measures\. UniEvo\-VL uses corrective feedback and distillation without training rewards; evaluation scores do not enter its training objective\.

##### Evaluation inputs and pairing\.

Each generated image is assessed against the original benchmark prompt\. For inference with corrective feedback, the final image is still judged against that original request; the revised generation prompt does not replace the evaluation target\. Direct generation and generation with feedback are reported separately\. Corresponding prompts and generation seeds are paired within each experiment across checkpoints and inference conditions, not across the verified and unverified configurations\.

The full\-cohort evaluations use1024×10241024\\times 1024images, 20 denoising steps, and a true classifier\-free guidance scale of 4\.0\. The verified recipe uses generation seed42\+20,000,000\+i42\+20\{,\}000\{,\}000\+i, whereas the unverified full\-set runs use20,000,000\+i20\{,\}000\{,\}000\+i, whereiiis the zero\-based metadata\-row index\. Repeated GenEval prompts occupy distinct rows and receive distinct seeds\. Table[6](https://arxiv.org/html/2609.38721#A4.T6)specifies the full cohorts\. The main holistic learning curves use 553 GenEval, 800 GenEval2, and 1,018 OCR prompts, with one image per prompt\. The generation–reflection/model\-gap study uses 553 unique GenEval prompts\. Those analyses retain their own sampling settings and are not pooled with the full\-cohort evaluations\.

Table 6:Full\-cohort Gemini evaluation for the verified recipe\. Image counts are per checkpoint and inference condition\. HumanPref is evaluated separately on each corresponding image pool\.
### D\.1Gemini Evaluation

The judge settings, request rubrics, and failure policy below specify the full\-cohort scoring implementation\. The full\-set holistic learning curves and historical subset analysis retain their experiment\-specific evaluation settings\.

##### Shared judge configuration\.

We usegemini\-2\.5\-flash, with temperature 0 and judge seed 42\. Each request contains the image followed by text specifying the benchmark, original prompt, and evaluation instructions\. Responses are constrained to a JSON schema\. The judge seed is separate from the generation seed; these settings reduce sampling variability without guaranteeing identical responses across repeated calls to the hosted model\.

##### Atom\-based semantic evaluation\.

We construct the checks from benchmark annotations before judging the image\. For GenEval, the metadata determine object\-presence and exact\-count checks, with color and spatial\-relation checks where specified\. For GenEval2, we use every released VQA question, expected answer, and skill label\. The skills cover objects, attributes, counts, spatial relations, and actions\. Auxiliary questions, including count questions whose answer is “one,” remain part of scoring even when they do not contribute to the benchmark’s annotated atomicity\.

One semantic request contains all checks for an image\. Each check includes an identifier, skill, question, and expected answer\. Gemini is instructed to judge each check independently from visible evidence, to treat expected answers as targets rather than evidence, and to returnuncertainwhen the image is ambiguous\. Its response must contain exactly oneatom\_id,verdict, and nonemptyevidenceentry for each requested check\. Verdicts arepass,fail, oruncertain; duplicate, missing, or extra identifiers invalidate the response\.

LetNNdenote the number of evaluated image instances,KiK\_\{i\}the number of checks for imageii, andzi​j=1z\_\{ij\}=1only when checkjjreceivespass\. We report

Scheck=∑i=1N∑j=1Kizi​j∑i=1NKi,Sstrict=1N∑i=1N\[∑j=1Kizi​j=Ki\]\\displaystyle S\_\{\\mathrm\{check\}\}=\\frac\{\\sum\_\{i=1\}^\{N\}\\sum\_\{j=1\}^\{K\_\{i\}\}z\_\{ij\}\}\{\\sum\_\{i=1\}^\{N\}K\_\{i\}\},\\quad S\_\{\\mathrm\{strict\}\}=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\mathbf\{1\}\\\!\\left\[\\sum\_\{j=1\}^\{K\_\{i\}\}z\_\{ij\}=K\_\{i\}\\right\]\(8\)Check accuracy weights every check equally\. Strict success requires all checks for an image to pass\. For full GenEval2 evaluation, their denominators are 6,012 checks and 800 images, respectively\. For verified GenEval, strict success is averaged over 2,212 images, rather than counting a prompt as successful if any of its four images passes\. Unverified GenEval uses 553 images and 2,098 checks\. We also retain per\-skill check accuracy and strict success grouped by GenEval2 atomicity\.

##### Holistic task ratings and HumanPref\.

Holistic evaluation uses one task\-specific request per image\. The composition rubric is “Score compositional fidelity to the prompt on an integer 0–10 scale\.” The OCR rubric substitutes “rendered text fidelity” for “compositional fidelity\.” Each response supplies an integerscorein\[0,10\]\[0,10\]and a shortrationale\. These ratings assess the image as a whole and are not calculated by rescaling atom accuracy\. The OCR rating is a model judgment of text rendering, rather than an OCR edit\-distance metric\.

In both semantic modes, a separate request scores HumanPref using the rubric “Score overall image quality and human preference on an integer 0–10 scale\.” We report the arithmetic mean of each scalar measure separately over its valid returned ratings\. HumanPref is an absolute automated proxy; it is neither a human annotation study nor a pairwise win rate, and it is not combined with semantic correctness\.

##### Uncertainty and failed requests\.

Retryable service failures receive up to three retries after the initial request\. In atom mode, uncertain checks earn no credit\. A failed semantic request also earns no credit, while all its scheduled checks and its image remain in the full\-evaluation denominators\. Such failures are recorded separately from valid negative judgments\. A failed HumanPref request in atom mode yields a missing scalar rating and is excluded from the HumanPref mean\. Full holistic scoring instead stops on an unrecoverable request; a partially scored cohort is not silently reported as complete\. We preserve individual verdicts, rationales, and error records alongside the aggregate scores\. Particular requests are also rejected without specific safety reasons provided by the API\. S

### D\.2Native Benchmark Metrics

##### Official GenEval\.

We use the GM scorer for all native GenEval \(GenEval1\) results\. The official evaluator\([Ghosh et al\., 2023](https://arxiv.org/html/2609.38721#bib.bib1)\)uses Mask2Former detections, CLIP\-based color classification, and geometric rules for spatial relations\. Each image receives a binary correctness label according to the benchmark metadata\. The overall score is the unweighted mean of the six category accuracies:

SGenEval=16​∑c=161Nc​∑i∈cbi,S\_\{\\mathrm\{GenEval\}\}=\\frac\{1\}\{6\}\\sum\_\{c=1\}^\{6\}\\frac\{1\}\{N\_\{c\}\}\\sum\_\{i\\in c\}b\_\{i\},\(9\)wherebib\_\{i\}is the official binary label andNcN\_\{c\}is the number of images in categorycc\. This category\-balanced metric differs from both Gemini check accuracy and Gemini strict success\. Results labeled official GenEval refer to this detector\-based protocol\.

##### Native GenEval2 reference\.

GenEval2’s released Soft\-TIFA evaluator\([Kamath et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib4)\)uses Qwen3\-VL\-8B\-Instruct to obtain soft answer probabilities for the VQA checks\. Its prompt\-level score is the geometric mean of those probabilities, averaged across prompts\. For question probabilitiespi​jp\_\{ij\}, the geometric\-mean \(GM\) and arithmetic\-mean \(AM\) summaries are

SGM=1N​∑i\(∏j=1Kipi​j\)1/Ki,SAM=1N​∑i1Ki​∑j=1Kipi​j\.S\_\{\\mathrm\{GM\}\}=\\frac\{1\}\{N\}\\sum\_\{i\}\\left\(\\prod\_\{j=1\}^\{K\_\{i\}\}p\_\{ij\}\\right\)^\{1/K\_\{i\}\},\\qquad S\_\{\\mathrm\{AM\}\}=\\frac\{1\}\{N\}\\sum\_\{i\}\\frac\{1\}\{K\_\{i\}\}\\sum\_\{j=1\}^\{K\_\{i\}\}p\_\{ij\}\.\(10\)The released evaluator reports both measures multiplied by 100\. AM gives each prompt equal weight, unlike the pooled Gemini check accuracy\. Our main GenEval2 table reports atomic Gemini ratings and native Soft\-TIFA over all 800 official prompts; Gemini binary atom judgments are a separate supplementary protocol\.

##### Flow\-GRPO OCR reference\.

The Flow\-GRPO reference evaluator\([Liu et al\., 2025](https://arxiv.org/html/2609.38721#bib.bib18)\)uses English PaddleOCR to read the image and compares the recognized text with the first double\-quoted target string in the prompt\. It concatenates recognized text regions with positive recognition confidence, removes ASCII spaces, and lowercases both strings\. A substring match receives 1; otherwise its score is1−min⁡\(dLev​\(y^,y\),\|y\|\)/\|y\|1\-\\min\(d\_\{\\mathrm\{Lev\}\}\(\\hat\{y\},y\),\|y\|\)/\|y\|, whereyyis the normalized target,y^\\hat\{y\}is the recognized text, anddLevd\_\{\\mathrm\{Lev\}\}is Levenshtein edit distance\. Recognition exceptions receive zero, and scores are averaged over all images\. This recognition\-based reference is distinct from the Gemini OCR ratings reported in our task evaluations\.

##### Interpreting the scores\.

Detector errors can cause official GenEval to penalize images that satisfy the prompt, consistent with the evaluator drift documented by[Kamath et al\. \(2025\)](https://arxiv.org/html/2609.38721#bib.bib4)\. Because our reward\-free training does not optimize these scores directly, improved prompt fulfillment need not produce a near\-perfect detector score\. Gemini judgments also remain automated assessments\. We interpret each metric according to its own evaluator, aggregation rule, and image population, alongside qualitative evidence\.

### D\.3Comparison with other methods

Table 7:GenEval performance on 553 prompts\.Scores use the official evaluator \(0–1; higher is better\)\. Our update\-200 rows use training without post\-revision verification; update\-140 rows use training with post\-revision verification\. Each checkpoint is evaluated with direct generation and with one critique iteration\. The Qwen\-Image\-2512 and update\-200 rows use one evaluated image per prompt; update\-140 rows use four images per prompt \(2,212 images\)\. Bold and underlined values indicate the highest and second\-highest scores in each column, with ties at the displayed precision\.Table[7](https://arxiv.org/html/2609.38721#A4.T7)shows thatUniEvo\-VLraises Qwen\-Image\-2512 to competitive GenEval performance without using external evaluator signal during training\. Direct generation reaches 0\.81 without post\-revision verification and 0\.82 with verification, compared with the reported Qwen\-Image\-2512 baseline of 0\.75\. One critique iteration raises both configurations to 0\.85, the second\-highest overall score among the listed methods\. The verified configuration matches BAGEL’s reported overall score in direct generation and reaches the highest spatial\-position score \(0\.81\) with one critique iteration\. These results should be interpreted in light of the training signal available to our method\. Approaches that optimize native evaluator\-derived rewards receive feedback directly aligned with the benchmark’s scoring criteria\. Our adaptation forgoes this advantage: it relies on semantic diagnoses and corrections from a critic, which must transfer to the native evaluator’s object, count, attribute, and spatial checks\. The resulting native\-score improvements therefore provide evidence that critic\-derived semantic supervision can improve compositional generation under a separate evaluation mechanism, without directly optimizing its reward\.

### D\.4Full judge\-less learning curve

Table 8:Full\-set learning curves without post\-revision verification, rounded to three decimals\. Each checkpoint uses 553 GenEval, 800 GenEval2, and 1,018 OCR prompts; task and HumanPref scores retain their 0–10 scale\.Table[8](https://arxiv.org/html/2609.38721#A4.T8)motivate post\-revision verification as a safeguard for training\-signal reliability\. Although GenEval improves steadily, GenEval2 exhibits an intermediate decline, and OCR fluctuates\. These trajectories suggest that critique\-guided prompt revision without verification may not consistently provide beneficial supervision on relatively more difficult\-to\-learn tasks\. A primary cause of this is that producing a revised prompt does not guarantee that the regenerated image resolves the original error\. Post\-revision verification checks this outcome against the original request before accepting the revision for training\. By admitting confirmed corrections and filtering unsuccessful revisions, this step is designed to provide a more reliable training signal and support more stable learning\.

### D\.5Historical Difficulty Analysis on 500\-Prompt Subsets

These historical analyses use 500 prompts per task and are not full\-set results\. Easy contains baseline scores 5–10 and Hard contains 0–4; membership is fixed before training\. GenEval uses update 180 and the other tasks use update 200\. The Hard subsets contain 51, 144, and 24 prompts, respectively\.

##### Normalized difficulty gains\.

For a fixed subsetBBand a task scores∈\[0,10\]s\\in\[0,10\], we report

ΔB\(%\)=100\(𝔼⁡\[sevolved∣B\]−𝔼⁡\[sbase∣B\]10\)\.\\Delta\_\{B\}^\{\(\\%\)\}=100\\left\(\\frac\{\\mathbb\{E\}\[s\_\{\\rm evolved\}\\mid B\]\-\\mathbb\{E\}\[s\_\{\\rm base\}\\mid B\]\}\{10\}\\right\)\.\(11\)These are percentage\-point changes on a normalized 0–100 score\. The denominator is the full score range, not the baseline mean\. Subsets are defined once from the baseline, with no regrouping after training\. Values in Figure[4](https://arxiv.org/html/2609.38721#S3.F4)are rounded to the nearest integer\. The small size of OCR’s Hard subset should be considered when interpreting its large normalized gain\.

### D\.6Native GenEval2 Soft\-TIFA Across Updates

All points use 800 prompts and the released Qwen3\-VL\-8B\-Instruct VQA evaluator\. GM is the primary native metric; AM is a supplementary arithmetic\-mean summary\. Both retain the evaluator’s 0–100 scale\. The main result uses update 200, without selecting the later peak at update 220\.

Figure 6:Complete GenEval2 Soft\-TIFA trajectory for GPT\-5\.6\-Luna critique, updates 0–300\. The Qwen\-critic baseline and update\-200 endpoints are shown as separate markers\. GM and AM use each run’s own baseline\.Table 9:Paired native GenEval2 results at update 200 \(800 prompts\)\. Deltas use unrounded scores\.
### D\.7GenEval Evaluator Limitations

GenEval relies on object detection, color classification, and geometric rules, whose errors can penalize images that satisfy the prompt\. Consistent with this limitation,[Kamath et al\. \(2025\)](https://arxiv.org/html/2609.38721#bib.bib4)report 96\.7% human\-assessed correctness for Gemini 2\.5 Flash Image with prompt rewriting, compared with an automatic GenEval score of 82\.1%\. UniEvo\-VL uses corrective feedback and distillation without training rewards; GenEval scores are used for evaluation and do not enter the training objective\. Consequently, improved prompt fulfillment need not translate into near\-perfect GenEval scores, and a score below 0\.95 should not automatically be interpreted as a corresponding deficit in semantic correctness\. We therefore assess progress jointly through GenEval, the harder GenEval2 benchmark, and qualitative inspection\.

### D\.8Unreturned Judge Responses

Few generated\-image instances lack their Gemini task judgment and their visual\-preference rating\. A diagnostic request for each of these ten judgments \(over all experiments\) returned no candidate and no parsable answer; the API reportedprompt\_feedback\.block\_reason=OTHERwith no safety\-category ratings\. This response does not establish that the generated image violated the prompt or identify a specific reason for the block\. We therefore distinguish an unreturned judgment from a valid negative judgment\.

### D\.9Image Comparison

![Refer to caption](https://arxiv.org/html/2609.38721v1/geneval2_grid.png)Figure 7:Qualitative examples of UniEvo\-VL on GenEval2\.Examples cover object counts, colors, materials, and patterns\. Rows show the base model, UniEvo\-VL direct generation, and UniEvo\-VL with up to one critique\. Each column shares the original prompt and seed; both UniEvo\-VL rows use checkpoint 160 of the Qwen critic\-confirmed variant\. AKEEPdecision retains the direct image\.![Refer to caption](https://arxiv.org/html/2609.38721v1/ocr_grid.png)Figure 8:Qualitative examples of UniEvo\-VL on OCR\.Examples illustrate text rendering across varied scenes; headings summarize the scene and quote the requested text\. Rows show the base model, UniEvo\-VL direct generation, and UniEvo\-VL with up to one critique\. Each column shares the original prompt and seed; both UniEvo\-VL rows use checkpoint 130 of the Qwen critic\-confirmed variant\. AKEEPdecision retains the direct image\.##### Influence of feedback\-prompt design\.

Some outputs on GenEval and GenEval2 exhibit muted colors and frequent plain, light\-colored backgrounds\. This pattern is consistent with a stylistic bias introduced by our feedback\-prompt design for realism\. Although this aesthetic differs from more common high\-saturation AI\-generated photos, it scores higher on our selected human preference benchmarks\. This motivates greater caution when designing aesthetic prompts during feedback for self\-evolving models as small biases could accumulate\.

## Appendix EPreliminary Attempts at Supervised Fine\-Tuning

We explored supervised fine\-tuning \(SFT\) as another way to learn from critique\-guided refinement\. The idea is to use an accepted refined image as a training target for its original prompt, so that subsequent generation can reproduce the correction without receiving the revised instruction\. We did not succeed in obtaining improved generation with the SFT recipes we tried\. We describe the implementation and a development\-set diagnostic below to document these attempts\.

##### Constructing training examples\.

We use the acquisition\-with\-verification branch of Algorithm 1 \(ν=1\\nu=1\), with one revision\. For an original promptpp, draw generation noiseϵ\\epsilonusing a recorded seedrrand obtainI=ℳ𝜽gen​\(p,ϵ\)I=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(p,\\epsilon\)and\(c,a\)=ℳ𝜽und​\(p,I\)\(c,a\)=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,I\)\. If this assessment is valid anda=0a=0, synthesizep~=ℳ𝜽und​\(p,c\)\\widetilde\{p\}=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,c\)and generateI′=ℳ𝜽gen​\(p~,ϵ\)I^\{\\prime\}=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\widetilde\{p\},\\epsilon\)using the same generation noise\. We retain\(p,I′,r\)\(p,I^\{\\prime\},r\)in a separate collection𝒜kSFT\\mathcal\{A\}\_\{k\}^\{\\mathrm\{SFT\}\}only when the revision is valid and the subsequent assessment\(c′,a′\)=ℳ𝜽und​\(p,I′\)\(c^\{\\prime\},a^\{\\prime\}\)=\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,I^\{\\prime\}\)is valid witha′=1a^\{\\prime\}=1\. Initial acceptance, invalid responses, and unaccepted revisions supply no SFT example\. The main OPSD objective usesI′I^\{\\prime\}only for verification; SFT instead retains this accepted image as its training target\.

##### Flow\-matching objective\.

Letz⋆=sg⁡\[Enc⁡\(I′;r\)\]∈ℝdz^\{\\star\}=\\operatorname\{sg\}\[\\operatorname\{Enc\}\(I^\{\\prime\};r\)\]\\in\\mathbb\{R\}^\{d\}, whereEnc\\operatorname\{Enc\}samples the frozen VAE posterior with a seed derived fromrrand applies the generator’s fixed latent normalization and packing\. Recreate one Gaussian noise tensorξ\\xifrom the acquisition seedrrand reuse it at every selected noise level\. We distinguish this SFT noising tensor from the generation initializationϵ\\epsilon; no independent noise is drawn for eachjj\. Using the scheduler indices𝒥\\mathcal\{J\}and noise levelsσj\\sigma\_\{j\}defined in Appendix[A\.1](https://arxiv.org/html/2609.38721#A1.SS1), construct

zjSFT=\(1−σj\)​z⋆\+σj​sg⁡\[ξ\],u=sg⁡\[ξ−z⋆\]\.z\_\{j\}^\{\\mathrm\{SFT\}\}=\(1\-\\sigma\_\{j\}\)z^\{\\star\}\+\\sigma\_\{j\}\\operatorname\{sg\}\[\\xi\],\\qquad u=\\operatorname\{sg\}\[\\xi\-z^\{\\star\}\]\.\(12\)These interpolation states are obtained by noising an accepted image; they are not the on\-policy rollout statessjs\_\{j\}used by OPSD\. At the corresponding noise level, the same local generator notation meansℳ𝜽gen​\(zjSFT,p\)=v𝜽\(g\)​\(zjSFT,σj,p\)\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(z\_\{j\}^\{\\mathrm\{SFT\}\},p\)=v\_\{\\boldsymbol\{\\theta\}\}^\{\(g\)\}\(z\_\{j\}^\{\\mathrm\{SFT\}\},\\sigma\_\{j\},p\), with the guidance rule in Equation[4](https://arxiv.org/html/2609.38721#A1.E4)andg=4g=4\. The SFT objective is

ℒSFT​\(𝜽\)=𝔼\(p,I′,r\)∼𝒜kSFT​\[1\|𝒥\|​∑j∈𝒥1d​‖ℳ𝜽gen​\(sg⁡\[zjSFT\],p\)−u‖22\]\.\\mathcal\{L\}\_\{\\mathrm\{SFT\}\}\(\\boldsymbol\{\\theta\}\)=\\mathbb\{E\}\_\{\(p,I^\{\\prime\},r\)\\sim\\mathcal\{A\}\_\{k\}^\{\\mathrm\{SFT\}\}\}\\left\[\\frac\{1\}\{\|\\mathcal\{J\}\|\}\\sum\_\{j\\in\\mathcal\{J\}\}\\frac\{1\}\{d\}\\left\\\|\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\operatorname\{sg\}\[z\_\{j\}^\{\\mathrm\{SFT\}\}\],p\)\-u\\right\\\|\_\{2\}^\{2\}\\right\]\.\(13\)This is an unweighted velocity MSE, evaluated in float32: it has neither the\(Δ​σj\)2\(\\Delta\\sigma\_\{j\}\)^\{2\}weighting nor the1/21/2prefactor of the implemented OPSD transition loss\. Only generator LoRA parameters receive gradients, including through both branches of the guided student prediction\. Acquisition, accepted images, VAE encoding, and Gaussian noise are detached\. Pure SFT has no reference\-model target or EMA update\. The inspected recipe usesT=20T=20and𝒥=\{0,…,5\}\\mathcal\{J\}=\\\{0,\\ldots,5\\\}, with gradient accumulation over the selected levels and configured example batches\.

Algorithm 2SFT on verified revised images \(one\-revision recipe\)1:Model interfaces

ℳ𝜽gen\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}and fixed

ℳ𝜽und\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}, prompt batches

𝒫k\\mathcal\{P\}\_\{k\}, schedule

\{σj\}j=0T\\\{\\sigma\_\{j\}\\\}\_\{j=0\}^\{T\}, selected indices

𝒥\\mathcal\{J\}
2:for

k=0,1,…k=0,1,\\ldotsdo

3:

𝒜kSFT←∅\\mathcal\{A\}\_\{k\}^\{\\mathrm\{SFT\}\}\\leftarrow\\varnothing
4:Verified experience acquisition \(no gradients\)

5:foreach

p∈𝒫kp\\in\\mathcal\{P\}\_\{k\}do

6:Choose seed

rr; draw

ϵ∼𝒩⁡\(0,𝐈\)\\epsilon\\sim\\mathcal\{N\}\(0,\\mathbf\{I\}\)using

rr
7:

I←ℳ𝜽gen​\(p,ϵ\)I\\leftarrow\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(p,\\epsilon\)
8:

\(c,a\)←ℳ𝜽und​\(p,I\)\(c,a\)\\leftarrow\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,I\)
9:ifassessment is invalid or

a=1a=1then

10:continue

11:endif

12:

p~←ℳ𝜽und​\(p,c\)\\widetilde\{p\}\\leftarrow\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,c\); skip if invalid

13:

I′←ℳ𝜽gen​\(p~,ϵ\)I^\{\\prime\}\\leftarrow\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\widetilde\{p\},\\epsilon\)
14:

\(c′,a′\)←ℳ𝜽und​\(p,I′\)\(c^\{\\prime\},a^\{\\prime\}\)\\leftarrow\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{und\}\}\(p,I^\{\\prime\}\)
15:ifassessment is valid and

a′=1a^\{\\prime\}=1then

16:

𝒜kSFT←𝒜kSFT∪\{\(p,sg⁡\[I′\],r\)\}\\mathcal\{A\}\_\{k\}^\{\\mathrm\{SFT\}\}\\leftarrow\\mathcal\{A\}\_\{k\}^\{\\mathrm\{SFT\}\}\\cup\\\{\(p,\\operatorname\{sg\}\[I^\{\\prime\}\],r\)\\\}
17:endif

18:endfor

19:Accepted\-image supervision

20:foreach optimizer accumulation window

𝒞⊆𝒜kSFT\\mathcal\{C\}\\subseteq\\mathcal\{A\}\_\{k\}^\{\\mathrm\{SFT\}\}do

21:

ℓ𝒞←0\\ell\_\{\\mathcal\{C\}\}\\leftarrow 0
22:foreach

\(p,I′,r\)∈𝒞\(p,I^\{\\prime\},r\)\\in\\mathcal\{C\}do

23:

z⋆←sg⁡\[Enc⁡\(I′;r\)\]z^\{\\star\}\\leftarrow\\operatorname\{sg\}\[\\operatorname\{Enc\}\(I^\{\\prime\};r\)\]
24:Recreate Gaussian

ξ\\xiusing

rr;

u←sg⁡\[ξ−z⋆\]u\\leftarrow\\operatorname\{sg\}\[\\xi\-z^\{\\star\}\]
25:foreach

j∈𝒥j\\in\\mathcal\{J\}do

26:

zjSFT←\(1−σj\)​z⋆\+σj​sg⁡\[ξ\]z\_\{j\}^\{\\mathrm\{SFT\}\}\\leftarrow\(1\-\\sigma\_\{j\}\)z^\{\\star\}\+\\sigma\_\{j\}\\operatorname\{sg\}\[\\xi\]
27:

ℓ𝒞←ℓ𝒞\+‖ℳ𝜽gen​\(sg⁡\[zjSFT\],p\)−u‖22\|𝒞\|​\|𝒥\|​d\\ell\_\{\\mathcal\{C\}\}\\leftarrow\\ell\_\{\\mathcal\{C\}\}\+\\dfrac\{\\\|\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}\(\\operatorname\{sg\}\[z\_\{j\}^\{\\mathrm\{SFT\}\}\],p\)\-u\\\|\_\{2\}^\{2\}\}\{\|\\mathcal\{C\}\|\\,\|\\mathcal\{J\}\|\\,d\}
28:endfor

29:endfor

30:Accumulate

∇𝜽ℓ𝒞\\nabla\_\{\\boldsymbol\{\\theta\}\}\\ell\_\{\\mathcal\{C\}\}over LoRA parameters

31:Clip gradients, apply one AdamW update, and clear gradients

32:endfor

33:endfor

34:return

ℳ𝜽gen\\mathcal\{M\}\_\{\\boldsymbol\{\\theta\}\}^\{\\mathrm\{gen\}\}

We did not obtain improved generation with the SFT configurations we tried\. We observed rapid degradation of the student during training\. In our experiments, on\-policy self\-distillation \(OPSD\) proved easier to make effective, motivating its use in the main method\. We suspect SFT may require more complex regularization techniques and prompt selection than opd\.

## Appendix FCritic prompts, prompt synthesis, and recorded examples

This appendix documents the exact feedback interface used by the Qwen\-based acquisition\-with\-verification experiments\. The configured pipeline uses Qwen3\-VL\-8B\-Thinking for image critique and Qwen3\-VL\-8B\-Instruct for synthesizing the resulting feedback into a revised generation prompt\. Both components remain fixed throughout training\.

The acquisition and post\-revision verification rule is defined in Appendix[A\.2](https://arxiv.org/html/2609.38721#A1.SS2)\. Here we specify only the textual interfaces that produce the critique and revised prompt, together with recorded examples from the corresponding acquisition runs\.

### F\.1Critic and merger interface

For an imageIIgenerated from promptpp, the critic receives the image and the current evaluation prompt\. Three complementary lenses are queried: semantic fidelity, rendered text, and visual quality\. Each lens returns either one actionable correction or the exact no\-issue responseNo issue on this lens\.Only the final textual verdict is passed downstream; internal reasoning is not used by the training pipeline\.

The prompt\-synthesis module receives the original generation prompt together with the nonempty, axis\-labeled critic notes; it does not receive the image\. It produces a self\-contained text\-to\-image prompt that restates the original request while incorporating the actionable corrections\. If all critic lenses return no actionable issue, the pipeline emitsKEEPdirectly and does not invoke the synthesis model\.

For post\-revision verification, the regenerated imageI′I^\{\\prime\}is evaluated against the*original*requestpp, following Appendix[A\.2](https://arxiv.org/html/2609.38721#A1.SS2)\. A corrective experience is retained only when this second assessment is valid and finds no remaining actionable discrepancy with respect topp\. The regenerated image determines only whether the experience is admitted; the revised textp~\\widetilde\{p\}, rather thanI′I^\{\\prime\}, provides the privileged teacher condition during distillation\.

##### Reading the prompt listings\.

Sections[F](https://arxiv.org/html/2609.38721#A6)reproduce the recorded textual request templates, including their fixed few\-shot demonstrations\. Angle\-bracketed fields denote runtime substitutions and are not literal input tokens; line wrapping is typographical\. The hypothetical scenes inside the templates are few\-shot demonstrations, whereas the examples reported afterward are recorded model outputs\.

The recorded quality and synthesis prompts contain explicit preferences for natural lighting and moderate contrast in suitable photographic scenes\. One synthesis demonstration additionally introduces a plain background\. These design choices can affect appearance beyond the object\-level correction itself and are therefore part of the experimental intervention rather than neutral formatting\.

### F\.2Exact semantic critic prompt

You are inspecting an AI\-generated image for an automated pipeline\. All people in the image are AI\-generated; ignore privacy concerns\.The image was generated for this request:"<CURRENT\_PROMPT\>"LENS: FIDELITY — composition vs the request only: presence, exact count,color/material/size/shape, and any stated spatial relation\. Request = groundtruth\. Not quality or lighting \(other lens\)\.\- Subject first: depict the head noun\. In "an X that focuses on A, B, C", theA/B/C characterize X — they are NOT objects to draw or label \(unlike "a catand a dog", where each is real\)\. A missing or wrong subject outranks anylist item\.\- Ignore prompt\-silent extras that don’t change a named object’scount/color/placement; do not debate them\.\- Fix = the COMPLETE end\-state — full target \(every object, count, attribute,relation\), never "change X to Y"\. Restate the parts already correct so theysurvive a from\-scratch rebuild; state the arrangement concretely \(which isbeside / behind / on which; independent objects, not one printed on or fusedinto the other\) — never "keep the relations unchanged"\.\- Attribute fix = the object’s full appearance across its named parts with thecurrent value ruled out \("whole coat solid green, head to tail, no brown"\),not "change to green"\. For shape, give the geometry \(faces / sides /silhouette\)\.\- Counts exact \(N, no more\); relations explicit; reason out shape geometrybefore judging, don’t guess from a glance\.Examples of FIDELITY notes:PROMPT: A photo of a purple banana on a wooden table\.\[a yellow banana on a wooden table; one banana\]NOTE: One purple banana on the wooden table is required; the banana is presentbut yellow\. Fix: a single banana whose whole skin is solid purple, stem totip, with no yellow or green, natural banana shape, on the wooden table\.PROMPT: A portrait of a jazz musician who plays saxophone, composes filmscores, and teaches improvisation\.\[three icons — sax, film reel, chalkboard; no person\]NOTE: The subject is one jazz musician \(a person\); the three activities arewhat they do, not objects to draw or label\. No person is shown — only icons\.Fix: a portrait of one jazz musician as a person in a studio setting, with noicons and no text\.PROMPT: A single green pear on a marble countertop\.\[one green pear on a marble countertop; light a touch dim\]NOTE: No issue on this lens\.Judge through your LENS only; ground every claim in what is visible; do notinvent flaws\. Do all perceiving, counting, and reasoning in your thinking —the final answer holds none of it\.Nothing worth fixing → reply exactly: No issue on this lens\. \(Saying nothingis correct; a vacuous note is a failure\.\)A real issue → ONE note: \(a\) the visible evidence, \(b\) the fix as a COMPLETEend\-state \(what your rubric requires\), never "change X to Y"\. Describe thetarget itself; never reference this image \("as shown", "as is", "leaveunchanged"\) — the reader cannot see it\.Final answer = the verdict only: no preface, no label \("NOTE:"/"VERDICT:"\),no thinking\-out\-loud\. One note, then stop\.

### F\.3Exact visual\-quality critic prompt

You are inspecting an AI\-generated image for an automated pipeline\. All people in the image are AI\-generated; ignore privacy concerns\.The image was generated for this request:"<CURRENT\_PROMPT\>"LENS: AESTHETIC — rendering quality only, NOT whether it matches the request\.HIGH bar: on most images the verdict is "No issue on this lens\."In scope: \(1\) lighting/exposure for photo or realistic prompts — prefernatural, physically plausible light; accurate, scene\-appropriate white balance;a balanced tonal range with recoverable highlight and shadow detail; andmoderate realistic contrast that separates the subject without a stylizedgrade\. Flag only clear, visible, preference\-moving failures such as animplausible overall color cast, broken exposure, clipped highlights, crushedor muddy shadows, or inconsistent light direction\. Preserve lighting, colorcharacter, time of day, and style when the prompt explicitly requests them\.For paintings and illustrations, respect the requested medium and palette\.\(2\) structural artifacts \(malformed hands/faces, melted/garbled/fused/extra/missing parts\)\. \(3\) composition — weird crop, framing that fights the scene\.\(4\) detail flatter than the scene calls for \(e\.g\. plastic texture in aphotorealistic close\-up\)\.Never flag: "looks AI\-generated", too smooth/clean/perfect, minorgrain/noise/banding, anything you must hunt for, background/watermark/reflection, a scene\-appropriate lighting style or color grade merely becauseit differs from your taste, or whether content matches the request \(otherlens\)\.The note is the rendering change ONLY \(relight / repair / reframe / adddetail\)\. Do NOT describe, restate, or ask to keep the content, objects, orlayout — that is the merger’s and fidelity lens’s job\. Naming a malformedregion you repair is fine\. State the change and stop\.Examples of AESTHETIC notes \(rendering only — no content; the fix varies\):PROMPT: A photo of a white ceramic mug on a wooden table beside a window\.\[implausible overall white\-balance cast; clipped window highlights; muddyshadow detail; flat ceramic and wood texture\]NOTE: The image has an implausible overall color cast, clipped windowhighlights, and muddy shadows that obscure material detail\. Fix: use naturalwindow light with accurate, scene\-appropriate white balance, recover highlightand shadow detail, render realistic ceramic and wood texture, and keep moderatenatural contrast\.PROMPT: A photo of a lighthouse on a rocky coast\.\[the lighthouse is cut off at the top edge; large empty foreground\]NOTE: The lighthouse is cropped at the top edge, with a large emptyforeground\. Fix: reframe so the whole lighthouse fits, not cut off, with theforeground tightened\.PROMPT: A dramatic fantasy illustration of a wizard’s tower at night\.\[already strong moonlight, deep shadows, high contrast; no artifacts\]NOTE: No issue on this lens\.Judge through your LENS only; ground every claim in what is visible; do notinvent flaws\. Do all perceiving, counting, and reasoning in your thinking —the final answer holds none of it\.Nothing worth fixing → reply exactly: No issue on this lens\. \(Saying nothingis correct; a vacuous note is a failure\.\)A real issue → ONE note: \(a\) the visible evidence, \(b\) the fix as a COMPLETEend\-state \(what your rubric requires\), never "change X to Y"\. Describe thetarget itself; never reference this image \("as shown", "as is", "leaveunchanged"\) — the reader cannot see it\.Final answer = the verdict only: no preface, no label \("NOTE:"/"VERDICT:"\),no thinking\-out\-loud\. One note, then stop\.

### F\.4Exact rendered\-text critic prompt

You are inspecting an AI\-generated image for an automated pipeline\. All people in the image are AI\-generated; ignore privacy concerns\.The image was generated for this request:"<CURRENT\_PROMPT\>"LENS: TEXT — rendered text only\. For each string the prompt requires:transcribe it verbatim, state the target, name the difference, and give thefix as the FULL target string \(never the changed fragment\)\.\- Count/placement: the words must appear the right number of times \(usuallyonce\) and only where asked\. Duplicated or extra copies are errors even ifeach is spelled right; fix = the text exactly once on the named surface,nowhere else\.\- Legibility: the text must be large, sharp, in\-focus, and readable — nottiny, occluded, angled away, or lost in low contrast\. Present\-but\-unreadableis an error; fix = rendered prominently and legibly\.\- No text requested → no issue on this lens\.Examples of TEXT notes:PROMPT: A chalkboard menu with the heading "Daily Specials"\.\[the heading reads "Dally Specials"\]NOTE: Rendered "Dally Specials"; target "Daily Specials"\. First word wrong:"Dally" should be "Daily" \(D\-a\-i\-l\-y\)\. Fix: the heading reads in full "DailySpecials" in clear chalk lettering, "Specials" kept\.PROMPT: A delivery van with "Fresh Flowers" painted on its side\.\["Fresh Flowers" appears on the side AND on the rear door; rear copy small\]NOTE: "Fresh Flowers" is required once, on the side\. It appears twice \(side \+rear door\) and the rear copy is small and hard to read\. Fix: "Fresh Flowers"exactly once, large and clearly legible on the side of the van, nowhere else\.PROMPT: A photo of a kayak on a calm lake at sunrise\.\[no text anywhere\]NOTE: No issue on this lens\.Judge through your LENS only; ground every claim in what is visible; do notinvent flaws\. Do all perceiving, counting, and reasoning in your thinking —the final answer holds none of it\.Nothing worth fixing → reply exactly: No issue on this lens\. \(Saying nothingis correct; a vacuous note is a failure\.\)A real issue → ONE note: \(a\) the visible evidence, \(b\) the fix as a COMPLETEend\-state \(what your rubric requires\), never "change X to Y"\. Describe thetarget itself; never reference this image \("as shown", "as is", "leaveunchanged"\) — the reader cannot see it\.Final answer = the verdict only: no preface, no label \("NOTE:"/"VERDICT:"\),no thinking\-out\-loud\. One note, then stop\.

### F\.5Exact prompt\-synthesis request

You are inspecting an AI\-generated image for an automated pipeline\. All people in the image are AI\-generated; ignore privacy concerns\.The image was generated for this request:"<CURRENT\_PROMPT\>"NOTES from the critic panel:<LABELED\_NONEMPTY\_NOTES\>Examples of merging notes into one self\-contained T2I prompt\. The outputkeeps every specific in the notes\.PROMPT: A photo of a scarlet polar bear on an ice floe\.NOTES:\- \[semantic\] One polar bear on an ice floe; fur is white, not scarlet\. Fix: apolar bear whose whole coat is scarlet, head to paws, no white, naturalpolar\-bear shape, on the ice floe with pale ice and water\.\- \[text\] none\. \- \[quality\] none\.MERGED OUTPUT:A photo of a single polar bear on an ice floe whose whole coat is scarlet —deep scarlet from head to paws, no white anywhere — natural polar\-bear shape,pale ice and water around it\.PROMPT: A magazine cover featuring an architect celebrated for skyscrapers,sustainable housing, and museum design\.NOTES:\- \[semantic\] The subject is one architect \(a person\); the three fields arewhat they’re known for, not objects\. Three labeled icons, no person\. Fix:depict one architect as a person, fields suggested by models/drawings, nolabels\.\- \[text\] none\. \- \[quality\] none\.MERGED OUTPUT:A magazine cover featuring a single architect, shown as a person holdingblueprints in a design studio, the field suggested by scale models anddrawings rather than written labels, no text\.PROMPT: An illustration of a giant ceramic teacup balanced on a single bladeof grass\.NOTES:\- \[semantic\] Teacup and grass present, but the blade is drawn thick and thecup sits beside it\. Fix: a giant teacup balanced on one thin blade of grass,the blade far thinner than the cup; it stays thin even with the cup on it —impossible balance intended\.\- \[text\] none\. \- \[quality\] none\.MERGED OUTPUT:An illustration of an enormous ceramic teacup balanced on top of a single thinblade of grass; the blade is tiny and slender, far thinner than the cup,bending only slightly\. The blade stays thin even with the giant cup on it —the impossible balance is intentional\.PROMPT: A photo of a vase and a candle\.NOTES:\- \[semantic\] The vase is correct\. The item beside it is a lamp, not a candle\.Fix: one vase and one candle, two distinct non\-overlapping objects side byside; the candle is an upright wax pillar with a lit flame, not a lamp\.\- \[text\] none\. \- \[quality\] The lighting has an implausible overall color castand uneven exposure, with clipped highlights and muddy shadow detail\. Fix:use natural\-looking light with accurate, scene\-appropriate white balance,recover highlight and shadow detail, and keep moderate realistic contrastwithout a stylized grade\.MERGED OUTPUT:A photo of a vase and a candle, side by side as two distinct, non\-overlappingobjects; the candle is an upright wax pillar with a lit flame, not a lamp\.Natural\-looking light with accurate, scene\-appropriate white balance,recovered highlight and shadow detail, and moderate realistic contrast withouta stylized grade\. Plain background\.PROMPT: A photo of a red bicycle leaning against a brick wall\.NOTES:\- \[semantic\] One red bicycle leaning against a brick wall, correct\. No issue\.\- \[text\] none\. \- \[quality\] none\.MERGED OUTPUT:KEEPPrompt synthesis \(continued\): output instructions

Your reply IS one complete, self\-contained new T2I prompt \(or the tokenKEEP\) — not analysis, not reasoning\. The regenerator never sees the originalrequest or the old image, so describe everything; never write "as requested","preserved", "unchanged", or "no changes to X"\.\- Include everything the original prompt specified PLUS the corrections,folded in naturally\.\- Carry the critics’ detail through: keep every specific in the notes \(parts,attributes, geometry, counts, relations, qualifiers\)\. Combine and preserve —at least as detailed as the notes, never a terser paraphrase — but inventnothing they do not contain\.\- Hard attributes the model resists \(unusual color/material/shape/state\):spell them out across the object’s parts and rule out the default \("entirelyblack, florets and stalk, no green"; "six flat faces, not round"\)\.\- Objects that should be separate: distinct, non\-overlapping, independent —not one printed on, fused into, or patterned on the other\.\- Relative size: tie "small/large" to a concrete yardstick\. If a size and aspatial relation make the scene impossible \(a big thing on a tiny one\), keepboth and render it impossible — especially for "an illustration of …"; donot rescale to make it plausible\.\- Roles: the semantic note owns content and arrangement; text owns renderedtext; the quality note is rendering only \(lighting/contrast/repair\) and nevermoves or renames objects — ignore any layout it asserts\. On conflict, followsemantic\. One coherent, physically possible scene\.\- Every named object fully in frame and recognizable \(not cropped, occluded,or shrunk\); required text large and legible; add no exclusions \("no people"\)the notes did not flag\.Correctness \(object, count, text, structure\) outranks polish\. If nothing realremains, reply exactly KEEP\.Reply starts with the first word of the prompt \(or KEEP\): no preface, nolabel, no deliberation word \("Hmm", "Wait", "Let me", …\), no notes echoed\.

### F\.6Example 1: repairing an object\-count error

![[Uncaptioned image]](https://arxiv.org/html/2609.38721v1/figures/two_sinks_1.png)

Draft: original request

![[Uncaptioned image]](https://arxiv.org/html/2609.38721v1/figures/two_sinks_2.png)

Regenerated: revised prompt

Original request\.

a photo of two sinks

Semantic critic: recorded note\.

One sink is present; two sinks are required\. Fix: two sinks, each with a white basin, silver faucet, and pedestal base, positioned side by side against the tiled wall with no overlap or fusion\.The quality and text lenses supplied no actionable note\.

Synthesis: recorded revised prompt\.

A photo of two sinks, each with a white basin, silver faucet, and pedestal base, positioned side by side against the tiled wall with no overlap or fusion\.

### F\.7Example 2: correcting required text

![[Uncaptioned image]](https://arxiv.org/html/2609.38721v1/figures/105838_prompt_306_seed_0_iter_1.png)

Draft: original request

![[Uncaptioned image]](https://arxiv.org/html/2609.38721v1/figures/105838_prompt_306_seed_0_iter_2.png)

Regenerated: revised prompt

Original request\.

A majestic historical monument, intricately carved with the words "Freedom 1776", stands tall against a backdrop of an overcast sky, surrounded by lush, green foliage and a cobblestone pathway leading up to its base\.

Text critic: recorded note\.

Rendered "Freedom 1777"; target "Freedom 1776"\. Year incorrect: "1777" should be "1776"\. Fix: the monument displays "Freedom 1776" prominently and legibly above the central arch, nowhere else\.The quality lens supplied no actionable note\.

Synthesis: recorded revised prompt\.

A majestic historical monument with the words "Freedom 1776" prominently and legibly carved on its upper section, nowhere else, standing tall against an overcast sky, surrounded by lush green foliage and a cobblestone pathway leading up to its base\.