From Plans to Pixels: Learning to Plan and Orchestrate for Open-Ended Image Editing
Summary
An experiential framework for long-horizon image editing that couples planning with reward-driven execution to improve coherence and reliability of complex multi-step edits.
View Cached Full Text
Cached at: 05/18/26, 06:24 AM
Paper page - From Plans to Pixels: Learning to Plan and Orchestrate for Open-Ended Image Editing
Source: https://huggingface.co/papers/2605.15181
Abstract
An experiential framework for long-horizon image editing that couples planning with reward-driven execution to improve coherence and reliability of complex multi-step edits.
Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly’’). Prior agent based methods decompose such tasks but rely on handcrafted pipelines or teacher imitation, limiting flexibility and decoupling learning from actual editing outcomes. We propose an experiential framework for long-horizon image editing, where aplannergenerates structuredatomic decompositionsand anorchestratorselects tools and regions to execute each step. Avision language judgeprovides outcome-based rewards forinstruction adherenceandvisual quality. Theorchestratoris trained to maximize these rewards, and successful trajectories are used to refine theplanner. By tightly coupling planning with reward driven execution, our approach yields more coherent and reliable edits than single-step or rule-based multistep baselines.
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2605\.15181
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.15181 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.15181 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.15181 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
HP-Edit: A Human-Preference Post-Training Framework for Image Editing
HP-Edit introduces a post-training framework that aligns diffusion-based image editing models with human preferences via RLHF, using a new 50K real-world dataset and an automatic VLM-based evaluator.
CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
This paper introduces CanvasCraft, a large-scale multimodal tool-use dataset for complex image creation and editing, and CanvasAgent, a tool-augmented multimodal agent that learns to orchestrate heterogeneous visual tools through multi-turn interactions and hybrid reward optimization.
ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition
ReDesign is an agentic framework that recovers editable layer hierarchies from raster images by selecting and composing specialized tools across modalities, introducing graceful verification to prevent error accumulation. It also introduces the FigmaEditReplay Benchmark for evaluating editability at scale, achieving high visual fidelity and superior editability over baselines.
SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing
SmartPhotoCrafter introduces an automatic photographic image editing pipeline that unifies quality comprehension and enhancement without explicit human instructions, outperforming existing generative models on photo-realistic enhancement tasks.
What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems
A three-stage multimodal framework improves follow-up edit recommendations in conversational image-creation systems, using SFT, multi-objective RL, and visual verification to reduce visual inconsistency and boost engagement metrics in a live A/B test.