From Plans to Pixels: Learning to Plan and Orchestrate for Open-Ended Image Editing

Hugging Face Daily Papers Papers

Summary

An experiential framework for long-horizon image editing that couples planning with reward-driven execution to improve coherence and reliability of complex multi-step edits.

Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly''). Prior agent based methods decompose such tasks but rely on handcrafted pipelines or teacher imitation, limiting flexibility and decoupling learning from actual editing outcomes. We propose an experiential framework for long-horizon image editing, where a planner generates structured atomic decompositions and an orchestrator selects tools and regions to execute each step. A vision language judge provides outcome-based rewards for instruction adherence and visual quality. The orchestrator is trained to maximize these rewards, and successful trajectories are used to refine the planner. By tightly coupling planning with reward driven execution, our approach yields more coherent and reliable edits than single-step or rule-based multistep baselines.
Original Article
View Cached Full Text

Cached at: 05/18/26, 06:24 AM

Paper page - From Plans to Pixels: Learning to Plan and Orchestrate for Open-Ended Image Editing

Source: https://huggingface.co/papers/2605.15181

Abstract

An experiential framework for long-horizon image editing that couples planning with reward-driven execution to improve coherence and reliability of complex multi-step edits.

Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly’’). Prior agent based methods decompose such tasks but rely on handcrafted pipelines or teacher imitation, limiting flexibility and decoupling learning from actual editing outcomes. We propose an experiential framework for long-horizon image editing, where aplannergenerates structuredatomic decompositionsand anorchestratorselects tools and regions to execute each step. Avision language judgeprovides outcome-based rewards forinstruction adherenceandvisual quality. Theorchestratoris trained to maximize these rewards, and successful trajectories are used to refine theplanner. By tightly coupling planning with reward driven execution, our approach yields more coherent and reliable edits than single-step or rule-based multistep baselines.

View arXiv pageView PDFProject pageAdd to collection

Get this paper in your agent:

hf papers read 2605\.15181

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2605.15181 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2605.15181 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2605.15181 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition

Hugging Face Daily Papers

ReDesign is an agentic framework that recovers editable layer hierarchies from raster images by selecting and composing specialized tools across modalities, introducing graceful verification to prevent error accumulation. It also introduces the FigmaEditReplay Benchmark for evaluating editability at scale, achieving high visual fidelity and superior editability over baselines.