面向物理信息优化的端到端可微分扩散条件化
摘要
提出了可微分扩散条件化(D2C),通过使冻结的条件扩散模型的确定性反向去噪链对条件信号可微,将其转化为基于梯度的端到端优化器,用于离线模型优化,并在激光脉冲优化、数据中心调度及 Design-Bench 任务上取得最佳结果。
查看缓存全文
缓存时间: 2026/10/28 01:29
# End-to-End Differentiable Diffusion Conditioning for Physics-Informed Optimization
Source: [https://arxiv.org/html/2610.31721](https://arxiv.org/html/2610.31721)
Vineet GundechaAffiliation:Hewlett Packard EnterpriseEmail:[vineet\.gundecha@hpe\.com](mailto:)Rahman EjazAffiliation:University of RochesterEmail:[sahand\.ghorbanpour@hpe\.com](mailto:)Varchas GopalaswamyAffiliation:University of RochesterEmail:[soumyendu\.sarkar@hpe\.com](mailto:)Riccardo BettiAffiliation:University of RochesterEmail:[reja@lle\.rochester\.edu](mailto:)Sahand GhorbanpourAffiliation:Hewlett Packard EnterpriseEmail:[vgop@lle\.rochester\.edu](mailto:)Aarne LeesAffiliation:University of RochesterEmail:[betti@lle\.rochester\.edu](mailto:)Soumyendu Sarkar††thanks:Corresponding author\. †These authors contributed equally\.Affiliation:Hewlett Packard EnterpriseEmail:[alees@lle\.rochester\.edu](mailto:)
###### Abstract
Optimizing high\-dimensional physical systems under expensive evaluations and complex constraints is a central challenge in science and engineering\. In offline model\-based optimization \(MBO\), methods must improve designs using only a fixed dataset and no test\-time access to the true objective\. However, existing methods typically suffer from conservatism, unconstrained surrogate exploitation, or function as static inference\-time samplers that cannot refine candidates against precise physical objectives\. In this paper, we propose Differentiable Diffusion Conditioning \(D2C\) for offline MBO, which leverages the fact that deterministic sampling makes the reverse denoising chain differentiable with respect to the conditioning signal\. D2C turns a frozen conditional diffusion model into an end\-to\-end gradient\-based optimizer by directly optimizing conditioning variables at test time via gradients from frozen surrogate objectives and physics\-informed penalties backpropagated through the reverse chain\. We implement this idea in a composed proposer\-evaluator framework and evaluate it on laser pulse optimization for inertial confinement fusion, sustainable data\-center workload scheduling, and four Design\-Bench tasks\. Our method achieves the strongest results on the two real\-world tasks and the best average rank across four Design\-Bench tasks\.
## 1Introduction
The optimization of complex physical systems remains one of the most consequential challenges in science and engineering\. Problems such as laser pulse shaping for inertial confinement fusion \(ICF\) and workload scheduling in large\-scale data centers share a common structure: objective functions are computationally expensive to evaluate, the design space is high\-dimensional with non\-linear correlations, and candidate solutions must satisfy strict physical constraints where any violation carries safety\-critical consequences\.
The offline model\-based optimization \(MBO\) paradigm addresses the evaluation\-cost bottleneck by learning entirely from a fixed dataset of previously evaluated designs, with no access to the true objective at test time\. Within this paradigm, existing approaches fall into three broad families\. Forward \(surrogate\-based\) methods train a neural network to approximate the objective and perform gradient ascent in design space\[[31](https://arxiv.org/html/2610.31721#bib.bib2),[9](https://arxiv.org/html/2610.31721#bib.bib3)\]; while effective, optimizing directly in unconstrained design space can move into regions poorly supported by the offline data, where the surrogate is unreliable\. Inverse methods learn a conditional mapping from target performance labels to designs\[[2](https://arxiv.org/html/2610.31721#bib.bib6),[19](https://arxiv.org/html/2610.31721#bib.bib7),[18](https://arxiv.org/html/2610.31721#bib.bib8),[22](https://arxiv.org/html/2610.31721#bib.bib39)\]; these tend to stay closer to the empirical data distribution but are limited by the performance ceiling of the training labels and struggle to extrapolate beyond observed optima\. Trajectory\-based methods construct synthetic improvement paths and train generative models to imitate optimization dynamics\[[3](https://arxiv.org/html/2610.31721#bib.bib10),[39](https://arxiv.org/html/2610.31721#bib.bib11)\]; while powerful, they remain inference\-time samplers whose conditioning targets are fixed prior to generation, with no mechanism to refine designs against downstream objectives\.
A common limitation across these families is the lack of a direct, differentiable path from a physics\-informed objective back to the generative process\. The conditioning signal that steers generation is treated as a static input rather than an optimizable variable\. This decoupling is especially limiting in safety\-critical physical domains where the objective is not a single scalar score but a composite of performance metrics, conservation laws, and hard feasibility constraints that must be jointly satisfied\.
We address these limitations by proposing Differentiable Diffusion Conditioning \(D2C\) for Physics\-Informed Optimization, a novel approach that converts a conditional diffusion model into an end\-to\-end gradient\-based optimizer for constrained physical design\. Our key insight for offline MBO is that deterministic diffusion sampling renders the reverse chain differentiable with respect to the conditioning input, enabling end\-to\-end backpropagation from downstream physics\-informed objectives, through a frozen surrogate evaluator and physics\-informed penalty terms, back to the conditioning variables\. D2C therefore optimizes conditioning directly at test time while keeping both the diffusion proposer and surrogate evaluator fixed, yielding a practical end\-to\-end gradient path from the downstream objective to the conditioning variables\. The diffusion model tends to keep candidates closer to the data distribution, while surrogate and physics\-informed losses steer them toward feasible, high\-performing designs\.
We embed this mechanism within a composed proposer\-evaluator architecture: the diffusion modelGθG\_\{\\theta\}\(proposer\) generates candidates, and a surrogateSϕS\_\{\\phi\}\(evaluator\) scores them, with both remaining fixed during test\-time optimization\. Only the conditioning input is updated, which helps keep optimization closer to the proposer’s learned data distribution while limiting direct surrogate exploitation\. A stochastic multi\-objective weighting scheme and validity\-first selection further encourage broad exploration of competing objective trade\-offs while enforcing strict constraint satisfaction\. Figure[1](https://arxiv.org/html/2610.31721#S1.F1)provides an overview of the full D2C pipeline\. Our main contributions are:
- •End\-to\-End Conditioning Optimization Through Diffusion\.We use the deterministic reverse diffusion chain to backpropagate end\-to\-end from composite physics objectives to the conditioning inputs, making the conditioning signal itself the optimization variable within the generative process; optimizing it outperforms optimizing the latent noise \(Appendix[D\.7](https://arxiv.org/html/2610.31721#A4.SS7)\)\.
- •Frozen Proposer\-Evaluator Architecture\.We introduce a composed proposer\-evaluator architecture in which a frozen diffusion proposer helps keep candidates closer to the empirical data distribution, while a frozen surrogate evaluator provides optimization gradients, reducing out\-of\-distribution exploitation\.
- •Physics\-Informed Multi\-Objective Optimization\.We integrate heterogeneous objectives directly into the differentiable sampling chain via a stochastic Dirichlet\-weighted loss, enabling principled multi\-objective optimization under domain\-specific constraints\.
- •Strong Empirical Performance\.D2C achieves the best results on the two real\-world physical design tasks and the best average rank across four Design\-Bench tasks\.
Figure 1:Overview of D2C\. A frozen conditional diffusion proposer generates designs from conditioning inputs, a frozen surrogate evaluator and physics\-informed penalties define a differentiable test\-time objective, and gradients are backpropagated through the deterministic DDIM chain to optimize the conditioning signal\. Multiple noise trials and loss\-weight samples produce a candidate pool, from which the best valid design is selected after domain\-specific constraint checks\.
## 2Preliminaries
### 2\.1Conditional Denoising Diffusion Models
Denoising Diffusion Probabilistic Models \(DDPMs\)\[[14](https://arxiv.org/html/2610.31721#bib.bib19)\]learn a generative model of a data distributionp\(x\)p\(x\)by reversing a forward noise process\. In the conditional setting, the model learns to samplex∼p\(x\|c\)x\\sim p\(x\|c\)given a conditioning signalc∈ℝdcc\\in\\mathbb\{R\}^\{d\_\{c\}\}\. For a continuous design spacex∈ℝdx\\in\\mathbb\{R\}^\{d\}, the forward process adds Gaussian noise according to a variance scheduleβ1,…,βT\\beta\_\{1\},\\dots,\\beta\_\{T\}:
q\(xt\|xt−1\)=𝒩\(xt,1−βtxt−1,βt𝐈\)q\(x\_\{t\}\|x\_\{t\-1\}\)=\\mathcal\{N\}\(x\_\{t\};\\sqrt\{1\-\\beta\_\{t\}\}x\_\{t\-1\},\\beta\_\{t\}\\mathbf\{I\}\)\(1\)A noise\-prediction networkϵθ\(xt,c,t\)\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)is trained by minimizing the denoising objective:
ℒdiff=𝔼x∼p\(x∣c\),ϵ∼𝒩\(0,𝐈\),t∼Unif\(\{1,…,T\}\)\[‖ϵ−ϵθ\(xt,c,t\)‖2\]\\mathcal\{L\}\_\{diff\}=\\mathbb\{E\}\_\{x\\sim p\(x\\mid c\),\\,\\epsilon\\sim\\mathcal\{N\}\(0,\\mathbf\{I\}\),\\,t\\sim\\mathrm\{Unif\}\(\\\{1,\\ldots,T\\\}\)\}\\left\[\\\|\\epsilon\-\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\\\|^\{2\}\\right\]\(2\)wherext=α¯tx\+1−α¯tϵx\_\{t\}=\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}x\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\epsilonandα¯t=∏i=1t\(1−βi\)\\bar\{\\alpha\}\_\{t\}=\\prod\_\{i=1\}^\{t\}\(1\-\\beta\_\{i\}\)\.
### 2\.2Deterministic DDIM Sampling
Denoising Diffusion Implicit Models \(DDIM\)\[[29](https://arxiv.org/html/2610.31721#bib.bib18)\]generalize the sampling process by considering a non\-Markovian forward process that yields the same marginals as DDPM\. Crucially, DDIM allows for a deterministic mapping from a latent noisexTx\_\{T\}to a clean samplex0x\_\{0\}\. The update rule is given by:
xt−1=α¯t−1\(xt−1−α¯tϵθ\(xt,c,t\)α¯t\)\+1−α¯t−1ϵθ\(xt,c,t\)x\_\{t\-1\}=\\sqrt\{\\bar\{\\alpha\}\_\{t\-1\}\}\\left\(\\frac\{x\_\{t\}\-\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\}\{\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}\}\\right\)\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\-1\}\}\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\(3\)Eq\. \([3](https://arxiv.org/html/2610.31721#S2.E3)\) gives the fully deterministic DDIM update \(σt=0\\sigma\_\{t\}=0\), in which the stochastic noise term is omitted and the sampling chain becomes a deterministic discrete mapping fromxTx\_\{T\}tox0x\_\{0\}\. This update can be viewed as a discrete analogue of the probability\-flow ODE perspective, but here we rely only on the finite\-step deterministic map induced by the sampler\. This determinism ensures that the mappingGθ:\(c,xT\)↦x0G\_\{\\theta\}:\(c,x\_\{T\}\)\\mapsto x\_\{0\}is differentiable with respect to the conditioning inputcc\.
### 2\.3Classifier\-Free Guidance \(CFG\)
Classifier\-Free Guidance is a technique to improve the adherence of the generated samples to the conditioning signalcc\. During training, the conditioningccis randomly replaced with a null token∅\\emptysetwith probabilitypdropp\_\{\\mathrm\{drop\}\}\. At inference time, the noise estimate is interpolated between the conditional and unconditional predictions:
ϵ~θ\(xt,c,t\)=ϵθ\(xt,∅,t\)\+w\(ϵθ\(xt,c,t\)−ϵθ\(xt,∅,t\)\)\\tilde\{\\epsilon\}\_\{\\theta\}\(x\_\{t\},c,t\)=\\epsilon\_\{\\theta\}\(x\_\{t\},\\emptyset,t\)\+w\(\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\-\\epsilon\_\{\\theta\}\(x\_\{t\},\\emptyset,t\)\)\(4\)wherew≥0w\\geq 0is the guidance scale \(w=0w=0yields unconditional sampling,w=1w=1recovers standard conditional sampling, andw\>1w\>1amplifies conditioning adherence\)\. In D2C, we use this guidance not only to bias sampling but also to provide a stable optimization regime in which gradient\-based updates ofcccan proceed\.
## 3Methodology
We present Differentiable Diffusion Conditioning \(D2C\), a framework that enables a pretrained conditional diffusion model to function as an end\-to\-end gradient\-based optimizer for physical design\. The key idea is a composed proposer\-evaluator architecture in which a conditional diffusion model serves as a differentiable proposer and a frozen forward surrogate provides a training\-time consistency signal and inference\-time gradient guidance\. Algorithm[1](https://arxiv.org/html/2610.31721#alg1)summarizes the full pipeline\. We describe each component below\.
### 3\.1Problem Formulation
Letx∈𝒳⊆ℝdx\\in\\mathcal\{X\}\\subseteq\\mathbb\{R\}^\{d\}denote a physical design \(e\.g\. a temporal power profile or a laser pulse shape\) andc∈𝒞⊆ℝdcc\\in\\mathcal\{C\}\\subseteq\\mathbb\{R\}^\{d\_\{c\}\}its associated conditioning vector encoding environmental state and performance targets\. We decompose the conditioning into a fixed componentcfixc\_\{\\mathrm\{fix\}\}\(immutable physical context such as ambient conditions\) and an optimizable componentcoptc\_\{\\mathrm\{opt\}\}\(optimizable performance targets\):
c=\(cfix,copt\),cfix∈ℝdf,copt∈ℝdo,df\+do=dc\.c=\(c\_\{\\mathrm\{fix\}\},\\;c\_\{\\mathrm\{opt\}\}\),\\qquad c\_\{\\mathrm\{fix\}\}\\in\\mathbb\{R\}^\{d\_\{f\}\},\\;\\;c\_\{\\mathrm\{opt\}\}\\in\\mathbb\{R\}^\{d\_\{o\}\},\\;\\;d\_\{f\}\+d\_\{o\}=d\_\{c\}\.\(5\)Given a pretrained conditional diffusion model with frozen parametersθ\\thetaand a deterministic reverse chainGθ:𝒞×ℝd→𝒳G\_\{\\theta\}:\\mathcal\{C\}\\times\\mathbb\{R\}^\{d\}\\to\\mathcal\{X\}mapping conditioning and a latent noise vector to a designx0=Gθ\(c,xT\)x\_\{0\}=G\_\{\\theta\}\(c,x\_\{T\}\), we seek, for a*fixed*noise realizationxTx\_\{T\}:
copt∗\(xT\)=argmincoptℒ\(Gθ\(\(cfix,copt\),xT\),xref,cfix\),xT∼𝒩\(0,𝐈\)\.c\_\{\\mathrm\{opt\}\}^\{\*\}\(x\_\{T\}\)=\\arg\\min\_\{c\_\{\\mathrm\{opt\}\}\}\\;\\mathcal\{L\}\\\!\\bigl\(G\_\{\\theta\}\\\!\\left\(\(c\_\{\\mathrm\{fix\}\},\\,c\_\{\\mathrm\{opt\}\}\),\\,x\_\{T\}\\right\),\\;x\_\{\\mathrm\{ref\}\},\\;c\_\{\\mathrm\{fix\}\}\\bigr\),\\qquad x\_\{T\}\\sim\\mathcal\{N\}\(0,\\mathbf\{I\}\)\.\(6\)Each drawxTx\_\{T\}induces a different deterministic mappingGθ\(⋅,xT\)G\_\{\\theta\}\(\\cdot,x\_\{T\}\); the optimization is therefore conditional on the noise realization\. To cover multiple modes, we solve Eq\. \([6](https://arxiv.org/html/2610.31721#S3.E6)\) independently forNzN\_\{z\}draws and select the best feasible solution \(Section[3\.6](https://arxiv.org/html/2610.31721#S3.SS6)\)\. Herexrefx\_\{\\mathrm\{ref\}\}is the reference \(baseline\) design andℒ\\mathcal\{L\}is a composite physics\-informed loss detailed in Section[3\.5](https://arxiv.org/html/2610.31721#S3.SS5)\.
### 3\.2Composed Proposer–Evaluator Architecture
D2C employs a composed proposer\-evaluator architecture consisting of a conditional diffusion modelGθG\_\{\\theta\}\(the*proposer*\) that generates designs from conditioning inputs, and a forward surrogateSϕS\_\{\\phi\}\(the*evaluator*\) that predicts performance metrics from designs:
y^=Sϕ\(x,cfix\),y^∈ℝdy,\\hat\{y\}=S\_\{\\phi\}\(x,\\,c\_\{\\mathrm\{fix\}\}\),\\qquad\\hat\{y\}\\in\\mathbb\{R\}^\{d\_\{y\}\},\(7\)wherey^\\hat\{y\}are predicted scalar quantities \(e\.g\., energy consumption, yield, carbon emissions\)\. The surrogateSϕS\_\{\\phi\}is trained independently on the same dataset and remains frozen throughout\.
This architecture serves two roles: providing a surrogate consistency signal during training \(Section[3\.3](https://arxiv.org/html/2610.31721#S3.SS3)\) and an objective gradient∇x0ℒobj\\nabla\_\{x\_\{0\}\}\\mathcal\{L\}\_\{\\mathrm\{obj\}\}during inference\-time optimization \(Section[3\.5](https://arxiv.org/html/2610.31721#S3.SS5)\)\.
### 3\.3Training the Conditional Diffusion Proposer
The proposerGθG\_\{\\theta\}is trained offline on a dataset𝒟=\{\(cfix,i,xi,yi\)\}i=1N\\mathcal\{D\}=\\\{\(c\_\{\\mathrm\{fix\},i\},\\,x\_\{i\},\\,y\_\{i\}\)\\\}\_\{i=1\}^\{N\}, whereyi∈ℝdoy\_\{i\}\\in\\mathbb\{R\}^\{d\_\{o\}\}are observed performance metrics\. The full conditioning is assembled asci=\(cfix,i,yi\)c\_\{i\}=\(c\_\{\\mathrm\{fix\},i\},\\,y\_\{i\}\), so the metrics serve dual roles: as supervised labels for the surrogateSϕS\_\{\\phi\}and as the optimizable conditioning targetscoptc\_\{\\mathrm\{opt\}\}that steer generation\. The training objective combines the standard denoising score\-matching loss with auxiliary terms that improve generation fidelity:
ℒtrain=‖ϵ−ϵθ\(xt,c,t\)‖2⏟denoising\+αr‖x^0−x‖2⏟reconstruction\+αaℒfid\(x^0,x\)⏟physics\-based fidelity\+αs‖Sϕ\(x^0,cfix\)−y‖2⏟surrogate consistency,\\mathcal\{L\}\_\{\\mathrm\{train\}\}=\\underbrace\{\\\|\\epsilon\-\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\\\|^\{2\}\}\_\{\\text\{denoising\}\}\+\\alpha\_\{r\}\\,\\underbrace\{\\\|\\hat\{x\}\_\{0\}\-x\\\|^\{2\}\}\_\{\\text\{reconstruction\}\}\+\\alpha\_\{a\}\\,\\underbrace\{\\mathcal\{L\}\_\{\\mathrm\{fid\}\}\(\\hat\{x\}\_\{0\},x\)\}\_\{\\text\{physics\-based fidelity\}\}\+\\alpha\_\{s\}\\,\\underbrace\{\\\|S\_\{\\phi\}\(\\hat\{x\}\_\{0\},c\_\{\\mathrm\{fix\}\}\)\-y\\\|^\{2\}\}\_\{\\text\{surrogate consistency\}\},\(8\)wherext=α¯tx\+1−α¯tϵx\_\{t\}=\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}\\,x\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\,\\epsilonis the noised sample withϵ∼𝒩\(0,𝐈\)\\epsilon\\sim\\mathcal\{N\}\(0,\\mathbf\{I\}\), andx^0\\hat\{x\}\_\{0\}is the one\-step predicted clean sample:
x^0=xt−1−α¯tϵθ\(xt,c,t\)α¯t\.\\hat\{x\}\_\{0\}=\\frac\{x\_\{t\}\-\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\,\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\}\{\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}\}\.\(9\)The physics\-based fidelity termℒfid\\mathcal\{L\}\_\{\\mathrm\{fid\}\}encodes domain\-specific structural constraints on the generated design, for example, integral conservation laws, peak\-amplitude bounds, or spectral regularity\. We express it generically as:
ℒfid\(x^0,x\)=∑k\[gk\(x^0\)−gk\(x\)\]\+,\\mathcal\{L\}\_\{\\mathrm\{fid\}\}\(\\hat\{x\}\_\{0\},x\)=\\sum\_\{k\}\\bigl\[g\_\{k\}\(\\hat\{x\}\_\{0\}\)\-g\_\{k\}\(x\)\\bigr\]\_\{\+\},\(10\)where eachgkg\_\{k\}is a scalar functional encoding a physical constraint and\[⋅\]\+=max\(⋅,0\)\[\\cdot\]\_\{\+\}=\\max\(\\cdot,0\)ensures the penalty activates only when the generated design exceeds the reference on that constraint\. In the smooth case, the resulting penalty is differentiable almost everywhere; some instantiated constraints additionally use non\-smooth operators such as coordinatewisemax/min\\max/\\min, which are handled in practice with automatic\-differentiation subgradients\. The concrete instantiations ofℒfid\\mathcal\{L\}\_\{\\mathrm\{fid\}\}and the surrogate consistency term for each application domain are detailed in Appendix[E](https://arxiv.org/html/2610.31721#A5)\. The surrogate consistency term leverages the composed architecture of Section[3\.2](https://arxiv.org/html/2610.31721#S3.SS2): the frozen evaluatorSϕS\_\{\\phi\}maps generated designs back to the performance\-metric space, encouraging the proposer to produce physically consistent outputs\.
To enable classifier\-free guidance at inference, the conditioning is randomly replaced with a learned null embedding∅\\emptysetwith probabilitypdropp\_\{\\mathrm\{drop\}\}during training\. Exponential moving averaging \(EMA\) of model weights with decayβ\\betafurther stabilizes generation quality\. Once training converges, all proposer parametersθ\\thetaare frozen\.
### 3\.4Differentiable DDIM Reverse Chain
The key observation is that when the DDIM sampler uses zero noise \(σt=0\\sigma\_\{t\}=0\), the entire reverse chain becomes a deterministic, differentiable function of its inputs, including the conditioningcc\. With the proposer frozen, we establish the differentiable path fromℒ\\mathcal\{L\}tocoptc\_\{\\mathrm\{opt\}\}required by Eq\. \([6](https://arxiv.org/html/2610.31721#S3.E6)\)\. Each reverse step takes the form:
xt−1=α¯t−1x^0\(xt,c,t\)\+1−α¯t−1ϵ~θ\(xt,c,t\),x\_\{t\-1\}=\\sqrt\{\\bar\{\\alpha\}\_\{t\-1\}\}\\;\\hat\{x\}\_\{0\}\(x\_\{t\},c,t\)\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\-1\}\}\\;\\tilde\{\\epsilon\}\_\{\\theta\}\(x\_\{t\},c,t\),\(11\)wherex^0\(xt,c,t\)=\(xt−1−α¯tϵ~θ\)/α¯t\\hat\{x\}\_\{0\}\(x\_\{t\},c,t\)=\\bigl\(x\_\{t\}\-\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\;\\tilde\{\\epsilon\}\_\{\\theta\}\\bigr\)/\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}is the predicted clean sample, andϵ~θ\\tilde\{\\epsilon\}\_\{\\theta\}is the CFG\-guided noise estimate\[[15](https://arxiv.org/html/2610.31721#bib.bib20)\]:
ϵ~θ\(xt,c,t\)=ϵθ\(xt,∅,t\)\+w\(ϵθ\(xt,c,t\)−ϵθ\(xt,∅,t\)\),\\tilde\{\\epsilon\}\_\{\\theta\}\(x\_\{t\},c,t\)=\\epsilon\_\{\\theta\}\(x\_\{t\},\\emptyset,t\)\+w\\bigl\(\\epsilon\_\{\\theta\}\(x\_\{t\},c,t\)\-\\epsilon\_\{\\theta\}\(x\_\{t\},\\emptyset,t\)\\bigr\),\(12\)with∅\\emptysetthe learned null embedding andw≥0w\\geq 0the guidance scale\. Because every operation is deterministic and differentiable, the fullTT\-step compositionGθ\(c,xT\)=x0G\_\{\\theta\}\(c,x\_\{T\}\)=x\_\{0\}is differentiable with respect tocc\. The conditioningccis injected at every timestep, providing gradient shortcut connections that mitigate vanishing gradients across deep chains\. The guidance scalewwmodulates the magnitude of∂ϵ~θ/∂c\\partial\\tilde\{\\epsilon\}\_\{\\theta\}/\\partial c, controlling both generation fidelity and optimization stability\.
### 3\.5Inference\-Time Conditioning Optimization
WithGθG\_\{\\theta\}andSϕS\_\{\\phi\}, we optimizecoptc\_\{\\mathrm\{opt\}\}by backpropagating a composite loss through the DDIM chain\. The loss is a weighted combination ofKKdifferentiable penalty terms:
ℒ=∑k=1Kλkℒk\(x0,xref,cfix\),\\mathcal\{L\}=\\sum\_\{k=1\}^\{K\}\\lambda\_\{k\}\\,\\mathcal\{L\}\_\{k\}\(x\_\{0\},\\,x\_\{\\mathrm\{ref\}\},\\,c\_\{\\mathrm\{fix\}\}\),\(13\)where eachℒk\\mathcal\{L\}\_\{k\}is a scalar loss computed from the generated designx0=Gθ\(c,xT\)x\_\{0\}=G\_\{\\theta\}\(c,x\_\{T\}\), the reference designxrefx\_\{\\mathrm\{ref\}\}, and/or the fixed conditioningcfixc\_\{\\mathrm\{fix\}\}\(e\.g\., the surrogate evaluationSϕ\(x0,cfix\)S\_\{\\phi\}\(x\_\{0\},c\_\{\\mathrm\{fix\}\}\)\), and the weights𝝀=\(λ1,…,λK\)\\boldsymbol\{\\lambda\}=\(\\lambda\_\{1\},\\ldots,\\lambda\_\{K\}\)control the trade\-off among competing objectives\. Crucially, no loss term depends directly on the optimizable componentcoptc\_\{\\mathrm\{opt\}\}; all losses are functions of the*realized design*x0x\_\{0\}only\. The conditioningcoptc\_\{\\mathrm\{opt\}\}influences the loss exclusively through its effect on the generated design viax0=Gθ\(\(cfix,copt\),xT\)x\_\{0\}=G\_\{\\theta\}\(\(c\_\{\\mathrm\{fix\}\},c\_\{\\mathrm\{opt\}\}\),x\_\{T\}\), ensuring that any reported improvement reflects a genuine change in the physical design rather than a shift in target labels\. In the instantiated losses used here, some penalty terms include non\-smooth operators such as coordinatewisemax/min\\max/\\min, so optimization is implemented through the deterministic reverse chain with practical automatic\-differentiation subgradients where needed\.
The loss terms are domain\-specific but follow a common taxonomy\. A*surrogate objective*term uses the frozen evaluator to maximize a target metric \(e\.g\.,ℒobj=−Sϕ\(x0,cfix\)k\\mathcal\{L\}\_\{\\mathrm\{obj\}\}=\-S\_\{\\phi\}\(x\_\{0\},c\_\{\\mathrm\{fix\}\}\)\_\{k\}for target metrickk\);*constraint*terms penalize violations of physical invariants \(integral conservation, amplitude bounds, spectral stability\); and a*smoothness*term enforces temporal or spatial regularity\. The task\-specific loss terms are constructed to be on broadly comparable scales; the concrete loss definitions for each application are given in Appendix[F](https://arxiv.org/html/2610.31721#A6)\.
At each optimization step, the conditioning is updated via gradient descent:
copt\(j\+1\)=copt\(j\)−η∇coptℒ\(Gθ\(c\(j\),xT\),xref,cfix\),c\_\{\\mathrm\{opt\}\}^\{\(j\+1\)\}=c\_\{\\mathrm\{opt\}\}^\{\(j\)\}\-\\eta\\,\\nabla\_\{c\_\{\\mathrm\{opt\}\}\}\\mathcal\{L\}\\\!\\bigl\(G\_\{\\theta\}\(c^\{\(j\)\},x\_\{T\}\),\\,x\_\{\\mathrm\{ref\}\},\\,c\_\{\\mathrm\{fix\}\}\\bigr\),\(14\)wherej=0,…,J−1j=0,\\ldots,J\{\-\}1indexes optimization steps,η\\etais the learning rate, andxTx\_\{T\}is held fixed throughout\. In practice, any first\-order optimizer \(e\.g\., Adam\) can replace vanilla gradient descent; the key requirement is differentiability of the full chain\. Crucially, onlycoptc\_\{\\mathrm\{opt\}\}receives gradient updates;θ\\thetaandϕ\\phiremain frozen\. This mitigates the risk of surrogate exploitation common in unconstrained model\-based optimization\[[31](https://arxiv.org/html/2610.31721#bib.bib2)\]: under suitably tuned guidance, the generative model helps keep designs closer to the empirical data distribution induced by the learned prior while the surrogate provides only a directional gradient signal\.
### 3\.6Stochastic Coverage and Candidate Selection
Since the mappingGθ\(c,xT\)G\_\{\\theta\}\(c,x\_\{T\}\)depends on the latent noisexTx\_\{T\}, a single noise draw may not expose the best mode of the conditional distribution\. To ensure broad coverage without sacrificing differentiability, we adopt a two\-level diversification strategy\.
##### Noise trials\.
For each input, we drawNzN\_\{z\}independent noise vectors\{xT\(n\)\}n=1Nz\\\{x\_\{T\}^\{\(n\)\}\\\}\_\{n=1\}^\{N\_\{z\}\}, each held fixed during optimization\. Each trial explores a different region of the latent space, producing structurally distinct candidates\.
##### Weight diversity\.
Within each noise trial, we instantiateNλN\_\{\\lambda\}loss\-weight vectors𝝀\(m\)∼Dir\(𝜶\)\\boldsymbol\{\\lambda\}^\{\(m\)\}\\sim\\mathrm\{Dir\}\(\\boldsymbol\{\\alpha\}\)drawn from a symmetric Dirichlet distribution\[[8](https://arxiv.org/html/2610.31721#bib.bib30)\]withαk=1\\alpha\_\{k\}=1for allkk\(i\.e\., uniform over the simplex; see Appendix[G](https://arxiv.org/html/2610.31721#A7)for details\)\. The Dirichlet distribution ensures each weight vector sums to one and covers the full trade\-off simplex uniformly, so no single objective dominates across all trajectories\. This yieldsB=Nz×NλB=N\_\{z\}\\times N\_\{\\lambda\}parallel trajectories per sample, each emphasizing a different trade\-off among competing objectives\.
##### Candidate selection\.
AfterJJoptimization steps, each trajectory produces a candidatex0\(b\)x\_\{0\}^\{\(b\)\}\. Each candidate is then validated against domain\-specific hard physical constraints𝒞\(x0\)≤𝟎\\mathcal\{C\}\(x\_\{0\}\)\\leq\\mathbf\{0\}\(e\.g\., temperature limits, integral tolerances; see Appendix[C](https://arxiv.org/html/2610.31721#A3)for details\)\. Among candidates that satisfy the hard constraints, the one with the best primary objective is selected; if no candidate passes all constraints, the baseline designxrefx\_\{\\mathrm\{ref\}\}is retained \(yielding0%0\\%gain\)\.
Algorithm 1D2C: Differentiable Diffusion Conditioning0:Dataset
𝒟=\{\(cfix,i,xi,yi\)\}\\mathcal\{D\}=\\\{\(c\_\{\\mathrm\{fix\},i\},\\,x\_\{i\},\\,y\_\{i\}\)\\\}with
ci=\(cfix,i,yi\)c\_\{i\}=\(c\_\{\\mathrm\{fix\},i\},\\,y\_\{i\}\); test sample
\(c,xref\)\(c,\\,x\_\{\\mathrm\{ref\}\}\)
0:Noise trials
NzN\_\{z\}, weight samples
NλN\_\{\\lambda\}, optimization steps
JJ, guidance scale
ww
1:Train surrogate
SϕS\_\{\\phi\}on
\{\(xi,cfix,i\)→yi\}\\\{\(x\_\{i\},\\,c\_\{\\mathrm\{fix\},i\}\)\\to y\_\{i\}\\\}; freeze
ϕ\\phi
2:Train
ϵθ\\epsilon\_\{\\theta\}on
𝒟\\mathcal\{D\}using
ℒtrain\\mathcal\{L\}\_\{\\mathrm\{train\}\}\(Eq\.[8](https://arxiv.org/html/2610.31721#S3.E8)\) with CFG dropout
pdropp\_\{\\mathrm\{drop\}\}and frozen
SϕS\_\{\\phi\}; freeze
θ\\theta
3:
4:Decompose
c=\(cfix,copt\(0\)\)c=\(c\_\{\\mathrm\{fix\}\},\\,c\_\{\\mathrm\{opt\}\}^\{\(0\)\}\)
5:
ℛ←∅\\mathcal\{R\}\\leftarrow\\emptyset\{candidate pool\}
6:for
n=1,…,Nzn=1,\\ldots,N\_\{z\}do
7:Sample
xT\(n\)∼𝒩\(0,𝐈\)x\_\{T\}^\{\(n\)\}\\sim\\mathcal\{N\}\(0,\\mathbf\{I\}\)
8:for
m=1,…,Nλm=1,\\ldots,N\_\{\\lambda\}do
9:Sample
𝝀\(m\)∼Dir\(𝜶\)\\boldsymbol\{\\lambda\}^\{\(m\)\}\\sim\\mathrm\{Dir\}\(\\boldsymbol\{\\alpha\}\)
10:Initialize
copt←copt\(0\)c\_\{\\mathrm\{opt\}\}\\leftarrow c\_\{\\mathrm\{opt\}\}^\{\(0\)\}
11:for
j=1,…,Jj=1,\\ldots,Jdo
12:
x0←Gθ\(\(cfix,copt\),xT\(n\),w\)x\_\{0\}\\leftarrow G\_\{\\theta\}\\bigl\(\(c\_\{\\mathrm\{fix\}\},\\,c\_\{\\mathrm\{opt\}\}\),\\,x\_\{T\}^\{\(n\)\};\\,w\\bigr\)\{Eqs\.[11](https://arxiv.org/html/2610.31721#S3.E11)–[12](https://arxiv.org/html/2610.31721#S3.E12)\}
13:
ℒ←∑kλk\(m\)ℒk\(x0,xref,cfix\)\\mathcal\{L\}\\leftarrow\\sum\_\{k\}\\lambda\_\{k\}^\{\(m\)\}\\,\\mathcal\{L\}\_\{k\}\(x\_\{0\},\\,x\_\{\\mathrm\{ref\}\},\\,c\_\{\\mathrm\{fix\}\}\)\{Eq\.[13](https://arxiv.org/html/2610.31721#S3.E13)\}
14:
copt←copt−η∇coptℒc\_\{\\mathrm\{opt\}\}\\leftarrow c\_\{\\mathrm\{opt\}\}\-\\eta\\,\\nabla\_\{c\_\{\\mathrm\{opt\}\}\}\\mathcal\{L\}\{backprop through
GθG\_\{\\theta\},
SϕS\_\{\\phi\}\}
15:endfor
16:
ℛ←ℛ∪\{Gθ\(\(cfix,copt\),xT\(n\),w\)\}\\mathcal\{R\}\\leftarrow\\mathcal\{R\}\\cup\\bigl\\\{G\_\{\\theta\}\\bigl\(\(c\_\{\\mathrm\{fix\}\},\\,c\_\{\\mathrm\{opt\}\}\),\\,x\_\{T\}^\{\(n\)\};\\,w\\bigr\)\\bigr\\\}
17:endfor
18:endfor
19:
20:
𝒱←\{x∈ℛ∣𝒞\(x\)≤𝟎\}\\mathcal\{V\}\\leftarrow\\\{x\\in\\mathcal\{R\}\\mid\\mathcal\{C\}\(x\)\\leq\\mathbf\{0\}\\\}\{filter by hard constraints\}
21:if
𝒱≠∅\\mathcal\{V\}\\neq\\emptysetthen
22:return
argminx∈𝒱ℒobj\(x\)\\arg\\min\_\{x\\in\\mathcal\{V\}\}\\mathcal\{L\}\_\{\\mathrm\{obj\}\}\(x\)\{surrogate objective\}
23:else
24:return
xrefx\_\{\\mathrm\{ref\}\}\{no valid improving candidate; retain baseline \(0% gain\)\}
25:endif
## 4Experiments
We evaluate D2C on two sets of tasks: \(i\) two real\-world physical design problems where constraint satisfaction is safety\-critical, and \(ii\) the standard Design\-Bench\[[30](https://arxiv.org/html/2610.31721#bib.bib1)\]benchmark suite for offline model\-based optimization\. Although D2C is motivated by constrained physical domains, we also evaluate it on Design\-Bench to test whether the same mechanism remains strong on standard offline MBO benchmarks beyond the application domains that motivate the method\. Additional implementation, hyperparameter, and evaluation details are provided in Appendices[A](https://arxiv.org/html/2610.31721#A1)and[B\.4](https://arxiv.org/html/2610.31721#A2.SS4)\.
### 4\.1Real\-World Physical Design Tasks
##### Inertial Confinement Fusion \(ICF\) laser pulse optimization\.
In ICF, a precisely shaped laser pulse drives the implosion of a deuterium\-tritium fuel capsule to achieve thermonuclear ignition\. The design variablex∈ℝ256x\\in\\mathbb\{R\}^\{256\}is a temporal laser power profile discretized into 256 time steps, and the conditioning signalccencodes target specifications \(cfixc\_\{\\mathrm\{fix\}\}, 7 dimensions\) and 20 performance metrics \(coptc\_\{\\mathrm\{opt\}\}\) derived from LILAC, the radiation\-hydrodynamics simulation code used for inertial\-confinement\-fusion design studies\. At inference, D2C optimizes the 20 performance targets to steer the proposer toward higher\-yield pulses\. The primary objective is to maximize neutron yield, subject to constraints on pulse energy conservation \(the integral of the optimized pulse must match the reference\), temporal smoothness \(to ensure manufacturability\), and spectral fidelity \(the frequency content must remain physically plausible\)\. Designs that violate these constraints are operationally unsafe and cannot be fielded on a real facility; the concrete validation criteria are detailed in Appendix[C](https://arxiv.org/html/2610.31721#A3)\.
##### Data center workload scheduling\.
For this task we follow the SustainDC\[[24](https://arxiv.org/html/2610.31721#bib.bib28)\]framework where the goal is to reduce the carbon footprint of large\-scale data centers, which requires scheduling computational workloads to exploit temporal variations in grid carbon intensity and cooling efficiency\. Here,x∈ℝ144x\\in\\mathbb\{R\}^\{144\}is a 24\-hour workload power profile at 10\-minute resolution, andccencodes environmental state variables \(cfixc\_\{\\mathrm\{fix\}\}, 73 dimensions: ambient temperatures, cooling set\-points, IT demand\) and energy metrics \(coptc\_\{\\mathrm\{opt\}\}, 10 dimensions: total power, carbon intensity, etc\.\)\. At inference, D2C optimizes the 10 energy metric targets to minimize emissions\. The objective is to minimize operational carbon emissions while satisfying a hard workload conservation constraint: the total compute delivered must equal the demand \(the integral of the optimized profile must match the reference within a tight tolerance\)\. Additional constraints include inlet temperature safety limits\. Final designs are validated against the full SustainDC thermal model \(Appendix[C](https://arxiv.org/html/2610.31721#A3)\)\.
### 4\.2Design\-Bench Benchmarks
To position D2C among established MBO methods, we evaluate on four tasks from Design\-Bench\[[30](https://arxiv.org/html/2610.31721#bib.bib1)\]:Ant Morphology\(continuous, 60\-d\),D’Kitty Morphology\(continuous, 56\-d\),TF Bind 8\(discrete, 8\-d\), andTF Bind 10\(discrete, 10\-d\)\. These tasks span transcription factor binding \(DNA sequence design\) and robot morphology optimization, providing a diverse testbed for offline optimization from fixed datasets\. The goal in each task is to maximize a black\-box oracle score using only the offline dataset\.
### 4\.3Baselines
We compare against 12 baselines, 11 of which are commonly used in offline MBO: Gradient Ascent, COMs\[[31](https://arxiv.org/html/2610.31721#bib.bib2)\], BDI\[[5](https://arxiv.org/html/2610.31721#bib.bib21)\], CbAS\[[2](https://arxiv.org/html/2610.31721#bib.bib6)\], MINs\[[19](https://arxiv.org/html/2610.31721#bib.bib7)\], REINFORCE\[[34](https://arxiv.org/html/2610.31721#bib.bib23)\], DDOM\[[18](https://arxiv.org/html/2610.31721#bib.bib8)\], GTG\[[39](https://arxiv.org/html/2610.31721#bib.bib11)\], PGS\[[3](https://arxiv.org/html/2610.31721#bib.bib10)\], GP\-qEI\[[28](https://arxiv.org/html/2610.31721#bib.bib24)\], CMA\-ES\[[13](https://arxiv.org/html/2610.31721#bib.bib22)\], and Brute Force, a diffusion\-based approach that replaces gradient\-based conditioning optimization with a forward\-only sweep overcoptc\_\{\\mathrm\{opt\}\}\(Appendix[A](https://arxiv.org/html/2610.31721#A1)\)\. For the real\-world tasks, all surrogate\-based baselines share the same frozenSϕS\_\{\\phi\}\.
### 4\.4Main Results
Table[1](https://arxiv.org/html/2610.31721#S4.T1)reports results on the real\-world tasks\. All results report mean±\\pmstandard deviation over 5 independent runs with different random seeds; the same seeds and test samples are used across all methods\. Following the standard MBO candidate\-generation protocol\[[30](https://arxiv.org/html/2610.31721#bib.bib1),[18](https://arxiv.org/html/2610.31721#bib.bib8),[39](https://arxiv.org/html/2610.31721#bib.bib11)\], all baselines generate 128 candidate designs per test sample; D2C generates 100 candidates per sample\. For the real\-world tasks, these 100 candidates arise fromNz=20N\_\{z\}\{=\}20noise trials×\\timesNλ=5N\_\{\\lambda\}\{=\}5weight samples; for Design\-Bench, we use 100 latent/noise trials \(Nλ=1N\_\{\\lambda\}\{=\}1since single objective\) with the Design\-Bench\-specific setup described in Appendix[B\.4](https://arxiv.org/html/2610.31721#A2.SS4)\. For the real\-world tasks we report gains in terms of % neutron yield improvement for ICF and % carbon\-footprint reduction for the data center task\. For ICF, final performance is evaluated by a separate LILAC\-validated evaluation oracle \(Appendix[B\.2](https://arxiv.org/html/2610.31721#A2.SS2)\); for DC, generated workloads are evaluated directly on the SustainDC physics\-based simulator\. For Design\-Bench, we report 100th\-percentile normalized score of the best design found as is standard\[[30](https://arxiv.org/html/2610.31721#bib.bib1),[18](https://arxiv.org/html/2610.31721#bib.bib8),[39](https://arxiv.org/html/2610.31721#bib.bib11)\]\. ICF Standard evaluates optimization over 2,000 randomly sampled pulses from the test set \(the same 2,000 for all methods\); ICF Top selects the 1,000 highest\-yield designs from the test set and optimizes only those, stress\-testing each method on the hardest cases where the baseline design is already among the best\. For all tasks, only candidates that pass the domain\-specific hard constraints \(Section[3\.6](https://arxiv.org/html/2610.31721#S3.SS6.SSS0.Px3)\) are counted as improvements; samples where no valid improving candidate is found retain the baseline design and contribute0%0\\%gain\.
Table 1:Real\-world physical design tasks\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.Bold: best\.##### Real\-world tasks\.
D2C achieves the highest improvement on all three real\-world settings \(Table[1](https://arxiv.org/html/2610.31721#S4.T1)\)\. On ICF Standard, D2C improves yield by17\.98%17\.98\\%, outperforming all baselines by a large margin\. On ICF Top, where the baseline designs are already high\-yield, D2C achieves10\.06%10\.06\\%, more than two and a half times the best baseline, Brute Force \(3\.93%3\.93\\%\)\. This suggests that differentiable guidance through the DDIM chain enables more precise conditioning than fixed\-target generation, especially in the high\-performance regime\. On data center scheduling \(DC\), D2C reduces carbon emissions by8\.98%8\.98\\%, surpassing the best baseline GP\-qEI \(5\.93%5\.93\\%\) and the best generative baseline GTG \(5\.50%5\.50\\%\)\.
Table 2:Design\-Bench tasks\. 100th\-percentile normalized score±\\pmstd over 5 runs\. The row*𝒟\\mathcal\{D\}\(best\)*reports the best design present in the offline dataset for each task\. Scores above*𝒟\\mathcal\{D\}\(best\)*therefore indicate improvement beyond the best offline example under the evaluation protocol used for that column\. Avg\. Rank is the mean ordinal rank across all four tasks \(↓\\downarrowlower is better\)\.Bold: best per column\.
##### Design\-Bench tasks\.
D2C achieves the best average rank across the four Design\-Bench tasks, placing first on TF Bind 8 and TF Bind 10, second on D’Kitty, and third on Ant\. We therefore position D2C as robust across standard MBO benchmarks, with the strongest overall performance by average rank\.
Additional ablations on guidance scale \(including its selection without oracle access\), optimization steps, learning rate, DDIM steps, optimizable conditioning dimensionality, conditioning versus latent\-noise optimization, constraint\-satisfying improvement rate, candidate budget, and computational cost are reported in Section[D](https://arxiv.org/html/2610.31721#A4)\. In particular, with the proposer, surrogate, and evaluation protocol held fixed, optimizing the conditioning outperforms optimizing the latent noise on both real\-world tasks \(Section[D\.7](https://arxiv.org/html/2610.31721#A4.SS7)\)\.
## 5Related Work
Offline model\-based optimization \(MBO\) seeks high\-scoring designs using only a fixed dataset, with no online evaluations\[[30](https://arxiv.org/html/2610.31721#bib.bib1)\]\. Existing approaches include forward methods that optimize a learned surrogate in design space\[[31](https://arxiv.org/html/2610.31721#bib.bib2),[9](https://arxiv.org/html/2610.31721#bib.bib3),[36](https://arxiv.org/html/2610.31721#bib.bib4),[37](https://arxiv.org/html/2610.31721#bib.bib5),[4](https://arxiv.org/html/2610.31721#bib.bib17)\], inverse methods that map target scores to designs with increasingly expressive generators\[[2](https://arxiv.org/html/2610.31721#bib.bib6),[7](https://arxiv.org/html/2610.31721#bib.bib15),[19](https://arxiv.org/html/2610.31721#bib.bib7),[16](https://arxiv.org/html/2610.31721#bib.bib16),[18](https://arxiv.org/html/2610.31721#bib.bib8)\], and trajectory\-based methods that learn to improve from synthetic optimization paths\[[23](https://arxiv.org/html/2610.31721#bib.bib9),[3](https://arxiv.org/html/2610.31721#bib.bib10),[39](https://arxiv.org/html/2610.31721#bib.bib11)\]\. Forward methods remain limited by surrogate extrapolation, while inverse and trajectory\-based methods typically keep the conditioning target fixed at inference time rather than refining it against downstream objectives\.
Recent diffusion\-based optimization methods attempt to integrate optimization feedback into generation, including guided warm\-starts with Langevin corrections\[[17](https://arxiv.org/html/2610.31721#bib.bib12)\], uncertainty\-aware conditioning selection\[[35](https://arxiv.org/html/2610.31721#bib.bib13)\], editing\-based optimization against pseudo\-targets\[[38](https://arxiv.org/html/2610.31721#bib.bib14)\], and end\-to\-end gradient propagation through diffusion samplers in image\-generation settings\[[33](https://arxiv.org/html/2610.31721#bib.bib31),[27](https://arxiv.org/html/2610.31721#bib.bib32)\]\. However, these methods either operate outside offline MBO, rely on post\-hoc corrections or heuristic target selection, or do not study physics\-informed constrained design with a frozen proposer\-evaluator architecture\. Unlike these methods, D2C targets offline MBO and treats the deterministic reverse diffusion chain as a differentiable map in the conditioning signal itself, optimizing that conditioning directly against surrogate and physics\-based penalty losses, with final validity enforced by domain\-specific hard constraints\.
## 6Conclusion and Limitations
We introduced Differentiable Diffusion Conditioning \(D2C\), a framework that turns a pretrained conditional diffusion model into an end\-to\-end gradient\-based optimizer for physical design\. By establishing a practical backpropagation path from composite physics\-informed objectives, through a frozen surrogate evaluator, back through the deterministic DDIM reverse chain to the conditioning input, D2C enables gradient\-based optimization without retraining or fine\-tuning the generative model\. The composed proposer\-evaluator architecture of D2C helps keep generated designs closer to the empirical data distribution induced by the learned prior under appropriately tuned guidance while the surrogate provides directional gradient signals, helping reduce the out\-of\-distribution exploitation that plagues direct surrogate optimization\. Across two real\-world scientific tasks and four Design\-Bench tasks, D2C delivers the strongest results on the real\-world tasks and the best average rank across the benchmark suite\.
### 6\.1Limitations
- •Computational cost\. D2C requires backpropagation through aTT\-step DDIM chain at each optimization iteration, making it roughly88–17×17\\timesslower than single\-pass methods \(Table[16](https://arxiv.org/html/2610.31721#A4.T16)\)\. While our ablations show thatTTandJJcan be reduced with minimal quality loss, the method remains unsuitable for latency\-critical applications\.
- •Surrogate dependence\. The quality of the gradient signal is bounded by the accuracy of the frozen surrogateSϕS\_\{\\phi\}\. In regimes where the surrogate is poorly calibrated, the optimization may converge to high\-scoring surrogate designs that perform poorly on the true objective\. Future work could incorporate uncertainty quantification into the surrogate to mitigate this\.
- •Validity\-first selection\. D2C combines differentiable penalties with a final validity\-first selection step\. As a result, method quality should be interpreted jointly through both achieved gain and the rate at which valid improving solutions are found\.
- •Domain\-specific tuning\. While D2C is broadly applicable, the choice of loss terms, constraint definitions, and optimization hyperparameters requires domain expertise and may involve trial\-and\-error tuning for new applications\. Appendix[I](https://arxiv.org/html/2610.31721#A9)provides extended practical guidance\.
## Acknowledgments
This work was supported by the U\.S\. Department of Energy, Office of Science, under Award No\. DE\-SC0024408 and DE\-SC0024381\.
## References
- \[1\]Alibaba Group\(2026\)Alibaba cluster trace program\.Note:[https://github\.com/alibaba/clusterdata](https://github.com/alibaba/clusterdata)Cited by:[§B\.3](https://arxiv.org/html/2610.31721#A2.SS3.p1.1)\.
- \[2\]D\. Brookes, H\. Park, and J\. Listgarten\(2019\)Conditioning by adaptive sampling for robust design\.InICML,Cited by:[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[3\]Y\. Chemingui, A\. Deshwal, T\. N\. Hoang, and J\. R\. Doppa\(2024\)Offline model\-based optimization via policy\-guided gradient search\.InAAAI,Cited by:[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[4\]C\. S\. Chen, C\. Beckham, Z\. Liu, X\. S\. Liu, and C\. Pal\(2023\)Parallel mentoring for offline model\-based optimization\.InNeurIPS,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[5\]C\. Chen, Y\. Zhang, J\. Fu, X\. Liu, and M\. Coates\(2022\)Bidirectional learning for offline infinite\-width model\-based optimization\.InNeurIPS,Cited by:[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1)\.
- \[6\]J\. Delettrez, R\. Epstein, M\. C\. Richardson, P\. A\. Jaanimagi, and B\. L\. Henke\(1987\)Effect of laser illumination nonuniformity on the analysis of time\-resolved x\-ray measurements in uv spherical transport experiments\.Phys\. Rev\. A36,pp\. 3926–3934\.External Links:[Document](https://dx.doi.org/10.1103/PhysRevA.36.3926),[Link](https://link.aps.org/doi/10.1103/PhysRevA.36.3926)Cited by:[§B\.1\.1](https://arxiv.org/html/2610.31721#A2.SS1.SSS1.p1.1)\.
- \[7\]C\. Fannjiang and J\. Listgarten\(2020\)Autofocused oracles for model\-based design\.InNeurIPS,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[8\]B\. A\. Frigyik, A\. Kapila, and M\. R\. Gupta\(2010\)Introduction to the Dirichlet distribution and related processes\.Technical reportTechnical ReportUWEETR\-2010\-0006,University of Washington, Department of Electrical Engineering\.Cited by:[§3\.6](https://arxiv.org/html/2610.31721#S3.SS6.SSS0.Px2.p1.1)\.
- \[9\]J\. Fu and S\. Levine\(2021\)Offline model\-based optimization via normalized maximum likelihood estimation\.InICLR,Cited by:[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[10\]V\. Gopalaswamy, R\. Betti, J\. P\. Knauer, N\. Luciani, D\. Patel, K\. M\. Woo, A\. Bose, I\. V\. Igumenshchev, E\. M\. Campbell, K\. S\. Anderson, K\. A\. Bauer, M\. J\. Bonino, D\. Cao, A\. R\. Christopherson, G\. W\. Collins, T\. J\. B\. Collins, J\. R\. Davies, J\. A\. Delettrez, D\. H\. Edgell, R\. Epstein, C\. J\. Forrest, D\. H\. Froula, V\. Y\. Glebov, V\. N\. Goncharov, D\. R\. Harding, S\. X\. Hu, D\. W\. Jacobs\-Perkins, R\. T\. Janezic, J\. H\. Kelly, O\. M\. Mannion, A\. Maximov, F\. J\. Marshall, D\. T\. Michel, S\. Miller, S\. F\. B\. Morse, J\. Palastro, J\. Peebles, P\. B\. Radha, S\. P\. Regan, S\. Sampat, T\. C\. Sangster, A\. B\. Sefkow, W\. Seka, R\. C\. Shah, W\. T\. Shmyada, A\. Shvydky, C\. Stoeckl, A\. A\. Solodov, W\. Theobald, J\. D\. Zuegel, M\. G\. Johnson, R\. D\. Petrasso, C\. K\. Li, and J\. A\. Frenje\(2019\)Tripled yield in direct\-drive laser fusion through statistical modelling\.Nature565\(7741\),pp\. 581–586\.Cited by:[§B\.1\.1](https://arxiv.org/html/2610.31721#A2.SS1.SSS1.p1.1)\.
- \[11\]V\. Gopalaswamy, C\. A\. Williams, R\. Betti, D\. Patel, J\. P\. Knauer, A\. Lees, D\. Cao, E\. M\. Campbell, P\. Farmakis, R\. Ejaz, K\. S\. Anderson, R\. Epstein, J\. Carroll\-Nellenback, I\. V\. Igumenshchev, J\. A\. Marozas, P\. B\. Radha, A\. A\. Solodov, C\. A\. Thomas, K\. M\. Woo, T\. J\. B\. Collins, S\. X\. Hu, W\. Scullin, D\. Turnbull, V\. N\. Goncharov, K\. Churnetski, C\. J\. Forrest, V\. Y\. Glebov, P\. V\. Heuer, H\. McClow, R\. C\. Shah, C\. Stoeckl, W\. Theobald, D\. H\. Edgell, S\. Ivancic, M\. J\. Rosenberg, S\. P\. Regan, D\. Bredesen, C\. Fella, M\. Koch, R\. T\. Janezic, M\. J\. Bonino, D\. R\. Harding, K\. A\. Bauer, S\. Sampat, L\. J\. Waxer, M\. Labuzeta, S\. F\. B\. Morse, M\. Gatu\-Johnson, R\. D\. Petrasso, J\. A\. Frenje, J\. Murray, B\. Serrato, D\. Guzman, C\. Shuldberg, M\. Farrell, and C\. Deeney\(2024\)Demonstration of a hydrodynamically equivalent burning plasma in direct\-drive inertial confinement fusion\.Nature Physics20\(5\),pp\. 751–757\.Cited by:[§B\.1\.1](https://arxiv.org/html/2610.31721#A2.SS1.SSS1.p1.1)\.
- \[12\]E\. C\. Hansen, D\. H\. Barnak, R\. Betti, E\. M\. Campbell, P\. Chang, J\. R\. Davies, V\. Y\. Glebov, J\. P\. Knauer, J\. Peebles, S\. P\. Regan, and A\. B\. Sefkow\(2018\)Measuring implosion velocities in experiments and simulations of laser\-driven cylindrical implosions on the OMEGA laser\.Plasma Physics and Controlled Fusion60\(5\),pp\. 054014\.External Links:[Document](https://dx.doi.org/10.1088/1361-6587/aab73f),[Link](https://dx.doi.org/10.1088/1361-6587/aab73f)Cited by:[§B\.1\.1](https://arxiv.org/html/2610.31721#A2.SS1.SSS1.p1.1)\.
- \[13\]N\. Hansen\(2016\)The CMA evolution strategy: a tutorial\.arXiv:1604\.00772\.Cited by:[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1)\.
- \[14\]J\. Ho, A\. Jain, and P\. Abbeel\(2020\)Denoising diffusion probabilistic models\.InNeurIPS,Cited by:[§2\.1](https://arxiv.org/html/2610.31721#S2.SS1.p1.1)\.
- \[15\]J\. Ho and T\. Salimans\(2021\)Classifier\-free diffusion guidance\.InNeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications,Cited by:[§3\.4](https://arxiv.org/html/2610.31721#S3.SS4.p1.2)\.
- \[16\]M\. Kim, F\. Berto, S\. Ahn, and J\. Park\(2023\)Bootstrapped training of score\-conditioned generator for offline design of biological sequences\.InNeurIPS,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[17\]L\. Kong, Y\. Du, W\. Mu, K\. Neklyudov, V\. De Bortoli, D\. Wu, H\. Wang, A\. Ferber, Y\. Ma, C\. P\. Gomes, and C\. Zhang\(2025\)Diffusion models as constrained samplers for optimization with unknown constraints\.InAISTATS,External Links:2402\.18012,[Link](https://arxiv.org/abs/2402.18012)Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p2.1)\.
- \[18\]S\. Krishnamoorthy, S\. M\. Mashkaria, and A\. Grover\(2023\)Diffusion models for black\-box optimization\.InICML,Cited by:[§B\.4](https://arxiv.org/html/2610.31721#A2.SS4.p3.1),[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1),[§4\.4](https://arxiv.org/html/2610.31721#S4.SS4.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[19\]A\. Kumar and S\. Levine\(2020\)Model inversion networks for model\-based optimization\.InNeurIPS,Cited by:[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[20\]A\. Lees, R\. Betti, J\. P\. Knauer, V\. Gopalaswamy, D\. Patel, K\. M\. Woo, K\. S\. Anderson, E\. M\. Campbell, D\. Cao, J\. Carroll\-Nellenback, R\. Epstein, C\. Forrest, V\. N\. Goncharov, D\. R\. Harding, S\. X\. Hu, I\. V\. Igumenshchev, R\. T\. Janezic, O\. M\. Mannion, P\. B\. Radha, S\. P\. Regan, A\. Shvydky, R\. C\. Shah, W\. T\. Shmyada, C\. Stoeckl, W\. Theobald, and C\. Thomas\(2021\)Experimentally inferred fusion yield dependencies of OMEGA inertial confinement fusion implosions\.Phys\. Rev\. Lett\.127,pp\. 105001\.External Links:[Document](https://dx.doi.org/10.1103/PhysRevLett.127.105001),[Link](https://link.aps.org/doi/10.1103/PhysRevLett.127.105001)Cited by:[§B\.1\.1](https://arxiv.org/html/2610.31721#A2.SS1.SSS1.p1.1)\.
- \[21\]I\. Loshchilov and F\. Hutter\(2019\)Decoupled weight decay regularization\.ICLR\.Cited by:[§A\.4](https://arxiv.org/html/2610.31721#A1.SS4.p1.1)\.
- \[22\]R\. Luna Gutierrez, V\. Gundecha, R\. Ejaz, V\. Gopalaswamy, R\. Betti, S\. Ghorbanpour, A\. Lees, and S\. Sarkar\(2025\)IM\-LPG: inverse modeling approach to laser pulse shape generation in inertial confinement fusion\.InAI for Science Workshop at NeurIPS 2025,External Links:[Link](https://openreview.net/forum?id=Wjh3yUUAoS)Cited by:[§1](https://arxiv.org/html/2610.31721#S1.p2.1)\.
- \[23\]S\. M\. Mashkaria, S\. Krishnamoorthy, and A\. Grover\(2023\)Generative pretraining for black\-box optimization\.InICML,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[24\]A\. Naug, A\. Guillen, R\. Luna Gutierrez, V\. Gundecha, C\. E\. Bash, S\. Ghorbanpour, S\. Mousavi, A\. R\. Babu, D\. Markovikj, L\. D\. Kashyap, D\. Rengarajan, and S\. Sarkar\(2024\)SustainDC: benchmarking for sustainable data center control\.InNeurIPS,Cited by:[§B\.3](https://arxiv.org/html/2610.31721#A2.SS3.p1.1),[§4\.1](https://arxiv.org/html/2610.31721#S4.SS1.SSS0.Px2.p1.1)\.
- \[25\]Y\. Nesterov\(2004\)Introductory lectures on convex optimization: a basic course\.Springer,Boston, MA\.Cited by:[§H\.2](https://arxiv.org/html/2610.31721#A8.SS2.p3.1)\.
- \[26\]A\. Q\. Nichol and P\. Dhariwal\(2021\)Improved denoising diffusion probabilistic models\.ICML\.Cited by:[§A\.3](https://arxiv.org/html/2610.31721#A1.SS3.p1.1)\.
- \[27\]J\. Pan, J\. H\. Liew, V\. Y\. F\. Tan, J\. Feng, and H\. Yan\(2024\)AdjointDPM: adjoint sensitivity method for gradient backpropagation of diffusion probabilistic models\.InICLR,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p2.1)\.
- \[28\]J\. Snoek, H\. Larochelle, and R\. P\. Adams\(2012\)Practical Bayesian optimization of machine learning algorithms\.InNeurIPS,Cited by:[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1)\.
- \[29\]J\. Song, C\. Meng, and S\. Ermon\(2021\)Denoising diffusion implicit models\.InICLR,Cited by:[§2\.2](https://arxiv.org/html/2610.31721#S2.SS2.p1.1)\.
- \[30\]B\. Trabucco, X\. Geng, A\. Kumar, and S\. Levine\(2022\)Design\-Bench: benchmarks for data\-driven offline model\-based optimization\.InICML,Cited by:[§B\.4](https://arxiv.org/html/2610.31721#A2.SS4.p1.1),[§4\.2](https://arxiv.org/html/2610.31721#S4.SS2.p1.1),[§4\.4](https://arxiv.org/html/2610.31721#S4.SS4.p1.1),[§4](https://arxiv.org/html/2610.31721#S4.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[31\]B\. Trabucco, A\. Kumar, X\. Geng, and S\. Levine\(2021\)Conservative objective models for effective offline model\-based optimization\.InICML,Cited by:[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§3\.5](https://arxiv.org/html/2610.31721#S3.SS5.p3.2),[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[32\]University of Rochester, Laboratory for Laser Energetics\(2000\)LLE review, volume 85\.Technical reportTechnical ReportDOE/SF/19460\-378,University of Rochester, Laboratory for Laser Energetics\.Note:Quarterly ReportExternal Links:[Link](https://www.lle.rochester.edu/media/publications/lle_review/documents/v85/85_Review.pdf)Cited by:[§B\.1\.1](https://arxiv.org/html/2610.31721#A2.SS1.SSS1.p1.1)\.
- \[33\]B\. Wallace, A\. Gokul, S\. Ermon, and N\. Naik\(2023\)End\-to\-end diffusion latent optimization improves classifier guidance\.InICCV,pp\. 7246–7256\.External Links:[Document](https://dx.doi.org/10.1109/ICCV51070.2023.00669),[Link](https://doi.org/10.1109/ICCV51070.2023.00669)Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p2.1)\.
- \[34\]R\. J\. Williams\(1992\)Simple statistical gradient\-following algorithms for connectionist reinforcement learning\.Machine Learning8\(3–4\),pp\. 229–256\.Cited by:[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1)\.
- \[35\]D\. Wu, N\. L\. Kuang, R\. Niu, Y\. Ma, and R\. Yu\(2025\)Diffusion\-BBO: diffusion\-based inverse modeling for online black\-box optimization\.External Links:2407\.00610,[Link](https://arxiv.org/abs/2407.00610)Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p2.1)\.
- \[36\]S\. Yu, S\. Ahn, L\. Song, and J\. Shin\(2021\)RoMA: robust model adaptation for offline model\-based optimization\.InNeurIPS,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[37\]Y\. Yuan, C\. S\. Chen, Z\. Liu, W\. Neiswanger, and X\. S\. Liu\(2023\)Importance\-aware co\-teaching for offline model\-based optimization\.InNeurIPS,Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
- \[38\]Y\. Yuan, Y\. Zhang, C\. Chen, H\. Wu, Z\. Li, J\. Li, J\. J\. Clark, and X\. Liu\(2025\)Design editing for offline model\-based optimization\.Transactions on Machine Learning Research\.External Links:2405\.13964,[Link](https://arxiv.org/abs/2405.13964)Cited by:[§5](https://arxiv.org/html/2610.31721#S5.p2.1)\.
- \[39\]T\. Yun, S\. Yun, J\. Lee, and J\. Park\(2024\)Guided trajectory generation with diffusion models for offline model\-based optimization\.InNeurIPS,Cited by:[§B\.4](https://arxiv.org/html/2610.31721#A2.SS4.p3.1),[§1](https://arxiv.org/html/2610.31721#S1.p2.1),[§4\.3](https://arxiv.org/html/2610.31721#S4.SS3.p1.1),[§4\.4](https://arxiv.org/html/2610.31721#S4.SS4.p1.1),[§5](https://arxiv.org/html/2610.31721#S5.p1.1)\.
## Appendix AExperimental Details
### A\.1Computational Resources
All experiments were conducted on a node equipped with four NVIDIA H100 GPUs\. Training the diffusion proposer and the surrogate evaluator together on a single GPU takes approximately 20 hours per training run\. For the optimization time on this same hardware please refer to Subsection[D\.10](https://arxiv.org/html/2610.31721#A4.SS10)\.
### A\.2Diffusion Proposer Architecture
The proposerGθG\_\{\\theta\}is an MLP\-based epsilon\-prediction network\. Both ICF and DC tasks use the same architecture design; only the input/output dimensionalities and hidden width differ\. The architecture consists of:
- •Adata projectionlayer:Linear\(dout,H\)→LayerNorm→SiLU\\texttt\{Linear\}\(d\_\{\\mathrm\{out\}\},H\)\\to\\texttt\{LayerNorm\}\\to\\texttt\{SiLU\}, wheredoutd\_\{\\mathrm\{out\}\}is the design dimensionality andHHis the hidden dimension\.
- •Atime embeddingMLP: sinusoidal positional encoding of the diffusion timestep, followed by three linear layers with SiLU activations, projecting to dimensionHH\.
- •Aconditioning MLP: three linear layers with SiLU activations mapping the full conditioning vectorc∈ℝdcc\\in\\mathbb\{R\}^\{d\_\{c\}\}to dimensionHH\.
- •LLresidual blocks, each containing LayerNorm→\\toLinear\(H,4H\)\(H,4H\)→\\toSiLU→\\toDropout→\\toLinear\(4H,H\)\(4H,H\)→\\toDropout, with a learnable residual scale parameter initialized to0\.10\.1\.
- •Per\-blockFiLM modulation: at each residual block, the time embedding produces scale and shift vectors via dedicated linear projections, applied ash←γt⊙h\+βth\\leftarrow\\gamma\_\{t\}\\odot h\+\\beta\_\{t\}\. The conditioning embedding is added to the hidden state before the residual stack\.
- •Anull conditioning embedding\(learnable,ℝ1×H\\mathbb\{R\}^\{1\\times H\}, initialized to𝒩\(0,0\.01\)\\mathcal\{N\}\(0,0\.01\)\) for classifier\-free guidance: during training, the conditioning embedding is replaced by the null embedding with probabilitypdropp\_\{\\mathrm\{drop\}\}\.
- •Anoutput projection: LayerNorm→\\toLinear\(H,dout\)\(H,d\_\{\\mathrm\{out\}\}\), with weights and biases initialized to zero for stable early training\.
### A\.3Noise Schedule
Both tasks use a cosine noise schedule\[[26](https://arxiv.org/html/2610.31721#bib.bib25)\]withTtrain=100T\_\{\\mathrm\{train\}\}=100diffusion steps,s=0\.008s=0\.008offset, and betas clipped to\[10−4,0\.999\]\[10^\{\-4\},\\,0\.999\]:
α¯t=f\(t\)f\(0\),f\(t\)=cos\(t/T\+s1\+s⋅π2\)2\.\\bar\{\\alpha\}\_\{t\}=\\frac\{f\(t\)\}\{f\(0\)\},\\quad f\(t\)=\\cos\\\!\\left\(\\frac\{t/T\+s\}\{1\+s\}\\cdot\\frac\{\\pi\}\{2\}\\right\)^\{2\}\.\(15\)At inference, we use DDIM withσt=0\\sigma\_\{t\}=0\(fully deterministic\) andT=25T=25inference steps \(selected via ablation, Section[D\.5](https://arxiv.org/html/2610.31721#A4.SS5)\)\.
### A\.4Training Hyperparameters
The proposer is trained with AdamW\[[21](https://arxiv.org/html/2610.31721#bib.bib26)\]using a cosine\-annealed learning rate with linear warmup\. EMA \(Exponential Moving Average\) of model weights is maintained throughout training with a warmup period of 2,000 steps\. Table[3](https://arxiv.org/html/2610.31721#A1.T3)summarizes the training hyperparameters for both domains\.
Table 3:Training hyperparameters for the diffusion proposer\.HyperparameterICFDCHidden dimensionHH10241024Residual blocksLL66Dropout0\.10\.1CFG dropoutpdropp\_\{\\mathrm\{drop\}\}0\.10\.1EMA decayβ\\beta0\.99990\.9999Learning rate5×10−55\\times 10^\{\-5\}5×10−55\\times 10^\{\-5\}Batch size10241024Training epochs4005,000Diffusion stepsTtrainT\_\{\\mathrm\{train\}\}100100Noise scheduleCosineCosineReconstruction weightαr\\alpha\_\{r\}0\.50\.5Fidelity weightαa\\alpha\_\{a\}0\.0010\.01Smoothness weightαsm\\alpha\_\{\\mathrm\{sm\}\}0\.00010\.0001Surrogate weightαs\\alpha\_\{s\}1\.01\.0Conditioning dimdcd\_\{c\}2783Design dimdoutd\_\{\\mathrm\{out\}\}256144
### A\.5Inference\-Time Optimization Hyperparameters
At inference, we freeze the trained proposer and evaluator and optimize the conditioning separately for each test sample\. Table[4](https://arxiv.org/html/2610.31721#A1.T4)reports the optimization hyperparameters used for the main results \(selected via ablation studies in Section[D](https://arxiv.org/html/2610.31721#A4)\)\.
Hyperparameters were selected via grid search on the*validation*set over manually specified value ranges\. During inference\-time optimization, only the optimizable coordinates of the conditioning vector are updated; the fixed coordinates remain unchanged\. After each Adam step, the updated conditioning coordinates are clipped back to the normalized\[0,1\]\[0,1\]range before the next DDIM rollout, so the frozen proposer is not queried with out\-of\-range values on those dimensions\.
Table 4:Inference\-time optimization hyperparameters\.HyperparameterICFDCGuidance scaleww2\.02\.0DDIM inference stepsTT2525Optimization stepsJJ10040Learning rateη\\eta1×10−31\\times 10^\{\-3\}2×10−22\\times 10^\{\-2\}Noise trialsNzN\_\{z\}2020Weight samplesNλN\_\{\\lambda\}per trial55Total candidatesBBper sample100100Optimizable conditioning dimsdod\_\{o\}20 \(LILAC variables\)10 \(energy metrics\)OptimizerAdamAdamBarrier coefficientμ\\mu\(DC workload loss\)—100Validity thresholdsMinimum gainδgain\\delta\_\{\\mathrm\{gain\}\}0\.1%0\.1\\%0\.1%0\.1\\%Spectral toleranceτfft\\tau\_\{\\mathrm\{fft\}\}0\.2—Correlation thresholdτcorr\\tau\_\{\\mathrm\{corr\}\}0\.8—Workload deviation tolerance—1%1\\%
### A\.6Baselines Implementations and Hyperparameters
For thereal\-world tasks, we implement all baselines that require a surrogate model using the same frozenSϕS\_\{\\phi\}to ensure a fair comparison\. For approaches that require training a neural network or diffusion model for test\-time optimization, we use the same hidden dimension as our proposer when applicable\. For gradient\-based baselines, we perform grid search over learning rates\{5×10−4,1×10−3,5×10−3,1×10−2,5×10−2\}\\\{5\\times 10^\{\-4\},1\\times 10^\{\-3\},5\\times 10^\{\-3\},1\\times 10^\{\-2\},5\\times 10^\{\-2\}\\\}and select the best\-performing value for each method and task\. For the evolutionary baseline CMA\-ES, we use thecmaPython package with default hyperparameters except for population size\. For GP\-qEI, we use a Gaussian Process surrogate with a Matérn kernel \(ν=2\.5\\nu=2\.5\)\.
For the diffusion\-basedBrute Forcebaseline on the real\-world tasks, we do not perform a single one\-shot DDIM sample\. Instead, we reuse the same frozen proposer as D2C but replace gradient\-based conditioning updates with an explicit sweep over hand\-chosen conditioning directions\. On ICF, the baseline linearly increases the yield\-related conditioning coordinate and runs one full DDIM rollout at each sweep point, retaining the best candidate that passes the same gain, area, FFT, and correlation checks used for D2C\. On DC, it linearly decreases selected energy\-metric conditioning coordinates and runs repeated DDIM rollouts for multiple noise seeds at each sweep point, followed by the same workload\-conservation and inlet\-temperature checks used for D2C\. Thus, Brute Force should be interpreted as a forward\-only conditioning sweep with many repeated DDIM generations, not as a single batched generation pass\.
For the surrogate\-optimized real\-world baselines, we do not optimize the primary objective alone\. To reduce the chance that differences in constraint\-satisfying improvement rate are an artifact of objective\-only optimization, Gradient Ascent, REINFORCE, and CMA\-ES are augmented with domain\-aligned penalties or projections that mirror the main constraint families used by D2C, although these baselines operate directly in design space or in low\-dimensional latent parameterizations rather than through the conditioning optimization of Eq\.[13](https://arxiv.org/html/2610.31721#S3.E13)\. On ICF, Gradient Ascent maximizes surrogate\-predicted yield while adding similarity and first/second\-order smoothness regularization, REINFORCE uses reward terms for yield together with area and spectral penalties, and CMA\-ES searches in a PCA\-reduced pulse space with an objective that combines surrogate\-predicted yield with similarity, area, and squared first\-difference penalties, together with a hard projection that prevents pulse area from exceeding the reference; all three are then validated using the same gain, area, FFT, and correlation thresholds as D2C\. On DC, Gradient Ascent minimizes surrogate\-predicted carbon emissions with area\-conservation and similarity penalties, REINFORCE uses carbon\-reduction reward together with an area\-conservation penalty, and CMA\-ES searches in a PCA\-reduced profile space with carbon\-reduction objective plus area\-conservation, similarity, and squared first\-difference penalties; all three are then filtered by the same workload\-conservation and inlet\-temperature constraints used for D2C\. Thus, the lower constraint\-satisfying improvement rates of these baselines in Table[14](https://arxiv.org/html/2610.31721#A4.T14)should not be interpreted as evidence that they ignore constraint\-aware optimization entirely\.
For all real\-world baselines, hyperparameters were selected on the validation split only, and the test split was used exclusively for final reporting\.
### A\.7Surrogate Evaluator Architecture
The frozen evaluatorSϕS\_\{\\phi\}is a feedforward residual network with LayerNorm and dropout, trained independently via supervised regression\. For ICF, the surrogate has 10 hidden layers of width 1024 with residual connections every two layers, predicting 20 LILAC performance variables from a 263\-dimensional input \(256\-d pulse \+ 7 target parameters\)\. For DC, the surrogate has 6 hidden layers of width 1024 with residual connections every two layers, predicting 10 energy metrics from a 217\-dimensional input \(144\-d workload profile \+ 73 environmental conditions\)\. Both surrogates use ReLU activations, LayerNorm, 10% dropout during training, and a sigmoid output layer mapping to\[0,1\]\[0,1\]\(targets are MinMax\-scaled\)\.
Table[5](https://arxiv.org/html/2610.31721#A1.T5)summarizes the training hyperparameters for the surrogate evaluator\.
Table 5:Training hyperparameters for the surrogate evaluatorSϕS\_\{\\phi\}\.
## Appendix BData and Evaluation
### B\.1ICF
The training dataset comprises∼2,600,000\{\\sim\}2\{,\}600\{,\}000radiation\-hydrodynamics simulations from the LILAC simulation database\. Each sample consists of a 256\-dimensional laser pulse profile and 27 conditioning dimensions \(7 target parameters \+ 20 LILAC performance variables\)\. The data are split into 80% training, 10% validation, and 10% test \(∼260,000\{\\sim\}260\{,\}000samples each\)\. The validation set was used for hyperparameter tuning; the test set is used exclusively for final evaluation\. We randomly sample 2,000 pulses from the test set and use the same 2,000 for all methods\. ICF Top selects the 1,000 highest\-yield samples from the test set\. The surrogateSϕS\_\{\\phi\}achieves<1%<1\\%WMAPE on all 20 predicted LILAC variables\.
#### B\.1\.1ICF Data Generation
The ICF dataset is generated from radiation\-hydrodynamics simulations \(LILAC code\), where each simulation is specified by a target design and a laser pulse shape\. LILAC is a prominent one\-dimensional Lagrangian hydrodynamics ICF code\[[12](https://arxiv.org/html/2610.31721#bib.bib33),[32](https://arxiv.org/html/2610.31721#bib.bib34),[6](https://arxiv.org/html/2610.31721#bib.bib35),[20](https://arxiv.org/html/2610.31721#bib.bib36),[10](https://arxiv.org/html/2610.31721#bib.bib37),[11](https://arxiv.org/html/2610.31721#bib.bib38)\]\. The laser pulse shape is prescribed via an internal library that parameterizes it into descriptive features such as inter\-pulse time delays between Gaussian\-shaped components, maximum power, and total energy\. The full input specification thus lives in a 27\-dimensional parameter space consisting of target specifications and a parameterized laser\-pulse description\.
Although this 27\-D space permits uniform sampling subject to physical constraints \(e\.g\., maximum laser energy, allowable target thicknesses\), such sampling does not reflect how experiments or simulations are actually designed\. In practice, high\-performing implosions occupy only a small region of this high\-dimensional space, guided by physics intent rather than being distributed uniformly across the full admissible hypervolume\. The region of desirable inputs therefore lies on a lower\-dimensional manifold embedded within the 27\-D space, a manifold that is not explicitly known or parameterized but emerges from complex physics couplings between target geometry and laser\-pulse features\.
To sample this manifold more effectively, we supplement random draws with perturbations of known high\-performing implosion designs\. Perturbing their laser\-pulse features and target parameters produces a family of nearby points that remain close to the underlying physics manifold while still providing variation in implosion performance\. This strategy captures the empirical observation that, for a fixed target specification, laser\-pulse shapes close to physics\-informed designs typically outperform large random perturbations\. The resulting dataset therefore reflects a distribution with multiple high\-performance clusters concentrated on an unknown manifold within the 27\-D input space, rather than a uniform distribution over the full hypervolume\.
Note:The fusion dataset and simulation code fall under US export\-control regulations\. Certain implementation details and the data cannot be publicly released\. Interested parties may contact the authors; data may be shared upon reasonable request with parties who have the appropriate permissions and legal authorization to access this class of controlled data\.
### B\.2ICF Oracle Evaluator
At test time, optimized ICF pulse designs are scored by a separate high\-accuracy LILAC\-validated evaluation surrogate that is distinct from the frozen optimization\-time surrogate\. This evaluation oracle is trained on the full available ICF dataset and is used only for final offline scoring, not for optimization\. It should therefore be interpreted as a best\-available simulator proxy trained on all available offline data for final comparison, rather than as a held\-out model used within the optimization loop\. Because this evaluation oracle is distinct from the frozen optimization\-time surrogate, the final reported scores are not obtained by reusing the same model that provides gradients during optimization\.
The oracle achieves<<1% weighted mean absolute percentage error \(WMAPE\) on all 20 LILAC performance variables when compared against LILAC radiation\-hydrodynamics simulation outputs\. This level of accuracy indicates that the reported yield gains are a close proxy for relative trends predicted by the underlying physics code\.
##### Why not evaluate with LILAC directly?
Direct online evaluation with the LILAC simulator is infeasible at the scale required in this study because simulator access requires advanced scheduling, computational allocation, and substantial preparation\. We therefore use a separate high\-accuracy evaluation surrogate for final offline scoring\. This introduces a proxy\-evaluation limitation, but the same evaluation oracle is used for D2C and all baselines, making the large\-scale comparison internally fair under a common scoring rule\. Because the oracle has sub\-1% error relative to LILAC simulation outputs, it provides a practical and informative approximation for large\-scale comparison\. This separation between optimization\-time surrogate and evaluation\-time oracle does not eliminate proxy\-evaluation bias, but it reduces the risk that reported gains are merely artifacts of the optimization surrogate itself\. In addition to this large\-scale oracle\-based evaluation, we performed a separate small\-scale LILAC validation on 20 high\-yield expert\-designed pulses\. Here, expert\-designed refers to pulses manually designed by ICF experts based on expert knowledge\. Using the same D2C conditioning\-optimization approach, we observed an average yield gain of 9\.8% relative to the original expert pulse baselines\. Because this direct\-simulator check is small\-scale, we treat it as supplementary corroboration rather than the primary quantitative basis for the large\-scale comparison\.
### B\.3DC
The training dataset comprises200,000200\{,\}000data center operating scenarios generated from the SustainDC physics\-based thermal and energy simulator\[[24](https://arxiv.org/html/2610.31721#bib.bib28)\]\. The simulator computes rack\-level IT power, HVAC power, cooling tower fan power, compressor load, and thermal state from workload profiles and carbon footprints\. We seed the generation with real workload traces from the Alibaba cluster dataset\[[1](https://arxiv.org/html/2610.31721#bib.bib29)\]and region\-specific carbon intensity and weather profiles for Arizona \(AZ\), California \(CA\), and New York \(NY\), both provided within the SustainDC framework\. We augment with synthetic variations of workload patterns, carbon footprint schedules, and CRAC set\-point profiles to ensure broad distributional coverage\. The three geographic regions provide diverse grid carbon intensities and climate conditions, enabling the model to generalize across different operational regimes\. Each sample consists of a 144\-dimensional workload power profile \(24h at 10\-min resolution\) and 83 conditioning dimensions \(73 environment state variables \+ 10 energy metrics\)\. The data are split into 80% training, 10% validation, and 10% test \(∼20,000\{\\sim\}20\{,\}000samples each\)\. Following the same protocol as ICF, all hyperparameter selection is performed on the validation set; the test set is reserved for final reporting\. We randomly sample 2,000 scenarios from the test set and use the same 2,000 for all methods\. Final designs are validated against the full physics\-based model \(not the surrogate\)\. We use the public SustainDC codebase, whose repository documentation states that the project is primarily released under the MIT License, with some derived portions attributed to CarbonExplorer under CC BY\-NC 4\.0; we use and cite that code under the stated repository terms\.444[https://github\.com/HewlettPackard/dc\-rl](https://github.com/HewlettPackard/dc-rl)
### B\.4Design\-Bench
We use the standard offline\-subset protocol of Design\-Bench\[[30](https://arxiv.org/html/2610.31721#bib.bib1)\]: each method trains on the bottompp\-th percentile of the full dataset byyy\-value \(50% for TF Bind 8/10, 40% for Ant/D’Kitty Morphology\), andyy\-normalization uses full\-dataset bounds so that the best offline design scores below 1\. The public Design\-Bench codebase used for these tasks is released under the MIT License, and we use and cite the benchmark under that license\.555[https://github\.com/brandontrabucco/design\-bench](https://github.com/brandontrabucco/design-bench)For Design\-Bench, D2C uses a task\-specific variant of the inference\-time optimization procedure because the conditional input is only a single scalar target score\. In this setting, directly optimizing the conditioning provides only limited control\. We therefore fix the conditioning to a high normalized target score \(c=1\.0c\{=\}1\.0\) and instead optimize the initial latent/noise vector through the deterministic DDIM chain using gradients from the frozen surrogate\. Empirically, this latent\-optimization variant performed better on Design\-Bench than direct optimization of the one\-dimensional conditioning input\. In contrast, for ICF and DC we retain direct conditioning optimization because those domains expose multiple optimizable conditioning coordinates; on those tasks, conditioning optimization outperforms latent\-noise optimization \(Section[D\.7](https://arxiv.org/html/2610.31721#A4.SS7)\)\.
Table[6](https://arxiv.org/html/2610.31721#A2.T6)summarizes the inference\-time Design\-Bench hyperparameters used for our method\.
Table 6:D2C inference\-time hyperparameters for Design\-Bench\. These settings are shared across TF Bind 8, TF Bind 10, Ant Morphology, and D'Kitty Morphology unless noted otherwise\.For discrete tasks \(TF Bind 8/10\), we use the native exact Design\-Bench oracle \(\*\-Exact\-v0variants\)\. These two columns in Table[2](https://arxiv.org/html/2610.31721#S4.T2)are therefore exact\-oracle benchmark results, and D2C attains the best result on both of them\. For these tasks we do not use a discrete diffusion process or token embeddings: each sequence is represented as its original length\-88or length\-1010integer token vector and then MinMax\-scaled coordinatewise to\[0,1\]\[0,1\], so the four nucleotide categories become the four scalar levels\{0,1/3,2/3,1\}\\\{0,1/3,2/3,1\\\}\. The Gaussian forward process, DDIM reverse process, and gradient\-based conditioning optimization are all performed in this relaxed continuous space\. After generation, each coordinate is projected to the nearest valid discrete level before oracle evaluation; the normalized design is then inverse\-transformed and rounded back to integer tokens for exact lookup\. Thus gradients are taken with respect to the relaxed continuous representation, and no gradient is propagated through the final discrete projection step\. For continuous tasks \(Ant Morphology and D’Kitty Morphology\), we use a reproducible evaluation protocol grounded in the released benchmark data rather than relying on the version\-sensitive MuJoCo/Gym oracle path\. This choice is motivated by two observations: \(i\) the current Design\-Bench continuous\-task oracle path has documented reliability issues in the public repository,666[https://github\.com/brandontrabucco/design\-bench/issues/11](https://github.com/brandontrabucco/design-bench/issues/11),777[https://github\.com/brandontrabucco/design\-bench/issues/23](https://github.com/brandontrabucco/design-bench/issues/23)and \(ii\) published continuous\-task score ranges already vary substantially across prior Design\-Bench papers such as DDOM and GTG\[[18](https://arxiv.org/html/2610.31721#bib.bib8),[39](https://arxiv.org/html/2610.31721#bib.bib11)\], indicating limited cross\-paper comparability under differing software environments\. To obtain a stable within\-paper comparison, we therefore evaluate all methods on these two tasks using the samekk\-nearest\-neighbor \(k=5k\{=\}5, distance\-weighted\) regression oracle fitted on the full released dataset\. This protocol is grounded entirely in the benchmark data and ensures that all reported Ant and D’Kitty results are directly comparable under a single reproducible evaluation rule\. The added row𝒟\\mathcal\{D\}\(best\) in Table[2](https://arxiv.org/html/2610.31721#S4.T2)reports the best design already contained in the offline dataset for each task\. Under this protocol, scores above𝒟\\mathcal\{D\}\(best\) indicate that a method is assigned a value higher than the best offline example for that task\. Accordingly, these continuous\-task results should be interpreted as a reproducible within\-paper comparison under a single stable evaluation rule, rather than as a claim of direct numerical comparability to prior MuJoCo/Gym\-based reports\.
### B\.5Data Normalization
All design variablesxxand conditioning vectorsccare MinMax\-scaled to\[0,1\]\[0,1\]using statistics computed on the training set\. The same scalers are applied at inference time, and generated designs are inverse\-transformed to physical units for evaluation\.
## Appendix CDomain\-Specific Constraints
After conditioning optimization \(Section[3\.6](https://arxiv.org/html/2610.31721#S3.SS6)\), each candidate design is validated against a set of domain\-specific hard physical constraints before selection\. These constraints are not a property of the D2C framework itself but reflect the safety\-critical requirements of each application domain\. Only candidates that pass all constraints are eligible for selection by primary objective; this ensures that reported improvements correspond to physically realizable and operationally safe designs\.
##### ICF laser pulse constraints\.
A candidate pulsex^0\\hat\{x\}\_\{0\}is deemed*valid*if it satisfies all four of the following conditions simultaneously:
1. 1\.Yield gain\.The surrogate\-predicted neutron yield must exceed the baseline yield by at least a minimum threshold:\(Y^−Yref\)/Yref≥δgain\(\\hat\{Y\}\-Y\_\{\\mathrm\{ref\}\}\)/Y\_\{\\mathrm\{ref\}\}\\geq\\delta\_\{\\mathrm\{gain\}\}, withδgain=0\.1%\\delta\_\{\\mathrm\{gain\}\}=0\.1\\%\.
2. 2\.Energy conservation\.The integral of the generated pulse must not exceed that of the reference pulse \(with a small toleranceϵ=0\.01\\epsilon=0\.01\):∫x^0\(t\)𝑑t≤∫xref\(t\)𝑑t\+ϵ\\int\\hat\{x\}\_\{0\}\(t\)\\,dt\\leq\\int x\_\{\\mathrm\{ref\}\}\(t\)\\,dt\+\\epsilon\. This ensures the optimized pulse does not deliver more laser energy than the original design, which would violate facility power budgets\.
3. 3\.Spectral fidelity\.The mean absolute difference between the Fourier amplitude spectra of the generated and reference pulses must remain below a threshold:1N∑k\|\|X^k\|−\|Xkref\|\|<τfft\\frac\{1\}\{N\}\\sum\_\{k\}\\bigl\|\|\\hat\{X\}\_\{k\}\|\-\|X\_\{k\}^\{\\mathrm\{ref\}\}\|\\bigr\|<\\tau\_\{\\mathrm\{fft\}\}, withτfft=0\.2\\tau\_\{\\mathrm\{fft\}\}=0\.2\. This prevents the optimizer from introducing high\-frequency oscillations that are not physically realizable by the laser system\.
4. 4\.Temporal correlation\.The Pearson correlation between the generated and reference pulse waveforms must exceed a minimum:ρ\(x^0,xref\)\>τcorr\\rho\(\\hat\{x\}\_\{0\},x\_\{\\mathrm\{ref\}\}\)\>\\tau\_\{\\mathrm\{corr\}\}, withτcorr=0\.8\\tau\_\{\\mathrm\{corr\}\}=0\.8\. This ensures structural similarity to the original pulse shape, preventing the optimizer from producing qualitatively different \(and potentially unsafe\) drive profiles\.
##### Data center workload constraints\.
A candidate workload profilex^0\\hat\{x\}\_\{0\}is deemed*valid*if it satisfies all three conditions:
1. 1\.Carbon reduction\.The operational carbon emissions under the optimized profile must be lower than the baseline by at leastδred=0\.1%\\delta\_\{\\mathrm\{red\}\}=0\.1\\%:\(ErefCO2−E^CO2\)/ErefCO2≥δred\(E\_\{\\mathrm\{ref\}\}^\{\\mathrm\{CO\}\_\{2\}\}\-\\hat\{E\}^\{\\mathrm\{CO\}\_\{2\}\}\)/E\_\{\\mathrm\{ref\}\}^\{\\mathrm\{CO\}\_\{2\}\}\\geq\\delta\_\{\\mathrm\{red\}\}\.
2. 2\.Workload conservation\.The total compute delivered \(integral of the workload power profile\) must not fall more than1%1\\%below the reference:\(∫x^0\(t\)𝑑t−∫xref\(t\)𝑑t\)/∫xref\(t\)𝑑t≥−1%\(\\int\\hat\{x\}\_\{0\}\(t\)\\,dt\-\\int x\_\{\\mathrm\{ref\}\}\(t\)\\,dt\)/\\int x\_\{\\mathrm\{ref\}\}\(t\)\\,dt\\geq\-1\\%\. Under\-delivery violates service\-level agreements\. We make this final hard check asymmetric because under\-delivery is the operational failure mode tied to service\-level agreements; over\-delivery is still discouraged upstream by the inference\-time near\-equality penalty\.
3. 3\.Inlet temperature safety\.The predicted server inlet temperature must remain below a safety limit:Tinlet≤TmaxT\_\{\\mathrm\{inlet\}\}\\leq T\_\{\\max\}, withTmax=50∘CT\_\{\\max\}=50\\,^\{\\circ\}\\mathrm\{C\}\. Exceeding this threshold risks hardware damage and triggers emergency shutdowns in real facilities\.
In both domains, if no candidate satisfies all constraints, the baseline design is retained unchanged, contributing0%0\\%improvement to the reported metrics \(Algorithm[1](https://arxiv.org/html/2610.31721#alg1)\)\.
## Appendix DAblation Studies
We ablate guidance scale \(Section[D\.1](https://arxiv.org/html/2610.31721#A4.SS1)\) and its selection without oracle access \(Section[D\.2](https://arxiv.org/html/2610.31721#A4.SS2)\), optimization steps \(Section[D\.3](https://arxiv.org/html/2610.31721#A4.SS3)\), learning rate \(Section[D\.4](https://arxiv.org/html/2610.31721#A4.SS4)\), DDIM steps \(Section[D\.5](https://arxiv.org/html/2610.31721#A4.SS5)\), optimizable conditioning dimensionality \(Section[D\.6](https://arxiv.org/html/2610.31721#A4.SS6)\), conditioning versus latent\-noise optimization \(Section[D\.7](https://arxiv.org/html/2610.31721#A4.SS7)\), constraint\-satisfying improvement rate \(Section[D\.8](https://arxiv.org/html/2610.31721#A4.SS8)\), candidate budget \(Section[D\.9](https://arxiv.org/html/2610.31721#A4.SS9)\), and computational cost \(Section[D\.10](https://arxiv.org/html/2610.31721#A4.SS10)\)\.
### D\.1Effect of the Guidance Scale
The CFG guidance scalewwcontrols the strength of conditioning adherence during the DDIM reverse chain \(Eq\.[12](https://arxiv.org/html/2610.31721#S3.E12)\)\. While higherwwsharpens the conditional distribution and amplifies∂ϵ~θ/∂c\\partial\\tilde\{\\epsilon\}\_\{\\theta\}/\\partial c, excessively large values push generated designs away from the empirical data distribution captured by the learned prior, degrading both quality and optimizability\. We sweepw∈\{0,0\.5,1,2,3,5,7\}w\\in\\\{0,0\.5,1,2,3,5,7\\\}on both DC and ICF Top, holding all other hyperparameters fixed\.
Table 7:Ablation on the guidance scaleww\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.Table[7](https://arxiv.org/html/2610.31721#A4.T7)reveals a clear optimum atw=2w=2for both tasks\. Without guidance \(w=0w=0\), the model ignores conditioning entirely and optimization has no steering signal, producing little \(2\.30%2\.30\\%on DC\) or no \(0\.00%0\.00\\%on ICF Top\) improvement\. Moderate guidance \(w=1w=1–22\) provides strong conditioning gradients while keeping designs closer to the data distribution learned by the prior, yielding peak performance\. The two tasks exhibit markedly different sensitivity to over\-guidance\. DC degrades gracefully: performance drops only0\.400\.40percentage points fromw=2w=2tow=7w=7, reflecting the relatively smooth DC loss landscape\. ICF Top collapses sharply beyondw=2w=2, falling to0\.00%0\.00\\%atw=7w=7\. This is consistent with the ICF domain’s tight physical constraints: over\-guidance drives the generated pulses away from the feasible region represented in the offline data, causing validity\-first selection to reject most candidates\. These results validate the dual role ofwwdescribed in Section[3\.4](https://arxiv.org/html/2610.31721#S3.SS4): it modulates not only generation fidelity but also optimization stability, and must be tuned per domain\. Note that the0\.00%0\.00\\%entries do not indicate numerical divergence of the optimizer: they mean that no candidate passed the hard constraints of Appendix[C](https://arxiv.org/html/2610.31721#A3), so validity\-first selection returned the baseline design rather than an infeasible pulse\.
### D\.2Selecting the Guidance Scale Without Oracle Access
Table[7](https://arxiv.org/html/2610.31721#A4.T7)is computed with the evaluation oracle, which is unavailable when D2C is deployed on a new problem\. We therefore examine whetherwwcan be selected using only quantities available at optimization time, namely the frozen surrogateSϕS\_\{\\phi\}and the geometric validity checks of Appendix[C](https://arxiv.org/html/2610.31721#A3)\. On 100 held\-out ICF Top samples, we run D2C forw∈\{1,2,3,4\}w\\in\\\{1,2,3,4\\\}with all other hyperparameters fixed and, for each sample, select a single candidate under two surrogate\-only rules:
- •Full selection rule\.The selection rule used throughout the paper: candidates must satisfy the energy\-conservation, spectral\-fidelity \(τfft=0\.2\\tau\_\{\\mathrm\{fft\}\}\{=\}0\.2\), and temporal\-correlation \(τcorr=0\.8\\tau\_\{\\mathrm\{corr\}\}\{=\}0\.8\) checks together with the surrogate\-predicted gain thresholdδgain=0\.1%\\delta\_\{\\mathrm\{gain\}\}\{=\}0\.1\\%, and the remaining candidate with the highest surrogate\-predicted yield gain is chosen\.
- •Geometric\-only rule\.A more conservative variant that drops the surrogate\-gain threshold and keeps only the three geometric checks, again choosing the candidate with the highest surrogate\-predicted yield gain\.
Table[8](https://arxiv.org/html/2610.31721#A4.T8)reports the mean surrogate\-predicted yield gain of the selected candidates\.
Table 8:Surrogate\-only selection of the guidance scalewwon 100 held\-out ICF Top samples\. Values are the mean surrogate\-predicted yield gain \(%\) of the candidate selected per sample; no oracle evaluation is used\.Bold: best per row\.Both surrogate\-only signals peak atw=2w\{=\}2, the same value identified with oracle access in Table[7](https://arxiv.org/html/2610.31721#A4.T7), and the two rules produce identical rankings overww\. Because these values are surrogate predictions on a smaller sample rather than oracle evaluations, their magnitudes are not directly comparable to Table[7](https://arxiv.org/html/2610.31721#A4.T7); what matters for deployment is that the ranking overwwis preserved\. Thus, althoughwwmust be tuned per domain, this tuning can be carried out offline with the frozen surrogate and geometric checks alone, without access to the true objective\.
### D\.3Effect of the Number of Optimization Steps
We vary the number of conditioning optimization stepsJ∈\{10,20,30,40,50,75,100\}J\\in\\\{10,20,30,40,50,75,100\\\}with all other hyperparameters fixed at their default values \(w=2w=2\)\.
Table 9:Ablation on the number of optimization stepsJJ\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.The two tasks exhibit contrasting convergence profiles \(Table[9](https://arxiv.org/html/2610.31721#A4.T9)\)\. DC saturates rapidly:J=10J=10already captures88%88\\%of the peak improvement, and performance plateaus beyondJ=40J=40\. This reflects the relatively simple loss landscape of the workload scheduling problem, where a few gradient steps suffice to find a good conditioning point\. ICF Top improves monotonically with more steps, reaching its best result atJ=100J=100\. The ICF loss landscape is substantially more complex: the interplay of yield maximization, energy conservation, spectral stability, and smoothness constraints creates narrow feasible corridors that require more iterations to navigate\. In practice,J=40J=40offers a good efficiency–quality trade\-off for DC, while ICF benefits from the fullJ=100J=100budget\.
### D\.4Effect of the Optimization Learning Rate
The learning rateη\\etafor the conditioning optimizer controls the step size during gradient\-based optimization of the conditioning vector\. Too large a learning rate overshoots narrow feasible regions; too small a rate under\-explores within the allocated budgetJJ\. We sweepη∈\{10−1,5×10−2,2×10−2,10−2,10−3\}\\eta\\in\\\{10^\{\-1\},5\\times 10^\{\-2\},2\\times 10^\{\-2\},10^\{\-2\},10^\{\-3\}\\\}on DC and ICF Top with all other hyperparameters fixed\.
Table 10:Ablation on the optimization learning rateη\\eta\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.The two tasks exhibit markedly different optimal learning rates \(Table[10](https://arxiv.org/html/2610.31721#A4.T10)\)\. DC peaks atη=2×10−2\\eta=2\\times 10^\{\-2\}: its relatively smooth loss landscape permits aggressive steps that quickly reach the optimum, while smaller rates under\-explore within theJ=40J=40budget\. ICF Top peaks atη=10−3\\eta=10^\{\-3\}: the complex, tightly constrained ICF landscape requires cautious steps to remain within narrow feasible corridors\. Large rates \(η=10−1\\eta=10^\{\-1\}\) are catastrophic for ICF \(2\.34%2\.34\\%\) but only mildly harmful for DC \(8\.22%8\.22\\%\), confirming that ICF optimization is far more sensitive to step size\.
### D\.5Effect of the Number of DDIM Inference Steps
The number of DDIM reverse stepsTTcontrols the granularity of the denoising trajectory and, consequently, the quality of the differentiable path through which gradients flow\. Fewer steps reduce the computational cost per optimization iteration but make the discrete denoising trajectory coarser, potentially degrading both generation quality and gradient fidelity\. We sweepT∈\{10,25,50\}T\\in\\\{10,25,50\\\}on DC and ICF Top with all other hyperparameters fixed\.
Table 11:Ablation on the number of DDIM inference stepsTT\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.Performance is remarkably insensitive toTT\(Table[11](https://arxiv.org/html/2610.31721#A4.T11)\)\. Even with onlyT=10T=10steps, both tasks retain over95%95\\%of the peak improvement, and the optimum is reached atT=25T=25for both\. Increasing toT=50T=50yields no further gain, indicating that the gradient signal through the DDIM chain is already well\-conditioned at moderate step counts\. Practically, fewer inference steps translate directly to lower wall\-clock time per optimization iteration, makingT=25T=25the default choice\.
### D\.6Effect of the Number of Optimizable Conditioning Inputs
A key design choice in D2C is which conditioning dimensions to optimize\. Optimizing all dimensions ofcoptc\_\{\\mathrm\{opt\}\}maximizes expressivity but increases the search space; restricting to fewer inputs reduces degrees of freedom but may miss beneficial trade\-offs\. We vary the number of optimizable conditioning inputsdod\_\{o\}on both DC and ICF Top while keeping all other hyperparameters fixed\. For DC, the full conditioning includesdo=10d\_\{o\}=10optimizable energy metrics; we test subsets of size11,22,44, and66\. For ICF, the full conditioning includesdo=20d\_\{o\}=20optimizable LILAC variables; we test subsets of size11,44,99, and1515\. These subsets were not randomly re\-sampled across trials\. Instead, for each task we used one fixed, nested family of task\-specific subsets chosen once and then held fixed across all seeds, progressively expanding the optimizable block from the most central target dimensions outward \(for ICF beginning with the yield\-related LILAC targets, and for DC beginning with the primary energy\-metric targets used in the implementation\)\. Thus Table[12](https://arxiv.org/html/2610.31721#A4.T12)should be interpreted as a controlled dimensionality ablation under a fixed variable ordering, rather than as an average over all subsets of a given size\. In both cases, “All” denotes the full set used in the main results\.
Table 12:Ablation on the number of optimizable conditioning inputsdod\_\{o\}\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.Using the full set of optimizable inputs consistently yields the best results \(Table[12](https://arxiv.org/html/2610.31721#A4.T12)\)\. Restricting to a single input \(do=1d\_\{o\}=1\) cuts performance roughly in half on both tasks, confirming that D2C leverages multi\-dimensional conditioning to find better trade\-offs\. Both tasks improve monotonically withdod\_\{o\}: on ICF, performance rises steadily from4\.02%4\.02\\%to8\.97%8\.97\\%as more target parameters become available, while DC follows the same trend from5\.14%5\.14\\%to7\.97%7\.97\\%\. The full conditioning set \(“All”\) achieves the best result on both tasks, justifying the default of optimizing all available inputs\.
### D\.7Conditioning Optimization versus Latent\-Noise Optimization
Since the deterministic DDIM chainGθ\(c,xT\)G\_\{\\theta\}\(c,x\_\{T\}\)is differentiable in both of its inputs, the same gradient\-based procedure can be applied either to the optimizable conditioningcoptc\_\{\\mathrm\{opt\}\}\(the default D2C setting on the real\-world tasks\) or to the latent noisexTx\_\{T\}\(the variant used on Design\-Bench, Appendix[B\.4](https://arxiv.org/html/2610.31721#A2.SS4)\)\. To isolate the effect of this choice, we compare the two variants on ICF Top and DC while holding the diffusion proposer, surrogate, loss, candidate budget, validity\-first selection, and evaluation protocol fixed, and changing only the optimized variable\. In the latent variant, the conditioning is fixed to its initial value and the gradient updates of Eq\. \([14](https://arxiv.org/html/2610.31721#S3.E14)\) are applied toxTx\_\{T\}instead ofcoptc\_\{\\mathrm\{opt\}\}\.
Table 13:Conditioning optimization versus latent\-noise optimization on the real\-world tasks\. Values are mean percentage improvement \(%\) over the baseline design±\\pmstd over 5 runs\.Bold: best\.Conditioning optimization outperforms latent\-noise optimization on both tasks \(Table[13](https://arxiv.org/html/2610.31721#A4.T13)\), by2\.502\.50percentage points on ICF Top and5\.365\.36percentage points on DC\. This supports treating the conditioning signal, rather than the initial noise, as the optimizable variable whenever the conditioning exposes several optimizable coordinates \(do=20d\_\{o\}\{=\}20for ICF anddo=10d\_\{o\}\{=\}10for DC\)\. In this regime,coptc\_\{\\mathrm\{opt\}\}acts on the generated design through the semantically meaningful performance targets that the proposer was trained to follow, so updates move designs along directions supported by the learned conditional distribution; perturbingxTx\_\{T\}directly offers more raw degrees of freedom but is less aligned with the objectives and more prone to drifting toward regions where candidates fail the hard constraints\. Together with Table[12](https://arxiv.org/html/2610.31721#A4.T12), where restricting ICF todo=1d\_\{o\}\{=\}1reduces performance to4\.02%4\.02\\%, these results also explain the Design\-Bench setting: when the conditioning is a single scalar score, it provides too few handles and latent\-noise optimization becomes the stronger choice\.
### D\.8Constraint\-Satisfying Improvement Rate
Because final selection is validity\-first \(Section[3\.6](https://arxiv.org/html/2610.31721#S3.SS6.SSS0.Px3)\), overall performance depends not only on objective improvement but also on how often a method produces a successful test sample\. We therefore report the mean constraint\-satisfying improvement rate over 5 seeds: the percentage of evaluation samples for which the method produces a final design with nonzero gain, i\.e\., for which at least one valid improving candidate is found and selected rather than reverting to the baseline\. Higher constraint\-satisfying improvement rates indicate that a method succeeds more often on the 2,000\-sample ICF Standard/DC evaluations and the 1,000\-sample ICF Top evaluation\.
Table 14:Constraint\-satisfying improvement rate \(%\) on the real\-world tasks\. Values are mean constraint\-satisfying improvement rate±\\pmstd over 5 runs, where the metric is the percentage of evaluation samples for which the final selected design achieves nonzero gain relative to the baseline \(equivalently, at least one valid improving candidate is found\)\. Higher is better\.Table[14](https://arxiv.org/html/2610.31721#A4.T14)shows that D2C attains the highest constraint\-satisfying improvement rate on both ICF settings and ties for the highest rate on DC\. Importantly, the surrogate\-based real\-world baselines in this comparison are not optimized against the primary objective alone; their implementation details and constraint\-aware penalty terms are summarized in Appendix[A](https://arxiv.org/html/2610.31721#A1)\. The margin is especially pronounced on the ICF tasks: D2C succeeds on81\.23%81\.23\\%of ICF Standard samples and75\.12%75\.12\\%of ICF Top samples, far above the next\-best methods\. This indicates that optimizing conditioning through the differentiable DDIM chain improves not only the quality of the final solution when optimization succeeds, but also the probability of finding any valid improvement at all\.
The gap is most informative on ICF Top, where all methods operate on already high\-performing baseline designs and the feasible improvement region is especially narrow\. Most baselines experience a sharp drop in constraint\-satisfying improvement rate in this regime, whereas D2C retains a75\.12%75\.12\\%success rate, showing that its advantage is not only better objective optimization but also a higher rate of finding valid improving candidates under strict constraints\. On DC, constraint\-satisfying improvement rates are generally higher across methods, consistent with the smoother operational landscape of the scheduling problem; D2C and GP\-qEI both achieve100%100\\%, while DDOM \(79\.10%79\.10\\%\) and REINFORCE \(88\.18%88\.18\\%\) also remain relatively robust\. Overall, these results explain why validity\-first selection benefits D2C so strongly: it not only finds stronger solutions, but also reverts to the baseline much less often\.
### D\.9Effect of Candidate Budget \(Nz×NλN\_\{z\}\\times N\_\{\\lambda\}\)
The total candidate budgetB=Nz×NλB=N\_\{z\}\\times N\_\{\\lambda\}determines how many parallel optimization trajectories are explored per test sample\.NzN\_\{z\}controls the number of independent noise realizations \(exploring structurally different regions of the latent space\), whileNλN\_\{\\lambda\}controls the number of Dirichlet\-sampled weight vectors per noise trial \(exploring different objective trade\-offs from the same starting point\)\. We sweep seven configurations fromB=3B\{=\}3toB=100B\{=\}100on ICF Top and DC, holding all other hyperparameters fixed\.
Table 15:Ablation on the candidate budgetNz×NλN\_\{z\}\\times N\_\{\\lambda\}\. Values are mean±\\pmstandard deviation over 5 seeds\. Configurations are labeled by theirNz×NλN\_\{z\}\\times N\_\{\\lambda\}values\.Table[15](https://arxiv.org/html/2610.31721#A4.T15)reveals two complementary effects\. First, increasing noise diversity \(NzN\_\{z\}\) with fixedNλ=3N\_\{\\lambda\}\{=\}3produces large gains: ICF Top improves from0\.86%0\.86\\%\(Nz=1N\_\{z\}\{=\}1\) to9\.64%9\.64\\%\(Nz=20N\_\{z\}\{=\}20\), confirming that multiple latent\-space starting points are essential for discovering high\-quality modes in complex landscapes\. Second, for a fixed budget ofNz=20N\_\{z\}\{=\}20noise trials, increasing weight diversity fromNλ=1N\_\{\\lambda\}\{=\}1\(single loss weighting\) toNλ=3N\_\{\\lambda\}\{=\}3\(Dirichlet\-sampled\) yields substantial gains on ICF Top \(5\.72%→9\.64%5\.72\\%\\to 9\.64\\%\), validating the multi\-objective coverage strategy\. The comparison between20×120\\times 1\(no Dirichlet diversity\) and20×520\\times 5isolates the contribution of stochastic weight sampling: the\+76%\+76\\%relative improvement on ICF Top \(5\.72%→10\.06%5\.72\\%\\to 10\.06\\%\) demonstrates that exploring different trade\-offs from the same noise realization uncovers solutions that a single fixed weighting misses\. On DC, the landscape is smoother and the method saturates earlier:Nz=10,Nλ=3N\_\{z\}\{=\}10,N\_\{\\lambda\}\{=\}3already captures96%96\\%of the peak, and further budget increases yield diminishing returns\. Overall,Nz=20,Nλ=3N\_\{z\}\{=\}20,N\_\{\\lambda\}\{=\}3\(B=60B\{=\}60total candidates\) offers the best efficiency–quality trade\-off across both tasks, whereasNz=20,Nλ=5N\_\{z\}\{=\}20,N\_\{\\lambda\}\{=\}5\(B=100B\{=\}100\) yields the strongest final performance and is therefore used for the main reported results\. Because the optimization trajectories are batched on the GPU, increasing the candidate budget is substantially more efficient than evaluating trajectories sequentially; however, larger budgets still increase memory usage and may increase latency depending on hardware and batch size\.
### D\.10Computational Cost
Table[16](https://arxiv.org/html/2610.31721#A4.T16)reports the wall\-clock time per sample \(in seconds\) for each method on ICF Top and DC\.
Table 16:Computation time \(seconds per sample\) for each method\. Lower is better\.For this evaluation we use theNz=20,Nλ=5N\_\{z\}\{=\}20,N\_\{\\lambda\}\{=\}5\(B=100B\{=\}100total candidates\) configuration \(the configuration used for the main results\)\. D2C is among the more expensive methods \(34\.734\.7s /39\.839\.8s\), comparable to CMA\-ES and Gradient Ascent, because each optimization step requires a full forward and backward pass through theTT\-step DDIM chain\. TheJ=100J\{=\}100conditioning updates are sequential, but within each update allB=100B\{=\}100candidate trajectories are executed as a single batched DDIM forward/backward pass on the GPU rather than as 100 separate launches\. Lightweight baselines such as MINs, PGS, and DDOM run an order of magnitude faster \(22–55s\) since they perform a single forward pass without iterative optimization\. GP\-qEI is the most expensive due to Gaussian process fitting\. Importantly, D2C’s cost scales linearly withJJandTT\(Sections[D\.3](https://arxiv.org/html/2610.31721#A4.SS3)and[D\.5](https://arxiv.org/html/2610.31721#A4.SS5)\), and the ablations above show that reducing either has minimal impact on quality\. For example, reducingTTfrom2525to1010would cut wall\-clock time by roughly60%60\\%while retaining98%98\\%of the improvement\. The Brute Force baseline takes2323–3636s despite lacking gradient computation because it is not a single batched forward pass\. Instead, it repeatedly reruns the DDIM sampler across an explicit conditioning sweep \(100 sweep points per sample in ICF, and 100 sweep points with multiple noise seeds per point in the DC implementation\), evaluating each generated candidate afterward\. Its runtime is therefore comparable to D2C because both methods spend most of their time repeatedly invoking the DDIM proposer; D2C adds backpropagation, whereas Brute Force spends that budget on many forward\-only sweep evaluations\.
## Appendix EDomain\-Specific Training Losses
We instantiate the general training objective \(Eq\.[8](https://arxiv.org/html/2610.31721#S3.E8)\) for each application domain\. In both cases the total loss follows the same four\-term structure: denoising, reconstruction, physics\-based fidelity, and surrogate consistency\. The differences lie in the specific fidelity constraints and surrogate architecture\.
### E\.1ICF Laser Pulse Optimization
The designx∈ℝ256x\\in\\mathbb\{R\}^\{256\}is a laser power pulse profile, conditioned onc=\(T0,…,T6,L1,…,L20\)∈ℝ27c=\(T\_\{0\},\\ldots,T\_\{6\},L\_\{1\},\\ldots,L\_\{20\}\)\\in\\mathbb\{R\}^\{27\}, whereTiT\_\{i\}are target parameters andLjL\_\{j\}are the 20 LILAC\-simulated performance variables included in the conditioning vector\.
##### Surrogate consistency \(LILAC\)\.
The frozen LILAC surrogateSϕICFS\_\{\\phi\}^\{\\mathrm\{ICF\}\}takes as input the concatenation\[x^0,cfix\]∈ℝ256\+7\[\\hat\{x\}\_\{0\},\\,c\_\{\\mathrm\{fix\}\}\]\\in\\mathbb\{R\}^\{256\+7\}\(predicted pulse and the 7 target parameters\) and predicts 20 LILAC performance variablesL^∈ℝ20\\hat\{L\}\\in\\mathbb\{R\}^\{20\}\. The loss is:
ℒsurrICF=‖L^−L‖2,L^=SϕICF\(x^0,cfix\),\\mathcal\{L\}\_\{\\mathrm\{surr\}\}^\{\\mathrm\{ICF\}\}=\\\|\\hat\{L\}\-L\\\|^\{2\},\\qquad\\hat\{L\}=S\_\{\\phi\}^\{\\mathrm\{ICF\}\}\(\\hat\{x\}\_\{0\},\\,c\_\{\\mathrm\{fix\}\}\),\(16\)whereL=\(c8,…,c27\)∈ℝ20L=\(c\_\{8\},\\ldots,c\_\{27\}\)\\in\\mathbb\{R\}^\{20\}are the ground\-truth LILAC variables from the conditioning vector\. This loss is applied with weightαs=1\.0\\alpha\_\{s\}=1\.0\.
##### Physics\-based fidelity\.
Two one\-sided penalties encourage physical realizability of the generated pulse:
ℒfidICF=\[∫x^0\(t\)⋅sy𝑑t−∫x\(t\)⋅sy𝑑t\]\+\+\[max\(x^0⋅sy\)−Vmax\]\+,\\mathcal\{L\}\_\{\\mathrm\{fid\}\}^\{\\mathrm\{ICF\}\}=\\Bigl\[\\int\\hat\{x\}\_\{0\}\(t\)\\cdot s\_\{y\}\\,dt\-\\int x\(t\)\\cdot s\_\{y\}\\,dt\\Bigr\]\_\{\+\}\+\\bigl\[\\max\(\\hat\{x\}\_\{0\}\\cdot s\_\{y\}\)\-V\_\{\\max\}\\bigr\]\_\{\+\},\(17\)wheresys\_\{y\}is the data scaler that maps normalized values back to physical units,VmaxV\_\{\\max\}is the maximum observed pulse amplitude, and\[⋅\]\+=max\(⋅,0\)\[\\cdot\]\_\{\+\}=\\max\(\\cdot,0\)\. The first term prevents the generated pulse from delivering more energy than the reference; the second prevents physically impossible peak powers\.
##### Total ICF training loss\.
ℒtrainICF=‖ϵ−ϵθ‖2\+αr‖x^0−x‖2\+ℒsurrICF\+αaℒfidICF\+αsmℒsmooth,\\mathcal\{L\}\_\{\\mathrm\{train\}\}^\{\\mathrm\{ICF\}\}=\\\|\\epsilon\-\\epsilon\_\{\\theta\}\\\|^\{2\}\+\\alpha\_\{r\}\\,\\\|\\hat\{x\}\_\{0\}\-x\\\|^\{2\}\+\\mathcal\{L\}\_\{\\mathrm\{surr\}\}^\{\\mathrm\{ICF\}\}\+\\alpha\_\{a\}\\,\\mathcal\{L\}\_\{\\mathrm\{fid\}\}^\{\\mathrm\{ICF\}\}\+\\alpha\_\{\\mathrm\{sm\}\}\\,\\mathcal\{L\}\_\{\\mathrm\{smooth\}\},\(18\)with weightsαr=0\.5\\alpha\_\{r\}=0\.5,αa=0\.001\\alpha\_\{a\}=0\.001,αsm=0\.0001\\alpha\_\{\\mathrm\{sm\}\}=0\.0001\.
### E\.2Data Center Workload Scheduling
The designx∈ℝ144x\\in\\mathbb\{R\}^\{144\}is a 24\-hour workload power profile at 10\-minute resolution, conditioned onc∈ℝ83c\\in\\mathbb\{R\}^\{83\}comprising 73 environment state dimensions \(C0,C1,C3∈ℝ24C\_\{0\},C\_\{1\},C\_\{3\}\\in\\mathbb\{R\}^\{24\}hourly profiles andC2C\_\{2\}scalar IT demand\) and 10 energy performance metrics \(E0,…,E9E\_\{0\},\\ldots,E\_\{9\}\)\.
##### Surrogate consistency\.
The frozen DC surrogateSϕDCS\_\{\\phi\}^\{\\mathrm\{DC\}\}takes the concatenation\[x^0,cfix\]∈ℝ144\+73\[\\hat\{x\}\_\{0\},\\,c\_\{\\mathrm\{fix\}\}\]\\in\\mathbb\{R\}^\{144\+73\}\(predicted profile and the 73 environment conditioning dimensions\) and predicts 10 energy metricsE^∈ℝ10\\hat\{E\}\\in\\mathbb\{R\}^\{10\}:
ℒsurrDC=‖E^−E‖2,E^=SϕDC\(x^0,cfix\),\\mathcal\{L\}\_\{\\mathrm\{surr\}\}^\{\\mathrm\{DC\}\}=\\\|\\hat\{E\}\-E\\\|^\{2\},\\qquad\\hat\{E\}=S\_\{\\phi\}^\{\\mathrm\{DC\}\}\(\\hat\{x\}\_\{0\},\\,c\_\{\\mathrm\{fix\}\}\),\(19\)whereE=\(c74,…,c83\)∈ℝ10E=\(c\_\{74\},\\ldots,c\_\{83\}\)\\in\\mathbb\{R\}^\{10\}are the ground\-truth metrics from the conditioning\.
##### Physics\-based fidelity\.
The fidelity term enforces workload integral conservation and amplitude bounds:
ℒfidDC=\[∫x^0\(t\)⋅M𝑑t−∫x\(t\)⋅M𝑑t\]\+\+\[max\(x^0\)−1\]\+\+\[−min\(x^0\)\]\+,\\mathcal\{L\}\_\{\\mathrm\{fid\}\}^\{\\mathrm\{DC\}\}=\\Bigl\[\\int\\hat\{x\}\_\{0\}\(t\)\\cdot M\\,dt\-\\int x\(t\)\\cdot M\\,dt\\Bigr\]\_\{\+\}\+\\bigl\[\\max\(\\hat\{x\}\_\{0\}\)\-1\\bigr\]\_\{\+\}\+\\bigl\[\-\\min\(\\hat\{x\}\_\{0\}\)\\bigr\]\_\{\+\},\(20\)whereMMis the data\-range scaling factor\. The first term prevents the scheduled workload from exceeding the reference demand; the second and third keep the normalized profile within\[0,1\]\[0,1\]\. This training\-stage relaxation is intentionally one\-sided: the reconstruction term already anchors samples near observed workloads, so the fidelity term mainly suppresses unrealistic demand inflation while preserving coverage of the empirical profile manifold\.
##### Total DC training loss\.
ℒtrainDC=‖ϵ−ϵθ‖2\+αr‖x^0−x‖2\+αaℒfidDC\+αsmℒsmooth\+αsℒsurrDC,\\mathcal\{L\}\_\{\\mathrm\{train\}\}^\{\\mathrm\{DC\}\}=\\\|\\epsilon\-\\epsilon\_\{\\theta\}\\\|^\{2\}\+\\alpha\_\{r\}\\,\\\|\\hat\{x\}\_\{0\}\-x\\\|^\{2\}\+\\alpha\_\{a\}\\,\\mathcal\{L\}\_\{\\mathrm\{fid\}\}^\{\\mathrm\{DC\}\}\+\\alpha\_\{\\mathrm\{sm\}\}\\,\\mathcal\{L\}\_\{\\mathrm\{smooth\}\}\+\\alpha\_\{s\}\\,\\mathcal\{L\}\_\{\\mathrm\{surr\}\}^\{\\mathrm\{DC\}\},\(21\)with default weightsαr=0\.5\\alpha\_\{r\}=0\.5,αa=0\.01\\alpha\_\{a\}=0\.01,αsm=0\.0001\\alpha\_\{\\mathrm\{sm\}\}=0\.0001,αs=1\.0\\alpha\_\{s\}=1\.0\.
##### Smoothness loss \(shared\)\.
Both domains use the same squared first\-difference penalty \(discrete Dirichlet energy\):
ℒsmooth\(x^0\)=1d−1∑i=1d−1\(x^0,i\+1−x^0,i\)2\.\\mathcal\{L\}\_\{\\mathrm\{smooth\}\}\(\\hat\{x\}\_\{0\}\)=\\frac\{1\}\{d\-1\}\\sum\_\{i=1\}^\{d\-1\}\(\\hat\{x\}\_\{0,i\+1\}\-\\hat\{x\}\_\{0,i\}\)^\{2\}\.\(22\)
## Appendix FDomain\-Specific Inference\-Time Losses
We instantiate the general inference\-time loss \(Eq\.[13](https://arxiv.org/html/2610.31721#S3.E13)\) for each application domain\. In both cases the loss is a weighted sum of a surrogate\-based objective, physical constraint penalties, and a smoothness term\. We do not apply an additional post\-hoc normalization after forming these task\-specific losses; instead, comparability is enforced by construction wherever possible\. In particular, the objective terms are written as relative improvements over the baseline, conservation penalties are written as relative deviations when appropriate, smoothness and spectral penalties are averaged over dimensions, and all designs and conditioning variables are MinMax\-scaled to\[0,1\]\[0,1\]\(Appendix[B\.5](https://arxiv.org/html/2610.31721#A2.SS5)\)\. The Dirichlet\-sampled weights therefore act over task\-specific losses that are already on broadly comparable scales rather than over raw quantities with incompatible units\.
### F\.1ICF Laser Pulse Optimization
The inference\-time loss for ICF combines four terms with Dirichlet\-sampled weights𝝀=\(λy,λs,λe,λsm\)\\boldsymbol\{\\lambda\}=\(\\lambda\_\{y\},\\lambda\_\{s\},\\lambda\_\{e\},\\lambda\_\{\\mathrm\{sm\}\}\):
ℒICF=λyℒyield\+λsℒstab\+λeℒenergy\+λsmℒsmooth\.\\mathcal\{L\}^\{\\mathrm\{ICF\}\}=\\lambda\_\{y\}\\,\\mathcal\{L\}\_\{\\mathrm\{yield\}\}\+\\lambda\_\{s\}\\,\\mathcal\{L\}\_\{\\mathrm\{stab\}\}\+\\lambda\_\{e\}\\,\\mathcal\{L\}\_\{\\mathrm\{energy\}\}\+\\lambda\_\{\\mathrm\{sm\}\}\\,\\mathcal\{L\}\_\{\\mathrm\{smooth\}\}\.\(23\)
##### Yield objective\.
The frozen LILAC surrogate predicts the log neutron yield from the generated pulse and laser parameters\. The loss maximizes relative yield gain over the baseline:
ℒyield=−exp\(Sϕ\(x0,cfix\)0\)−YbaseYbase\+ϵ,\\mathcal\{L\}\_\{\\mathrm\{yield\}\}=\-\\frac\{\\exp\\\!\\bigl\(S\_\{\\phi\}\(x\_\{0\},c\_\{\\mathrm\{fix\}\}\)\_\{0\}\\bigr\)\-Y\_\{\\mathrm\{base\}\}\}\{Y\_\{\\mathrm\{base\}\}\+\\epsilon\},\(24\)whereSϕ\(⋅\)0S\_\{\\phi\}\(\\cdot\)\_\{0\}is the predicted log yield \(inverse\-scaled to physical units\) andYbase=exp\(Sϕ\(xref,cfix\)0\)Y\_\{\\mathrm\{base\}\}=\\exp\(S\_\{\\phi\}\(x\_\{\\mathrm\{ref\}\},c\_\{\\mathrm\{fix\}\}\)\_\{0\}\)\.
##### Spectral stability\.
The optimized pulse must preserve the frequency content of the reference to ensure physical plausibility:
ℒstab=1N∑i=1N\(\|ℱ\(x0\)i\|−\|ℱ\(xref\)i\|\)2,\\mathcal\{L\}\_\{\\mathrm\{stab\}\}=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\bigl\(\|\\mathcal\{F\}\(x\_\{0\}\)\_\{i\}\|\-\|\\mathcal\{F\}\(x\_\{\\mathrm\{ref\}\}\)\_\{i\}\|\\bigr\)^\{2\},\(25\)whereℱ\\mathcal\{F\}denotes the discrete Fourier transform overNNfrequency bins\.
##### Energy conservation\.
The pulse integral must not exceed the reference \(one\-sided penalty\):
ℒenergy=\[∫x0\(t\)⋅sy𝑑t−∫xref\(t\)⋅sy𝑑t\]\+,\\mathcal\{L\}\_\{\\mathrm\{energy\}\}=\\Bigl\[\\int x\_\{0\}\(t\)\\cdot s\_\{y\}\\,dt\-\\int x\_\{\\mathrm\{ref\}\}\(t\)\\cdot s\_\{y\}\\,dt\\Bigr\]\_\{\+\},\(26\)wheresys\_\{y\}maps normalized values to physical units\.
##### Smoothness\.
Squared first\-difference penalty \(discrete Dirichlet energy\):ℒsmooth=1d−1∑i\(x0,i\+1−x0,i\)2\\mathcal\{L\}\_\{\\mathrm\{smooth\}\}=\\frac\{1\}\{d\-1\}\\sum\_\{i\}\(x\_\{0,i\+1\}\-x\_\{0,i\}\)^\{2\}\.
##### Validity criteria\.
The hard constraint thresholds used for candidate selection are detailed in Appendix[C](https://arxiv.org/html/2610.31721#A3)\.
### F\.2Data Center Workload Scheduling
The inference\-time loss for DC combines three terms with Dirichlet\-sampled weights𝝀=\(λc,λp,λsm\)\\boldsymbol\{\\lambda\}=\(\\lambda\_\{c\},\\lambda\_\{p\},\\lambda\_\{\\mathrm\{sm\}\}\):
ℒDC=λcℒcost\+λpℒpower\+λsmℒsmooth\.\\mathcal\{L\}^\{\\mathrm\{DC\}\}=\\lambda\_\{c\}\\,\\mathcal\{L\}\_\{\\mathrm\{cost\}\}\+\\lambda\_\{p\}\\,\\mathcal\{L\}\_\{\\mathrm\{power\}\}\+\\lambda\_\{\\mathrm\{sm\}\}\\,\\mathcal\{L\}\_\{\\mathrm\{smooth\}\}\.\(27\)
##### Cost objective\.
The frozen DC surrogate predicts energy metrics from the generated profile and environmental conditioning\. The loss maximizes relative reduction in the target metric \(e\.g\., carbon footprintE9E\_\{9\}or total powerE0E\_\{0\}\):
ℒcost=−fbase−Sϕ\(x0,cfix\)kfbase\+ϵ,\\mathcal\{L\}\_\{\\mathrm\{cost\}\}=\-\\frac\{f\_\{\\mathrm\{base\}\}\-S\_\{\\phi\}\(x\_\{0\},c\_\{\\mathrm\{fix\}\}\)\_\{k\}\}\{f\_\{\\mathrm\{base\}\}\+\\epsilon\},\(28\)whereSϕ\(⋅\)kS\_\{\\phi\}\(\\cdot\)\_\{k\}is thekk\-th predicted metric inverse\-scaled to physical units andfbasef\_\{\\mathrm\{base\}\}is its baseline value\.
##### Workload conservation\.
The total workload delivered must match the reference within a tight toleranceτ\\tau:
ℒpower=d2\+μ\[\|d\|−τ\]\+2,d=ℐ\(x0\)−ℐ\(xref\)\|ℐ\(xref\)\|\+ϵ,\\mathcal\{L\}\_\{\\mathrm\{power\}\}=d^\{2\}\+\\mu\\,\[\\,\|d\|\-\\tau\\,\]\_\{\+\}^\{2\},\\qquad d=\\frac\{\\mathcal\{I\}\(x\_\{0\}\)\-\\mathcal\{I\}\(x\_\{\\mathrm\{ref\}\}\)\}\{\|\\mathcal\{I\}\(x\_\{\\mathrm\{ref\}\}\)\|\+\\epsilon\},\(29\)whereℐ\(x\)=∫x\(t\)⋅M𝑑t\\mathcal\{I\}\(x\)=\\int x\(t\)\\cdot M\\,dtis the scaled integral andμ\\muis the barrier penalty coefficient \(μ=100\\mu=100in all DC experiments\)\. At inference, in contrast, we optimize against an external carbon objective, so we use a near\-equality penalty around the reference workload to prevent the optimizer from exploiting either over\-delivery or under\-delivery as an artificial route to lower emissions\.
##### Smoothness\.
First\- and second\-order finite differences:
ℒsmooth=1d−1∑i\(Δxi\)2\+12\(d−2\)∑i\(Δ2xi\)2,\\mathcal\{L\}\_\{\\mathrm\{smooth\}\}=\\frac\{1\}\{d\{\-\}1\}\\sum\_\{i\}\(\\Delta x\_\{i\}\)^\{2\}\+\\frac\{1\}\{2\(d\{\-\}2\)\}\\sum\_\{i\}\(\\Delta^\{2\}x\_\{i\}\)^\{2\},\(30\)whereΔxi=x0,i\+1−x0,i\\Delta x\_\{i\}=x\_\{0,i\+1\}\-x\_\{0,i\}andΔ2xi=x0,i\+2−2x0,i\+1\+x0,i\\Delta^\{2\}x\_\{i\}=x\_\{0,i\+2\}\-2x\_\{0,i\+1\}\+x\_\{0,i\}\.
##### Validity criteria\.
The hard constraint thresholds used for candidate selection are detailed in Appendix[C](https://arxiv.org/html/2610.31721#A3)\.
## Appendix GDirichlet\-Weighted Multi\-Objective Sampling
The Dirichlet distributionDir\(𝜶\)\\mathrm\{Dir\}\(\\boldsymbol\{\\alpha\}\)is a continuous probability distribution over the\(K−1\)\(K\{\-\}1\)\-dimensional simplexΔK−1=\{𝝀∈ℝK:λk≥0,∑kλk=1\}\\Delta^\{K\-1\}=\\\{\\boldsymbol\{\\lambda\}\\in\\mathbb\{R\}^\{K\}:\\lambda\_\{k\}\\geq 0,\\;\\sum\_\{k\}\\lambda\_\{k\}=1\\\}\. It is parameterized by a concentration vector𝜶=\(α1,…,αK\)\\boldsymbol\{\\alpha\}=\(\\alpha\_\{1\},\\ldots,\\alpha\_\{K\}\)withαk\>0\\alpha\_\{k\}\>0, and has density:
p\(𝝀∣𝜶\)=Γ\(∑kαk\)∏kΓ\(αk\)∏k=1Kλkαk−1,p\(\\boldsymbol\{\\lambda\}\\mid\\boldsymbol\{\\alpha\}\)=\\frac\{\\Gamma\\\!\\bigl\(\\sum\_\{k\}\\alpha\_\{k\}\\bigr\)\}\{\\prod\_\{k\}\\Gamma\(\\alpha\_\{k\}\)\}\\prod\_\{k=1\}^\{K\}\\lambda\_\{k\}^\{\\alpha\_\{k\}\-1\},\(31\)whereΓ\(⋅\)\\Gamma\(\\cdot\)is the gamma function\. Key properties relevant to our use:
- •Simplex constraint\.Every sample𝝀∼Dir\(𝜶\)\\boldsymbol\{\\lambda\}\\sim\\mathrm\{Dir\}\(\\boldsymbol\{\\alpha\}\)satisfies∑kλk=1\\sum\_\{k\}\\lambda\_\{k\}=1andλk≥0\\lambda\_\{k\}\\geq 0by construction, making it a natural distribution over loss\-weight vectors\.
- •Symmetric case \(αk=α\\alpha\_\{k\}=\\alphafor allkk\)\.When all concentration parameters are equal, the distribution is symmetric over allKKobjectives\. Withα=1\\alpha=1\(our default\), the density is*uniform*over the simplex: every possible trade\-off among theKKloss terms is equally likely\.
- •Concentration control\.Settingα<1\\alpha<1concentrates samples near the vertices of the simplex \(i\.e\., each draw emphasizes a single objective strongly\), whileα\>1\\alpha\>1concentrates samples near the center𝝀=\(1/K,…,1/K\)\\boldsymbol\{\\lambda\}=\(1/K,\\ldots,1/K\)\(i\.e\., more balanced trade\-offs\)\. The choiceα=1\\alpha=1provides maximum diversity\.
##### Intuition for D2C\.
In our framework, each of theNλN\_\{\\lambda\}weight vectors𝝀\(m\)∼Dir\(𝟏K\)\\boldsymbol\{\\lambda\}^\{\(m\)\}\\sim\\mathrm\{Dir\}\(\\mathbf\{1\}\_\{K\}\)defines a different scalarization of the multi\-objective loss \(Eq\.[13](https://arxiv.org/html/2610.31721#S3.E13)\)\. Some draws will heavily weight the surrogate yield objective \(exploring aggressive performance gains\); others will emphasize constraint penalties \(producing conservative but highly feasible designs\); yet others will balance smoothness against performance\. By optimizingNλN\_\{\\lambda\}trajectories in parallel with different weight vectors, the candidate pool explores diverse scalarized trade\-offs without requiring manual tuning of fixed weights\. This uniformity is with respect to the weight simplex over these task\-specific scalarizations; it is not a claim that Dirichlet weighting alone removes arbitrary objective\-scale mismatches without the loss design described above\. The validity\-first selection \(Stage 3 of Algorithm[1](https://arxiv.org/html/2610.31721#alg1)\) then picks the best feasible candidate from this diverse pool, combining broad exploration with strict constraint satisfaction\.
## Appendix HTheoretical Analysis: Convergence and Stability
We summarize several local and conditional analytical properties of D2C\. The results below establish an exact chain\-rule decomposition for gradients through the DDIM reverse chain, a standard gradient\-descent bound for a fixed smooth\-region subproblem, almost\-everywhere differentiability for smooth one\-sided penalties, and a simple conditional ranking guarantee for the frozen surrogate objective\.
### H\.1Gradient Stability Through the DDIM Chain
A primary concern in differentiating through iterative denoising chains is the potential for vanishing or exploding gradients as the number of stepsTTgrows\. Rather than claiming a full global stability theorem, we first record the exact chain\-rule decomposition that underlies gradient flow through the DDIM reverse process\.
Proposition 1 \(Conditioning\-Jacobian Decomposition\)\.LetGθ\(c,xT\)=x0G\_\{\\theta\}\(c,x\_\{T\}\)=x\_\{0\}denote theTT\-step DDIM reverse chain \(Eq\.[11](https://arxiv.org/html/2610.31721#S3.E11)\) with frozen parametersθ\\theta, and assume each reverse step is differentiable in\(xt,c\)\(x\_\{t\},c\)\. Then:
∂x0∂c=∑t=1T\(∏s=1t−1Js\)∂xt−1∂c\|xt,\\frac\{\\partial x\_\{0\}\}\{\\partial c\}=\\sum\_\{t=1\}^\{T\}\\left\(\\prod\_\{s=1\}^\{t\-1\}J\_\{s\}\\right\)\\frac\{\\partial x\_\{t\-1\}\}\{\\partial c\}\\bigg\|\_\{x\_\{t\}\},\(32\)whereJs=∂xs−1∂xsJ\_\{s\}=\\frac\{\\partial x\_\{s\-1\}\}\{\\partial x\_\{s\}\}is the per\-step transition Jacobian, and the direct term∂xt−1∂c\|xt\\frac\{\\partial x\_\{t\-1\}\}\{\\partial c\}\\big\|\_\{x\_\{t\}\}captures the local effect ofccat steptt\.
Proof\.Each DDIM step \(Eq\.[11](https://arxiv.org/html/2610.31721#S3.E11)\) computesxt−1=ϕ\(xt,c,t\)x\_\{t\-1\}=\\phi\(x\_\{t\},c,t\)whereϕ\\phidepends onccthrough the CFG\-guided noiseϵ~θ\\tilde\{\\epsilon\}\_\{\\theta\}\(Eq\.[12](https://arxiv.org/html/2610.31721#S3.E12)\)\. Applying the chain rule recursively over theTTreverse steps yields Eq\. \([32](https://arxiv.org/html/2610.31721#A8.E32)\)\.□\\square
Remark\.Proposition 1 is only an exact chain\-rule decomposition\. A separate heuristic interpretation is that, under a clipped schedule and moderate step sizes, each DDIM transition is close to identity, so recent reverse steps may dominate the gradient more than distant ones\. We do not promote that heuristic to a theorem here; we mention it only because it is consistent with the empirical finding in Section[D\.5](https://arxiv.org/html/2610.31721#A4.SS5)that moderate values ofTTalready perform well\.
### H\.2Convergence of the Weighted\-Sum Optimization
We now state a standard smooth\-nonconvex gradient\-descent bound for a single fixed scalarization inside one smooth region of the objective\.
Proposition 2 \(Gradient\-Descent Bound Within a Fixed Smooth Region\)\.Letℒ\(c\)=∑k=1Kλkℒk\(Gθ\(c,xT\)\)\\mathcal\{L\}\(c\)=\\sum\_\{k=1\}^\{K\}\\lambda\_\{k\}\\mathcal\{L\}\_\{k\}\\bigl\(G\_\{\\theta\}\(c,x\_\{T\}\)\\bigr\)be the scalarized objective \(Eq\.[13](https://arxiv.org/html/2610.31721#S3.E13)\) with fixed weights𝛌\>0\\boldsymbol\{\\lambda\}\>0and fixed latentxTx\_\{T\}\. Let𝒰⊆ℝdc\\mathcal\{U\}\\subseteq\\mathbb\{R\}^\{d\_\{c\}\}be an open region on whichℒ\\mathcal\{L\}isβ\\beta\-smooth and bounded below byℒ∗\\mathcal\{L\}^\{\*\}\. If gradient descent with step sizeη≤1/β\\eta\\leq 1/\\betais initialized in𝒰\\mathcal\{U\}and all iterates remain in𝒰\\mathcal\{U\}, then:
minj=0,…,J−1‖∇cℒ\(c\(j\)\)‖2≤2\(ℒ\(c\(0\)\)−ℒ∗\)ηJ\.\\min\_\{j=0,\\ldots,J\-1\}\\\|\\nabla\_\{c\}\\mathcal\{L\}\(c^\{\(j\)\}\)\\\|^\{2\}\\;\\leq\\;\\frac\{2\\bigl\(\\mathcal\{L\}\(c^\{\(0\)\}\)\-\\mathcal\{L\}^\{\*\}\\bigr\)\}\{\\eta J\}\.\(33\)This is the standard𝒪\(1/J\)\\mathcal\{O\}\(1/J\)first\-order bound for gradient descent on the restricted smooth\-region objective\.
Proof\.This follows from the standard descent lemma for smooth nonconvex optimization\[[25](https://arxiv.org/html/2610.31721#bib.bib27)\]\. Byβ\\beta\-smoothness:ℒ\(c\(j\+1\)\)≤ℒ\(c\(j\)\)−η\(1−ηβ/2\)‖∇cℒ\(c\(j\)\)‖2\\mathcal\{L\}\(c^\{\(j\+1\)\}\)\\leq\\mathcal\{L\}\(c^\{\(j\)\}\)\-\\eta\(1\-\\eta\\beta/2\)\\\|\\nabla\_\{c\}\\mathcal\{L\}\(c^\{\(j\)\}\)\\\|^\{2\}\. Forη≤1/β\\eta\\leq 1/\\beta, each step provides descent of at least\(η/2\)‖∇cℒ‖2\(\\eta/2\)\\\|\\nabla\_\{c\}\\mathcal\{L\}\\\|^\{2\}\. Telescoping overJJsteps yields the bound\.□\\square
Remark\.Proposition 2 is intentionally conditional and local\. It applies only to a single trajectory with fixedxTx\_\{T\}, fixed weight vector𝝀\\boldsymbol\{\\lambda\}, plain gradient descent, and iterates that remain inside one pre\-specified smooth region𝒰\\mathcal\{U\}\. In the actual implementation, Adam replaces vanilla gradient descent, the optimizable conditioning coordinates are clipped to\[0,1\]\[0,1\]after each step, the loss is only piecewise smooth because of hinge/max/min operators, and different trajectories use independently sampled Dirichlet weights\. The proposition therefore should not be read as a global convergence guarantee for the full D2C objective\.
Within that idealized smooth\-region setting, a stationary point satisfies
∑k=1Kλk∇cℒk=0\.\\sum\_\{k=1\}^\{K\}\\lambda\_\{k\}\\nabla\_\{c\}\\mathcal\{L\}\_\{k\}=0\.\(34\)This is the first\-order stationarity condition for the scalarized objective associated with that particular weighting𝝀\\boldsymbol\{\\lambda\}\. Sampling multiple weight vectors𝝀\\boldsymbol\{\\lambda\}therefore provides a practical way to generate a diverse set of scalarized trade\-offs, but it does not by itself establish broad Pareto\-front coverage or any global Pareto\-optimality guarantee\.
Lemma 1 \(Smooth One\-Sided Penalties Are Differentiable Almost Everywhere\)\.Letg:ℝd→ℝg:\\mathbb\{R\}^\{d\}\\to\\mathbb\{R\}be continuously differentiable, and assumeGθ\(c,xT\)G\_\{\\theta\}\(c,x\_\{T\}\)is continuously differentiable incc\. Defineℒfid\(c\)=\[g\(Gθ\(c,xT\)\)−g\(xref\)\]\+\\mathcal\{L\}\_\{\\mathrm\{fid\}\}\(c\)=\[g\(G\_\{\\theta\}\(c,x\_\{T\}\)\)\-g\(x\_\{\\mathrm\{ref\}\}\)\]\_\{\+\}and the boundary set∂ℱ=\{c:g\(Gθ\(c,xT\)\)=g\(xref\)\}\\partial\\mathcal\{F\}=\\\{c:g\(G\_\{\\theta\}\(c,x\_\{T\}\)\)=g\(x\_\{\\mathrm\{ref\}\}\)\\\}\. Thenℒfid\\mathcal\{L\}\_\{\\mathrm\{fid\}\}is differentiable onℝdc∖∂ℱ\\mathbb\{R\}^\{d\_\{c\}\}\\setminus\\partial\\mathcal\{F\}, with:
∇cℒfid\(c\)=\{\(∂x0∂c\)T∇x0gifg\(x0\)\>g\(xref\),0ifg\(x0\)<g\(xref\)\.\\nabla\_\{c\}\\mathcal\{L\}\_\{\\mathrm\{fid\}\}\(c\)=\\begin\{cases\}\\left\(\\dfrac\{\\partial x\_\{0\}\}\{\\partial c\}\\right\)^\{\\\!T\}\\nabla\_\{x\_\{0\}\}g&\\text\{if \}g\(x\_\{0\}\)\>g\(x\_\{\\mathrm\{ref\}\}\),\\\\\[6\.0pt\] 0&\\text\{if \}g\(x\_\{0\}\)<g\(x\_\{\\mathrm\{ref\}\}\)\.\\end\{cases\}\(35\)Moreover, ifg∘Gθg\\circ G\_\{\\theta\}is a submersion at every boundary point \(i\.e\.,∇c\(g∘Gθ\)\(c\)≠0\\nabla\_\{c\}\(g\\circ G\_\{\\theta\}\)\(c\)\\neq 0for allc∈∂ℱc\\in\\partial\\mathcal\{F\}\), then∂ℱ\\partial\\mathcal\{F\}is locally a\(dc−1\)\(d\_\{c\}\{\-\}1\)\-dimensional manifold and in particular has Lebesgue measure zero\. Consequently,ℒfid\\mathcal\{L\}\_\{\\mathrm\{fid\}\}is differentiable almost everywhere\.
Proof\.The functionh\(c\)=g\(Gθ\(c,xT\)\)−g\(xref\)h\(c\)=g\(G\_\{\\theta\}\(c,x\_\{T\}\)\)\-g\(x\_\{\\mathrm\{ref\}\}\)is continuously differentiable sinceggandGθG\_\{\\theta\}are\. Since\[r\]\+=r⋅𝟏r\>0\[r\]\_\{\+\}=r\\cdot\\mathbf\{1\}\_\{r\>0\}is differentiable forr≠0r\\neq 0, the compositionℒfid=\[h\(c\)\]\+\\mathcal\{L\}\_\{\\mathrm\{fid\}\}=\[h\(c\)\]\_\{\+\}is differentiable whereverh\(c\)≠0h\(c\)\\neq 0, i\.e\., onℝdc∖∂ℱ\\mathbb\{R\}^\{d\_\{c\}\}\\setminus\\partial\\mathcal\{F\}\.
In the violated regime \(h\(c\)\>0h\(c\)\>0\):∇cℒfid=∇ch=\(∂x0∂c\)T∇x0g\\nabla\_\{c\}\\mathcal\{L\}\_\{\\mathrm\{fid\}\}=\\nabla\_\{c\}h=\\left\(\\frac\{\\partial x\_\{0\}\}\{\\partial c\}\\right\)^\{\\\!T\}\\nabla\_\{x\_\{0\}\}g\. If additionally∇ch\(c\)≠0\\nabla\_\{c\}h\(c\)\\neq 0, then the negative gradient is a nonzero local descent direction for the penalty\.
In the feasible interior \(h\(c\)<0h\(c\)<0\):ℒfid=0\\mathcal\{L\}\_\{\\mathrm\{fid\}\}=0identically, so∇cℒfid=0\\nabla\_\{c\}\\mathcal\{L\}\_\{\\mathrm\{fid\}\}=0and the penalty is inactive\.
For the measure\-zero claim: the preimage theorem states that if∇ch\(c\)≠0\\nabla\_\{c\}h\(c\)\\neq 0on the level seth−1\(0\)h^\{\-1\}\(0\), then∂ℱ=h−1\(0\)\\partial\\mathcal\{F\}=h^\{\-1\}\(0\)is a smooth\(dc−1\)\(d\_\{c\}\{\-\}1\)\-dimensional submanifold and hence hasdcd\_\{c\}\-dimensional Lebesgue measure zero\. This establishes almost\-everywhere differentiability ofℒfid\\mathcal\{L\}\_\{\\mathrm\{fid\}\}, but it does not imply that optimization trajectories cannot reach∂ℱ\\partial\\mathcal\{F\}; if an iterate lands on the hinge boundary in practice, first\-order optimization is interpreted through the corresponding subgradient\.□\\square
Remark\.Lemma 1 applies only to the smooth one\-sided penalties obtained from continuously differentiable constraint functionalsgg\. Some instantiated fidelity terms in Appendix[E](https://arxiv.org/html/2610.31721#A5)additionally use coordinatewisemax/min\\max/\\minoperators to enforce amplitude bounds; those terms are Lipschitz but notC1C^\{1\}, so the manifold and almost\-everywhere differentiability claims above should not be read as applying to those non\-smooth pieces\. In practice, such terms are handled through the corresponding subgradients supplied by automatic differentiation\.
### H\.3Limits of the Frozen Surrogate Objective
The preceding results establish differentiability and local first\-order properties of the conditioning optimization, but they do not imply that optimizing the frozen surrogate is equivalent to optimizing the true objective\. The relevant question is instead whether the surrogate remains accurate on the region of design space reached through conditioning optimization\.
Proposition 3 \(Pairwise Ordering Reliability Under Uniform Surrogate Error\)\.Fix a latent noise drawxTx\_\{T\}and writex\(c\)=Gθ\(c,xT\)x\(c\)=G\_\{\\theta\}\(c,x\_\{T\}\)\. Letf^\(x\)=Sϕ\(x,cfix\)\\hat\{f\}\(x\)=S\_\{\\phi\}\(x,c\_\{\\mathrm\{fix\}\}\)denote the surrogate objective and letf\(x\)f\(x\)denote the corresponding true objective\. Letℛ⊆\{x\(c\):c∈ℝdc\}\\mathcal\{R\}\\subseteq\\\{x\(c\):c\\in\\mathbb\{R\}^\{d\_\{c\}\}\\\}be any set that contains the optimization trajectory under consideration\. Suppose that
supx∈ℛ\|f^\(x\)−f\(x\)\|≤ε\.\\sup\_\{x\\in\\mathcal\{R\}\}\|\\hat\{f\}\(x\)\-f\(x\)\|\\leq\\varepsilon\.\(36\)Then for anyx1,x2∈ℛx\_\{1\},x\_\{2\}\\in\\mathcal\{R\},
\|\(f^\(x1\)−f^\(x2\)\)−\(f\(x1\)−f\(x2\)\)\|≤2ε\.\\big\|\\big\(\\hat\{f\}\(x\_\{1\}\)\-\\hat\{f\}\(x\_\{2\}\)\\big\)\-\\big\(f\(x\_\{1\}\)\-f\(x\_\{2\}\)\\big\)\\big\|\\leq 2\\varepsilon\.\(37\)In particular, iff^\(x1\)≥f^\(x2\)\+2ε\\hat\{f\}\(x\_\{1\}\)\\geq\\hat\{f\}\(x\_\{2\}\)\+2\\varepsilon, thenf\(x1\)≥f\(x2\)f\(x\_\{1\}\)\\geq f\(x\_\{2\}\)\.
Proof\.By direct expansion,
\(f^\(x1\)−f^\(x2\)\)−\(f\(x1\)−f\(x2\)\)=\(f^\(x1\)−f\(x1\)\)−\(f^\(x2\)−f\(x2\)\)\.\\big\(\\hat\{f\}\(x\_\{1\}\)\-\\hat\{f\}\(x\_\{2\}\)\\big\)\-\\big\(f\(x\_\{1\}\)\-f\(x\_\{2\}\)\\big\)=\\big\(\\hat\{f\}\(x\_\{1\}\)\-f\(x\_\{1\}\)\\big\)\-\\big\(\\hat\{f\}\(x\_\{2\}\)\-f\(x\_\{2\}\)\\big\)\.\(38\)Applying the triangle inequality and the uniform error bound gives
\|\(f^\(x1\)−f^\(x2\)\)−\(f\(x1\)−f\(x2\)\)\|≤\|f^\(x1\)−f\(x1\)\|\+\|f^\(x2\)−f\(x2\)\|≤2ε\.\\big\|\\big\(\\hat\{f\}\(x\_\{1\}\)\-\\hat\{f\}\(x\_\{2\}\)\\big\)\-\\big\(f\(x\_\{1\}\)\-f\(x\_\{2\}\)\\big\)\\big\|\\leq\|\\hat\{f\}\(x\_\{1\}\)\-f\(x\_\{1\}\)\|\+\|\\hat\{f\}\(x\_\{2\}\)\-f\(x\_\{2\}\)\|\\leq 2\\varepsilon\.\(39\)The ordering statement follows immediately\.□\\square
Remark\.This proposition is intentionally conditional\. Freezingθ\\thetaandϕ\\phidoes not, by itself, rule out input\-space exploitation: optimizingcccan still movex\(c\)x\(c\)into parts of the generator image where the surrogate is inaccurate\. What freezing changes is the search space, not the existence of blind spots\. D2C instead relies on a weaker and more defensible claim: the frozen diffusion prior, physics\-informed penalties, and validity\-first filtering can reduce exploitation in practice by biasing search toward designs that remain closer to the empirical data distribution and satisfy explicit feasibility checks\. These mechanisms are practical safeguards, not a general theoretical guarantee against surrogate exploitation\.
## Appendix IPractical Guidance for Design Optimization with D2C
D2C is designed for settings where \(i\) evaluations of the true objective are expensive \(physical simulations, wet\-lab experiments, or large\-scale facility tests\), \(ii\) hard physical constraints must be satisfied for safety or feasibility, and \(iii\) offline datasets of moderate size are available\. Below we summarize the settings where the method is most compelling, together with regimes where simpler alternatives may sometimes be sufficient\.
##### Settings Well Suited to D2C\.
- •High\-cost physical systems with expensive evaluations\.D2C is most valuable when each ground\-truth evaluation costs hours of compute \(e\.g\., radiation\-hydrodynamics simulations\) or involves irreversible physical consequences \(e\.g\., laser shots on a fusion facility, equipment management in data centers\)\. The offline training investment is amortized over many test\-time optimizations\.
- •Multi\-objective problems with hard constraints\.The framework naturally accommodates competing objectives and strict feasibility requirements through the composite loss and validity\-first selection\. If your application has safety\-critical constraints that cannot be violated, D2C provides explicit mechanisms to enforce them\.
- •High\-dimensional or strongly structured designs\.The diffusion proposer excels at generating designs with complex internal structure \(temporal profiles, spatial fields\) that naive gradient ascent in design space often cannot capture robustly\. If the design space has strong correlations or manifold structure, the learned prior is especially beneficial\.
- •Settings where a reliable surrogate exists\.The method requires a differentiable surrogateSϕS\_\{\\phi\}that is accurate in the region of interest\. If surrogate error is low \(<5%<5\\%relative error\), the gradient signal is informative\.
##### Settings Where Simpler Alternatives May Suffice\.
- •Low\-dimensional problems with weak structure or cheap evaluation\.If the design space is very small, the constraints are mild, and evaluations are cheap enough to support direct search or standard Bayesian optimization, then methods such as GP\-qEI, CMA\-ES, or even brute\-force search may be simpler to deploy and sufficiently effective\. This is not a blanket limitation of D2C: even in lower\-dimensional settings, the method can still be worthwhile when evaluations are expensive, feasibility is safety\-critical, or data\-distribution\-aware generation and validity\-first selection materially improve robustness\.
- •Cheap online evaluations available\.If the true objective can be queried cheaply and repeatedly, online methods \(reinforcement learning, active learning\) are often preferable because they can adapt directly to fresh evaluations\. D2C is designed for settings with no online evaluation access at test time\.
- •Severely miscalibrated surrogates\.If the surrogate is unreliable in the optimization region, gradient\-based methods can exploit those inaccuracies\. The diffusion prior and validity checks mitigate this to some extent by constraining designs toward the empirical data distribution, but a fundamentally miscalibrated surrogate can still misdirect optimization\.
- •Latency\-critical applications\.D2C requires backpropagation through aTT\-step DDIM chain at each ofJJoptimization iterations\. On current hardware, this takes 30–60 seconds per test sample\. If sub\-second inference is required, single\-pass methods \(MINs, DDOM\) may be a better fit despite their weaker optimization and constraint\-handling performance\.
##### Practical considerations\.
- •Surrogate investment\.We recommend training the surrogate to convergence with proper validation, achieving<2%<2\\%error before proceeding to diffusion model training\.
- •Guidance scale sensitivity\.The guidance scalewwis domain\-dependent and must be tuned\. Domains with tight physical constraints \(e\.g\., ICF\) are highly sensitive tow\>2w\>2; smoother landscapes \(e\.g\., DC\) are more tolerant\. Start withw=2w=2and sweep\{1,2,3,5\}\\\{1,2,3,5\\\}\. The sweep does not require oracle access: rankingwwby the surrogate\-predicted gain of candidates that pass the geometric validity checks recovers the oracle\-selected value \(Section[D\.2](https://arxiv.org/html/2610.31721#A4.SS2)\)\.
- •Noise trials vs\. optimization steps\.When compute budget is fixed, we find it more effective to increase noise trialsNzN\_\{z\}\(broader coverage\) than optimization stepsJJ\(deeper optimization per trial\)\. Diminishing returns onJJset in after 50–100 steps for most problems\.
- •Constraint design\.Hard constraints should be expressed as differentiable penalty terms in the loss wherever possible\. Non\-differentiable constraints \(e\.g\., discrete feasibility checks\) should be handled via the post\-hoc validity filter rather than incorporated into the gradient\-based loop\.
## Appendix JBroader Impact
As a general offline design\-optimization method, D2C could have positive impact in domains where evaluations are expensive and constrained operation matters, such as reducing carbon\-footprint in data centers or accelerating scientific design loops while lowering simulation cost\. More broadly, methods that keep optimization closer to the empirical data distribution captured by a learned prior while exposing explicit validity checks help reduce unrealistic proposals relative to unconstrained surrogate optimization\.
Potential negative impacts are also application\-specific\. The same optimization machinery could be used in domains where accelerating design search is undesirable or access should be restricted\.
## NeurIPS Paper Checklist
1. 1\.Claims
2. Question: Do the main claims made in the abstract and introduction accurately reflect the paper’s contributions and scope?
3. Answer:\[Yes\]
4. Justification: See the abstract, Section 1, and Sections 4–5; the claims are scoped to offline physics\-informed optimization and the reported experiments\.
5. Guidelines: - •The answer\[N/A\]means that the abstract and introduction do not include the claims made in the paper\. - •The abstract and/or introduction should clearly state the claims made, including the contributions made in the paper and important assumptions and limitations\. A\[No\]or\[N/A\]answer to this question will not be perceived well by the reviewers\. - •The claims made should match theoretical and experimental results, and reflect how much the results can be expected to generalize to other settings\. - •It is fine to include aspirational goals as motivation as long as it is clear that these goals are not attained by the paper\.
6. 2\.Limitations
7. Question: Does the paper discuss the limitations of the work performed by the authors?
8. Answer:\[Yes\]
9. Justification: Section 5 discusses computational cost, surrogate dependence, validity\-first selection, and domain\-specific tuning\.
10. Guidelines: - •The answer\[N/A\]means that the paper has no limitation while the answer\[No\]means that the paper has limitations, but those are not discussed in the paper\. - •The authors are encouraged to create a separate “Limitations” section in their paper\. - •The paper should point out any strong assumptions and how robust the results are to violations of these assumptions \(e\.g\., independence assumptions, noiseless settings, model well\-specification, asymptotic approximations only holding locally\)\. The authors should reflect on how these assumptions might be violated in practice and what the implications would be\. - •The authors should reflect on the scope of the claims made, e\.g\., if the approach was only tested on a few datasets or with a few runs\. In general, empirical results often depend on implicit assumptions, which should be articulated\. - •The authors should reflect on the factors that influence the performance of the approach\. For example, a facial recognition algorithm may perform poorly when image resolution is low or images are taken in low lighting\. Or a speech\-to\-text system might not be used reliably to provide closed captions for online lectures because it fails to handle technical jargon\. - •The authors should discuss the computational efficiency of the proposed algorithms and how they scale with dataset size\. - •If applicable, the authors should discuss possible limitations of their approach to address problems of privacy and fairness\. - •While the authors might fear that complete honesty about limitations might be used by reviewers as grounds for rejection, a worse outcome might be that reviewers discover limitations that aren’t acknowledged in the paper\. The authors should use their best judgment and recognize that individual actions in favor of transparency play an important role in developing norms that preserve the integrity of the community\. Reviewers will be specifically instructed to not penalize honesty concerning limitations\.
11. 3\.Theory assumptions and proofs
12. Question: For each theoretical result, does the paper provide the full set of assumptions and a complete \(and correct\) proof?
13. Answer:\[N/A\]
14. Justification: The paper does not include theoretical results\.
15. Guidelines: - •The answer\[N/A\]means that the paper does not include theoretical results\. - •All the theorems, formulas, and proofs in the paper should be numbered and cross\-referenced\. - •All assumptions should be clearly stated or referenced in the statement of any theorems\. - •The proofs can either appear in the main paper or the supplemental material, but if they appear in the supplemental material, the authors are encouraged to provide a short proof sketch to provide intuition\. - •Inversely, any informal proof provided in the core of the paper should be complemented by formal proofs provided in appendix or supplemental material\. - •Theorems and Lemmas that the proof relies upon should be properly referenced\.
16. 4\.Experimental result reproducibility
17. Question: Does the paper fully disclose all the information needed to reproduce the main experimental results of the paper to the extent that it affects the main claims and/or conclusions of the paper \(regardless of whether the code and data are provided or not\)?
18. Answer:\[Yes\]
19. Justification: Sections 4–6 and the appendix specify datasets, splits, losses, hyperparameters, baselines, evaluation, and ablation settings\.
20. Guidelines: - •The answer\[N/A\]means that the paper does not include experiments\. - •If the paper includes experiments, a\[No\]answer to this question will not be perceived well by the reviewers: Making the paper reproducible is important, regardless of whether the code and data are provided or not\. - •If the contribution is a dataset and/or model, the authors should describe the steps taken to make their results reproducible or verifiable\. - •Depending on the contribution, reproducibility can be accomplished in various ways\. For example, if the contribution is a novel architecture, describing the architecture fully might suffice, or if the contribution is a specific model and empirical evaluation, it may be necessary to either make it possible for others to replicate the model with the same dataset, or provide access to the model\. In general\. releasing code and data is often one good way to accomplish this, but reproducibility can also be provided via detailed instructions for how to replicate the results, access to a hosted model \(e\.g\., in the case of a large language model\), releasing of a model checkpoint, or other means that are appropriate to the research performed\. - •While NeurIPS does not require releasing code, the conference does require all submissions to provide some reasonable avenue for reproducibility, which may depend on the nature of the contribution\. For example 1. \(a\)If the contribution is primarily a new algorithm, the paper should make it clear how to reproduce that algorithm\. 2. \(b\)If the contribution is primarily a new model architecture, the paper should describe the architecture clearly and fully\. 3. \(c\)If the contribution is a new model \(e\.g\., a large language model\), then there should either be a way to access this model for reproducing the results or a way to reproduce the model \(e\.g\., with an open\-source dataset or instructions for how to construct the dataset\)\. 4. \(d\)We recognize that reproducibility may be tricky in some cases, in which case authors are welcome to describe the particular way they provide for reproducibility\. In the case of closed\-source models, it may be that access to the model is limited in some way \(e\.g\., to registered users\), but it should be possible for other researchers to have some path to reproducing or verifying the results\.
21. 5\.Open access to data and code
22. Question: Does the paper provide open access to the data and code, with sufficient instructions to faithfully reproduce the main experimental results, as described in supplemental material?
23. Answer:\[Yes\]
24. Justification: We provide the code used for DC and design\-bench attached in the supplementary material\. The ICF data and its artifacts are export controlled and cannot be publicly shared \(Appendix, ICF data generation\)\.
25. Guidelines: - •The answer\[N/A\]means that paper does not include experiments requiring code\. - • - •While we encourage the release of code and data, we understand that this might not be possible, so\[No\]is an acceptable answer\. Papers cannot be rejected simply for not including code, unless this is central to the contribution \(e\.g\., for a new open\-source benchmark\)\. - •The instructions should contain the exact command and environment needed to run to reproduce the results\. See the NeurIPS code and data submission guidelines \([https://neurips\.cc/public/guides/CodeSubmissionPolicy](https://neurips.cc/public/guides/CodeSubmissionPolicy)\) for more details\. - •The authors should provide instructions on data access and preparation, including how to access the raw data, preprocessed data, intermediate data, and generated data, etc\. - •The authors should provide scripts to reproduce all experimental results for the new proposed method and baselines\. If only a subset of experiments are reproducible, they should state which ones are omitted from the script and why\. - •At submission time, to preserve anonymity, the authors should release anonymized versions \(if applicable\)\. - •Providing as much information as possible in supplemental material \(appended to the paper\) is recommended, but including URLs to data and code is permitted\.
26. 6\.Experimental setting/details
27. Question: Does the paper specify all the training and test details \(e\.g\., data splits, hyperparameters, how they were chosen, type of optimizer\) necessary to understand the results?
28. Answer:\[Yes\]
29. Justification: Section 4 and Appendix A report the splits, architectures, optimizers, hyperparameters, and model\-selection procedures\.
30. Guidelines: - •The answer\[N/A\]means that the paper does not include experiments\. - •The experimental setting should be presented in the core of the paper to a level of detail that is necessary to appreciate the results and make sense of them\. - •The full details can be provided either with the code, in appendix, or as supplemental material\.
31. 7\.Experiment statistical significance
32. Question: Does the paper report error bars suitably and correctly defined or other appropriate information about the statistical significance of the experiments?
33. Answer:\[Yes\]
34. Justification: The main results and ablations report mean±\\pmstandard deviation over 5 runs; see Section 4\.3 and the table captions\.
35. Guidelines: - •The answer\[N/A\]means that the paper does not include experiments\. - •The authors should answer\[Yes\]if the results are accompanied by error bars, confidence intervals, or statistical significance tests, at least for the experiments that support the main claims of the paper\. - •The factors of variability that the error bars are capturing should be clearly stated \(for example, train/test split, initialization, random drawing of some parameter, or overall run with given experimental conditions\)\. - •The method for calculating the error bars should be explained \(closed form formula, call to a library function, bootstrap, etc\.\) - •The assumptions made should be given \(e\.g\., Normally distributed errors\)\. - •It should be clear whether the error bar is the standard deviation or the standard error of the mean\. - •It is OK to report 1\-sigma error bars, but one should state it\. The authors should preferably report a 2\-sigma error bar than state that they have a 96% CI, if the hypothesis of Normality of errors is not verified\. - •For asymmetric distributions, the authors should be careful not to show in tables or figures symmetric error bars that would yield results that are out of range \(e\.g\., negative error rates\)\. - •If error bars are reported in tables or plots, the authors should explain in the text how they were calculated and reference the corresponding figures or tables in the text\.
36. 8\.Experiments compute resources
37. Question: For each experiment, does the paper provide sufficient information on the computer resources \(type of compute workers, memory, time of execution\) needed to reproduce the experiments?
38. Answer:\[Yes\]
39. Justification: Appendix A reports the hardware \(four NVIDIA H100 GPUs\) and approximate training/optimization costs\.
40. Guidelines: - •The answer\[N/A\]means that the paper does not include experiments\. - •The paper should indicate the type of compute workers CPU or GPU, internal cluster, or cloud provider, including relevant memory and storage\. - •The paper should provide the amount of compute required for each of the individual experimental runs as well as estimate the total compute\. - •The paper should disclose whether the full research project required more compute than the experiments reported in the paper \(e\.g\., preliminary or failed experiments that didn’t make it into the paper\)\.
41. 9\.Code of ethics
43. Answer:\[Yes\]
44. Justification: To the best of our knowledge, yes; the work uses offline data/simulations, involves no human subjects, and discloses relevant release limitations\.
45. Guidelines: - •The answer\[N/A\]means that the authors have not reviewed the NeurIPS Code of Ethics\. - •If the authors answer\[No\], they should explain the special circumstances that require a deviation from the Code of Ethics\. - •The authors should make sure to preserve anonymity \(e\.g\., if there is a special consideration due to laws or regulations in their jurisdiction\)\.
46. 10\.Broader impacts
47. Question: Does the paper discuss both potential positive societal impacts and negative societal impacts of the work performed?
48. Answer:\[Yes\]
49. Justification: The appendix now includes a short broader\-impact discussion covering potential benefits, misuse risks, and deployment risks of the method\.
50. Guidelines: - •The answer\[N/A\]means that there is no societal impact of the work performed\. - •If the authors answer\[N/A\]or\[No\], they should explain why their work has no societal impact or why the paper does not address societal impact\. - •Examples of negative societal impacts include potential malicious or unintended uses \(e\.g\., disinformation, generating fake profiles, surveillance\), fairness considerations \(e\.g\., deployment of technologies that could make decisions that unfairly impact specific groups\), privacy considerations, and security considerations\. - •The conference expects that many papers will be foundational research and not tied to particular applications, let alone deployments\. However, if there is a direct path to any negative applications, the authors should point it out\. For example, it is legitimate to point out that an improvement in the quality of generative models could be used to generate Deepfakes for disinformation\. On the other hand, it is not needed to point out that a generic algorithm for optimizing neural networks could enable people to train models that generate Deepfakes faster\. - •The authors should consider possible harms that could arise when the technology is being used as intended and functioning correctly, harms that could arise when the technology is being used as intended but gives incorrect results, and harms following from \(intentional or unintentional\) misuse of the technology\. - •If there are negative societal impacts, the authors could also discuss possible mitigation strategies \(e\.g\., gated release of models, providing defenses in addition to attacks, mechanisms for monitoring misuse, mechanisms to monitor how a system learns from feedback over time, improving the efficiency and accessibility of ML\)\.
51. 11\.Safeguards
52. Question: Does the paper describe safeguards that have been put in place for responsible release of data or models that have a high risk for misuse \(e\.g\., pre\-trained language models, image generators, or scraped datasets\)?
53. Answer:\[N/A\]
54. Justification: The submission does not release a high\-risk model or scraped dataset\.
55. Guidelines: - •The answer\[N/A\]means that the paper poses no such risks\. - •Released models that have a high risk for misuse or dual\-use should be released with necessary safeguards to allow for controlled use of the model, for example by requiring that users adhere to usage guidelines or restrictions to access the model or implementing safety filters\. - •Datasets that have been scraped from the Internet could pose safety risks\. The authors should describe how they avoided releasing unsafe images\. - •We recognize that providing effective safeguards is challenging, and many papers do not require this, but we encourage authors to take this into account and make a best faith effort\.
56. 12\.Licenses for existing assets
57. Question: Are the creators or original owners of assets \(e\.g\., code, data, models\), used in the paper, properly credited and are the license and terms of use explicitly mentioned and properly respected?
58. Answer:\[Yes\]
59. Justification: The paper credits the public code assets used and explicitly states the Design\-Bench and SustainDC repository licenses in the appendix data section\.
60. Guidelines: - •The answer\[N/A\]means that the paper does not use existing assets\. - •The authors should cite the original paper that produced the code package or dataset\. - •The authors should state which version of the asset is used and, if possible, include a URL\. - •The name of the license \(e\.g\., CC\-BY 4\.0\) should be included for each asset\. - •For scraped data from a particular source \(e\.g\., website\), the copyright and terms of service of that source should be provided\. - •If assets are released, the license, copyright information, and terms of use in the package should be provided\. For popular datasets,[paperswithcode\.com/datasets](https://paperswithcode.com/datasets)has curated licenses for some datasets\. Their licensing guide can help determine the license of a dataset\. - •For existing datasets that are re\-packaged, both the original license and the license of the derived asset \(if it has changed\) should be provided\. - •If this information is not available online, the authors are encouraged to reach out to the asset’s creators\.
61. 13\.New assets
62. Question: Are new assets introduced in the paper well documented and is the documentation provided alongside the assets?
63. Answer:\[N/A\]
64. Justification: The paper does not introduce a new publicly released dataset, model, or code asset\.
65. Guidelines: - •The answer\[N/A\]means that the paper does not release new assets\. - •Researchers should communicate the details of the dataset/code/model as part of their submissions via structured templates\. This includes details about training, license, limitations, etc\. - •The paper should discuss whether and how consent was obtained from people whose asset is used\. - •At submission time, remember to anonymize your assets \(if applicable\)\. You can either create an anonymized URL or include an anonymized zip file\.
66. 14\.Crowdsourcing and research with human subjects
67. Question: For crowdsourcing experiments and research with human subjects, does the paper include the full text of instructions given to participants and screenshots, if applicable, as well as details about compensation \(if any\)?
68. Answer:\[N/A\]
69. Justification: The paper does not involve crowdsourcing or research with human subjects\.
70. Guidelines: - •The answer\[N/A\]means that the paper does not involve crowdsourcing nor research with human subjects\. - •Including this information in the supplemental material is fine, but if the main contribution of the paper involves human subjects, then as much detail as possible should be included in the main paper\. - •According to the NeurIPS Code of Ethics, workers involved in data collection, curation, or other labor should be paid at least the minimum wage in the country of the data collector\.
71. 15\.Institutional review board \(IRB\) approvals or equivalent for research with human subjects
72. Question: Does the paper describe potential risks incurred by study participants, whether such risks were disclosed to the subjects, and whether Institutional Review Board \(IRB\) approvals \(or an equivalent approval/review based on the requirements of your country or institution\) were obtained?
73. Answer:\[N/A\]
74. Justification: The paper does not involve crowdsourcing or research with human subjects\.
75. Guidelines: - •The answer\[N/A\]means that the paper does not involve crowdsourcing nor research with human subjects\. - •Depending on the country in which research is conducted, IRB approval \(or equivalent\) may be required for any human subjects research\. If you obtained IRB approval, you should clearly state this in the paper\. - •We recognize that the procedures for this may vary significantly between institutions and locations, and we expect authors to adhere to the NeurIPS Code of Ethics and the guidelines for their institution\. - •For initial submissions, do not include any information that would break anonymity \(if applicable\), such as the institution conducting the review\.
76. 16\.Declaration of LLM usage
77. Question: Does the paper describe the usage of LLMs if it is an important, original, or non\-standard component of the core methods in this research? Note that if the LLM is used only for writing, editing, or formatting purposes and does*not*impact the core methodology, scientific rigor, or originality of the research, declaration is not required\.
78. Answer:\[N/A\]
79. Justification: The paper does not involve the use of LLMs as an important, original, or non\-standard component of the core methods in this research\.
80. Guidelines: - •The answer\[N/A\]means that the core method development in this research does not involve LLMs as any important, original, or non\-standard components\. - •Please refer to our LLM policy in the NeurIPS handbook for what should or should not be described\.相似文章
简化并改进用于少步扩散的同策略蒸馏
提出简化匹配蒸馏(SMD)框架,通过纯回归的同策略速度回归与Pivot残差代理,实现无需辅助评分模型或对抗训练的4步少步扩散生成,在图像、3D、视频及音视频联合生成任务上超越强基线,并可扩展至330亿参数。
DiffusionART:高效、稳定且可扩展的扩散模型强化方法
本文提出DiffusionART,一种通过聚合奖励方向进行扩散模型强化学习微调的新方法,消除了一致性力并用信任区域掩码实现免EMA调参的稳定训练,在HunyuanVideo-13B上以约12倍更少的GPU小时数取得显著更高的训练奖励。
线性约束下的条件扩散:Langevin 混合与信息论保证
本文分析了预训练扩散模型在线性逆问题上的零样本条件采样,提供了信息论保证并提出了一种投影 Langevin 初始化方法。
DiffusionART:高效、稳定且可扩展的扩散模型强化学习
DiffusionART 提出一种聚合优先奖励倾斜(Aggregation-First Reward Tilting)的在线强化学习微调方法,通过消除前向-后向一致性力和引入信任域掩码更新,在无需 EMA 调参的情况下稳定高效地微调扩散模型,在 HunyuanVideo-13B 上以约 12 倍更少 GPU 时达到并超越 DiffusionNFT 与 Flow-GRPO-Fast 的效果。
通过 On-Policy 上下文蒸馏将智能体经验内化到扩散模型权重中
该论文提出 D-OPCD(Diffusion On-Policy Context Distillation),将 T2I 智能体 harness 通过提示词积累的经验蒸馏进扩散模型权重中,使模型在仅用原始查询条件时也能保留部分 harness 增益,并结合 Auto Skill Evolver 实现 harness 与模型的持续共同进化。