Self-Augmented Diffusion Guidance for Physics-Informed Generation

arXiv cs.LG Papers

Summary

The paper proposes a self-augmented diffusion guidance method to incorporate physical laws into diffusion models, reducing deviations from true dynamics and enabling faster generation.

arXiv:2608.26748v1 Announce Type: new Abstract: Diffusion models can be used to generate spatiotemporal signals of physical phenomena, such as time-series images of fluid dynamics. However, a major limitation of standard diffusion models is that they do not incorporate constraints derived from the underlying physical laws. Consequently, generated samples may appear visually plausible while deviating substantially from the true dynamics. In this study, we propose a simple yet effective physics-informed approach based on diffusion guidance with self-generated data augmentation. The proposed method learns the data distribution conditioned on the degree of deviation from the physically correct dynamics and generates samples by explicitly setting the deviation condition to be zero. The method decouples the evaluation of the governing equations from the diffusion model training and sampling processes, avoiding the need to solve the governing equations at every iteration of the denoising process. This design makes the method applicable to problems requiring computationally expensive numerical simulations and enables faster sample generation. Experimental results demonstrate that the proposed model not only significantly reduces the deviations compared with standard diffusion models but also achieves further reductions when combined with existing physics-constrained diffusion methods.
Original Article
View Cached Full Text

Cached at: 08/28/26, 09:43 AM

# Self-Augmented Diffusion Guidance for Physics-Informed Generation
Source: [https://arxiv.org/html/2608.26748](https://arxiv.org/html/2608.26748)
Akira Osakaakr\-osaka@g\.ecc\.u\-tokyo\.ac\.jpNaoya Takeishintake@g\.ecc\.u\-tokyo\.ac\.jpAffiliation:School of EngineeringAffiliation:The University of TokyoTakehisa Yairiyairi@g\.ecc\.u\-tokyo\.ac\.jpAffiliation:School of EngineeringAffiliation:The University of Tokyo

###### Abstract

Diffusion models can be used to generate spatiotemporal signals of physical phenomena, such as time\-series images of fluid dynamics\. However, a major limitation of standard diffusion models is that they do not incorporate constraints derived from the underlying physical laws\. Consequently, generated samples may appear visually plausible while deviating substantially from the true dynamics\. In this study, we propose a simple yet effective physics\-informed approach based on diffusion guidance with self\-generated data augmentation\. The proposed method learns the data distribution conditioned on the degree of deviation from the physically correct dynamics and generates samples by explicitly setting the deviation condition to be zero\. The method decouples the evaluation of the governing equations from the diffusion model training and sampling processes, avoiding the need to solve the governing equations at every iteration of the denoising process\. This design makes the method applicable to problems requiring computationally expensive numerical simulations and enables faster sample generation\. Experimental results demonstrate that the proposed model not only significantly reduces the deviations compared with standard diffusion models but also achieves further reductions when combined with existing physics\-constrained diffusion methods\.

## 1Introduction

Diffusion models provide a powerful framework for learning probability distributions and generating realistic samples\. Their applications extend beyond general image generation to physical phenomena in fields such as fluid dynamics\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\), oceanography\([Xu and Li, 2025](https://arxiv.org/html/2608.26748#bib.bib21)\), and atmospheric science\([Wang et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib18)\)\. However, when applied to physical problems, standard diffusion models, including score\-based models\([Song and Ermon, 2019](https://arxiv.org/html/2608.26748#bib.bib1);[Song et al\., 2021b](https://arxiv.org/html/2608.26748#bib.bib2)\)and denoising models\([Sohl\-Dickstein et al\., 2015](https://arxiv.org/html/2608.26748#bib.bib3);[Ho et al\., 2020](https://arxiv.org/html/2608.26748#bib.bib4);[Song et al\., 2021a](https://arxiv.org/html/2608.26748#bib.bib5)\), face a critical limitation that they do not explicitly account for the underlying physical laws\. Consequently, they may generate samples that appear visually plausible but are physically inconsistent, reducing their validity and practical utility\.

Several previous studies have addressed this issue by developing diffusion models that enforce adherence to governing physical laws\. The Physics\-Informed Diffusion Model \(PIDM\)\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\)reduces discrepancies between generated samples and the underlying physical constraints by incorporating the residuals of the governing equations into the training loss\. PIDM imposes these constraints only during training, leaving the sampling process unchanged from that of standard diffusion models\. Among the methods that incorporate physical constraints during sampling, CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\)modifies the sampling procedure so that denoising proceeds in a direction that reduces the constraint violation\. Similarly, Physics\-Guided Diffusion \(PG Diffusion\)\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\)integrates residual information into the model architecture using classifier\-free guidance\. Regarding PG Diffusion,[Bastek et al\. \(2025\)](https://arxiv.org/html/2608.26748#bib.bib6)point out that although the method incorporates gradient information into the model, it does not explicitly enforce residual minimization, resulting in insufficient physical consistency\. This observation highlights the need for methods that explicitly impose a zero\-residual condition during sampling\.

Another critical challenge is computational cost\. Existing methods\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6);[Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7);[Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\)require the evaluation and differentiation of the constraints during either training or sampling\. In some problems, such as the generation of time\-series data in fluid dynamics, snapshots are generated at spatial and temporal resolutions coarser than those required for stable and accurate numerical differentiation\. Such nature of data makes it inapplicable to evaluate the residuals of the partial differential equations \(PDEs\) as a mean to impose physics constraints expressed as PDEs\. In such cases, instead, the degrees of constraint satisfaction should be evaluated by measuring the deviations between generated samples and physically consistent time\-series samples obtained by numerically integrating the governing equations with smaller internal steps\. Evaluating such integration\-based constraints and their derivatives are typically more computationally expensive than diffusion model training or sampling, especially in high\-dimensional settings, and can result in prohibitively long runtimes\. To broaden the applicability of physics\-informed generative models, it is important to develop a method that separates constraint evaluation from diffusion training and sampling while still incorporating physical information into the model\.

In this study, we propose a simple yet effective physics\-aware diffusion guidance method based on the classifier\-free guidance framework\. Our method is based on a self\-augmentation strategy in which a base diffusion model is used to generate a kind of negative samples, while the original dataset is treated as positive samples\. The diffusion model is then guided to generate samples that are closer to the positive samples and further from the negative\. Furthermore, for problems requiring computationally expensive numerical simulations, our approach decouples constraint evaluation from diffusion model training and sampling\. It eliminates the need for calculating gradients of the constraint functions during either training or sampling\.

Unlike PG Diffusion\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\), which also employs classifier\-free guidance, our method explicitly enforces physical consistency by sampling from a diffusion model conditioned on zero constraint violation\. The Extrapolation\-Correction\-Interpolation \(ECI\) sampling method\([Cheng et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib13)\), based on flow matching\([Lipman et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib29)\), also achieves gradient\-free generation by taking advantage of its deterministic flow structure\. However, it assumes the availability of an appropriate correction algorithm that projects the samples to satisfy the constraints\. Our approach further removes this requirement and is applicable as long as the constraints can be evaluated somehow\. Table[1](https://arxiv.org/html/2608.26748#S1.T1)compares the requirements of previous approaches with those of our method\. Our method does not rely on any of the assumptions required by the existing methods\.

Table 1:Comparison of assumptions required by previous physics\-informed generative methods and ours\.MethodConstraint Evaluationduring TrainingConstraint Evaluationduring SamplingGradientof ConstraintProjection /CorrectionPG Diffusion\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\)✓✓✓–PIDM\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\)✓–✓–CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\)–✓✓–ECI\([Cheng et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib13)\)–––✓Proposed––––
Note: ECI is based on flow matching, whereas PG Diffusion, PIDM, CoCoGen, and ours are based on diffusion models\.

We evaluate our method on fluid dynamics tasks and demonstrate that it significantly reduces deviations from the underlying physical laws\. Our approach can also be readily combined with existing physics\-informed diffusion methods in a plug\-and\-play manner\. We show that combining it with previous approaches such as PIDM and CoCoGen yields further improvements in physical consistency\.

## 2Related work

As diffusion models and flow matching have become increasingly popular for generative modeling, constrained generation has attracted growing attention in recent years\. One of the early studies in this area is[Fishman et al\. \(2023\)](https://arxiv.org/html/2608.26748#bib.bib40), which investigated diffusion models defined on constrained domains\. Subsequent studies have explored several directions, such as constraint\-aware diffusion training\([Khalafi et al\., 2024](https://arxiv.org/html/2608.26748#bib.bib41)\), gradient\-guided sampling for constraint satisfaction\([Huang et al\., 2024b](https://arxiv.org/html/2608.26748#bib.bib42)\), and projection onto constrained regions during sampling\([Christopher et al\., 2024](https://arxiv.org/html/2608.26748#bib.bib28)\)\. In flow matching,[Li et al\. \(2026b\)](https://arxiv.org/html/2608.26748#bib.bib43)utilized its differential\-equation structure to formulate constrained generation as an optimal control problem\.

Generative modeling under physical constraints is a major application area of constrained generation\. A common approach in physics\-informed diffusion models and flow matching is to incorporate physical knowledge into the sampling process\.[Yuan et al\. \(2023\)](https://arxiv.org/html/2608.26748#bib.bib12)proposed PhysDiff, which directly modifies intermediate samples during denoising via imitation learning to generate physically plausible human motions\. In the context of flow matching,[Cheng et al\. \(2025\)](https://arxiv.org/html/2608.26748#bib.bib13),[Utkarsh et al\. \(2025\)](https://arxiv.org/html/2608.26748#bib.bib14), and[Christopher et al\. \(2026\)](https://arxiv.org/html/2608.26748#bib.bib33)developed methods that extrapolate intermediate states to the terminal time, project or refine the resulting terminal\-state estimates to satisfy the constraints, and then propagate the corrections back to the current sampling steps\. These methods exploit the deterministic nature of flow matching and apply the constraint operations to estimated terminal states rather than directly to intermediate states\. For diffusion models,[Li et al\. \(2026a\)](https://arxiv.org/html/2608.26748#bib.bib35)also introduced projections toward feasible regions during denoising\. Similarly,[Blanke et al\. \(2026\)](https://arxiv.org/html/2608.26748#bib.bib44)integrated projection steps into Langevin sampling\. Diffusion posterior sampling\([Chung et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib15);[Yao et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib16)\), which is designed to solve inverse problems, has also been applied to physics\-constrained generation\.[Huang et al\. \(2024a\)](https://arxiv.org/html/2608.26748#bib.bib17)and[Gallon et al\. \(2026\)](https://arxiv.org/html/2608.26748#bib.bib37)proposed methods that correct intermediate samples along the gradient of the residual\.[Peng et al\. \(2026\)](https://arxiv.org/html/2608.26748#bib.bib32)injected the physics gradient into the noise\-prediction steps\. Similarly, CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\)modifies the sampling process so that the denoising steps move in a direction that reduces the residual:

xi−1=Solver⁡\(xi\)−γ​∇xi∥r⁡\(xi\)∥22,x\_\{i\-1\}=\\operatorname\{Solver\}\(x\_\{i\}\)\-\\gamma\\nabla\_\{x\_\{i\}\}\\lVert r\(x\_\{i\}\)\\rVert\_\{2\}^\{2\},\(1\)wherexix\_\{i\}is an intermediate state,r⁡\(x\)r\(x\)is the residual of the governing equation, andγ\\gammais a hyperparameter\.

Another major approach is to introduce constraints during training to reduce deviations from physically consistent dynamics\. In the context of flow matching,[Tauberschmidt et al\. \(2026\)](https://arxiv.org/html/2608.26748#bib.bib30)incorporated the Adjoint Matching framework\([Domingo\-Enrich et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib31)\)to fine\-tune the flow for lower deviations using an additional control term\. For diffusion models, PIDM\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\)and related training\-based approaches\([Wang et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib18);[Zeng et al\., 2026](https://arxiv.org/html/2608.26748#bib.bib19);[Bai et al\., 2026](https://arxiv.org/html/2608.26748#bib.bib36);[Ismayilzada et al\., 2026](https://arxiv.org/html/2608.26748#bib.bib34)\)incorporate physics\-based constraints such as physics residuals into the training objective\. For example, when training a model to estimate the added noiseϵ\\epsilon, a simplified form of the PIDM objective can be written as

∥ϵθ​\(xt,t\)−ϵ∥2\+λ​∥r⁡\(𝔼⁡\[x0∣xt\]\)∥2,\\lVert\\epsilon\_\{\\theta\}\(x\_\{t\},t\)\-\\epsilon\\rVert^\{2\}\+\\lambda\\lVert r\(\\mathbb\{E\}\[x\_\{0\}\\mid x\_\{t\}\]\)\\rVert^\{2\},\(2\)whereϵθ​\(xt,t\)\\epsilon\_\{\\theta\}\(x\_\{t\},t\)denotes the function that estimates the noise,r⁡\(x\)r\(x\)denotes the residual, andλ\\lambdais a hyperparameter\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\)\. Related extensions of PIDM have also been explored in settings such as knowledge distillation\([Zhang et al\., 2026](https://arxiv.org/html/2608.26748#bib.bib20)\)and generation without full knowledge of the underlying dynamics\([Xu and Li, 2025](https://arxiv.org/html/2608.26748#bib.bib21);[Tan et al\., 2026](https://arxiv.org/html/2608.26748#bib.bib22)\)\.

Classifier\-free guidance\([Ho and Salimans, 2022](https://arxiv.org/html/2608.26748#bib.bib9)\), which provides a method for learning a conditional distributionp⁡\(x∣c\)p\(x\\mid c\), has also been applied to physics\-informed generation\. Although it was originally introduced for general image generation, PG Diffusion\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\)uses classifier\-free guidance to integrate physical information into the model architecture when reconstructing high\-resolution images from low\-fidelity inputs\. By using the gradient of the physical residual as conditioning information within the classifier\-free guidance framework, they incorporate residual information into the model and enables physics\-aware training and sampling\. However, as noted by[Bastek et al\. \(2025\)](https://arxiv.org/html/2608.26748#bib.bib6), PG Diffusion does not explicitly guide the sampling process toward a zero\-residual condition\.

Although these approaches enable physics\-aware generation, they require constraint evaluation during either training or sampling\. In some problem settings, such as generating snapshot time\-series of 3D fluid flow, the physical simulations required for constraint evaluation are computationally expensive and can substantially increase training and sampling times\. Motivated by this limitation, our approach separates physical simulations required for constraint evaluation from both diffusion training and sampling, avoiding a substantial increase in computational cost even in such cases\.

## 3Background

### 3\.1Diffusion models

Diffusion models\([Ho et al\., 2020](https://arxiv.org/html/2608.26748#bib.bib4)\)are generative models that learn the reverse\-time dynamics of a diffusion process, allowing data to be generated from Gaussian noise\. Lett∈\[0,T\]t\\in\[0,T\]denote a time step andxt∼pt​\(x\)x\_\{t\}\\sim p\_\{t\}\(x\)be an intermediate noisy sample\. The forward diffusion process is defined as

q⁡\(xt∣xt−1\)=𝒩⁡\(xt,1−βt​xt−1,βt​I\),q\(x\_\{t\}\\mid x\_\{t\-1\}\)=\\mathcal\{N\}\(x\_\{t\};\\sqrt\{1\-\\beta\_\{t\}\}x\_\{t\-1\},\\beta\_\{t\}I\),\(3\)whereβt\\beta\_\{t\}denotes the noise variance added at timett\. Given Gaussian noiseϵ∼𝒩⁡\(0,I\)\\epsilon\\sim\\mathcal\{N\}\(0,I\), a noisy sample at timettcan be obtained as follows:

xt​\(x0,ϵ\)=α¯t​x0\+1−α¯t​ϵ,α¯t=∏s=1t\(1−βs\)\.x\_\{t\}\(x\_\{0\},\\epsilon\)=\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}x\_\{0\}\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\epsilon,~~\\bar\{\\alpha\}\_\{t\}=\\prod\_\{s=1\}^\{t\}\(1\-\\beta\_\{s\}\)\.\(4\)
The corresponding reverse process, parameterized by a set of learnable parametersθ\\theta, can be written as

pθ​\(xt−1∣xt\)=𝒩⁡\(xt−1,μθ​\(xt,t\),σt2​I\),p\_\{\\theta\}\(x\_\{t\-1\}\\mid x\_\{t\}\)=\\mathcal\{N\}\(x\_\{t\-1\};\\mu\_\{\\theta\}\(x\_\{t\},t\),\\sigma\_\{t\}^\{2\}I\),\(5\)whereσt2\\sigma\_\{t\}^\{2\}is a fixed variance\. The diffusion model is trained by optimizingθ\\thetaso that the learned reverse process approximates the data distribution\.

According to[Ho et al\. \(2020\)](https://arxiv.org/html/2608.26748#bib.bib4), the parameter setθ\\thetacan be trained by predicting the added noiseϵ\\epsilonfrom the noisy samplextx\_\{t\}:

minθ⁡𝔼t,x0,ϵ​‖ϵ−ϵθ​\(α¯t​x0\+1−α¯t​ϵ,t\)‖2,\\min\_\{\\theta\}\\mathbb\{E\}\_\{t,x\_\{0\},\\epsilon\}\\\|\\epsilon\-\\epsilon\_\{\\theta\}\(\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}x\_\{0\}\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\epsilon,t\)\\\|^\{2\},\(6\)where the functionϵθ​\(x,t\)\\epsilon\_\{\\theta\}\(x,t\)predicts the noise added toxx\.

After training, samples can be generated by starting from Gaussian noise att=Tt=Tand iteratively applying the following reverse process untilt=0t=0:

xt−1=11−βt​\(xt−βt1−α¯t​ϵθ​\(xt,t\)\)\+σt​z,x\_\{t\-1\}=\\frac\{1\}\{\\sqrt\{1\-\\beta\_\{t\}\}\}\\left\(x\_\{t\}\-\\frac\{\\beta\_\{t\}\}\{\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\}\\epsilon\_\{\\theta\}\(x\_\{t\},t\)\\right\)\+\\sigma\_\{t\}z,\(7\)wherez∼𝒩⁡\(0,I\)z\\sim\\mathcal\{N\}\(0,I\)\.

### 3\.2Diffusion guidance

[Dhariwal and Nichol \(2021\)](https://arxiv.org/html/2608.26748#bib.bib23)proposed classifier guidance, which uses the gradient of a classifier to guide a diffusion model toward samples satisfying a conditioncc\. The conditional noise\-estimation model takes the conditionccas an additional input\. The model parameters are optimized as

minθ‖ϵθ​\(xt,t,c\)−ϵ‖2\.\\min\_\{\\theta\}\\quad\\left\\lVert\\epsilon\_\{\\theta\}\(x\_\{t\},t,c\)\-\\epsilon\\right\\rVert^\{2\}\.\(8\)
During sampling, the estimated noiseϵθ\\epsilon\_\{\\theta\}is modified using a classifierpϕ​\(c∣xt\)p\_\{\\phi\}\(c\\mid x\_\{t\}\)trained on noisy samples\([Ho and Salimans, 2022](https://arxiv.org/html/2608.26748#bib.bib9)\):

ϵ~θ​\(xt,t,c\)=ϵθ​\(xt,t,c\)−w​σt​∇xt​log⁡pϕ​\(c∣xt\),\\tilde\{\\epsilon\}\_\{\\theta\}\(x\_\{t\},t,c\)=\\epsilon\_\{\\theta\}\(x\_\{t\},t,c\)\-w\\sigma\_\{t\}\\nabla\_\{x\_\{t\}\}\\log p\_\{\\phi\}\(c\\mid x\_\{t\}\),\(9\)wherewwis a guidance scale, andσt\\sigma\_\{t\}is the standard deviation of the noise at timett\. As discussed in[Ho and Salimans \(2022\)](https://arxiv.org/html/2608.26748#bib.bib9), Eq\.[9](https://arxiv.org/html/2608.26748#S3.E9)effectively modifies the probability distribution as

p~θ​\(x∣c\)∝pθ​\(x∣c\)​pϕ​\(c∣x\)w,\\tilde\{p\}\_\{\\theta\}\(x\\mid c\)\\propto p\_\{\\theta\}\(x\\mid c\)p\_\{\\phi\}\(c\\mid x\)^\{w\},\(10\)which increases the likelihood of samples that the classifier associates with conditionccand guides the sampling process accordingly\.

Although classifier guidance improves sample quality, it requires training an additional classifier and complicates the overall procedure\. To address this issue,[Ho and Salimans \(2022\)](https://arxiv.org/html/2608.26748#bib.bib9)proposed classifier\-free guidance, which achieves a similar effect without an explicit classifier\. In this approach, the same model is trained with and without conditioncc, and sampling is guided by modifying the noise estimateϵθ\\epsilon\_\{\\theta\}as

ϵ~θ​\(xt,t,c\)=\(1\+w\)​ϵθ​\(xt,t,c\)−w​ϵθ​\(xt,t\),\\tilde\{\\epsilon\}\_\{\\theta\}\(x\_\{t\},t,c\)=\(1\+w\)\\epsilon\_\{\\theta\}\(x\_\{t\},t,c\)\-w\\epsilon\_\{\\theta\}\(x\_\{t\},t\),\(11\)which can be interpreted as using an implicit classifier:

pi​\(c∣x\)∝p⁡\(x∣c\)p⁡\(x\)\.p^\{\\text\{i\}\}\(c\\mid x\)\\propto\\frac\{p\(x\\mid c\)\}\{p\(x\)\}\.\(12\)

## 4Method

We propose a physics\-informed diffusion framework with data augmentation\. The main idea of the proposed approach is to train the guidance model using original data, which serve as physically consistent positive samples, and augmented data, which serve as negative samples with some deviations from the underlying physics\. The sampling process is then guided toward the positive samples\.

The augmented data consist of visually plausible but physically inconsistent negative samples generated by an ordinary diffusion model before the guidance model is trained\. As this initial diffusion model generates the augmented data that are subsequently used to train the guidance model, we refer to this process as self\-augmentation\. An overview of the proposed framework is shown in Figure[1](https://arxiv.org/html/2608.26748#S4.F1)\.

Let𝒟o=\{xo\}\\mathcal\{D\}\_\{\\text\{o\}\}=\\\{x\_\{\\text\{o\}\}\\\}denote the original dataset, where each sample satisfies the governing equationE⁡\(x\)=0E\(x\)=0\. The objective is to generate samples that are as close as possible to satisfyingE⁡\(x\)=0E\(x\)=0\. We evaluate deviations from the correct dynamics either by calculating the PDE residuals∥E⁡\(x\)∥\\lVert E\(x\)\\rVertor by measuring the deviations between generated time\-series samples and numerically integrated reference samples\. For simplicity, we use the term residual to refer to both types of deviation throughout this study and define a residual functionr⁡\(x\)r\(x\)to quantify them\.

### 4\.1Standard diffusion training for data augmentation and constraint evaluation

First, we train a diffusion model without guidance on the original dataset𝒟o\\mathcal\{D\}\_\{\\text\{o\}\}to obtain an approximate distributionpθ​\(x\)p\_\{\\theta\}\(x\)\. Any diffusion algorithm, such as DDPM\([Ho et al\., 2020](https://arxiv.org/html/2608.26748#bib.bib4)\), can be used for this purpose\. After training, we sample from the model to construct an augmentation dataset:

𝒟a=\{xa∼pθ\(x\)\}\.\\mathcal\{D\}\_\{\\text\{a\}\}=\\\{x\_\{\\text\{a\}\}\\sim p\_\{\\theta\}\(x\)\\\}\.\(13\)
Subsequently, we evaluate residuals withr⁡\(x\)r\(x\)\. The original samplesxox\_\{\\text\{o\}\}are assumed to satisfy the governing equation, such thatr⁡\(xo\)=0r\(x\_\{\\text\{o\}\}\)=0\. In contrast, the generated samplesxax\_\{\\text\{a\}\}generally exhibit nonzero residuals because the model is trained without physical constraints, resulting inr⁡\(xa\)\>0r\(x\_\{\\text\{a\}\}\)\>0\. Thus, we treatxox\_\{\\text\{o\}\}as positive samples satisfying the physical law, andxax\_\{\\text\{a\}\}as negative samples violating it\.

We then construct an augmented dataset by combining the original and generated samples with their corresponding residuals:

𝒟′=\{\(x,r\)\}=\{\(xo,r⁡\(xo\)\)\}∪\{\(xa,r⁡\(xa\)\)\}\.\\mathcal\{D\}^\{\\prime\}=\\\{\(x,r\)\\\}=\\\{\(x\_\{\\mathrm\{o\}\},r\(x\_\{\\mathrm\{o\}\}\)\)\\\}\\cup\\\{\(x\_\{\\mathrm\{a\}\},r\(x\_\{\\mathrm\{a\}\}\)\)\\\}\.\(14\)

### 4\.2Physics\-informed classifier\-free guidance

Finally, we train a classifier\-free guidance model\([Ho and Salimans, 2022](https://arxiv.org/html/2608.26748#bib.bib9)\)conditioned on the residualrrusing the dataset𝒟′\\mathcal\{D\}^\{\\prime\}, thereby obtaining an approximate distributionpψ​\(x∣r\)p\_\{\\psi\}\(x\\mid r\)\. Based on the general conditional training objective in Eq\.[8](https://arxiv.org/html/2608.26748#S3.E8), we use the physical residualrras the conditionccand define the training objective as follows:

minψ∥ϵψ​\(xt,t,r\)−ϵ∥2\.\\min\_\{\\psi\}\\quad\\lVert\\epsilon\_\{\\psi\}\(x\_\{t\},t,r\)\-\\epsilon\\rVert^\{2\}\.\(15\)As in standard classifier\-free guidance, the conditionrris randomly replaced with a null condition during training, allowing the same model to learn both conditional and unconditional noise estimates\.

After training, we generate samples frompψ​\(x∣0\)p\_\{\\psi\}\(x\\mid 0\)by setting the residual condition tor=0r=0, which is expected to guide the model toward samples with lower physical residuals\. Following Eq\.[11](https://arxiv.org/html/2608.26748#S3.E11), the noise estimate is modified as

ϵ~ψ​\(xt,t,0\)=\(1\+w\)​ϵψ​\(xt,t,0\)−w​ϵψ​\(xt,t\)\.\\tilde\{\\epsilon\}\_\{\\psi\}\(x\_\{t\},t,0\)=\(1\+w\)\\epsilon\_\{\\psi\}\(x\_\{t\},t,0\)\-w\\epsilon\_\{\\psi\}\(x\_\{t\},t\)\.\(16\)
![Refer to caption](https://arxiv.org/html/2608.26748v1/methods.png)Figure 1:Overview of the proposed guidance approach\.In the proposed method, any physical simulation required for residual evaluation is performed independently of diffusion training and sampling\. During the classifier\-free guidance step, the model uses only the precomputed residuals\. Algorithm[1](https://arxiv.org/html/2608.26748#alg1)presents the overall procedure of the proposed method\.

Algorithm 1Physics\-informed classifier\-free guidance1:

r⁡\(x\)r\(x\): function to evaluate residuals,

𝒟o\\mathcal\{D\}\_\{\\mathrm\{o\}\}: original dataset,

ℒDM\\mathcal\{L\}\_\{\\mathrm\{DM\}\}: diffusion loss,

ℒCFG\\mathcal\{L\}\_\{\\mathrm\{CFG\}\}: classifier\-free guidance loss

2:Diffusion training and sampling

3:

θ←arg⁡minθ​ℒDM​\(θ,𝒟o\)\\theta\\leftarrow\\arg\\min\_\{\\theta\}\\mathcal\{L\}\_\{\\mathrm\{DM\}\}\(\\theta;\\mathcal\{D\}\_\{\\mathrm\{o\}\}\)
4:

𝒟a=\{xa\},xa∼pθ​\(x\)\\mathcal\{D\}\_\{\\mathrm\{a\}\}=\\\{x\_\{\\mathrm\{a\}\}\\\},\\quad x\_\{\\mathrm\{a\}\}\\sim p\_\{\\theta\}\(x\)
5:Residual calculation and data augmentation

6:

𝒟′←\{\(xo,0\)∣xo∈𝒟o\}∪\{\(xa,r⁡\(xa\)\)∣xa∈𝒟a\}\\mathcal\{D\}^\{\\prime\}\\leftarrow\\\{\(x\_\{\\text\{o\}\},0\)\\mid x\_\{\\text\{o\}\}\\in\\mathcal\{D\}\_\{\\mathrm\{o\}\}\\\}\\cup\\\{\(x\_\{\\text\{a\}\},r\(x\_\{\\text\{a\}\}\)\)\\mid x\_\{\\text\{a\}\}\\in\\mathcal\{D\}\_\{\\mathrm\{a\}\}\\\}
7:Guidance model training and sampling

8:

ψ←arg⁡minψ​ℒCFG​\(ψ,𝒟′\)\\psi\\leftarrow\\arg\\min\_\{\\psi\}\\mathcal\{L\}\_\{\\mathrm\{CFG\}\}\(\\psi;\\mathcal\{D\}^\{\\prime\}\)
9:

x∗∼pψ\(⋅∣0\)x^\{\*\}\\sim p\_\{\\psi\}\(\\cdot\\mid 0\)

### 4\.3Extensibility

While the proposed algorithm can improve physical consistency on its own, it can also be readily extended to achieve further performance improvements\.

First, the proposed algorithm can be applied iteratively by using samples generated by the guidance model as additional negative samples\. Specifically, these newly generated samplesxa′∈𝒟a′x\_\{\\text\{a\}\}^\{\\prime\}\\in\\mathcal\{D\_\{\\text\{a\}\}^\{\\prime\}\}are added to the existing set of negative samples, and the guidance model is retrained on the expanded dataset𝒟′′=𝒟′∪\{\(xa′,r⁡\(xa′\)\)\}\\mathcal\{D\}^\{\\prime\\prime\}=\\mathcal\{D\}^\{\\prime\}\\cup\\\{\(x\_\{\\mathrm\{a\}\}^\{\\prime\},r\(x\_\{\\mathrm\{a\}\}^\{\\prime\}\)\)\\\}\. Samples are then generated again by conditioning on zero residual\. Repeating this procedure allows the model to progressively generate samples with lower residuals\.

Second, the proposed method can be readily combined with existing approaches that incorporate physical constraints during training \(e\.g\., PIDM\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\)\) or during sampling \(e\.g\., CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\)\)\. The proposed method differs from ordinary diffusion models in four main aspects, \(i\) the generation of negative samples, \(ii\) the inclusion of a simulation step, \(iii\) the introduction of the conditional variablerrinto the noise estimation modelϵψ\\epsilon\_\{\\psi\}in Eq\.[15](https://arxiv.org/html/2608.26748#S4.E15), \(iv\) the guidance mechanism in Eq\.[16](https://arxiv.org/html/2608.26748#S4.E16)\. These modifications do not fundamentally alter the structure of the diffusion model, which allows the proposed method to be applied to a wide range of existing diffusion\-based approaches in plug\-and\-play manner\.

## 5Experiments

We demonstrate physics\-guided generation using the proposed method on Darcy flow and time\-series fluid data\.

### 5\.1Darcy flow

#### 5\.1\.1Problem setting

In this section, we compare the proposed method with existing methods on the Darcy flow problem, which is commonly used as a benchmark in previous studies\.

The Darcy flow equations describe fluid flow through porous media\. LetK⁡\(x\)K\(x\)denote the permeability,p⁡\(x\)p\(x\)the pressure field,u⁡\(x\)u\(x\)the velocity field, andf⁡\(x\)f\(x\)a source function representing where fluid enters and exits the domain\. As introduced in the related studies\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6);[Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\), the governing equations are given by:

u⁡\(x\)\\displaystyle u\(x\)=−K\(x\)∇p\(x\),x∈Ω,\\displaystyle=\-K\(x\)\\nabla p\(x\),\\quad x\\in\\Omega,\(17\)∇⋅u⁡\(x\)\\displaystyle\\nabla\\cdot u\(x\)=f\(x\),x∈Ω,\\displaystyle=f\(x\),\\quad x\\in\\Omega,u​\(x\)⋅n^​\(x\)\\displaystyle u\(x\)\\cdot\\hat\{n\}\(x\)=0,x∈∂Ω,\\displaystyle=0,\\quad x\\in\\partial\\Omega,∫Ωp⁡\(x\)​𝑑x\\displaystyle\\int\_\{\\Omega\}p\(x\)dx=0,\\displaystyle=0,wheren^​\(x\)\\hat\{n\}\(x\)denotes the outward normal vector on the boundary\.

In this experiment, the purpose of the diffusion model is to generate samples of the pressure fieldp⁡\(x\)p\(x\)and the permeability fieldK⁡\(x\)K\(x\)while maintaining consistency with the static relations defined in Eq\.[17](https://arxiv.org/html/2608.26748#S5.E17)\. The residual is defined as PDE residual of the governing equation\.

We use the Darcy flow dataset released by[Bastek et al\. \(2025\)](https://arxiv.org/html/2608.26748#bib.bib6)\. The dataset consists of 10000 training samples and 1000 validation samples, each with a resolution of64×6464\\times 64\. The number of negative samples generated in the first step of our method is 10000, matching the size of the training set\.

We compare the proposed method with a standard DDPM without physical constraints and evaluate the reduction in residuals achieved by the proposed method\. We also evaluate the extensibility of our approach by applying a second round of guidance\. We further combine the proposed method with other physics\-informed diffusion approaches, including PIDM\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\), which incorporates physical constraints during training, and CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\), which incorporates them during sampling\. In addition, we compare our method with PG Diffusion\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\), another approach using classifier\-free guidance\. In each setting, we repeated the experiments 8 times using different random seeds\. More detailed settings are provided in Appendix[A](https://arxiv.org/html/2608.26748#A1)\.

#### 5\.1\.2Results

Figure[2](https://arxiv.org/html/2608.26748#S5.F2)compares samples generated by the standard diffusion model and the proposed guidance model\. The comparison visually demonstrates that our classifier\-free guidance approach reduces the residuals\.

Figure[3](https://arxiv.org/html/2608.26748#S5.F3)shows the distribution of the mean residuals over 8 trials with different random seeds\. In each trial, 1000 samples were generated to calculate the mean\. The results quantitatively demonstrate that the proposed method reduces the residual relative to the baseline and that repeated application of the proposed method further reduces it\. A similar trend is observed in Figure[4](https://arxiv.org/html/2608.26748#S5.F4), which shows the residual distributions within individual trials\. The distributions shift toward zero after applying the proposed method, with an additional shift observed after the second application\.

Figure[3](https://arxiv.org/html/2608.26748#S5.F3)also demonstrates that the proposed method achieves lower residuals than PG Diffusion\. We hypothesize that this improvement is attributable to the sampling strategy of the proposed method, which uses zero residual as an explicit target condition\. Furthermore, combining the proposed method with both PIDM and CoCoGen achieves the best overall performance, outperforming the PIDM \+ CoCoGen baseline\. This result highlights a key advantage of our approach, which is compatible with existing physics\-informed diffusion methods for further improvements in physical consistency\. Additional experimental results are provided in Appendix[B](https://arxiv.org/html/2608.26748#A2)\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_2_1.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_4_1.png)

\(a\)Standard diffusion model\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x1.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x2.png)

\(b\)Proposed guidance model\.

Figure 2:Comparison of samples and residuals generated by the standard diffusion model and the proposed guidance model in the Darcy flow experiment\. The residual represents the PDE residual of the Darcy flow equation\.Figure 3:Distribution of the mean residuals across independent runs under different conditions in the Darcy flow experiment\. The red dashed lines show the mean values\. The notation 1x and 2x indicate that the proposed method is applied once and twice, respectively\.Figure 4:Residual distributions of 1000 generated samples in 2 different trials in the Darcy flow experiment\.

### 5\.2Time\-series generation of 2D fluid dynamics

#### 5\.2\.1Problem setting

The second experiment considers the generation of time\-series snapshots of 2D fluid dynamics\.

Letuudenote the velocity field,ppthe pressure,ffthe external forcing,R​eRethe Reynolds number, andρ\\rhothe density\. We consider 2D incompressible flows as introduced in\([Kochkov et al\., 2021](https://arxiv.org/html/2608.26748#bib.bib24)\), described by the following Navier–Stokes equations:

∂u∂t=−∇⋅\(u⊗u\)\+1R​e∇2u−1ρ∇p\+f,\\frac\{\\partial u\}\{\\partial t\}=\-\\nabla\\cdot\(u\\otimes u\)\+\\frac\{1\}\{Re\}\\nabla^\{2\}u\-\\frac\{1\}\{\\rho\}\\nabla p\+f,\(18\)∇⋅u=0,\\nabla\\cdot u=0,\(19\)where⊗\\otimesdenotes the tensor product\. The vorticity associated with the velocity field in Eqs\.[18](https://arxiv.org/html/2608.26748#S5.E18)and[19](https://arxiv.org/html/2608.26748#S5.E19)is defined as

ω=∂uy∂x−∂ux∂y\.\\omega=\\frac\{\\partial u\_\{y\}\}\{\\partial x\}\-\\frac\{\\partial u\_\{x\}\}\{\\partial y\}\.\(20\)
In this experiment, we consider the generation of 2D vorticity fields in the absence of external forcing \(i\.e\.,f=0f=0, corresponding to decaying flow\)\. We prepared 10000 training samples and 1000 validation samples, each consisting of 4 snapshots showing the evolution over 3 seconds at a resolution of64×6464\\times 64\. The number of negative samples generated in the first step of our method is 10000, matching the size of the training set\.

To calculate the residuals, we use the generated snapshot att=0t=0as the initial condition and numerically integrate Eq\.[18](https://arxiv.org/html/2608.26748#S5.E18)and[19](https://arxiv.org/html/2608.26748#S5.E19)to obtain a physically consistent reference trajectory\. The residuals are defined as the deviations between the generated samples and the corresponding reference snapshots\. For numerical stability, the integration timestepΔ​t\\Delta tis set to 0\.05, which is smaller than the snapshot interval of 1\.0\. As the snapshots are generated at a coarser temporal resolution than that adopted for stable numerical integration, directly calculated PDE residuals at the snapshot interval are not suitable for evaluating physical consistency\.

As in the Darcy flow experiment, we compare the proposed method with a standard DDPM, PG Diffusion\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\), PIDM\([Bastek et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib6)\), and CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\)baselines\. In each setting, we repeated the experiments 8 times using different random seeds\. More detailed settings are provided in Appendix[C](https://arxiv.org/html/2608.26748#A3)\.

#### 5\.2\.2Results

Figure[5](https://arxiv.org/html/2608.26748#S5.F5)compares samples generated by the standard diffusion model and the proposed guidance model\. The comparison visually demonstrates that our classifier\-free guidance approach reduces the residuals\.

Figure[6](https://arxiv.org/html/2608.26748#S5.F6)shows the distribution of the mean residuals over 8 trials with different random seeds\. In each trial, 1000 samples were generated to calculate the mean\. The trends are similar to those observed in the Darcy flow experiment, and the proposed guidance models outperform the standard diffusion and PG Diffusion baselines\. Although the difference is not clearly visible in the figure, the average mean residual decreases from1\.19×10−21\.19\\times 10^\{\-2\}for Proposed Guidance applied once \(1x\) to1\.11×10−21\.11\\times 10^\{\-2\}for Proposed Guidance applied twice \(2x\)\. In addition, the largest mean residual among the trials is lower for Proposed Guidance \(2x\), demonstrating the effectiveness of repeated applications of the proposed method\. This trend is also reflected in Figure[7](https://arxiv.org/html/2608.26748#S5.F7), which shows the residual distribution within individual trials\. Furthermore, combining the proposed model with PIDM and CoCoGen achieves the best performance and substantially improves from the PIDM \+ CoCoGen baseline\. Additional experimental results are provided in Appendix[D](https://arxiv.org/html/2608.26748#A4)\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_6_1.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_8_4.png)

\(a\)Standard diffusion model\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x3.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x4.png)

\(b\)Proposed guidance model\.

Figure 5:Comparison of samples and residuals generated by the standard diffusion model and the proposed guidance model in the time\-series fluid experiment\. The residual represents the deviation between generated samples and the corresponding snapshots obtained by numerically integrating the Navier–Stokes equations from the same initial states\.Figure 6:Distribution of the mean residuals across independent runs under different conditions in the time\-series fluid experiment\. The red dashed lines show the mean values\. The notation 1x and 2x indicate that the proposed method is applied once and twice, respectively\.Figure 7:Residual distributions of 1000 generated samples in 2 different trials in the time\-series fluid experiment\.
#### 5\.2\.3Comparison of computational cost

We compare the computational cost among different sampling algorithms\. We measure the time to generate 1000 samples using PG Diffusion\([Shu et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib8)\), CoCoGen\([Jacobsen et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib7)\), and our proposed diffusion guidance approach\. PG Diffusion and CoCoGen repeatedly require gradient calculations during the sampling process, while the proposed approach does not\. The experimental configurations used for these measurements correspond to PG Diffusion, PIDM \+ CoCoGen, and Proposed Guidance \(1x\) in Section[5\.2\.2](https://arxiv.org/html/2608.26748#S5.SS2.SSS2)\.

Table[2](https://arxiv.org/html/2608.26748#S5.T2)reports the average sampling time over 8 trials for each method\. The results show that the proposed approach substantially reduces the sampling time compared with gradient\-based PG Diffusion and CoCoGen\. This reduction demonstrates the computational advantage of our simulation\-free sampling strategy, which avoids repeated evaluation of physical residuals and their gradients during sampling\.

We expect this advantage to become more effective for computationally demanding problems such as 3D fluid dynamics\. In such problems, a single numerical simulation can require hours or days, making simulation at every sampling iteration computationally prohibitive\. Our approach instead uses a model trained in advance on precomputed residuals and incorporates information about the underlying physics without performing simulations during generation, in a manner analogous to amortized inference\([Cranmer et al\., 2020](https://arxiv.org/html/2608.26748#bib.bib10);[Zammit\-Mangion et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib11)\)\.

Table 2:Comparison of the wall\-clock time required to generate 1000 samples in the time\-series fluid experiment\. Results are reported as the mean±\\pmstandard deviation across trials\.Sampling methodMean Sampling Time±\\pmStd\. \[s\]PG Diffusion265\.9±7\.4265\.9\\pm 7\.4CoCoGen135\.6±4\.4135\.6\\pm 4\.4Classifier\-free guidance\-based \(proposed\)66\.8±0\.8\\mathbf\{66\.8\\pm 0\.8\}
#### 5\.2\.4Data augmentation with noise

In our approach, we first train a standard diffusion model to obtain negative samples\. However, negative samples can also be constructed by adding noise to the original data and then evaluating the residuals of the noisy samples, without using diffusion training or sampling\. This provides a simpler variant of our approach\. Here, we conduct experiments to examine whether the first\-stage diffusion training can be replaced by noise\-based data augmentation\.

We use the same time\-series 2D fluid dataset and consider two experimental settings, with the standard diffusion model and PIDM \+ CoCoGen serving as the respective baselines\. For each setting, we generate negative samples by adding Gaussian noise to the original data\. We adjust the noise variance so that the mean residual of the resulting negative samples matches that of the corresponding baseline\. For the standard diffusion setting, the mean residuals are4\.97×10−24\.97\\times 10^\{\-2\}for the baseline and4\.93×10−24\.93\\times 10^\{\-2\}for the noise\-augmented negative samples\. For the PIDM \+ CoCoGen setting, the corresponding values are6\.90×10−36\.90\\times 10^\{\-3\}and6\.83×10−36\.83\\times 10^\{\-3\}, respectively\.

We train the classifier\-free guidance model using the noise\-augmented dataset\. The model parameters and training hyperparameters are kept the same as those used in the diffusion\-based augmentation experiments, and we conduct 8 trials with different random seeds\. Table[3](https://arxiv.org/html/2608.26748#S5.T3)compares the mean residuals calculated over 1000 generated samples\. Although noise augmentation also reduces the residuals, the diffusion\-based augmentation adopted in our method results in lower mean residuals\. These results indicate that augmentation with random noise provides a potential alternative, particularly when training the first\-stage diffusion model is prohibitively expensive\. Nevertheless, when computationally feasible, first\-stage diffusion training is preferable because employing visually plausible negative samples tends to provide better physical consistency\.

Table 3:Comparison of mean residuals between models augmented with Gaussian noise and with diffusion\-generated samples\. Results across trials are reported as the mean±\\pmstandard deviation and the median with the interquartile range shown in parentheses\.Experimental conditionMean Residual±\\pmStd\.Median Residual \(IQR\)Standard Diffusion \(baseline\)4\.97×10−2±2\.90×10−24\.97\\times 10^\{\-2\}\\pm 2\.90\\times 10^\{\-2\}4\.02×10−2​\(3\.98×10−2\)4\.02\\times 10^\{\-2\}\\ \(3\.98\\times 10^\{\-2\}\)Noise Augmentation \(guidance\)1\.28×10−2±7\.92×10−41\.28\\times 10^\{\-2\}\\pm 7\.92\\times 10^\{\-4\}1\.31×10−2​\(8\.95×10−4\)1\.31\\times 10^\{\-2\}\\ \(8\.95\\times 10^\{\-4\}\)Diffusion\-Based Augmentation \(guidance\)1\.19×𝟏𝟎−𝟐±5\.96×𝟏𝟎−𝟑\\mathbf\{1\.19\\times 10^\{\-2\}\\pm 5\.96\\times 10^\{\-3\}\}8\.64×𝟏𝟎−𝟑​\(5\.84×𝟏𝟎−𝟑\)\\mathbf\{8\.64\\times 10^\{\-3\}\\ \(5\.84\\times 10^\{\-3\}\)\}PIDM \+ CoCoGen \(baseline\)6\.90×10−3±2\.23×10−36\.90\\times 10^\{\-3\}\\pm 2\.23\\times 10^\{\-3\}6\.45×10−3​\(2\.42×10−3\)6\.45\\times 10^\{\-3\}\\ \(2\.42\\times 10^\{\-3\}\)Noise Augmentation \(guidance\)1\.07×10−3±9\.89×10−51\.07\\times 10^\{\-3\}\\pm 9\.89\\times 10^\{\-5\}1\.08×10−3​\(1\.64×10−4\)1\.08\\times 10^\{\-3\}\\ \(1\.64\\times 10^\{\-4\}\)Diffusion\-Based Augmentation \(guidance\)8\.43×𝟏𝟎−𝟒±4\.64×𝟏𝟎−𝟒\\mathbf\{8\.43\\times 10^\{\-4\}\\pm 4\.64\\times 10^\{\-4\}\}7\.11×𝟏𝟎−𝟒​\(7\.15×𝟏𝟎−𝟒\)\\mathbf\{7\.11\\times 10^\{\-4\}\\ \(7\.15\\times 10^\{\-4\}\)\}

## 6Conclusion

In this study, we proposed a method to enhance the physical consistency of diffusion models using classifier\-free guidance with self\-generated data augmentation\. The proposed model learns a distribution conditioned on residuals and guides the generation process toward samples with lower deviations from physical laws by setting the residual condition to zero\. In addition, our approach decouples physics simulation from diffusion training and sampling, avoiding repeated and time\-consuming constraint evaluation as well as gradient calculations of the constraints\.

Experimental results demonstrate that the proposed method reduces residuals compared with standard diffusion models such as DDPM, and further improves physical consistency when combined with existing physics\-constrained training and sampling approaches\. Moreover, our empirical results show that multiple application of the proposed method yields additional improvements in physical consistency without requiring evaluation of the governing equations during diffusion training or sampling\. This property broadens the applicability of physics\-aware diffusion models to computationally demanding problems\.

The proposed framework is applicable to a wide range of constrained generation tasks, provided that consistency with a given set of rules can be evaluated\. Such rules are not limited to the physical laws considered in this study\. For example, the method could be applied to generating control inputs for robotic systems under motion constraints or generating robot trajectories that comply with operational rules\. Exploring such extensions remains an important direction for future work\.

#### Acknowledgments

This work was supported by JST PRESTO JPMJPR24T6, JSPS KAKENHI JP25H01454, JP26K02968, and JST SPRING JPMJSP2108\.

## References

- Baiet al\.\(2026\)Y\. Bai, G\. Eskandar, Z\. Liu, and G\. KutyniokPhysics\-informed video diffusion for shallow water equations\.InProceedings of the 2026 IEEE International Conference on Acoustics, Speech, and Signal Processing,pp\. 13242–13246\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.1)\.
- Basteket al\.\(2025\)J\. Bastek, W\. Sun, and D\. M\. KochmannPhysics\-informed diffusion models\.InProceedings of the 13th International Conference on Learning Representations,Cited by:[§A\.1](https://arxiv.org/html/2608.26748#A1.SS1.p1.1),[Table 1](https://arxiv.org/html/2608.26748#S1.T1.5.3.1.1),[§1](https://arxiv.org/html/2608.26748#S1.p2.1),[§1](https://arxiv.org/html/2608.26748#S1.p3.1),[§2](https://arxiv.org/html/2608.26748#S2.p3.1),[§2](https://arxiv.org/html/2608.26748#S2.p3.2),[§2](https://arxiv.org/html/2608.26748#S2.p4.1),[§4\.3](https://arxiv.org/html/2608.26748#S4.SS3.p3.1),[§5\.1\.1](https://arxiv.org/html/2608.26748#S5.SS1.SSS1.p2.2),[§5\.1\.1](https://arxiv.org/html/2608.26748#S5.SS1.SSS1.p4.1),[§5\.1\.1](https://arxiv.org/html/2608.26748#S5.SS1.SSS1.p5.1),[§5\.2\.1](https://arxiv.org/html/2608.26748#S5.SS2.SSS1.p5.1)\.
- Blankeet al\.\(2026\)M\. Blanke, Y\. Qu, S\. Shamekh, and P\. GentineStrictly constrained generative modeling via split augmented langevin sampling\.InProceedings of the 14th International Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Caoet al\.\(2025\)S\. Cao, F\. Brarda, R\. Li, and Y\. XiSpectral\-Refiner: accurate fine\-tuning of spatiotemporal fourier neural operator for turbulent flows\.InProceedings of the 13th International Conference on Learning Representations,Cited by:[§C\.1](https://arxiv.org/html/2608.26748#A3.SS1.p1.1)\.
- Chenget al\.\(2025\)C\. Cheng, B\. Han, D\. C\. Maddix, A\. F\. Ansari, A\. Stuart, M\. W\. Mahoney, and B\. WangGradient\-free generation for hard\-constrained systems\.InProceedings of the 13th International Conference on Learning Representations,Cited by:[Table 1](https://arxiv.org/html/2608.26748#S1.T1.5.5.1.1),[§1](https://arxiv.org/html/2608.26748#S1.p5.1),[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Christopheret al\.\(2024\)J\. K\. Christopher, S\. Baek, and F\. FiorettoConstrained synthesis with projected diffusion models\.InAdvances in Neural Information Processing Systems,Vol\.37,pp\. 89307–89333\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p1.1)\.
- Christopheret al\.\(2026\)J\. K\. Christopher, J\. E\. Warner, and F\. FiorettoConstraint\-aware flow matching: decision aligned end\-to\-end training for constrained sampling\.Note:arXiv preprint arXiv:2605\.12754External Links:2605\.12754Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Chunget al\.\(2023\)H\. Chung, J\. Kim, M\. T\. McCann, M\. L\. Klasky, and J\. C\. YeDiffusion posterior sampling for general noisy inverse problems\.InProceedings of the 11th International Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Cranmeret al\.\(2020\)K\. Cranmer, J\. Brehmer, and G\. LouppeThe frontier of simulation\-based inference\.Proceedings of the National Academy of Sciences117\(48\),pp\. 30055–30062\.Cited by:[§5\.2\.3](https://arxiv.org/html/2608.26748#S5.SS2.SSS3.p3.1)\.
- Dhariwal and Nichol \(2021\)P\. Dhariwal and A\. NicholDiffusion models beat GANs on image synthesis\.InAdvances in Neural Information Processing Systems,Vol\.34,pp\. 8780–8794\.Cited by:[§3\.2](https://arxiv.org/html/2608.26748#S3.SS2.p1.1)\.
- Domingo\-Enrichet al\.\(2025\)C\. Domingo\-Enrich, M\. Drozdzal, B\. Karrer, and R\. T\. Q\. ChenAdjoint matching: fine\-tuning flow and diffusion generative models with memoryless stochastic optimal control\.InProceedings of the 13th International Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.1)\.
- Dresdneret al\.\(2023\)G\. Dresdner, D\. Kochkov, P\. C\. Norgaard, L\. Zepeda\-Núñez, J\. A\. Smith, M\. P\. Brenner, and S\. HoyerLearning to correct spectral methods for simulating turbulent flows\.Transactions on Machine Learning Research\.Cited by:[§C\.1](https://arxiv.org/html/2608.26748#A3.SS1.p1.1)\.
- Fishmanet al\.\(2023\)N\. Fishman, L\. Klarner, V\. De Bortoli, E\. Mathieu, and M\. J\. HutchinsonDiffusion models for constrained domains\.Transactions on Machine Learning Research\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p1.1)\.
- Gallonet al\.\(2026\)D\. Gallon, P\. von Wurstemberger, P\. Cheridito, and A\. JentzenPhysics\-informed diffusion models in spectral space\.InProceedings of the 43rd International Conference on Machine Learning,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Hoet al\.\(2020\)J\. Ho, A\. Jain, and P\. AbbeelDenoising diffusion probabilistic models\.InAdvances in Neural Information Processing Systems,Vol\.33,pp\. 6840–6851\.Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p1.1),[§3\.1](https://arxiv.org/html/2608.26748#S3.SS1.p1.1),[§3\.1](https://arxiv.org/html/2608.26748#S3.SS1.p3.1),[§4\.1](https://arxiv.org/html/2608.26748#S4.SS1.p1.1)\.
- Ho and Salimans \(2022\)J\. Ho and T\. SalimansClassifier\-free diffusion guidance\.Note:arXiv preprint arXiv:2207\.12598External Links:2207\.12598Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p4.1),[§3\.2](https://arxiv.org/html/2608.26748#S3.SS2.p2.1),[§3\.2](https://arxiv.org/html/2608.26748#S3.SS2.p2.2),[§3\.2](https://arxiv.org/html/2608.26748#S3.SS2.p3.1),[§4\.2](https://arxiv.org/html/2608.26748#S4.SS2.p1.1)\.
- Huanget al\.\(2024a\)J\. Huang, G\. Yang, Z\. Wang, and J\. J\. ParkDiffusionPDE: generative PDE\-solving under partial observation\.InAdvances in Neural Information Processing Systems,Vol\.37,pp\. 130291–130323\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Huanget al\.\(2024b\)W\. Huang, Y\. Jiang, T\. Van Wouwe, and C\. K\. LiuConstrained diffusion with trust sampling\.InAdvances in Neural Information Processing Systems,Vol\.37,pp\. 93849–93873\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p1.1)\.
- Ismayilzadaet al\.\(2026\)E\. Ismayilzada, Y\. Zhang, and Z\. CuiPAD\-Hand: physics\-aware diffusion for hand motion recovery\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 28358–28368\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.1)\.
- Jacobsenet al\.\(2025\)C\. Jacobsen, Y\. Zhuang, and K\. DuraisamyCoCoGen: physically consistent and conditioned score\-based generative models for forward and inverse problems\.SIAM Journal on Scientific Computing47\(2\),pp\. C399–C425\.Cited by:[Table 1](https://arxiv.org/html/2608.26748#S1.T1.5.4.1.1),[§1](https://arxiv.org/html/2608.26748#S1.p2.1),[§1](https://arxiv.org/html/2608.26748#S1.p3.1),[§2](https://arxiv.org/html/2608.26748#S2.p2.1),[§4\.3](https://arxiv.org/html/2608.26748#S4.SS3.p3.1),[§5\.1\.1](https://arxiv.org/html/2608.26748#S5.SS1.SSS1.p2.2),[§5\.1\.1](https://arxiv.org/html/2608.26748#S5.SS1.SSS1.p5.1),[§5\.2\.1](https://arxiv.org/html/2608.26748#S5.SS2.SSS1.p5.1),[§5\.2\.3](https://arxiv.org/html/2608.26748#S5.SS2.SSS3.p1.1)\.
- Khalafiet al\.\(2024\)S\. Khalafi, D\. Ding, and A\. RibeiroConstrained diffusion models via dual training\.InAdvances in Neural Information Processing Systems,Vol\.37,pp\. 26543–26576\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p1.1)\.
- Kingma and Ba \(2015\)D\. P\. Kingma and J\. BaAdam: a method for stochastic optimization\.InProceedings of the 3rd International Conference on Learning Representations,Cited by:[§A\.2](https://arxiv.org/html/2608.26748#A1.SS2.p3.1),[§C\.2](https://arxiv.org/html/2608.26748#A3.SS2.p3.1)\.
- Kochkovet al\.\(2021\)D\. Kochkov, J\. A\. Smith, A\. Alieva, Q\. Wang, M\. P\. Brenner, and S\. HoyerMachine learning\-accelerated computational fluid dynamics\.Proceedings of the National Academy of Sciences118\(21\),pp\. e2101784118\.Cited by:[§C\.1](https://arxiv.org/html/2608.26748#A3.SS1.p1.1),[§5\.2\.1](https://arxiv.org/html/2608.26748#S5.SS2.SSS1.p2.1)\.
- Liet al\.\(2026a\)T\. Li, M\. Buzzicotti, F\. Bonaccorso, and L\. BiferalePhysics\-constrained diffusion model for synthesis of 3d turbulent data\.Note:arXiv preprint arXiv:2603\.12834External Links:2603\.12834Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Liet al\.\(2026b\)Z\. Li, K\. Alim, and N\. AzizanHardFlow: hard\-constrained sampling for flow\-matching models via trajectory optimization\.IEEE Transactions on Pattern Analysis and Machine Intelligence\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p1.1)\.
- Lipmanet al\.\(2023\)Y\. Lipman, R\. T\. Q\. Chen, H\. Ben\-Hamu, M\. Nickel, and M\. LeFlow matching for generative modeling\.InProceedings of the 11th International Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p5.1)\.
- Nichol and Dhariwal \(2021\)A\. Q\. Nichol and P\. DhariwalImproved denoising diffusion probabilistic models\.InProceedings of the 38th International Conference on Machine Learning,pp\. 8162–8171\.Cited by:[§C\.2](https://arxiv.org/html/2608.26748#A3.SS2.p3.1)\.
- Penget al\.\(2026\)D\. Peng, Y\. Chen, Y\. Zhou, and X\. YuanLoPhyDA: low\-rank tensor and physics gradient guided diffusion for atmospheric data assimilation\.InProceedings of the 43rd International Conference on Machine Learning,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Ronnebergeret al\.\(2015\)O\. Ronneberger, P\. Fischer, and T\. BroxU\-Net: convolutional networks for biomedical image segmentation\.InProceedings of the 18th International Conference on Medical Image Computing and Computer\-Assisted Intervention,Lecture Notes in Computer Science, Vol\.9351,pp\. 234–241\.Cited by:[§A\.2](https://arxiv.org/html/2608.26748#A1.SS2.p3.1),[§C\.2](https://arxiv.org/html/2608.26748#A3.SS2.p3.1)\.
- Shuet al\.\(2023\)D\. Shu, Z\. Li, and A\. Barati FarimaniA physics\-informed diffusion model for high\-fidelity flow field reconstruction\.Journal of Computational Physics478,pp\. 111972\.Cited by:[Table 1](https://arxiv.org/html/2608.26748#S1.T1.5.2.1.1),[§1](https://arxiv.org/html/2608.26748#S1.p1.1),[§1](https://arxiv.org/html/2608.26748#S1.p2.1),[§1](https://arxiv.org/html/2608.26748#S1.p3.1),[§1](https://arxiv.org/html/2608.26748#S1.p5.1),[§2](https://arxiv.org/html/2608.26748#S2.p4.1),[§5\.1\.1](https://arxiv.org/html/2608.26748#S5.SS1.SSS1.p5.1),[§5\.2\.1](https://arxiv.org/html/2608.26748#S5.SS2.SSS1.p5.1),[§5\.2\.3](https://arxiv.org/html/2608.26748#S5.SS2.SSS3.p1.1)\.
- Sohl\-Dicksteinet al\.\(2015\)J\. Sohl\-Dickstein, E\. Weiss, N\. Maheswaranathan, and S\. GanguliDeep unsupervised learning using nonequilibrium thermodynamics\.InProceedings of the 32nd International Conference on Machine Learning,pp\. 2256–2265\.Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p1.1)\.
- Songet al\.\(2021a\)J\. Song, C\. Meng, and S\. ErmonDenoising diffusion implicit models\.InProceedings of the 9th International Conference on Learning Representations,Cited by:[§A\.2](https://arxiv.org/html/2608.26748#A1.SS2.p1.1),[§A\.2](https://arxiv.org/html/2608.26748#A1.SS2.p3.1),[§C\.2](https://arxiv.org/html/2608.26748#A3.SS2.p1.1),[§C\.2](https://arxiv.org/html/2608.26748#A3.SS2.p3.1),[§1](https://arxiv.org/html/2608.26748#S1.p1.1)\.
- Song and Ermon \(2019\)Y\. Song and S\. ErmonGenerative modeling by estimating gradients of the data distribution\.InAdvances in Neural Information Processing Systems,Vol\.32,pp\. 11918–11930\.Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p1.1)\.
- Songet al\.\(2021b\)Y\. Song, J\. Sohl\-Dickstein, D\. P\. Kingma, A\. Kumar, S\. Ermon, and B\. PooleScore\-based generative modeling through stochastic differential equations\.InProceedings of the 9th International Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p1.1)\.
- Tanet al\.\(2026\)K\. Tan, K\. Givens, P\. Li, and T\. BeckersPHDME: physics\-informed diffusion models without explicit governing equations\.Note:arXiv preprint arXiv:2601\.21234External Links:2601\.21234Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.2)\.
- Tauberschmidtet al\.\(2026\)J\. Tauberschmidt, S\. Fellenz, S\. J\. Vollmer, and A\. B\. DuncanPhysics\-constrained fine\-tuning of flow\-matching models for generation and inverse problems\.InProceedings of the 14th International Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.1)\.
- Utkarshet al\.\(2025\)U\. Utkarsh, P\. Cai, A\. Edelman, R\. Gomez\-Bombarelli, and C\. V\. RackauckasPhysics\-constrained flow matching: sampling generative models with hard constraints\.InAdvances in Neural Information Processing Systems,Vol\.38,pp\. 160217–160252\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Wanget al\.\(2025\)H\. Wang, J\. Han, W\. Fan, W\. Zhang, and H\. LiuPhyDA: physics\-guided diffusion models for data assimilation in atmospheric systems\.Note:arXiv preprint arXiv:2505\.12882External Links:2505\.12882Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p1.1),[§2](https://arxiv.org/html/2608.26748#S2.p3.1)\.
- Xu and Li \(2025\)Q\. Xu and Z\. LiPartial physics informed diffusion model for ocean chlorophyll concentration reconstruction\.InAdvances in Neural Information Processing Systems,Vol\.38,pp\. 156490–156507\.Cited by:[§1](https://arxiv.org/html/2608.26748#S1.p1.1),[§2](https://arxiv.org/html/2608.26748#S2.p3.2)\.
- Yaoet al\.\(2025\)J\. Yao, A\. Mammadov, J\. Berner, G\. Kerrigan, J\. C\. Ye, K\. Azizzadenesheli, and A\. AnandkumarGuided diffusion sampling on function spaces with applications to PDEs\.InAdvances in Neural Information Processing Systems,Vol\.38,pp\. 127057–127094\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Yuanet al\.\(2023\)Y\. Yuan, J\. Song, U\. Iqbal, A\. Vahdat, and J\. KautzPhysDiff: physics\-guided human motion diffusion model\.InProceedings of the IEEE/CVF International Conference on Computer Vision,pp\. 15964–15975\.Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p2.1)\.
- Zammit\-Mangionet al\.\(2025\)A\. Zammit\-Mangion, M\. Sainsbury\-Dale, and R\. HuserNeural methods for amortized inference\.Annual Review of Statistics and Its Application12,pp\. 311–335\.Cited by:[§5\.2\.3](https://arxiv.org/html/2608.26748#S5.SS2.SSS3.p3.1)\.
- Zenget al\.\(2026\)T\. Zeng, T\. Wang, J\. Zhang, Z\. Zeng, F\. Zhang, Y\. Xu, S\. Chen, J\. Jiao, C\. Claudel, and X\. ChenPILD: physics\-informed learning via diffusion\.Note:arXiv preprint arXiv:2601\.21284External Links:2601\.21284Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.1)\.
- Zhanget al\.\(2026\)Y\. Zhang, P\. Wang, and D\. ZouPhysics\-informed distillation of diffusion models for PDE\-constrained generation\.InForty\-third International Conference on Machine Learning,Cited by:[§2](https://arxiv.org/html/2608.26748#S2.p3.2)\.

## Appendix ADetails of the Darcy flow experiment

### A\.1Dataset

The Darcy flow dataset released by[Bastek et al\. \(2025\)](https://arxiv.org/html/2608.26748#bib.bib6)consists of 10000 training samples and 1000 validation samples\. Each sample contains the pressure fieldppand permeability fieldKK, both at a resolution of64×6464\\times 64\. We concatenateppandKKalong the channel dimension so that each sample is represented asx∈ℝ2×64×64x\\in\\mathbb\{R\}^\{2\\times 64\\times 64\}\. Figure[8](https://arxiv.org/html/2608.26748#A1.F8)shows examples from the dataset\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_colorbar_0.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_colorbar_1.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_colorbar_2.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_colorbar_3.png)

Figure 8:Examples from the Darcy flow dataset\.
### A\.2Implementation details

The proposed method was implemented based on the code provided for Denoising Diffusion Implicit Models \(DDIM\)\([Song et al\., 2021a](https://arxiv.org/html/2608.26748#bib.bib5)\)\. All experiments were conducted on an NVIDIA GH200 GPU for both training and sampling\.

The pressure and permeability channels were independently normalized to\[−1,1\]\[\-1,1\]using the minimum and maximum values computed from the corresponding training set\. Before residual evaluation, generated samples were transformed back to their original physical scales\.

Following[Song et al\. \(2021a\)](https://arxiv.org/html/2608.26748#bib.bib5), we use a U\-Net architecture\([Ronneberger et al\., 2015](https://arxiv.org/html/2608.26748#bib.bib26)\)to estimate the added noise\. The model parameters are optimized using Adam\([Kingma and Ba, 2015](https://arxiv.org/html/2608.26748#bib.bib27)\)\. The residualrris input to the model as a condition vectorc=\[r,1\]∈ℝ2c=\[r,1\]\\in\\mathbb\{R\}^\{2\}, where the second component distinguishes a valid condition from the null condition used for classifier\-free guidance\. The condition vector is embedded with an encoder neural network, and added to residual blocks of the U\-Net\. During classifier\-free guidance training, the condition is replaced with the null conditionc∅=\[−1,0\]c\_\{\\varnothing\}=\[\-1,0\]with probability0\.10\.1\. During sampling, the zero\-residual condition is represented byc=\[0,1\]c=\[0,1\]\.

Table[4](https://arxiv.org/html/2608.26748#A1.T4)summarizes the model and experimental settings\. The same model configuration is used for both the first\-stage diffusion model and the subsequent guidance model\.

Table 4:Experimental settings for the Darcy flow experiments\.ParameterSettingModelArchitectureU\-NetBase channels64Channel multipliers\(1,2,4,8\)\(1,2,4,8\)Residual blocks2 per resolutionAttention16×1616\\times 16resolutionDropout0\.1EMA decay0\.9999DiffusionNumber of diffusion steps1000Variance scheduleLinear \(1×10−4→2×10−21\\times 10^\{\-4\}\\rightarrow 2\\times 10^\{\-2\}\)TrainingOptimizerAdamLearning rate1\.0×10−41\.0\\times 10^\{\-4\}Batch size64Epochs500Weight decay0\.0Gradient clipping1\.0Classifier\-free dropout0\.1SamplingSampling steps100DDIM stochasticity parameterη\\eta1\.0Guidance scaleww2\.0

## Appendix BAdditional results of the Darcy flow experiment

### B\.1Residual distributions of individual trials

Figure[4](https://arxiv.org/html/2608.26748#S5.F4)in Section[5\.1](https://arxiv.org/html/2608.26748#S5.SS1)shows the residual distributions for 2 of the 8 trials, while Figure[9](https://arxiv.org/html/2608.26748#A2.F9)presents those for the remaining 6 trials\. Each histogram is computed from 1000 samples generated in a single independent trial with a different random seed\. In all trials, the distributions shift toward lower residual values when the proposed guidance is applied\. The distributions shift further toward zero when the proposed method is applied twice by adding the samples generated by the first guidance model to the existing training data and retraining the guidance model\. These results are consistent with the findings reported in Section[5\.1](https://arxiv.org/html/2608.26748#S5.SS1)\.

Figure 9:Residual distributions over 1000 generated samples for 6 independent trials in the Darcy flow experiment\. Each histogram corresponds to a different random seed\.
### B\.2Generated samples

Figure[10](https://arxiv.org/html/2608.26748#A2.F10)shows samples generated under different experimental conditions\. The residual represents the PDE residual of the Darcy flow equation\.

It illustrates how the proposed method and other physics\-informed diffusion methods reduce the residuals\. It also demonstrates the proposed method combined with PIDM and CoCoGen achieves the largest reduction\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_5_3.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_8_2.png)

\(a\)Standard diffusion model\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x8.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x9.png)

\(b\)PG Diffusion\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x10.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x11.png)

\(c\)Proposed guidance model applied once\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x12.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x13.png)

\(d\)Proposed guidance model applied twice\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x14.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x15.png)

\(e\)PIDM \+ CoCoGen\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x16.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x17.png)

\(f\)PIDM \+ CoCoGen with the proposed guidance applied once\.

Figure 10:Comparison of samples and residuals generated under different conditions in the Darcy flow experiment\.
### B\.3Novelty check

We compare the generated samples with the training data to assess whether the reduction in residuals could be attributed to memorization of training samples that satisfy the governing equations\. This analysis examines whether the model can generate novel, physically consistent samples rather than simply reproducing the training data\.

In Figure[11](https://arxiv.org/html/2608.26748#A2.F11), we randomly select four samples generated by PIDM \+ CoCoGen with the proposed guidance, which achieved the lowest residuals among the settings evaluated in Section[5\.1](https://arxiv.org/html/2608.26748#S5.SS1)\. For each generated sample, we show the three closest training samples in terms of MSE\. The generated samples differ from their nearest training samples, suggesting that the model does not simply reproduce the training data and can generate novel physics\-aware samples\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_1_0.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_3_1.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_5_3.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_7_4.png)

Figure 11:Samples generated using PIDM \+ CoCoGen with the proposed guidance and their three nearest neighbors in the training dataset for the Darcy flow experiment\.

## Appendix CDetails of the time\-series 2D fluid experiment

### C\.1Dataset

We construct a dataset of time\-series vorticity snapshotsω\\omegausing torch\-cfd\([Cao et al\., 2025](https://arxiv.org/html/2608.26748#bib.bib38)\), a PyTorch\-based CFD library built on JAX\-CFD\([Kochkov et al\., 2021](https://arxiv.org/html/2608.26748#bib.bib24);[Dresdner et al\., 2023](https://arxiv.org/html/2608.26748#bib.bib25)\)\. The viscosity is set to1\.5×10−21\.5\\times 10^\{\-2\}, the maximum initial velocity to 0\.4, and the computational domain to\[0,5\]×\[0,5\]\[0,5\]\\times\[0,5\]\. No external forcing is applied\. The initial velocity fields are generated by applying a spectral filter to Gaussian noise\. The governing equations are integrated with an internal time step of0\.050\.05\. Each sample is represented asx∈ℝ4×64×64x\\in\\mathbb\{R\}^\{4\\times 64\\times 64\}, consisting of 4 snapshots at a resolution of64×6464\\times 64\. The snapshots span 3 seconds and are recorded at 1 second intervals\. We generate 10000 training samples and 1000 validation samples\. Examples are shown in Figure[12](https://arxiv.org/html/2608.26748#A3.F12)\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_1.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_3.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_6.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_8.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/data_sample_9.png)

Figure 12:Examples of time\-series 2D fluid data\.
### C\.2Implementation details

The proposed method was implemented based on the code provided for DDIM\([Song et al\., 2021a](https://arxiv.org/html/2608.26748#bib.bib5)\)\. All experiments were conducted on an NVIDIA GH200 GPU for both training and sampling\.

The four vorticity channels were jointly normalized to\[−1,1\]\[\-1,1\]using the global minimum and maximum values computed from the corresponding training set\. Before residual evaluation, generated samples were transformed back to their original physical scales\.

Following[Song et al\. \(2021a\)](https://arxiv.org/html/2608.26748#bib.bib5), we use a U\-Net architecture\([Ronneberger et al\., 2015](https://arxiv.org/html/2608.26748#bib.bib26)\)to estimate the added noise\. The model parameters are optimized using Adam\([Kingma and Ba, 2015](https://arxiv.org/html/2608.26748#bib.bib27)\)\. We use the cosine noise schedule proposed by[Nichol and Dhariwal \(2021\)](https://arxiv.org/html/2608.26748#bib.bib39)\. The fluid residualrris rescaled torrescaled∈\[0,1\]r\_\{\\text\{rescaled\}\}\\in\[0,1\]\. The transformed residual is input to the model as a condition vector𝐜=\[rrescaled,1\]∈ℝ2\\mathbf\{c\}=\[r\_\{\\text\{rescaled\}\},1\]\\in\\mathbb\{R\}^\{2\}, where the second component distinguishes a valid condition from the null condition used for classifier\-free guidance\. The condition vector is embedded with an encoder neural network, and added to residual blocks of the U\-Net\. During classifier\-free guidance training, the condition is replaced with the null condition𝐜∅=\[−1,0\]\\mathbf\{c\}\_\{\\varnothing\}=\[\-1,0\]with probability0\.20\.2\. During sampling, the zero\-residual target is represented by𝐜=\[0,1\]\\mathbf\{c\}=\[0,1\]\.

Table[5](https://arxiv.org/html/2608.26748#A3.T5)summarizes the model and experimental settings\. The same model configuration is used for both the first\-stage diffusion model and the subsequent guidance model\.

Table 5:Experimental settings for the time\-series 2D fluid experiments\.ParameterSettingModelArchitectureU\-NetBase channels64Channel multipliers\(1,2,2,4\)\(1,2,2,4\)Residual blocks2 per resolutionAttention16×1616\\times 16resolutionDropout0\.2EMA decay0\.9999DiffusionNumber of diffusion steps1000Variance scheduleCosine \(offset: 0\.008\)TrainingOptimizerAdamLearning rate1\.0×10−41\.0\\times 10^\{\-4\}Batch size32Epochs200Weight decay1\.0×10−41\.0\\times 10^\{\-4\}Gradient clipping1\.0Classifier\-free dropout0\.2SamplingSampling steps100DDIM stochasticity parameterη\\eta1\.0Guidance scaleww2\.0

## Appendix DAdditional results of the time\-series 2D fluid experiment

### D\.1Residual distributions of individual trials

Figure[7](https://arxiv.org/html/2608.26748#S5.F7)in Section[5\.2](https://arxiv.org/html/2608.26748#S5.SS2)shows the residual distributions for 2 of the 8 trials, while Figure[13](https://arxiv.org/html/2608.26748#A4.F13)presents those for the remaining 6 trials\. Each histogram is computed from 1000 samples generated in a single independent trial with a different random seed\. In all trials, the distributions shift toward lower residual values when the proposed guidance is applied\. The results also show a trend toward further reductions in the residuals when the proposed method is applied twice\. These results are consistent with the findings reported in Section[5\.2](https://arxiv.org/html/2608.26748#S5.SS2)\.

Figure 13:Residual distributions over 1000 generated samples for 6 independent trials in the time\-series 2D fluid experiment\. Each histogram corresponds to a different random seed\.
### D\.2Generated samples

Figures[14](https://arxiv.org/html/2608.26748#A4.F14)and[15](https://arxiv.org/html/2608.26748#A4.F15)show samples generated under different conditions\. The residual represents the deviation between generated samples and the corresponding snapshots obtained by numerically integrating the Navier–Stokes equations from the same initial states\.

They illustrate that the proposed method reduces the residuals compared with the baselines and that its combination with PIDM and CoCoGen achieves the lowest residuals among the adopted settings\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_4_4.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_7_2.png)

\(a\)Standard diffusion model\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x24.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x25.png)

\(b\)Proposed guidance model applied once\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x26.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x27.png)

\(c\)Proposed guidance model applied twice\.

Figure 14:Comparison of samples and residuals generated by the standard diffusion baseline and the proposed guidance models in the time\-series 2D fluid experiment\.![Refer to caption](https://arxiv.org/html/2608.26748v1/comparison_1_2.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x28.png)

\(a\)PG Diffusion\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x29.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x30.png)

\(b\)PIDM \+ CoCoGen\.
![Refer to caption](https://arxiv.org/html/2608.26748v1/x31.png)

![Refer to caption](https://arxiv.org/html/2608.26748v1/x32.png)

\(c\)PIDM \+ CoCoGen with the proposed guidance applied once\.

Figure 15:Comparison of samples and residuals generated by the physics\-informed diffusion baselines and their combination with the proposed guidance in the time\-series 2D fluid experiment\.
### D\.3Novelty check

As in the Darcy flow experiment, we compare the generated samples with the training dataset to assess whether the reduction in residuals could be attributed to memorization of training samples that satisfy the governing equations\. This analysis examines whether the model can generate novel, physically consistent samples rather than simply reproducing the training data\.

In Figure[16](https://arxiv.org/html/2608.26748#A4.F16), we randomly select four samples generated by PIDM \+ CoCoGen with the proposed guidance, which achieved the lowest residuals among the settings evaluated in Section[5\.2](https://arxiv.org/html/2608.26748#S5.SS2)\. Following the procedure used for the Darcy flow experiment in Figure[11](https://arxiv.org/html/2608.26748#A2.F11), we show the three closest training samples for each generated sample in terms of MSE\. The generated samples differ from their nearest training samples, suggesting that the model does not simply reproduce the training data and can generate novel physics\-aware samples\.

![Refer to caption](https://arxiv.org/html/2608.26748v1/x33.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_2_1.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_3_2.png)
![Refer to caption](https://arxiv.org/html/2608.26748v1/nearest_data_4_3.png)

Figure 16:Samples generated using PIDM \+ CoCoGen with the proposed guidance and their three nearest neighbors in the training dataset for the time\-series 2D fluid experiment\.

Similar Articles

Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance

arXiv cs.LG

This paper proposes a diffusion-based framework for learning adaptive mesh discretization conditioned on observed PDE dynamics, using spectral guidance and physics constraints to allocate resolution where needed. The method achieves competitive or superior performance across five PDE regimes.