Semigroup Consistency as a Diagnostic for Learned Physics Simulators
Summary
Proposes semigroup consistency as a diagnostic for evaluating learned physics simulators, showing that normalized semigroup error correlates with rollout degradation in heat and Burgers dynamics using ConvNet and FNO baselines.
View Cached Full Text
Cached at: 05/27/26, 09:08 AM
# Semigroup Consistency as a Diagnostic for Learned Physics Simulators
Source: [https://arxiv.org/html/2605.26324](https://arxiv.org/html/2605.26324)
###### Abstract
Learned physics simulators are often evaluated by one\-step or short\-horizon prediction error, but these metrics can miss failures in temporal composition and long\-horizon rollout\. For autonomous, state\-complete systems, exact solution maps satisfy a semigroup law: direct evolution overs\+ts\+tshould agree with evolution overssfollowed bytt\. We propose normalized semigroup error as a post hoc, model\-agnostic diagnostic comparing these direct and composed learned predictions\. On one\-dimensional heat and Burgers dynamics with time\-conditioned ConvNet and FNO baselines, semigroup error is positively associated with rollout degradation, with trajectory\-level Spearman correlationρ=0\.635\\rho=0\.635and95%95\\%CI\[0\.621,0\.649\]\[0\.621,0\.649\]\. Semigroup regularization has mixed effects, supporting semigroup consistency primarily as an evaluation diagnostic rather than a universally beneficial training objective\.
Scientific Machine Learning, Partial Differential Equations, Neural Operators, Learned Physics Simulators, Semigroup Consistency, Time\-Evolution Models, Rollout Stability, Model Evaluation
## 1Introduction
Learned physics simulators provide fast surrogates for PDE\-governed systems such as diffusion, fluids, and waves\. Neural operators and related models are especially natural for this setting because they learn maps between function spaces rather than finite\-dimensional vectors\([20](https://arxiv.org/html/2605.26324#bib.bib10);[16](https://arxiv.org/html/2605.26324#bib.bib11)\)\. This operator\-learning viewpoint has become a standard framework for PDE surrogate modeling\([9](https://arxiv.org/html/2605.26324#bib.bib19)\)\. Related operator\-learning models include multipole and graph constructions\([14](https://arxiv.org/html/2605.26324#bib.bib12);[15](https://arxiv.org/html/2605.26324#bib.bib13)\)\. Broader neural\-operator formulations further develop this direction for scientific simulation\([1](https://arxiv.org/html/2605.26324#bib.bib17)\)\. Recent work extends these ideas with physics\-informed losses and physics\-informed operator learning\([27](https://arxiv.org/html/2605.26324#bib.bib22);[6](https://arxiv.org/html/2605.26324#bib.bib21)\)\. Physics\-informed neural operators provide another route to combining operator learning with equation structure\([19](https://arxiv.org/html/2605.26324#bib.bib20)\)\. Other extensions include transformer\-style architectures and graph operators\([13](https://arxiv.org/html/2605.26324#bib.bib15);[31](https://arxiv.org/html/2605.26324#bib.bib16)\)\. Large\-scale learned simulation pipelines further demonstrate the promise of learned surrogates for physical systems\([7](https://arxiv.org/html/2605.26324#bib.bib18)\)\.
Standard evaluation often emphasizes one\-step or short\-horizon prediction error\. This is useful but insufficient: models can perform well locally while failing under rollout, time\-step shift, boundary\-condition shift, or broader distribution shift\. These issues appear in physics\-informed learning and autoregressive PDE benchmarks\([10](https://arxiv.org/html/2605.26324#bib.bib37);[8](https://arxiv.org/html/2605.26324#bib.bib28)\)\. They also arise in large PDE datasets and out\-of\-distribution studies of learned surrogates\([24](https://arxiv.org/html/2605.26324#bib.bib29);[23](https://arxiv.org/html/2605.26324#bib.bib35)\)\. Recent work on neural physics solvers likewise emphasizes out\-of\-distribution generalization failures\([36](https://arxiv.org/html/2605.26324#bib.bib36)\)\. Recent failure\-mode studies similarly show that in\-distribution accuracy can obscure rollout and regime\-shift errors\([32](https://arxiv.org/html/2605.26324#bib.bib30)\)\. A simulator should not merely predict the next frame; it should define a coherent time\-evolution rule\.
For autonomous well\-posed systems, the exact solution maps\{St\}t≥0\\\{S\_\{t\}\\\}\_\{t\\geq 0\}satisfy the semigroup law\([25](https://arxiv.org/html/2605.26324#bib.bib1);[5](https://arxiv.org/html/2605.26324#bib.bib2)\):
St\+s=St∘Ss,S0=I\.S\_\{t\+s\}=S\_\{t\}\\circ S\_\{s\},\\qquad S\_\{0\}=I\.\(1\)Thus, direct evolution byt\+st\+sshould agree with evolution byssfollowed bytt\. Related compositional structure appears in flow\-map learning and neural ODEs\([4](https://arxiv.org/html/2605.26324#bib.bib3);[26](https://arxiv.org/html/2605.26324#bib.bib4)\)\. Data\-driven PDE learning in modal space also studies evolution\-map structure\([37](https://arxiv.org/html/2605.26324#bib.bib5)\)\. Similar ideas appear in Koopman modeling and variational Markov models\([12](https://arxiv.org/html/2605.26324#bib.bib7);[21](https://arxiv.org/html/2605.26324#bib.bib8)\)\. Semigroup\-aware learning makes this structure explicit in learned evolution models\([3](https://arxiv.org/html/2605.26324#bib.bib6)\)\. Similar stability concerns arise in learned dissipative dynamics for chaotic systems\([17](https://arxiv.org/html/2605.26324#bib.bib9)\)\.
This paper proposes*semigroup consistency*as a diagnostic for learned physics simulators\. For a learned modelGθ\(u,t\)≈StuG\_\{\\theta\}\(u,t\)\\approx S\_\{t\}u, we compare the direct predictionGθ\(u,s\+t\)G\_\{\\theta\}\(u,s\+t\)with the composed predictionGθ\(Gθ\(u,s\),t\)G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\. Large disagreement indicates that the learned map is not temporally consistent, even if supervised error is small\. This is aligned with concerns that neural operators can learn brittle, regime\-specific, or boundary\-indexed solution families rather than robust physical evolution rules\([33](https://arxiv.org/html/2605.26324#bib.bib31);[22](https://arxiv.org/html/2605.26324#bib.bib32)\)\. It also connects to broader concerns in domain generalization\([38](https://arxiv.org/html/2605.26324#bib.bib33)\)\.
1\. PDE trajectoriesu\(t0\),…,u\(tT\)u\(t\_\{0\}\),\\ldots,u\(t\_\{T\}\)2\. Learn simulatorGθ\(u,Δt\)≈SΔtuG\_\{\\theta\}\(u,\\Delta t\)\\approx S\_\{\\Delta t\}u3\. Compare two learned pathsu^dir=Gθ\(u,s\+t\)\\hat\{u\}\_\{\\rm dir\}=G\_\{\\theta\}\(u,s\+t\)u^comp=Gθ\(Gθ\(u,s\),t\)\\hat\{u\}\_\{\\rm comp\}=G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)4\. Semigroup error‖u^comp−u^dir‖2/\(‖u^dir‖2\+ε\)\\\|\\hat\{u\}\_\{\\rm comp\}\-\\hat\{u\}\_\{\\rm dir\}\\\|\_\{2\}/\(\\\|\\hat\{u\}\_\{\\rm dir\}\\\|\_\{2\}\+\\varepsilon\)5\. Diagnostic testcompare semigroup error with rollout errorFigure 1:Evaluation pipeline for semigroup consistency\. A learned simulator is trained on PDE trajectories, then evaluated by comparing direct and composed learned evolution on held\-out states\.Our claim is that semigroup error complements standard prediction metrics\. It can expose rollout instability, time\-step extrapolation failure, fixed\-step overfitting, and disagreement between direct and autoregressive simulation\. Since it requires no architectural change or retraining, it can be applied to neural operators, autoregressive simulators, and continuous\-time models\([28](https://arxiv.org/html/2605.26324#bib.bib24);[2](https://arxiv.org/html/2605.26324#bib.bib25)\)\. It also applies to other learned surrogates used in physical forecasting\([11](https://arxiv.org/html/2605.26324#bib.bib26)\)\. Empirically, we find that semigroup error is positively associated with rollout degradation on heat and Burgers dynamics, while semigroup regularization has mixed effects and does not yield a reliable aggregate rollout improvement\.
Our contributions are:
1. 1\.We formulate semigroup consistency as a post hoc, model\-agnostic diagnostic for learned physics simulators\.
2. 2\.We define a normalized semigroup error comparing direct and composed learned evolution without requiring additional ground\-truth solves\.
3. 3\.We show that semigroup error is positively associated with rollout degradation and can reveal failures hidden by one\-step prediction metrics\.
4. 4\.We clarify the distinction between semigroup consistency as an evaluation diagnostic and semigroup consistency as a training regularizer\.
## 2Background and Related Work
### 2\.1Evolution Equations and Semigroups
Many physical simulators model autonomous, state\-complete evolution\. Here, autonomous means that the dynamics do not depend explicitly on absolute time, while state\-complete means that the current state contains the information needed to determine future evolution\. This is closely related to the Markov property, but distinct from autonomy: a system can be Markovian and non\-autonomous, or autonomous but non\-Markovian if the chosen state omits relevant history\. Let𝒳\\mathcal\{X\}be a state space and letSt:𝒳→𝒳S\_\{t\}:\\mathcal\{X\}\\to\\mathcal\{X\}map an initial stateu0u\_\{0\}to its state after elapsed timett\. Under standard well\-posedness assumptions, autonomous solution maps form a one\-parameter semigroup\([25](https://arxiv.org/html/2605.26324#bib.bib1);[5](https://arxiv.org/html/2605.26324#bib.bib2)\),
St\+s=St∘Ss,S0=I\.S\_\{t\+s\}=S\_\{t\}\\circ S\_\{s\},\\qquad S\_\{0\}=I\.\(2\)This identity states that evolving forssand thenttmust match evolving directly fors\+ts\+t\. Thus, the semigroup view is not only functional\-analytic; it is a structural condition for coherent prediction across temporal subdivisions, linking local differential descriptions to global evolution maps through the semigroup generator\([25](https://arxiv.org/html/2605.26324#bib.bib1);[5](https://arxiv.org/html/2605.26324#bib.bib2)\)\.
This operator\-level view also appears in data\-driven dynamics\. Flow\-map learning directly approximates evolution maps from trajectories\([26](https://arxiv.org/html/2605.26324#bib.bib4);[37](https://arxiv.org/html/2605.26324#bib.bib5)\)\. Neural ODEs define continuous\-time predictions through learned differential equations\([4](https://arxiv.org/html/2605.26324#bib.bib3)\)\. Koopman and variational Markov methods study learned evolution through composable operators\([12](https://arxiv.org/html/2605.26324#bib.bib7);[21](https://arxiv.org/html/2605.26324#bib.bib8)\)\. Learned dissipative dynamics similarly emphasize long\-time stability and composition effects\([17](https://arxiv.org/html/2605.26324#bib.bib9)\)\. Deep\-OSG is closest to our setting because it explicitly studies operator learning with semigroup structure and temporal partition consistency\([3](https://arxiv.org/html/2605.26324#bib.bib6)\)\. Prior work uses semigroup structure to design learned evolution models\([3](https://arxiv.org/html/2605.26324#bib.bib6)\); we instead study semigroup consistency as a post hoc diagnostic for rollout and time\-step failures\.
### 2\.2Learned Physics Simulators
Learned physics simulators replace or accelerate numerical solves with data\-driven surrogates\. Neural operators are central because they learn maps between function spaces rather than fixed finite\-dimensional discretizations\([20](https://arxiv.org/html/2605.26324#bib.bib10);[16](https://arxiv.org/html/2605.26324#bib.bib11)\)\. General neural operator theory formalizes this function\-space perspective for PDEs\([9](https://arxiv.org/html/2605.26324#bib.bib19);[1](https://arxiv.org/html/2605.26324#bib.bib17)\)\. DeepONet introduced branch–trunk operator approximation\([20](https://arxiv.org/html/2605.26324#bib.bib10)\), while the Fourier Neural Operator uses global spectral mixing and is a standard baseline for parametric PDEs\([16](https://arxiv.org/html/2605.26324#bib.bib11)\)\. Later variants extend operator learning through graph and multipole constructions\([15](https://arxiv.org/html/2605.26324#bib.bib13);[14](https://arxiv.org/html/2605.26324#bib.bib12)\)\. Convolutional, transformer, and finite\-regularity constructions further broaden neural\-operator architectures\([29](https://arxiv.org/html/2605.26324#bib.bib14);[13](https://arxiv.org/html/2605.26324#bib.bib15);[31](https://arxiv.org/html/2605.26324#bib.bib16)\)\. Physics\-informed methods incorporate equation residuals or physical structure into training\([27](https://arxiv.org/html/2605.26324#bib.bib22);[6](https://arxiv.org/html/2605.26324#bib.bib21)\)\. Physics\-informed neural operators extend this idea to operator learning\([19](https://arxiv.org/html/2605.26324#bib.bib20);[18](https://arxiv.org/html/2605.26324#bib.bib38)\)\.
In fluid and physical simulation, learned models support surrogate CFD and flow reconstruction\([28](https://arxiv.org/html/2605.26324#bib.bib24);[2](https://arxiv.org/html/2605.26324#bib.bib25)\)\. They also support machine\-learning\-accelerated CFD and turbulence emulation\([7](https://arxiv.org/html/2605.26324#bib.bib18);[34](https://arxiv.org/html/2605.26324#bib.bib23)\)\. Weather prediction provides another large\-scale setting for learned physical surrogates\([11](https://arxiv.org/html/2605.26324#bib.bib26)\)\. These uses make long\-horizon coherence important: a model may perform well at a fixed training interval but fail under rollout, unseen time steps, or shifted physical parameters\. Time\-conditioned and variable\-time models address this by learningGθ\(u,Δt\)≈SΔtuG\_\{\\theta\}\(u,\\Delta t\)\\approx S\_\{\\Delta t\}urather than a single fixed\-step map\([26](https://arxiv.org/html/2605.26324#bib.bib4);[37](https://arxiv.org/html/2605.26324#bib.bib5)\)\. Semigroup\-aware operator learning also directly targets consistency across temporal partitions\([3](https://arxiv.org/html/2605.26324#bib.bib6)\)\. This setting makes semigroup consistency directly testable by comparing direct prediction ats\+ts\+twith composed prediction throughssandtt\.
### 2\.3Reliability Beyond One\-Step Error
One\-step or short\-horizon prediction error is necessary but incomplete\. Benchmarks such as PDEBench and APEBench broaden evaluation to rollout, resolution transfer, parameter shift, and perturbations\([35](https://arxiv.org/html/2605.26324#bib.bib27);[8](https://arxiv.org/html/2605.26324#bib.bib28)\)\. The Well further expands large\-scale physics simulation datasets for machine learning\([24](https://arxiv.org/html/2605.26324#bib.bib29)\)\. Recent robustness studies likewise show that in\-distribution accuracy may not predict behavior under changes in PDE family, parameters, boundary or terminal conditions, resolution, or rollout horizon\([38](https://arxiv.org/html/2605.26324#bib.bib33);[30](https://arxiv.org/html/2605.26324#bib.bib34)\)\. Additional studies emphasize out\-of\-distribution generalization failures in neural PDE and physics solvers\([23](https://arxiv.org/html/2605.26324#bib.bib35);[36](https://arxiv.org/html/2605.26324#bib.bib36)\)\. Boundary and terminal conditions are particularly important because varying them can turn one operator\-learning problem into a family of condition\-indexed operators\([22](https://arxiv.org/html/2605.26324#bib.bib32)\)\.
These failures motivate structural diagnostics beyond pointwise accuracy\. Known issues include physics\-informed optimization pathologies\([10](https://arxiv.org/html/2605.26324#bib.bib37)\)\. Neural operators can also exhibit spectral or discretization sensitivity\([9](https://arxiv.org/html/2605.26324#bib.bib19);[1](https://arxiv.org/html/2605.26324#bib.bib17)\)\. Autoregressive rollout can introduce additional instability\([17](https://arxiv.org/html/2605.26324#bib.bib9);[8](https://arxiv.org/html/2605.26324#bib.bib28)\)\. Semigroup error targets a complementary failure mode: disagreement between direct and composed evolution\. Unlike supervised error, it does not require ground\-truth solves at every composed intermediate state; unlike conservation or energy diagnostics, it is model\-agnostic across autonomous evolution equations\. It is not sufficient for correctness, since a wrong model can be internally consistent, but it is a lightweight test of whether a learned simulator behaves like a coherent time\-evolution map\. We therefore report semigroup consistency alongside one\-step error, rollout error, and physics\-specific checks\.
## 3Problem Setup
### 3\.1Physical Systems
We study autonomous PDEs with solution maps satisfying the semigroup law in[Equation2](https://arxiv.org/html/2605.26324#S2.E2)\. The experiments use two lightweight one\-dimensional systems: the heat equation and viscous Burgers equation\. The heat equation,
∂tu=νΔu,\\partial\_\{t\}u=\\nu\\Delta u,\(3\)provides a stable dissipative test case\. The viscous Burgers equation,
∂tu\+u∂xu=ν∂xxu,\\partial\_\{t\}u\+u\\partial\_\{x\}u=\\nu\\partial\_\{xx\}u,\(4\)adds nonlinear transport while remaining computationally simple\. Both systems are evaluated with periodic boundary conditions so that the experiment isolates temporal composition rather than boundary\-condition effects\.
### 3\.2Learned Simulator
LetStuS\_\{t\}udenote the reference solution after elapsed timett\. We study time\-conditioned learned simulators
Gθ\(u,Δt\)≈SΔtu,G\_\{\\theta\}\(u,\\Delta t\)\\approx S\_\{\\Delta t\}u,\(5\)whereGθG\_\{\\theta\}is instantiated as either a time\-conditioned convolutional network or a compact Fourier Neural Operator\. The same learned map can be queried at different time increments, which makes it possible to compare direct evolutionGθ\(u,s\+t\)G\_\{\\theta\}\(u,s\+t\)with composed evolutionGθ\(Gθ\(u,s\),t\)G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\.
### 3\.3Training Objective
The base objective is supervised prediction against reference trajectories:
ℒpred\(θ\)=𝔼\(u,t\)\[‖Gθ\(u,t\)−Stu‖22\]\.\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\(\\theta\)=\\mathbb\{E\}\_\{\(u,t\)\}\\left\[\\left\\\|G\_\{\\theta\}\(u,t\)\-S\_\{t\}u\\right\\\|\_\{2\}^\{2\}\\right\]\.\(6\)This measures direct accuracy but does not enforce temporal composition\. For the semigroup\-regularized ablation, we add
ℒsg\(θ\)=𝔼\(u,s,t\)\[\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{sg\}\}\(\\theta\)=\\mathbb\{E\}\_\{\(u,s,t\)\}\\big\[∥Gθ\(Gθ\(u,s\),t\)\\displaystyle\\\|G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\(7\)−Gθ\(u,s\+t\)∥22\],\\displaystyle\\quad\-G\_\{\\theta\}\(u,s\+t\)\\\|\_\{2\}^\{2\}\\big\],and train with
ℒ\(θ\)=ℒpred\(θ\)\+λsgℒsg\(θ\)\.\\mathcal\{L\}\(\\theta\)=\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\(\\theta\)\+\\lambda\_\{\\mathrm\{sg\}\}\\mathcal\{L\}\_\{\\mathrm\{sg\}\}\(\\theta\)\.\(8\)The regularized variant is not the main contribution; it is included to distinguish semigroup consistency as an evaluation diagnostic from semigroup consistency as a training objective\.
## 4Semigroup Consistency Diagnostic
### 4\.1Definition
For an autonomous, state\-complete system, temporal evolution is not an arbitrary collection of input\-output maps: the maps must compose according to the semigroup law\. This gives a simple theoretical test for learned simulators\. IfGθ\(u,t\)G\_\{\\theta\}\(u,t\)approximatesStuS\_\{t\}u, then the two learned paths
Gθ\(u,s\+t\)andGθ\(Gθ\(u,s\),t\)G\_\{\\theta\}\(u,s\+t\)\\qquad\\text\{and\}\\qquad G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)should agree\. Their discrepancy measures whether the learned simulator behaves like a coherent time\-evolution map\.
###### Definition 1\(Semigroup error\)\.
Given a learned simulatorGθ:𝒳×ℝ\+→𝒳G\_\{\\theta\}:\\mathcal\{X\}\\times\\mathbb\{R\}\_\{\+\}\\to\\mathcal\{X\}, define
ℰsg\(u;s,t\)=‖Gθ\(Gθ\(u,s\),t\)−Gθ\(u,s\+t\)‖2‖Gθ\(u,s\+t\)‖2\+ε\.\\mathcal\{E\}\_\{\\mathrm\{sg\}\}\(u;s,t\)=\\frac\{\\left\\\|G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\-G\_\{\\theta\}\(u,s\+t\)\\right\\\|\_\{2\}\}\{\\left\\\|G\_\{\\theta\}\(u,s\+t\)\\right\\\|\_\{2\}\+\\varepsilon\}\.\(9\)
The normalization makes the metric comparable across states and times with different magnitudes\. The small constantε\>0\\varepsilon\>0prevents instability when the predicted state norm is close to zero, which can occur in dissipative systems\. A small value ofℰsg\\mathcal\{E\}\_\{\\mathrm\{sg\}\}does not prove physical correctness, but a large value indicates that the learned model violates a necessary composition property of autonomous evolution\.
### 4\.2Diagnostic Protocol
Given a trained simulator, we sample held\-out statesuuand evaluation time pairs\(s,t\)\(s,t\)such thats,t\>0s,t\>0ands\+ts\+tlies within the trajectory horizon\. For each pair, we compute the direct prediction
u^dir=Gθ\(u,s\+t\)\\widehat\{u\}\_\{\\mathrm\{dir\}\}=G\_\{\\theta\}\(u,s\+t\)and the composed prediction
u^comp=Gθ\(Gθ\(u,s\),t\)\.\\widehat\{u\}\_\{\\mathrm\{comp\}\}=G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\.The diagnostic is the normalized discrepancy between these two predictions, averaged over states, time pairs, random seeds, systems, and model classes\.
We evaluate two regimes\. Seen time pairs use increments similar to those used during training\. Unseen time pairs use larger or less common decompositions\. This distinction matters because a model may learn accurate local interpolation without learning a consistent family of time\-indexed maps\. In that case, semigroup error should remain small on familiar increments but increase under unseen temporal decompositions\.
We use semigroup error in two ways\. First, as a post hoc diagnostic, it measures whether a trained simulator is internally consistent\. Second, as an association test, it evaluates whether composition inconsistency is statistically linked to downstream failures such as rollout drift or time\-step extrapolation error\. We therefore compareℰsg\\mathcal\{E\}\_\{\\mathrm\{sg\}\}with one\-step error and long\-horizon rollout error, and report correlations between per\-trajectory semigroup error and rollout degradation\.
### 4\.3Failure Modes
Semigroup error is designed to flag failure modes suggested by the structure of autonomous evolution\. The guiding principle is that if a learned model does not approximately satisfy a necessary composition law, then its repeated use as a simulator is suspect even when its local prediction error is small\.
#### Fixed\-step overfitting\.
A model trained mainly at one time increment can learn a good approximation toSΔtS\_\{\\Delta t\}without learning the full family\{St\}t≥0\\\{S\_\{t\}\\\}\_\{t\\geq 0\}\. Theoretical consistency requiresS2Δt=SΔt∘SΔtS\_\{2\\Delta t\}=S\_\{\\Delta t\}\\circ S\_\{\\Delta t\}, and more generallySs\+t=St∘SsS\_\{s\+t\}=S\_\{t\}\\circ S\_\{s\}\. IfGθ\(u,2Δt\)G\_\{\\theta\}\(u,2\\Delta t\)andGθ\(Gθ\(u,Δt\),Δt\)G\_\{\\theta\}\(G\_\{\\theta\}\(u,\\Delta t\),\\Delta t\)disagree, the model has likely learned time\-step\-specific interpolation rather than a coherent evolution rule\.
#### Rollout drift\.
Autoregressive simulation repeatedly feeds model outputs back into the model\. If direct and composed predictions disagree, then the model’s own predictions move it onto states where later updates follow a different effective dynamics\. This provides a theoretical reason for high semigroup error to be associated with long\-horizon rollout drift\.
#### Excessive damping\.
In dissipative systems, a learned model may reduce short\-horizon error by over\-smoothing high\-frequency content\. Such a model can appear stable, but it may not preserve the correct relationship between short and long time evolution\. Semigroup error can detect this when repeated small\-step damping does not match direct large\-step damping\.
#### Temporal aliasing\.
A time\-conditioned model may encode different effective dynamics at different queried time increments\. ThenGθ\(u,s\+t\)G\_\{\\theta\}\(u,s\+t\)andGθ\(Gθ\(u,s\),t\)G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)behave as if they came from different learned simulators\. This failure is especially likely under unseen time pairs, where the model must extrapolate its representation of elapsed time\.
#### Boundary of the diagnostic\.
These failure predictions are one\-way\. Large semigroup error is evidence of temporal inconsistency, but small semigroup error is not a certificate of correctness\. A model can be compositionally consistent and still solve the wrong equation\. Semigroup error may reveal this mismatch when repeated small\-step smoothing does not agree with direct large\-step smoothing, although energy or spectral diagnostics are needed to identify damping errors\.
## 5Experiments
### 5\.1Research Questions
We evaluate whether semigroup consistency is a useful diagnostic for learned simulators through five questions:
1. 1\.Correlation:Does semigroup error correlate with long\-horizon rollout error across trajectories and model variants?
2. 2\.Time\-composition shift:Does semigroup error increase on larger unseen composition pairs\(s,t\)\(s,t\)?
3. 3\.Regularization:Does semigroup regularization reduce semigroup error relative to prediction\-only training?
4. 4\.Predictive utility:Does reduced semigroup error improve rollout error, or does it mainly improve internal consistency?
5. 5\.Beyond one\-step error:Can models with similar one\-step error differ materially in semigroup and rollout behavior?
### 5\.2Datasets and Splits
We use synthetic trajectories from two one\-dimensional PDE systems with periodic boundary conditions: the heat equation and viscous Burgers equation\. Initial conditions are sampled as random Fourier series with decaying amplitudes\. Trajectories are generated on a uniform spatial grid and saved at uniformly spaced times in\[0,1\]\[0,1\]\.
The experiments use grid sizeNx=128N\_\{x\}=128,2121saved time points, and128/32/64128/32/64train/validation/test trajectories\. The heat equation uses viscosityν=0\.05\\nu=0\.05, while Burgers usesν=0\.02\\nu=0\.02\. Out\-of\-distribution tests include unseen larger composition pairs\(s,t\)\(s,t\), a shifted initial\-condition spectrum, and a Burgers viscosity shift toν=0\.03\\nu=0\.03\. Splits are performed by trajectory to avoid leakage between training and testing time pairs\.
Table 1:Dataset configuration\.
### 5\.3Models
We evaluate two compact neural simulator families\. The first is a time\-conditioned residual ConvNet with one\-dimensional convolutional blocks and sinusoidal time embeddings\. The second is a compact one\-dimensional Fourier Neural Operator \(FNO1D\) with truncated spectral convolutions, residual1×11\\times 1paths, and the same time\-conditioning mechanism\.
For each family, we train a prediction\-only baseline and a semigroup\-regularized variant:
ℒ=ℒpred\+λsgℒsg,λsg=0\.01\.\\mathcal\{L\}=\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\+\\lambda\_\{\\mathrm\{sg\}\}\\mathcal\{L\}\_\{\\mathrm\{sg\}\},\\qquad\\lambda\_\{\\mathrm\{sg\}\}=0\.01\.
Table 2:Model families\.
### 5\.4Metrics
All primary errors use normalized relativeL2L^\{2\}:
relL2\(a,b\)=‖a−b‖2‖b‖2\+ε\.\\mathrm\{relL2\}\(a,b\)=\\frac\{\\\|a\-b\\\|\_\{2\}\}\{\\\|b\\\|\_\{2\}\+\\varepsilon\}\.We report one\-step error, rollout AUC error, final\-time rollout error, seen semigroup error, unseen semigroup error, and Spearman correlation between per\-trajectory semigroup error and rollout AUC\.
The semigroup error is
ℰsg\(u;s,t\)=‖Gθ\(Gθ\(u,s\),t\)−Gθ\(u,s\+t\)‖2‖Gθ\(u,s\+t\)‖2\+ε\.\\mathcal\{E\}\_\{\\mathrm\{sg\}\}\(u;s,t\)=\\frac\{\\\|G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\-G\_\{\\theta\}\(u,s\+t\)\\\|\_\{2\}\}\{\\\|G\_\{\\theta\}\(u,s\+t\)\\\|\_\{2\}\+\\varepsilon\}\.Seen semigroup error averages this quantity over training\-style time pairs\. Unseen semigroup error averages it over larger composition pairs\.
All reported means use bootstrap95%95\\%confidence intervals with20002000resamples\. We also report paired bootstrap intervals for baseline versus semigroup\-regularized differences, paired Wilcoxon signed\-rank tests when available, and Cohen’sddeffect sizes\. The default run uses55random seeds\.
### 5\.5Main Results
Across all held\-out trajectory evaluations, systems, architectures, and training variants, unseen semigroup error is positively associated with rollout AUC error, with global Spearman correlation
ρ=0\.635,95%CI=\[0\.621,0\.649\]\.\\rho=0\.635,\\qquad 95\\%\\ \\mathrm\{CI\}=\[0\.621,0\.649\]\.This supports the central diagnostic claim: larger composition inconsistency is associated with worse long\-horizon rollout behavior\.
Table[3](https://arxiv.org/html/2605.26324#S5.T3)reports in\-distribution means by system, model, and training variant\. One\-step error and rollout error are not in one\-to\-one correspondence\. In particular, FNO1D variants generally achieve lower one\-step error than TC\-Conv variants, but semigroup and rollout behavior still vary across systems and regularization settings\. Semigroup regularization also does not produce a reliable aggregate improvement: the paired baseline\-minus\-SG difference in unseen semigroup error is0\.00170\.0017with CI\[−0\.0123,0\.0156\]\[\-0\.0123,0\.0156\], while the paired difference in rollout AUC is−0\.0633\-0\.0633with CI\[−0\.2408,0\.1171\]\[\-0\.2408,0\.1171\]\. Overall, the results support semigroup error more strongly as a diagnostic than as a universally beneficial regularizer\.
Table 3:In\-distribution quantitative results\. Values are means; SG denotes unseen semigroup error\.5⋅10−25\\cdot 10^\{\-2\}6⋅10−26\\cdot 10^\{\-2\}7⋅10−27\\cdot 10^\{\-2\}8⋅10−28\\cdot 10^\{\-2\}9⋅10−29\\cdot 10^\{\-2\}0\.10\.10\.110\.110\.120\.120\.130\.130\.140\.140\.150\.150\.160\.160\.170\.170\.30\.30\.40\.40\.50\.50\.60\.60\.70\.70\.80\.80\.90\.911ρ=0\.635\\rho=0\.635Unseen semigroup errorRollout AUC errorFNOFNO \+ SGTC\-ConvTC\-Conv \+ SGFigure 2:Relationship between unseen semigroup error and rollout AUC error across systems, architectures, and training variants\. Each point shows a model\-level mean, while the annotatedρ\\rhoreports the global trajectory\-level Spearman correlation computed across all held\-out evaluations\.
### 5\.6Ablations
We study two compact ablations\. First, we compare semigroup error on seen and unseen composition pairs to test whether temporal inconsistency becomes more visible under time\-composition shift\. Averaged across all evaluated settings, unseen semigroup error exceeds seen semigroup error by0\.01650\.0165, indicating that larger unseen compositions expose additional inconsistency\.
Second, we compare prediction\-only and semigroup\-regularized training to test whether directly minimizingℒsg\\mathcal\{L\}\_\{\\mathrm\{sg\}\}improves downstream behavior\. In aggregate, this effect is weak\. The paired baseline\-minus\-SG difference in unseen semigroup error is0\.00170\.0017with95%95\\%CI\[−0\.0123,0\.0156\]\[\-0\.0123,0\.0156\], and the paired baseline\-minus\-SG difference in rollout AUC is−0\.0633\-0\.0633with95%95\\%CI\[−0\.2408,0\.1171\]\[\-0\.2408,0\.1171\]\. Both intervals contain zero, so the regularization effect is not statistically reliable at the aggregate level\.
FNOFNO\+SGTCTC\+SG02⋅10−22\\cdot 10^\{\-2\}4⋅10−24\\cdot 10^\{\-2\}6⋅10−26\\cdot 10^\{\-2\}8⋅10−28\\cdot 10^\{\-2\}0\.10\.10\.120\.120\.140\.140\.160\.160\.180\.18Semigroup errorSeenUnseenFigure 3:Seen and unseen semigroup error averaged across evaluated regimes\. Bars show model\-level means\. Unseen composition pairs generally increase semigroup error, consistent with time\-composition shift\.These ablations distinguish diagnostic value from regularization value\. Semigroup error reveals temporal inconsistency under unseen compositions, but explicitly minimizing the semigroup penalty does not reliably improve rollout behavior in aggregate\.
## 6Discussion
The results support semigroup error primarily as a diagnostic for learned physics simulators\. Across systems, architectures, and variants, higher unseen semigroup error is associated with worse rollout behavior\. This suggests that temporal composition provides information not captured by one\-step prediction error alone\. A model may approximate short\-time targets well while still failing to represent a coherent family of time\-indexed evolution maps\.
The regularization results are more mixed\. Addingℒsg\\mathcal\{L\}\_\{\\mathrm\{sg\}\}does not yield a reliable aggregate improvement in either semigroup error or rollout AUC\. This distinction is important: semigroup consistency can be useful for evaluation even when directly optimizing a simple semigroup penalty is not sufficient to improve learned dynamics\. In this sense, the diagnostic value of semigroup error is better supported here than its use as a universal training objective\.
Semigroup error should also be interpreted as a one\-way warning signal\. Large semigroup error indicates that direct and composed learned evolution disagree, which violates a necessary structural property of autonomous evolution\. Small semigroup error, however, does not imply that the learned model is physically correct\. A model can be internally consistent while solving the wrong equation, using the wrong dissipation rate, or failing under parameter and boundary shifts\. Semigroup consistency is therefore best reported alongside one\-step error, rollout error, and physics\-specific diagnostics\.
## 7Limitations
This study uses compact one\-dimensional heat and Burgers systems\. These settings isolate temporal composition cleanly, but they do not establish that the same diagnostic behaves identically for high\-dimensional fluids, turbulent flows, complex geometries, or multi\-physics simulators\. Extending the evaluation to larger PDE benchmarks is an important next step\.
The diagnostic is most appropriate for autonomous, state\-complete systems\. If the dynamics are non\-autonomous, controlled, stochastic, history\-dependent, or driven by changing boundary conditions, the one\-parameter semigroup law is not the right object without modification\. In those cases, the diagnostic should be replaced by an evolution\-family or cocycle consistency condition\.
Semigroup consistency is not a certificate of correctness\. It measures internal temporal coherence of the learned map, not agreement with the true physical dynamics\. The normalization inℰsg\\mathcal\{E\}\_\{\\mathrm\{sg\}\}can also become delicate for strongly dissipative systems when state norms are small\. Finally, for chaotic systems, state\-space rollout error may become less meaningful at long horizons, and semigroup diagnostics should be paired with statistical or distributional measures of physical behavior\.
## 8Conclusion
We proposed semigroup consistency as a post hoc diagnostic for learned physics simulators\. The diagnostic compares direct learned evolution overs\+ts\+twith composed learned evolution overssfollowed bytt, producing a normalized semigroup error that can be evaluated without additional ground\-truth solves\. Across heat and Burgers experiments, semigroup error is positively associated with rollout degradation, supporting its use as a structural warning signal beyond one\-step prediction error\. Semigroup regularization has mixed effects and does not produce a reliable aggregate rollout improvement, so the evidence supports semigroup consistency more strongly as an evaluation diagnostic than as a universal training objective\. Future work should test this diagnostic on higher\-dimensional PDEs, more realistic physics simulators, and richer composition\-aware training methods\.
## Impact Statement
This work aims to improve reliability evaluation for learned physics simulators by identifying temporal inconsistency that may be missed by one\-step prediction error\. Semigroup error is a lightweight diagnostic, not a certification method: a model can compose consistently while still being physically wrong\. In high\-stakes scientific or engineering settings, it should be used alongside numerical benchmarks, uncertainty quantification, physical diagnostics, and expert review\.
## Acknowledgements
#### Reproducibility\.
#### Computational Resources\.
The author gratefully acknowledges Dell Technologies, and in particular the Dell Pro Max workstation team, for providing computational resources that supported the experiments in this work\. Experiments were conducted on a Dell Pro Max T2 workstation equipped with an Intel Core Ultra 9 285K processor, 128 GB of DDR5 ECC memory, and an NVIDIA RTX PRO 6000 Blackwell GPU\. The views and conclusions expressed herein are those of the author and do not necessarily reflect the views of Dell Technologies\.
## References
- \[1\]K\. Azizzadenesheli, N\. Kovachki, Z\. Li, B\. Liu, K\. Bhattacharya, A\. Stuart, and A\. Anandkumar\(2024\)Neural operators for accelerating scientific simulations and design\.Nature Reviews Physics6,pp\. 320–328\.External Links:[Document](https://dx.doi.org/10.1038/s42254-024-00712-5)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p2.1)\.
- \[2\]S\. L\. Brunton, B\. R\. Noack, and P\. Koumoutsakos\(2020\-01\)Machine learning for fluid mechanics\.Annual Review of Fluid Mechanics52\(1\),pp\. 477–508\.External Links:ISSN 1545\-4479,[Link](http://dx.doi.org/10.1146/annurev-fluid-010719-060214),[Document](https://dx.doi.org/10.1146/annurev-fluid-010719-060214)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p5.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[3\]J\. Chen and K\. Wu\(2023\)Deep\-osg: deep learning of operators in semigroup\.Journal of Computational Physics493,pp\. 112498\.External Links:ISSN 0021\-9991,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.jcp.2023.112498),[Link](https://www.sciencedirect.com/science/article/pii/S0021999123005934)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[4\]R\. T\. Q\. Chen, Y\. Rubanova, J\. Bettencourt, and D\. Duvenaud\(2018\)Neural ordinary differential equations\.InAdvances in Neural Information Processing Systems,Vol\.31\.Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1)\.
- \[5\]L\. C\. Evans\(2010\)Partial differential equations\.2 edition,American Mathematical Society\.Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.1),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p1.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p1.7)\.
- \[6\]G\. E\. Karniadakis, I\. G\. Kevrekidis, L\. Lu, P\. Perdikaris, S\. Wang, and L\. Yang\(2021\)Physics\-informed machine learning\.Nature Reviews Physics3,pp\. 422–440\.External Links:[Document](https://dx.doi.org/10.1038/s42254-021-00314-5)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[7\]D\. Kochkov, J\. A\. Smith, A\. Alieva, Q\. Wang, M\. P\. Brenner, and S\. Hoyer\(2021\)Machine learning–accelerated computational fluid dynamics\.Proceedings of the National Academy of Sciences118\(21\),pp\. e2101784118\.External Links:[Document](https://dx.doi.org/10.1073/pnas.2101784118),[Link](https://www.pnas.org/doi/abs/10.1073/pnas.2101784118),https://www\.pnas\.org/doi/pdf/10\.1073/pnas\.2101784118Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[8\]F\. Koehler, S\. Niedermayr, R\. Westermann, and N\. Thuerey\(2024\)APEBench: a benchmark for autoregressive neural emulators of pdes\.External Links:2411\.00180,[Link](https://arxiv.org/abs/2411.00180)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p2.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p2.1)\.
- \[9\]N\. Kovachki, Z\. Li, B\. Liu, K\. Azizzadenesheli, K\. Bhattacharya, A\. Stuart, and A\. Anandkumar\(2023\)Neural operator: learning maps between function spaces with applications to pdes\.Journal of Machine Learning Research24\(89\),pp\. 1–97\.External Links:[Link](http://jmlr.org/papers/v24/21-1524.html)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p2.1)\.
- \[10\]A\. S\. Krishnapriyan, A\. Gholami, S\. Zhe, R\. M\. Kirby, and M\. W\. Mahoney\(2021\)Characterizing possible failure modes in physics\-informed neural networks\.Advances in Neural Information Processing Systems \(NeurIPS\)34\.External Links:[Link](https://arxiv.org/abs/2109.01050),[Document](https://dx.doi.org/10.48550/arXiv.2109.01050)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p2.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p2.1)\.
- \[11\]T\. Kurth, S\. Subramanian, P\. Harrington, J\. Pathak, M\. Mardani, D\. Hall, A\. Miele, K\. Kashinath, and A\. Anandkumar\(2023\)FourCastNet: accelerating global high\-resolution weather forecasting using adaptive fourier neural operators\.InProceedings of the Platform for Advanced Scientific Computing Conference,PASC ’23,New York, NY, USA\.External Links:ISBN 9798400701900,[Link](https://doi.org/10.1145/3592979.3593412),[Document](https://dx.doi.org/10.1145/3592979.3593412)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p5.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[12\]J\. N\. Kutz, J\. L\. Proctor, and S\. L\. Brunton\(2016\)Koopman theory for partial differential equations\.External Links:1607\.07076,[Link](https://arxiv.org/abs/1607.07076)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1)\.
- \[13\]Z\. Li, K\. Meidani, and A\. B\. Farimani\(2023\)Transformer for partial differential equations’ operator learning\.Transactions on Machine Learning Research\.Note:External Links:ISSN 2835\-8856,[Link](https://openreview.net/forum?id=EPPqt3uERT)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[14\]Z\. Li, N\. Kovachki, K\. Azizzadenesheli, B\. Liu, K\. Bhattacharya, A\. Stuart, and A\. Anandkumar\(2020\)Multipole graph neural operator for parametric partial differential equations\.External Links:2006\.09535,[Link](https://arxiv.org/abs/2006.09535)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[15\]Z\. Li, N\. Kovachki, K\. Azizzadenesheli, B\. Liu, K\. Bhattacharya, A\. Stuart, and A\. Anandkumar\(2020\)Neural operator: graph kernel network for partial differential equations\.External Links:2003\.03485,[Link](https://arxiv.org/abs/2003.03485)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[16\]Z\. Li, N\. B\. Kovachki, K\. Azizzadenesheli, B\. liu, K\. Bhattacharya, A\. Stuart, and A\. Anandkumar\(2021\)Fourier neural operator for parametric partial differential equations\.InInternational Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=c8P9NQVtmnO)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[17\]Z\. Li, M\. Liu\-Schiaffini, N\. Kovachki, B\. Liu, K\. Azizzadenesheli, K\. Bhattacharya, A\. Stuart, and A\. Anandkumar\(2022\)Learning dissipative dynamics in chaotic systems\.External Links:2106\.06898,[Link](https://arxiv.org/abs/2106.06898)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p2.1)\.
- \[18\]Z\. Li, H\. Zheng, N\. Kovachki, D\. Jin, H\. Chen, B\. Liu, K\. Azizzadenesheli, and A\. Anandkumar\(2023\)Physics\-informed neural operator for learning partial differential equations\.External Links:2111\.03794,[Link](https://arxiv.org/abs/2111.03794)Cited by:[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[19\]Z\. Li, H\. Zheng, N\. Kovachki, D\. Jin, H\. Chen, B\. Liu, K\. Azizzadenesheli, and A\. Anandkumar\(2023\)Physics\-informed neural operator for learning partial differential equations\.External Links:2111\.03794,[Link](https://arxiv.org/abs/2111.03794)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[20\]L\. Lu, P\. Jin, G\. Pang, Z\. Zhang, and G\. E\. Karniadakis\(2021\)Learning nonlinear operators via deeponet based on the universal approximation theorem of operators\.Nature Machine Intelligence3\(3\),pp\. 218–229\.External Links:[Document](https://dx.doi.org/10.1038/s42256-021-00302-5),[Link](https://doi.org/10.1038/s42256-021-00302-5)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[21\]A\. Mardt, L\. Pasquali, H\. Wu, and F\. Noé\(2018\)VAMPnets for deep learning of molecular kinetics\.Nature Communications9\(1\),pp\. 5\.External Links:[Document](https://dx.doi.org/10.1038/s41467-017-02388-1)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1)\.
- \[22\]S\. Mousavi, S\. Mishra, and L\. D\. Lorenzis\(2026\)Imposing boundary conditions on neural operators via learned function extensions\.External Links:2602\.04923,[Link](https://arxiv.org/abs/2602.04923)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p4.3),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
- \[23\]B\. D\. Nguyen and S\. Sandfeld\(2026\)Out\-of\-distribution generalization of deep\-learning surrogates for 2d pde\-generated dynamics in the small\-data regime\.External Links:2601\.08404,[Link](https://arxiv.org/abs/2601.08404)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p2.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
- \[24\]R\. Ohana, M\. McCabe, L\. Meyer, R\. Morel, F\. J\. Agocs, M\. Beneitez, M\. Berger, B\. Burkhart, K\. Burns, S\. B\. Dalziel, D\. B\. Fielding, D\. Fortunato, J\. A\. Goldberg, K\. Hirashima, Y\. Jiang, R\. R\. Kerswell, S\. Maddu, J\. Miller, P\. Mukhopadhyay, S\. S\. Nixon, J\. Shen, R\. Watteaux, B\. R\. Blancard, F\. Rozet, L\. H\. Parker, M\. Cranmer, and S\. Ho\(2025\)The well: a large\-scale collection of diverse physics simulations for machine learning\.External Links:2412\.00568,[Link](https://arxiv.org/abs/2412.00568)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p2.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
- \[25\]A\. Pazy\(2012\)Semigroups of linear operators and applications to partial differential equations\.Applied Mathematical Sciences,Springer New York\.External Links:LCCN 83010637,[Link](https://books.google.com/books?id=DQvpBwAAQBAJ)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.1),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p1.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p1.7)\.
- \[26\]T\. Qin, K\. Wu, and D\. Xiu\(2019\)Data driven governing equations approximation using deep neural networks\.Journal of Computational Physics395,pp\. 620–635\.External Links:ISSN 0021\-9991,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.jcp.2019.06.042),[Link](https://www.sciencedirect.com/science/article/pii/S0021999119304504)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[27\]M\. Raissi, P\. Perdikaris, and G\.E\. Karniadakis\(2019\)Physics\-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations\.Journal of Computational Physics378,pp\. 686–707\.External Links:ISSN 0021\-9991,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.jcp.2018.10.045),[Link](https://www.sciencedirect.com/science/article/pii/S0021999118307125)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[28\]M\. Raissi, A\. Yazdani, and G\. E\. Karniadakis\(2020\)Hidden fluid mechanics: learning velocity and pressure fields from flow visualizations\.Science367\(6481\),pp\. 1026–1030\.External Links:[Document](https://dx.doi.org/10.1126/science.aaw4741)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p5.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[29\]B\. Raonic, R\. Molinaro, T\. D\. Ryck, T\. Rohner, F\. Bartolucci, R\. Alaifari, S\. Mishra, and E\. de Bezenac\(2023\)Convolutional neural operators for robust and accurate learning of PDEs\.InThirty\-seventh Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=MtekhXRP4h)Cited by:[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[30\]P\. Setinek, G\. Galletti, T\. Gross, D\. Schnürer, J\. Brandstetter, and W\. Zellinger\(2025\)SIMSHIFT: a benchmark for adapting neural surrogates to distribution shifts\.External Links:[Link](https://openreview.net/forum?id=Eo4cRmb1yn)Cited by:[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
- \[31\]B\. Shih, A\. Peyvan, Z\. Zhang, and G\. E\. Karniadakis\(2025\)Transformers as neural operators for solutions of differential equations with finite regularity\.Computer Methods in Applied Mechanics and Engineering434,pp\. 117560\.External Links:ISSN 0045\-7825,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.cma.2024.117560),[Link](https://www.sciencedirect.com/science/article/pii/S0045782524008144)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p1.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p1.1)\.
- \[32\]L\. Shikhman\(2026\)Diagnosing failure modes of neural operators across diverse PDE families\.Transactions on Machine Learning Research\.Note:External Links:ISSN 2835\-8856,[Link](https://openreview.net/forum?id=0S1LWZHQYn)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p2.1)\.
- \[33\]L\. Shikhman\(2026\)One operator to rule them all? on boundary\-indexed operator families in neural PDE solvers\.InAI&PDE: ICLR 2026 Workshop on AI and Partial Differential Equations,External Links:[Link](https://openreview.net/forum?id=lDjWQ9UxRy)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p4.3)\.
- \[34\]K\. Stachenfeld, D\. B\. Fielding, D\. Kochkov, M\. Cranmer, T\. Pfaff, J\. Godwin, C\. Cui, S\. Ho, P\. Battaglia, and A\. Sanchez\-Gonzalez\(2022\)Learned simulators for turbulence\.InInternational Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=msRBojTz-Nh)Cited by:[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[35\]M\. Takamoto, T\. Praditia, R\. Leiteritz, D\. MacKinlay, F\. Alesiani, D\. Pflüger, and M\. Niepert\(2022\)PDEBench: an extensive benchmark for scientific machine learning\.InThirty\-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track,External Links:[Link](https://openreview.net/forum?id=dh_MkX0QfrK)Cited by:[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
- \[36\]Z\. Wei, C\. C\. Ooi, J\. C\. Wong, A\. Gupta, P\. Chiu, and Y\. Ong\(2026\)Out\-of\-distribution generalization for neural physics solvers\.External Links:2601\.19091,[Link](https://arxiv.org/abs/2601.19091)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p2.1),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
- \[37\]K\. Wu and D\. Xiu\(2020\)Data\-driven deep learning of partial differential equations in modal space\.Journal of Computational Physics408,pp\. 109307\.External Links:ISSN 0021\-9991,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.jcp.2020.109307),[Link](https://www.sciencedirect.com/science/article/pii/S0021999120300814)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p3.4),[§2\.1](https://arxiv.org/html/2605.26324#S2.SS1.p2.1),[§2\.2](https://arxiv.org/html/2605.26324#S2.SS2.p2.4)\.
- \[38\]K\. Zhou, Z\. Liu, Y\. Qiao, T\. Xiang, and C\. C\. Loy\(2022\)Domain generalization: a survey\.IEEE Transactions on Pattern Analysis and Machine Intelligence,pp\. 1–20\.External Links:ISSN 1939\-3539,[Link](http://dx.doi.org/10.1109/TPAMI.2022.3195549),[Document](https://dx.doi.org/10.1109/tpami.2022.3195549)Cited by:[§1](https://arxiv.org/html/2605.26324#S1.p4.3),[§2\.3](https://arxiv.org/html/2605.26324#S2.SS3.p1.1)\.
## Appendix ANumerical Solvers
All reference trajectories are generated before training using deterministic numerical solvers\. The experiments use two one\-dimensional systems: the heat equation and the viscous Burgers equation, both with periodic boundary conditions\. Periodic domains simplify the solver implementation and avoid boundary\-condition ambiguity, which is useful because the present work studies temporal composition rather than boundary generalization\.
Initial conditions are sampled as random Fourier series with controlled smoothness\. For the heat equation, trajectories are generated with viscosityν=0\.05\\nu=0\.05\. For viscous Burgers dynamics, trajectories are generated with viscosityν=0\.02\\nu=0\.02, with an additional shifted\-viscosity test regime usingν=0\.03\\nu=0\.03\. The solvers use periodic finite\-difference derivatives and a sufficiently small internal time step relative to the saved trajectory spacing\. The implementation checks that generated trajectories remain finite and contain no NaNs or infinities\.
In the main experiments, saved trajectories have shape
whereNNis the number of trajectories,TTis the number of saved times, andXXis the spatial grid size\. We useX=128X=128,T=21T=21, and128/32/64128/32/64train/validation/test trajectories\. Datasets are split by initial condition rather than by sampled time pairs, preventing leakage between training and testing trajectories\. Shifted test regimes include unseen time\-pair compositions, shifted Burgers viscosity, and shifted initial\-condition spectra\.
## Appendix BModel Details
The experiments use compact one\-dimensional learned simulators of the form
Gθ\(u,Δt\)≈SΔtu\.G\_\{\\theta\}\(u,\\Delta t\)\\approx S\_\{\\Delta t\}u\.The two model families are a time\-conditioned convolutional residual network and a compact one\-dimensional Fourier Neural Operator \(FNO\)\. Both models receive the current stateuuand a normalized time incrementΔt/T\\Delta t/T\. Time conditioning is implemented using sinusoidal time embeddings injected into the model layers\.
The convolutional baseline consists of one\-dimensional convolutional residual blocks\. The FNO baseline uses spectral convolution layers with a fixed number of retained Fourier modes, followed by pointwise channel mixing\. Both architectures use residual prediction, returning the input state plus a learned update\.
For each model family, we train two variants\. The baseline minimizes only the supervised prediction loss,
ℒpred\(θ\)=𝔼\(u,t\)\[‖Gθ\(u,t\)−Stu‖22\]\.\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\(\\theta\)=\\mathbb\{E\}\_\{\(u,t\)\}\\left\[\\\|G\_\{\\theta\}\(u,t\)\-S\_\{t\}u\\\|\_\{2\}^\{2\}\\right\]\.The semigroup\-regularized variant minimizes
ℒ\(θ\)=ℒpred\(θ\)\+λsgℒsg\(θ\),\\mathcal\{L\}\(\\theta\)=\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\(\\theta\)\+\\lambda\_\{\\mathrm\{sg\}\}\\mathcal\{L\}\_\{\\mathrm\{sg\}\}\(\\theta\),where
ℒsg\(θ\)=𝔼\(u,s,t\)\[‖Gθ\(Gθ\(u,s\),t\)−Gθ\(u,s\+t\)‖22\]\.\\mathcal\{L\}\_\{\\mathrm\{sg\}\}\(\\theta\)=\\mathbb\{E\}\_\{\(u,s,t\)\}\\left\[\\\|G\_\{\\theta\}\(G\_\{\\theta\}\(u,s\),t\)\-G\_\{\\theta\}\(u,s\+t\)\\\|\_\{2\}^\{2\}\\right\]\.The main experiments useλsg=0\.01\\lambda\_\{\\mathrm\{sg\}\}=0\.01\.
All models are trained with AdamW, gradient clipping, and deterministic random seeds where possible\. The reported experiments use five seeds and bootstrap95%95\\%confidence intervals with20002000resamples\. The implementation automatically uses CUDA when available and otherwise falls back to CPU\.
## Appendix CNon\-Autonomous Extensions
The semigroup identity used in the main paper applies most directly to autonomous, state\-complete systems\. Autonomy means that the evolution rule does not depend explicitly on absolute time\. State\-completeness means that the current state contains the information needed to determine future evolution\. Many physical systems are instead non\-autonomous or not state\-complete: the dynamics may depend explicitly on time, external controls, changing boundary conditions, moving geometry, stochastic forcing, or history\-dependent material response\. In these cases, the one\-parameter semigroup law
St\+s=St∘SsS\_\{t\+s\}=S\_\{t\}\\circ S\_\{s\}is generally not the correct structure\.
For non\-autonomous dynamics, the appropriate object is an evolution family\. LetS\(t,r\)S\(t,r\)denote the map that evolves a state from timerrto timett\. The composition law becomes
S\(t,r\)=S\(t,s\)∘S\(s,r\),r≤s≤t\.S\(t,r\)=S\(t,s\)\\circ S\(s,r\),\\qquad r\\leq s\\leq t\.A learned non\-autonomous simulator should therefore be written as
Gθ\(u,r,t\)≈S\(t,r\)u,G\_\{\\theta\}\(u,r,t\)\\approx S\(t,r\)u,or, when controls or forcing are present,
Gθ\(u,r,t,c\[r,t\]\)≈Sc\(t,r\)u,G\_\{\\theta\}\(u,r,t,c\_\{\[r,t\]\}\)\\approx S\_\{c\}\(t,r\)u,wherec\[r,t\]c\_\{\[r,t\]\}denotes the control, forcing, or boundary information over the interval\.
The corresponding diagnostic compares direct and composed evolution:
ℰevol\(u;r,s,t\)=‖Gθ\(Gθ\(u,r,s\),s,t\)−Gθ\(u,r,t\)‖2‖Gθ\(u,r,t\)‖2\+ε\.\\mathcal\{E\}\_\{\\mathrm\{evol\}\}\(u;r,s,t\)=\\frac\{\\\|G\_\{\\theta\}\(G\_\{\\theta\}\(u,r,s\),s,t\)\-G\_\{\\theta\}\(u,r,t\)\\\|\_\{2\}\}\{\\\|G\_\{\\theta\}\(u,r,t\)\\\|\_\{2\}\+\\varepsilon\}\.This reduces to the semigroup diagnostic in the autonomous case whenS\(t,r\)=St−rS\(t,r\)=S\_\{t\-r\}\. For controlled or externally forced systems, the diagnostic must also ensure that both direct and composed predictions condition on consistent forcing information over the same interval\. Otherwise, disagreement may reflect mismatched inputs rather than failure of the learned dynamics\.
Thus, semigroup consistency should not be applied blindly to every simulator\. It is best viewed as the autonomous case of a broader composition\-consistency principle: a learned simulator should agree with itself when the same physical evolution is represented either as one interval or as a composition of subintervals\.Similar Articles
Onnes: A Physics-Grounded Multi-Agent LLM Simulator for Cryogenic Fault Diagnosis in Quantum Computing Infrastructure
Presents Onnes, a physics-grounded multi-agent LLM simulator for cryogenic fault diagnosis in quantum computing infrastructure. With curated few-shot demonstrations and self-consistency voting, a zero-shot LLM agent panel achieves 0.990 fault-classification accuracy, matching a supervised classifier without parameter updates.
Physics-guided Convolutional Neural Network for Domain Growth Prediction in Systems with Conserved Kinetics
Proposes an attention-based, physics-guided convolutional neural network as a surrogate model to predict microstructural evolution in systems governed by the Cahn-Hilliard equation, demonstrating stable and accurate long-time predictions.
Conformal Prediction for Neural Operators: Distribution-Free Uncertainty Quantification in Physics Simulation
Proposes the first application of split conformal prediction to neural operator-based physics simulation, providing distribution-free prediction intervals with finite-sample coverage guarantees and adaptive-width intervals using MC Dropout uncertainty.
Testing Frontier Large Language Models' Physics Literacy in Parallel Physical Worlds
This paper introduces a four-stage diagnostic to test whether LLMs can reason in unfamiliar physics frameworks, finding that frontier models achieve low pass rates and exhibit a qualitative-versus-quantitative asymmetry.
Sequential Physics-Constrained Neural Operator Forward Modeling for the $\textit{Norne}$ Reservoir System
This paper presents a comprehensive mathematical framework for sequential surrogate modeling of three-phase black-oil reservoir dynamics using Fourier Neural Operators (FNO) and physics-informed variants (PINO), applied to the Norne benchmark reservoir. Theoretical contributions include functional-analytic formulation, covariate shift analysis, physics-constrained spectral stability, and truncated backpropagation gradient analysis.