Amortizing Physics-Informed Neural Solvers via Graph Hypernetworks

arXiv cs.LG Papers

Summary

This paper proposes using graph hypernetworks to explicitly represent relationships in PDEs for amortizing physics-informed neural networks, showing improved accuracy in solving coupled systems.

arXiv:2609.19915v1 Announce Type: new Abstract: Amortizing physics-informed neural networks (PINNs) across related PDEs requires describing each equation to a reusable solver. Coefficient vectors encode numerical parameters in predefined slots, leaving operator and cross-field assignments implicit. We make these relationships explicit in an operator graph, with nodes for fields, derivatives, terms, and residuals and coefficients retained as term attributes. A graph hypernetwork generates diagonal codes that initialize a meta-trained factorized PINN for each target equation. Meta-training and target-specific adaptation use governing equations and prescribed conditions without solution labels. We compare coefficient-vector, DeepSets-based term-set, and graph conditioning by solution accuracy within a fixed adaptation budget. In scalar convection-diffusion-reaction problems, both term-based descriptors improve high-reaction accuracy, with similar performance. In two-field Fisher-KPP, meta-training sees uncoupled and one-way systems; after 3,000 adaptation steps on unseen two-way coupling, the graph's mean final error is 35.7% below the term set and 67.7% below the coefficient vector. In a fixed-structure capacitively coupled plasma model, the coefficient vector performs best. These results support extending coefficient conditioning with explicit equation relationships for physics-based solver adaptation.
Original Article
View Cached Full Text

Cached at: 09/18/26, 09:12 AM

# Amortizing Physics-Informed Neural Solversvia Graph Hypernetworks
Source: [https://arxiv.org/html/2609.19915](https://arxiv.org/html/2609.19915)
Cheng Jing††thanks:Work done during internship at Applied Materials Inc\.Abhishek VermaAffiliation:Applied Materials Inc\.Email:[AbhishekKumar\_Verma@amat\.com](mailto:)Kallol BeraAffiliation:Applied Materials Inc\.Email:[Kallol\_Bera@amat\.com](mailto:)Yixuan HeAffiliation:Arizona State UniversityEmail:[Yixuan\.He@asu\.edu](mailto:)Kookjin Lee††thanks:Corresponding author\.Affiliation:Arizona State UniversityEmail:[Kookjin\.Lee@asu\.edu](mailto:)

###### Abstract

Amortizing physics\-informed neural networks \(PINNs\) across related PDEs requires describing each equation to a reusable solver\. Coefficient vectors encode numerical parameters in predefined slots, leaving operator and cross\-field assignments implicit\. We make these relationships explicit in an operator graph, with nodes for fields, derivatives, terms, and residuals and coefficients retained as term attributes\. A graph hypernetwork generates diagonal codes that initialize a meta\-trained factorized PINN for each target equation\. Meta\-training and target\-specific adaptation use governing equations and prescribed conditions without solution labels\. We compare coefficient\-vector, DeepSets\-based term\-set, and graph conditioning by solution accuracy within a fixed adaptation budget\. In scalar convection–diffusion–reaction problems, both term\-based descriptors improve high\-reaction accuracy, with similar performance\. In two\-field Fisher–KPP, meta\-training sees uncoupled and one\-way systems; after 3,000 adaptation steps on unseen two\-way coupling, the graph’s mean final error is35\.7%35\.7\\%below the term set and67\.7%67\.7\\%below the coefficient vector\. In a fixed\-structure capacitively coupled plasma model, the coefficient vector performs best\. These results support extending coefficient conditioning with explicit equation relationships for physics\-based solver adaptation\.

## 1Introduction

Scientific modeling often requires solving a family of related partial differential equations \(PDEs\) rather than a single equation\. Physics\-informed neural networks \(PINNs\) construct solutions by optimizing the governing residuals and prescribed conditions\([Raissi et al\., 2019](https://arxiv.org/html/2609.19915#bib.bib1)\), but repeating this optimization for every instance can be costly\. Hypernetwork\-based amortization shares information across instances by predicting equation\-specific solver configurations that can be further adapted using physics residuals\([de Avila Belbute\-Peres et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib2);[Cho et al\., 2023](https://arxiv.org/html/2609.19915#bib.bib3)\)\. This raises a representation question:*what information about an equation should the hypernetwork receive?*

Coefficient\-conditioned hypernetworks describe each instance through numerical parameters in a predefined equation layout\. Such layouts can cover different term combinations and coupling directions by reserving equation\-specific slots for candidate terms\. Our focus is how these relationships are presented to the hypernetwork: implicitly through slot conventions or explicitly through connections\. Coupled PDEs make this distinction concrete\. The strength of an interaction and the variables it connects are both part of the equation’s meaning: a sourceκ​v\\kappa vin the equation foruuand a sourceκ​u\\kappa uin the equation forvvdescribe opposite coupling directions, even whenκ\\kappais unchanged\. This motivates supplying the hypernetwork with differential operators and cross\-field relationships alongside their numerical coefficients\.

We represent this information as an*operator graph*: fields, derivatives, additive terms, and equation residuals are nodes, and their connections specify how the PDE is assembled\. Coefficients remain attributes of the terms, while connectivity makes operator composition and coupling explicit\. A graph hypernetwork reads this representation and predicts per\-layer configuration codes for a shared factorized PINN backbone\([Cho et al\., 2023](https://arxiv.org/html/2609.19915#bib.bib3)\)\. The predicted codes and meta\-trained backbone form an equation\-conditioned initialization\. The target solver is then adapted by minimizing its physics residual and enforcing its prescribed conditions\. This combines coefficients and connectivity within a shared operator vocabulary; both training phases use physics objectives without solution labels\.

We evaluate this approach on three PDE families, each with one spatial dimension and its own trained model\. Cross\-structure convection–diffusion–reaction \(cdr\) tests combinations of familiar terms, including a high\-reaction regime with a documented PINN optimization failure mode\([Krishnapriyan et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib4)\)\. Our two\-field Fisher–KPP variant builds on linearly coupled reaction–diffusion systems\([Holzer, 2016](https://arxiv.org/html/2609.19915#bib.bib5)\)and tests generalization from uncoupled and one\-way\-coupled systems to previously unseen two\-way coupling\. A simplified capacitively coupled plasma \(CCP\) model\([Jing et al\., 2026a](https://arxiv.org/html/2609.19915#bib.bib6)\)tests application to a continuity–Poisson system whose coupling structure stays fixed while its coefficients vary\. Comparisons with coefficient\-vector and DeepSets\-based term\-set baselines\([Zaheer et al\., 2017](https://arxiv.org/html/2609.19915#bib.bib7)\)show benefits from term\-based conditioning in the high\-reactioncdrregime and lower graph\-model error on unseen Fisher–KPP coupling\. The coefficient vector performs best in fixed\-structure CCP\. This contrast is consistent with the hypothesis that the value of relational conditioning depends on what varies within the equation family, rather than on coupling alone\.

Our contributions are:

- •Operator\-graph conditioning for amortized PINNs \(§[3](https://arxiv.org/html/2609.19915#S3)\)\.A graph hypernetwork configures a shared neural solver from a representation that combines numerical coefficients, differential operators, and cross\-field relationships\.
- •Evidence across term and coupling variation \(§[5](https://arxiv.org/html/2609.19915#S5)\)\.Under fixed target\-adaptation budgets, term\-based conditioning improves high\-reactioncdraccuracy, and graph conditioning gives the lowest mean error on unseen Fisher–KPP coupling composition\. A fixed\-structure continuity–Poisson comparison identifies a setting where coefficient conditioning performs best\.

## 2Background

We review the PINN solver, its factorized backbone, and the hypernetwork and message passing used to configure it\.

##### Physics\-informed neural networks\.

Letu⁡\(x,t\)u\(x,t\)denote a PDE solution anduθ​\(x,t\)u\_\{\\theta\}\(x,t\)its neural approximation, with solver parametersθ\\theta\. For a coupled system,uucollects the fieldsufu\_\{f\}andℛ\\mathcal\{R\}collects their equation residuals; parameter subscripts are suppressed in architectural formulas\. Givenℛ⁡\[u\]=0\\mathcal\{R\}\[u\]=0, physics\-informed training minimizes1\|X\|​∑\(x,t\)∈X‖ℛ⁡\[uθ\]​\(x,t\)‖22\\tfrac\{1\}\{\|X\|\}\\sum\_\{\(x,t\)\\in X\}\\\|\\mathcal\{R\}\[u\_\{\\theta\}\]\(x,t\)\\\|\_\{2\}^\{2\}over space–time collocation pointsXX, together with initial and boundary conditions\([Raissi et al\., 2019](https://arxiv.org/html/2609.19915#bib.bib1)\)\. These conditions are imposed either through loss penalties or directly in the network output\. Derivatives are computed by automatic differentiation\. Repeated optimization across PDE instances motivates amortization, especially when the physics loss is difficult to optimize\([Krishnapriyan et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib4)\)\.

##### Factorized PINN backbone\.

We adopt the layer parameterization of[Cho et al\. \(2023\)](https://arxiv.org/html/2609.19915#bib.bib3)for each field\. For fieldffand hidden layerℓ\\ell, the configured weight isWfℓ=Cℓ​diag​\(sfℓ\)​RℓW\_\{f\}^\{\\ell\}=C^\{\\ell\}\\,\\mathrm\{diag\}\(s\_\{f\}^\{\\ell\}\)\\,R^\{\\ell\}, whereCℓ,Rℓ∈ℝw×wC^\{\\ell\},R^\{\\ell\}\\in\\mathbb\{R\}^\{w\\times w\}are shared learned bases andwwis the hidden width\. The codesfℓ∈ℝws\_\{f\}^\{\\ell\}\\in\\mathbb\{R\}^\{w\}specifies the effective diagonal for that instance and field\. With these full\-width bases, the hypernetwork configures each layer throughwwdiagonal entries rather than predicting allw2w^\{2\}matrix entries\. The shared bases are learned across the PDE family; the codes are instance\-specific\.

##### Hypernetworks\.

A hypernetworkHHpredicts parameters of another neural network\([Ha et al\., 2017](https://arxiv.org/html/2609.19915#bib.bib8)\)\. In Hyper\-LR\-PINN, PDE coefficients condition the diagonal codes of a factorized solver\([Cho et al\., 2023](https://arxiv.org/html/2609.19915#bib.bib3)\)\. We retain this code interface,s=H⁡\(d\)s=H\(d\)withs=\{sfℓ\}s=\\\{s\_\{f\}^\{\\ell\}\\\}, and compare a coefficient vector, a set of terms, and an operator graph as the descriptordd\. The predicted codes configure the shared PINN, providing an initial approximation that is subsequently adapted using the physics objective\. This shares the cost of learning useful solver configurations across instances; the training and deployment phases are described in §[3](https://arxiv.org/html/2609.19915#S3)\.

##### Message passing\.

On a graphG=\(V,E\)G=\(V,E\), nodei∈Vi\\in Vhas a hidden statehikh\_\{i\}^\{k\}at roundkk\. A message\-passing update combines that state with its neighbors’ states using shared learned functions\([Gilmer et al\., 2017](https://arxiv.org/html/2609.19915#bib.bib9)\)\. AfterKKrounds, information can propagate across aKK\-hop neighborhood\. A readout pools node states into a graph\-level or field\-specific representation\. Section[3](https://arxiv.org/html/2609.19915#S3)specifies how this representation configures the PINN\.

## 3Method

We learn an equation\-conditioned initialization for physics\-based adaptation\. A hypernetwork reads the PDE’s operator graph and predicts diagonal codes; these codes and the meta\-trained backbone initialize the target PINN\. We then optimize its codes and backbone using the target physics objective\. The prediction before adaptation is the*initial approximation*\. We describe the graph, configured solver, and optimization phases below\.

### 3\.1Operator graph

For conditioning, we express each governing residual as additive terms, each represented by a scalar coefficient and its field or derivative factors\. These terms define the operator graphG=\(V,E\)G=\(V,E\)\. The physics loss evaluates the same governing equations by automatic differentiation; graph construction and loss evaluation may use algebraically equivalent residual forms \(App\.[A](https://arxiv.org/html/2609.19915#A1)\)\. The graph has four node kinds: fields, derivatives, terms, and equation residuals\. Connections link a field to its derivatives, each factor to the terms containing it, and each term to its target residual \(App\.[A](https://arxiv.org/html/2609.19915#A1)\)\.

Node featuresziz\_\{i\}record the node kind and its attributes: field identity and derivative orders where applicable, and coefficient sign, log\-magnitude, and arity \(number of factors\) for each nonzero term\. For example,−κ​v\-\\kappa vin the equation foruugives the pathv→\(−κ​v\)→ℛuv\\to\(\-\\kappa v\)\\to\\mathcal\{R\}\_\{u\}: the connections identify the source field and target equation, while the term node retains the coupling coefficient\. Field identities and distinct field/residual node kinds retain these source and target roles even when message passing uses symmetrized connections\. Changing terms or their assignments changes the graph over this shared vocabulary\. Coefficients and connectivity therefore describe complementary parts of the same equation\.

### 3\.2Graph hypernetwork and PINN

The hypernetworkHHembeds node features ashi0=ϕ⁡\(zi\)h\_\{i\}^\{0\}=\\phi\(z\_\{i\}\), aggregates neighboring states, and decodes per\-field configuration codes\. The Fisher–KPP implementation uses

hik\+1=hik\+σ⁡\(Wself​hik\+Wneigh​∑j∈Va^i​j​hjk\),h\_\{i\}^\{k\+1\}=h\_\{i\}^\{k\}\+\\sigma\\\!\\Big\(W\_\{\\text\{self\}\}h\_\{i\}^\{k\}\+W\_\{\\text\{neigh\}\}\\\!\\textstyle\\sum\_\{j\\in V\}\\hat\{a\}\_\{ij\}h\_\{j\}^\{k\}\\Big\),whereσ\\sigmais GELU andWself,WneighW\_\{\\text\{self\}\},W\_\{\\text\{neigh\}\}are shared across nodes and rounds\. The weightsa^i​j\\hat\{a\}\_\{ij\}come from symmetrizing graph connections, adding self\-loops, and normalizing each row\. All edges use one neighbor matrix; coefficient signs enter through node features\. AfterKKrounds \(K=2K=2in the main comparison\), a readout for fieldffwith nodeifi\_\{f\}predicts codes for theLLfactorized layers:

rf=ρ\(\[hifK;h¯\]\),sfℓ=ReLU\(Aℓrf\+bℓ\)∈ℝw\(ℓ=1,…,L\),r\_\{f\}=\\rho\\big\(\\big\[\\,h\_\{i\_\{f\}\}^\{K\}\\,;\\,\\bar\{h\}\\,\\big\]\\big\),\\qquad s\_\{f\}^\{\\ell\}=\\mathrm\{ReLU\}\\\!\\big\(A^\{\\ell\}r\_\{f\}\+b^\{\\ell\}\\big\)\\in\\mathbb\{R\}^\{w\}\\quad\(\\ell=1,\\dots,L\),\(1\)whereϕ\\phiis the learned node embedding,ρ\\rhois the learned readout network,\[;\]\[\\,;\\,\]denotes concatenation, andh¯\\bar\{h\}is the mean of the final term and field states\. The learnedAℓ,bℓA^\{\\ell\},b^\{\\ell\}decode layerℓ\\ell\. Family\-specific aggregation and readout settings are given in App\.[A\.2](https://arxiv.org/html/2609.19915#A1.SS2)\. Appendix[C\.4](https://arxiv.org/html/2609.19915#A3.SS4)varies the propagation depth with training and test depths matched\.

The codes configure fieldff’s MLPgfg\_\{f\}throughWfℓ=Cℓ​diag​\(sfℓ\)​RℓW\_\{f\}^\{\\ell\}=C^\{\\ell\}\\,\\mathrm\{diag\}\(s\_\{f\}^\{\\ell\}\)\\,R^\{\\ell\}\(§[2](https://arxiv.org/html/2609.19915#S2)\):HHpredicts diagonal codes rather than full weight matrices\. With a fixed coordinate encodingγ\\gammaand output transform𝒜f\\mathcal\{A\}\_\{f\}, the prediction isuf​\(x,t\)=𝒜f​\(gf​\(γ⁡\(x,t\)\),x,t\)u\_\{f\}\(x,t\)=\\mathcal\{A\}\_\{f\}\\\!\\big\(g\_\{f\}\(\\gamma\(x,t\)\),x,t\\big\)\. Fisher–KPP uses periodic spatial features and a hard initial\-condition transform; CCP uses RF\-periodic features and hard spatial boundary values\. Forcdr,𝒜f\\mathcal\{A\}\_\{f\}is the identity and initial and boundary conditions enter as loss penalties\. These family\-specific constructions are detailed in App\.[B\.2](https://arxiv.org/html/2609.19915#A2.SS2), App\.[B\.4](https://arxiv.org/html/2609.19915#A2.SS4), and App\.[B\.3](https://arxiv.org/html/2609.19915#A2.SS3)\.

### 3\.3Training and deployment

##### Meta\-training\.

We sample PDE instances and collocation points and jointly optimize the hypernetwork, shared basesCℓ,RℓC^\{\\ell\},R^\{\\ell\}, and the backbone’s remaining parameters, including its input and output layers\. Gradients pass through the predicted codes and the configured PINN\. The objective combines squared equation residuals with any soft initial/boundary penalties; hard constraints enter through the coordinate and output transforms above\. Each meta\-step averages losses over the declared training structures, then adds the basis penalty once \(App\.[A\.4](https://arxiv.org/html/2609.19915#A1.SS4)\)\. No solution labels enter this optimization\.

##### Coefficient sampling\.

The sampler determines which numerical instances are presented to the amortizer; the descriptor determines how they are represented\. High\-reactioncdruses bounded perturbations around coefficient\-grid nodes, with a radius that gradually expands to cover the coefficient box \(App\.[B\.2\.2](https://arxiv.org/html/2609.19915#A2.SS2.SSS2)\)\. The schedule is shared across descriptors\. Appendix[D](https://arxiv.org/html/2609.19915#A4)fixes the seven training structures, objective, and budgets and compares this schedule with full\-radius perturbations from the start and grid\-only sampling\.

##### Deployment\.

For each target instance, we evaluates=H⁡\(G\)s=H\(G\)once and initialize a separate solver with the predicted codes and meta\-trained backbone\. The hypernetwork is no longer optimized\. Our main*full*fine\-tune updates the instance’s codes and all backbone parameters using the target physics objective\. Fisher–KPP retains a ReLU parameterization of the effective diagonal codes during adaptation; CDR and CCP optimize the diagonal entries directly \(App\.[A\.4](https://arxiv.org/html/2609.19915#A1.SS4)\)\. Numerical reference solutions are used only for evaluation\. Algorithm[1](https://arxiv.org/html/2609.19915#alg1)in App\.[A\.4](https://arxiv.org/html/2609.19915#A1.SS4)summarizes both phases; App\.[B](https://arxiv.org/html/2609.19915#A2)gives the family\-specific protocols\.

### 3\.4Descriptor baselines

##### DeepSets\-based term set\.

We use a standard DeepSets encoder\([Zaheer et al\., 2017](https://arxiv.org/html/2609.19915#bib.bib7)\)for variable\-cardinality term conditioning\. It independently embeds each term tokenzqz\_\{q\}and mean\-pools over the term setTT,r=ρ⁡\(1\|T\|​∑q∈Tϕ⁡\(zq\)\)r=\\rho\\big\(\\tfrac\{1\}\{\|T\|\}\\sum\_\{q\\in T\}\\phi\(z\_\{q\}\)\\big\), with its own learned embedding and readout networks\. Tokens contain coefficient sign and log\-magnitude, derivative orders, and arity\. In Fisher–KPP, they omit source\-field and target\-equation assignment and are pooled globally; CCP instead groups terms by residual/field\. Thus the graph–set comparison evaluates complete descriptor designs, including their input information and readouts\.

##### Coefficient vector\.

We adapt the coefficient\-conditioned hypernetwork of[Cho et al\. \(2023\)](https://arxiv.org/html/2609.19915#bib.bib3)to each benchmark family: an MLP maps its predefined coefficient layout to codes\. The layouts, normalization, and missing\-term conventions are part of our benchmark implementation\. Equation\-specific slots can encode coupling assignments implicitly\. Absent terms are zero\-filled; in our standardizedcdrimplementation, this zero can coincide with an active coefficient’s mean; Fisher–KPP additionally tests explicit presence indicators\. Layouts and transformations are specified in App\.[A\.2](https://arxiv.org/html/2609.19915#A1.SS2)\.

Each descriptor retains the active numerical coefficients and is trained with its own hypernetwork and backbone under the same within\-family protocol\. Backbone architectures and approximate total parameter counts are matched within each family; the fitted weights are learned separately\.

## 4Problem families and evaluation rationale

We select three PDE families to examine when a hypernetwork benefits from receiving operator composition and cross\-field relationships alongside coefficients\. Scalarcdrtests combinations of local operators without cross\-field coupling\. Two\-field Fisher–KPP adds independently controlled interactions between fields, allowing familiar couplings to be combined in an unseen pattern\. CCP retains a physically meaningful continuity–Poisson feedback while varying only its coefficients\. All three problems have one spatial dimension, with a separate model trained for each family and descriptor comparisons made within each family\.

### 4\.1cdr: recombining local operators

Convection transports a profile, diffusion smooths it, and logistic reaction drives growth toward saturation\. Their combinations provide a controlled setting for studying equation composition in a single field\. Ourcdrfamily combines the operators studied by[Krishnapriyan et al\. \(2021\)](https://arxiv.org/html/2609.19915#bib.bib4)and used for parameterized\-PDE meta\-learning by[Cho et al\. \(2023\)](https://arxiv.org/html/2609.19915#bib.bib3)\. Foru⁡\(x,t\)u\(x,t\)on the periodic linex∈\[0,1\)x\\in\[0,1\),t∈\[0,1\]t\\in\[0,1\], the full residual is

ℛ⁡\[u\]=∂tu\+a​∂xu−D​∂x​xu−r​u​\(1−u\),\\mathcal\{R\}\[u\]=\\partial\_\{t\}u\\;\+\\;a\\,\\partial\_\{x\}u\\;\-\\;D\\,\\partial\_\{xx\}u\\;\-\\;r\\,u\(1\-u\),\(2\)with three switchable*motifs*: advection, diffusion, and logistic reaction\. The evolution term∂tu\\partial\_\{t\}uis always present; each non\-empty subset of the three motifs defines one of seven structures \(Table[1](https://arxiv.org/html/2609.19915#S4.T1)\)\. The initial profile, periodic boundary condition, and time window are fixed, so only the active motifs and their coefficients vary\. App\.[B\.2](https://arxiv.org/html/2609.19915#A2.SS2)gives the coefficient ranges, initial profile, and numerical references\. Throughout, “Fisher” denotes the scalar diffusion–reaction member; “two\-field Fisher–KPP” denotes the coupled family below\.

Table 1:Thecdrstructures and the cross\-structure split: train on the five seen structures, test on the two unseen combinations of advection with reaction\.##### Term composition and coefficient variation\.

The cross\-structure protocol trains one amortizer on five structures and deploys on two unseen combinations\. Training never pairs advection with reaction; both test structures do\. This asks whether conditioning on familiar operators helps configure a solver for their unseen combination\.

The reaction coefficient also controls an optimization challenge: PINNs can converge to inaccurate low\-residual solutions at high reaction rates\([Krishnapriyan et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib4)\)\. We therefore distinguish*structural generalization*from*optimization reliability*\. The five\-to\-two protocol tests held structures in lower\-reaction and high\-reaction regimes\. A separate all\-seven\-structure protocol trains through the high\-reaction range and evaluates held\-out coefficients of known structures; it tests the role of training coverage and descriptor\-conditioned initialization\. Section[5](https://arxiv.org/html/2609.19915#S5)compares the high\-reaction protocols; App\.[C\.1](https://arxiv.org/html/2609.19915#A3.SS1)reports the lower\-reaction results\.

### 4\.2Two\-field Fisher–KPP: recombining cross\-field couplings

Fisher–KPP models a field that spreads by diffusion and grows locally toward saturation\([Fisher, 1937](https://arxiv.org/html/2609.19915#bib.bib10)\)\.[Holzer \(2016\)](https://arxiv.org/html/2609.19915#bib.bib5)studies two such equations with a linear one\-way source coupling, showing that coupling can change spreading dynamics\. Our periodic, advective extension controls both coupling directions independently\. Onx∈\[0,1\)x\\in\[0,1\),t∈\[0,1\]t\\in\[0,1\], the two fields satisfyℛu=ℛv=0\\mathcal\{R\}\_\{u\}=\\mathcal\{R\}\_\{v\}=0, with residuals

ℛu\\displaystyle\\mathcal\{R\}\_\{u\}=∂tu−ϵu​∂x​xu\+au​∂xu−ρu​u​\(1−u\)−κu​v​v,\\displaystyle=\\partial\_\{t\}u\-\\epsilon\_\{u\}\\partial\_\{xx\}u\+a\_\{u\}\\partial\_\{x\}u\-\\rho\_\{u\}u\(1\-u\)\-\\kappa\_\{uv\}v,\(3a\)ℛv\\displaystyle\\mathcal\{R\}\_\{v\}=∂tv−ϵv​∂x​xv\+av​∂xv−ρv​v​\(1−v\)−κv​u​u\.\\displaystyle=\\partial\_\{t\}v\-\\epsilon\_\{v\}\\partial\_\{xx\}v\+a\_\{v\}\\partial\_\{x\}v\-\\rho\_\{v\}v\(1\-v\)\-\\kappa\_\{vu\}u\.\(3b\)The source\+κu​v​v\+\\kappa\_\{uv\}vin the evolution ofuurepresentsv→uv\\to u, while\+κv​u​u\+\\kappa\_\{vu\}urepresentsu→vu\\to v\. Setting either nonnegative coupling coefficient to zero removes that interaction while retaining both fields’ transport, diffusion, and growth\. The initial fields, periodic boundaries, and time window are fixed, and the local coefficients and active coupling strengths vary within prescribed ranges \(App\.[B\.3](https://arxiv.org/html/2609.19915#A2.SS3)\)\. This gives a small coupled family in which source\-field and target\-equation assignments can change without changing the local physical mechanisms\.

We train on the uncoupled system and each of the two one\-way systems, then test the bidirectionally coupled system at four coefficient settings\. Both interactions have appeared during training, but the test activates them together for the first time\. Unlike scalarcdr, this composition specifies not only which operators are active but also which field influences which equation\. The question is whether explicitly organizing these relationships improves solver conditioning for the unseen coupling combination\. App\.[B\.3](https://arxiv.org/html/2609.19915#A2.SS3)specifies the held systems; Apps\.[C\.2](https://arxiv.org/html/2609.19915#A3.SS2)and[C\.3](https://arxiv.org/html/2609.19915#A3.SS3)report the descriptor controls\.

### 4\.3CCP: coefficient variation within a fixed coupled structure

A capacitively coupled plasma \(CCP\) is a gas discharge driven by an alternating voltage between electrodes, with charge transport and the electric field influencing each other\. This fixed\-coupling family tests whether physical interaction alone motivates graph conditioning\. We use a simplified one\-dimensional drift–diffusion–Poisson model\([Jing et al\., 2026a](https://arxiv.org/html/2609.19915#bib.bib6)\), coupling a charged\-species densityNNto an electrostatic potentialΦ\\Phi\. Onξ,τ∈\[0,1\]\\xi,\\tau\\in\[0,1\], its residuals are

ℛN\\displaystyle\\mathcal\{R\}\_\{N\}=∂τN−aD​∂ξ​ξN\+aμ​∂ξ\(N​∂ξΦ\)−S⁡\(ξ\),\\displaystyle=\\partial\_\{\\tau\}N\-a\_\{D\}\\,\\partial\_\{\\xi\\xi\}N\+a\_\{\\mu\}\\,\\partial\_\{\\xi\}\\\!\\big\(N\\,\\partial\_\{\\xi\}\\Phi\\big\)\-S\(\\xi\),\(4a\)ℛΦ\\displaystyle\\mathcal\{R\}\_\{\\Phi\}=∂ξ​ξΦ−β⁡\(N−1\),\\displaystyle=\\partial\_\{\\xi\\xi\}\\Phi\-\\beta\\,\(N\-1\),\(4b\)The potential gradient drives density transport inℛN\\mathcal\{R\}\_\{N\}, and the density sources the potential inℛΦ\\mathcal\{R\}\_\{\\Phi\}\. Both feedback links are retained throughout the family: deleting either would remove part of this self\-consistent coupling\. Instead, an applied voltageV0V\_\{0\}and source rateR0R\_\{0\}determine the varying coefficients while the operator structure stays fixed\. We train on a continuous\(V0,R0\)\(V\_\{0\},R\_\{0\}\)box and deploy on held\-out interior parameter values\. The nondimensional map, boundary conditions, and reference fields are given in App\.[B\.4](https://arxiv.org/html/2609.19915#A2.SS4)\.

A fixed coefficient layout describes the instance variation in this family\. CCP therefore tests whether graph\-based processing provides an additional benefit in a coupled application whose connectivity is already known, complementing Fisher–KPP’s varying\-coupling test\.

Our working hypothesis across these problems is that the utility of relational conditioning depends on which parts of an equation vary across instances, rather than on the presence of coupling alone\. Section[5](https://arxiv.org/html/2609.19915#S5)evaluates the three roles through within\-family comparisons of accuracy after target\-specific adaptation\.

## 5Experiments

### 5\.1Evaluation protocol

We evaluate equation\-conditioned initializations by the solution accuracy reached within a fixed budget of target\-specific physics optimization\. We compare coefficient\-vector, term\-set, and operator\-graph conditioning using the shared factorized backbone of §[3](https://arxiv.org/html/2609.19915#S3)\. Each family has its own trained models\. Within a comparison, the amortized descriptor methods share the PDE distribution, backbone architecture, physics objective, sampling policy, and training and adaptation budgets\. The from\-scratch control uses the same backbone and deployment budget without meta\-training\. Main results use ten training seeds forcdrand five for each coupled family; their numerical settings are in Apps\.[B\.2\.1](https://arxiv.org/html/2609.19915#A2.SS2.SSS1),[B\.3](https://arxiv.org/html/2609.19915#A2.SS3), and[B\.4](https://arxiv.org/html/2609.19915#A2.SS4)\.

We measure relative solution errorrel​L2=∥uθ−u⋆∥2/∥u⋆∥2\\mathrm\{rel\}L\_\{2\}=\\lVert u\_\{\\theta\}\-u^\{\\star\}\\rVert\_\{2\}/\\lVert u^\{\\star\}\\rVert\_\{2\}on the reference grid, averaging fieldwise errors for coupled systems\. We first average held cases within each training seed, then report the mean and sample standard deviation across independent seeds\. For Fisher–KPP and CCP, the primary measure is the*final*error after 3,000 adaptation steps\. Thecdroptimization study reports*oracle\-best*: the lowest error over scheduled evaluations within its fixed deployment budget\. Reference solutions are used only for evaluation, including oracle\-best selection, and never for training or online stopping\. Results from distinct training protocols are reported separately\.

### 5\.2Term composition and training coverage incdr

Scalarcdrfirst tests whether term\-based conditioning helps when familiar operators appear in new combinations\. The high\-reaction five\-to\-two and all\-seven protocols of §[4\.1](https://arxiv.org/html/2609.19915#S4.SS1)evaluate the same eight high\-reaction AR/ADR cases, separating unseen term composition from held\-coefficient adaptation within known structures\.

Table 2:High\-reactioncdroracle\-bestrel​L2\\mathrm\{rel\}L\_\{2\}\(mean±\\pmsample SD over ten seed means\)\. Both protocols evaluate the same eight AR/ADR cases\. Five\-to\-two holds out their structures; all\-seven training holds out only their coefficients\.Table[2](https://arxiv.org/html/2609.19915#S5.T2)shows substantially lower mean errors for both term\-based descriptors than for the coefficient vector\. On unseen structures, the term set and operator graph reduce the mean by85\.1%85\.1\\%and85\.4%85\.4\\%, respectively\. Including all seven structures further lowers their errors and reduces seed\-to\-seed variation\. Their means remain close in both protocols: this scalar family supports term\-based conditioning, without a consistent advantage for the graph over the set\. Fixed\-final errors support the same comparison \(App\.[C\.1](https://arxiv.org/html/2609.19915#A3.SS1)\), which also reports lower\-reaction results and seed distributions\.

A supplementary all\-seven experiment \(App\.[D](https://arxiv.org/html/2609.19915#A4)\) tests dependence on the coefficient\-sampling schedule\. Low Set and Graph errors persist with full jitter from the start\. Under grid\-only training, Graph has more consistent threshold attainment across the sampled seeds\. Thus coefficient exposure affects adaptation alongside the descriptor; these supplementary results use their own collocation budget and seed cohorts\.

### 5\.3Generalization to unseen Fisher–KPP coupling

Figure 1:Fisher–KPP error at step 3000\. Circles: five seed means over H1–H4; diamonds: overall means\.Fisher–KPP tests whether explicitly representing cross\-field relationships improves adaptation to an unseen combination of familiar interactions\. Under the split in §[4\.2](https://arxiv.org/html/2609.19915#S4.SS2), all four held systems activate both coupling directions, which meta\-training sees only separately\.

The operator graph has the lowest mean final error \(Fig\.[1](https://arxiv.org/html/2609.19915#S5.F1)\):\(1\.786±0\.318\)×10−3\(1\.786\\pm 0\.318\)\\times 10^\{\-3\}, compared with\(2\.779±0\.712\)×10−3\(2\.779\\pm 0\.712\)\\times 10^\{\-3\}for the term set,\(5\.531±1\.302\)×10−3\(5\.531\\pm 1\.302\)\\times 10^\{\-3\}for the coefficient vector, and\(9\.660±0\.626\)×10−3\(9\.660\\pm 0\.626\)\\times 10^\{\-3\}from scratch\. Its mean is35\.7%35\.7\\%below the term set and67\.7%67\.7\\%below the coefficient vector\. The ordering is also preserved under oracle\-best evaluation \(Table[7](https://arxiv.org/html/2609.19915#A3.T7)\)\. The lower final error supports graph conditioning for adaptation to the unseen coupling combination, beyond the gains already provided by the term set\. The lower Graph mean also holds for each held case and each field separately \(App\.[C\.2](https://arxiv.org/html/2609.19915#A3.SS2), Table[8](https://arxiv.org/html/2609.19915#A3.T8)\)\.

![Refer to caption](https://arxiv.org/html/2609.19915v1/iclr2027_fisher_fields.png)Figure 2:Fisher–KPP H1, seed 101\. Rows showuuandvv; columns show the reference, Graph and Set predictions, and their absolute errors\. The first three columns share the adjacent field\-value colorbar; the error columns share the rightmost linear colorbar\. Both use rainbow\. The case and seed are fixed; Graph and Set use their respective oracle\-best checkpoints at steps 2400 and 3000\. These snapshots illustrate solution quality; Fig\.[1](https://arxiv.org/html/2609.19915#S5.F1)reports aggregate final\-step performance\.The solution maps in Fig\.[2](https://arxiv.org/html/2609.19915#S5.F2)show that both learned solvers recover the main field structure\. Their differences are clearer in the shared\-scale absolute\-error maps, where the graph prediction has smaller errors on this example\. The quantitative conclusion above uses all held cases and seeds rather than the displayed snapshot\.

A separate five\-seed complete\-method comparison on one GPU \(App\.[F](https://arxiv.org/html/2609.19915#A6)\) evaluates a parameter\-matched Iwata\-style conditional decoder\. It has lower initialization error, whereas Graph has44\.6%44\.6\\%lower mean error after 3,000 updates\.

### 5\.4Coefficient variation within fixed CCP coupling

Table 3:CCP error at step 3000: mean±\\pmsample SD over five seeds\.CCP retains the continuity–Poisson feedback throughout training and testing, so coefficients specify all variation within the equation family\. Table[3](https://arxiv.org/html/2609.19915#S5.T3)reports final accuracy at the two held interior parameter settings\. The coefficient vector performs best\. The operator graph lowers the mean error relative to training from scratch, but not relative to coefficient conditioning\. This fixed\-structure application shows that physical coupling alone does not ensure a graph advantage under this protocol\.

### 5\.5Number of message\-passing rounds

Figure 3:Fisher–KPP error after 3000 updates\. Thin lines: five seed means over fields and H1–H4; bold line and whiskers: mean and sample SD\.On Fisher–KPP, we vary propagation roundsK∈\{1,2,3,4,5\}K\\in\\\{1,2,3,4,5\\\}, matching meta\-training and target\-encoding depths\. Shared weights keep all models at 132,866 parameters; initialization and coefficient/collocation streams are paired within each seed\.

A five\-seed depth ablation \(App\.[C\.4](https://arxiv.org/html/2609.19915#A3.SS4)\) fixes the parameter count and optimizer budgets\. Increasing propagation from two to five rounds further lowers mean final error, with a paired improvement in four of the five seeds\. The descriptor comparison above retains two rounds\. At step 3000, the mean error reduction fromK=2K=2toK=5K=5is26\.6%26\.6\\%\(Fig\.[3](https://arxiv.org/html/2609.19915#S5.F3)\)\. The comparison fixes optimizer updates, not compute time; deeper encoding requires more computation\.

##### Evidence across families\.

Fisher–KPP provides the direct evidence that graph conditioning improves adaptation to an unseen coupling composition\. High\-reactioncdrshows benefits from both term\-based descriptors, while CCP identifies a fixed\-structure setting where coefficient conditioning performs best\. Together, these observations motivate testing relational conditioning when cross\-field interactions vary across instances\. The sampler controls in App\.[D](https://arxiv.org/html/2609.19915#A4)complement this structural comparison by testing sensitivity to numerical coefficient exposure\. Complementing fixed\-budget accuracy, a separate three\-seedcdrstudy in App\.[E](https://arxiv.org/html/2609.19915#A5)measures updates to a common error threshold\. On held structures, graph conditioning reduces the median from 2200 scratch updates to 600; Vector and Set also require fewer updates, establishing an amortization benefit shared by the descriptors\.

## 6Related work

##### Amortized physics\-informed solvers\.

HyperPINN\([de Avila Belbute\-Peres et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib2)\)predicts PINN weights from equation parameters to share learning across instances\. Hyper\-LR\-PINN\([Cho et al\., 2023](https://arxiv.org/html/2609.19915#bib.bib3)\)predicts diagonal codes for shared factorized layers, including for a parameterized CDR family\. We retain this factorization and coefficient\-to\-code interface while broadening the equation descriptor\. Our comparisons use full adaptation of codes and backbone parameters \(§[3](https://arxiv.org/html/2609.19915#S3)\), whereas Cho et al\.’s online phase freezes the factorized bases\. The contribution concerns solver conditioning within this framework\. In a related dynamics\-learning setting,[Jing et al\. \(2026b\)](https://arxiv.org/html/2609.19915#bib.bib11)use latent\-conditioned hypernetworks for few\-shot adaptation of structure\-preserving models from trajectory data, whereas we condition PINNs on explicit equation graphs and adapt them using physics residuals\.

##### Representing equation families\.

Coefficient dictionaries can describe different equations, not just different parameter values of one equation\.[Iwata et al\. \(2023\)](https://arxiv.org/html/2609.19915#bib.bib12)encode coefficients of a polynomial in fields and derivatives, combine them with a set representation of boundary conditions, and condition a coordinate\-based solution network trained with physics losses\. Their target\-specific refinement updates the solution decoder and the inferred problem representation while keeping the problem encoder fixed\. This differs from coefficient\-to\-code hypernetwork conditioning\. Appendix[F](https://arxiv.org/html/2609.19915#A6)compares a parameter\-matched two\-field adaptation of this conditional decoder with our solver\. Their setting motivates comparing equation representations without treating fixed\-length vectors as intrinsically restricted to one structure\. Our operator graph makes factor and residual assignments explicit\. The term\-set baseline uses standard DeepSets pooling\([Zaheer et al\., 2017](https://arxiv.org/html/2609.19915#bib.bib7)\), providing a variable\-size representation of additive terms against which to assess the complete graph descriptor\.

##### Graph\-conditioned neural fields\.

Graph hypernetworks predict weights from target\-network connectivity in architecture search, unseen\-architecture prediction, and program synthesis\([Zhang et al\., 2019](https://arxiv.org/html/2609.19915#bib.bib13);[Knyazev et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib14);[Li et al\., 2026](https://arxiv.org/html/2609.19915#bib.bib15)\)\. Our graph instead describes the governing equations\. More closely, PDEformer and PDEformer\-2 combine equation graphs with graph Transformers and implicit neural representations\([Ye et al\., 2024](https://arxiv.org/html/2609.19915#bib.bib16);[Ye et al\., 2025](https://arxiv.org/html/2609.19915#bib.bib17)\)\. PDEformer generates layer modulations from graph embeddings, so graph\-conditioned neural fields already have a direct precedent\. These models use numerical solution datasets for pretraining; we use equation graphs to configure factorized PINNs through physics\-only meta\-training and adaptation\.

##### Multi\-equation learning with physics\.

HyPINO\([Bischof et al\., 2025](https://arxiv.org/html/2609.19915#bib.bib18)\)generates PINNs from PDE parameterizations using manufactured\-solution labels and physics losses, and evaluates both forward prediction and subsequent fine\-tuning\. PI\-MFM\([Zhu et al\., 2025](https://arxiv.org/html/2609.19915#bib.bib19)\)combines symbolic equations and condition inputs, assembles physics losses automatically, and supports physics\-only adaptation after mixed data/physics pretraining\. Our study shares the goal of reusing solvers across equations, but focuses on how coefficient, term\-set, and graph descriptors condition a common within\-family backbone when neither meta\-training nor adaptation uses solution labels\.

## 7Limitations and future directions

Our results concern three separately trained, one\-spatial\-dimensional PDE families with fixed conditions and bounded coefficients\. Transfer across families, dimensions, and boundary conditions remains open\. Varying coefficients and admissible connectivity independently within a common coupled model would better isolate when relational conditioning helps\.

The sampler controls use small, unequal seed cohorts \(App\.[D](https://arxiv.org/html/2609.19915#A4)\)\. The update\-count study \(App\.[E](https://arxiv.org/html/2609.19915#A5)\) and measured Fisher timings \(App\.[F](https://arxiv.org/html/2609.19915#A6)\) cover fixed deployment sets\. Broader deployment coverage and physics\-based stopping rules remain future work\.

## Acknowledgements

Cheng Jing acknowledges funding support from Applied Materials, Inc\. Yixuan He acknowledges support from a Jetstream2 AI Fellowship and an NVIDIA Academic Grant Award\.

## References

- Raissi et al\. \(2019\)Maziar Raissi, Paris Perdikaris, and George E\. Karniadakis\.Physics\-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations\.*Journal of Computational Physics*, 378:686–707, 2019\.doi:10\.1016/j\.jcp\.2018\.10\.045\.
- de Avila Belbute\-Peres et al\. \(2021\)Filipe de Avila Belbute\-Peres, Yi\-fan Chen, and Fei Sha\.HyperPINN: Learning parameterized differential equations with physics\-informed hypernetworks\.In*NeurIPS Workshop on the Symbiosis of Deep Learning and Differential Equations*, 2021\.URLhttps://openreview\.net/forum?id=LxUuRDUhRjM\.
- Cho et al\. \(2023\)Woojin Cho, Kookjin Lee, Donsub Rim, and Noseong Park\.Hypernetwork\-based meta\-learning for low\-rank physics\-informed neural networks\.In*Advances in Neural Information Processing Systems*, volume 36, pages 11219–11231, 2023\.doi:10\.52202/075280\-0496\.
- Krishnapriyan et al\. \(2021\)Aditi S\. Krishnapriyan, Amir Gholami, Shandian Zhe, Robert M\. Kirby, and Michael W\. Mahoney\.Characterizing possible failure modes in physics\-informed neural networks\.In*Advances in Neural Information Processing Systems*, volume 34, pages 26548–26560, 2021\.URLhttps://proceedings\.neurips\.cc/paper/2021/hash/df438e5206f31600e6ae4af72f2725f1\-Abstract\.html\.
- Holzer \(2016\)Matt Holzer\.A proof of anomalous invasion speeds in a system of coupled Fisher–KPP equations\.*Discrete and Continuous Dynamical Systems*, 36\(4\):2069–2084, 2016\.doi:10\.3934/dcds\.2016\.36\.2069\.
- Jing et al\. \(2026a\)Cheng Jing, Uvini Balasuriya Mudiyanselage, Abhishek Verma, Kallol Bera, Shahid Rauf, and Kookjin Lee\.Extending Fourier neural operators for modeling parameterized and coupled PDEs\.In*International Conference on Learning Representations*, volume 2026, pages 119621–119651, 2026a\.URLhttps://proceedings\.iclr\.cc/paper\_files/paper/2026/hash/c253f6fe5cc2bd1905427da63ac37917\-Abstract\-Conference\.html\.
- Zaheer et al\. \(2017\)Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Ruslan Salakhutdinov, and Alexander J\. Smola\.Deep Sets\.In*Advances in Neural Information Processing Systems*, volume 30, 2017\.URLhttps://proceedings\.neurips\.cc/paper\_files/paper/2017/hash/f22e4747da1aa27e363d86d40ff442fe\-Abstract\.html\.
- Ha et al\. \(2017\)David Ha, Andrew M\. Dai, and Quoc V\. Le\.HyperNetworks\.In*International Conference on Learning Representations \(ICLR\)*, 2017\.URLhttps://openreview\.net/forum?id=rkpACe1lx\.
- Gilmer et al\. \(2017\)Justin Gilmer, Samuel S\. Schoenholz, Patrick F\. Riley, Oriol Vinyals, and George E\. Dahl\.Neural message passing for quantum chemistry\.In*Proceedings of the 34th International Conference on Machine Learning*, volume 70 of*Proceedings of Machine Learning Research*, pages 1263–1272\. PMLR, 2017\.URLhttps://proceedings\.mlr\.press/v70/gilmer17a\.html\.
- Fisher \(1937\)Ronald A\. Fisher\.The wave of advance of advantageous genes\.*Annals of Eugenics*, 7\(4\):355–369, 1937\.doi:10\.1111/j\.1469\-1809\.1937\.tb02153\.x\.
- Jing et al\. \(2026b\)Cheng Jing, Uvini Balasuriya Mudiyanselage, Woojin Cho, Minju Jo, Anthony Gruber, and Kookjin Lee\.Meta\-learning structure\-preserving dynamics\.In*International Conference on Machine Learning*, 2026b\.URLhttps://arxiv\.org/abs/2508\.11205\.
- Iwata et al\. \(2023\)Tomoharu Iwata, Yusuke Tanaka, and Naonori Ueda\.Meta\-learning of physics\-informed neural networks for efficiently solving newly given PDEs\.*arXiv preprint arXiv:2310\.13270*, 2023\.URLhttps://arxiv\.org/abs/2310\.13270\.
- Zhang et al\. \(2019\)Chris Zhang, Mengye Ren, and Raquel Urtasun\.Graph HyperNetworks for neural architecture search\.In*International Conference on Learning Representations*, 2019\.URLhttps://openreview\.net/forum?id=rkgW0oA9FX\.
- Knyazev et al\. \(2021\)Boris Knyazev, Michal Drozdzal, Graham W\. Taylor, and Adriana Romero\-Soriano\.Parameter prediction for unseen deep architectures\.In*Advances in Neural Information Processing Systems*, volume 34, pages 29433–29448, 2021\.URLhttps://proceedings\.neurips\.cc/paper/2021/hash/f6185f0ef02dcaec414a3171cd01c697\-Abstract\.html\.
- Li et al\. \(2026\)Wenhao Li, Yudong Xu, Elias Khalil, and Scott Sanner\.Structure\-aware graph hypernetworks for neural program synthesis\.In*International Conference on Learning Representations*, volume 2026, pages 129239–129270, 2026\.URLhttps://proceedings\.iclr\.cc/paper\_files/paper/2026/hash/d1e2f808a51842eedaf6ef0099d716c6\-Abstract\-Conference\.html\.
- Ye et al\. \(2024\)Zhanhong Ye, Xiang Huang, Leheng Chen, Hongsheng Liu, Zidong Wang, and Bin Dong\.PDEformer: Towards a foundation model for one\-dimensional partial differential equations\.*arXiv preprint arXiv:2402\.12652*, 2024\.URLhttps://arxiv\.org/abs/2402\.12652\.
- Ye et al\. \(2025\)Zhanhong Ye, Zining Liu, Bingyang Wu, Hongjie Jiang, Leheng Chen, Minyan Zhang, Xiang Huang, Qinghe Meng, Jingyuan Zou, Hongsheng Liu, and Bin Dong\.PDEformer\-2: A versatile foundation model for two\-dimensional partial differential equations\.*arXiv preprint arXiv:2507\.15409*, 2025\.URLhttps://arxiv\.org/abs/2507\.15409\.
- Bischof et al\. \(2025\)Rafael Bischof, Michal Piovarci, Michael Kraus, Siddhartha Mishra, and Bernd Bickel\.HyPINO: Multi\-physics neural operators via HyperPINNs and the method of manufactured solutions\.In*Advances in Neural Information Processing Systems*, volume 38, pages 144798–144831, 2025\.doi:10\.52202/085713\-4845\.URLhttps://proceedings\.neurips\.cc/paper\_files/paper/2025/hash/d551ee47a0165febf1f2748b9b450886\-Abstract\-Conference\.html\.
- Zhu et al\. \(2025\)Min Zhu, Jingmin Sun, Zecheng Zhang, Hayden Schaeffer, and Lu Lu\.PI\-MFM: Physics\-informed multimodal foundation model for solving partial differential equations\.*arXiv preprint arXiv:2512\.23056*, 2025\.URLhttps://arxiv\.org/abs/2512\.23056\.

## Appendix ARepresentation and implementation

This section gives the descriptor details supplementing §[3](https://arxiv.org/html/2609.19915#S3)\. Benchmark settings are in App\.[B](https://arxiv.org/html/2609.19915#A2); supplementary descriptor comparisons and coefficient\-sampling controls are in Apps\.[C](https://arxiv.org/html/2609.19915#A3)and[D](https://arxiv.org/html/2609.19915#A4)\.

### A\.1Graph construction

We useufu\_\{f\}for fieldff,ℛf\\mathcal\{R\}\_\{f\}for its governing residual,G=\(V,E\)G=\(V,E\)for the operator graph, andsfℓs\_\{f\}^\{\\ell\}for the code of factorized layerℓ\\ell\. Each additive monomial is a term node with a scalar coefficient and a tuple of field or derivative factors\. Arity counts factors with multiplicity:u2u^\{2\}has arity two, a constant has arity zero, and−κ​v\-\\kappa vinℛu\\mathcal\{R\}\_\{u\}has arity one with source fieldvvand target equationuu\.

The four node kinds are fields, derivatives, terms, and residual roots\. Connections run from a field to its derivatives, from factors to their terms, and from each term to its target residual\. Node attributes identify kind, field or target\-field identity, derivative orders, and coefficient sign/log\-magnitude where applicable\. The symbolic incidence is directed; message passing uses symmetrized, self\-looped, row\-normalized connectivity without edge\-specific transformations\. The CDR and CCP layouts reserve a global\-node kind but remove that node before encoding\.

Figure[4](https://arxiv.org/html/2609.19915#A1.F4)shows all CDR motifs\. Removing reaction removes the−r​u\-ruand\+r​u2\+ru^\{2\}terms and their incidences\. In a coupled system, the target connection also identifies which equation receives each term \(Fig\.[5](https://arxiv.org/html/2609.19915#A1.F5)\)\. The schematics useru,rN,rΦr\_\{u\},r\_\{N\},r\_\{\\Phi\}forℛu,ℛN,ℛΦ\\mathcal\{R\}\_\{u\},\\mathcal\{R\}\_\{N\},\\mathcal\{R\}\_\{\\Phi\}\. Their edge signs illustrate residual assembly; the encoders receive coefficient signs as term\-node attributes and use unsigned message\-passing adjacency\.

Figure 4:CDR operator graph\. Other motif combinations remove the corresponding terms and incidences\.
### A\.2Family\-specific descriptor inputs and readouts

##### CDR\.

The coefficient vector has layout\[a,D,r\]\[a,D,r\]\. ActiveDDuseslog10\\log\_\{10\};aaandrruse the identity transform\. Active entries are standardized using the protocol’s active\-value means and standard deviations; absent entries are zero\-filled after standardization, without presence indicators\. Thus absence and a mean\-valued active coefficient can share an encoding\. Term\-set and graph inputs instead use coefficient sign and log\-magnitude without this standardization\.

The graph has 22\-dimensional features: five node\-kind slots, eight field\-identity slots, three derivative\-order slots, three term\-attribute slots, and three source/location slots\. Its two residual update rounds have round\-specific affine maps\. The embedded and updated states are concatenated at each node, projected to the node width, and mean\-pooled over term and field nodes before decoding the single field’s codes\. Each amortized CDR model has approximately1\.01\.0M parameters\.

##### Fisher–KPP\.

The equation\-ordered vector is\[ϵu,au,ρu,κu​v,ϵv,av,ρv,κv​u\]\[\\epsilon\_\{u\},a\_\{u\},\\rho\_\{u\},\\kappa\_\{uv\},\\epsilon\_\{v\},a\_\{v\},\\rho\_\{v\},\\kappa\_\{vu\}\]\. Diffusion entries arelog10\\log\_\{10\}\-transformed, active entries are analytically standardized, and absent couplings are filled with zero after standardization\. The presence\-indicator control appends eight binary indicators\.

A term\-set token contains\[sign⁡\(c\),log10⁡\|c\|,∑dx,∑dt,arity,𝟙constant​source\]\[\\mathrm\{sign\}\(c\),\\log\_\{10\}\|c\|,\\sum d\_\{x\},\\sum d\_\{t\},\\mathrm\{arity\},\\mathbb\{1\}\_\{\\mathrm\{constant\\ source\}\}\]\. Tokens are independently embedded and globally mean\-pooled; the readout then receives target\-field identity\. The tokens do not identify their source fields or target equations\. The ownership\-aware control adds these assignments \(App\.[C\.3](https://arxiv.org/html/2609.19915#A3.SS3)\)\.

The graph has 12\-dimensional node features: four node\-kind indicators, two field indicators, two derivative orders, and coefficient sign, log\-magnitude, arity, and a constant\-source flag\. The bidirectionally coupled test graph has 22 nodes and 30 directed incidence edges before symmetrization\. Its update and readout follow §[3](https://arxiv.org/html/2609.19915#S3)\. The operator graph uses two rounds and has 132,866 parameters\. Other descriptor totals are within0\.3%0\.3\\%of this total\.

##### CCP\.

The vector uses a 17\-slot union layout with four active coefficients\(aD,aμ,β,S0\)\(a\_\{D\},a\_\{\\mu\},\\beta,S\_\{0\}\), whereS0S\_\{0\}is the source amplitude defined in App\.[B\.4](https://arxiv.org/html/2609.19915#A2.SS4)\. Active entries uselog10⁡\(\|c\|\+10−8\)\\log\_\{10\}\(\|c\|\+10^\{\-8\}\)without standardization; other slots are zero\. One predicted code set is broadcast to both fields\. The set encoder uses five term attributes \(coefficient sign, log\-magnitude, two derivative orders, and arity\) and groups terms by residual/field\. The graph uses the 22\-dimensional layout above, including source\-location attributes, with two non\-residual update rounds and a final\-hop per\-field readout\. Total parameter counts differ by at most0\.12%0\.12\\%between amortized arms\.

### A\.3Consistency between the graph and physics loss

CDR and Fisher–KPP share term lists between descriptor construction and automatic\-differentiation residual evaluation\. The five\-seed CCP implementation constructs the graph explicitly while differentiating its drift in conservative form:

∂ξ\(N​∂ξΦ\)=\(∂ξN\)​\(∂ξΦ\)\+N​∂ξ​ξΦ\.\\partial\_\{\\xi\}\(N\\,\\partial\_\{\\xi\}\\Phi\)=\(\\partial\_\{\\xi\}N\)\(\\partial\_\{\\xi\}\\Phi\)\+N\\,\\partial\_\{\\xi\\xi\}\\Phi\.Both right\-hand terms occur in the graph with coefficientaμa\_\{\\mu\}\. The Poisson residual is∂ξ​ξΦ−β⁡\(N−1\)\\partial\_\{\\xi\\xi\}\\Phi\-\\beta\(N\-1\)\. The graph and physics loss use the same coefficients and prescribed two\-zone source: the graph stores the first interval and uses the fixed mirrored\-interval convention\. Thus the two code paths represent the same governing equations\.

##### Engineering value\.

Within the supported operator vocabulary, the graph provides an inspectable interface between an equation definition and the hypernetwork\. In CDR and Fisher–KPP, one term representation supplies both graph construction and residual evaluation, so supported term or coupling edits can be expressed once and reused in both paths\. This code reuse complements the accuracy comparisons; new operators, field layouts, or boundary prescriptions still require explicit implementation\.

Figure 5:CCP operator graph\. Density and potential enter both the drift–diffusion and Poisson residuals\.

### A\.4Physics\-only training and adaptation

Algorithm[1](https://arxiv.org/html/2609.19915#alg1)summarizes the two phases for one PDE family\. The physics loss is the weighted mean of squared equation residuals, computed by automatic differentiation, plus any soft initial/boundary penalties\. Hard conditions are built into the coordinate and output transforms\. Numerical reference solutions enter only the separate evaluation procedure \(App\.[B\.1](https://arxiv.org/html/2609.19915#A2.SS1)\)\.

Algorithm 1Physics\-only meta\-training and full adaptation\.1:Input:Training PDE structures, coefficient sampler, prescribed conditions, and training/adaptation budgets\.

2:Phase 1: Learn a shared equation\-conditioned initialization

3:Initialize the graph hypernetwork and shared factorized PINN backbone\.

4:foreach meta\-training stepdo

5:Sample one PDE per training structure and fresh collocation points\.

6:foreach sampled PDEdo

7:Build its operator graph, retaining coefficients and term assignments\.

8:Predict diagonal codes with the hypernetwork and configure the shared PINN\.

9:Evaluate the physics loss for this PDE at its sampled points\.

10:endfor

11:Average the PDE losses; add the configured basis\-orthogonality penalty once\.

12:Backpropagate through the codes; update the hypernetwork and shared backbone\.

13:endfor

14:Phase 2: Adapt an independent solver to each target equation

15:foreach target PDEdo

16:Build its graph and call the trained hypernetwork once to obtain initial codes\.

17:Copy the trained backbone; make the codes independent trainable tensors\.

18:foreach adaptation stepdo

19:Sample fresh points and recompute the target physics loss and configured penalty\.

20:Update the codes and all copied backbone parameters; keep the hypernetwork fixed\.

21:endfor

22:Return the adapted PINN as the target solution approximation\.

23:endfor

Meta\-training is joint optimization across equations; it has no inner adaptation loop\. The training set has five or seven structures in CDR, three in Fisher–KPP, and one in CCP\. Equal step counts across different structure sets therefore need not imply equal computation\. Samplers, loss weights, regularization, and optimizer budgets follow the family protocols in App\.[B](https://arxiv.org/html/2609.19915#A2)\.

The predicted codes include the output ReLU of Eq\. \([1](https://arxiv.org/html/2609.19915#S3.E1)\)\. At deployment, Fisher–KPP initializes independent trainable tensorss~fℓ\\tilde\{s\}\_\{f\}^\{\\ell\}with these predictions and usessfℓ=ReLU⁡\(s~fℓ\)s\_\{f\}^\{\\ell\}=\\operatorname\{ReLU\}\(\\tilde\{s\}\_\{f\}^\{\\ell\}\)inCℓ​diag⁡\(sfℓ\)​RℓC^\{\\ell\}\\operatorname\{diag\}\(s\_\{f\}^\{\\ell\}\)R^\{\\ell\}at every forward pass\. CDR and CCP instead optimizesfℓs\_\{f\}^\{\\ell\}directly, without a nonnegativity clamp\. Full adaptation updates the instance’s code tensors and all copied backbone parameters; the hypernetwork remains unchanged\.

## Appendix BBenchmark and evaluation protocols

### B\.1Errors and aggregation

For one field,rel​L2=‖uθ−u⋆‖2/‖u⋆‖2\\mathrm\{rel\}L\_\{2\}=\\\|u\_\{\\theta\}\-u^\{\\star\}\\\|\_\{2\}/\\\|u^\{\\star\}\\\|\_\{2\}on the reference grid\. For a coupled case, we average the two fieldwise relative errors\. Final error is measured at the fixed deployment budget; oracle\-best is the minimum case error over scheduled evaluations, including initialization\. Reference fields are used only for evaluation, not for training or online stopping\.

We average case errors within each training seed, then report the mean and sample standard deviation over ten CDR or five Fisher–KPP/CCP seed means\. The three\-seed ownership control and the supplementary CDR sampling cohorts are reported separately in Apps\.[C\.3](https://arxiv.org/html/2609.19915#A3.SS3)and[D](https://arxiv.org/html/2609.19915#A4)\.

### B\.2CDR: motif combinations and coefficient regimes

The scalar family of Eq\. \([2](https://arxiv.org/html/2609.19915#S4.E2)\) combines convection, diffusion, and logistic reaction\([Krishnapriyan et al\., 2021](https://arxiv.org/html/2609.19915#bib.bib4);[Cho et al\., 2023](https://arxiv.org/html/2609.19915#bib.bib3)\)onx∈\[0,1\)x\\in\[0,1\)andt∈\[0,1\]t\\in\[0,1\]\. Advection translates the profile, diffusion damps spatial variation, and logistic reaction drives positive values toward saturation\. The seven nonempty combinations of these motifs are listed in Table[1](https://arxiv.org/html/2609.19915#S4.T1)\. All share the initial condition

u0​\(x\)=0\.5\+0\.20​sin⁡\(2​π​x\)\+0\.10​sin⁡\(4​π​x\+0\.7\)\+0\.05​cos⁡\(6​π​x\)u\_\{0\}\(x\)=0\.5\+0\.20\\sin\(2\\pi x\)\+0\.10\\sin\(4\\pi x\+0\.7\)\+0\.05\\cos\(6\\pi x\)and periodic boundary conditions\. Both constraints enter as separate unit\-weighted soft penalties\. In the five\-to\-two split, meta\-training omits AR and ADR; these two structures combine advection and reaction for the first time at deployment\. In the all\-seven protocol, all structures are seen and only evaluation coefficient settings are new\.

##### Reference solutions\.

We use 256 endpoint\-excluded Fourier spatial nodes and 101 output times, with a float64 pseudo\-spectral method of lines, BDF integration, relative tolerance10−810^\{\-8\}, and absolute tolerance10−1010^\{\-10\}, without dealiasing\. Translation and diffusion modal\-decay checks give errors of approximately10−710^\{\-7\}\. References are used only for evaluation\.

#### B\.2\.1Ten\-seed descriptor comparisons

The ten\-seed comparisons use the width\-256 backbone with three coded layers and two graph\-update rounds\. Each physics\-loss evaluation draws 512 interior, 128 initial, and 128 periodic\-boundary samples\. Meta\-training and full adaptation use Adam at2\.5×10−42\.5\\times 10^\{\-4\}; the basis\-orthogonality weight is10−410^\{\-4\}during meta\-training and zero during adaptation\. Errors are evaluated every 200 deployment steps\. All three protocols use seeds00–99and float32 computation on NVIDIA GB10 GPUs\. Task draws share seed IDs across descriptors; collocation sampling follows the same policy but is not pointwise paired across architectures\.

Both high\-reaction protocols use 30,000 meta\-training and 3,000 deployment steps\. They share the coefficient grid and bounded\-jitter schedule of App\.[B\.2\.2](https://arxiv.org/html/2609.19915#A2.SS2.SSS2), with radius held at zero through step 8,000 and expanded to full coverage by step 24,000\. Each meta\-step averages the loss over the declared five or seven training structures\. The five\-to\-two protocol omits AR/ADR losses; the all\-seven protocol includes them\. Their common primary evaluation comprises AR and ADR ata∈\{4\.5,9\.5\}a\\in\\\{4\.5,9\.5\\\}andr∈\{8\.5,9\.5\}r\\in\\\{8\.5,9\.5\\\}, withD=10−2D=10^\{\-2\}for ADR, giving eight cases\. Table[2](https://arxiv.org/html/2609.19915#S5.T2)reports their results\.

The lower\-reaction five\-to\-two protocol instead uses 20,000 meta\-training and 5,000 deployment steps, witha∼U⁡\[2,4\]a\\sim U\[2,4\],r∼U⁡\[1,4\]r\\sim U\[1,4\], and log\-uniformD∈\[10−3,10−1\]D\\in\[10^\{\-3\},10^\{\-1\}\]on active terms\. App\.[C\.1](https://arxiv.org/html/2609.19915#A3.SS1)reports its six\-case held AR/ADR evaluation\.

#### B\.2\.2Coefficient grid and sampling schedule

The high\-reaction protocols sample the Cartesian product of the active coefficient axes in Table[4](https://arxiv.org/html/2609.19915#A2.T4)\. Writeα⁡\(m\)∈\[0,1\]\\alpha\(m\)\\in\[0,1\]for the jitter radius at meta\-stepmm\. A sampled grid node is perturbed uniformly by up toα⁡\(m\)\\alpha\(m\)times the axis half\-spacing, inlog10⁡D\\log\_\{10\}Dfor diffusion, then clipped to its range\. Atα=0\\alpha=0only grid nodes are sampled; atα=1\\alpha=1neighboring jitter intervals meet and the whole box is covered\. This is continuous support, not a claim that the clipped distribution is uniform\. The scheduled setting holdsα=0\\alpha=0through step 8,000 and increases it linearly to one by step 24,000 of 30,000\.

Table 4:High\-reaction coefficient grid and jitter half\-spacings\.

### B\.3Two\-field Fisher–KPP: held coupling composition

We solve the residual system in Eqs\. \([3a](https://arxiv.org/html/2609.19915#S4.E3.1)\)–\([3b](https://arxiv.org/html/2609.19915#S4.E3.2)\) onx∈\[0,1\)x\\in\[0,1\),t∈\[0,1\]t\\in\[0,1\], with periodic space and

u0​\(x\)\\displaystyle u\_\{0\}\(x\)=0\.35\+0\.20​sin⁡\(2​π​x\)\+0\.08​cos⁡\(4​π​x\+0\.3\),\\displaystyle=0\.35\+0\.20\\sin\(2\\pi x\)\+0\.08\\cos\(4\\pi x\+0\.3\),v0​\(x\)\\displaystyle v\_\{0\}\(x\)=0\.30\+0\.18​cos⁡\(2​π​x\+0\.4\)−0\.06​sin⁡\(6​π​x\)\.\\displaystyle=0\.30\+0\.18\\cos\(2\\pi x\+0\.4\)\-0\.06\\sin\(6\\pi x\)\.For eachq∈\{u,v\}q\\in\\\{u,v\\\}, we independently drawlog10⁡ϵq\\log\_\{10\}\\epsilon\_\{q\}uniformly onlog10⁡\[0\.005,0\.02\]\\log\_\{10\}\[0\.005,0\.02\],aq∼U⁡\[0\.2,0\.8\]a\_\{q\}\\sim U\[0\.2,0\.8\], andρq∼U⁡\[0\.8,1\.6\]\\rho\_\{q\}\\sim U\[0\.8,1\.6\]; each active coupling is drawn fromU⁡\[0\.1,0\.4\]U\[0\.1,0\.4\]\. The three meta\-training structures are uncoupled \(κu​v=κv​u=0\\kappa\_\{uv\}=\\kappa\_\{vu\}=0\),v→uv\\to uonly \(κu​v\>0,κv​u=0\\kappa\_\{uv\}\>0,\\kappa\_\{vu\}=0\), andu→vu\\to vonly \(κu​v=0,κv​u\>0\\kappa\_\{uv\}=0,\\kappa\_\{vu\}\>0\)\. Within a meta\-training step, they share one draw of the six local coefficients and the same collocation batch\. The four test systems activate both couplings\. The residual convention makes the advection term positive on the left\-hand side and the active coupling term negative; the equivalent evolution equations have−aq∂xq\-a\_\{q\}\\partial\_\{x\}qand positive cross\-field sources\.

Table 5:Four held bidirectionally coupled Fisher–KPP coefficient settings\.The backbone has width 96, three coded factor layers,tanhactivation, orthogonal basis initialization, and spatial Fourier features at frequencies1,2,3,41,2,3,4\. The initial condition is imposed exactly as\(u,v\)=\(u0,v0\)\+t​fθ​\(x,t\)\(u,v\)=\(u\_\{0\},v\_\{0\}\)\+tf\_\{\\theta\}\(x,t\)\. Training seeds are101,202,303,404,505101,202,303,404,505\. Meta\-training uses 3,000 Adam steps at5×10−45\\times 10^\{\-4\}; deployment uses 3,000 steps at2×10−42\\times 10^\{\-4\}\. Both phases resample 1,024 interior points per step, clip the gradient norm at 10, weight the two residuals equally, and set the basis penalty to zero\. Scratch uses the same width\-96 backbone without an encoder and is optimized under the same deployment objective, test settings, sampled batches, and 3,000\-step budget\. We evaluate every 100 steps\. Descriptor configurations are specified in App\.[A\.2](https://arxiv.org/html/2609.19915#A1.SS2.SSS0.Px2)\.

Reference fields use a float64 periodic Fourier method of lines on a 256\-point spatial grid with 101 uniform output times, integrated by BDF with relative tolerance10−910^\{\-9\}, absolute tolerance10−1110^\{\-11\}, and maximum step0\.020\.02\. The relative difference between reference fields computed on 128\- and 256\-point grids is less than10−1210^\{\-12\}\. References are used only for evaluation\.

### B\.4CCP: fixed\-structure coefficient variation

The one\-dimensional continuity–Poisson model of Eq\. \([4](https://arxiv.org/html/2609.19915#S4.E4)\)\([Jing et al\., 2026a](https://arxiv.org/html/2609.19915#bib.bib6)\)evolves densityNNand potentialΦ\\Phionξ∈\[0,1\]\\xi\\in\[0,1\], with RF phaseτ∈\[0,1\]\\tau\\in\[0,1\]\. Potential drives density transport, and density supplies the Poisson source\. The structure is fixed throughout this benchmark\.

##### Nondimensionalization and constraints\.

Withnio=R0​\(x2−x1\)/csn\_\{\\mathrm\{io\}\}=R\_\{0\}\(x\_\{2\}\-x\_\{1\}\)/c\_\{s\},

aD=D​TL2,aμ=μ​V0​TL2,β=e​nio​L2ε0​V0,S⁡\(ξ\)=S0​I​\(ξ\),S0=R0​Tnio,a\_\{D\}=\\frac\{DT\}\{L^\{2\}\},\\qquad a\_\{\\mu\}=\\frac\{\\mu V\_\{0\}T\}\{L^\{2\}\},\\qquad\\beta=\\frac\{e\\,n\_\{\\mathrm\{io\}\}L^\{2\}\}\{\\varepsilon\_\{0\}V\_\{0\}\},\\qquad S\(\\xi\)=S\_\{0\}I\(\\xi\),\\quad S\_\{0\}=\\frac\{R\_\{0\}T\}\{n\_\{\\mathrm\{io\}\}\},whereIIis the indicator of\[0\.2,0\.4\]∪\[0\.6,0\.8\]\[0\.2,0\.4\]\\cup\[0\.6,0\.8\]andx2−x1=0\.2​Lx\_\{2\}\-x\_\{1\}=0\.2L\. Thusβ∝R0/V0\\beta\\propto R\_\{0\}/V\_\{0\}, whileS0=T​cs/\(x2−x1\)S\_\{0\}=Tc\_\{s\}/\(x\_\{2\}\-x\_\{1\}\)is independent ofR0R\_\{0\}\. The physical constants areL=0\.025L=0\.025m,f=13\.56f=13\.56MHz,T=1/fT=1/f,Te=3\.0T\_\{e\}=3\.0eV,νm=108​s−1\\nu\_\{m\}=10^\{8\}\\,\\mathrm\{s\}^\{\-1\}, andmi=40m\_\{i\}=40amu, withμ=e/\(me​νm\)\\mu=e/\(m\_\{e\}\\nu\_\{m\}\),D=μ​TeD=\\mu T\_\{e\}, andcs=e​Te/mic\_\{s\}=\\sqrt\{eT\_\{e\}/m\_\{i\}\}\. There is no initial\-condition constraint\. Spatial boundary values are imposed through

N=ξ⁡\(1−ξ\)​egN,Φ=ξ​sin⁡\(2​π​τ\)\+ξ⁡\(1−ξ\)​gΦ\.N=\\xi\(1\-\\xi\)e^\{g\_\{N\}\},\\qquad\\Phi=\\xi\\sin\(2\\pi\\tau\)\+\\xi\(1\-\\xi\)g\_\{\\Phi\}\.

##### Reference bank and evaluation cases\.

The reference bank coversV0∈\{130,200,270\}V\_\{0\}\\in\\\{130,200,270\\\}V andR0∈\{1,2,3\.5,5\}×1020​m−3​s−1R\_\{0\}\\in\\\{1,2,3\.5,5\\\}\\times 10^\{20\}\\,\\mathrm\{m\}^\{\-3\}\\mathrm\{s\}^\{\-1\}\. It uses 200 finite\-volume cells \(201 nodes\), backward Euler with Scharfetter–Gummel fluxes, 2,000 time steps per RF period, three Gummel sweeps per step, and 40 periods, storing 200 time levels from the final period\. The bank filter rejects nonfinite values, a mid\-domain bulk meanN<0\.7N<0\.7, ormax⁡\|Φ\|\>3\\max\|\\Phi\|\>3\. We evaluate the two interior cellsV0=200V\_\{0\}=200V,R0∈\{2,3\.5\}×1020​m−3​s−1R\_\{0\}\\in\\\{2,3\.5\\\}\\times 10^\{20\}\\,\\mathrm\{m\}^\{\-3\}\\mathrm\{s\}^\{\-1\}\. Training samples the continuous enclosing box without excluding these neighborhoods, so this is coefficient interpolation, not a held region or held topology\.

#### B\.4\.1Five\-seed training and deployment

The width\-96 backbone has three coded layers and coordinate input\[ξ,sin⁡\(2​π​τ\),cos⁡\(2​π​τ\)\]\[\\xi,\\sin\(2\\pi\\tau\),\\cos\(2\\pi\\tau\)\], enforcing RF periodicity exactly\. Seeds 0–4 each receive 3,000 meta\-training steps and 3,000 full\-adaptation steps; Scratch receives the same deployment budget without meta\-training\. Both phases use Adam at2\.5×10−42\.5\\times 10^\{\-4\}and 1,024 fresh interior points per step; evaluation occurs every 100 deployment steps\. The weighted residual loss uses\(wN,wΦ\)=\(0\.003,0\.997\)\(w\_\{N\},w\_\{\\Phi\}\)=\(0\.003,0\.997\)\. The orthogonality penalty is added once after combining residual losses, with weight10−410^\{\-4\}during meta\-training and zero during deployment\. The coefficient sampler usesV0∈\[130,270\]V\_\{0\}\\in\[130,270\]and logarithmicR0∈\[1020,5×1020\]R\_\{0\}\\in\[10^\{20\},5\\times 10^\{20\}\], holding its centre\-out radius at zero through step 750 and reaching the full box at step 2,250\. The operator graph applies two non\-residual update rounds\.

## Appendix CSupplementary comparisons

### C\.1CDR: term composition and seed variation

Figure[6](https://arxiv.org/html/2609.19915#A3.F6)complements Table[2](https://arxiv.org/html/2609.19915#S5.T2)with the ten seed means\. Set and Graph perform similarly in both high\-reaction protocols; including AR/ADR during meta\-training lowers their errors and seed variation\.

Figure 6:CDR oracle\-best error: five\-to\-two \(left\) and all\-seven training \(right\)\. Circles average eight AR/ADR cases within each seed; diamonds average ten seeds\.##### Fixed\-budget endpoints\.

Table[6](https://arxiv.org/html/2609.19915#A3.T6)reports the step\-3000 errors for the same ten seeds and eight AR/ADR cases as Table[2](https://arxiv.org/html/2609.19915#S5.T2), without checkpoint selection\. Both term\-based descriptors retain substantially lower mean errors than Vector\. All\-seven training again lowers their errors and seed variation; Graph does not consistently outperform Set across the two protocols\.

Table 6:High\-reaction CDR finalrel​L2\\mathrm\{rel\}L\_\{2\}at step 3000: mean±\\pmsample SD over ten seed means, each averaging the same eight cases as Table[2](https://arxiv.org/html/2609.19915#S5.T2)\.In the lower\-reaction five\-to\-two protocol of App\.[B\.2\.1](https://arxiv.org/html/2609.19915#A2.SS2.SSS1), the oracle\-best means are0\.0210±0\.00750\.0210\\pm 0\.0075\(Vector\),0\.0119±0\.00310\.0119\\pm 0\.0031\(Set\), and0\.0312±0\.02330\.0312\\pm 0\.0233\(Graph\), each averaging six cases within a seed and then ten seeds\. Together, these comparisons support term\-based conditioning in high\-reaction CDR, with no consistent Graph advantage over Set across the evaluated regimes\.

### C\.2Fisher–KPP: accuracy and coefficient\-presence control

Table[7](https://arxiv.org/html/2609.19915#A3.T7)reports final and oracle\-best errors for the five\-seed coupling\-composition experiment\. The extra vector control adds presence indicators to distinguish an absent coupling from a mean\-valued active coefficient\. It improves the mean error relative to the unmasked vector, while the operator graph retains the lowest mean error\.

Table 7:Fisher–KPP relative errors in units of10−310^\{\-3\}: mean±\\pmsample SD over five seed means\. Final uses step 3000; oracle\-best uses each case’s lowest scheduled error\.##### Consistency across held cases and fields\.

Table[8](https://arxiv.org/html/2609.19915#A3.T8)separates the same five\-seed cohort by held instance\. Graph has lower mean final error than Set and Vector on each of H1–H4\. Across matched case–seed pairs, Graph is lower than Set in 18/20 and lower than Vector in 20/20; these pairs comprise five independent training seeds, not 20\. The Graph–Set ordering also holds separately for each field after averaging the four cases within each seed: the five\-seed means are1\.3061\.306versus2\.2332\.233foruuand2\.2662\.266versus3\.3263\.326forvv, all in units of10−310^\{\-3\}\. Thus the aggregate improvement is not confined to one held case or one field\.

Table 8:Fisher–KPP final error by held case, in units of10−310^\{\-3\}\. Mean±\\pmsample SD over five seeds, averaging the two fieldwise errors\.

### C\.3Fisher–KPP: ownership\-aware term conditioning

To test whether explicit field/equation assignments suffice for the term set, we add two target\-equation indicators and eight source\-factor multiplicities to its six\-attribute token\. This 16\-attribute token uses the same DeepSets pooling and field\-conditioned readout, without graph adjacency\. The control uses seeds 101, 202, and 303 with the backbone, budgets, and within\-seed coefficient/collocation streams of App\.[B\.3](https://arxiv.org/html/2609.19915#A2.SS3)\. These seed IDs overlap the five\-seed comparison\.

Table 9:Ownership control: final relative error at step 3000, in units of10−310^\{\-3\}\. Mean±\\pmsample SD over three seed means, each averaging H1–H4 and both fields\.Adding ownership attributes does not close the gap to the graph under this budget\. This comparison concerns complete encoders, including their processing and readouts\.

### C\.4Fisher–KPP: message\-passing depth

We test whether the graph\-conditioned initialization and its subsequent adaptation benefit from additional message\-passing rounds\. This ablation varies the recurrence countK∈\{1,2,3,4,5\}K\\in\\\{1,2,3,4,5\\\}in the encoder of §[3](https://arxiv.org/html/2609.19915#S3), retaining the operator graph, node features, readout, and PINN backbone\. The sameKKis used in meta\-training and when encoding a held equation\. Because the update weights are shared across rounds, all depths have 132,866 parameters\.

##### Matched protocol\.

We use the Fisher–KPP split, coefficient distribution, hard initial/periodic constraints, and optimization settings of App\.[B\.3](https://arxiv.org/html/2609.19915#A2.SS3)\. Seeds101,202,303,404,505101,202,303,404,505each define five depth models with identical initial parameter tensors and coefficient/collocation streams within the seed\. Every model receives 3,000 meta\-training updates, followed by 3,000 full\-adaptation updates on each of H1–H4, starting from a fresh model copy for every case\. TheK=2K=2setting matches the main graph comparison\. We evaluate initialization and steps 500 and 3000, first averaging relative errors over both fields and four held cases within a seed, then reporting the mean and sample SD across seeds\.

Table 10:Matched\-depth Fisher–KPP ablation\. RelativeL2L\_\{2\}error in units of10−310^\{\-3\}: mean±\\pmsample SD over five seed means\.Figure 7:Depth sensitivity at initialization and two adaptation checkpoints\. Thin lines connect the five depth models within each seed; the bold line and whiskers show the mean and sample SD\. Training and test depths are matched\. Vertical scales differ across checkpoints\.
##### Depth sensitivity\.

Table[10](https://arxiv.org/html/2609.19915#A3.T10)and Fig\.[7](https://arxiv.org/html/2609.19915#A3.F7)show lower mean error at five rounds than at two: reductions of21\.0%21\.0\\%at initialization,39\.5%39\.5\\%after 500 updates, and26\.6%26\.6\\%after 3000\. The paired five\-versus\-two comparison improves all five seeds at the first two checkpoints and four of five at the last; seed 202 has lower final error at two rounds\. Intermediate depths do not improve monotonically in every seed\. Thus additional graph processing can improve fixed\-budget adaptation at unchanged parameter count, while the benefit varies across training runs\. This comparison holds optimizer updates fixed, not compute time: deeper encoding requires more computation\.

As a separate equation\-consistency diagnostic, we measure mean squared residual over both equations on a fixed32×3232\\times 32midpoint grid, then average H1–H4 within each seed\. At step 3000, residual MSE decreases from\(6\.907±2\.565\)×10−5\(6\.907\\pm 2\.565\)\\times 10^\{\-5\}atK=2K=2to\(3\.623±0\.994\)×10−5\(3\.623\\pm 0\.994\)\\times 10^\{\-5\}atK=5K=5\. This diagnostic uses no reference solution values and is distinct from the relative solution error above\.

Figure[8](https://arxiv.org/html/2609.19915#A3.F8)complements the aggregate comparison with the H1 fields\. The predictions recover the main spatiotemporal structure at every depth, while the error maps reveal remaining local differences\. Scalar results in Table[10](https://arxiv.org/html/2609.19915#A3.T10)use the full reference grid and all four held cases\.

![Refer to caption](https://arxiv.org/html/2609.19915v1/iclr2027_fisher_depth_predictions.png)

![Refer to caption](https://arxiv.org/html/2609.19915v1/iclr2027_fisher_depth_errors.png)

Figure 8:H1 after 3000 adaptation steps\. Top: reference and predicted fields for the predeclared seed 101, with one shared field\-value scale per row\. Bottom: reference fields and the five\-seed mean of pointwise absolute errors, computed before averaging seeds\. Each pair of rows showsuuandvv\. In the bottom panel, the reference colorbar follows the left column; the error colorbar is at the far right\. All maps use linear rainbow scales, shared across depths within each field and quantity\. Display grids contain 128 spatial and 51 temporal points\.

## Appendix DCoefficient interpolation under different training samplers

The all\-seven CDR comparison in §[5\.2](https://arxiv.org/html/2609.19915#S5.SS2)shows that term\-based descriptors can configure accurate solvers at new coefficients of familiar structures\. Its meta\-training sampler gradually expands around coefficient\-grid nodes\. This raises a complementary question: does the observed accuracy require that particular sampling schedule, or does it persist when training sees either the full continuous range from the start or only the discrete grid? We address this question by fixing the training structures and varying the coefficient sampler\. The comparison concerns coefficient interpolation after physics\-based adaptation, rather than new term combinations\.

### D\.1Controlled coefficient\-interpolation setting

All three sampling conditions train on the seven CDR structures in Table[1](https://arxiv.org/html/2609.19915#S4.T1)\. They share the initial and boundary conditions, reference solver, descriptor definitions, and coefficient grid of Apps\.[B\.2](https://arxiv.org/html/2609.19915#A2.SS2)and[A\.2](https://arxiv.org/html/2609.19915#A1.SS2.SSS0.Px1)\. For each active axis, a grid node is sampled and perturbed within a fractionα⁡\(m\)\\alpha\(m\)of its half\-spacing at meta\-stepmm, with clipping at the axis limits\. Diffusion is sampled inlog10⁡D\\log\_\{10\}D\. The three conditions are:

- •*Scheduled jitter*:α⁡\(m\)=0\\alpha\(m\)=0through step 8,000, then increases linearly to one by step 24,000 and remains one through step 30,000\.
- •*Full jitter*:α⁡\(m\)=1\\alpha\(m\)=1throughout training, so the continuous coefficient box is accessible from the first step\.
- •*Grid\-only*:α⁡\(m\)=0\\alpha\(m\)=0throughout training, so only the discrete nodes are accessible\.

At full radius, neighboring perturbation intervals meet; the clipped sampling distribution need not be uniform\. Scheduled and full jitter have the same eventual support but different exposure to intermediate values during training\. Grid\-only retains the range endpoints and all grid nodes while removing the intervening continuous support\.

##### Shared optimization protocol\.

This supplementary experiment uses the width\-256 backbone with three coded layers, two graph\-update rounds, 30,000 meta\-training steps, and 3,000 full\-adaptation steps\. Adam uses learning rate2\.5×10−42\.5\\times 10^\{\-4\}in both phases\. Each loss evaluation resamples 20,000 interior points, 1,000 initial points, and 1,000 periodic\-boundary pairs\. Residual, initial, and periodic\-value losses have unit weights; the basis\-orthogonality weight is10−410^\{\-4\}during meta\-training and zero during adaptation\. Meta\-training averages the losses of all seven structures and adds the basis penalty once\. Descriptor preprocessing and architecture are held fixed across samplers\. These larger collocation batches distinguish this experiment from the ten\-seed main comparison; its results are reported separately\.

##### Evaluation cases and aggregation\.

The 12 high\-reaction cases comprise reaction and diffusion–reaction atr∈\{8\.5,9\.5\}r\\in\\\{8\.5,9\.5\\\}, and AR/ADR ata∈\{4\.5,9\.5\}×r∈\{8\.5,9\.5\}a\\in\\\{4\.5,9\.5\\\}\\times r\\in\\\{8\.5,9\.5\\\}\. Diffusion\-bearing cases useD=0\.01D=0\.01\. Both test reaction rates lie strictly between adjacent training nodes7\.757\.75and1010, while the test advection and diffusion values are grid nodes\. Thus grid\-only deployment specifically tests interpolation in reaction strength, without changing the equation structures or extrapolating beyond the coefficient ranges\.

We evaluate every 200 adaptation steps and use each case’s oracle\-bestrel​L2\\mathrm\{rel\}L\_\{2\}within the budget, including initialization\. Table[11](https://arxiv.org/html/2609.19915#A4.T11)averages the 12 case errors within each seed and then across seeds\. Its hit fraction is the proportion of case–seed deployments with oracle\-bestrel​L2<0\.3\\mathrm\{rel\}L\_\{2\}<0\.3; reference fields enter only this evaluation, not training or online stopping\. Scheduled and full jitter use three seeds per descriptor\. Grid\-only uses six seeds for Set and Graph and three for Vector\. Each seed contributes the same 12 cases within a condition, and unsuccessful deployments remain in both the error and hit summaries\.

### D\.2Gradual widening is not required for low error

Table[11](https://arxiv.org/html/2609.19915#A4.T11)compares accuracy under the three samplers\. With scheduled jitter, Set and Graph both have mean error0\.0100\.010and every evaluated deployment reaches the stated threshold\. Full jitter gives closely similar errors,0\.0130\.013for Set and0\.0120\.012for Graph, with the same hit fractions\. Their low errors therefore persist when the continuous coefficient range is available from the beginning\. The gradual\-widening schedule is not required for this outcome under the tested budget\.

Table 11:CDR coefficient\-sampling comparison: mean oracle\-bestrel​L2\\mathrm\{rel\}L\_\{2\}and hit fraction \(rel​L2<0\.3\\mathrm\{rel\}L\_\{2\}<0\.3\)\. Scheduled/full jitter use three seeds per method; grid\-only uses three Vector and six Set/Graph seeds, with 12 cases per seed\.The coefficient vector also responds to the sampler: its mean error falls from0\.9580\.958with scheduled jitter to0\.3300\.330with full jitter, and its hit fraction increases from zero to0\.670\.67\. It still has higher error than the term\-based descriptors\. This comparison shows that sampling choices can change the size of a descriptor gap; the term\-based advantage in this experiment is nevertheless present under both continuous\-support conditions\.

### D\.3Grid\-only training exposes seed variation

Removing continuous coefficient support separates Set and Graph in this cohort\. The graph’s mean error remains0\.0100\.010, while Set’s mean increases to0\.2000\.200\. The seed\-level counts in Table[12](https://arxiv.org/html/2609.19915#A4.T12)show why the aggregate gap should not be read as uniformly worse Set performance: four of its six training seeds reach the threshold on all 12 cases, one reaches it on nine, and one on none\. Graph reaches it on all 12 cases for each of six seeds\.

Table 12:Grid\-only deployments with oracle\-bestrel​L2<0\.3\\mathrm\{rel\}L\_\{2\}<0\.3, out of 12 per seed\. The total combines deployments, not independent training runs\.Within the shared seed IDs 0–2, the counts are36/3636/36for Graph,21/3621/36for Set, and0/360/36for Vector\. In the additional seeds 3–5, both Set and Graph reach36/3636/36\. The pooled hit\-fraction gap therefore comes from two of the six Set training seeds, rather than a loss of accuracy in every seed\. Seed IDs are shared across descriptors, but different architectures do not produce pointwise\-matched collocation streams\.

##### Implication and scope\.

Together, these controls support two specific observations: low Set/Graph error persists without gradual widening, and Graph is more consistent across the sampled seeds when meta\-training sees only grid coefficients\. Both observations concern solver adaptation to intermediate reaction rates within familiar equation structures and a bounded coefficient range\. Each target solver receives 3,000 physics\-based updates\. These results complement the coupling\-composition experiment by showing how numerical coefficient exposure affects adaptation under the three conditioning schemes\.

## Appendix EOptimization steps and amortization

##### Reaching a common solution accuracy\.

A separate lower\-reactioncdrexperiment measures the optimization head\-start provided by equation\-conditioned initialization\. Five structures are used for meta\-training, with advection–reaction and advection–diffusion–reaction held out\. Training samplesa∈\[2,4\]a\\in\[2,4\],r∈\[1,4\]r\\in\[1,4\], andlog10⁡D∈\[−3,−1\]\\log\_\{10\}D\\in\[\-3,\-1\]for active terms\. Each method uses three independent seeds, a width\-256 backbone with three coded layers, and full target\-specific adaptation\. The amortized methods receive 20,000 meta\-training updates, each averaging one sampled problem per training structure\. Physics losses use 25,000 interior, 1,000 initial, and 1,000 periodic samples, with Adam at2\.5×10−42\.5\\times 10^\{\-4\}\. Deployment runs for 5,000 updates, evaluating the reference\-grid error every 200 updates, including initialization\. This cohort is separate from the ten\-seed comparisons in App\.[B\.2\.1](https://arxiv.org/html/2609.19915#A2.SS2.SSS1)\.

For each deployment,n0\.1n\_\{0\.1\}is the first scheduled update withrel​L2≤0\.1\\mathrm\{rel\}L\_\{2\}\\leq 0\.1\. Table[13](https://arxiv.org/html/2609.19915#A5.T13)reports its median among successful deployments, together with the fraction reaching the threshold\. The control contains ten held\-coefficient cases per seed on seen structures; the structural test contains six cases per seed on the two held structures\. Reference errors determine these evaluation statistics only; they are not used for training or online stopping\.

Table 13:cdrupdates torel​L2≤0\.1\\mathrm\{rel\}L\_\{2\}\\leq 0\.1: three seeds, with 30 control and 18 held\-structure deployments per method\. Medians condition on threshold attainment; reach fractions are rounded\.On held structures, the graph requires 600 rather than 2200 median updates, giving a ratio of3\.673\.67\. The vector and set also reduce the required updates\. Across seeds, the mean and population standard deviation of the within\-seed medians are2267±1702267\\pm 170for scratch,833±125833\\pm 125for Vector,467±125467\\pm 125for Set, and633±340633\\pm 340for Graph\. These results support an amortized optimization head\-start, while the Fisher–KPP comparison in §[5\.3](https://arxiv.org/html/2609.19915#S5.SS3)addresses the additional value of relational conditioning\.

These are update\-count comparisons: a grouped meta\-training update processes five PDE instances, whereas a deployment update processes one\. Matched\-device Fisher–KPP timings are reported separately in App\.[F](https://arxiv.org/html/2609.19915#A6)\.

## Appendix FConditional\-decoder comparison

### F\.1A matched\-budget external method

The descriptor comparison in §[5\.3](https://arxiv.org/html/2609.19915#S5.SS3)fixes the solver backbone\. Here we compare the complete graph\-conditioned solver with a conditional decoder following[Iwata et al\. \(2023\)](https://arxiv.org/html/2609.19915#bib.bib12), whose equation and condition encoders produce a latent input to a sinusoidal solution network\. Its deployment phase refines a copied decoder and this latent while keeping the encoder fixed\. Both approaches therefore share physics information across equations and retain target\-specific refinement, but use different solver architectures\.

We extend the polynomial coefficient dictionary to the two Fisher fields\. For each residual, the variables\(u,ut,ux,ut​t,ut​x,ux​x,v,vt,vx,vt​t,vt​x,vx​x\)\(u,u\_\{t\},u\_\{x\},u\_\{tt\},u\_\{tx\},u\_\{xx\},v,v\_\{t\},v\_\{x\},v\_\{tt\},v\_\{tx\},v\_\{xx\}\)give one constant, 12 linear and 78 quadratic monomials\. Concatenating the two residual rows gives 182 signed coefficients, with absent monomials represented by zero\. The condition encoder pools 64 prescribed initial point–value pairs; the initial profiles are fixed across this benchmark\. Four\-layer ReLU networks encode coefficients and condition points, followed by pooling and a linear combination layer\. A coordinate projection and the latent feed a five\-layer sine decoder with residual hidden connections\.

All methods use the Fisher task distribution, periodic coordinate features, hard initial\-condition construction, physics objective and optimizer budgets of App\.[B\.3](https://arxiv.org/html/2609.19915#A2.SS3)\. The conditional decoder uses hidden and latent width 82, chosen by parameter count: 132,514 parameters versus 132,866 for Graph\. Its decoder has 34,934 parameters; the remainder belongs to the encoder\. Linear layers use the PyTorch default initialization\. We refer to this two\-field, parameter\-matched implementation as*Iwata\-style*: the source paper uses scalar equations, Dirichlet conditions, width 256 and a different training distribution\. This comparison evaluates complete methods at a matched total parameter budget, alongside the fixed\-backbone descriptor controls in the main text\.

The external\-method cohort runs Iwata\-style, two\-round Graph and scratch serially on one NVIDIA GB10 with PyTorch 2\.10\.0a0 and CUDA 13, float32, without AMP or TF32\. Each method uses seeds 101, 202, 303, 404 and 505, the same per\-seed coefficient and collocation streams, 3,000 grouped meta\-updates for the trained methods, and 3,000 adaptation updates on each of H1–H4\. All comparisons in this section use this cohort; the CPU descriptor results in the main text remain a separate experiment\.

Table 14:Matched\-device Fisher–KPP external\-method comparison\. RelativeL2L\_\{2\}errors in units of10−310^\{\-3\}: mean±\\pmsample SD over five seed means\.Table[14](https://arxiv.org/html/2609.19915#A6.T14)shows lower initialization error for Iwata\-style, but lower Graph error after 500 and 3000 updates\. At the final checkpoint, Graph reduces the mean by44\.6%44\.6\\%relative to Iwata\-style, with lower case\-averaged error in all five seeds\. Thus the ordering of initial predictions differs from that after physics refinement\.

##### Measured solve cost\.

Meta\-training takes356\.1±16\.5356\.1\\pm 16\.5seconds for Graph and285\.9±17\.0285\.9\\pm 17\.0seconds for Iwata\-style \(mean±\\pmsample SD across five seeds\)\. All methods reachrel​L2≤0\.1\\mathrm\{rel\}L\_\{2\}\\leq 0\.1on all 20 deployments; Graph’s mean online time to the first scheduled hit is4\.12±0\.244\.12\\pm 0\.24seconds per problem, versus16\.54±1\.8416\.54\\pm 1\.84from scratch, while Iwata\-style has lower online cost than Graph at this loose target\. CUDA\-synchronized online time includes encoding, target setup and optimization, but excludes reference generation and diagnostic evaluation\. Threshold hits are evaluated every 100 updates, including initialization, retrospectively over the full 3,000\-update trajectories rather than used as an online stopping rule\.

Similar Articles