When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study
Summary
This study investigates the benefits of frequency decomposition for Physics-Informed Neural Networks (PINNs) by proposing a dual-branch, spectrally-gated architecture (DBSG-PINN). Ablation experiments on 1D PDE benchmarks indicate that frequency decomposition is most effective on spectrally complex problems, reducing error by up to 59.2%.
View Cached Full Text
Cached at: 08/27/26, 09:27 AM
# When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study
Source: [https://arxiv.org/html/2608.24940](https://arxiv.org/html/2608.24940)
August 14, 2026
###### Abstract
Partial differential equations \(PDEs\) often have high\-frequency and multi\-scale features that neural networks struggle to approximate\. Physics\-Informed Neural Networks \(PINNs\) build the governing equations directly into training, but suffer from*spectral bias*: they learn low\-frequency components faster than high\-frequency ones\. Techniques such as Fourier feature embeddings and sinusoidal activations address this, but most studies assume they help across the board without checking which spectral regimes actually benefit\. We introduce a dual\-branch, spectrally\-gated architecture \(DBSG\-PINN\) that splits low\- and high\-frequency components into separate subnetworks joined by an adaptive gate, and use it to run a partially controlled ablation of frequency decomposition and spectral routing\. We test this on five one\-dimensional benchmark PDEs, ranging from smooth, single\-scale problems to oscillatory, multi\-scale ones\. Frequency decomposition helps most on the spectrally complex benchmarks, cutting relativeL2L\_\{2\}error by up to59\.2%59\.2\\%on a multimodal wave problem, but gives little benefit on smoother PDEs\. On one benchmark \(1D Wave\), it performs substantially worse than a simpler fixed\-combination variant\. The gate’s benefit scales with how spectrally rich the target solution is: the full model’s advantage over the ablations is largest on multi\-scale benchmarks and smallest \(or negative\) on single\-scale ones, consistent with the gate exploiting frequency structure rather than acting as noise, though we do not directly visualize or quantify its spatial activations in this study\. All results come from a single training seed across five 1D benchmarks, so we present this as an exploratory study meant to raise questions rather than answer them, and outline the additional seeds and benchmarks needed to test whether the pattern holds\.
*Keywords*Physics Informed Neural Networks⋅\\cdotSpectral Bias⋅\\cdotFrequency Decomposition⋅\\cdotAblation Study⋅\\cdotPartial Differential Equations
## 1Introduction
Partial differential equations \(PDEs\) are the mathematical backbone for modelling physical, biological, and engineering systems, including fluid flow, heat transfer, wave propagation, diffusion, reaction kinetics, and electromagnetic phenomena\. Most of these equations come from conservation laws and first principles, yet closed\-form solutions exist only for a narrow class of idealized cases\. Once nonlinear dynamics, complex geometries, heterogeneous materials, or high\-dimensional parameter spaces enter the picture, an analytical solution is usually out of reach\. That is why numerical methods – finite differences, finite elements, spectral solvers – carry most of the load in practice\. They work, but not cheaply: mesh generation, repeated simulation runs, and heavy compute are the price, and that price gets steeper for inverse problems, uncertainty quantification, and parameter estimation\.
Scientific Machine Learning \(SciML\) takes a different route by folding the governing physical laws directly into a data\-driven model, rather than relying on observed data alone – the network is pushed toward physically consistent solutions without needing as much labelled data\. Physics\-Informed Neural Networks \(PINNs\)\([22](https://arxiv.org/html/2608.24940#bib.bib1)\)are probably the most influential framework to come out of this line of work for forward and inverse PDE problems: governing equations, boundary conditions, and initial conditions all get folded into the training objective through automatic differentiation, so whatever the network learns has to satisfy the underlying physics\. PINNs have since shown up in computational fluid dynamics, inverse modelling, biomedical engineering, and geophysical simulation, and are more or less a default tool in SciML at this point\([10](https://arxiv.org/html/2608.24940#bib.bib12);[2](https://arxiv.org/html/2608.24940#bib.bib17);[15](https://arxiv.org/html/2608.24940#bib.bib18)\)\.
That said, conventional PINNs are not without problems: optimization pathologies, imbalance between competing loss terms, and poor convergence on stiff or highly nonlinear PDEs have all been reported\([12](https://arxiv.org/html/2608.24940#bib.bib3);[27](https://arxiv.org/html/2608.24940#bib.bib4);[28](https://arxiv.org/html/2608.24940#bib.bib2)\)\.*Spectral bias*is probably the most studied of these – networks trained with gradient descent pick up low\-frequency components of a target function well before high\-frequency ones\.[21](https://arxiv.org/html/2608.24940#bib.bib13)first showed this in deep networks, and the Neural Tangent Kernel \(NTK\) later gave a reason why: low\-frequency functions line up with the dominant kernel eigenmodes and so converge faster\([6](https://arxiv.org/html/2608.24940#bib.bib14)\)\. In practice this means PINNs often struggle with localized discontinuities, sharp gradients, oscillatory behaviour, or several interacting spatial or temporal scales – wave propagation\([17](https://arxiv.org/html/2608.24940#bib.bib10)\), reaction–diffusion systems, and other high\-frequency or multi\-scale PDEs are where this tends to bite hardest\([19](https://arxiv.org/html/2608.24940#bib.bib8)\)\.
A number of frequency\-aware fixes have been proposed for spectral bias, and they roughly split into four camps\. One enriches the input itself: Fourier feature embeddings help a network approximate high\-frequency functions\([26](https://arxiv.org/html/2608.24940#bib.bib5)\), and the periodic activations in Sinusoidal Representation Networks \(SIREN\) do something similar for oscillatory signals and their derivatives\([24](https://arxiv.org/html/2608.24940#bib.bib6)\)\. A second camp works on the optimization process directly, through adaptive activation functions, adaptive loss balancing, and learning\-rate annealing\([8](https://arxiv.org/html/2608.24940#bib.bib7);[27](https://arxiv.org/html/2608.24940#bib.bib4)\)\. A third tackles scalability with domain decomposition – Conservative PINNs \(cPINNs\), Extended PINNs \(XPINNs\), and Finite Basis PINNs \(FBPINNs\) all split the domain into subregions to make optimization and local accuracy more tractable\([9](https://arxiv.org/html/2608.24940#bib.bib19);[7](https://arxiv.org/html/2608.24940#bib.bib15);[18](https://arxiv.org/html/2608.24940#bib.bib16)\)\. And a fourth leans on gating mechanisms or deeper residual architectures for scalability and stability\([25](https://arxiv.org/html/2608.24940#bib.bib9);[3](https://arxiv.org/html/2608.24940#bib.bib11)\)\. Between them, these advances have pushed the range of problems PINNs can handle considerably further\.
Despite this progress, most existing work focuses on building more sophisticated architectures to fight spectral bias, and pays less attention to*when*these mechanisms actually help\. Most frequency\-aware methods assume that richer spectral representations are broadly useful across PDE types\. But physical systems differ a lot in their spectral character: some PDEs are smooth and low\-frequency, while others involve localized oscillations, several interacting frequency modes, or complex multi\-scale dynamics\. This raises a natural question: does explicit frequency decomposition consistently improve accuracy, or does its value depend on the spectral character of the PDE? As far as we know, few studies have directly compared frequency\-decomposed architectures against matched\-capacity ablations across PDEs of varying spectral complexity\. That gap motivates the exploratory study we present here\.
To study this question, we build theDual\-Branch Spectral\-Gated Physics\-Informed Neural Network \(DBSG\-PINN\), a controlled experimental framework for examining the role of frequency decomposition in PINNs\. It consists of two subnetworks that each specialize in a different frequency regime: a low\-frequency branch using hyperbolic tangent activations to capture smooth solution components, and a high\-frequency branch using sinusoidal activations to model oscillatory behaviour\. Their outputs are combined by an adaptive gate that learns spatially varying mixing weights, letting the model balance the two representations according to local solution behaviour\. Each component can be removed without changing the optimization procedure or \(roughly\) the network’s capacity, which is what makes ablation studies possible: we can isolate the individual contributions of frequency decomposition and adaptive spectral routing\.
We test the framework on five benchmark PDEs spanning a range of spectral complexity: the Burgers equation, Reaction–Diffusion equation, Allen–Cahn equation, Wave equation, and a Multimodal Wave equation, ranging from smooth, single\-scale solutions to oscillatory, multi\-scale dynamics\. For each benchmark, we compare the full DBSG\-PINN against three ablation variants, made by removing the high\-frequency branch, the low\-frequency branch, or the adaptive gate on its own, while keeping network capacity and optimization settings matched as closely as the architecture allows\. This is meant to reduce, though not remove, the risk that any performance difference comes from model complexity or training strategy rather than frequency decomposition itself; we discuss what this control does and does not achieve in Section[4](https://arxiv.org/html/2608.24940#S4)\.
Across the five benchmarks, frequency decomposition clearly pays off on the spectrally complex ones: up to 59\.2% lower relativeL2L\_\{2\}error on Multimodal Wave, plus better spectral recovery there more broadly\. On the smoother, single\-scale problems the benefit shrinks or disappears – a simpler fixed\-combination variant edges out the full gated model on Burgers, and beats it outright on 1D Wave\. We want to be careful about what this does and does not show: these are observations from one seed across five benchmarks, not a general claim about frequency\-decomposed PINNs as a class\.
Beyond accuracy, we also looked at what the learned gate contributes across benchmarks\. Its benefit is largest on the benchmarks with the richest spectral content and smallest \(or negative\) on the simplest ones – a pattern consistent with the gate exploiting frequency structure rather than acting as noise, though we infer this from benchmark\-level comparisons rather than from a direct visualization of the gate’s spatial activations\. That said, this comes from one trained model per benchmark, and it needs independent verification – ideally including an explicit visualization ofg\(x,t\)g\(x,t\)against local spectral content – before we can call it a general property of the architecture\.
#### Our Contributions
- •We build DBSG\-PINN, a dual\-branch architecture combining low\- and high\-frequency subnetworks through an adaptive spectral gate\.
- •We design an ablation framework that removes the low\-frequency branch, high\-frequency branch, or gate individually, keeping training settings matched exactly and per\-branch capacity matched only approximately – depth and width are not identical between the low\- and high\-frequency branches on most benchmarks \(Section[2\.3](https://arxiv.org/html/2608.24940#S2.SS3)\)\.
- •We report an initial comparison across five 1D benchmark PDEs of varying spectral complexity – meant to surface a pattern worth investigating further, not to establish a general rule\.
- •We show a preliminary, benchmark\-level pattern in which the gate’s contribution scales with the spectral complexity of the target solution, though we do not directly visualize or quantify its spatial activations here\.
## 2Methodology
### 2\.1Physics\-Informed Neural Networks
PINNs belong to the broader class of Scientific Machine Learning \(SciML\) models that fold the governing physical laws directly into the training objective rather than relying only on labelled data\([22](https://arxiv.org/html/2608.24940#bib.bib1)\)\. Concretely, this means minimizing the residual of the governing PDE alongside the initial and boundary conditions, pushing the network toward solutions consistent with the underlying physics rather than merely fitting data points\.
Consider a general nonlinear PDE
∂u\(𝐱,t\)∂t\+𝒩\[u\(𝐱,t\)\]=0,\\frac\{\\partial u\(\\mathbf\{x\},t\)\}\{\\partial t\}\+\\mathcal\{N\}\[u\(\\mathbf\{x\},t\)\]=0,\(1\)
whereu\(𝐱,t\)u\(\\mathbf\{x\},t\)is the unknown solution,𝐱\\mathbf\{x\}is the spatial coordinate, and𝒩\(⋅\)\\mathcal\{N\}\(\\cdot\)is a nonlinear differential operator\.
The solution is approximated by a neural network
u\(𝐱,t\)≈uθ\(𝐱,t\),u\(\\mathbf\{x\},t\)\\approx u\_\{\\theta\}\(\\mathbf\{x\},t\),\(2\)
whereθ\\thetaare the trainable network parameters\.
Using automatic differentiation, the PDE residual is computed as
rθ\(𝐱,t\)=∂uθ\(𝐱,t\)∂t\+𝒩\[uθ\(𝐱,t\)\]\.r\_\{\\theta\}\(\\mathbf\{x\},t\)=\\frac\{\\partial u\_\{\\theta\}\(\\mathbf\{x\},t\)\}\{\\partial t\}\+\\mathcal\{N\}\[u\_\{\\theta\}\(\\mathbf\{x\},t\)\]\.\(3\)
All the spatial and temporal derivatives needed to evaluaterθ\(𝐱,t\)r\_\{\\theta\}\(\\mathbf\{x\},t\)come from automatic differentiation\([1](https://arxiv.org/html/2608.24940#bib.bib20)\), which computes exact derivatives through the network graph instead of relying on finite\-difference approximations\.
The overall PINN objective is a weighted sum of the governing\-equation residual and the initial and boundary condition losses,
ℒ=λrℒPDE\+λICℒIC\+λBCℒBC,\\mathcal\{L\}=\\lambda\_\{r\}\\mathcal\{L\}\_\{PDE\}\+\\lambda\_\{IC\}\\mathcal\{L\}\_\{IC\}\+\\lambda\_\{BC\}\\mathcal\{L\}\_\{BC\},\(4\)
The scalar weightsλr\\lambda\_\{r\},λIC\\lambda\_\{IC\}, andλBC\\lambda\_\{BC\}balance these terms\. Poorly chosen weights are a known cause of the gradient imbalance and stiffness problems reported in PINN training, which is why prior work has explored adaptive or self\-weighting schemes\([16](https://arxiv.org/html/2608.24940#bib.bib21);[28](https://arxiv.org/html/2608.24940#bib.bib2)\)\. Here we fix the weights per benchmark \(Table[6](https://arxiv.org/html/2608.24940#A1.T6)\) so that all ablation variants share the same loss landscape; we leave adaptive weighting for future work\.
where
ℒPDE=1Nr∑i=1Nr\|rθ\(𝐱i,ti\)\|2,\\mathcal\{L\}\_\{PDE\}=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\|r\_\{\\theta\}\(\\mathbf\{x\}\_\{i\},t\_\{i\}\)\\right\|^\{2\},\(5\)
and
ℒIC=1NIC∑i=1NIC\|uθ\(𝐱i,0\)−u0\(𝐱i\)\|2,\\mathcal\{L\}\_\{IC\}=\\frac\{1\}\{N\_\{IC\}\}\\sum\_\{i=1\}^\{N\_\{IC\}\}\\left\|u\_\{\\theta\}\(\\mathbf\{x\}\_\{i\},0\)\-u\_\{0\}\(\\mathbf\{x\}\_\{i\}\)\\right\|^\{2\},\(6\)
Equation[1](https://arxiv.org/html/2608.24940#S2.E1)is written as a first\-order\-in\-time PDE for generality, in which case the value term above is the only initial condition needed\. For the second\-order\-in\-time \(wave\-type\) benchmarks in Section[3](https://arxiv.org/html/2608.24940#S3)\(Multimodal Wave and 1D Wave\), the governing equation also specifies an initial velocityut\(𝐱,0\)=v0\(𝐱\)u\_\{t\}\(\\mathbf\{x\},0\)=v\_\{0\}\(\\mathbf\{x\}\)alongside the initial valueu\(𝐱,0\)=u0\(𝐱\)u\(\\mathbf\{x\},0\)=u\_\{0\}\(\\mathbf\{x\}\); we enforce both terms inℒIC\\mathcal\{L\}\_\{IC\},
ℒIC=1NIC∑i=1NIC\[\|uθ\(𝐱i,0\)−u0\(𝐱i\)\|2\+\|∂tuθ\(𝐱i,0\)−v0\(𝐱i\)\|2\],\\mathcal\{L\}\_\{IC\}=\\frac\{1\}\{N\_\{IC\}\}\\sum\_\{i=1\}^\{N\_\{IC\}\}\\left\[\\left\|u\_\{\\theta\}\(\\mathbf\{x\}\_\{i\},0\)\-u\_\{0\}\(\\mathbf\{x\}\_\{i\}\)\\right\|^\{2\}\+\\left\|\\partial\_\{t\}u\_\{\\theta\}\(\\mathbf\{x\}\_\{i\},0\)\-v\_\{0\}\(\\mathbf\{x\}\_\{i\}\)\\right\|^\{2\}\\right\],\(7\)with∂tuθ\(𝐱i,0\)\\partial\_\{t\}u\_\{\\theta\}\(\\mathbf\{x\}\_\{i\},0\)again obtained via automatic differentiation and both terms weighted equally withinℒIC\\mathcal\{L\}\_\{IC\}\. For the first\-order\-in\-time benchmarks \(Burgers, Allen–Cahn, Reaction–Diffusion\), only the value term applies, as in the equation above\.
ℒBC=1NBC∑i=1NBC\|uθ\(𝐱i,ti\)−g\(𝐱i,ti\)\|2\.\\mathcal\{L\}\_\{BC\}=\\frac\{1\}\{N\_\{BC\}\}\\sum\_\{i=1\}^\{N\_\{BC\}\}\\left\|u\_\{\\theta\}\(\\mathbf\{x\}\_\{i\},t\_\{i\}\)\-g\(\\mathbf\{x\}\_\{i\},t\_\{i\}\)\\right\|^\{2\}\.\(8\)
Following common practice in the PINN literature, we minimizeℒ\\mathcal\{L\}in two stages: a first\-order Adam optimizer\([11](https://arxiv.org/html/2608.24940#bib.bib22)\)handles rapid initial descent, then a second\-order L\-BFGS optimizer\([13](https://arxiv.org/html/2608.24940#bib.bib23)\)refines convergence near the minimum\. Table[6](https://arxiv.org/html/2608.24940#A1.T6)reports the iteration budgets used for each benchmark\.
### 2\.2Proposed DBSG\-PINN Architecture
The Dual\-Branch Spectral\-Gated Physics\-Informed Neural Network \(DBSG\-PINN\) splits the approximation of low\- and high\-frequency solution components into two subnetworks, combined by a learned gate\. The input coordinates\(x,t\)\(x,t\)go in parallel to all three subnetworks — the low\-frequency branch, the high\-frequency branch, and the gate network — which are trained jointly, end to end, by backpropagating the composite loss \(Eq\.[4](https://arxiv.org/html/2608.24940#S2.E4)\) through the combined output\. No branch is pretrained or frozen on its own\.
The low\-frequency branch is represented as
ulo=flo\(𝐱,t,θlo\),u\_\{\\mathrm\{lo\}\}=f\_\{\\mathrm\{lo\}\}\(\\mathbf\{x\},t;\\theta\_\{\\mathrm\{lo\}\}\),\(9\)
whereflo\(⋅\)f\_\{\\mathrm\{lo\}\}\(\\cdot\)uses hyperbolic tangent activations — a standard smooth nonlinearity backed by classical universal approximation results for feedforward networks\([4](https://arxiv.org/html/2608.24940#bib.bib24)\)— to model smooth solution components\.
Similarly, the high\-frequency branch is defined as
uhi=fhi\(𝐱,t,θhi\),u\_\{\\mathrm\{hi\}\}=f\_\{\\mathrm\{hi\}\}\(\\mathbf\{x\},t;\\theta\_\{\\mathrm\{hi\}\}\),\(10\)
wherefhi\(⋅\)f\_\{\\mathrm\{hi\}\}\(\\cdot\)uses sinusoidal activations to better represent oscillatory and multi\-scale features, following the periodic\-activation design of SIREN\-style networks\([24](https://arxiv.org/html/2608.24940#bib.bib6)\)\.
We use “low\-frequency” and “high\-frequency branch” as shorthand for each branch’s intended inductive bias – smoothtanh\\tanhnonlinearities versus oscillatorysin\(ωx\)\\sin\(\\omega x\)activations at a fixed frequencyω\\omega– not as a formal spectral decomposition\. Nothing in the architecture constrainsulou\_\{\\mathrm\{lo\}\}to contain only low\-frequency content oruhiu\_\{\\mathrm\{hi\}\}to contain only high\-frequency content: either branch is, in principle, free to represent any function its activation function and depth allow, and the gate is what determines how much each contributes at a given\(x,t\)\(x,t\)\. Throughout this paper we use “frequency decomposition” to mean this soft, activation\-driven inductive bias, not a guarantee of exact spectral separation\.
To combine the two representations, a lightweight gating network predicts an adaptive weighting coefficient, in the spirit of mixture\-of\-experts architectures that route between subnetworks with a trained gate\([5](https://arxiv.org/html/2608.24940#bib.bib25);[23](https://arxiv.org/html/2608.24940#bib.bib26)\)\. Those architectures usually gate more than two experts and so use a softmax; since DBSG\-PINN mixes exactly two branches, we use a scalar sigmoid gate instead,
g\(𝐱,t\)=σ\(fg\(𝐱,t,θg\)\),g\(\\mathbf\{x\},t\)=\\sigma\\left\(f\_\{g\}\(\\mathbf\{x\},t;\\theta\_\{g\}\)\\right\),\(11\)
whereσ\(⋅\)\\sigma\(\\cdot\)is the sigmoid activation function, so that
0≤g\(𝐱,t\)≤1\.0\\leq g\(\\mathbf\{x\},t\)\\leq 1\.\(12\)
The final prediction is a convex combination of the two branches,
uθ\(𝐱,t\)=g\(𝐱,t\)uhi\(𝐱,t\)\+\(1−g\(𝐱,t\)\)ulo\(𝐱,t\)\.u\_\{\\theta\}\(\\mathbf\{x\},t\)=g\(\\mathbf\{x\},t\)u\_\{\\mathrm\{hi\}\}\(\\mathbf\{x\},t\)\+\\left\(1\-g\(\\mathbf\{x\},t\)\\right\)u\_\{\\mathrm\{lo\}\}\(\\mathbf\{x\},t\)\.\(13\)
The PDE residual for this architecture is therefore
rθ\(𝐱,t\)=∂uθ∂t\+𝒩\[uθ\],r\_\{\\theta\}\(\\mathbf\{x\},t\)=\\frac\{\\partial u\_\{\\theta\}\}\{\\partial t\}\+\\mathcal\{N\}\[u\_\{\\theta\}\],\(14\)
where, again, all derivatives come from automatic differentiation\. Figure[1](https://arxiv.org/html/2608.24940#S2.F1)shows the overall framework\.
Figure 1:DBSG\-PINN architecture
### 2\.3Ablation Variants
Each ablation variant is trained separately, from a fresh random initialization, on its own copy of the computational graph above — built by structurally removing or fixing the relevant component \(the high\-frequency branch, the low\-frequency branch, or the gate\), not by defining a different architecture\. Every variant uses the same optimizer, iteration budget, collocation strategy, and loss weights as the full model for that benchmark \(Table[6](https://arxiv.org/html/2608.24940#A1.T6)\); only the active architectural components change\. This reduces the risk that any performance difference comes from optimizer settings or training procedure rather than frequency decomposition itself\. It does not, on its own, control for seed variance, which we discuss as a limitation in Section[4](https://arxiv.org/html/2608.24940#S4)\.
The low\- and high\-frequency branches are not strictly capacity\-matched\.We state this up front because it bears directly on how LowOnly and HighOnly should be read: depth and width differ between the two branches on most benchmarks \(details below\), so a LowOnly\-vs\-HighOnly comparison is not a clean like\-for\-like test of the two activation functions alone – some of the difference could come from capacity rather than frequency bias\.
- •Full \(DBSG\-PINN\):both branches active, combined via the learned gateg\(x,t\)g\(x,t\)as in Eq\.[13](https://arxiv.org/html/2608.24940#S2.E13)\.
- •NoGate:both branches active, butg\(x,t\)g\(x,t\)in Eq\.[13](https://arxiv.org/html/2608.24940#S2.E13)is fixed at0\.50\.5instead of learned, giving a simple average of the two branches\.
- •LowOnly:the high\-frequency branch is dropped \(uθ=ulou\_\{\\theta\}=u\_\{\\mathrm\{lo\}\}\); the gate and high\-frequency branch are not used at all\.
- •HighOnly:the low\-frequency branch is dropped in the same way \(uθ=uhiu\_\{\\theta\}=u\_\{\\mathrm\{hi\}\}\)\.
For each PDE, the low\- and high\-frequency branches use a roughly similar number of hidden layers and parameters \(Table[6](https://arxiv.org/html/2608.24940#A1.T6)\), but depth and width are not identical between the two branches: on most benchmarks the high\-frequency branch is wider \(e\.g\. 64 vs\. 32 units on Multimodal Wave, 128 vs\. 64 on 1D Wave\), and depth differs by one or two layers on Burgers, Reaction–Diffusion, and Allen–Cahn\. We chose these settings empirically per benchmark rather than by a strict matching rule, so LowOnly and HighOnly are not exactly capacity\-matched ablations — they are only roughly comparable in scale, with activation function \(tanh\\tanhvs\.sin\(ωx\)\\sin\(\\omega x\)\) as the main intended difference\. Even when depth and width do match, that does not fully equate capacity in a functional sense:tanh\\tanhandsin\(ωx\)\\sin\(\\omega x\)networks of the same size can still differ in expressivity, so any parameter matching here is a partial control, not a complete one\. With that caveat in mind, the comparison is meant to highlight the inductive bias from the activation function rather than gross differences in network size, though the per\-benchmark width and depth choices remain an uncontrolled source of variation\. Together, the four variants probe two questions: does explicit frequency separation with a learned gate help \(Full vs\. NoGate\), and is either single\-frequency regime alone enough for the target solution \(LowOnly / HighOnly vs\. Full\)?
### 2\.4Evaluation Metrics
We report the following metrics throughout Section[3](https://arxiv.org/html/2608.24940#S3), evaluated on a uniform100×100100\\times 100\(Nx×NtN\_\{x\}\\times N\_\{t\}\) grid over the problem domain \(Table[6](https://arxiv.org/html/2608.24940#A1.T6)gives the collocation spacing used during training; the evaluation grid is separate from, and coarser\-to\-finer than, the training resolution depending on benchmark\)\. Letuθu\_\{\\theta\}be the trained network’s prediction anduexactu\_\{\\mathrm\{exact\}\}the reference solution, both evaluated on this grid\. For Multimodal Wave, Reaction–Diffusion, and 1D Wave,uexactu\_\{\\mathrm\{exact\}\}is the closed\-form analytical solution given in Section[3](https://arxiv.org/html/2608.24940#S3)\. Allen–Cahn and Burgers admit no simple closed form on this domain, so for these two benchmarksuexactu\_\{\\mathrm\{exact\}\}denotes a high\-resolution numerical reference solution rather than an analytical one; we say more about how each is obtained in the corresponding subsection of Section[3](https://arxiv.org/html/2608.24940#S3)\.
#### RelativeL2L\_\{2\}error\.
Following the evaluation convention[22](https://arxiv.org/html/2608.24940#bib.bib1)introduced for PINNs \(used there on, among others, the Burgers and Allen–Cahn benchmarks studied here too\) and adopted as a default reporting metric in the DeepXDE library\([14](https://arxiv.org/html/2608.24940#bib.bib27)\), the global relativeL2L\_\{2\}error over the evaluation grid is
Rel\.L2=\(∑i,j\(uθ\(xi,tj\)−uexact\(xi,tj\)\)2\)1/2\(∑i,juexact\(xi,tj\)2\)1/2\.\\mathrm\{Rel\.L\_\{2\}\}=\\frac\{\\left\(\\sum\_\{i,j\}\\left\(u\_\{\\theta\}\(x\_\{i\},t\_\{j\}\)\-u\_\{\\mathrm\{exact\}\}\(x\_\{i\},t\_\{j\}\)\\right\)^\{2\}\\right\)^\{1/2\}\}\{\\left\(\\sum\_\{i,j\}u\_\{\\mathrm\{exact\}\}\(x\_\{i\},t\_\{j\}\)^\{2\}\\right\)^\{1/2\}\}\.\(15\)
#### L∞L\_\{\\infty\}error\.
Reported alongside relativeL2L\_\{2\}error in the same references\([22](https://arxiv.org/html/2608.24940#bib.bib1);[14](https://arxiv.org/html/2608.24940#bib.bib27)\), this is the pointwise maximum absolute error over the evaluation grid,
L∞=maxi,j\|uθ\(xi,tj\)−uexact\(xi,tj\)\|\.L\_\{\\infty\}=\\max\_\{i,j\}\\left\|u\_\{\\theta\}\(x\_\{i\},t\_\{j\}\)\-u\_\{\\mathrm\{exact\}\}\(x\_\{i\},t\_\{j\}\)\\right\|\.\(16\)
#### Mean PDE residual\.
Reporting the governing\-equation residual on the evaluation grid as a post\-training diagnostic, alongside pointwise accuracy metrics, follows practice established for PINN software such as DeepXDE\([14](https://arxiv.org/html/2608.24940#bib.bib27)\)\. Unlike the metrics above, the PDE residual reported in Tables[1](https://arxiv.org/html/2608.24940#S3.T1)–[5](https://arxiv.org/html/2608.24940#S3.T5)is not the autodiff\-based residualrθr\_\{\\theta\}minimized during training \(Eq\.[3](https://arxiv.org/html/2608.24940#S2.E3), following[22](https://arxiv.org/html/2608.24940#bib.bib1)\)\. It is a post\-hoc diagnostic: after training, we apply second\-order central finite differences to the trained predictionuθu\_\{\\theta\}on the evaluation grid, approximating each benchmark’s own governing\-equation operator\. For the wave\-type benchmarks \(Eqs\.[20](https://arxiv.org/html/2608.24940#S3.E20)and[31](https://arxiv.org/html/2608.24940#S3.E31)\), for example, this isr^θ\(xi,tj\)=u^tt\(xi,tj\)−c2u^xx\(xi,tj\)\\hat\{r\}\_\{\\theta\}\(x\_\{i\},t\_\{j\}\)=\\hat\{u\}\_\{tt\}\(x\_\{i\},t\_\{j\}\)\-c^\{2\}\\hat\{u\}\_\{xx\}\(x\_\{i\},t\_\{j\}\), withu^xx\\hat\{u\}\_\{xx\}andu^tt\\hat\{u\}\_\{tt\}evaluated by central differences at spacingΔx\\Delta x,Δt\\Delta tover the interior evaluation grid; the other benchmarks use the equivalent finite\-difference form of their own PDE \(Eqs\.[23](https://arxiv.org/html/2608.24940#S3.E23),[26](https://arxiv.org/html/2608.24940#S3.E26),[29](https://arxiv.org/html/2608.24940#S3.E29)\)\. We report the mean absolute residual over interior grid points,
\|R\|¯=1\(Nx−2\)\(Nt−2\)∑i=2Nx−1∑j=2Nt−1\|r^θ\(xi,tj\)\|\.\\overline\{\|R\|\}=\\frac\{1\}\{\(N\_\{x\}\-2\)\(N\_\{t\}\-2\)\}\\sum\_\{i=2\}^\{N\_\{x\}\-1\}\\sum\_\{j=2\}^\{N\_\{t\}\-1\}\\left\|\\hat\{r\}\_\{\\theta\}\(x\_\{i\},t\_\{j\}\)\\right\|\.\(17\)Because this is a finite\-difference approximation computed separately from training, rather than the exact autodiff residualrθr\_\{\\theta\}, it should be read as a post\-hoc consistency check on the trained solution, not as a direct measure of the quantity minimized during optimization\.
#### Spectral error, HF recovery, and LF recovery\.
These diagnostics adapt, for a post\-training evaluation setting, the Fourier\-domain approach[21](https://arxiv.org/html/2608.24940#bib.bib13)and[29](https://arxiv.org/html/2608.24940#bib.bib28)used to characterize spectral bias during training: comparing the amplitude spectra of a network’s output against the target function across frequency bands to show that low frequencies are learned first \(*spectral bias*/*F\-Principle*\)\. We apply the same comparison to the trained solution instead of to training dynamics: for each time slicetjt\_\{j\}, we compute the discrete Fourier amplitude spectra of the predicted and exact solutions alongxx,u^θ\(k,tj\)=\|FFTx\[uθ\(⋅,tj\)\]\(k\)\|\\widehat\{u\}\_\{\\theta\}\(k,t\_\{j\}\)=\\left\|\\mathrm\{FFT\}\_\{x\}\[u\_\{\\theta\}\(\\cdot,t\_\{j\}\)\]\(k\)\\right\|andu^exact\(k,tj\)\\widehat\{u\}\_\{\\mathrm\{exact\}\}\(k,t\_\{j\}\)defined the same way, for wavenumbersk=1,…,Kmaxk=1,\\dots,K\_\{\\max\}\(we useKmax=20K\_\{\\max\}=20\)\. We then average over theNtN\_\{t\}time slices to get the mean amplitude spectrau¯θ\(k\)=1Nt∑ju^θ\(k,tj\)\\bar\{u\}\_\{\\theta\}\(k\)=\\frac\{1\}\{N\_\{t\}\}\\sum\_\{j\}\\widehat\{u\}\_\{\\theta\}\(k,t\_\{j\}\)andu¯exact\(k\)\\bar\{u\}\_\{\\mathrm\{exact\}\}\(k\), defined the same way\. We exclude the zero\-frequency \(DC\) component from all spectral metrics because it reflects the mean solution level rather than its oscillatory content\. The*spectral error*is the normalizedL2L\_\{2\}distance between the two mean spectra over all remaining modes,
SpecErr=‖u¯θ\(2:Kmax\)−u¯exact\(2:Kmax\)‖2‖u¯exact\(2:Kmax\)‖2\.\\mathrm\{SpecErr\}=\\frac\{\\left\\lVert\\bar\{u\}\_\{\\theta\}\(2\{:\}K\_\{\\max\}\)\-\\bar\{u\}\_\{\\mathrm\{exact\}\}\(2\{:\}K\_\{\\max\}\)\\right\\rVert\_\{2\}\}\{\\left\\lVert\\bar\{u\}\_\{\\mathrm\{exact\}\}\(2\{:\}K\_\{\\max\}\)\\right\\rVert\_\{2\}\}\.\(18\)We split the remaining modes into a low\-frequency band𝒦LF\\mathcal\{K\}\_\{\\mathrm\{LF\}\}\(modes22–55\) and a high\-frequency band𝒦HF\\mathcal\{K\}\_\{\\mathrm\{HF\}\}\(modes66–KmaxK\_\{\\max\}\), and define a per\-band normalized errore𝒦=‖u¯θ\(𝒦\)−u¯exact\(𝒦\)‖2/‖u¯exact\(𝒦\)‖2e\_\{\\mathcal\{K\}\}=\\left\\lVert\\bar\{u\}\_\{\\theta\}\(\\mathcal\{K\}\)\-\\bar\{u\}\_\{\\mathrm\{exact\}\}\(\\mathcal\{K\}\)\\right\\rVert\_\{2\}/\\left\\lVert\\bar\{u\}\_\{\\mathrm\{exact\}\}\(\\mathcal\{K\}\)\\right\\rVert\_\{2\}\. The*LF recovery*and*HF recovery*scores are then
Recovery\(𝒦\)=11\+e𝒦,𝒦∈\{𝒦LF,𝒦HF\},\\mathrm\{Recovery\}\(\\mathcal\{K\}\)=\\frac\{1\}\{1\+e\_\{\\mathcal\{K\}\}\},\\qquad\\mathcal\{K\}\\in\\\{\\mathcal\{K\}\_\{\\mathrm\{LF\}\},\\mathcal\{K\}\_\{\\mathrm\{HF\}\}\\\},\(19\)a score of11means the two spectra match perfectly in that band, and the score drops toward00as the normalized error grows\. Unlike Eq\.[15](https://arxiv.org/html/2608.24940#S2.E15), these are diagnostic scores rather than accuracy metrics: they capture how well the amplitude spectrum is recovered in a given band, regardless of any phase or pointwise error elsewhere\.
A caveat applies when a benchmark’s reference solution has little or no energy in one of these two bands\. Reaction–Diffusion’s solution is a single spatial mode \(sin\(πx\)\\sin\(\\pi x\), Section[3](https://arxiv.org/html/2608.24940#S3)\) with essentially all its Fourier energy at the lowest retained mode, and 1D Wave’s solution is likewise a single spatial mode \(k=4k=4\) sitting inside the LF band as we define it here\. In both cases the reference amplitude in the opposite band is close to zero, so the per\-band normalized errore𝒦e\_\{\\mathcal\{K\}\}divides by a near\-zero denominator; the resulting recovery score is then driven mainly by whatever small, largely non\-physical high\-frequency content the trained network happens to produce \(interpolation artifacts, activation\-induced ripple, discretization leakage from the FFT treating a non\-periodic Dirichlet solution as periodic\), rather than by how well a genuine spectral feature is recovered\. We still report these columns for completeness and consistency across benchmarks, but on Reaction–Diffusion \(HF band\) and 1D Wave \(HF band, since its only real content sits in the LF band atk=4k=4\) the recovery score should be read as a noise\-floor diagnostic rather than a substantive accuracy measure\.
## 3Results
Every number below comes from a single training run per model per benchmark \(seed in Table[6](https://arxiv.org/html/2608.24940#A1.T6)\), so we read these as observations from an initial study rather than statistically confirmed effects – Section[4](https://arxiv.org/html/2608.24940#S4)says more about what that limitation should and should not be taken to mean\. Metric definitions \(relativeL2L\_\{2\}error, spectral error, HF/LF recovery\) are in Section[2\.4](https://arxiv.org/html/2608.24940#S2.SS4)\.
### 3\.11D Multimodal Wave Equation
We consider the multimodal wave equation
utt=c2uxx,\(x,t\)∈\[0,1\]×\[0,1\],c=1,u\_\{tt\}=c^\{2\}\\,u\_\{xx\},\\qquad\(x,t\)\\in\[0,1\]\\times\[0,1\],\\quad c=1,\(20\)with a multimodal initial condition composed of modesk∈\{1,3,5\}k\\in\\\{1,3,5\\\}with amplitudesak∈\{1\.0,0\.7,0\.4\}a\_\{k\}\\in\\\{1\.0,\\,0\.7,\\,0\.4\\\},
u\(x,0\)=∑k∈\{1,3,5\}aksin\(kπx\),ut\(x,0\)=0,u\(x,0\)=\\sum\_\{k\\in\\\{1,3,5\\\}\}a\_\{k\}\\sin\(k\\pi x\),\\qquad u\_\{t\}\(x,0\)=0,\(21\)and Dirichlet boundary conditionsu\(0,t\)=u\(1,t\)=0u\(0,t\)=u\(1,t\)=0\. This admits the closed\-form solution
u\(x,t\)=∑k∈\{1,3,5\}aksin\(kπx\)cos\(kπct\)\.u\(x,t\)=\\sum\_\{k\\in\\\{1,3,5\\\}\}a\_\{k\}\\sin\(k\\pi x\)\\cos\(k\\pi c\\,t\)\.\(22\)
Table 1:Ablation Study of DBSG\-PINN on the 1D Multimodal Wave Equation \(single seed\)
### 3\.21D Allen–Cahn Equation
The Allen–Cahn equation, subject to periodic boundary conditions, takes the form
ut=εuxx\+5u−5u3,\(x,t\)∈\[−1,1\]×\[0,1\],u\_\{t\}=\\varepsilon\\,u\_\{xx\}\+5u\-5u^\{3\},\\qquad\(x,t\)\\in\[\-1,1\]\\times\[0,1\],\(23\)with diffusion coefficientε=10−4\\varepsilon=10^\{\-4\}, initial condition
u\(x,0\)=x2cos\(πx\),u\(x,0\)=x^\{2\}\\cos\(\\pi x\),\(24\)and periodic boundary conditions
u\(−1,t\)=u\(1,t\),ux\(−1,t\)=ux\(1,t\)\.u\(\-1,t\)=u\(1,t\),\\qquad u\_\{x\}\(\-1,t\)=u\_\{x\}\(1,t\)\.\(25\)This equation has no simple closed\-form solution\. Following the same benchmark as originally introduced for PINNs\([22](https://arxiv.org/html/2608.24940#bib.bib1)\), we evaluate against a high\-resolution numerical reference solution \(obtained independently of the network being trained\) rather than an analytical one; all “exact”/reference figures and metrics for Allen–Cahn refer to this numerical reference\.
Table 2:Ablation Study of DBSG\-PINN on the Allen–Cahn Equation \(single seed\)
### 3\.31D Burgers Equation
We use the viscous Burgers equation with Dirichlet boundary conditions,
ut\+uux=νuxx,\(x,t\)∈\[−1,1\]×\[0,1\],u\_\{t\}\+u\\,u\_\{x\}=\\nu\\,u\_\{xx\},\\qquad\(x,t\)\\in\[\-1,1\]\\times\[0,1\],\(26\)with viscosityν=0\.01/π\\nu=0\.01/\\pi, initial condition
u\(x,0\)=−sin\(πx\),u\(x,0\)=\-\\sin\(\\pi x\),\(27\)and boundary conditions
u\(−1,t\)=0,u\(1,t\)=0\.u\(\-1,t\)=0,\\qquad u\(1,t\)=0\.\(28\)This viscosity and initial condition admit no simple closed\-form solution either; following the same benchmark as in\([22](https://arxiv.org/html/2608.24940#bib.bib1)\), we evaluate against a high\-resolution numerical reference solution rather than an analytical one\.
Table 3:Ablation Study of DBSG\-PINN on the 1D Burgers Equation \(single seed\)
### 3\.41D Reaction–Diffusion Equation
This benchmark is governed by the linear reaction–diffusion equation
ut=Duxx\+λu,\(x,t\)∈\[0,1\]×\[0,1\],u\_\{t\}=D\\,u\_\{xx\}\+\\lambda u,\\qquad\(x,t\)\\in\[0,1\]\\times\[0,1\],\(29\)with diffusion coefficientD=0\.01D=0\.01and reaction rateλ=2\\lambda=2, initial conditionu\(x,0\)=sin\(πx\)u\(x,0\)=\\sin\(\\pi x\), and Dirichlet boundary conditionsu\(0,t\)=u\(1,t\)=0u\(0,t\)=u\(1,t\)=0, with exact solution
u\(x,t\)=sin\(πx\)exp\(\(λ−Dπ2\)t\)\.u\(x,t\)=\\sin\(\\pi x\)\\,\\exp\\\!\\big\(\(\\lambda\-D\\pi^\{2\}\)\\,t\\big\)\.\(30\)Unlike Multimodal Wave, this solution is a single spatial mode – asin\(πx\)\\sin\(\\pi x\)profile that grows or decays in time depending on the sign ofλ−Dπ2\\lambda\-D\\pi^\{2\}– so we include this benchmark as a smooth, low\-order case rather than a spectrally complex one; we return to what that implies for the ablation results in Section[4](https://arxiv.org/html/2608.24940#S4)\.
Table 4:Ablation Study of DBSG\-PINN on the 1D Reaction–Diffusion Equation \(single seed\)
### 3\.51D Wave Equation
The final benchmark is the standard 1D wave equation
utt=c2uxx,\(x,t\)∈\[0,1\]×\[0,1\],c=1,u\_\{tt\}=c^\{2\}\\,u\_\{xx\},\\qquad\(x,t\)\\in\[0,1\]\\times\[0,1\],\\quad c=1,\(31\)with a single\-mode initial condition of wavenumberk=4k=4,
u\(x,0\)=sin\(4πx\),ut\(x,0\)=0,u\(x,0\)=\\sin\(4\\pi x\),\\qquad u\_\{t\}\(x,0\)=0,\(32\)and Dirichlet boundary conditionsu\(0,t\)=u\(1,t\)=0u\(0,t\)=u\(1,t\)=0, whose exact solution is
u\(x,t\)=sin\(4πx\)cos\(4πct\)\.u\(x,t\)=\\sin\(4\\pi x\)\\cos\(4\\pi c\\,t\)\.\(33\)
Table 5:Ablation Study of DBSG\-PINN on the 1D Wave Equation \(single seed\)
## 4Discussion
Every number in this section comes from one trained model per benchmark per variant\. We treat the pattern below as a hypothesis to test with more seeds and benchmarks, not as a settled result\. To avoid repeating that caveat in every paragraph, we say it once here and come back to it, with specifics, in the Limitations paragraph\.
#### Decomposition helps most on genuinely multi\-scale targets\.
On Multimodal Wave – the one benchmark whose solution is an explicit superposition of multiple spatial modes \(k∈\{1,3,5\}k\\in\\\{1,3,5\\\}, Section[3](https://arxiv.org/html/2608.24940#S3)\) – the full model beats every ablation on nearly every metric \(Table[1](https://arxiv.org/html/2608.24940#S3.T1)\)\. LowOnly and HighOnly each specialize in one part of the spectrum, and each does measurably worse than the full model at recovering the content the other branch was meant to handle, which is roughly what we expected going in: separating the branches pays off when a solution genuinely mixes frequency regimes\. Reaction–Diffusion also shows Full leading on every accuracy metric \(Table[4](https://arxiv.org/html/2608.24940#S3.T4)\) – LowOnly edges it out only on HF recovery, which Section[2\.4](https://arxiv.org/html/2608.24940#S2.SS4)already flags as a noise\-floor diagnostic rather than a substantive measure for this benchmark’s near\-single\-mode spectrum – but that benchmark’s solution is a single spatial mode \(Section[3](https://arxiv.org/html/2608.24940#S3)\), not a spectrally rich target, so we do not think the same explanation applies there; we return to this discrepancy below\.
#### On Allen–Cahn, LowOnly nearly matches the full model\.
Full still comes out ahead \(0\.1038 vs\. 0\.1108 relativeL2L\_\{2\}for LowOnly\), though only just, whereas the gap to NoGate and HighOnly is large \(Table[2](https://arxiv.org/html/2608.24940#S3.T2)\)\. The Allen–Cahn solution is smooth and low\-frequency apart from sharp, localized transition layers, so a sinusoidal high\-frequency branch mostly gets in the way here: HighOnly and the unweighted NoGate average both pay for that mismatch\. It looks like the gate’s real job on this benchmark is suppressing a branch that is not helping rather than blending two useful ones, though Full and LowOnly sit close enough together that a different seed could flip the ranking\.
#### On Burgers, gating showed no meaningful edge either way\.
NoGate \(fixed atg=0\.5g=0\.5\) and the full model end up close together across all six metrics for Burgers \(Table[3](https://arxiv.org/html/2608.24940#S3.T3)\): 0\.0240 vs\. 0\.0238 relativeL2L\_\{2\}, say, with each variant ahead on roughly half the columns and by less than 5% either way\. Viscosity smooths Burgers out to something close to single\-scale, so there is not much spectral content left for an adaptive gate to route between – a wash is more or less what we would expect here\.
#### On 1D Wave, the full model did meaningfully worse than NoGate\.
Unlike Burgers, this gap is not small: NoGate leads the full model on every metric we tracked \(Table[5](https://arxiv.org/html/2608.24940#S3.T5)\), by around 53% on relativeL2L\_\{2\}and 68% on spectral error\. The benchmark uses a single wavenumber \(k=4k=4\), so we didn’t expect the gate to have much to route between — instead, learning a gate actively hurt performance compared to a fixed average\. We don’t have a confident explanation for why the effect is this large on Wave but not Burgers; that’s a priority for multi\-seed follow\-up\.
#### Interpreting the gate\.
Stepping back, the gate’s benefit is largest on the benchmark with the richest spectral content \(Multimodal Wave\), smaller but still positive on Allen–Cahn \(smooth except for sharp transition layers\), roughly neutral on Burgers, and negative on 1D Wave, whose target is a single spatial mode\. This much fits what we would expect if the gate’s aggregate benefit tracks spectral complexity across benchmarks\. Reaction–Diffusion is an exception: its solution is also a single spatial mode, yet the full model still leads on every accuracy metric there \(HF recovery aside, a noise\-floor diagnostic for this benchmark\), so whatever the gate is doing on that benchmark, it does not look like it is exploiting multi\-mode spectral structure in the way our framing above assumes\. We flag this as an open question rather than force it into the pattern, and note again that none of this is based on a direct visualization ofg\(x,t\)g\(x,t\)– only on comparing aggregate performance across benchmarks of differing spectral content\.
#### Limitations\.
Three limitations bound how far these results should be read\.*Seeds:*every result comes from a single training seed \(Table[6](https://arxiv.org/html/2608.24940#A1.T6)\), so we have no variance estimate\. This matters most for Allen–Cahn’s Full\-vs\-LowOnly gap, which is small enough to plausibly flip under a different seed, and arguably even more for the 1D Wave Full\-vs\-NoGate gap — that gap is large in this run, but with a single seed we can’t tell whether it’s a real, reproducible effect or just an unlucky training run for the full model\.*Capacity matching:*branch depth and width are only roughly comparable, not identical, across the low\- and high\-frequency branches for most benchmarks \(Section[2\.3](https://arxiv.org/html/2608.24940#S2.SS3)\); even where sizes do match, equal parameter count doesn’t guarantee equal functional capacity, sincetanh\\tanhandsin\(ωx\)\\sin\(\\omega x\)networks of the same size aren’t guaranteed equal expressivity\.*Scope:*all five benchmarks are one\-dimensional, so we can’t say whether the pattern holds in higher dimensions or under stronger nonlinearity\.
## 5Conclusion
This work asked when frequency decomposition actually helps Physics\-Informed Neural Networks, instead of assuming its value is universal\. We introduced DBSG\-PINN, a dual\-branch architecture with an adaptive spectral gate built specifically for ablation: each of its three components — the low\-frequency branch, the high\-frequency branch, and the gating mechanism — can be removed without changing the optimization procedure, so we can compare their individual contributions directly\.
The pattern across the five benchmarks is not a single clean story\. Decomposition helped most on Multimodal Wave, the one benchmark whose solution is a genuine superposition of spatial modes, cutting relativeL2L\_\{2\}error by up to 59\.2%\. The full gated model also beat every ablation on every accuracy metric for Reaction–Diffusion \(HF recovery aside, a noise\-floor diagnostic there\), even though that benchmark’s solution is a single spatial mode rather than a spectrally rich one – we flag this as an open question rather than a confirmation of our starting hypothesis\. Allen–Cahn was more mixed, with Full ahead but only barely so over LowOnly, suggesting the gate’s job there was really screening out a poorly matched high\-frequency branch rather than blending two useful ones\. Burgers gave learned gating no meaningful edge over a simple fixed average, and 1D Wave went the other way entirely: NoGate beat the full model by a wide margin on every metric tracked, a gap large enough that it needs multi\-seed confirmation before being read as more than a flag\. Where the gate did help, its benefit tracked the benchmark’s spectral complexity – a preliminary, interpretable signal, not a proven mechanism\.
None of this settles when frequency decomposition helps, and it is not meant to\. The single\-seed, five\-benchmark, one\-dimensional setting is a real limitation, and the closer comparisons here, Allen–Cahn’s Full\-vs\-LowOnly gap especially, should not be read past what is actually reported\. What it does offer is a concrete, testable pattern: decomposition helps most on genuinely multi\-scale solutions and least on smooth, single\-scale ones\. The natural next step is checking whether that pattern survives more seeds and a wider benchmark suite, before drawing any firmer conclusions for PINN practice\.
Figure 2:RelativeL2L\_\{2\}error by ablation variant across the five benchmarks \(single seed per bar\)\. DBSG\-PINN \(Full\) leads on Multimodal Wave, Allen–Cahn, and Reaction–Diffusion, while NoGate leads on Burgers and 1D Wave\.#### Future work\.
The most immediate next step is repeating this ablation study across multiple seeds to get variance estimates and confirm whether the reported orderings are stable; several of the comparisons in Section[4](https://arxiv.org/html/2608.24940#S4)are close enough that this is a prerequisite for any stronger claim\. Beyond that, natural extensions include: \(i\) extending the benchmark suite to 2D and time\-dependent multi\-scale PDEs \(e\.g\., 2D Navier–Stokes, wave scattering\); \(ii\) building a lightweight diagnostic, based on the spectral content of the initial/boundary data, that estimates in advance whether frequency decomposition is likely to help for a given PDE; and \(iii\) testing whether the gate network’s link to spectral complexity holds up as an interpretability signal beyond the specific architecture studied here\.
## Acknowledgements
Figures[1](https://arxiv.org/html/2608.24940#S2.F1)and[2](https://arxiv.org/html/2608.24940#S5.F2)were generated with the assistance of Paper Banana\. Claude \(Anthropic\) was used for language refinement of the manuscript text\. All AI\-assisted content was reviewed and verified by the author, who takes full responsibility for the research, experiments, analysis, and conclusions presented in this work\.
## References
- Baydinet al\.\(2018\)A\. G\. Baydin, B\. A\. Pearlmutter, A\. A\. Radul, and J\. M\. SiskindAutomatic differentiation in machine learning: a survey\.Journal of Machine Learning Research18\(153\),pp\. 1–43\.Cited by:[§2\.1](https://arxiv.org/html/2608.24940#S2.SS1.p10.1)\.
- Cuomoet al\.\(2022\)S\. Cuomo, V\. S\. Di Cola, F\. Giampaolo, G\. Rozza, M\. Raissi, and F\. PiccialliScientific machine learning through physics–informed neural networks: where we are and what’s next\.Journal of Scientific Computing92\(3\),pp\. 88\.External Links:[Document](https://dx.doi.org/10.1007/s10915-022-01939-z)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p2.1)\.
- Heet al\.\(2016\)K\. He, X\. Zhang, S\. Ren, and J\. SunDeep residual learning for image recognition\.InProceedings of the IEEE conference on computer vision and pattern recognition,pp\. 770–778\.External Links:[Document](https://dx.doi.org/10.1109/CVPR.2016.90)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Horniket al\.\(1989\)K\. Hornik, M\. Stinchcombe, and H\. WhiteMultilayer feedforward networks are universal approximators\.Neural Networks2\(5\),pp\. 359–366\.Cited by:[§2\.2](https://arxiv.org/html/2608.24940#S2.SS2.p4.1)\.
- Jacobset al\.\(1991\)R\. A\. Jacobs, M\. I\. Jordan, S\. J\. Nowlan, and G\. E\. HintonAdaptive mixtures of local experts\.Neural Computation3\(1\),pp\. 79–87\.External Links:[Document](https://dx.doi.org/10.1162/neco.1991.3.1.79)Cited by:[§2\.2](https://arxiv.org/html/2608.24940#S2.SS2.p9.1)\.
- Jacotet al\.\(2018\)A\. Jacot, F\. Gabriel, and C\. HonglerNeural tangent kernel: convergence and generalization in neural networks\.Advances in neural information processing systems31\.Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1)\.
- Jagtap and Karniadakis \(2020\)A\. D\. Jagtap and G\. E\. KarniadakisExtended physics\-informed neural networks \(xpinns\): a generalized space\-time domain decomposition based deep learning framework for nonlinear partial differential equations\.Communications in Computational Physics28\(5\),pp\. 2002–2041\.External Links:[Document](https://dx.doi.org/10.4208/cicp.OA-2020-0164)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Jagtapet al\.\(2020a\)A\. D\. Jagtap, K\. Kawaguchi, and G\. E\. KarniadakisAdaptive activation functions accelerate convergence in deep and physics\-informed neural networks\.Journal of Computational Physics404,pp\. 109136\.External Links:[Document](https://dx.doi.org/10.1016/j.jcp.2019.109136)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Jagtapet al\.\(2020b\)A\. D\. Jagtap, E\. Kharazmi, and G\. E\. KarniadakisConservative physics\-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems\.Computer Methods in Applied Mechanics and Engineering365,pp\. 113028\.External Links:[Document](https://dx.doi.org/10.1016/j.cma.2020.113028)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Karniadakiset al\.\(2021\)G\. E\. Karniadakis, I\. G\. Kevrekidis, L\. Lu, P\. Perdikaris, S\. Wang, and L\. YangPhysics\-informed machine learning\.Nature Reviews Physics3\(6\),pp\. 422–440\.External Links:[Document](https://dx.doi.org/10.1038/s42254-021-00314-5)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p2.1)\.
- Kingma and Ba \(2015\)D\. P\. Kingma and J\. BaAdam: a method for stochastic optimization\.InInternational Conference on Learning Representations \(ICLR\),Cited by:[§A\.1](https://arxiv.org/html/2608.24940#A1.SS1.SSS0.Px1.p1.1),[§2\.1](https://arxiv.org/html/2608.24940#S2.SS1.p20.1)\.
- Krishnapriyanet al\.\(2021\)A\. Krishnapriyan, A\. Gholami, S\. Zhe, R\. Kirby, and M\. W\. MahoneyCharacterizing possible failure modes in physics\-informed neural networks\.Advances in neural information processing systems34,pp\. 26548–26560\.Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1)\.
- Liu and Nocedal \(1989\)D\. C\. Liu and J\. NocedalOn the limited memory BFGS method for large scale optimization\.Mathematical Programming45\(1\-3\),pp\. 503–528\.External Links:[Document](https://dx.doi.org/10.1007/BF01589116)Cited by:[§A\.1](https://arxiv.org/html/2608.24940#A1.SS1.SSS0.Px1.p1.1),[§2\.1](https://arxiv.org/html/2608.24940#S2.SS1.p20.1)\.
- Luet al\.\(2021\)L\. Lu, X\. Meng, Z\. Mao, and G\. E\. KarniadakisDeepXDE: a deep learning library for solving differential equations\.SIAM Review63\(1\),pp\. 208–228\.External Links:[Document](https://dx.doi.org/10.1137/19M1274067)Cited by:[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px1.p1.1),[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px2.p1.1),[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px3.p1.1)\.
- Luoet al\.\(2025\)K\. Luo, J\. Zhao, Y\. Wang, J\. Li, J\. Wen, J\. Liang, H\. Soekmadji, and S\. LiaoPhysics\-informed neural networks for pde problems: a comprehensive review\.Artificial Intelligence Review58\(10\),pp\. 323\.External Links:[Document](https://dx.doi.org/10.1007/s10462-025-11322-7)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p2.1)\.
- McClenny and Braga\-Neto \(2020\)L\. McClenny and U\. Braga\-NetoSelf\-adaptive physics\-informed neural networks using a soft attention mechanism\.arXiv preprint arXiv:2009\.04544\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2009.04544)Cited by:[§2\.1](https://arxiv.org/html/2608.24940#S2.SS1.p13.1)\.
- Moseleyet al\.\(2020\)B\. Moseley, A\. Markham, and T\. Nissen\-MeyerSolving the wave equation with physics\-informed deep learning\.arXiv preprint arXiv:2006\.11894\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2006.11894)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1)\.
- Moseleyet al\.\(2023\)B\. Moseley, A\. Markham, and T\. Nissen\-MeyerFinite basis physics\-informed neural networks \(fbpinns\): a scalable domain decomposition approach for solving differential equations\.Advances in Computational Mathematics49\(4\),pp\. 62\.External Links:[Document](https://dx.doi.org/10.1007/s10444-023-10065-9)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Mustajabet al\.\(2024\)A\. H\. Mustajab, H\. Lyu, Z\. Rizvi, and F\. WuttkePhysics\-informed neural networks for high\-frequency and multi\-scale problems using transfer learning\.Applied Sciences14\(8\),pp\. 3204\.External Links:[Document](https://dx.doi.org/10.3390/app14083204)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1)\.
- Pal \(2023\)Lux: Explicit Parameterization of Deep Neural Networks in JuliaExternal Links:[Document](https://dx.doi.org/10.5281/zenodo.7808904),[Link](https://doi.org/10.5281/zenodo.7808904)Cited by:[§A\.1](https://arxiv.org/html/2608.24940#A1.SS1.SSS0.Px1.p1.1)\.
- Rahamanet al\.\(2019\)N\. Rahaman, A\. Baratin, D\. Arpit, F\. Draxler, M\. Lin, F\. Hamprecht, Y\. Bengio, and A\. CourvilleOn the spectral bias of neural networks\.InInternational conference on machine learning,pp\. 5301–5310\.Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1),[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px4.p1.1)\.
- Raissiet al\.\(2019\)M\. Raissi, P\. Perdikaris, and G\. E\. KarniadakisPhysics\-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations\.Journal of Computational physics378,pp\. 686–707\.External Links:[Document](https://dx.doi.org/10.1016/j.jcp.2018.10.045)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.24940#S2.SS1.p1.1),[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px1.p1.1),[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px2.p1.1),[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px3.p1.1),[§3\.2](https://arxiv.org/html/2608.24940#S3.SS2.p1.4),[§3\.3](https://arxiv.org/html/2608.24940#S3.SS3.p1.4)\.
- Shazeeret al\.\(2017\)N\. Shazeer, A\. Mirhoseini, K\. Maziarz, A\. Davis, Q\. Le, G\. Hinton, and J\. DeanOutrageously large neural networks: the sparsely\-gated mixture\-of\-experts layer\.arXiv preprint arXiv:1701\.06538\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.1701.06538)Cited by:[§2\.2](https://arxiv.org/html/2608.24940#S2.SS2.p9.1)\.
- Sitzmannet al\.\(2020\)V\. Sitzmann, J\. Martel, A\. Bergman, D\. Lindell, and G\. WetzsteinImplicit neural representations with periodic activation functions\.Advances in neural information processing systems33,pp\. 7462–7473\.Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1),[§2\.2](https://arxiv.org/html/2608.24940#S2.SS2.p7.1)\.
- Stilleret al\.\(2020\)P\. Stiller, F\. Bethke, M\. Böhme, R\. Pausch, S\. Torge, A\. Debus, J\. Vorberger, M\. Bussmann, and N\. HoffmannLarge\-scale neural solvers for partial differential equations\.InSmoky Mountains Computational Sciences and Engineering Conference,pp\. 20–34\.External Links:[Document](https://dx.doi.org/10.1007/978-3-030-63393-6%5F2)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Tanciket al\.\(2020\)M\. Tancik, P\. Srinivasan, B\. Mildenhall, S\. Fridovich\-Keil, N\. Raghavan, U\. Singhal, R\. Ramamoorthi, J\. Barron, and R\. NgFourier features let networks learn high frequency functions in low dimensional domains\.Advances in neural information processing systems33,pp\. 7537–7547\.Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Wanget al\.\(2021\)S\. Wang, Y\. Teng, and P\. PerdikarisUnderstanding and mitigating gradient flow pathologies in physics\-informed neural networks\.SIAM Journal on Scientific Computing43\(5\),pp\. A3055–A3081\.External Links:[Document](https://dx.doi.org/10.1137/20M1318043)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1),[§1](https://arxiv.org/html/2608.24940#S1.p4.1)\.
- Wanget al\.\(2022\)S\. Wang, X\. Yu, and P\. PerdikarisWhen and why pinns fail to train: a neural tangent kernel perspective\.Journal of Computational Physics449,pp\. 110768\.External Links:[Document](https://dx.doi.org/10.1016/j.jcp.2021.110768)Cited by:[§1](https://arxiv.org/html/2608.24940#S1.p3.1),[§2\.1](https://arxiv.org/html/2608.24940#S2.SS1.p13.1)\.
- Xuet al\.\(2020\)Z\. J\. Xu, Y\. Zhang, T\. Luo, Y\. Xiao, and Z\. MaFrequency principle: fourier analysis sheds light on deep neural networks\.Communications in Computational Physics28\(5\),pp\. 1746–1767\.External Links:[Document](https://dx.doi.org/10.4208/cicp.OA-2020-0085)Cited by:[§2\.4](https://arxiv.org/html/2608.24940#S2.SS4.SSS0.Px4.p1.1)\.
- Zubovet al\.\(2021\)K\. Zubov, Z\. McCarthy, Y\. Ma, F\. Calisto, V\. Pagliarino, S\. Azeglio, L\. Bottero, E\. Luján, V\. Sulzer, A\. Bharambe, N\. Vinchhi, K\. Balakrishnan, D\. Upadhyay, and C\. RackauckasNeuralPDE: automating physics\-informed neural networks \(PINNs\) with error approximations\.arXiv preprint arXiv:2107\.09443\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2107.09443)Cited by:[§A\.1](https://arxiv.org/html/2608.24940#A1.SS1.SSS0.Px1.p1.1)\.
## Appendix AAppendix
### A\.1Hyperparameter Configuration
Table[6](https://arxiv.org/html/2608.24940#A1.T6)reports the hyperparameter configuration we used for DBSG\-PINN across all five benchmark PDEs, including each branch’s architecture \(activation function, hidden layers, width\), the gate network configuration, and training settings \(collocation grid spacing, Adam/L\-BFGS iteration counts, loss weights, and random seed\)\. All ablation variants \(NoGate, LowOnly, HighOnly\) reuse the same per\-benchmark configuration from Table[6](https://arxiv.org/html/2608.24940#A1.T6)for their active components\. Training budget and per\-branch capacity therefore stay matched across variants for a given benchmark, though this alone gives no variance estimate, since only one seed was run per configuration \(Section[4](https://arxiv.org/html/2608.24940#S4)\)\.
Table 6:Hyperparameter configuration of DBSG\-PINN across the five benchmark PDEs\. All entries use a single random seed per benchmark; see Section[4](https://arxiv.org/html/2608.24940#S4)for the resulting limitation on statistical confidence\.#### Implementation\.
All models are implemented in Julia using NeuralPDE\.jl\([30](https://arxiv.org/html/2608.24940#bib.bib29)\)for the physics\-informed training loop and Lux\.jl version 1\.2\.3\([20](https://arxiv.org/html/2608.24940#bib.bib30)\)for network parameterization, with grid\-based collocation \(GridTraining\) at the per\-benchmark spacings listed above\. Training uses Adam\([11](https://arxiv.org/html/2608.24940#bib.bib22)\)at the learning rate given above, followed by L\-BFGS\([13](https://arxiv.org/html/2608.24940#bib.bib23)\)for the iteration counts listed, both with default \(JuliaOptim\.jl/OptimizationOptimJL\) line\-search settings\. All evaluation metrics in Section[3](https://arxiv.org/html/2608.24940#S3)\(relativeL2L\_\{2\},L∞L\_\{\\infty\}, mean PDE residual, spectral error, HF/LF recovery\) are computed on a uniform100×100100\\times 100evaluation grid, as stated in Section[2\.4](https://arxiv.org/html/2608.24940#S2.SS4); this grid is independent of, and in most cases finer than, the training collocation spacing above\.
### A\.21D Multimodal Wave Equation: Qualitative Comparison Across Variants
Figures[3](https://arxiv.org/html/2608.24940#A1.F3)–[7](https://arxiv.org/html/2608.24940#A1.F7)show, for each ablation variant, the exact solution, the model’s prediction, the pointwise absolute error, and \(where shown\) the FFT\-based spectral recovery on the 1D Multimodal Wave benchmark\. All panels share a consistent color scale within a figure to support direct visual comparison; each figure corresponds to a single trained model \(Section[4](https://arxiv.org/html/2608.24940#S4)\)\.



Figure 3:1D Multimodal Wave, Full DBSG\-PINN: exact solution, prediction, and absolute error\.


Figure 4:1D Multimodal Wave, HighOnly variant\.


Figure 5:1D Multimodal Wave, LowOnly variant\.


Figure 6:1D Multimodal Wave, NoGate variant\.\(a\)Full \(DBSG\-PINN\)
\(b\)HighOnly
\(c\)LowOnly
\(d\)NoGate
Figure 7:1D Multimodal Wave spectral recovery across ablation variants \(FFT amplitude vs\. frequency mode, single seed\)\.
### A\.31D Burgers Equation: Qualitative Comparison Across Variants
Figures[8](https://arxiv.org/html/2608.24940#A1.F8)–[12](https://arxiv.org/html/2608.24940#A1.F12)show the same reference\-solution / prediction / absolute\-error / spectral\-recovery comparison for the 1D Burgers benchmark \(reference here meaning the high\-resolution numerical solution described in Section[3](https://arxiv.org/html/2608.24940#S3), not a closed\-form exact solution\)\.



Figure 8:1D Burgers Equation, Full DBSG\-PINN: high\-resolution reference solution, prediction, and absolute error\.


Figure 9:1D Burgers Equation, HighOnly variant\.


Figure 10:1D Burgers Equation, LowOnly variant\.


Figure 11:1D Burgers Equation, NoGate variant\.\(a\)Full \(DBSG\-PINN\)
\(b\)HighOnly
\(c\)LowOnly
\(d\)NoGate
Figure 12:1D Burgers Equation spectral recovery across ablation variants \(FFT amplitude vs\. frequency mode, single seed\)\.
### A\.41D Allen–Cahn Equation: Qualitative Comparison Across Variants
Figures[13](https://arxiv.org/html/2608.24940#A1.F13)–[17](https://arxiv.org/html/2608.24940#A1.F17)show the same comparison for the 1D Allen–Cahn benchmark\.



Figure 13:1D Allen–Cahn Equation, Full DBSG\-PINN: high\-resolution reference solution, prediction, and absolute error\.


Figure 14:1D Allen–Cahn Equation, HighOnly variant\.


Figure 15:1D Allen–Cahn Equation, LowOnly variant\.


Figure 16:1D Allen–Cahn Equation, NoGate variant\.\(a\)Full \(DBSG\-PINN\)
\(b\)HighOnly
\(c\)LowOnly
\(d\)NoGate
Figure 17:1D Allen–Cahn Equation spectral recovery across ablation variants \(FFT amplitude vs\. frequency mode, single seed\)\.
### A\.51D Reaction–Diffusion Equation: Qualitative Comparison Across Variants
Figures[18](https://arxiv.org/html/2608.24940#A1.F18)–[22](https://arxiv.org/html/2608.24940#A1.F22)show the same comparison for the 1D Reaction–Diffusion benchmark\.



Figure 18:1D Reaction–Diffusion Equation, Full DBSG\-PINN: exact solution, prediction, and absolute error\.


Figure 19:1D Reaction–Diffusion Equation, HighOnly variant\.


Figure 20:1D Reaction–Diffusion Equation, LowOnly variant\.


Figure 21:1D Reaction–Diffusion Equation, NoGate variant\.\(a\)Full \(DBSG\-PINN\)
\(b\)HighOnly
\(c\)LowOnly
\(d\)NoGate
Figure 22:1D Reaction–Diffusion Equation spectral recovery across ablation variants \(FFT amplitude vs\. frequency mode, single seed\)\.
### A\.61D Wave Equation: Qualitative Comparison Across Variants
Figures[23](https://arxiv.org/html/2608.24940#A1.F23)–[27](https://arxiv.org/html/2608.24940#A1.F27)show the same comparison for the 1D Wave benchmark\.



Figure 23:1D Wave Equation, Full DBSG\-PINN: exact solution, prediction, and absolute error\.


Figure 24:1D Wave Equation, HighOnly variant\.


Figure 25:1D Wave Equation, LowOnly variant\.


Figure 26:1D Wave Equation, NoGate variant\.\(a\)Full \(DBSG\-PINN\)
\(b\)HighOnly
\(c\)LowOnly
\(d\)NoGate
Figure 27:1D Wave Equation spectral recovery across ablation variants \(FFT amplitude vs\. frequency mode, single seed\)\.Similar Articles
Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features
This paper proposes FALM-PINN, an alternating Levenberg-Marquardt training framework for physics-informed neural networks that uses Fourier-enhanced features to address spectral bias and representation-coefficient coupling, achieving up to two orders of magnitude lower errors on high-frequency and nonlinear PDEs.
Fourier Feature Pyramids for Physics-Informed Neural Networks
The paper introduces beignet, a PINN architecture that replaces random Fourier features with a trainable multi-resolution Fourier feature pyramid, achieving higher accuracy and computational efficiency on PDE benchmarks.
Feature Interaction Modeling for Physics-Informed Neural Networks and Neural Operators
This paper introduces feature interaction modules based on factorization machines into physics-informed neural networks and neural operators (FM-PINN, FM-Operator, FM-DeepONet) to better capture spatio-temporal variable couplings for solving parameterized PDEs, showing accuracy gains particularly on shock-dominated equations.
Physics-Informed Neural Networks with Learnable Loss Balancing and Transfer Learning
This paper proposes a self-supervised physics-informed neural network (PINN) framework with a learnable blending neuron to adaptively balance physics-based and data-driven losses, and integrates transfer learning to improve efficiency under data scarcity. It is validated on liquid-metal miniature heat sink CFD data with only 87 datapoints, achieving under 8% error.
A Computational Comparison of Fourier Spectral Differentiation and Spatial Automatic Differentiation in Periodic Physics-Informed Neural Networks
This paper compares Fourier spectral differentiation and spatial automatic differentiation in periodic physics-informed neural networks, finding that Fourier methods achieve significant training speedups and memory reductions without compromising accuracy.