Geometric Kolmogorov--Arnold Network (GeoKAN)
Summary
This paper introduces Geometric Kolmogorov-Arnold Networks (GeoKAN), a family of geometry-aware models that learn Riemannian metrics to adapt coordinates for improved function approximation and physics-informed learning.
View Cached Full Text
Cached at: 05/11/26, 06:46 AM
# Geometric Kolmogorov–Arnold Network (GeoKAN)
Source: [https://arxiv.org/html/2605.06740](https://arxiv.org/html/2605.06740)
Abhijit Sen[https://orcid.org/0000-0003-2783-1763](https://orcid.org/0000-0003-2783-1763)1\*, Bikram Keshari Parida[https://orcid.org/0000-0003-1204-357X](https://orcid.org/0000-0003-1204-357X)1\*, Giridas Maiti[https://orcid.org/0000-0002-7813-6480](https://orcid.org/0000-0002-7813-6480)2, Mahima Arya[https://orcid.org/0000-0002-1847-9705](https://orcid.org/0000-0002-1847-9705)1, Denys I\. Bondar[https://orcid.org/0000-0002-3626-4804](https://orcid.org/0000-0002-3626-4804)1 1Department of Physics and Engineering Physics, Tulane University, New Orleans, Louisiana 70118, USA\. 2Institute of Applied Geosciences, Karlsruhe Institute of Technology, Karlsruhe 76131, Germany\. \{asen1, bparida, dbondar\}@tulane\.edu \*Equal Contribution\.
###### Abstract
We introduce*Geometric Kolmogorov–Arnold Networks*\(GeoKANs\), a family of geometry\-aware KAN\-type models in which approximation is carried out in learned, geometry\-adapted coordinates rather than in fixed Euclidean input coordinates\. GeoKAN achieves this by learning a diagonal Riemannian metric that warps the input before basis expansion and feature mixing\. The learned metric provides a geometric inductive bias through local length scaling and volume distortion, and in physics\-informed settings it also affects the differential structure seen by the model\. Within this framework, we develop three main variants, namely*GeoKAN\-NNMetric*,*GeoKAN\-γ\\gamma*, and*LM\-KAN*\. For*LM\-KAN*, we further consider three basis\-specific versions,*LM\-KAN\-RBF*,*LM\-KAN\-Wav*, and*LM\-KAN\-Fourier*\. These variants allow us to study geometry\-aware KAN models both as general function approximators and as surrogates in physics\-informed learning\. By stretching regions with rapid variation and compressing smoother regions, GeoKAN reallocates representational resolution in a task\-dependent manner, allowing the model to place capacity where it is most needed\. As a result, GeoKAN is well suited to sharp, stiff, localized, and strongly non\-uniform regimes arising in scientific machine learning and differential\-equation problems\. Code is available at[https://github\.com/AI\-and\-Quantum\-Computing/GeoKAN](https://github.com/AI-and-Quantum-Computing/GeoKAN)\.
*K*eywordsKAN⋅\\cdotGeometric KAN⋅\\cdotDeep Learning⋅\\cdotPINN⋅\\cdotPIKAN⋅\\cdotLM\-KAN⋅\\cdotMachine Learning
## 1Introduction
Recently, Kolmogorov–Arnold Network \(KAN\) has emerged as a promising alternative to standard multilayer perceptrons\[[25](https://arxiv.org/html/2605.06740#bib.bib18)\]\. KAN is motivated by the Kolmogorov–Arnold representation theorem, which shows that multivariate continuous functions can be represented through sums and compositions of univariate functions\[[20](https://arxiv.org/html/2605.06740#bib.bib25),[8](https://arxiv.org/html/2605.06740#bib.bib24)\]\. Unlike ordinary neural networks that use fixed activation functions, KAN employs learnable nonlinear functions, which gives it greater flexibility in approximation\[[25](https://arxiv.org/html/2605.06740#bib.bib18)\]\. Because of this, KAN has shown promising performance in function approximation and in the numerical solution of differential equations\[[42](https://arxiv.org/html/2605.06740#bib.bib1),[19](https://arxiv.org/html/2605.06740#bib.bib2),[36](https://arxiv.org/html/2605.06740#bib.bib3)\]\. In particular, KAN\-based physics\-informed models have shown that they can often capture the solutions of differential equations more accurately than standard neural networks\[[42](https://arxiv.org/html/2605.06740#bib.bib1),[36](https://arxiv.org/html/2605.06740#bib.bib3),[30](https://arxiv.org/html/2605.06740#bib.bib62),[35](https://arxiv.org/html/2605.06740#bib.bib64)\]\.
Despite this flexibility, most existing KAN models still operate in a fixed coordinate system\. Their basis functions are learned, but they are still evaluated directly on the original input coordinates\. This can become a limitation when the target function is highly nonuniform across the domain\. In many problems, especially in scientific computing, the solution is smooth in some regions but varies rapidly in others, for example near shocks, thin interfaces, sharp peaks, or boundary layers\[[30](https://arxiv.org/html/2605.06740#bib.bib62),[35](https://arxiv.org/html/2605.06740#bib.bib64)\]\. In such cases, a fixed representation may spend too much capacity in simple regions and not enough in the difficult ones\.
This limitation motivates the main idea of the paper\. Instead of learning only the approximation, we also learn the geometry of the input space\. To this end, we introduce*Geometric KAN*\(GeoKAN\), a family of geometry\-aware KAN models in which the input is first warped by a learned metric and the representation is then constructed in geometry\-adapted coordinates\. In this way, the model can stretch regions where the target is difficult and compress regions where it is smooth, so that representational resolution is allocated more effectively across the domain\. The GeoKAN framework gives rise to several variants depending on how the metric is parameterized and how the post\-warp features are constructed\. In this work, we introduce three main variants of GeoKAN\. \(1\)*GeoKAN\-NNMetric*learns a coupled metric from the full input and combines it with a localized wavelet dictionary\. \(2\)*GeoKAN\-γ\\gamma*uses a more structured separable metric and builds explicit geometric features from the learned scaling and its local variation\. \(3\)*Learned\-Metric KAN*\(LM\-KAN\) uses a coupled learned metric together with localized post\-warp basis functions, and serves as the main geometry\-aware surrogate in the physics\-informed setting considered later\.
We first apply GeoKAN in a supervised function\-approximation setting through matched\-capacity curve\-fitting benchmarks\. This makes it possible to evaluate the representational behavior of the architecture before introducing differential\-equation residuals, boundary conditions, or initial conditions\. In this way, the curve\-fitting experiments test whether geometry\-aware KAN models provide an intrinsic approximation advantage on targets with oscillatory, localized, discontinuous, or multiscale structure\.
We then use GeoKAN to construct physics\-informed models\. Physics\-Informed Neural Networks \(PINNs\) provide a widely used framework for solving differential equations by incorporating the governing equation directly into the loss function\[[32](https://arxiv.org/html/2605.06740#bib.bib4)\]\. Since their introduction, PINNs have been extended to many classes of problems, including fractional equations, integro\-differential equations, and stochastic partial differential equations\[[10](https://arxiv.org/html/2605.06740#bib.bib7),[29](https://arxiv.org/html/2605.06740#bib.bib8),[43](https://arxiv.org/html/2605.06740#bib.bib9),[28](https://arxiv.org/html/2605.06740#bib.bib10)\]\. Despite this progress, PINNs still face several challenges, including optimization instability, sensitivity to hyperparameters, and difficulty in handling solutions with sharp gradients, shocks, or boundary layers\[[21](https://arxiv.org/html/2605.06740#bib.bib13),[17](https://arxiv.org/html/2605.06740#bib.bib14),[14](https://arxiv.org/html/2605.06740#bib.bib15),[12](https://arxiv.org/html/2605.06740#bib.bib16)\]\. A number of remedies have therefore been proposed to improve their robustness and training behavior\[[41](https://arxiv.org/html/2605.06740#bib.bib17)\]\. One recent direction is to replace the standard multilayer perceptron surrogate by a KAN\-type model, leading to Physics\-Informed KAN models, often referred to as PIKAN\[[36](https://arxiv.org/html/2605.06740#bib.bib3),[30](https://arxiv.org/html/2605.06740#bib.bib62),[35](https://arxiv.org/html/2605.06740#bib.bib64)\]\. Within this setting, we use the*LM\-KAN*variant from the broader GeoKAN family as the physics\-informed surrogate\. The training framework remains the standard residual\-based one, but the surrogate now learns a task\-dependent metric and evaluates its localized basis representation in metric\-adapted coordinates\. This allows a direct comparison with earlier PIKAN models based on existing KAN variants, while keeping the surrounding physics\-informed methodology essentially unchanged\.
Altogether this work shows GeoKAN contribution at two levels\. The curve\-fitting benchmarks examine its approximation properties in isolation\. The physics\-informed experiments examine whether the same geometry\-aware mechanism improves the solution of differential equations in practice\. The rest of the paper is organized as follows\. Section[2](https://arxiv.org/html/2605.06740#S2)reviews the background on KAN architecture\. Section[3](https://arxiv.org/html/2605.06740#S3)presents the GeoKAN framework and its main variants, together with the role of the learned metric in geometry\-adapted representation\. Section[4](https://arxiv.org/html/2605.06740#S4)studies matched\-capacity data\-fitting benchmarks to isolate the approximation behavior of the models\. Section[5](https://arxiv.org/html/2605.06740#S5)then turns to physics\-informed learning and compares the LM\-KAN surrogate with earlier PIKAN models\. Finally, Section[6](https://arxiv.org/html/2605.06740#S6)summarizes the main conclusions and discusses possible future directions\.
## 2Brief Overview of KAN Architecture
Before introducing Kolmogorov–Arnold Networks \(KANs\), we briefly recall the standard deep neural network \(DNN\), including the multilayer perceptron \(MLP\), whose approximation capability is classically justified by the universal approximation theorem\. In one standard form, ifσ\\sigmais a continuous sigmoidal activation function, then functions of the form
k\(𝐱\)=∑j=1Nαjσ\(𝐰jT𝐱\+bj\),𝐱,𝐰j∈ℝn,αj,bj∈ℝ,k\(\\mathbf\{x\}\)=\\sum\_\{j=1\}^\{N\}\\alpha\_\{j\}\\,\\sigma\\\!\\left\(\\mathbf\{w\}\_\{j\}^\{T\}\\mathbf\{x\}\+b\_\{j\}\\right\),\\qquad\\mathbf\{x\},\\mathbf\{w\}\_\{j\}\\in\\mathbb\{R\}^\{n\},\\;\\alpha\_\{j\},b\_\{j\}\\in\\mathbb\{R\},\(1\)are dense in the space of continuous functions on\[0,1\]n\[0,1\]^\{n\}\[[11](https://arxiv.org/html/2605.06740#bib.bib19)\]\. Hence, for any continuous target functionσ\(𝐱\)\\sigma\(\\mathbf\{x\}\)and anyε\>0\\varepsilon\>0, there exists such a network satisfying
\|k\(𝐱\)−σ\(𝐱\)\|<ε\|k\(\\mathbf\{x\}\)\-\\sigma\(\\mathbf\{x\}\)\|<\\varepsilon\(2\)on the given compact domain\[[15](https://arxiv.org/html/2605.06740#bib.bib21),[16](https://arxiv.org/html/2605.06740#bib.bib22)\]\. This result provides the theoretical basis for using sufficiently wide feed\-forward networks to approximate nonlinear maps\.
In a standard feed\-forward network, each neuron first forms an affine combination of its inputs and then applies a fixed nonlinear activation \(Fig\.[1](https://arxiv.org/html/2605.06740#S2.F1)\)\. Thus, if\{xi\}i=1n\\\{x\_\{i\}\\\}\_\{i=1\}^\{n\}are the inputs, with weights\{wi\}i=1n\\\{w\_\{i\}\\\}\_\{i=1\}^\{n\}and biasbb, then the neuron computes
z=∑i=1nwixi\+b,z=\\sum\_\{i=1\}^\{n\}w\_\{i\}x\_\{i\}\+b,\(3\)followed by
whereσ\\sigmais typically chosen in advance, for example ReLU,tanh\\tanh, or GELU\. In this framework, the trainable parameters are the linear weights and biases, while the nonlinearity is fixed at the node level\.
KAN is based instead on the Kolmogorov–Arnold representation theorem, which states that any continuous multivariate function can be represented through superpositions of continuous univariate functions and addition\[[20](https://arxiv.org/html/2605.06740#bib.bib25),[8](https://arxiv.org/html/2605.06740#bib.bib24),[1](https://arxiv.org/html/2605.06740#bib.bib23)\]\. More precisely, iff:\[0,1\]n→ℝf:\[0,1\]^\{n\}\\to\\mathbb\{R\}is continuous, then there exist continuous univariate functionsϕi,j\\phi\_\{i,j\}andψi\\psi\_\{i\}such that
f\(x1,…,xn\)=∑i=02nψi\(∑j=1nϕi,j\(xj\)\)\.f\(x\_\{1\},\\dots,x\_\{n\}\)=\\sum\_\{i=0\}^\{2n\}\\psi\_\{i\}\\\!\\left\(\\sum\_\{j=1\}^\{n\}\\phi\_\{i,j\}\(x\_\{j\}\)\\right\)\.\(5\)This theorem, originating from the resolution of Hilbert’s thirteenth problem by Kolmogorov and its refinement by Arnold, provides the conceptual foundation for KAN architectures \(Fig\.[1](https://arxiv.org/html/2605.06740#S2.F1)\)\.
Figure 1:Comparison of the fundamental input\-to\-node operation in a traditional DNN and a KAN\. For simplicity, the figure focuses on the local neuron/layer mechanism rather than the full deep architecture\. In a traditional DNN, inputs are first combined through learnable scalar weights and summed, after which a fixed nonlinearity is applied at the node\. In a KAN, by contrast, each input\-edge carries its own learnable univariate nonlinear function, and the node primarily performs additive aggregation of these transformed inputs\.### 2\.1Network Architectures of KAN in Comparison to Traditional DNN
Although earlier attempts had explored neural architectures motivated by the Kolmogorov–Arnold theorem\[[24](https://arxiv.org/html/2605.06740#bib.bib26),[22](https://arxiv.org/html/2605.06740#bib.bib27),[38](https://arxiv.org/html/2605.06740#bib.bib28),[23](https://arxiv.org/html/2605.06740#bib.bib29),[27](https://arxiv.org/html/2605.06740#bib.bib30),[13](https://arxiv.org/html/2605.06740#bib.bib31)\], the work in Ref\.\[[25](https://arxiv.org/html/2605.06740#bib.bib18)\]gave a practical and systematic realization of this idea\. In KAN, the role of a scalar edge weight is replaced by a learnable univariate nonlinear function\. In practice, these edge functions are often parameterized by spline representations, especially B\-splines, whose coefficients are learned during training\.
The structural contrast with a traditional DNN is immediate\. In a standard DNN, a neuron first forms a weighted sum of its inputs and only then applies a fixed nonlinearity:
z=∑i=1nwixi\+b,a=σ\(z\)\.z=\\sum\_\{i=1\}^\{n\}w\_\{i\}x\_\{i\}\+b,\\qquad a=\\sigma\(z\)\.\(6\)Thus, the learnable parameters are the scalar weightswiw\_\{i\}, while the activation functionσ\\sigmais prescribed in advance\.
In a KAN, the order is reversed at the local level\. Each input is first transformed by its own learnable univariate mapϕi:ℝ→ℝ\\phi\_\{i\}:\\mathbb\{R\}\\to\\mathbb\{R\}, and the node then aggregates these transformed signals additively:
z=∑i=1nϕi\(xi\)\+b\.z=\\sum\_\{i=1\}^\{n\}\\phi\_\{i\}\(x\_\{i\}\)\+b\.\(7\)
Because the edge mapsϕi\\phi\_\{i\}are themselves nonlinear and trainable, a separate fixed activation at the node is not essential\. If desired, one may still apply an additional outer univariate mapψ\\psi, giving
This expression should be understood as a single KAN node, or equivalently as one outer\-function component of the Kolmogorov–Arnold representation\. The full Kolmogorov–Arnold form contains multiple such outer functions, typically indexed byqq, whose outputs are summed\.
This simple scalar picture can also be written in the same feature\-construction language used later for GeoKAN\. Define the KAN feature vector
FKAN\(x\)=\[ϕ1\(x1\),ϕ2\(x2\),…,ϕn\(xn\)\]⊤\.F\_\{\\mathrm\{KAN\}\}\(x\)=\\big\[\\phi\_\{1\}\(x\_\{1\}\),\\phi\_\{2\}\(x\_\{2\}\),\\dots,\\phi\_\{n\}\(x\_\{n\}\)\\big\]^\{\\top\}\.\(9\)Here,FKAN\(x\)∈ℝnF\_\{\\mathrm\{KAN\}\}\(x\)\\in\\mathbb\{R\}^\{n\}collects the learned univariate edge features associated with the input coordinatesx1,…,xnx\_\{1\},\\dots,x\_\{n\}\. The node output may then be viewed as a linear mixing of these learned edge features:
z=𝕀⊤FKAN\(x\)\+b,z=\\mathbb\{I\}^\{\\top\}F\_\{\\mathrm\{KAN\}\}\(x\)\+b,\(10\)where𝕀∈ℝn\\mathbb\{I\}\\in\\mathbb\{R\}^\{n\}denotes the all\-ones vector, so that𝕀⊤FKAN\(x\)=∑i=1nϕi\(xi\)\\mathbb\{I\}^\{\\top\}F\_\{\\mathrm\{KAN\}\}\(x\)=\\sum\_\{i=1\}^\{n\}\\phi\_\{i\}\(x\_\{i\}\), andb∈ℝb\\in\\mathbb\{R\}is a scalar bias term\.
More generally, at the layer level, the same construction can be written as
h~\(ℓ\)=WKAN\(ℓ\)FKAN\(ℓ\)\+bKAN\(ℓ\)\.\\tilde\{h\}^\{\(\\ell\)\}=W\_\{\\mathrm\{KAN\}\}^\{\(\\ell\)\}F\_\{\\mathrm\{KAN\}\}^\{\(\\ell\)\}\+b\_\{\\mathrm\{KAN\}\}^\{\(\\ell\)\}\.\(11\)Here,FKAN\(ℓ\)F\_\{\\mathrm\{KAN\}\}^\{\(\\ell\)\}denotes the vector of learned univariate edge features at layerℓ\\ell,WKAN\(ℓ\)W\_\{\\mathrm\{KAN\}\}^\{\(\\ell\)\}is a trainable linear mixing matrix,bKAN\(ℓ\)b\_\{\\mathrm\{KAN\}\}^\{\(\\ell\)\}is the corresponding bias vector, andh~\(ℓ\)\\tilde\{h\}^\{\(\\ell\)\}denotes the pre\-activation output of the layer\.
Thus, standard KAN may be interpreted as a feature\-construction architecture in which the features are learnable univariate edge functions, whereas the node itself mainly performs additive aggregation\. This perspective is useful because it places KAN and GeoKAN in a common framework\. Both first construct a set of nonlinear features and then linearly combine them\. The essential difference is that in KAN the features are built directly from one\-dimensional edge maps, whereas in GeoKAN they are constructed after learning a geometry\-dependent warp of the representation\.
For the sake of understanding, the final output in a DNN is denoted asaa\(see Eq\. \([6](https://arxiv.org/html/2605.06740#S2.E6)\) \), while in a KAN, it is denoted asyy\(see Eq\. \([8](https://arxiv.org/html/2605.06740#S2.E8)\)\)\. This distinction is intentional to avoid confusion during comparison or analysis\.
Hence, whereas a DNN learns linear weights followed by a fixed node activation, a KAN places the learnable nonlinearities directly on the edges\. The node in a KAN mainly performs summation, while the trainable parameters specify the univariate edge functions\.
This distinction extends naturally to depth\. A deep DNN is built by stacking linear maps and fixed activations \(Fig\.[2](https://arxiv.org/html/2605.06740#S2.F2)\), whereas a deep KAN is formed by stacking layers whose entries are learnable univariate functions \(Fig\.[2](https://arxiv.org/html/2605.06740#S2.F2)\)\. Denoting theℓth\\ell^\{th\}KAN layer byΦ\(ℓ\)\\Phi^\{\(\\ell\)\}, the resulting architecture may be written as
KAN\(x\)=Φ\(L−1\)∘Φ\(L−2\)∘⋯∘Φ\(0\)\(x\),\\mathrm\{KAN\}\(x\)=\\Phi^\{\(L\-1\)\}\\circ\\Phi^\{\(L\-2\)\}\\circ\\cdots\\circ\\Phi^\{\(0\)\}\(x\),\(12\)where eachΦ\(ℓ\)\\Phi^\{\(\\ell\)\}represents a matrix of learnable one\-dimensional functions acting on edges, followed by additive aggregation at the nodes\. In this way, the single\-node picture shown in the earlier figure extends directly to deep architectures of arbitrary width and depth\.
Figure 2:Comparison of deep architectures in a traditional DNN and a KAN\. For clarity, the figure emphasizes the basic stacked structure rather than full implementation detail\. A traditional DNN is built by alternating learnable linear maps with fixed activations, whereas a KAN is built by stacking layers of learnable univariate edge functions whose outputs are additively aggregated at nodes\.
### 2\.2Variants of KAN in the Literature
Recent years have seen the rapid development of several variants of the Kolmogorov–Arnold Network \(KAN\), including FastKAN, Efficient\-KAN, Wav\-KAN, T\-KAN, and related architectures, each designed to address specific computational or application\-driven requirements\[[30](https://arxiv.org/html/2605.06740#bib.bib62),[35](https://arxiv.org/html/2605.06740#bib.bib64),[37](https://arxiv.org/html/2605.06740#bib.bib60)\]\. Among these, Efficient\-KAN and Wav\-KAN are especially relevant here\. Efficient\-KAN reformulates the original architecture using spline\-based edge functions \(Fig\.[3](https://arxiv.org/html/2605.06740#S2.F3)\) and improves computational efficiency and memory usage, making KAN more practical in large\-scale settings\[[4](https://arxiv.org/html/2605.06740#bib.bib58)\]\. Wav\-KAN, in contrast, replaces spline\-based edge functions with wavelet\-based ones \(Fig\.[3](https://arxiv.org/html/2605.06740#S2.F3)\), thereby introducing an explicitly localized and multiscale representation\[[6](https://arxiv.org/html/2605.06740#bib.bib61)\]\. Since Geometric KAN developed later in this work also relies on localized multiscale structure, Wav\-KAN is particularly relevant to discuss in greater detail\.
Wavelet\-based KAN \(Wav\-KAN\) modifies the original KAN construction by replacing spline\-based learnable edge functions with wavelet\-based ones\. The motivation is that wavelets provide basis functions that are localized both in position and in scale, which is advantageous when the target mapping contains sharp transitions, oscillations, or features distributed across multiple resolutions\.
Figure 3:Comparison of the general KAN formulation and two important variants\. In all cases, the layer update iszi\(ℓ\+1\)=∑j=1nℓϕij\(ℓ\)\(xj\(ℓ\)\)\+bi\(ℓ\)z\_\{i\}^\{\(\\ell\+1\)\}=\\sum\_\{j=1\}^\{n\_\{\\ell\}\}\\phi\_\{ij\}^\{\(\\ell\)\}\\\!\\left\(x\_\{j\}^\{\(\\ell\)\}\\right\)\+b\_\{i\}^\{\(\\ell\)\}\. Efficient\-KAN parameterizes the edge functionsϕij\(ℓ\)\\phi\_\{ij\}^\{\(\\ell\)\}by spline basis expansions, whereas Wav\-KAN employs wavelet\-based edge functions with explicit localization and scale\.The construction begins with a mother waveletψ:ℝ→ℝ\\psi:\\mathbb\{R\}\\to\\mathbb\{R\}, from which one generates translated and dilated wavelets
ψs,τ\(u\)=1sψ\(u−τs\),s\>0,τ∈ℝ\.\\psi\_\{s,\\tau\}\(u\)\\;=\\;\\frac\{1\}\{\\sqrt\{s\}\}\\,\\psi\\\!\\left\(\\frac\{u\-\\tau\}\{s\}\\right\),\\qquad s\>0,\\ \\tau\\in\\mathbb\{R\}\.\(13\)Here,sscontrols scale, with larger values capturing coarser behavior and smaller values resolving finer localized structure, whileτ\\taudetermines the position of the wavelet along the input axis\. This is the fundamental idea underlying the continuous wavelet transform,
C\(s,τ\)=∫−∞\+∞g\(t\)1sψ\(t−τs\)𝑑t,C\(s,\\tau\)\\;=\\;\\int\_\{\-\\infty\}^\{\+\\infty\}g\(t\)\\,\\frac\{1\}\{\\sqrt\{s\}\}\\,\\psi\\\!\\left\(\\frac\{t\-\\tau\}\{s\}\\right\)\\,dt,\(14\)which analyzes a signal across locations and resolutions\.
Wav\-KAN incorporates this multiscale structure directly into the KAN edge functions\. Instead of expressingϕij\(ℓ\)\\phi^\{\(\\ell\)\}\_\{ij\}through a spline basis, each edge is modeled by a learnable wavelet atom with trainable amplitude, translation, and scale:
ϕij\(ℓ\)\(u\)=wij\(ℓ\)ψ\(u−τij\(ℓ\)sij\(ℓ\)\),sij\(ℓ\)\>0,\\phi^\{\(\\ell\)\}\_\{ij\}\(u\)\\;=\\;w^\{\(\\ell\)\}\_\{ij\}\\,\\psi\\\!\\left\(\\frac\{u\-\\tau^\{\(\\ell\)\}\_\{ij\}\}\{s^\{\(\\ell\)\}\_\{ij\}\}\\right\),\\qquad s^\{\(\\ell\)\}\_\{ij\}\>0,\(15\)wherewij\(ℓ\)w^\{\(\\ell\)\}\_\{ij\}is the amplitude coefficient,τij\(ℓ\)\\tau^\{\(\\ell\)\}\_\{ij\}determines the location of the wavelet, andsij\(ℓ\)s^\{\(\\ell\)\}\_\{ij\}controls its effective support or bandwidth\. Substituting Eq\. \([15](https://arxiv.org/html/2605.06740#S2.E15)\) into the KAN layer definition gives
zi\(ℓ\+1\)=∑j=1nℓwij\(ℓ\)ψ\(xj\(ℓ\)−τij\(ℓ\)sij\(ℓ\)\)\+bi\(ℓ\),i=1,…,mℓ,z^\{\(\\ell\+1\)\}\_\{i\}\\;=\\;\\sum\_\{j=1\}^\{n\_\{\\ell\}\}w^\{\(\\ell\)\}\_\{ij\}\\,\\psi\\\!\\left\(\\frac\{x^\{\(\\ell\)\}\_\{j\}\-\\tau^\{\(\\ell\)\}\_\{ij\}\}\{s^\{\(\\ell\)\}\_\{ij\}\}\\right\)\\;\+\\;b^\{\(\\ell\)\}\_\{i\},\\qquad i=1,\\ldots,m\_\{\\ell\},\(16\)and, if desired, an outer nonlinearity may be applied as
ai\(ℓ\+1\)=σ\(ℓ\)\(zi\(ℓ\+1\)\),i=1,…,mℓ\.a^\{\(\\ell\+1\)\}\_\{i\}\\;=\\;\\sigma^\{\(\\ell\)\}\\\!\\bigl\(z^\{\(\\ell\+1\)\}\_\{i\}\\bigr\),\\qquad i=1,\\ldots,m\_\{\\ell\}\.\(17\)
The importance of wavelets here goes beyond computational convenience\. Because they encode locality and scale simultaneously, wavelets are well suited to problems in which relevant structure is concentrated near interfaces, singularities, sharp gradients, or other localized regions\. In multiscale settings such as PDEs, dynamical systems, and geometrically structured data, they provide a natural way to separate coarse global behavior from fine local corrections\. Compared with spline\-based parameterizations tied to a fixed partition, wavelet\-based edge functions can therefore adapt more naturally to irregular structure through their learned translations and dilations\.
From this perspective, Wav\-KAN is more than a computational variant of KAN; it provides a useful bridge toward geometry\-aware learning\. Its edge functions resolve features according to both location and scale, which is precisely the type of structure that later motivates Geometric KAN\. While Wav\-KAN enriches KAN through multiscale localized representations, Geometric KAN goes further by learning not only the representation but also the geometry of the input domain\.
## 3Geometric KAN: Motivation, Input Geometry, Variants, and Mathematical Formulation
Most existing deep learning models are defined on an input domainℝW\\mathbb\{R\}^\{W\}endowed with the standard Euclidean geometry\. This fixes both the metric and the effective resolution of the representation across the whole domain\. In many applications, however, the target map is not uniformly regular\. It may be smooth in some regions and vary sharply near interfaces, shocks, boundary layers, stiff transients, or localized singular structures\. In such cases, fixed coordinates allocate model capacity inefficiently\. Smooth regions are often over\-resolved, while the regions that matter most remain under\-resolved\.
This limitation also appears in KAN\-type models\. Methods such as Efficient\-KAN improve the flexibility of approximation by replacing scalar weights with learnable one\-dimensional edge functions\. However, these functions are still evaluated on the original coordinates\. Thus, the representation becomes more expressive, but the underlying geometry of the input domain remains fixed\. As a consequence, capturing sharp local variation typically requires either a finer basis grid or a larger model, even when the difficulty is highly localized\.
GeoKAN is motivated by a different principle\. The model should adapt not only the representation, namely the basis functions or feature map used to approximate the target, but also the geometry on which that representation is constructed\. Here, geometry is understood in the differential\-geometric sense, through a learned Riemannian metric on the input domain\. The central idea is to learn a task\-dependent metric that stretches regions of rapid variation and compresses smoother regions, so that basis evaluation is performed in geometry\-adapted coordinates rather than in the original Euclidean coordinates\.
### 3\.1Mathematical Prerequisites
#### 3\.1\.1Prerequisite 1: Learned Metric and Geometric Quantities
The central geometric object in GeoKAN is a learned diagonal Riemannian metric\[[34](https://arxiv.org/html/2605.06740#bib.bib65)\]\. For a representationu=\(u1,…,ud\)∈ℝdu=\(u\_\{1\},\\ldots,u\_\{d\}\)\\in\\mathbb\{R\}^\{d\}, we write
g\(u\)=diag\(g1\(u\),…,gd\(u\)\),gi\(u\)\>0\.g\(u\)=\\mathrm\{diag\}\\\!\\big\(g\_\{1\}\(u\),\\dots,g\_\{d\}\(u\)\\big\),\\qquad g\_\{i\}\(u\)\>0\.\(18\)Here,g\(u\)∈ℝd×dg\(u\)\\in\\mathbb\{R\}^\{d\\times d\}is a positive diagonal metric matrix whoseii\-th diagonal entry isgi\(u\)g\_\{i\}\(u\)\.
This metric defines the local inner product
⟨p,q⟩g\(u\)=p⊤g\(u\)q=∑i=1dgi\(u\)piqi,\\langle p,q\\rangle\_\{g\(u\)\}=p^\{\\top\}g\(u\)\\,q=\\sum\_\{i=1\}^\{d\}g\_\{i\}\(u\)\\,p\_\{i\}q\_\{i\},\(19\)
Here, the vectorsp=\(p1,…,pd\)∈ℝdp=\(p\_\{1\},\\ldots,p\_\{d\}\)\\in\\mathbb\{R\}^\{d\}andq=\(q1,…,qd\)∈ℝdq=\(q\_\{1\},\\ldots,q\_\{d\}\)\\in\\mathbb\{R\}^\{d\}denote arbitrary tangent vectors, or equivalently local perturbation directions, at the representationuu\.
And the corresponding infinitesimal length element
ds2=∑i=1dgi\(u\)\(dui\)2\.ds^\{2\}=\\sum\_\{i=1\}^\{d\}g\_\{i\}\(u\)\\,\(du\_\{i\}\)^\{2\}\.\(20\)Each componentgi\(u\)g\_\{i\}\(u\)controls local stretching or compression along directionuiu\_\{i\}\. Large values ofgi\(u\)g\_\{i\}\(u\)increase geometric distance along that coordinate and therefore increase effective representational resolution in that region\.
A second useful quantity is the volume distortion\. Since the metric is diagonal,
detg\(u\)=∏i=1dgi\(u\),logdetg\(u\)=∑i=1dloggi\(u\)\.\\det g\(u\)=\\prod\_\{i=1\}^\{d\}g\_\{i\}\(u\),\\qquad\\log\\det g\(u\)=\\sum\_\{i=1\}^\{d\}\\log g\_\{i\}\(u\)\.\(21\)This scalar summarizes how the learned geometry expands or contracts local volume\. In several GeoKAN variants,logdetg\(u\)\\log\\det g\(u\)is appended as an additional feature\.
#### 3\.1\.2Prerequisite 2: Geometry\-Adapted Feature Construction
The main difference between GeoKAN and standard KAN\-type models is that feature evaluation is performed after a learned geometric warp \(Fig\.[4](https://arxiv.org/html/2605.06740#S3.F4)\)\. For a coordinateuiu\_\{i\}, define the warped variable
zi\(u\)=uigi\(u\),i=1,…,d\.z\_\{i\}\(u\)=u\_\{i\}\\sqrt\{g\_\{i\}\(u\)\},\\qquad i=1,\\dots,d\.\(22\)A canonical geometry\-adapted building block has the form
φi,k\(u\)=ψ\(zi\(u\)−ci,ksi,k\)=ψ\(uigi\(u\)−ci,ksi,k\),\\varphi\_\{i,k\}\(u\)=\\psi\\\!\\left\(\\frac\{z\_\{i\}\(u\)\-c\_\{i,k\}\}\{s\_\{i,k\}\}\\right\)=\\psi\\\!\\left\(\\frac\{u\_\{i\}\\sqrt\{g\_\{i\}\(u\)\}\-c\_\{i,k\}\}\{s\_\{i,k\}\}\\right\),\(23\)whereψ\\psiis a chosen basis function,ci,kc\_\{i,k\}is a learnable center, andsi,k\>0s\_\{i,k\}\>0is a learnable scale\.
At a general level, the GeoKAN family is determined by three choices \(see Fig\.[4](https://arxiv.org/html/2605.06740#S3.F4)\):
\(i\) the metric modelg,\(ii\) the feature dictionaryF,\(iii\) any additional geometric features\.\\text\{\(i\) the metric model \}g,\\qquad\\text\{\(ii\) the feature dictionary \}F,\\qquad\\text\{\(iii\) any additional geometric features\.\}\(24\)
A central component of this construction is the choice of basis functionψ\\psiused in the post\-warp feature dictionary\. Since different basis families encode different approximation biases, the basis choice strongly influences which kinds of structures are represented most naturally after geometric warping\. Before introducing the unified layerwise formulation and the specific GeoKAN variants, we briefly summarize the basis families used in this work\.
#### 3\.1\.3Prerequisite 3: Basis Functions to Be Used in GeoKAN Variants
In GeoKAN\-type models, the nonlinear representation is constructed from a chosen family of basis functions applied after the learned geometric warp\. The basis determines the functional language in which the model expresses its nonlinear map, and therefore provides an important inductive bias\. In the variants considered in this work, the principal basis families are the wavelet basis, the radial basis function \(RBF\) basis, and the Fourier basis\. These bases enter the model after the input or hidden representation has been transformed into geometry\-adapted coordinates\.
##### Wavelet basis\.
A wavelet basis represents a function using shifted and scaled copies of a mother waveletψ\\psi:
f\(x\)=∑j,kcj,kψj,k\(x\),ψj,k\(x\)=2j/2ψ\(2jx−k\)\.f\(x\)=\\sum\_\{j,k\}c\_\{j,k\}\\,\\psi\_\{j,k\}\(x\),\\qquad\\psi\_\{j,k\}\(x\)=2^\{j/2\}\\psi\(2^\{j\}x\-k\)\.\(25\)Here,jjdenotes the scale,kkdenotes the location, andcj,kc\_\{j,k\}are coefficients\. In contrast to global trigonometric modes, wavelets are localized in both position and scale\. This makes them well suited for representing localized structure, sharp transitions, singular behavior, and multi\-resolution features\.
Within GeoKAN, wavelet basis are evaluated in the warped coordinateszi\(u\)=uigi\(u\)z\_\{i\}\(u\)=u\_\{i\}\\sqrt\{g\_\{i\}\(u\)\}rather than in the original Euclidean coordinates\. A typical geometry\-adapted wavelet atom therefore has the form
ϕi,k\(u\)=ψ\(zi\(u\)−ci,ksi,k\),\\phi\_\{i,k\}\(u\)=\\psi\\\!\\left\(\\frac\{z\_\{i\}\(u\)\-c\_\{i,k\}\}\{s\_\{i,k\}\}\\right\),\(26\)whereci,kc\_\{i,k\}andsi,ks\_\{i,k\}are learnable centers and scales\. In this way, local multi\-scale approximation is combined with the learned geometric stretching or compression of the input domain\.
##### Radial basis function\.
An RBF expansion represents a function as
f\(x\)=∑m=1Mcmϕ\(‖x−μm‖σm\),f\(x\)=\\sum\_\{m=1\}^\{M\}c\_\{m\}\\,\\phi\\\!\\left\(\\frac\{\\\|x\-\\mu\_\{m\}\\\|\}\{\\sigma\_\{m\}\}\\right\),\(27\)whereμm\\mu\_\{m\}is the center of themm\-th basis function,σm\\sigma\_\{m\}determines its width, andcmc\_\{m\}is a coefficient\. A common choice is the Gaussian RBF,
ϕ\(r\)=e−γr2,\\phi\(r\)=e^\{\-\\gamma r^\{2\}\},\(28\)which yields
f\(x\)=∑m=1Mcme−γ‖x−μm‖2\.f\(x\)=\\sum\_\{m=1\}^\{M\}c\_\{m\}\\,e^\{\-\\gamma\\\|x\-\\mu\_\{m\}\\\|^\{2\}\}\.\(29\)
RBFs are localized smooth bump functions centered around specific points, and they are especially effective for smooth local interpolation and approximation\. In GeoKAN, these basis functions are likewise evaluated in geometry\-adapted coordinates\. A typical warped RBF atom takes the form
ϕi,k\(u\)=exp\(−γ\(zi\(u\)−ci,ksi,k\)2\)\.\\phi\_\{i,k\}\(u\)=\\exp\\\!\\left\(\-\\gamma\\left\(\\frac\{z\_\{i\}\(u\)\-c\_\{i,k\}\}\{s\_\{i,k\}\}\\right\)^\{2\}\\right\)\.\(30\)Accordingly, the locality of the approximation is controlled jointly by the learned geometry and by the atom parameters\.
##### Fourier basis\.
A Fourier basis represents a function as a linear combination of sinusoidal modes:
f\(x\)=a0\+∑k=1K\[akcos\(kωx\)\+bksin\(kωx\)\],f\(x\)=a\_\{0\}\+\\sum\_\{k=1\}^\{K\}\\left\[a\_\{k\}\\cos\(k\\omega x\)\+b\_\{k\}\\sin\(k\\omega x\)\\right\],\(31\)whereaka\_\{k\}andbkb\_\{k\}are coefficients,ω\\omegais a base frequency, andKKdetermines the number of harmonics retained in the expansion\. This basis is particularly natural for oscillatory or approximately periodic phenomena, since sine and cosine functions already encode wave\-like structure\.
In the GeoKAN framework, Fourier features may also be evaluated after geometric warping\. A geometry\-adapted Fourier atom may be written as
ϕi,kcos\(u\)=cos\(kωzi\(u\)\),ϕi,ksin\(u\)=sin\(kωzi\(u\)\),\\phi\_\{i,k\}^\{\\cos\}\(u\)=\\cos\\\!\\big\(k\\omega z\_\{i\}\(u\)\\big\),\\qquad\\phi\_\{i,k\}^\{\\sin\}\(u\)=\\sin\\\!\\big\(k\\omega z\_\{i\}\(u\)\\big\),\(32\)where againzi\(u\)=uigi\(u\)z\_\{i\}\(u\)=u\_\{i\}\\sqrt\{g\_\{i\}\(u\)\}\. This allows oscillatory structure to be represented in coordinates that have already been adapted to the local geometry of the target map\. Such a construction is particularly appropriate when the underlying problem exhibits strong wave\-like behavior, as in the Helmholtz setting considered later in this work\.
##### Basis choice within the GeoKAN variants\.
The preceding basis families enter the GeoKAN variants in different ways depending on how the post\-warp representation is constructed\. In variants based on localized dictionaries, the geometry\-adapted coordinates may be expanded using wavelet, Gaussian RBF, or, for strongly oscillatory problems, Fourier basis function\. In more structured variants, the model may instead bypass an explicit post\-warp basis expansion and construct features directly from the learned metric and its derivatives\. This distinction in feature construction is one of the main mechanisms through which the GeoKAN variants differ\.
Figure 4:Comparison between a standard KAN and GeoKAN at the level of feature construction\. In a standard KAN, each input coordinate is passed directly through a learnable univariate edge function, and the resulting responses are additively combined, schematicallyz=∑iϕi\(xi\)\+bz=\\sum\_\{i\}\\phi\_\{i\}\(x\_\{i\}\)\+b\. Thus, the representation is learned directly in the original coordinate system\. In GeoKAN, the same additive principle is retained, but feature construction is preceded by a learned geometric warp: a positive metricgi\(x\)g\_\{i\}\(x\)first reshapes each coordinate throughzi=xigi\(x\)z\_\{i\}=x\_\{i\}\\sqrt\{g\_\{i\}\(x\)\}, after which geometry\-aware responses are constructed from the warped representation\. These responses may be realized by localized basis functions, such as wavelet, RBF, or Fourier, or by explicit metric\-derived quantities\. The figure therefore highlights the central distinction: KAN learns nonlinear responses in the original coordinates, whereas GeoKAN first learns the geometry of the representation space and then builds nonlinear responses within that learned geometry\.
### 3\.2GeoKAN
In a standard KAN, one may first describe the computation at the level of a single output unit in a hidden layer \(see Fig[4](https://arxiv.org/html/2605.06740#S3.F4)\)\. Let
x=\(x1,…,xn\)x=\(x\_\{1\},\\dots,x\_\{n\}\)denote the vector received by this unit from the previous layer\. Each coordinatexix\_\{i\}is passed through a learnable univariate edge functionϕi\\phi\_\{i\}, and the resulting scalar responses are additively combined to produce the unit’s pre\-activation output,
z=∑i=1nϕi\(xi\)\+b\.z=\\sum\_\{i=1\}^\{n\}\\phi\_\{i\}\(x\_\{i\}\)\+b\.The quantityzztherefore represents the scalar output of one hidden\-layer unit before the outer nonlinearity is applied, rather than the output of the entire layer\. Applying the node function gives
Hence, the local computation of a KAN unit can be viewed as first extracting coordinate\-wise nonlinear responses and then aggregating them into a single hidden\-unit response\. Here, the learnable nonlinear responses are applied directly in the original input space\. Each coordinate contributes through its own edge\-wise functionϕi\\phi\_\{i\}, and the node or unit then combines these responses by summation\. In this sense, KAN learns which nonlinear one\-dimensional responses should be extracted from the raw coordinates and then aggregates them\.
GeoKAN can be introduced most clearly by first looking at the computation performed by a single hidden\-layer unit\. Suppose this unit receives the same input vector as in KAN from the previous layer, GeoKAN keeps the one\-unit additive structure of standard KAN, but changes the nature of the coordinate\-wise response\. Instead of evaluating the nonlinear response directly on the raw coordinatexix\_\{i\}, GeoKAN first introduces a learned positive metricgi\(x\)g\_\{i\}\(x\)\([18](https://arxiv.org/html/2605.06740#S3.E18)\), which locally reshapes the input space\. Similar to Eq\. \([22](https://arxiv.org/html/2605.06740#S3.E22)\), a simple metric\-warped coordinate is
ξi=xigi\(x\)\.\\xi\_\{i\}=x\_\{i\}\\sqrt\{g\_\{i\}\(x\)\}\.The contribution of theii\-th coordinate is then evaluated in this warped geometry\. Therefore, for one hidden\-layer unit, the GeoKAN response can be written schematically as
z=b\+∑i=1n𝒢i\(xi,gi\(x\)\),z=b\+\\sum\_\{i=1\}^\{n\}\\mathcal\{G\}\_\{i\}\\\!\\left\(x\_\{i\},g\_\{i\}\(x\)\\right\),where𝒢i\\mathcal\{G\}\_\{i\}denotes a geometry\-aware nonlinear contribution associated with theii\-th input coordinate\. In the simplest case, this may take the form
𝒢i\(xi,gi\(x\)\)=ϕi\(ξi\)=ϕi\(xigi\(x\)\)\.\\mathcal\{G\}\_\{i\}\\\!\\left\(x\_\{i\},g\_\{i\}\(x\)\\right\)=\\phi\_\{i\}\\\!\\left\(\\xi\_\{i\}\\right\)=\\phi\_\{i\}\\\!\\left\(x\_\{i\}\\sqrt\{g\_\{i\}\(x\)\}\\right\)\.so that the ordinary KAN responseϕi\(xi\)\\phi\_\{i\}\(x\_\{i\}\)is replaced by a response evaluated after a learned metric warp\.
More flexible GeoKAN variants may enrich𝒢i\\mathcal\{G\}\_\{i\}further by using localized basis functions or additional geometric quantities\. For example,𝒢i\\mathcal\{G\}\_\{i\}may be constructed from wavelet, Gaussian RBF, Fourier basis, or explicit metric\-dependent features such as
xigi\(x\),∂xiloggi\(x\),gi\(x\),logdetg\(x\)\.x\_\{i\}\\sqrt\{g\_\{i\}\(x\)\},\\qquad\\partial\_\{x\_\{i\}\}\\log g\_\{i\}\(x\),\\qquad\\sqrt\{g\_\{i\}\(x\)\},\\qquad\\log\\det g\(x\)\.The essential idea is that the nonlinear response is no longer learned only in the original coordinate system; it is learned after the input has been locally reshaped by a data\-dependent geometry\.
For a full hidden layer with multiple output units, the same idea is applied to each unit\. Ifjjindexes the output unit, then a GeoKAN layer can be written as
zj=bj\+∑i=1n𝒢ji\(xi,gi\(x\)\),j=1,…,m\.z\_\{j\}=b\_\{j\}\+\\sum\_\{i=1\}^\{n\}\\mathcal\{G\}\_\{ji\}\\\!\\left\(x\_\{i\},g\_\{i\}\(x\)\\right\),\\qquad j=1,\\ldots,m\.Here,𝒢ji\\mathcal\{G\}\_\{ji\}is the geometry\-aware response connecting input coordinateiito output unitjj\. In vector form, the layer maps
x⟼z=\(z1,…,zm\)\.x\\longmapsto z=\(z\_\{1\},\\ldots,z\_\{m\}\)\.
In the implemented GeoKAN/LM\-KAN models used here, this geometry\-aware layer output is followed by a node\-wise nonlinearity between hidden layers:
yj=ψ\(zj\),ψ=tanh\.y\_\{j\}=\\psi\(z\_\{j\}\),\\qquad\\psi=\\tanh\.This final nonlinearity should be understood as an implementation\-level hybridization\. The standard KAN formulation keeps the node as a pure summation operator, whereas the present GeoKAN/LM\-KAN implementation combines KAN\-style geometry\-aware responses with an MLP\-style outer activation\.
This direct scalar viewpoint also makes it easier to understand the full layerwise construction\. Let
h\(0\)=x∈ℝd0,h^\{\(0\)\}=x\\in\\mathbb\{R\}^\{d\_\{0\}\},\(33\)and leth\(ℓ−1\)∈ℝdℓ−1h^\{\(\\ell\-1\)\}\\in\\mathbb\{R\}^\{d\_\{\\ell\-1\}\}denote the input to layerℓ\\ell\. A generic GeoKAN layer first learns a positive diagonal metric over the incoming representation,
g\(ℓ\)\(h\(ℓ−1\)\)=diag\(g1\(ℓ\),…,gdℓ−1\(ℓ\)\),gi\(ℓ\)\>0\.g^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)=\\mathrm\{diag\}\\\!\\Big\(g\_\{1\}^\{\(\\ell\)\},\\ldots,g\_\{d\_\{\\ell\-1\}\}^\{\(\\ell\)\}\\Big\),\\qquad g\_\{i\}^\{\(\\ell\)\}\>0\.\(34\)This metric defines a locally warped representation
ξ\(ℓ\)=h\(ℓ−1\)⊙g\(ℓ\)\(h\(ℓ−1\)\)\.\\xi^\{\(\\ell\)\}=h^\{\(\\ell\-1\)\}\\odot\\sqrt\{g^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\}\.\(35\)Here,⊙\\odotdenotes element\-wise multiplication, so theii\-th warped coordinate isξi\(ℓ\)=hi\(ℓ−1\)gi\(ℓ\)\(h\(ℓ−1\)\)\.\\xi\_\{i\}^\{\(\\ell\)\}=h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\}\.The layer then constructs a variant\-dependent geometry\-aware feature vector
F\(ℓ\)\(h\(ℓ−1\)\)∈ℝMℓ,F^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\\in\\mathbb\{R\}^\{M\_\{\\ell\}\},\(36\)whose entries may depend on the warped coordinatesξ\(ℓ\)\\xi^\{\(\\ell\)\}, the metric valuesg\(ℓ\)g^\{\(\\ell\)\}, and, in some variants, additional metric\-derived quantities\. The pre\-activation output of the layer is then computed as
h~\(ℓ\)=W\(ℓ\)F\(ℓ\)\(h\(ℓ−1\)\)\+b\(ℓ\)\.\\tilde\{h\}^\{\(\\ell\)\}=W^\{\(\\ell\)\}F^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\+b^\{\(\\ell\)\}\.\(37\)
Thus, the scalar quantityzzintroduced for one hidden unit corresponds, in the full layer notation, to one component of the pre\-activation vector:
z=h~j\(ℓ\)\.z=\\tilde\{h\}^\{\(\\ell\)\}\_\{j\}\.
For hidden layers in the implemented GeoKAN/LM\-KAN models, this pre\-activation is followed by a pointwise nonlinearity, for example
h\(ℓ\)=ψ\(h~\(ℓ\)\),ψ=tanh,ℓ=1,…,L\.h^\{\(\\ell\)\}=\\psi\\\!\\left\(\\tilde\{h\}^\{\(\\ell\)\}\\right\),\\qquad\\psi=\\tanh,\\qquad\\ell=1,\\ldots,L\.\(38\)Here, each componenth~j\(ℓ\)\\tilde\{h\}^\{\(\\ell\)\}\_\{j\}is precisely the layerwise analogue of the scalar unit outputzz; that is, for thejj\-th hidden unit,z=h~j\(ℓ\)z=\\tilde\{h\}^\{\(\\ell\)\}\_\{j\}\. A final linear readout then produces the model prediction,
y^\(x\)=Wouth\(L\)\+bout\.\\hat\{y\}\(x\)=W\_\{\\mathrm\{out\}\}h^\{\(L\)\}\+b\_\{\\mathrm\{out\}\}\.\(39\)Thus, the scalar intuition and the layerwise formalism are consistent\. At the scalar level GeoKAN forms geometry\-aware coordinate responses and combines them, while at the layer level it builds a geometry\-aware feature vector and linearly mixes those features to produce the next representation\.
### 3\.3GeoKAN Variants
The main GeoKAN variants arise from three natural modeling choices\. The first is the parameterization of the metric\. One may learn the metric from the full incoming representation through a coupled model such as
gi\(u\)=softplus\(MetricNeti\(u\)\)\+ε,g\_\{i\}\(u\)=\\mathrm\{softplus\}\\\!\\big\(\\mathrm\{MetricNet\}\_\{i\}\(u\)\\big\)\+\\varepsilon,\(40\)whereMetricNeti\\mathrm\{MetricNet\}\_\{i\}denotes theii\-th scalar output of a trainable metric network
MetricNet:ℝdin→ℝdin,\\mathrm\{MetricNet\}:\\mathbb\{R\}^\{d\_\{\\mathrm\{in\}\}\}\\to\\mathbb\{R\}^\{d\_\{\\mathrm\{in\}\}\},which maps the full incoming representationu=\(u1,…,udin\)u=\(u\_\{1\},\\ldots,u\_\{d\_\{\\mathrm\{in\}\}\}\)to unconstrained metric logits\. The softplus transformation, together with the small offsetε\>0\\varepsilon\>0, ensures that each diagonal metric componentgi\(u\)g\_\{i\}\(u\)is strictly positive\. This coupled parameterization allows the local scaling of one coordinate to depend on the others\.
Alternatively, one may use a more structured separable form,
gi\(ui\)=exp\(∑k=1Kci,kρk\(ui\)\),g\_\{i\}\(u\_\{i\}\)=\\exp\\\!\\left\(\\sum\_\{k=1\}^\{K\}c\_\{i,k\}\\,\\rho\_\{k\}\(u\_\{i\}\)\\right\),\(41\)whereρk\\rho\_\{k\}denotes a localized basis function\. This separable form is lighter, more interpretable, and less expensive\.
The second choice is the construction of post\-warp features\. After the geometry has transformeduuinto warped coordinates
ξi\(u\)=uigi\(u\),\\xi\_\{i\}\(u\)=u\_\{i\}\\sqrt\{g\_\{i\}\(u\)\},\(42\)the model may build features using wavelet, Gaussian RBF, Fourier basis functions, or, in the most structured case, explicit geometric quantities derived directly from the metric itself\.
The third choice is whether to append additional geometric summaries, such as the volume termlogdetg\(u\)\\log\\det g\(u\), or derivative\-based quantities such as
γi\(ui\)=12∂uiloggi\(ui\)\.\\gamma\_\{i\}\(u\_\{i\}\)=\\frac\{1\}\{2\}\\partial\_\{u\_\{i\}\}\\log g\_\{i\}\(u\_\{i\}\)\.\(43\)These choices determine the major GeoKAN variants in a systematic way rather than in an ad hoc manner\.
From this perspective, GeoKAN\-NNMetric corresponds to the case in which the metric is learned from the full representation and the post\-warp features are constructed using localized wavelet basis, typically together with a volume term\. GeoKAN\-γ\\gammacorresponds to the more structured setting in which the metric is separable and the features are built explicitly from metric\-derived geometric quantities such as the warped coordinate, the local logarithmic derivative of the metric, and the metric magnitude itself\. LM\-KAN again uses a coupled learned metric, but allows the post\-warp feature dictionary to be chosen according to the target problem, for example using wavelet, RBF, or Fourier basis functions\. In this way, all variants remain instances of the same general GeoKAN principle: learn a geometry, construct nonlinear features within that learned geometry, and then combine them to produce the output\.
Accordingly, the distinction between KAN and GeoKAN can be summarized in a simple and precise way\. KAN may be described as learning nonlinear edge functions and summing them, whereas GeoKAN first learns the local geometry, constructs nonlinear responses in that learned geometry, and then sums or mixes those responses\. A compact generic scalar template for one GeoKAN unit is therefore
z=b\+∑i=1n𝒢i\(xigi\(x\),gi\(x\),∂xiloggi\(x\),…\)z=b\+\\sum\_\{i=1\}^\{n\}\\mathcal\{G\}\_\{i\}\\\!\\left\(x\_\{i\}\\sqrt\{g\_\{i\}\(x\)\},\\,g\_\{i\}\(x\),\\,\\partial\_\{x\_\{i\}\}\\log g\_\{i\}\(x\),\\,\\ldots\\right\)\(44\)where the precise arguments ofΦi\\Phi\_\{i\}depend on the chosen variant\. In the implemented hidden layers used here, this scalar pre\-activation may then be passed through an additional pointwise nonlinearity,
y=ψ\(z\),ψ=tanh\.y=\\psi\(z\),\\qquad\\psi=\\tanh\.\(45\)This expression captures the central idea of the framework: GeoKAN preserves the additive response structure of KAN, but extends it by making the response itself geometry\-aware through a learned metric warp\.
In one sentence, the direct\-scalar interpretation of GeoKAN is this: instead of summing learnable nonlinear functions of the raw inputs, GeoKAN sums learnable or structured nonlinear functions of geometrically warped inputs and related metric features\.
### 3\.4GeoKAN\-NNMetric
GeoKAN\-NNMetric is a flexible coupled\-metric variant of the GeoKAN framework\. Within the generic GeoKAN template introduced above, it corresponds to the choice of a learned metric that depends on the full incoming representation, followed by a post\-warp wavelet feature dictionary and an additional volume summary term\. In this way, the model first learns a data\-adaptive local geometry of the representation space and then constructs localized nonlinear responses within that learned geometry\. Because the metric depends on the full input to the layer, the local scaling of one coordinate may depend on the others, allowing the model to capture coupled nonlinear structure that may not be well represented by more separable alternatives\. The resulting warped representation is then expanded using Mexican\-hat wavelet basis, making GeoKAN\-NNMetric a natural variant when one seeks a flexible geometry\-aware model with localized multiscale features\.
Leth\(ℓ−1\)∈ℝdℓ−1h^\{\(\\ell\-1\)\}\\in\\mathbb\{R\}^\{d\_\{\\ell\-1\}\}denote the input to layerℓ\\ell\. GeoKAN\-NNMetric learns a positive diagonal metric whoseii\-th component is given by
gi\(ℓ\)\(h\(ℓ−1\)\)=softplus\(MetricNeti\(ℓ\)\(h\(ℓ−1\)\)\)\+ε,i=1,…,dℓ−1\.g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)=\\mathrm\{softplus\}\\\!\\left\(\\mathrm\{MetricNet\}^\{\(\\ell\)\}\_\{i\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\\right\)\+\\varepsilon,\\qquad i=1,\\dots,d\_\{\\ell\-1\}\.\(46\)Here, the metric componentgi\(ℓ\)g\_\{i\}^\{\(\\ell\)\}is a function of the full incoming representationh\(ℓ−1\)h^\{\(\\ell\-1\)\}, not only of the coordinatehi\(ℓ−1\)h\_\{i\}^\{\(\\ell\-1\)\}\. The corresponding warped coordinate is written consistently as
ξi\(ℓ\)=hi\(ℓ−1\)gi\(ℓ\)\(h\(ℓ−1\)\)\.\\xi\_\{i\}^\{\(\\ell\)\}=h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\}\.\(47\)
For each coordinateiiand wavelet basisk=1,…,Kk=1,\\dots,K, define the normalized post\-warp coordinate
ri,k\(ℓ\)=ξi\(ℓ\)−ci,k\(ℓ\)si,k\(ℓ\),si,k\(ℓ\)\>0,r\_\{i,k\}^\{\(\\ell\)\}=\\frac\{\\xi\_\{i\}^\{\(\\ell\)\}\-c\_\{i,k\}^\{\(\\ell\)\}\}\{s\_\{i,k\}^\{\(\\ell\)\}\},\\qquad s\_\{i,k\}^\{\(\\ell\)\}\>0,\(48\)whereci,k\(ℓ\)c\_\{i,k\}^\{\(\\ell\)\}andsi,k\(ℓ\)s\_\{i,k\}^\{\(\\ell\)\}are the center and scale of thekk\-th basis associated with coordinateii\. GeoKAN\-NNMetric uses the Mexican\-hat wavelet
ψwav\(r\)=\(1−r2\)exp\(−r22\),\\psi\_\{\\mathrm\{wav\}\}\(r\)=\(1\-r^\{2\}\)\\exp\\\!\\left\(\-\\frac\{r^\{2\}\}\{2\}\\right\),\(49\)and hence the corresponding wavelet feature is
ηi,k\(ℓ\)=ψwav\(ri,k\(ℓ\)\)\.\\eta\_\{i,k\}^\{\(\\ell\)\}=\\psi\_\{\\mathrm\{wav\}\}\\\!\\left\(r\_\{i,k\}^\{\(\\ell\)\}\\right\)\.\(50\)We useηi,k\(ℓ\)\\eta\_\{i,k\}^\{\(\\ell\)\}for these dictionary features in order to avoid confusing them with the standard KAN edge functionsϕi\\phi\_\{i\}\.
The layer also includes the volume feature
v\(ℓ\)=∑i=1dℓ−1loggi\(ℓ\)\(h\(ℓ−1\)\)=logdetg\(ℓ\)\(h\(ℓ−1\)\),v^\{\(\\ell\)\}=\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\log g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)=\\log\\det g^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\),\(51\)where the last equality follows because the learned metric is diagonal\. The GeoKAN\-NNMetric feature vector is therefore
FNNMetric\(ℓ\)=\[η1,1\(ℓ\),…,ηdℓ−1,K\(ℓ\),v\(ℓ\)\]⊤\.F\_\{\\mathrm\{NNMetric\}\}^\{\(\\ell\)\}=\\Big\[\\eta\_\{1,1\}^\{\(\\ell\)\},\\dots,\\eta\_\{d\_\{\\ell\-1\},K\}^\{\(\\ell\)\},v^\{\(\\ell\)\}\\Big\]^\{\\top\}\.\(52\)
The layerwise pre\-activation output is computed by linearly mixing these geometry\-aware features:
h~NNMetric\(ℓ\)=WNNMetric\(ℓ\)FNNMetric\(ℓ\)\+bNNMetric\(ℓ\)\.\\tilde\{h\}\_\{\\mathrm\{NNMetric\}\}^\{\(\\ell\)\}=W\_\{\\mathrm\{NNMetric\}\}^\{\(\\ell\)\}F\_\{\\mathrm\{NNMetric\}\}^\{\(\\ell\)\}\+b\_\{\\mathrm\{NNMetric\}\}^\{\(\\ell\)\}\.\(53\)As in the generic GeoKAN notation, each component ofh~NNMetric\(ℓ\)\\tilde\{h\}\_\{\\mathrm\{NNMetric\}\}^\{\(\\ell\)\}corresponds to the scalar outputzzof one hidden\-layer unit\.
Equivalently, for output channelj=1,…,dℓj=1,\\dots,d\_\{\\ell\}, the expanded scalar form is
h~NNMetric,j\(ℓ\)=bNNMetric,j\(ℓ\)\+∑i=1dℓ−1∑k=1Kaj,i,k\(ℓ\)ψwav\(hi\(ℓ−1\)gi\(ℓ\)\(h\(ℓ−1\)\)−ci,k\(ℓ\)si,k\(ℓ\)\)\+aj,vol\(ℓ\)∑i=1dℓ−1loggi\(ℓ\)\(h\(ℓ−1\)\)\.\\tilde\{h\}\_\{\\mathrm\{NNMetric\},j\}^\{\(\\ell\)\}=b\_\{\\mathrm\{NNMetric\},j\}^\{\(\\ell\)\}\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\sum\_\{k=1\}^\{K\}a\_\{j,i,k\}^\{\(\\ell\)\}\\psi\_\{\\mathrm\{wav\}\}\\\!\\left\(\\frac\{h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\(h^\{\(\\ell\-1\)\}\)\}\-c\_\{i,k\}^\{\(\\ell\)\}\}\{s\_\{i,k\}^\{\(\\ell\)\}\}\\right\)\+a\_\{j,\\mathrm\{vol\}\}^\{\(\\ell\)\}\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\log g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\.\(54\)Thus, GeoKAN\-NNMetric realizes the general GeoKAN principle by learning a coupled positive metric, warping each coordinate by that learned geometry, building localized wavelet responses in the warped coordinates, appending a volume summary, and finally mixing these features to produce the next\-layer pre\-activation\.
Figure 5:Schematic comparison of the main GeoKAN variants through their metric and post\-warp feature construction\. GeoKAN\-NNMetric uses a coupled learned metricgi\(h\)=softplus\(MetricNeti\(h\)\)\+εg\_\{i\}\(h\)=\\mathrm\{softplus\}\(\\mathrm\{MetricNet\}\_\{i\}\(h\)\)\+\\varepsilontogether with warped wavelet features and a volume term∑iloggi\(h\)\\sum\_\{i\}\\log g\_\{i\}\(h\)\. GeoKAN\-γ\\gammauses a separable metricgi\(hi\)g\_\{i\}\(h\_\{i\}\)and replaces a warped basis dictionary by explicit metric\-derived features such ashigih\_\{i\}\\sqrt\{g\_\{i\}\},γi=12∂hiloggi\\gamma\_\{i\}=\\frac\{1\}\{2\}\\partial\_\{h\_\{i\}\}\\log g\_\{i\}, andgi\\sqrt\{g\_\{i\}\}\. LM\-KAN again uses a coupled learned metric, but builds the post\-warp dictionary from wavelet, RBF, or Fourier basis, making it the most flexible basis\-driven variant for PDE\-oriented settings\.
### 3\.5GeoKAN\-γ\\gamma
GeoKAN\-γ\\gammais the lightest and most structured variant in the GeoKAN family\. It uses a separable metric, so each coordinate learns its own local scaling independently\. Rather than applying a learned wavelet or RBF dictionary after the warp, it constructs explicit geometric features from the metric and its local variation \(Fig\.[5](https://arxiv.org/html/2605.06740#S3.F5)b\)\. This gives the model a stronger inductive bias, makes the geometric role of each feature easier to interpret, and keeps the architecture relatively compact\.
The metric is defined by
loggi\(ℓ\)\(hi\(ℓ−1\)\)=∑k=1Kci,k\(ℓ\)ρk\(hi\(ℓ−1\)\),\\log g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)=\\sum\_\{k=1\}^\{K\}c\_\{i,k\}^\{\(\\ell\)\}\\rho\_\{k\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\),\(55\)and hence
gi\(ℓ\)\(hi\(ℓ−1\)\)=exp\[∑k=1Kci,k\(ℓ\)ρk\(hi\(ℓ−1\)\)\]\.g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)=\\exp\\\!\\left\[\\sum\_\{k=1\}^\{K\}c\_\{i,k\}^\{\(\\ell\)\}\\rho\_\{k\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\\right\]\.\(56\)In the implementation, the basis functionsρk\\rho\_\{k\}are Gaussian RBFs on a one\-dimensional grid\.
This variant does not use a post\-warp wavelet or RBF dictionary\. Instead, it constructs explicit geometric features:
σi\(ℓ\)\\displaystyle\\sigma\_\{i\}^\{\(\\ell\)\}=SiLU\(hi\(ℓ−1\)\),\\displaystyle=\\mathrm\{SiLU\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\),\(57\)ξi\(ℓ\)\\displaystyle\\xi\_\{i\}^\{\(\\ell\)\}=hi\(ℓ−1\)gi\(ℓ\)\(hi\(ℓ−1\)\),\\displaystyle=h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\},\(58\)γi\(ℓ\)\\displaystyle\\gamma\_\{i\}^\{\(\\ell\)\}=12∂hi\(ℓ−1\)loggi\(ℓ\)\(hi\(ℓ−1\)\),\\displaystyle=\\frac\{1\}\{2\}\\partial\_\{h\_\{i\}^\{\(\\ell\-1\)\}\}\\log g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\),\(59\)qi\(ℓ\)\\displaystyle q\_\{i\}^\{\(\\ell\)\}=gi\(ℓ\)\(hi\(ℓ−1\)\)\.\\displaystyle=\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\}\.\(60\)Here,ξi\(ℓ\)\\xi\_\{i\}^\{\(\\ell\)\}is the warped coordinate,γi\(ℓ\)\\gamma\_\{i\}^\{\(\\ell\)\}measures the local logarithmic variation of the metric, andqi\(ℓ\)q\_\{i\}^\{\(\\ell\)\}represents the metric magnitude through its square root\.
These metric\-derived quantities are combined into a geometric branch
geoi\(ℓ\)=αi\(ℓ\)ξi\(ℓ\)\+βi\(ℓ\)γi\(ℓ\)\+δi\(ℓ\)qi\(ℓ\)\.\\mathrm\{geo\}\_\{i\}^\{\(\\ell\)\}=\\alpha\_\{i\}^\{\(\\ell\)\}\\xi\_\{i\}^\{\(\\ell\)\}\+\\beta\_\{i\}^\{\(\\ell\)\}\\gamma\_\{i\}^\{\(\\ell\)\}\+\\delta\_\{i\}^\{\(\\ell\)\}q\_\{i\}^\{\(\\ell\)\}\.\(61\)The feature vector is
Fγ\(ℓ\)=\[σ1\(ℓ\),…,σdℓ−1\(ℓ\),geo1\(ℓ\),…,geodℓ−1\(ℓ\)\]⊤\.F\_\{\\gamma\}^\{\(\\ell\)\}=\\Big\[\\sigma\_\{1\}^\{\(\\ell\)\},\\dots,\\sigma\_\{d\_\{\\ell\-1\}\}^\{\(\\ell\)\},\\mathrm\{geo\}\_\{1\}^\{\(\\ell\)\},\\dots,\\mathrm\{geo\}\_\{d\_\{\\ell\-1\}\}^\{\(\\ell\)\}\\Big\]^\{\\top\}\.\(62\)The layerwise pre\-activation output is
h~γ\(ℓ\)=Wγ\(ℓ\)Fγ\(ℓ\)\+bγ\(ℓ\)\.\\tilde\{h\}\_\{\\gamma\}^\{\(\\ell\)\}=W\_\{\\gamma\}^\{\(\\ell\)\}F\_\{\\gamma\}^\{\(\\ell\)\}\+b\_\{\\gamma\}^\{\(\\ell\)\}\.\(63\)As in the generic GeoKAN notation, each component ofh~γ\(ℓ\)\\tilde\{h\}\_\{\\gamma\}^\{\(\\ell\)\}corresponds to the scalar outputzzof one hidden\-layer unit\.
Equivalently, for output channelj=1,…,dℓj=1,\\dots,d\_\{\\ell\}, the expanded scalar form is
h~γ,j\(ℓ\)=bγ,j\(ℓ\)\+∑i=1dℓ−1uj,i\(ℓ\)SiLU\(hi\(ℓ−1\)\)\+∑i=1dℓ−1vj,i\(ℓ\)\[αi\(ℓ\)ξi\(ℓ\)\+βi\(ℓ\)γi\(ℓ\)\+δi\(ℓ\)qi\(ℓ\)\]\.\\tilde\{h\}\_\{\\gamma,j\}^\{\(\\ell\)\}=b\_\{\\gamma,j\}^\{\(\\ell\)\}\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}u\_\{j,i\}^\{\(\\ell\)\}\\,\\mathrm\{SiLU\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}v\_\{j,i\}^\{\(\\ell\)\}\\Big\[\\alpha\_\{i\}^\{\(\\ell\)\}\\xi\_\{i\}^\{\(\\ell\)\}\+\\beta\_\{i\}^\{\(\\ell\)\}\\gamma\_\{i\}^\{\(\\ell\)\}\+\\delta\_\{i\}^\{\(\\ell\)\}q\_\{i\}^\{\(\\ell\)\}\\Big\]\.\(64\)Substituting the definitions ofξi\(ℓ\)\\xi\_\{i\}^\{\(\\ell\)\}andqi\(ℓ\)q\_\{i\}^\{\(\\ell\)\}, this can also be written as
h~γ,j\(ℓ\)=bγ,j\(ℓ\)\+∑i=1dℓ−1uj,i\(ℓ\)SiLU\(hi\(ℓ−1\)\)\+∑i=1dℓ−1vj,i\(ℓ\)\[αi\(ℓ\)hi\(ℓ−1\)gi\(ℓ\)\(hi\(ℓ−1\)\)\+βi\(ℓ\)γi\(ℓ\)\+δi\(ℓ\)gi\(ℓ\)\(hi\(ℓ−1\)\)\]\.\\tilde\{h\}\_\{\\gamma,j\}^\{\(\\ell\)\}=b\_\{\\gamma,j\}^\{\(\\ell\)\}\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}u\_\{j,i\}^\{\(\\ell\)\}\\,\\mathrm\{SiLU\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}v\_\{j,i\}^\{\(\\ell\)\}\\Big\[\\alpha\_\{i\}^\{\(\\ell\)\}h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\}\+\\beta\_\{i\}^\{\(\\ell\)\}\\gamma\_\{i\}^\{\(\\ell\)\}\+\\delta\_\{i\}^\{\(\\ell\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h\_\{i\}^\{\(\\ell\-1\)\}\\right\)\}\\Big\]\.\(65\)Thus, GeoKAN\-γ\\gammais best viewed as a metric\-feature model rather than a warped basis model\.
### 3\.6LM\-KAN
LM\-KAN is a PDE\-oriented branch of the same geometric framework\. Like GeoKAN\-NNMetric, it learns a coupled metric from the full incoming representation\. In terms of feature construction, it employs a localized post\-warp dictionary, whose basis may be chosen according to the structure of the target problem, including wavelet, Gaussian RBF, or Fourier features \(Fig\.[5](https://arxiv.org/html/2605.06740#S3.F5)c\)\.
Leth\(ℓ−1\)∈ℝdℓ−1h^\{\(\\ell\-1\)\}\\in\\mathbb\{R\}^\{d\_\{\\ell\-1\}\}denote the input to layerℓ\\ell\. LM\-KAN learns a coupled positive metric from the full incoming representation,
gi\(ℓ\)\(h\(ℓ−1\)\)=softplus\(MetricNeti\(ℓ\)\(h\(ℓ−1\)\)\)\+ε,i=1,…,dℓ−1\.g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)=\\mathrm\{softplus\}\\\!\\left\(\\mathrm\{MetricNet\}^\{\(\\ell\)\}\_\{i\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\\right\)\+\\varepsilon,\\qquad i=1,\\dots,d\_\{\\ell\-1\}\.\(66\)Thus, the metric componentgi\(ℓ\)g\_\{i\}^\{\(\\ell\)\}may depend on all coordinates ofh\(ℓ−1\)h^\{\(\\ell\-1\)\}, not only onhi\(ℓ−1\)h\_\{i\}^\{\(\\ell\-1\)\}\.
The warped coordinate is written consistently as
ξi\(ℓ\)=hi\(ℓ−1\)gi\(ℓ\)\(h\(ℓ−1\)\)\.\\xi\_\{i\}^\{\(\\ell\)\}=h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)\}\.\(67\)For localized wavelet or RBF basis, we define the normalized post\-warp basis coordinate
ri,k\(ℓ\)=ξi\(ℓ\)−ci,k\(ℓ\)si,k\(ℓ\),si,k\(ℓ\)\>0,k=1,…,K\.r\_\{i,k\}^\{\(\\ell\)\}=\\frac\{\\xi\_\{i\}^\{\(\\ell\)\}\-c\_\{i,k\}^\{\(\\ell\)\}\}\{s\_\{i,k\}^\{\(\\ell\)\}\},\\qquad s\_\{i,k\}^\{\(\\ell\)\}\>0,\\qquad k=1,\\dots,K\.\(68\)
LM\-KAN admits multiple basis choices\. The wavelet version uses the Mexican\-hat wavelet
ψwav\(r\)=\(1−r2\)exp\(−r22\),\\psi\_\{\\mathrm\{wav\}\}\(r\)=\(1\-r^\{2\}\)\\exp\\\!\\left\(\-\\frac\{r^\{2\}\}\{2\}\\right\),\(69\)while the RBF version uses the Gaussian radial basis function
ψrbf\(r\)=exp\(−γr2\),γ\>0\.\\psi\_\{\\mathrm\{rbf\}\}\(r\)=\\exp\(\-\\gamma r^\{2\}\),\\qquad\\gamma\>0\.\(70\)For oscillatory problems, LM\-KAN may also employ a Fourier basis directly in the warped coordinate,
ψfour,kcos\(ξi\(ℓ\)\)=cos\(kωξi\(ℓ\)\),ψfour,ksin\(ξi\(ℓ\)\)=sin\(kωξi\(ℓ\)\),\\psi\_\{\\mathrm\{four\},k\}^\{\\cos\}\\\!\\left\(\\xi\_\{i\}^\{\(\\ell\)\}\\right\)=\\cos\\\!\\left\(k\\omega\\xi\_\{i\}^\{\(\\ell\)\}\\right\),\\qquad\\psi\_\{\\mathrm\{four\},k\}^\{\\sin\}\\\!\\left\(\\xi\_\{i\}^\{\(\\ell\)\}\\right\)=\\sin\\\!\\left\(k\\omega\\xi\_\{i\}^\{\(\\ell\)\}\\right\),\(71\)whereω\\omegais a base frequency andkkindexes the retained harmonics\.
For the wavelet and RBF cases, the dictionary atoms are written uniformly as
ηi,k\(ℓ\)=ψ\(ri,k\(ℓ\)\),ψ∈\{ψwav,ψrbf\}\.\\eta\_\{i,k\}^\{\(\\ell\)\}=\\psi\\\!\\left\(r\_\{i,k\}^\{\(\\ell\)\}\\right\),\\qquad\\psi\\in\\\{\\psi\_\{\\mathrm\{wav\}\},\\psi\_\{\\mathrm\{rbf\}\}\\\}\.\(72\)We useηi,k\(ℓ\)\\eta\_\{i,k\}^\{\(\\ell\)\}for these dictionary features to avoid confusing them with the standard KAN edge functionsϕi\\phi\_\{i\}\. For the Fourier case, the atoms are defined directly in terms of the warped coordinate:
ηi,k\(ℓ\),cos=cos\(kωξi\(ℓ\)\),ηi,k\(ℓ\),sin=sin\(kωξi\(ℓ\)\)\.\\eta\_\{i,k\}^\{\(\\ell\),\\cos\}=\\cos\\\!\\left\(k\\omega\\xi\_\{i\}^\{\(\\ell\)\}\\right\),\\qquad\\eta\_\{i,k\}^\{\(\\ell\),\\sin\}=\\sin\\\!\\left\(k\\omega\\xi\_\{i\}^\{\(\\ell\)\}\\right\)\.\(73\)
As in GeoKAN\-NNMetric, LM\-KAN also appends the volume feature
v\(ℓ\)=∑i=1dℓ−1loggi\(ℓ\)\(h\(ℓ−1\)\)=logdetg\(ℓ\)\(h\(ℓ−1\)\),v^\{\(\\ell\)\}=\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\log g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\)=\\log\\det g^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\),\(74\)where the last equality follows because the learned metric is diagonal\.
Accordingly, the feature vector depends on the chosen basis\. For the wavelet and RBF versions, it is
FLMKAN\(ℓ\)=\[η1,1\(ℓ\),…,ηdℓ−1,K\(ℓ\),v\(ℓ\)\]⊤\.F\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}=\\Big\[\\eta\_\{1,1\}^\{\(\\ell\)\},\\dots,\\eta\_\{d\_\{\\ell\-1\},K\}^\{\(\\ell\)\},v^\{\(\\ell\)\}\\Big\]^\{\\top\}\.\(75\)For the Fourier version, it becomes
FLMKAN\(ℓ\)=\[η1,1\(ℓ\),cos,η1,1\(ℓ\),sin,…,ηdℓ−1,K\(ℓ\),cos,ηdℓ−1,K\(ℓ\),sin,v\(ℓ\)\]⊤\.F\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}=\\Big\[\\eta\_\{1,1\}^\{\(\\ell\),\\cos\},\\eta\_\{1,1\}^\{\(\\ell\),\\sin\},\\dots,\\eta\_\{d\_\{\\ell\-1\},K\}^\{\(\\ell\),\\cos\},\\eta\_\{d\_\{\\ell\-1\},K\}^\{\(\\ell\),\\sin\},v^\{\(\\ell\)\}\\Big\]^\{\\top\}\.\(76\)
The layerwise pre\-activation output is obtained by linearly mixing these geometry\-aware features:
h~LMKAN\(ℓ\)=WLMKAN\(ℓ\)FLMKAN\(ℓ\)\+bLMKAN\(ℓ\)\.\\tilde\{h\}\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}=W\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}F\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}\+b\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}\.\(77\)As in the generic GeoKAN notation, each component ofh~LMKAN\(ℓ\)\\tilde\{h\}\_\{\\mathrm\{LMKAN\}\}^\{\(\\ell\)\}corresponds to the scalar outputzzof one hidden\-layer unit\.
Equivalently, for output channelj=1,…,dℓj=1,\\dots,d\_\{\\ell\}, the expanded scalar form in the wavelet/RBF case is
h~LMKAN,j\(ℓ\)=bLMKAN,j\(ℓ\)\+∑i=1dℓ−1∑k=1Kaj,i,k\(ℓ\)ψ\(hi\(ℓ−1\)gi\(ℓ\)\(h\(ℓ−1\)\)−ci,k\(ℓ\)si,k\(ℓ\)\)\+aj,vol\(ℓ\)∑i=1dℓ−1loggi\(ℓ\)\(h\(ℓ−1\)\),ψ∈\{ψwav,ψrbf\}\.\\tilde\{h\}\_\{\\mathrm\{LMKAN\},j\}^\{\(\\ell\)\}=b\_\{\\mathrm\{LMKAN\},j\}^\{\(\\ell\)\}\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\sum\_\{k=1\}^\{K\}a\_\{j,i,k\}^\{\(\\ell\)\}\\psi\\\!\\left\(\\frac\{h\_\{i\}^\{\(\\ell\-1\)\}\\sqrt\{g\_\{i\}^\{\(\\ell\)\}\(h^\{\(\\ell\-1\)\}\)\}\-c\_\{i,k\}^\{\(\\ell\)\}\}\{s\_\{i,k\}^\{\(\\ell\)\}\}\\right\)\+a\_\{j,\\mathrm\{vol\}\}^\{\(\\ell\)\}\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\log g\_\{i\}^\{\(\\ell\)\}\\\!\\left\(h^\{\(\\ell\-1\)\}\\right\),\\qquad\\psi\\in\\\{\\psi\_\{\\mathrm\{wav\}\},\\psi\_\{\\mathrm\{rbf\}\}\\\}\.\(78\)Equivalently, using the warped\-coordinate notation, this can be written more compactly as
h~LMKAN,j\(ℓ\)=bLMKAN,j\(ℓ\)\+∑i=1dℓ−1∑k=1Kaj,i,k\(ℓ\)ψ\(ri,k\(ℓ\)\)\+aj,vol\(ℓ\)v\(ℓ\)\.\\tilde\{h\}\_\{\\mathrm\{LMKAN\},j\}^\{\(\\ell\)\}=b\_\{\\mathrm\{LMKAN\},j\}^\{\(\\ell\)\}\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\sum\_\{k=1\}^\{K\}a\_\{j,i,k\}^\{\(\\ell\)\}\\psi\\\!\\left\(r\_\{i,k\}^\{\(\\ell\)\}\\right\)\+a\_\{j,\\mathrm\{vol\}\}^\{\(\\ell\)\}v^\{\(\\ell\)\}\.\(79\)
For the Fourier case, the corresponding expansion is
h~LMKAN,j\(ℓ\)=bLMKAN,j\(ℓ\)\+∑i=1dℓ−1∑k=1K\[aj,i,k\(ℓ\),coscos\(kωξi\(ℓ\)\)\+aj,i,k\(ℓ\),sinsin\(kωξi\(ℓ\)\)\]\+aj,vol\(ℓ\)v\(ℓ\)\.\\tilde\{h\}\_\{\\mathrm\{LMKAN\},j\}^\{\(\\ell\)\}=b\_\{\\mathrm\{LMKAN\},j\}^\{\(\\ell\)\}\+\\sum\_\{i=1\}^\{d\_\{\\ell\-1\}\}\\sum\_\{k=1\}^\{K\}\\left\[a\_\{j,i,k\}^\{\(\\ell\),\\cos\}\\cos\\\!\\left\(k\\omega\\xi\_\{i\}^\{\(\\ell\)\}\\right\)\+a\_\{j,i,k\}^\{\(\\ell\),\\sin\}\\sin\\\!\\left\(k\\omega\\xi\_\{i\}^\{\(\\ell\)\}\\right\)\\right\]\+a\_\{j,\\mathrm\{vol\}\}^\{\(\\ell\)\}v^\{\(\\ell\)\}\.\(80\)Forℓ\>1\\ell\>1, the learned metric acts on the hidden representationh\(ℓ−1\)h^\{\(\\ell\-1\)\}rather than directly on the original input\.
All GeoKAN variants follow the same geometric principle\. They differ only in how the metric is learned, how the post\-warp features are constructed, and which additional geometric quantities are included \(Table[1](https://arxiv.org/html/2605.06740#S3.T1), Fig\.[5](https://arxiv.org/html/2605.06740#S3.F5)\)\. GeoKAN\-NNMetric uses a coupled neural metric and warped wavelet atoms \(Fig\.[5](https://arxiv.org/html/2605.06740#S3.F5)a\)\. GeoKAN\-γ\\gammauses a separable metric and explicit geometric features \(Fig\.[5](https://arxiv.org/html/2605.06740#S3.F5)b\)\. LM\-KAN combines a coupled learned metric with localized warped atoms \(Fig\.[5](https://arxiv.org/html/2605.06740#S3.F5)c\) and is particularly suitable for PDE approximation\. In this way, GeoKAN extends the KAN idea beyond representation alone: standard KAN variants learn how to represent a function, whereas GeoKAN additionally learns the geometry in which that representation is constructed\.
Table 1:Comparison of the main GeoKAN variants\. Hereuudenotes a generic incoming representation, e\.g\.,u=xu=xin the first layer andu=h\(ℓ−1\)u=h^\{\(\\ell\-1\)\}in deeper layers\.
## 4Recovering Structure from Data: Data Fitting
Before turning to physics informed learning, we first study the representational behavior of the proposed models in a supervised approximation setting\. This separates two questions\. The first is whether the GeoKAN family has an intrinsic advantage as a function approximator\. The second is whether that advantage later improves performance in a physics informed framework\. To address the first question, we evaluate the models on a controlled one dimensional data fitting benchmark with targets chosen to test oscillation, nonstationarity, discontinuity, localization, and multiscale structure\.
### 4\.1Matched Capacity Function Approximation Benchmark
To compare the models fairly, we use a matched capacity benchmark in which all architectures have approximately the same parameter count, about2×1042\\times 10^\{4\}, and the same effective depth\. The compared models are the MLP baseline, Efficient\-KAN, GeoKAN\-γ\\gamma, GeoKAN\-NNMetric, LM\-KAN\-Wav, and LM\-KAN\-RBF\. The architectural hyperparameters are chosen so that the parameter counts are closely aligned while preserving the natural structure of each model\. The MLP uses width140140and depth22\. Efficient\-KAN uses layers\[1,57,57,1\]\[1,57,57,1\]with grid size33and spline order11\. GeoKAN\-γ\\gammauses width9090, depth22, andK=12K=12\. GeoKAN\-NNMetric, LM\-KAN\-Wav, and LM\-KAN\-RBF use width3838, depth22,K=12K=12, and metric hidden size88, while LM\-KAN\-RBF also usesγ=2\.0\\gamma=2\.0\. All models are trained with the same epoch budget, the same early stopping logic, and the same train test split for each target\. This makes the comparison primarily a test of architectural inductive bias rather than parameter count\. The architecture parameters are summarized in Table[2](https://arxiv.org/html/2605.06740#S4.T2)\.
Table 2:Architectures and parameter counts used in the matched\-capacity benchmark\.The targets are chosen to probe different approximation difficulties\. The high frequency sinusoid tests rapid oscillation over a fixed domain\. The chirp tests nonstationary frequency content\. The step function tests sharp nonsmooth transitions\. The narrow needle tests highly localized structure\. The multiscale envelope modulated sinusoid combines oscillation with spatially varying amplitude\. The sawtooth tests piecewise linear nonsmooth behavior\. Together, these targets cover several regimes in which fixed coordinate representations are known to be difficult\.
Figure 6:Per\-target function approximation fits under the matched capacity benchmark\. For each target, the left panel compares the baseline models against the ground truth, while the right panel compares the GeoKAN family variants against the same target\. Across several structure rich targets, the geometry aware variants provide visibly tighter fits than the fixed geometry baselines, especially for high frequency, localized, and multiscale functions\.\(a\)High frequency sinusoid: baselines\.
\(b\)High frequency sinusoid: GeoKAN variants\.
\(c\)Chirp: GeoKAN variants\.
\(d\)Step discontinuity: GeoKAN variants\.
\(e\)Narrow needle: GeoKAN variants\.
\(f\)Multiscale envelope modulated sinusoid: GeoKAN variants\.
Figure 7:Representative function fitting results from the matched capacity benchmark\. The panels illustrate the ability of the GeoKAN family models to capture nonuniform structure, including high frequency oscillation, discontinuity, sharp localization, chirped frequency variation, and multiscale modulation\. In most challenging cases, the learned metric variants track the target more closely than the fixed geometry baselines\.The results are reported in Table[3](https://arxiv.org/html/2605.06740#S4.T3)\. GeoKAN\-NNMetric and LM\-KAN\-Wav are the strongest models on several structure rich targets, including the high frequency sinusoid, step discontinuity, narrow needle, multiscale envelope modulated sinusoid, and sawtooth\. Onsin\(10πx\)\\sin\(10\\pi x\), they achieve a test MSE of4\.592×10−54\.592\\times 10^\{\-5\}, compared with8\.445×10−38\.445\\times 10^\{\-3\}for Efficient\-KAN and3\.472×10−13\.472\\times 10^\{\-1\}for the MLP\. On the multiscale envelope modulated sinusoid, they achieve1\.790×10−41\.790\\times 10^\{\-4\}, whereas Efficient\-KAN gives5\.715×10−25\.715\\times 10^\{\-2\}and the MLP gives2\.974×10−12\.974\\times 10^\{\-1\}\. On the chirp target, however, LM\-KAN\-RBF is best with a test MSE of1\.035×10−41\.035\\times 10^\{\-4\}\. Overall, the benchmark shows that GeoKAN type models provide a clear representational advantage on targets with strong local variation or multiscale structure\.
Table 3:Matched\-capacity data\-fitting benchmark at approximately2×1042\\times 10^\{4\}parameters and depth22\. Reported values are test MSE\. Best performance in each row is shown in bold\.
### 4\.2Interpretation of the Learned Geometry
The benchmark results are consistent with the geometric mechanism built into GeoKAN\. Standard MLPs operate in a fixed Euclidean coordinate system\. Efficient\-KAN increases basis flexibility, but still evaluates its learnable functions on the original coordinates\. GeoKAN first learns a positive metric field and then performs basis evaluation or geometric feature extraction in the corresponding warped coordinates\. This changes how resolution is allocated across the domain\. Regions that are difficult to approximate can be stretched, while smoother regions can be compressed\.
This provides a simple interpretation of the benchmark results\. The multiscale envelope modulated sinusoid, the narrow needle, and the step discontinuity all contain highly nonuniform local structure\. A fixed coordinate model must distribute its parameters globally, even when the difficulty is confined to a small part of the domain\. A learned metric allows GeoKAN models to redistribute effective resolution toward those difficult regions\. Near a sharp peak or a rapidly varying patch, the learned metric can enlarge geometric distance so that a modest number of localized atoms in warped coordinates behaves like a much finer basis\. In smoother regions, the geometry can contract the domain and avoid spending unnecessary capacity\. This is consistent with the large gains observed on the most nonuniform targets\.
A useful way to view this mechanism is through the learned metricg\(x\)g\(x\)and the warped coordinate
z\(x\)=xg\(x\)\.z\(x\)=x\\sqrt\{g\(x\)\}\.\(81\)Whereg\(x\)g\(x\)is large, the mapx↦z\(x\)x\\mapsto z\(x\)magnifies local detail and increases effective basis resolution\. Whereg\(x\)g\(x\)is smaller, the representation is compressed\. The learned geometry therefore acts as a task dependent coordinate transformation\.
### 4\.3Functional Roles of the GeoKAN Variants
Although all GeoKAN variants are geometry aware, the benchmark suggests that they play different functional roles\. GeoKAN\-NNMetric is the most expressive variant\. It learns a coupled metric from the full input and combines it with a wavelet style localized dictionary\. In this benchmark, it attains the best or tied best result on the high frequency sinusoid, step discontinuity, narrow needle, multiscale envelope modulated sinusoid, and sawtooth\. These are settings in which localized responses and geometric adaptation are especially useful\.
LM\-KAN\-Wav behaves similarly and, in the present implementation, matches GeoKAN\-NNMetric on several targets\. This indicates that the combination of a learned metric with a wavelet type dictionary is particularly effective for sharp transitions, localized oscillations, and multiscale structure\. LM\-KAN\-RBF shows a different behavior\. It is the strongest model on the chirp target, where the main difficulty is smoothly varying local frequency rather than a sharp discontinuity or isolated spike\. In this regime, the smoother localized character of the RBF dictionary appears to be better matched to the target\.
GeoKAN\-γ\\gammais the most structured and lightweight variant\. Rather than using a full post warp dictionary, it extracts explicit metric derived features\. It does not dominate the benchmark, but it remains competitive and substantially outperforms the MLP and, on several targets, Efficient\-KAN\. Taken together, these results suggest that the GeoKAN family should be viewed as a collection of geometry aware approximators with different inductive biases rather than as a single uniform model class\.
### 4\.4Transition to Physics Informed Learning
The matched capacity data fitting results establish that the advantage of the GeoKAN family appears already at the level of pure representation learning, before any physical constraints are imposed\. The improvement is therefore not only a consequence of residual based training\. It is already present in the surrogate architecture through the learned metric warp and the geometry adapted feature construction\.
This motivates the next stage of the paper\. If geometry aware coordinate adaptation improves the approximation of sharp, localized, stiff, or multiscale targets in supervised fitting, then the same mechanism may also be useful when the solution must be inferred from a differential equation together with initial and boundary conditions\. We therefore turn next to physics informed Kolmogorov Arnold models built from the GeoKAN framework, with particular emphasis on the LM\-KAN surrogate introduced earlier\.
## 5Physics\-Informed KAN Models and the LM\-KAN Surrogate
Physics\-Informed Kolmogorov–Arnold Networks \(PIKAN\) extend the general philosophy of Physics\-Informed Neural Networks \(PINN\) by replacing the standard deep neural network surrogate with a KAN\-type architecture\[[30](https://arxiv.org/html/2605.06740#bib.bib62)\]\. Thus, the essential idea remains unchanged\. One seeks a neural approximation of the unknown solution that is trained not only from data, if available, but also from the governing differential equation together with its initial and boundary conditions\. The main distinction from classical PINN lies in the choice of function approximator\. Instead of using a multilayer perceptron with fixed activation functions and learnable scalar weights, PIKAN employs a KAN in which the connections carry learnable univariate nonlinear functions\.
To illustrate the standard construction, consider a differential equation posed on a domain of interest, together with suitable initial and/or boundary conditions\. In the physics\-informed setting, the unknown solution is approximated by a neural networku^θ\\hat\{u\}\_\{\\theta\}, whereθ\\thetadenotes the trainable parameters of the model\. For KAN\-type networks, these parameters correspond to the coefficients defining the learnable univariate edge functions\. The network is then trained by minimizing a loss function built from the residual of the governing equation and the mismatch in the prescribed conditions\. In this way, the network is encouraged to satisfy the physical law throughout the domain while also respecting the auxiliary constraints\.
For example, for an ordinary differential equation of the form
dy\(x\)dx−f\(y\(x\),x\)=0,y\(a\)=ya,\\frac\{dy\(x\)\}\{dx\}\-f\(y\(x\),x\)=0,\\qquad y\(a\)=y\_\{a\},\(82\)the neural approximationy^θ\(x\)\\hat\{y\}\_\{\\theta\}\(x\)is expected to satisfy
dy^θ\(x\)dx−f\(y^θ\(x\),x\)≈0,y^θ\(a\)=ya\.\\frac\{d\\hat\{y\}\_\{\\theta\}\(x\)\}\{dx\}\-f\(\\hat\{y\}\_\{\\theta\}\(x\),x\)\\approx 0,\\qquad\\hat\{y\}\_\{\\theta\}\(a\)=y\_\{a\}\.\(83\)To enforce this, one defines the residual at collocation points\{xri\}i=1Nr\\\{x\_\{r\}^\{i\}\\\}\_\{i=1\}^\{N\_\{r\}\}by
ℛθ\(xri\)=dy^θ\(xri\)dx−f\(y^θ\(xri\),xri\),\\mathcal\{R\}\_\{\\theta\}\(x\_\{r\}^\{i\}\)=\\frac\{d\\hat\{y\}\_\{\\theta\}\(x\_\{r\}^\{i\}\)\}\{dx\}\-f\(\\hat\{y\}\_\{\\theta\}\(x\_\{r\}^\{i\}\),x\_\{r\}^\{i\}\),\(84\)and the corresponding physics loss by
ℒr=1Nr∑i=1Nr\|ℛθ\(xri\)\|2\.\\mathcal\{L\}\_\{r\}=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\|\\mathcal\{R\}\_\{\\theta\}\(x\_\{r\}^\{i\}\)\\right\|^\{2\}\.\(85\)The initial or boundary conditions may be imposed either as hard constraints, by reparameterizing the network output so that the conditions are satisfied identically, or as soft constraints, by adding penalty terms to the loss function\. In the latter case, one typically arrives at a weighted loss of the form
ℒfinal=λrℒr\+λbcℒbc\+λicℒic,\\mathcal\{L\}\_\{\\mathrm\{final\}\}=\\lambda\_\{r\}\\mathcal\{L\}\_\{r\}\+\\lambda\_\{bc\}\\mathcal\{L\}\_\{bc\}\+\\lambda\_\{ic\}\\mathcal\{L\}\_\{ic\},\(86\)whereℒbc\\mathcal\{L\}\_\{bc\}andℒic\\mathcal\{L\}\_\{ic\}denote the boundary and initial condition losses, respectively, and the coefficientsλr\\lambda\_\{r\},λbc\\lambda\_\{bc\}, andλic\\lambda\_\{ic\}are introduced to balance the influence of the different terms during optimization\.
In some settings, one also augments the physics\-based loss with observational or simulated data\. This leads to the data\-driven form of PIKAN, in which the total loss becomes
ℒfinalDD=λrℒr\+λbcℒbc\+λicℒic\+λdataℒdata,\\mathcal\{L\}\_\{\\mathrm\{final\}\}^\{DD\}=\\lambda\_\{r\}\\mathcal\{L\}\_\{r\}\+\\lambda\_\{bc\}\\mathcal\{L\}\_\{bc\}\+\\lambda\_\{ic\}\\mathcal\{L\}\_\{ic\}\+\\lambda\_\{\\mathrm\{data\}\}\\mathcal\{L\}\_\{\\mathrm\{data\}\},\(87\)with
ℒdata=1Ndata∑i=1Ndata\|u^θ\(xdatai\)−u\(xdatai\)\|2\.\\mathcal\{L\}\_\{\\mathrm\{data\}\}=\\frac\{1\}\{N\_\{\\mathrm\{data\}\}\}\\sum\_\{i=1\}^\{N\_\{\\mathrm\{data\}\}\}\\left\|\\hat\{u\}\_\{\\theta\}\(x\_\{\\mathrm\{data\}\}^\{i\}\)\-u\(x\_\{\\mathrm\{data\}\}^\{i\}\)\\right\|^\{2\}\.\(88\)Such a formulation is particularly useful when the purely data\-free physics loss is difficult to optimize, as can happen for convection\-dominated, stiff, or highly nonlinear problems\. In this sense, PIKAN follows the same broad strategy as PINN\. The governing equation provides the principal supervision, while additional data may be incorporated to improve convergence and accuracy\.
Accordingly, much of the earlier PIKAN literature can be understood as using the standard physics\-informed training framework described above while changing only the underlying KAN surrogate\[[25](https://arxiv.org/html/2605.06740#bib.bib18)\]\. In other words, the residual\-based loss, the treatment of boundary and initial conditions, and the optional use of observational data remain close to the standard PINN methodology\. Most successful physics\-informed KAN models reported in the literature are based mainly on two KAN variants, namely Efficient\-KAN\[[30](https://arxiv.org/html/2605.06740#bib.bib62),[4](https://arxiv.org/html/2605.06740#bib.bib58)\]and wavelet\-KAN \(Wav\-KAN\)\[[30](https://arxiv.org/html/2605.06740#bib.bib62),[7](https://arxiv.org/html/2605.06740#bib.bib32)\]\. In these models, the main change lies in the basis representation used by the surrogate, while the physics\-informed optimization framework itself remains essentially the same\.
In the present work, we keep this standard physics\-informed framework, but replace the surrogate by*Geometric KAN*, specifically its*Learned\-Metric KAN*\(LM\-KAN\) variants \(Eqs\. \([78](https://arxiv.org/html/2605.06740#S3.E78)\), \([80](https://arxiv.org/html/2605.06740#S3.E80)\)\)\. Thus, the main novelty of our approach is architectural rather than procedural\. The residual\-based training framework is unchanged, but the network now learns a task\-dependent metric and evaluates its localized basis representation in metric\-adapted coordinates\.
For this reason, in the remainder of the paper we use*PIKAN*mainly to refer to earlier physics\-informed KAN baselines, especially those based on Efficient\-KAN and Wav\-KAN, while*LM\-KAN*denotes our proposed geometry\-aware surrogate\. This distinction is important for the comparisons that follow, since our goal is to evaluate whether the learned geometric adaptation in LM\-KAN yields an advantage over earlier PIKAN models under the same physics\-informed training setup\.
### 5\.1Differential Equation Case Studies
In this work, the LM\-KAN architecture is specified by the hidden width, network depth, number of basis functions per input dimensionKK, basis family, kernel parameterγ\\gammawhen applicable, and the hidden width of the learned metric network\. Unless noted otherwise, each hidden LM\-KAN block consists of aLearnedMetricBasisLayerfollowed by atanh\\tanhactivation, while the final layer is a linear output head\. The metric subnetwork used to generate the diagonal metric coefficients is implemented as
Linear→SiLU→Linear→SiLU→Linear→Softplus,\\texttt\{Linear\}\\rightarrow\\texttt\{SiLU\}\\rightarrow\\texttt\{Linear\}\\rightarrow\\texttt\{SiLU\}\\rightarrow\\texttt\{Linear\}\\rightarrow\\texttt\{Softplus\},so that the learned diagonal metric remains strictly positive\.
The benchmark problems considered here are trained with a small amount of additional data supervision together with the physics\-informed residual and constraint losses\. In all equations, data\-driven loss terms are included, but they account for only 10% of the training information\. These data points provide limited guidance while preserving the predominantly physics\-informed character of the training\. For Burgers’ equation, the additional data help resolve the steep gradient more accurately\. For Allen–Cahn Case 2 and Helmholtz, they provide useful supervision in regimes where the solution structure is harder to learn\. The same 10% data\-assisted setting is also used for the remaining Allen–Cahn and Lorenz experiments\.
The selected benchmark equations span several characteristic challenges in scientific machine learning\. Burgers’ equation tests the ability of the model to resolve nonlinear advection–diffusion dynamics and sharp localized gradients\. The Allen–Cahn equation probes reaction–diffusion behavior with thin transition layers, making it a useful test of how well the model captures interface dynamics and multiscale structure\. The Helmholtz equation examines the representation of oscillatory and wave\-like solutions, and is therefore well suited for assessing approximation quality in problems with high\-frequency spatial patterns\. The Lorenz system provides a strongly coupled nonlinear ODE benchmark that tests the stability and accuracy of the learned temporal dynamics\. Taken together, these case studies assess whether LM\-KAN improves representation efficiency and training behavior across qualitatively different regimes\.
### 5\.2Allen–Cahn Equation
##### Case 1:
The Allen–Cahn equation is a prototypical nonlinear reaction–diffusion model used to describe phase separation and interface evolution in materials science\. In this case study, we consider the one\-dimensional Allen–Cahn equation with diffusion coefficientν=0\.001\\nu=0\.001:
ut\\displaystyle u\_\{t\}=νuxx−u3\+u,\\displaystyle=\\nu u\_\{xx\}\-u^\{3\}\+u,\{u\(x,0\)=0\.53x\+0\.47sin\(−1\.5πx\),u\(1,t\)=1,u\(−1,t\)=−1,\\displaystyle\\begin\{cases\}u\(x,0\)=0\.53x\+0\.47\\sin\(\-1\.5\\pi x\),\\\\ u\(1,t\)=1,\\\\ u\(\-1,t\)=\-1,\\end\{cases\}\(89\)forx∈\[−1,1\]x\\in\[\-1,1\]andt∈\[0,1\]t\\in\[0,1\]\.
Allen–Cahn Case 1 constitutes a representative benchmark for nonlinear PDE learning with localized interface dynamics\. The combination of cubic reaction, diffusion, and nontrivial initial data produces evolving solution profiles with sharp internal layers and spatially non\-uniform behavior\. In particular, the small diffusion coefficientν=0\.001\\nu=0\.001gives rise to narrow transition regions that are difficult to approximate using fixed\-resolution representations\. This makes the problem well suited for evaluating whether geometry\-aware models can adapt their effective representational resolution to capture steep gradients and interface motion more efficiently than standard fixed\-geometry architectures\.
To solve Eq\. \([5\.2](https://arxiv.org/html/2605.06740#S5.Ex14)\), we employ physics\-informed KAN\-type models and compare the baseline PIKAN with the proposed LM\-KAN formulation\. The physics\-informed residual is defined as
ℛθ\(x,t\)=u^t\+u^3−u^−νu^xx,\\displaystyle\\mathcal\{R\}\_\{\\theta\}\(x,t\)=\\hat\{u\}\_\{t\}\+\\hat\{u\}^\{3\}\-\\hat\{u\}\-\\nu\\hat\{u\}\_\{xx\},\(90\)and the total training objective is given by
ℒr\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{r\}\}=1Nr∑i=1Nr\|ℛθ\(xri,tri\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\|\\mathcal\{R\}\_\{\\theta\}\(x\_\{r\}^\{i\},t\_\{r\}^\{i\}\)\\right\|^\{2\},ℒic\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{ic\}\}=1Nic∑j=1Nic\(u^\(xicj,0\)−u\(xicj,0\)\)2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{ic\}\}\}\\sum\_\{j=1\}^\{N\_\{\\mathrm\{ic\}\}\}\\left\(\\hat\{u\}\(x\_\{\\mathrm\{ic\}\}^\{j\},0\)\-u\(x\_\{\\mathrm\{ic\}\}^\{j\},0\)\\right\)^\{2\},ℒbc\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{bc\}\}=1Nbc∑k=1Nbc\[\(u^\(1,tbck\)−1\)2\+\(u^\(−1,tbck\)\+1\)2\],\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{bc\}\}\}\\sum\_\{k=1\}^\{N\_\{\\mathrm\{bc\}\}\}\\left\[\\bigl\(\\hat\{u\}\(1,t\_\{\\mathrm\{bc\}\}^\{k\}\)\-1\\bigr\)^\{2\}\+\\bigl\(\\hat\{u\}\(\-1,t\_\{\\mathrm\{bc\}\}^\{k\}\)\+1\\bigr\)^\{2\}\\right\],ℒfinalDF\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{final\}\}^\{DF\}=ℒr\+ℒic\+ℒbc\.\\displaystyle=\\mathcal\{L\}\_\{\\mathrm\{r\}\}\+\\mathcal\{L\}\_\{\\mathrm\{ic\}\}\+\\mathcal\{L\}\_\{\\mathrm\{bc\}\}\.\(91\)
For Allen–Cahn Case 1, the PIKAN baseline uses the architecture\[2,12,8,12,1\]\[2,12,8,12,1\]with cubic B\-spline edge functions on a grid of size 5 and sinusoidal base activation\. The corresponding LM\-KAN model uses two learned\-metric basis layers of width 5, withK=7K=7RBF basis functions per input dimension and a compact metric network of hidden size 9 \(Table[4](https://arxiv.org/html/2605.06740#S5.T4)\)\. This configuration was selected by grid search to keep the model small while still allowing geometry\-adaptive resolution in the\(x,t\)\(x,t\)\-domain\.
Table 4:Architecture comparison for Allen–Cahn Case 1 between PIKAN vs LM\-KANModelArchitectureDepthBasis resolutionBasis typeMetric hiddenOutputPIKAN\[2,12,8,12,1\]\[2,12,8,12,1\]3 hidden layersGrid size=5=5Cubic B\-spline \+sin\\sinbase–1LM\-KAN\(2→5→5→1\)\(2\\rightarrow 5\\rightarrow 5\\rightarrow 1\)2 metric\-basis layersK=7K=7per input dimRBF,γ=2\.0\\gamma=2\.091\(a\)t=0\.9t=0\.9ms
\(b\)t=1\.0t=1\.0ms
\(c\)t=1\.5t=1\.5ms
Figure 8:Solution profile comparison at three representative time instants\. The PIKAN and LM\-KAN predictions closely overlap with the numerical solution, demonstrating high pointwise accuracy throughout the evolution\.\(a\)t=0\.9t=0\.9ms
\(b\)t=1\.0t=1\.0ms
\(c\)t=1\.5t=1\.5ms
Figure 9:PDE residual comparison for PIKAN and LM\-KAN at three representative time instants\. Both methods satisfy the governing equation well, while PIKAN exhibits consistently smaller residual magnitudes across the spatial domain\.For training, we useNx=100N\_\{x\}=100collocation points in space andNt=100N\_\{t\}=100collocation points in time, uniformly distributed over the computational domain\. The network is optimized for 10,000 epochs using the AdamW optimizer with learning rateη=10−3\\eta=10^\{\-3\}\. To first assess pointwise predictive accuracy, Fig\.[8](https://arxiv.org/html/2605.06740#S5.F8)compares the numerical and predicted solution profiles att=0\.9t=0\.9,1\.01\.0, and1\.51\.5ms\. In all three snapshots, the predicted curves are nearly indistinguishable from the numerical solution, indicating that both models recover the nonlinear solution profile with high accuracy\. PIKAN shows slightly closer agreement with the reference curve at some locations, although LM\-KAN remains comparably accurate overall\.
The corresponding PDE residual distributions are shown in Fig\.[9](https://arxiv.org/html/2605.06740#S5.F9)at the same three time instants\. The residual remains small across most of the spatial domain for both models, confirming that the learned solutions satisfy the governing equation well\. However, PIKAN consistently exhibits lower residual magnitudes than LM\-KAN, suggesting somewhat stronger PDE enforcement in this test case\.
Finally, Fig\.[10](https://arxiv.org/html/2605.06740#S5.F10)presents a broader comparison of the training behavior and spatiotemporal predictions of PIKAN and LM\-KAN for Allen–Cahn Case 1 after10,00010\{,\}000training epochs\. As shown in Fig\.[10](https://arxiv.org/html/2605.06740#S5.F10)\(a\), both models exhibit stable convergence, demonstrating that each architecture is capable of learning the underlying solution dynamics robustly\. PIKAN attains the smaller final loss,1×10−61\\times 10^\{\-6\}, whereas LM\-KAN reaches5×10−65\\times 10^\{\-6\}\. Despite this, LM\-KAN completes training in substantially less wall\-clock time, requiring315\.81315\.81s compared with539\.01539\.01s for PIKAN\. The model sizes are also similar, with22802280trainable parameters for PIKAN and21362136for LM\-KAN\. A quantitative comparison between the two models is reported in Table[5](https://arxiv.org/html/2605.06740#S5.T5)\. Fig\.[10](https://arxiv.org/html/2605.06740#S5.F10)\(b\) further shows that both methods accurately reconstruct the spatiotemporal solution field, capturing the overall evolution and principal interface structure throughout the considered time interval\.
\(a\)
\(b\)
Figure 10:Comparison of PIKAN and LM\-KAN for Allen–Cahn Case 1: \(a\) training loss versus epochs, and \(b\) spatiotemporal solution heatmaps for the numerical reference, PIKAN, and LM\-KAN predictions\. Both models recover the overall solution evolution accurately, while LM\-KAN converges in less wall\-clock time and PIKAN reaches a lower final loss\.Overall, the results for Allen–Cahn Case 1 show that both PIKAN and LM\-KAN provide accurate physics\-informed surrogates\. The profile comparisons in Fig\.[8](https://arxiv.org/html/2605.06740#S5.F8)and the residual plots in Fig\.[9](https://arxiv.org/html/2605.06740#S5.F9)confirm that both models achieve high solution accuracy and good PDE satisfaction, while the global comparison in Fig\.[10](https://arxiv.org/html/2605.06740#S5.F10)highlights the main trade\-off: PIKAN achieves slightly better residual accuracy and a lower final loss, whereas LM\-KAN offers a substantial reduction in training time while preserving a highly accurate approximation of the solution field\.
Table 5:Comparison between PIKAN and LM\-KAN for Allen–Cahn Case 1 after10,00010\{,\}000training epochs\. PIKAN attains the smaller final loss, while LM\-KAN completes training in less wall\-clock time with a slightly smaller parameter count\.
##### Case 2:
We next consider a more challenging Allen–Cahn test problem, characterized by a smaller diffusion coefficient and a stronger nonlinear reaction term\. The governing equation is given by\[[31](https://arxiv.org/html/2605.06740#bib.bib57)\]
ut\\displaystyle u\_\{t\}=νuxx−5u3\+5u,\\displaystyle=\\nu u\_\{xx\}\-5u^\{3\}\+5u,\{u\(x,0\)=x2cos\(πx\),u\(1,t\)=1,u\(−1,t\)=−1,\\displaystyle\\begin\{cases\}u\(x,0\)=x^\{2\}\\cos\(\\pi x\),\\\\ u\(1,t\)=1,\\\\ u\(\-1,t\)=\-1,\\end\{cases\}\(92\)whereν=0\.0001\\nu=0\.0001,x∈\[−1,1\]x\\in\[\-1,1\], andt∈\[0,1\]t\\in\[0,1\]\.
Compared with Case 1, this problem introduces additional complexity through both the smaller diffusion coefficient and the stronger nonlinear reaction term\. The reduced diffusion,ν=0\.0001\\nu=0\.0001, generates narrower transition layers, while the amplified reaction term accelerates the local phase dynamics and increases the stiffness of the equation\. Consequently, the solution exhibits sharper interfaces and stronger spatial non\-uniformity, making accurate approximation more challenging\. This setting therefore provides a more stringent benchmark for evaluating whether geometry\-aware models can adapt their effective resolution to localized structures more efficiently than fixed\-geometry architectures\.
\(a\)t=0\.00t=0\.00
\(b\)t=0\.05t=0\.05
\(c\)t=0\.90t=0\.90
Figure 11:Solution profile comparison at representative time instants for Allen–Cahn Case 2\. Both models follow the numerical solution closely, while LM\-KAN shows improved agreement across the evolving interface region\.To solve Eq\. \([5\.2](https://arxiv.org/html/2605.06740#S5.Ex18)\), we use a data\-assisted physics\-informed formulation\. In addition to the PDE residual, initial\-condition, and boundary\-condition losses, a supervised data term is introduced using a sparse subset of the numerical reference solution\. The residual and training losses are defined as
ℛθ\(x,t\)\\displaystyle\\mathcal\{R\}\_\{\\theta\}\(x,t\)=u^t\+5u^3−5u^−νu^xx,\\displaystyle=\\hat\{u\}\_\{t\}\+5\\hat\{u\}^\{3\}\-5\\hat\{u\}\-\\nu\\hat\{u\}\_\{xx\},ℒr\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{r\}\}=1Nr∑i=1Nr\|ℛθ\(xri,tri\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\|\\mathcal\{R\}\_\{\\theta\}\(x\_\{r\}^\{i\},t\_\{r\}^\{i\}\)\\right\|^\{2\},ℒic\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{ic\}\}=1Nic∑j=1Nic\(u^\(xicj,0\)−\(xicj\)2cos\(πxicj\)\)2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{ic\}\}\}\\sum\_\{j=1\}^\{N\_\{\\mathrm\{ic\}\}\}\\left\(\\hat\{u\}\(x\_\{\\mathrm\{ic\}\}^\{j\},0\)\-\(x\_\{\\mathrm\{ic\}\}^\{j\}\)^\{2\}\\cos\(\\pi x\_\{\\mathrm\{ic\}\}^\{j\}\)\\right\)^\{2\},ℒbc\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{bc\}\}=1Nbc∑k=1Nbc\[\(u^\(1,tbck\)−1\)2\+\(u^\(−1,tbck\)\+1\)2\],\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{bc\}\}\}\\sum\_\{k=1\}^\{N\_\{\\mathrm\{bc\}\}\}\\left\[\\bigl\(\\hat\{u\}\(1,t\_\{\\mathrm\{bc\}\}^\{k\}\)\-1\\bigr\)^\{2\}\+\\bigl\(\\hat\{u\}\(\-1,t\_\{\\mathrm\{bc\}\}^\{k\}\)\+1\\bigr\)^\{2\}\\right\],ℒdata\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{data\}\}=1Ndata∑p=1Ndata\|u^\(xdatap\)−u\(xdatap\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{data\}\}\}\\sum\_\{p=1\}^\{N\_\{\\mathrm\{data\}\}\}\\left\|\\hat\{u\}\(x\_\{\\mathrm\{data\}\}^\{p\}\)\-u\(x\_\{\\mathrm\{data\}\}^\{p\}\)\\right\|^\{2\},ℒfinalDD\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{final\}\}^\{DD\}=ℒr\+ℒic\+ℒbc\+ℒdata\.\\displaystyle=\\mathcal\{L\}\_\{\\mathrm\{r\}\}\+\\mathcal\{L\}\_\{\\mathrm\{ic\}\}\+\\mathcal\{L\}\_\{\\mathrm\{bc\}\}\+\\mathcal\{L\}\_\{\\mathrm\{data\}\}\.\(93\)
For Allen–Cahn Case 2, the PIKAN baseline again uses the architecture\[2,12,8,12,1\]\[2,12,8,12,1\]with cubic B\-spline parameterization and sinusoidal base activation\. To enable a controlled comparison at similar model capacity, both LM\-KAN variants use the same compact architecture, consisting of two learned\-metric basis layers of width 5 withK=7K=7basis functions per input dimension and a metric\-network hidden width of 9 \(Table[6](https://arxiv.org/html/2605.06740#S5.T6)\)\. The only difference between the two LM\-KAN models is the basis family\. One uses Gaussian radial basis functions, while the other uses a Mexican\-hat wavelet basis\. This isolates the effect of the basis choice from the geometric adaptation mechanism itself\.The LM\-KAN hyperparameters for this case were chosen by grid search so as to match the parameter count of the PIKAN baseline as closely as possible, thereby making the comparison focus on representation mechanism rather than model size\.
In this experiment, the numerical reference solution is first computed, and only10%10\\%of the data is randomly sampled for inclusion through the data\-driven loss term\. The model is trained usingNx=100N\_\{x\}=100spatial andNt=100N\_\{t\}=100temporal collocation points, uniformly distributed over the computational domain\. Training is carried out for20,00020\{,\}000epochs with the AdamW optimizer and learning rateη=10−3\\eta=10^\{\-3\}\.
Table 6:Architecture comparison for Allen–Cahn Case 2\. The two LM\-KAN variants share the same learned\-metric architecture and differ only in the basis family\.To first examine pointwise predictive accuracy, Fig\.[11](https://arxiv.org/html/2605.06740#S5.F11)presents one\-dimensional solution profiles att=0\.00t=0\.00,0\.050\.05, and0\.900\.90\. At all three time instants, both PIKAN and LM\-KAN capture the main shape of the numerical solution and reproduce the dominant interface structure\. However, LM\-KAN generally follows the reference profile more closely, particularly in the interior region and near the evolving transition zone, whereas PIKAN exhibits slightly larger deviations\. These profile comparisons indicate that both models are able to recover the nonlinear solution behavior, but LM\-KAN provides the more accurate local approximation in this more challenging setting\.
A broader view of the predicted solution fields is given in Fig\.[12](https://arxiv.org/html/2605.06740#S5.F12)\(a\), which compares the spatiotemporal heatmaps of the numerical reference, PIKAN prediction, and LM\-KAN prediction\. Both models successfully reproduce the global spatiotemporal evolution of the Allen–Cahn solution, including the formation and persistence of the central transition structure\. The qualitative agreement is good in both cases, confirming that the main dynamics are captured over the full domain\. Nevertheless, LM\-KAN appears visually closer to the reference field, especially in regions where the solution varies more sharply\.
\(a\)Spatiotemporal solution heatmaps for the numerical reference, PIKAN prediction, and LM\-KAN prediction\. Both models capture the main evolution pattern, with LM\-KAN showing closer agreement with the reference field\.
\(b\)Absolute error and PDE residual heatmaps for PIKAN and LM\-KAN\. LM\-KAN exhibits both smaller prediction error and lower residual magnitude over most of the spatiotemporal domain\.
Figure 12:Spatiotemporal comparison for Allen–Cahn Case 2\. The predicted solution fields, error maps, and PDE residual distributions show that both models capture the overall dynamics, while LM\-KAN provides closer agreement with the numerical reference and stronger physics consistency across the domain\.This trend is further confirmed by the absolute error and PDE residual maps shown in Fig\.[12](https://arxiv.org/html/2605.06740#S5.F12)\(b\)\. The absolute error\|prediction−numerical\|\|\\mathrm\{prediction\}\-\\mathrm\{numerical\}\|for LM\-KAN is uniformly smaller across most of the spatiotemporal domain than that of PIKAN\. Likewise, the PDE residual magnitude is substantially lower for LM\-KAN, indicating that it satisfies the governing equation more accurately in this data\-assisted setting\.
The training behavior is summarized in Fig\.[13](https://arxiv.org/html/2605.06740#S5.F13)\. As shown in Fig\.[13](https://arxiv.org/html/2605.06740#S5.F13), both PIKAN and LM\-KAN converge stably during training\. Unlike Case 1, however, PIKAN is faster in terms of wall\-clock time\. In the RBF\-based setting, for20,00020\{,\}000epochs, PIKAN trains in1281\.2891281\.289s, while LM\-KAN takes4759\.984759\.98s\. Both models have the same number of trainable parameters, namely700700\. The final loss values are8\.606×10−28\.606\\times 10^\{\-2\}for PIKAN and7\.6563×10−27\.6563\\times 10^\{\-2\}for LM\-KAN\. A quantitative comparison between the two models is reported in Table[7](https://arxiv.org/html/2605.06740#S5.T7)\. Overall, Case 2 shows that LM\-KAN can yield slightly better final accuracy, although this improvement comes with a significantly larger training cost\.
Figure 13:Training loss comparison for Allen–Cahn Case 2\.Table 7:Comparison between PIKAN and LM\-KAN for Allen–Cahn Case 2 after20,00020\{,\}000training epochs\. LM\-KAN achieves a slightly smaller final loss, while PIKAN is substantially faster to train; both models use the same number of trainable parameters\.Overall, these results indicate that the more challenging Allen–Cahn configuration benefits from the geometry\-adaptive representation of LM\-KAN\. The profile comparisons in Fig\.[11](https://arxiv.org/html/2605.06740#S5.F11), the spatiotemporal fields in Fig\.[12\(a\)](https://arxiv.org/html/2605.06740#S5.F12.sf1), and the error/residual maps in Fig\.[12\(b\)](https://arxiv.org/html/2605.06740#S5.F12.sf2)consistently show that LM\-KAN provides more accurate solution reconstruction and stronger physics consistency across the domain\. The training curves in Fig\.[13](https://arxiv.org/html/2605.06740#S5.F13)further show that this improved accuracy is obtained at the expense of substantially higher computational cost, while PIKAN remains the faster alternative\.
### 5\.3Burgers’ Equation
The one\-dimensional viscous Burgers’ equation is a classical nonlinear advection–diffusion model, originally introduced by Bateman\[[2](https://arxiv.org/html/2605.06740#bib.bib51)\]and later studied by Burgers\[[9](https://arxiv.org/html/2605.06740#bib.bib52)\]\. It arises in several areas of applied mathematics and physics, including fluid dynamics, nonlinear wave propagation, and plasma physics\[[5](https://arxiv.org/html/2605.06740#bib.bib53),[3](https://arxiv.org/html/2605.06740#bib.bib54),[40](https://arxiv.org/html/2605.06740#bib.bib55)\]\. From the perspective of scientific machine learning, Burgers’ equation is an important benchmark because it combines nonlinear convection and diffusion in a single PDE\. The nonlinear termuuxu\\,u\_\{x\}tends to steepen the solution profile, while the viscous termνuxx\\nu u\_\{xx\}smooths it\. As a result, the problem tests whether the model can accurately capture transport, dissipation, and evolving localized gradients at the same time\.
For LM\-KAN, this example is especially useful because it examines whether the learned geometric adaptation can improve representation efficiency in regions where the solution changes more rapidly\. In this sense, Burgers’ equation tests not only accuracy, but also how well the model allocates resolution across the space–time domain under nonlinear dynamics\.
We consider Burgers’ equation with the following initial and boundary conditions\[[39](https://arxiv.org/html/2605.06740#bib.bib56)\]:
ut\(x,t\)\+u\(x,t\)ux\(x,t\)\\displaystyle u\_\{t\}\(x,t\)\+u\(x,t\)u\_\{x\}\(x,t\)=νuxx\(x,t\),\\displaystyle=\\nu u\_\{xx\}\(x,t\),\(94\)u\(x,0\)\\displaystyle u\(x,0\)=sin\(πx\),\\displaystyle=\\sin\(\\pi x\),u\(0,t\)\\displaystyle u\(0,t\)=0,\\displaystyle=0,u\(1,t\)\\displaystyle u\(1,t\)=0,\\displaystyle=0,whereν=0\.1\\nu=0\.1,x∈\[0,1\]x\\in\[0,1\], andt∈\[0,1\]t\\in\[0,1\]\.
Letu^\(x,t\)\\hat\{u\}\(x,t\)denote the network approximation\. The PDE residual is defined by
ℛθ\(x,t\)=u^t\+u^u^x−νu^xx\.\\mathcal\{R\}\_\{\\theta\}\(x,t\)=\\hat\{u\}\_\{t\}\+\\hat\{u\}\\hat\{u\}\_\{x\}\-\\nu\\hat\{u\}\_\{xx\}\.\(95\)Accordingly, the residual, initial\-condition, boundary\-condition, and data\-driven losses are given by
ℒr\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{r\}\}=1Nr∑i=1Nr\|ℛθ\(xri,tri\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\|\\mathcal\{R\}\_\{\\theta\}\(x\_\{r\}^\{i\},t\_\{r\}^\{i\}\)\\right\|^\{2\},ℒic\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{ic\}\}=1Nic∑j=1Nic\(u^\(xicj,0\)−sin\(πxicj\)\)2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{ic\}\}\}\\sum\_\{j=1\}^\{N\_\{\\mathrm\{ic\}\}\}\\left\(\\hat\{u\}\(x\_\{\\mathrm\{ic\}\}^\{j\},0\)\-\\sin\(\\pi x\_\{\\mathrm\{ic\}\}^\{j\}\)\\right\)^\{2\},ℒbc\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{bc\}\}=1Nbc∑k=1Nbc\|u^\(0,tbck\)\|2\+1Nbc∑k=1Nbc\|u^\(1,tbck\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{bc\}\}\}\\sum\_\{k=1\}^\{N\_\{\\mathrm\{bc\}\}\}\\left\|\\hat\{u\}\(0,t\_\{\\mathrm\{bc\}\}^\{k\}\)\\right\|^\{2\}\+\\frac\{1\}\{N\_\{\\mathrm\{bc\}\}\}\\sum\_\{k=1\}^\{N\_\{\\mathrm\{bc\}\}\}\\left\|\\hat\{u\}\(1,t\_\{\\mathrm\{bc\}\}^\{k\}\)\\right\|^\{2\},ℒdata\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{data\}\}=1Ndata∑p=1Ndata\|u^\(xdatap,tdatap\)−u\(xdatap,tdatap\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{data\}\}\}\\sum\_\{p=1\}^\{N\_\{\\mathrm\{data\}\}\}\\left\|\\hat\{u\}\(x\_\{\\mathrm\{data\}\}^\{p\},t\_\{\\mathrm\{data\}\}^\{p\}\)\-u\(x\_\{\\mathrm\{data\}\}^\{p\},t\_\{\\mathrm\{data\}\}^\{p\}\)\\right\|^\{2\},ℒfinalDD\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{final\}\}^\{\\mathrm\{DD\}\}=ℒr\+ℒic\+ℒbc\+ℒdata\.\\displaystyle=\\mathcal\{L\}\_\{\\mathrm\{r\}\}\+\\mathcal\{L\}\_\{\\mathrm\{ic\}\}\+\\mathcal\{L\}\_\{\\mathrm\{bc\}\}\+\\mathcal\{L\}\_\{\\mathrm\{data\}\}\.\(96\)HereNrN\_\{r\},NicN\_\{\\mathrm\{ic\}\},NbcN\_\{\\mathrm\{bc\}\}, andNdataN\_\{\\mathrm\{data\}\}denote the numbers of residual, initial\-condition, boundary\-condition, and supervised data points, respectively\.
In this experiment we adopt a data\-driven physics\-informed strategy\. A numerical reference solution is first computed, and a small subset of solution values is incorporated into training through the additional termℒdata\\mathcal\{L\}\_\{\\mathrm\{data\}\}\. In particular, sharp\-feature points corresponding to 10% of the time grid are sampled and matched to the numerical RK45 solution, thereby providing localized supervision in regions where steep gradients emerge\. This hybrid construction is especially useful for Burgers’ equation, since the nonlinear advective term can produce rapidly varying transient structures that are often more difficult to capture accurately using a purely residual\-based objective\. The supervised data help anchor the solution near these sharp regions, while the physics\-informed residual enforces consistency with the governing PDE\.
For Burgers’ equation, the PIKAN baseline uses the architecture\[2,8,4,1\]\[2,8,4,1\]with cubic B\-spline parameterization on a grid of size 5\. In contrast, the LM\-KAN model employs two learned\-metric basis layers of width 8 withK=8K=8RBF basis functions per input dimension,γ=2\.5\\gamma=2\.5, and metric hidden width 9 \(Table[8](https://arxiv.org/html/2605.06740#S5.T8)\)\. This larger LM\-KAN configuration was chosen deliberately, since Burgers’ equation develops sharp spatial gradients and requires higher local representational resolution near the evolving front\. Unlike the Allen–Cahn experiments, the Burgers setup does not enforce a tightly matched parameter budget; instead, the LM\-KAN architecture is enlarged to test whether geometry\-adaptive basis placement is beneficial in the presence of shock\-forming dynamics\.
Table 8:Architecture comparison for Burgers’ equation\. The LM\-KAN model is intentionally larger than the PIKAN baseline, using both larger hidden width and more basis functions per input dimension to better resolve steep gradients and shock\-like structures\.\(a\)t=0\.25t=0\.25
\(b\)t=0\.5t=0\.5
\(c\)t=0\.75t=0\.75
\(d\)t=1\.0t=1\.0
Figure 14:Comparison of the numerical solution with the PIKAN and LM\-KAN predictions for Burgers’ equation at four representative time instances\. Both models remain in close agreement with the numerical reference over the full time interval, showing that they accurately capture the nonlinear advection–diffusion evolution\.\(a\)Training loss comparison between PIKAN and LM\-KAN\.Figure 15:Training behavior for Burgers’ equation\. Both models exhibit rapid early\-stage loss decay and then stabilize in the10−410^\{\-4\}regime\. PIKAN reaches a slightly smaller final loss, while LM\-KAN attains comparable accuracy with lower wall\-clock training time\.Table 9:Comparison between PIKAN and LM\-KAN for Burgers’ equation after50005000training epochs\. PIKAN attains a slightly smaller final loss, while LM\-KAN completes training in less wall\-clock time despite using more trainable parameters\.To first assess pointwise predictive accuracy, Fig\.[14](https://arxiv.org/html/2605.06740#S5.F14)compares the numerical and predicted solution profiles att=0\.25t=0\.25,0\.50\.5,0\.750\.75, and1\.01\.0\. At all four time instants, both PIKAN and LM\-KAN closely follow the numerical solution, indicating that each model successfully captures the nonlinear advection–diffusion dynamics\. The agreement remains strong not only at earlier times, when the solution amplitude is larger and gradients are more pronounced, but also at later times, when viscosity progressively smooths the solution profile\. These profile comparisons confirm that both models correctly learn the temporal evolution of Burgers’ dynamics\.
At the end of training, the two models attain nearly the same final loss:9\.9×10−59\.9\\times 10^\{\-5\}for PIKAN and1\.03×10−41\.03\\times 10^\{\-4\}for LM\-KAN\. However, LM\-KAN achieves this with a noticeably smaller wall\-clock training time, requiring206\.48206\.48seconds compared with295\.39295\.39seconds for PIKAN, despite having more trainable parameters \(1229 for LM\-KAN versus 520 for PIKAN\)\. A quantitative comparison between the two models is reported in Table[9](https://arxiv.org/html/2605.06740#S5.T9)\. This suggests that the learned\-metric representation improves computational efficiency while maintaining essentially the same predictive quality\.
Fig\.[15](https://arxiv.org/html/2605.06740#S5.F15)shows the evolution of the training loss for the two models\. Both curves decrease sharply during the early epochs and then flatten into a similar convergence regime\. Although PIKAN ends with a marginally smaller loss value, the difference is very small, and both models exhibit stable optimization behavior throughout training\. When viewed together with the training times, this result indicates that LM\-KAN reaches essentially the same accuracy level more efficiently\.
\(a\)Spatiotemporal solution comparison among the numerical reference, PIKAN, and LM\-KAN\.
\(b\)Absolute error maps\|upred−unum\|\|u\_\{\\mathrm\{pred\}\}\-u\_\{\\mathrm\{num\}\}\|for PIKAN and LM\-KAN\.
Figure 16:Global space–time comparison for Burgers’ equation\. The top panel shows that both learned models reproduce the overall transport–diffusion pattern of the numerical solution very accurately\. The bottom panel shows that the largest errors are localized mainly near early times and in regions with stronger spatial variation, while the error remains small over most of the domain for both methods\.A more global picture is provided in Fig\.[16](https://arxiv.org/html/2605.06740#S5.F16)\. The spatiotemporal heatmaps in Fig\.[16](https://arxiv.org/html/2605.06740#S5.F16)\(a\) show that both PIKAN and LM\-KAN reproduce the full solution field very closely, including the gradual decay and redistribution induced by the balance between nonlinear transport and viscosity\. The absolute error maps in Fig\.[16](https://arxiv.org/html/2605.06740#S5.F16)\(b\) further show that the largest discrepancies are confined to localized regions, mainly near early times and near sharper transient structures\. Outside these regions, both models maintain very small errors across most of the domain\.
Overall, Burgers’ equation provides a meaningful benchmark for GeoKAN\-type models because it tests nonlinear transport, diffusion balance, and localized gradient resolution simultaneously\. The profile comparisons in Fig\.[14](https://arxiv.org/html/2605.06740#S5.F14), the training behavior in Fig\.[15](https://arxiv.org/html/2605.06740#S5.F15), and the global space–time results in Fig\.[16](https://arxiv.org/html/2605.06740#S5.F16)all show that LM\-KAN preserves the predictive quality of PIKAN while reducing training time\. This supports the usefulness of the learned geometric adaptation for nonlinear PDE learning\.
### 5\.4The Lorenz System
The Lorenz system is a classical nonlinear system of ordinary differential equations originally introduced as a simplified model for atmospheric convection\[[26](https://arxiv.org/html/2605.06740#bib.bib43)\]\. It is one of the most widely studied benchmark problems in nonlinear dynamics, owing to its rich transient behavior and strong coupling among state variables\. In the present work, we consider a non\-chaotic regime of the Lorenz system and use it to compare the original physics\-informed KAN \(PIKAN\) with the geometry\-adaptive LM\-KAN model\.
The governing equations are given by\[[33](https://arxiv.org/html/2605.06740#bib.bib42)\]
x′\(t\)=σ\(y\(t\)−x\(t\)\),y′\(t\)=x\(t\)\(ρ−z\(t\)\)−y\(t\),z′\(t\)=x\(t\)y\(t\)−βz\(t\),\{x\(0\)=1,y\(0\)=1,z\(0\)=1,\\begin\{aligned\} x^\{\\prime\}\(t\)&=\\sigma\\bigl\(y\(t\)\-x\(t\)\\bigr\),\\\\ y^\{\\prime\}\(t\)&=x\(t\)\\bigl\(\\rho\-z\(t\)\\bigr\)\-y\(t\),\\\\ z^\{\\prime\}\(t\)&=x\(t\)y\(t\)\-\\beta z\(t\),\\end\{aligned\}\\qquad\\begin\{cases\}x\(0\)=1,\\\\ y\(0\)=1,\\\\ z\(0\)=1,\\end\{cases\}\(97\)wheret∈\[0,20\]t\\in\[0,20\]\.
Letx^\(t\)\\hat\{x\}\(t\),y^\(t\)\\hat\{y\}\(t\), andz^\(t\)\\hat\{z\}\(t\)denote the learned solution components\. The corresponding residuals are defined as
ℛθ1\(t\)\\displaystyle\\mathcal\{R\}\_\{\\theta\}^\{1\}\(t\)=x^′\(t\)−σ\(y^\(t\)−x^\(t\)\),\\displaystyle=\\hat\{x\}^\{\\prime\}\(t\)\-\\sigma\\bigl\(\\hat\{y\}\(t\)\-\\hat\{x\}\(t\)\\bigr\),\(98\)ℛθ2\(t\)\\displaystyle\\mathcal\{R\}\_\{\\theta\}^\{2\}\(t\)=y^′\(t\)−\(x^\(t\)\(ρ−z^\(t\)\)−y^\(t\)\),\\displaystyle=\\hat\{y\}^\{\\prime\}\(t\)\-\\bigl\(\\hat\{x\}\(t\)\(\\rho\-\\hat\{z\}\(t\)\)\-\\hat\{y\}\(t\)\\bigr\),ℛθ3\(t\)\\displaystyle\\mathcal\{R\}\_\{\\theta\}^\{3\}\(t\)=z^′\(t\)−\(x^\(t\)y^\(t\)−βz^\(t\)\)\.\\displaystyle=\\hat\{z\}^\{\\prime\}\(t\)\-\\bigl\(\\hat\{x\}\(t\)\\hat\{y\}\(t\)\-\\beta\\hat\{z\}\(t\)\\bigr\)\.The residual and initial\-condition losses are then given by
ℒr\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{r\}\}=1Nr∑i=1Nr\(\|ℛθ1\(tri\)\|2\+\|ℛθ2\(tri\)\|2\+\|ℛθ3\(tri\)\|2\),\\displaystyle=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\(\\left\|\\mathcal\{R\}\_\{\\theta\}^\{1\}\(t\_\{r\}^\{i\}\)\\right\|^\{2\}\+\\left\|\\mathcal\{R\}\_\{\\theta\}^\{2\}\(t\_\{r\}^\{i\}\)\\right\|^\{2\}\+\\left\|\\mathcal\{R\}\_\{\\theta\}^\{3\}\(t\_\{r\}^\{i\}\)\\right\|^\{2\}\\right\),\(99\)ℒic\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{ic\}\}=\(x^\(0\)−1\)2\+\(y^\(0\)−1\)2\+\(z^\(0\)−1\)2,\\displaystyle=\(\\hat\{x\}\(0\)\-1\)^\{2\}\+\(\\hat\{y\}\(0\)\-1\)^\{2\}\+\(\\hat\{z\}\(0\)\-1\)^\{2\},and the final loss function is
ℒfinalDF=ℒr\+ℒic\.\\mathcal\{L\}\_\{\\mathrm\{final\}\}^\{\\mathrm\{DF\}\}=\\mathcal\{L\}\_\{\\mathrm\{r\}\}\+\\mathcal\{L\}\_\{\\mathrm\{ic\}\}\.\(100\)
For the Lorenz system, in the architecture the input is the scalar time variablett, while the output is the three\-dimensional state vector\(x\(t\),y\(t\),z\(t\)\)\(x\(t\),y\(t\),z\(t\)\)\. The PIKAN baseline is implemented as a wavelet\-based KAN with architecture\[1,8,16,3\]\[1,8,16,3\]\. The LM\-KAN architecture uses three learned\-metric basis layers of width 4 withK=5K=5RBF basis functions per layer and metric hidden width 9, followed by a linear head producing the three state components simultaneously \(Table[10](https://arxiv.org/html/2605.06740#S5.T10)\)\. Here, the RBF parameter is reduced toγ=0\.5\\gamma=0\.5, yielding smoother and wider kernels that are better suited to long\-horizon trajectory learning\.
Table 10:Architecture comparison for the Lorenz system\. Since the task maps a scalar time input to the three coupled state variables\(x,y,z\)\(x,y,z\), the output dimension is 3 for all models\.ModelArchitectureDepthResolutionBasisMetric hiddenOutputPIKAN \(Wav\-KAN\)\[1,8,16,3\]\[1,8,16,3\]2–Wavelet basis–3LM\-KAN\(1→4→4→4→3\)\(1\\rightarrow 4\\rightarrow 4\\rightarrow 4\\rightarrow 3\)3K=5K=5RBF,γ=0\.5\\gamma=0\.593We useNr=100N\_\{r\}=100collocation points uniformly distributed over0≤t≤200\\leq t\\leq 20\. Both models are trained for10410^\{4\}epochs using the AdamW optimizer with learning rateη=10−3\\eta=10^\{\-3\}\. The corresponding solution trajectories are shown first in Fig\.[17](https://arxiv.org/html/2605.06740#S5.F17)\. For all three state variables, both learned models closely match the numerical reference solution over the full time interval\. Thex\(t\)x\(t\)trajectory in Fig\.[17\(a\)](https://arxiv.org/html/2605.06740#S5.F17.sf1)is captured accurately by both approaches, with the predicted curves nearly overlapping the numerical solution\. A similarly close agreement is observed fory\(t\)y\(t\)in Fig\.[17\(b\)](https://arxiv.org/html/2605.06740#S5.F17.sf2), including its initial transient and subsequent smooth evolution\. Thez\(t\)z\(t\)trajectory in Fig\.[17\(c\)](https://arxiv.org/html/2605.06740#S5.F17.sf3)is also well resolved, showing that both models successfully learn the coupled system dynamics\. Overall, the trajectory plots indicate that both PIKAN and LM\-KAN provide accurate solution approximations throughout the interval0≤t≤200\\leq t\\leq 20\.
The training\-loss evolution is shown next in Fig\.[18](https://arxiv.org/html/2605.06740#S5.F18)\. Both models achieve stable optimization and reduce the loss by several orders of magnitude\. However, LM\-KAN converges to a slightly smaller final loss than PIKAN\. At the end of training, the final loss is2\.7×10−52\.7\\times 10^\{\-5\}for PIKAN and5×10−65\\times 10^\{\-6\}for LM\-KAN, confirming the stronger final fit achieved by the geometry\-adaptive model\.
A quantitative comparison between the two models is reported in Table[11](https://arxiv.org/html/2605.06740#S5.T11)\. Although LM\-KAN requires a longer training time, it achieves the smallest final loss while keeping the parameter count close to that of PIKAN\. Specifically, PIKAN uses 736 trainable parameters and completes training in 232\.46 seconds, whereas LM\-KAN uses 777 trainable parameters and requires 527\.37 seconds\. Thus, for this Lorenz\-system experiment, LM\-KAN provides improved final accuracy at the expense of higher computational cost\.
\(a\)Comparison for thex\(t\)x\(t\)trajectory\.
\(b\)Comparison for they\(t\)y\(t\)trajectory\.
\(c\)Comparison for thez\(t\)z\(t\)trajectory\.
Figure 17:Solution comparison for the Lorenz system\. Both PIKAN and LM\-KAN closely follow the numerical solution for all three state variables over0≤t≤200\\leq t\\leq 20\.Figure 18:Training loss comparison between PIKAN and LM\-KAN for the Lorenz system\. Both models exhibit steady loss decay over training, while LM\-KAN reaches a lower final loss than PIKAN after10410^\{4\}epochs\.Table 11:Comparison between PIKAN and LM\-KAN for the Lorenz system after10410^\{4\}training epochs\. LM\-KAN attains a lower final loss, while PIKAN remains more computationally efficient\.
### 5\.5Helmholtz Equation
The one\-dimensional Helmholtz equation is a canonical frequency\-domain model for wave propagation in inhomogeneous media\. In the present work, it serves as a demanding benchmark because the solution is complex\-valued and combines rapid phase oscillations with spatially varying amplitude\. As the wavelength decreases, the effective wavenumber increases, and the field becomes progressively more oscillatory\. This makes the Helmholtz problem a useful test of whether the model can preserve phase accuracy, amplitude transitions, and global wave geometry under increasing representational difficulty\.
Following the structure\-preserving Helmholtz formulation in\[[18](https://arxiv.org/html/2605.06740#bib.bib63)\], we consider a one\-dimensional monochromatic scattering problem for a complex\-valued fieldu\(z\)u\(z\)on the intervalz∈\[0,1\]z\\in\[0,1\]:
uzz\(z\)\+k2\(z\)u\(z\)\\displaystyle u\_\{zz\}\(z\)\+k^\{2\}\(z\)u\(z\)=0,\\displaystyle=0,\(101\)\(uz\+ik−u\)\|z=0\\displaystyle\\left\(u\_\{z\}\+ik\_\{\-\}\\,u\\right\)\\big\|\_\{z=0\}=2ik−Ainc,\\displaystyle=2ik\_\{\-\}\\,A\_\{\\mathrm\{inc\}\},\(uz−ik\+u\)\|z=1\\displaystyle\\left\(u\_\{z\}\-ik\_\{\+\}\\,u\\right\)\\big\|\_\{z=1\}=0,\\displaystyle=0,whereAincA\_\{\\mathrm\{inc\}\}denotes the incident\-wave amplitude, andk−k\_\{\-\}andk\+k\_\{\+\}are the exterior wavenumbers on the left and right boundaries, respectively\. The spatially varying wavenumber is related to the complex relative permittivityϵ\(z\)\\epsilon\(z\)through
k2\(z\)=ϵ\(z\)\(2πλ\)2,k^\{2\}\(z\)=\\epsilon\(z\)\\left\(\\frac\{2\\pi\}\{\\lambda\}\\right\)^\{2\},\(102\)whereλ\\lambdais the driving wavelength\. Sinceϵ\(z\)\\epsilon\(z\)may be complex\-valued, the solution exhibits both oscillatory and attenuative behavior, which makes the learning problem substantially more challenging than standard real\-valued smooth benchmarks\.
Letu^\(z\)\\hat\{u\}\(z\)denote the network approximation\. The Helmholtz residual is defined by
ℛθ\(z\)=u^zz\(z\)\+k2\(z\)u^\(z\)\.\\mathcal\{R\}\_\{\\theta\}\(z\)=\\hat\{u\}\_\{zz\}\(z\)\+k^\{2\}\(z\)\\hat\{u\}\(z\)\.\(103\)Accordingly, the residual and boundary\-condition losses are given by
ℒr\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{r\}\}=1Nr∑i=1Nr\|ℛθ\(zri\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{r\}\}\\sum\_\{i=1\}^\{N\_\{r\}\}\\left\|\\mathcal\{R\}\_\{\\theta\}\(z\_\{r\}^\{i\}\)\\right\|^\{2\},ℒbc\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{bc\}\}=1Nbc∑j=1Nbc\|u^z\(0\)\+ik−u^\(0\)−2ik−Ainc\|2\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{bc\}\}\}\\sum\_\{j=1\}^\{N\_\{\\mathrm\{bc\}\}\}\\left\|\\hat\{u\}\_\{z\}\(0\)\+ik\_\{\-\}\\hat\{u\}\(0\)\-2ik\_\{\-\}A\_\{\\mathrm\{inc\}\}\\right\|^\{2\}\+1Nbc∑j=1Nbc\|u^z\(1\)−ik\+u^\(1\)\|2\.\\displaystyle\\quad\+\\frac\{1\}\{N\_\{\\mathrm\{bc\}\}\}\\sum\_\{j=1\}^\{N\_\{\\mathrm\{bc\}\}\}\\left\|\\hat\{u\}\_\{z\}\(1\)\-ik\_\{\+\}\\hat\{u\}\(1\)\\right\|^\{2\}\.\(104\)If reference solution samples are additionally used, the data\-driven loss is written as
ℒdata\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{data\}\}=1Ndata∑p=1Ndata\|u^\(zdatap\)−u\(zdatap\)\|2,\\displaystyle=\\frac\{1\}\{N\_\{\\mathrm\{data\}\}\}\\sum\_\{p=1\}^\{N\_\{\\mathrm\{data\}\}\}\\left\|\\hat\{u\}\(z\_\{\\mathrm\{data\}\}^\{p\}\)\-u\(z\_\{\\mathrm\{data\}\}^\{p\}\)\\right\|^\{2\},\(105\)and the final training objective becomes
ℒfinalDD=ℒr\+ℒbc\+ℒdata,\\mathcal\{L\}\_\{\\mathrm\{final\}\}^\{\\mathrm\{DD\}\}=\\mathcal\{L\}\_\{\\mathrm\{r\}\}\+\\mathcal\{L\}\_\{\\mathrm\{bc\}\}\+\\mathcal\{L\}\_\{\\mathrm\{data\}\},\(106\)whereNrN\_\{r\},NbcN\_\{\\mathrm\{bc\}\}, andNdataN\_\{\\mathrm\{data\}\}denote the numbers of residual, boundary, and supervised data points, respectively\. This is the direct Helmholtz\-PINN formulation; the reference paper notes that such second\-order residuals become increasingly stiff in high\-frequency regimes, whereas reduced first\-order formulations can substantially improve optimization behavior\.
For the Helmholtz equation, we compare the PIKAN baseline implemented with EfficientKAN against the LM\-KAN model under an approximately matched parameter budget\. Both models are trained over the same wavelength interval,
λ∈\[130,110\],\\lambda\\in\\left\[\\frac\{1\}\{30\},\\frac\{1\}\{10\}\\right\],using the same residual\-based training objective\. This ensures that the comparison reflects differences in representation and inductive bias rather than differences in overall model size\.
The PIKAN baseline uses an EfficientKAN architecture of the form\[2,12,12,2\]\[2,12,12,2\]with cubic B\-spline parameterization on a grid of size 5\. In contrast, the LM\-KAN model employs a learned\-metric architecture with input dimension 2, output dimension 2, hidden width 4, and depth 2\. For this oscillatory problem, we use the Fourier\-based LM\-KAN variant \(Eq\. \([80](https://arxiv.org/html/2605.06740#S3.E80)\)\), since its post\-warp sinusoidal dictionary is naturally aligned with the wave\-like structure of the Helmholtz solution\. It usesK=16K=16Fourier basis functions per input dimension,γ=0\.5\\gamma=0\.5, and a metric hidden width of 18\. As shown in Table[12](https://arxiv.org/html/2605.06740#S5.T12), the two models have nearly identical parameter counts, with 1920 parameters for PIKAN and 1928 for LM\-KAN\. Hence, any performance difference in this benchmark cannot be attributed simply to model scale\. This matched\-capacity setup is particularly important for the Helmholtz problem, since the benchmark is designed to test how well each model handles oscillatory complex\-valued wavefields over multiple wavelengths\. In this setting, LM\-KAN is not given a larger budget; instead, it is evaluated at essentially the same parameter scale as the EfficientKAN\-based PIKAN baseline, so that the effect of learned geometric adaptation can be assessed directly\.
Table 12:Architecture comparison for the Helmholtz equation\. The PIKAN and LM\-KAN models are matched to nearly the same parameter count so that differences in performance reflect architectural bias rather than model size\.For the present comparison, we evaluate PIKAN and LM\-KAN at three wavelengths,λ=1/15\\lambda=1/15,1/201/20, and1/251/25\. These cases provide a controlled progression from moderately oscillatory to strongly oscillatory regimes\. In all cases, the reference solution is compared against the learned real part, imaginary part, magnitude, spatiotemporal field structure, and phase\-space orbit geometry\. This allows us to assess not only pointwise agreement, but also whether the learned representation preserves the qualitative structure of the complex wavefield under wavelength tension\. The original Helmholtz study similarly emphasizes that performance differences become more pronounced as the oscillatory burden increases\. The one\-dimensional wavefield comparisons provide the clearest view of model accuracy across increasing oscillatory difficulty\. Fig\.[19](https://arxiv.org/html/2605.06740#S5.F19)corresponds to the caseλ=1/15\\lambda=1/15, where both models reproduce the reference solution closely in the real and imaginary parts, and both capture the smooth magnitude transition accurately\. In this relatively easier regime, the difference between the methods is modest, although LM\-KAN remains slightly more tightly aligned with the reference in the oscillatory components\.
As the wavelength decreases toλ=1/20\\lambda=1/20, shown in Fig\.[20](https://arxiv.org/html/2605.06740#S5.F20), the oscillations become denser and the approximation becomes more sensitive to phase mismatch\. Both models still track the reference well, but the error level increases relative to theλ=1/15\\lambda=1/15case\. In particular, the transition region near the middle of the domain becomes a stricter test because the model must preserve both oscillatory phase and amplitude\-envelope variation\. LM\-KAN continues to maintain slightly better alignment with the reference acrossRe\[u\]\\mathrm\{Re\}\[u\],Im\[u\]\\mathrm\{Im\}\[u\], and\|u\|\|u\|\.
The hardest case,λ=1/25\\lambda=1/25, is shown in Fig\.[21](https://arxiv.org/html/2605.06740#S5.F21)\. Here the field contains the highest oscillation density among the tested cases, and the absolute error becomes largest overall\. Even in this regime, both models preserve the qualitative structure of the reference solution, but LM\-KAN remains marginally closer in the oscillatory components and through the downstream tail\. This trend supports the view that the learned geometric adaptation becomes more useful as the solution develops finer\-scale oscillatory structure\.
Figure 19:Wavefield components for the Helmholtz benchmark atλ=1/15\\lambda=1/15\. The figure showsRe\[u\]\\mathrm\{Re\}\[u\],Im\[u\]\\mathrm\{Im\}\[u\],\|u\|\|u\|, and the absolute error for the reference solution, PIKAN, and LM\-KAN\. At this wavelength, both models closely reproduce the reference field, while LM\-KAN remains slightly more tightly aligned across the oscillatory components\.Figure 20:Wavefield components for the Helmholtz benchmark atλ=1/20\\lambda=1/20\. As the wavelength decreases, the oscillations become denser and the approximation task becomes more sensitive to phase mismatch\. Both models continue to track the reference well, but LM\-KAN preserves the wavefield structure slightly more accurately through the transition region and in the error profile\.Figure 21:Wavefield components for the Helmholtz benchmark atλ=1/25\\lambda=1/25\. This is the most oscillatory case considered\. Although both models retain strong qualitative agreement with the reference solution, LM\-KAN better preserves the oscillatory structure and remains marginally closer in the absolute\-error distribution, especially near the main transition region\.\(a\)λ=1/15\\lambda=1/15
\(b\)λ=1/20\\lambda=1/20
\(c\)λ=1/25\\lambda=1/25
Figure 22:Spatiotemporal rendering of the Helmholtz wavefield for three wavelengths\. Each panel compares the reference field with the EfficientKAN and LM\-KAN reconstructions\. The stripe pattern becomes progressively denser asλ\\lambdadecreases, revealing the increasing oscillatory complexity of the benchmark\.The same trend appears in the spatiotemporal visualizations of Fig\.[22](https://arxiv.org/html/2605.06740#S5.F22)\. Forλ=1/15\\lambda=1/15, the stripe pattern is relatively well resolved by both methods, and the rendered fields appear visually close to the reference\. Atλ=1/20\\lambda=1/20, the frequency of the stripe pattern increases, making any local phase drift more noticeable\. Atλ=1/25\\lambda=1/25, the problem becomes clearly high\-frequency, and the benefit of LM\-KAN is more evident: its rendering remains closer to the reference stripe geometry and contrast pattern, while EfficientKAN exhibits slightly more visible deviation in the fine oscillatory structure\. These spatiotemporal plots therefore support the one\-dimensional error analysis by showing that LM\-KAN preserves the global propagation texture more faithfully as the wavelength decreases\.
A further geometric view is provided by the phase\-space traces in Fig\.[23](https://arxiv.org/html/2605.06740#S5.F23), where the complex field is visualized through its trajectory in the\(Re\[u\],Im\[u\]\)\(\\real\[u\],\\imaginary\[u\]\)plane\. Atλ=1/15\\lambda=1/15, both methods reproduce the nested elliptical orbit structure very well\. Atλ=1/20\\lambda=1/20, the orbit geometry remains well preserved, but small deviations become more visible as the loops tighten and the field becomes more oscillatory\. Atλ=1/25\\lambda=1/25, LM\-KAN again appears slightly closer to the reference nested structure, especially in maintaining the shape and spacing of the inner and outer loops\. Since these phase portraits encode the joint evolution of real and imaginary components, they provide strong evidence that LM\-KAN is not merely matching amplitude pointwise, but is also preserving the global geometry of the complex wave more accurately\.
\(a\)λ=1/15\\lambda=1/15
\(b\)λ=1/20\\lambda=1/20
\(c\)λ=1/25\\lambda=1/25
Figure 23:Phase\-space traces\(Re\[u\],Im\[u\]\)\(\\real\[u\],\\imaginary\[u\]\)for the Helmholtz benchmark\. The reference, EfficientKAN, and LM\-KAN trajectories are shown for each wavelength\. Preservation of these nested orbits provides a geometric diagnostic of phase consistency in the learned complex\-valued field\.Figure 24:Training loss convergence for the Helmholtz benchmark\. LM\-KAN begins from a larger initial loss, but its optimization progresses more efficiently and reaches a lower final loss than PIKAN, indicating improved convergence for this oscillatory complex\-valued problem\.Fig\.[24](https://arxiv.org/html/2605.06740#S5.F24)compares the training behavior of the two models, and Table[13](https://arxiv.org/html/2605.06740#S5.T13)summarizes the corresponding loss values and runtimes\. Both networks reduce the physics loss substantially during training, but they do so in different ways\. The EfficientKAN\-based PIKAN model starts from a much smaller initial loss, whereas LM\-KAN begins from a considerably larger value\. Despite this unfavorable starting point, LM\-KAN converges more effectively as training proceeds and reaches the lower final logged loss,4\.83×10−34\.83\\times 10^\{\-3\}, compared with8\.79×10−38\.79\\times 10^\{\-3\}for EfficientKAN\. This corresponds to an approximate45%45\\%reduction in final loss\. EfficientKAN does attain a slightly smaller temporary minimum during training,4\.49×10−34\.49\\times 10^\{\-3\}versus4\.83×10−34\.83\\times 10^\{\-3\}, but it does not preserve that advantage through the end of optimization\. In addition, LM\-KAN completes training in76\.7776\.77seconds, whereas EfficientKAN requires166\.42166\.42seconds, so the LM\-KAN model is more than twice as fast and reduces training time by about53\.9%53\.9\\%\. Since the two architectures are essentially parameter matched, with 1920 parameters for PIKAN and 1928 for LM\-KAN, this improvement cannot be attributed to model size alone\. Rather, it suggests that the learned metric together with the Fourier basis provides a more effective inductive bias for the multi\-wavelength Helmholtz problem, leading to faster and better final convergence\.
Table 13:Comparison between PIKAN and LM\-KAN for the Helmholtz benchmark\. LM\-KAN attains a lower final loss and trains substantially faster, while the two models remain nearly matched in parameter count\. EfficientKAN reaches a slightly smaller temporary minimum during training, but does not retain this advantage at the end of optimization\.Overall, the Helmholtz results show a clear and consistent trend\. At the largest tested wavelength, both models already provide accurate approximations of the reference solution\. As the wavelength decreases and the solution becomes more oscillatory, the advantage of LM\-KAN becomes more apparent\. In the one\-dimensional wavefield comparisons, LM\-KAN remains slightly closer to the reference in the real and imaginary components and generally exhibits a smaller final error profile\. In the spatiotemporal visualizations, it preserves the stripe structure of the propagating field more faithfully as oscillatory complexity increases\. In the phase\-space plots, it also maintains better agreement with the reference orbit geometry, which indicates stronger preservation of the joint real\-imaginary wave dynamics\.
The training results reinforce the same conclusion\. Although EfficientKAN briefly reaches a slightly lower intermediate minimum, LM\-KAN attains the better final solution and does so in substantially less time\. This is especially significant because the two models are compared under an almost identical parameter budget\. Taken together, these observations show that LM\-KAN provides the stronger overall performance for the Helmholtz benchmark, offering a better balance of final accuracy and computational efficiency\.
From the perspective of the present work, this result is important because the Helmholtz problem directly probes whether learned geometric adaptation is beneficial in highly oscillatory regimes\. The answer suggested by these experiments is affirmative\. LM\-KAN appears better able to allocate representational capacity to regions where the complex wavefield changes rapidly, and this leads to improved optimization, better structural fidelity, and more robust behavior as the wavelength decreases\. Thus, the Helmholtz benchmark supports the broader claim that geometry\-adaptive KAN models are particularly effective for wave problems with multi\-scale oscillatory structure\.
## 6Discussion and Conclusion
In this work, we introduced Geometric KAN \(GeoKAN\), a family of geometry\-aware Kolmogorov–Arnold models for supervised function approximation and physics\-informed differential equation solving\. The main novelty of GeoKAN is that it does not construct the representation only in fixed Euclidean coordinates\. Instead, it learns a task\-dependent metric and uses that learned geometry to define the coordinates in which the features are built\. This is the key difference from earlier models\. MLPs learn nonlinear maps on a fixed domain, while standard KANs improve the representation by replacing scalar weights with learnable univariate functions that are still evaluated directly on the original inputs\. GeoKAN extends this idea by learning the geometry itself\. In the layerwise formulation \(Eqns\. \([37](https://arxiv.org/html/2605.06740#S3.E37)\)–\([39](https://arxiv.org/html/2605.06740#S3.E39)\)\), the model first learns a positive metric, then forms warped coordinates, and only afterwards constructs the features\. In the physics\-informed setting, the loss remains the standard residual\-based one in Eq\. \([86](https://arxiv.org/html/2605.06740#S5.E86)\)\. The novelty is therefore architectural rather than variational\. Within this framework, LM\-KAN, defined in Eq\.\([78](https://arxiv.org/html/2605.06740#S3.E78)\) and Eq\. \([80](https://arxiv.org/html/2605.06740#S3.E80)\), is the main geometry\-aware surrogate considered in this work\.
The supervised data\-fitting experiments show that this geometric adaptation is useful across a broad range of targets\. In the matched\-capacity benchmark, GeoKAN models outperform the MLP baseline and often also Efficient\-KAN on functions with oscillatory, localized, discontinuous, and multiscale structure\. As shown in Table[3](https://arxiv.org/html/2605.06740#S4.T3), GeoKAN\-NNMetric and LM\-KAN\-Wav achieve the best or tied\-best results on several of the most difficult targets, including the high\-frequency sinusoid, the step discontinuity, the narrow needle, the multiscale envelope\-modulated sinusoid, and the sawtooth\. The same overall trend is visible in Fig\.[6](https://arxiv.org/html/2605.06740#S4.F6)and Fig\.[7](https://arxiv.org/html/2605.06740#S4.F7), where the geometry\-aware models track the difficult targets more closely than the fixed\-geometry baselines\. Since the parameter counts in Table[2](https://arxiv.org/html/2605.06740#S4.T2)are closely matched, these gains cannot be attributed simply to larger models\. Rather, they indicate that the learned geometric warp changes how approximation power is distributed across the domain\. Regions with rapid variation, sharp transitions, or fine\-scale structure can be represented more effectively, while smoother regions need less representational effort\. This is precisely the type of setting in which a geometry\-adaptive construction should be expected to help, and the data\-fitting results provide clear evidence that it does\.
The physics\-informed experiments lead to the same general conclusion\. We studied Allen–Cahn equations in two regimes, Burgers’ equation, the Lorenz system, and the Helmholtz equation, given by Eqns\. \([5\.2](https://arxiv.org/html/2605.06740#S5.Ex14)\), \([5\.2](https://arxiv.org/html/2605.06740#S5.Ex18)\), \([94](https://arxiv.org/html/2605.06740#S5.E94)\), \([97](https://arxiv.org/html/2605.06740#S5.E97)\), and \([101](https://arxiv.org/html/2605.06740#S5.E101)\)\. These problems cover different types of difficulty, including moving interfaces, steep gradients, nonlinear coupling, and oscillatory wave behavior\. For Allen–Cahn Case 1, both models recover the solution accurately\. The main difference is that PIKAN reaches the smaller final loss, while LM\-KAN trains much faster\. For Allen–Cahn Case 2, which is the harder regime, LM\-KAN gives the better overall approximation\. This suggests that the learned metric helps the model resolve sharper interface structure, although it comes with a higher training cost\. For Burgers’ equation, both models again produce very accurate solutions, but LM\-KAN reaches nearly the same final loss in less wall\-clock time\. This indicates that the learned warp is useful when the solution develops localized steepening\. For the Lorenz system, both methods reproduce the trajectories well, while LM\-KAN attains a lower final loss and PIKAN remains faster\. This shows that the benefit of geometry adaptation is not limited to PDEs with spatial structure, but can also appear in coupled nonlinear ODE systems\. The Helmholtz equation gives the strongest evidence in favor of the proposed approach\. In this case, the two models are nearly parameter matched, so the comparison mainly reflects the architecture itself\. LM\-KAN preserves the oscillatory structure more robustly, especially as the wavelength decreases, and it reaches a lower final loss in substantially less time\. Since this experiment uses the Fourier version of LM\-KAN, it also shows that performance improves when the basis is well matched to the structure of the target problem\.
Overall, the experiments show that GeoKAN is most effective when the target has non\-uniformity across the domain\. Fixed\-geometry models tend to distribute representational capacity more uniformly, whereas GeoKAN can adapt that allocation through the learned metric\. This interpretation is consistent with Fig\.[4](https://arxiv.org/html/2605.06740#S3.F4)and Table[1](https://arxiv.org/html/2605.06740#S3.T1), and it helps explain why the gains are strongest for localized, multiscale, and oscillatory problems\. At the same time, GeoKAN is not uniformly superior in every respect\. In some cases, such as Allen–Cahn Case 1, PIKAN still achieves the lowest final loss\. In other cases, such as Allen–Cahn Case 2 and the Lorenz system, LM\-KAN improves the final approximation but requires more training time\. The most balanced conclusion is therefore not that GeoKAN dominates all earlier models in every metric, but that it provides a more flexible and often more effective representational mechanism, especially for problems with sharp transitions, localized structure, or oscillatory complexity\.
Several directions remain open for future work\. One natural extension is to move beyond diagonal metrics and consider anisotropic or fully coupled metric tensors, especially for higher\-dimensional PDEs where directional effects may matter\. Another direction is to make the basis more adaptive, since the present results already show that wavelet, RBF, and Fourier variants have different strengths\. It would also be valuable to test GeoKAN on more demanding scientific machine\-learning tasks, including higher\-dimensional PDEs, inverse problems, operator learning, and wave propagation in heterogeneous media\.
## Data and code availability
The proposed model was implemented and evaluated on a Linux\-based system \(6\.8\.0\-57\-generic\) powered by a 56\-core x86\_64 CPU \(112 logical processors\) and 754\.53 GB of system memory\.
## Acknowledgments
This work was supported by Army Research Office \(ARO\) \(grant W911NF\-23\-1\-0288; program manager Dr\. James Joseph\)\. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of ARO, or the U\.S\. Government\. The U\.S\. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein\.
## References
- \[1\]\(2009\)InCollected Works,pp\. 25–46\.External Links:ISBN 9783642017421,[Link](http://dx.doi.org/10.1007/978-3-642-01742-1_5),[Document](https://dx.doi.org/10.1007/978-3-642-01742-1%5F5)Cited by:[§2](https://arxiv.org/html/2605.06740#S2.p3.3)\.
- \[2\]\(1915\-04\)SOME recent researches on the motion of fluids\.Monthly Weather Review43\(4\),pp\. 163–170\.External Links:ISSN 1520\-0493,[Link](http://dx.doi.org/10.1175/1520-0493(1915)43%3C163:SRROTM%3E2.0.CO;2),[Document](https://dx.doi.org/10.1175/1520-0493%281915%2943%3C163%3Asrrotm%3E2.0.co%3B2)Cited by:[§5\.3](https://arxiv.org/html/2605.06740#S5.SS3.p1.2)\.
- \[3\]J\. BEC and K\. KHANIN\(2007\-08\)Burgers turbulence\.Physics Reports447\(1–2\),pp\. 1–66\.External Links:ISSN 0370\-1573,[Link](http://dx.doi.org/10.1016/j.physrep.2007.04.002),[Document](https://dx.doi.org/10.1016/j.physrep.2007.04.002)Cited by:[§5\.3](https://arxiv.org/html/2605.06740#S5.SS3.p1.2)\.
- \[4\]Blealtan\(2024\)Efficient kan: a memory\-efficient kan implementation\.GitHub\.Note:[https://github\.com/Blealtan/efficient\-kan](https://github.com/Blealtan/efficient-kan)Cited by:[§2\.2](https://arxiv.org/html/2605.06740#S2.SS2.p1.1),[§5](https://arxiv.org/html/2605.06740#S5.p5.1)\.
- \[5\]M\. P\. Bonkile, A\. Awasthi, C\. Lakshmi, V\. Mukundan, and V\. S\. Aswin\(2018\-04\)A systematic literature review of burgers’ equation with recent advances\.Pramana90\(6\)\.External Links:ISSN 0973\-7111,[Link](http://dx.doi.org/10.1007/s12043-018-1559-4),[Document](https://dx.doi.org/10.1007/s12043-018-1559-4)Cited by:[§5\.3](https://arxiv.org/html/2605.06740#S5.SS3.p1.2)\.
- \[6\]Z\. Bozorgasl and H\. Chen\(2024\)Wav\-kan: wavelet kolmogorov\-arnold networks\.arXiv preprint arXiv:2405\.12832\.Cited by:[§2\.2](https://arxiv.org/html/2605.06740#S2.SS2.p1.1)\.
- \[7\]Z\. Bozorgasl and H\. Chen\(2024\)Wav\-kan: wavelet kolmogorov\-arnold networks\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2405.12832),[Link](https://arxiv.org/abs/2405.12832)Cited by:[§5](https://arxiv.org/html/2605.06740#S5.p5.1)\.
- \[8\]J\. Braun and M\. Griebel\(2009\-05\)On a constructive proof of kolmogorov’s superposition theorem\.Constructive Approximation30\(3\),pp\. 653–675\.External Links:ISSN 1432\-0940,[Link](http://dx.doi.org/10.1007/s00365-009-9054-2),[Document](https://dx.doi.org/10.1007/s00365-009-9054-2)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1),[§2](https://arxiv.org/html/2605.06740#S2.p3.3)\.
- \[9\]J\.M\. Burgers\(1948\)A mathematical model illustrating the theory of turbulence\.InAdvances in Applied Mechanics Volume 1,pp\. 171–199\.External Links:ISSN 0065\-2156,[Link](http://dx.doi.org/10.1016/S0065-2156(08)70100-5),[Document](https://dx.doi.org/10.1016/s0065-2156%2808%2970100-5)Cited by:[§5\.3](https://arxiv.org/html/2605.06740#S5.SS3.p1.2)\.
- \[10\]S\. Cuomo, V\. S\. Di Cola, F\. Giampaolo, G\. Rozza, M\. Raissi, and F\. Piccialli\(2022\-07\)Scientific machine learning through physics–informed neural networks: where we are and what’s next\.Journal of Scientific Computing92\(3\)\.External Links:ISSN 1573\-7691,[Link](http://dx.doi.org/10.1007/s10915-022-01939-z),[Document](https://dx.doi.org/10.1007/s10915-022-01939-z)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[11\]G\. Cybenko\(1989\-12\)Approximation by superpositions of a sigmoidal function\.Mathematics of Control, Signals, and Systems2\(4\),pp\. 303–314\.External Links:ISSN 1435\-568X,[Link](http://dx.doi.org/10.1007/BF02551274),[Document](https://dx.doi.org/10.1007/bf02551274)Cited by:[§2](https://arxiv.org/html/2605.06740#S2.p1.4)\.
- \[12\]V\. Dwivedi, N\. Parashar, and B\. Srinivasan\(2021\-01\)Distributed learning machines for solving forward and inverse problems in partial differential equations\.Neurocomputing420,pp\. 299–316\.External Links:ISSN 0925\-2312,[Link](http://dx.doi.org/10.1016/j.neucom.2020.09.006),[Document](https://dx.doi.org/10.1016/j.neucom.2020.09.006)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[13\]D\. Fakhoury, E\. Fakhoury, and H\. Speleers\(2022\)ExSpliNet: an interpretable and expressive spline\-based neural network\.Neural Networks152,pp\. 332–346\.Cited by:[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1)\.
- \[14\]O\. Fuks and H\. A\. Tchelepi\(2020\)LIMITATIONS of physics informed machine learning for nonlinear two\-phase transport in porous media\.Journal of Machine Learning for Modeling and Computing1\(1\),pp\. 19–37\.External Links:ISSN 2689\-3967,[Link](http://dx.doi.org/10.1615/JMachLearnModelComput.2020033905),[Document](https://dx.doi.org/10.1615/jmachlearnmodelcomput.2020033905)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[15\]K\. Funahashi\(1989\-01\)On the approximate realization of continuous mappings by neural networks\.Neural Networks2\(3\),pp\. 183–192\.External Links:ISSN 0893\-6080,[Link](http://dx.doi.org/10.1016/0893-6080(89)90003-8),[Document](https://dx.doi.org/10.1016/0893-6080%2889%2990003-8)Cited by:[§2](https://arxiv.org/html/2605.06740#S2.p1.5)\.
- \[16\]K\. Hornik, M\. Stinchcombe, and H\. White\(1989\-01\)Multilayer feedforward networks are universal approximators\.Neural Networks2\(5\),pp\. 359–366\.External Links:ISSN 0893\-6080,[Link](http://dx.doi.org/10.1016/0893-6080(89)90020-8),[Document](https://dx.doi.org/10.1016/0893-6080%2889%2990020-8)Cited by:[§2](https://arxiv.org/html/2605.06740#S2.p1.5)\.
- \[17\]W\. Ji, W\. Qiu, Z\. Shi, S\. Pan, and S\. Deng\(2021\-08\)Stiff\-pinn: physics\-informed neural network for stiff chemical kinetics\.The Journal of Physical Chemistry A125\(36\),pp\. 8098–8106\.External Links:ISSN 1520\-5215,[Link](http://dx.doi.org/10.1021/acs.jpca.1c05102),[Document](https://dx.doi.org/10.1021/acs.jpca.1c05102)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[18\]B\. Khairullin and S\. Rykovanov\(2026\)Structure\-preserving helmholtz pinns for absorbing media with transparent boundaries\.Communications in Nonlinear Science and Numerical Simulation159,pp\. 109926\.External Links:ISSN 1007\-5704,[Link](https://doi.org/10.1016/j.cnsns.2026.109926),[Document](https://dx.doi.org/10.1016/j.cnsns.2026.109926)Cited by:[§5\.5](https://arxiv.org/html/2605.06740#S5.SS5.p2.2)\.
- \[19\]B\. C\. Koenig, S\. Kim, and S\. Deng\(2024\-07\)KAN\-ODEs: Kolmogorov\-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physics\.Note:arXiv:2407\.04192External Links:[Document](https://dx.doi.org/10.48550/arXiv.2407.0419)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1)\.
- \[20\]A\. N\. Kolmogorov\(1957\)On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition\.Doklady Akademii Nauk SSSR114\(5\),pp\. 953–956\.Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1),[§2](https://arxiv.org/html/2605.06740#S2.p3.3)\.
- \[21\]A\. S\. Krishnapriyan, A\. Gholami, S\. Zhe, R\. Kirby, and M\. W\. Mahoney\(2021\)Characterizing possible failure modes in physics\-informed neural networks\.Advances in Neural Information Processing Systems34\.Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[22\]M\. Lai and Z\. Shen\(2021\)The kolmogorov superposition theorem can break the curse of dimensionality when approximating high dimensional functions\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2112.09963),[Link](https://arxiv.org/abs/2112.09963)Cited by:[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1)\.
- \[23\]P\. Leni, Y\. D\. Fougerolle, and F\. Truchetet\(2013\)The kolmogorov spline network for image processing\.InImage Processing: Concepts, Methodologies, Tools, and Applications,pp\. 54–78\.Cited by:[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1)\.
- \[24\]J\. Lin and R\. Unbehauen\(1993\)On the realization of a kolmogorov network\.Neural Computation5\(1\),pp\. 18–20\.Cited by:[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1)\.
- \[25\]Z\. Liu, Y\. Wang, S\. Vaidya, F\. Ruehle, J\. Halverson, M\. Soljačić, T\. Y\. Hou, and M\. Tegmark\(2024\)KAN: kolmogorov\-arnold networks\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2404.19756),[Link](https://arxiv.org/abs/2404.19756)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1),[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1),[§5](https://arxiv.org/html/2605.06740#S5.p5.1)\.
- \[26\]E\. N\. Lorenz\(1963\-03\)Deterministic nonperiodic flow\.Journal of the Atmospheric Sciences20\(2\),pp\. 130–141\.External Links:ISSN 1520\-0469,[Link](http://dx.doi.org/10.1175/1520-0469(1963)020%3C0130:DNF%3E2.0.CO;2),[Document](https://dx.doi.org/10.1175/1520-0469%281963%29020%3C0130%3Adnf%3E2.0.co%3B2)Cited by:[§5\.4](https://arxiv.org/html/2605.06740#S5.SS4.p1.1)\.
- \[27\]H\. Montanelli and H\. Yang\(2020\)Error bounds for deep relu networks using the kolmogorov–arnold superposition theorem\.Neural Networks129,pp\. 1–6\.Cited by:[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1)\.
- \[28\]J\. O’Leary, J\. A\. Paulson, and A\. Mesbah\(2022\-11\)Stochastic physics\-informed neural ordinary differential equations\.Journal of Computational Physics468,pp\. 111466\.External Links:ISSN 0021\-9991,[Link](http://dx.doi.org/10.1016/j.jcp.2022.111466),[Document](https://dx.doi.org/10.1016/j.jcp.2022.111466)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[29\]G\. Pang, L\. Lu, and G\. E\. Karniadakis\(2019\-01\)FPINNs: fractional physics\-informed neural networks\.SIAM Journal on Scientific Computing41\(4\),pp\. A2603–A2626\.External Links:ISSN 1095\-7197,[Link](http://dx.doi.org/10.1137/18M1229845),[Document](https://dx.doi.org/10.1137/18m1229845)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[30\]S\. Patra, S\. Panda, B\. K\. Parida, M\. Arya, K\. Jacobs, D\. I\. Bondar, and A\. Sen\(2025\)Physics informed kolmogorov\-arnold neural networks for dynamical analysis via efficient\-kan and wav\-kan\.Journal of Machine Learning Research26,pp\. 1–39\.External Links:ISSN 1533\-7928,[Link](https://www.jmlr.org/papers/v26/24-1278.html)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1),[§1](https://arxiv.org/html/2605.06740#S1.p2.1),[§1](https://arxiv.org/html/2605.06740#S1.p5.1),[§2\.2](https://arxiv.org/html/2605.06740#S2.SS2.p1.1),[§5](https://arxiv.org/html/2605.06740#S5.p1.1),[§5](https://arxiv.org/html/2605.06740#S5.p5.1)\.
- \[31\]M\. Raissi, P\. Perdikaris, and G\.E\. Karniadakis\(2019\)Physics\-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations\.Journal of Computational Physics378,pp\. 686–707\.External Links:ISSN 0021\-9991,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.jcp.2018.10.045),[Link](https://www.sciencedirect.com/science/article/pii/S0021999118307125)Cited by:[§5\.2](https://arxiv.org/html/2605.06740#S5.SS2.SSS0.Px2.p1.4)\.
- \[32\]M\. Raissi, P\. Perdikaris, and G\.E\. Karniadakis\(2019\-02\)Physics\-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations\.Journal of Computational Physics378,pp\. 686–707\.External Links:ISSN 0021\-9991,[Link](http://dx.doi.org/10.1016/j.jcp.2018.10.045),[Document](https://dx.doi.org/10.1016/j.jcp.2018.10.045)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[33\]H\. Robinson, S\. Pawar, A\. Rasheed, and O\. San\(2022\-10\)Physics guided neural networks for modelling of non\-linear dynamics\.Neural Networks154,pp\. 333–345\.External Links:ISSN 0893\-6080,[Link](http://dx.doi.org/10.1016/j.neunet.2022.07.023),[Document](https://dx.doi.org/10.1016/j.neunet.2022.07.023)Cited by:[§5\.4](https://arxiv.org/html/2605.06740#S5.SS4.p2.2)\.
- \[34\]L\. Ryder\(2009\-06\)Introduction to general relativity\.Cambridge University Press\.External Links:ISBN 9780511809033,[Link](http://dx.doi.org/10.1017/CBO9780511809033),[Document](https://dx.doi.org/10.1017/cbo9780511809033)Cited by:[§3\.1\.1](https://arxiv.org/html/2605.06740#S3.SS1.SSS1.p1.1)\.
- \[35\]A\. Sen, I\. V\. Lukin, K\. Jacobs, L\. Kaplan, A\. G\. Sotnikov, and D\. I\. Bondar\(2026\-04\)Physics\-informed time series analysis with kolmogorov\-arnold networks under ehrenfest constraints\.Physical Review Research8\(2\),pp\. 023018\.External Links:ISSN 2643\-1564,[Link](https://doi.org/10.1103/84vm-tvzm),[Document](https://dx.doi.org/10.1103/84vm-tvzm)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1),[§1](https://arxiv.org/html/2605.06740#S1.p2.1),[§1](https://arxiv.org/html/2605.06740#S1.p5.1),[§2\.2](https://arxiv.org/html/2605.06740#S2.SS2.p1.1)\.
- \[36\]K\. Shukla, J\. D\. Toscano, Z\. Wang, Z\. Zou, and G\. E\. Karniadakis\(2024\)A comprehensive and fair comparison between mlp and kan representations for differential equations and operator networks\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2406.02917),[Link](https://arxiv.org/abs/2406.02917)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1),[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[37\]S\. Somvanshi, S\. A\. Javed, M\. M\. Islam, D\. Pandit, and S\. Das\(2025\)A survey on kolmogorov\-arnold network\.ACM Computing Surveys,pp\. 1\.Cited by:[§2\.2](https://arxiv.org/html/2605.06740#S2.SS2.p1.1)\.
- \[38\]D\. A\. Sprecher and S\. Draghici\(2002\-01\)Space\-filling curves and kolmogorov superposition\-based neural networks\.Neural Networks15\(1\),pp\. 57–67\.External Links:ISSN 0893\-6080,[Link](http://dx.doi.org/10.1016/s0893-6080(01)00107-1),[Document](https://dx.doi.org/10.1016/s0893-6080%2801%2900107-1)Cited by:[§2\.1](https://arxiv.org/html/2605.06740#S2.SS1.p1.1)\.
- \[39\]Z\. Uddin, S\. Ganga, R\. Asthana, and W\. Ibrahim\(2023\-02\)Wavelets based physics informed neural networks to solve non\-linear differential equations\.Scientific Reports13\(1\)\.External Links:ISSN 2045\-2322,[Link](http://dx.doi.org/10.1038/s41598-023-29806-3),[Document](https://dx.doi.org/10.1038/s41598-023-29806-3)Cited by:[§5\.3](https://arxiv.org/html/2605.06740#S5.SS3.p3.4)\.
- \[40\]O\. Vallee and E\. Moreau\(2007\)THE burgers equation as an electrodynamic model in plasma physics\.High Temperature Material Processes \(An International Quarterly of High\-Technology Plasma Processes\)11\(4\),pp\. 611–617\.External Links:ISSN 1093\-3611,[Link](http://dx.doi.org/10.1615/HighTempMatProc.v11.i4.130),[Document](https://dx.doi.org/10.1615/hightempmatproc.v11.i4.130)Cited by:[§5\.3](https://arxiv.org/html/2605.06740#S5.SS3.p1.2)\.
- \[41\]S\. Wang, S\. Sankaran, H\. Wang, and P\. Perdikaris\(2023\)An expert’s guide to training physics\-informed neural networks\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2308.08468),[Link](https://arxiv.org/abs/2308.08468)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.
- \[42\]Y\. Wang, J\. Sun, J\. Bai, C\. Anitescu, M\. S\. Eshaghi, X\. Zhuang, T\. Rabczuk, and Y\. Liu\(2024\-06\)Kolmogorov Arnold Informed neural network: A physics\-informed deep learning framework for solving PDEs based on Kolmogorov Arnold Networks\.Note:arXiv:2406\.11045 \[cs, math\]External Links:[Link](http://arxiv.org/abs/2406.11045)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p1.1)\.
- \[43\]L\. Yuan, Y\. Ni, X\. Deng, and S\. Hao\(2022\-08\)A\-pinn: auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro\-differential equations\.Journal of Computational Physics462,pp\. 111260\.External Links:ISSN 0021\-9991,[Link](http://dx.doi.org/10.1016/j.jcp.2022.111260),[Document](https://dx.doi.org/10.1016/j.jcp.2022.111260)Cited by:[§1](https://arxiv.org/html/2605.06740#S1.p5.1)\.Similar Articles
Geometry-Aware R-Structured Kolmogorov-Arnold Networks
Proposes Geometry-aware R-Structured KAN (GRS-KAN), a hybrid neural architecture that integrates R-functions into KAN to encode geometric and logical constraints, achieving up to 67% RMSE reduction on regression benchmarks with discontinuities.
SechKAN: Kolmogorov-Arnold Networks with Hyperbolic Secant Functions
SechKAN is a novel Kolmogorov-Arnold Network architecture that uses hyperbolic secant functions as basis functions, achieving competitive performance in function fitting, PDE problems, and image classification tasks while maintaining parameter efficiency comparable to MLPs.
STKAN: Kolmogorov-Arnold Networks for Spatio-Temporal Forecasting
This paper introduces STKAN, a spatio-temporal forecasting architecture that integrates Taylor-polynomial Kolmogorov-Arnold Network modules for spatial and temporal token mixing. Experiments on five traffic benchmarks show competitive performance, suggesting nonlinear function approximators can complement architectural design.
SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bits
SparseKAN is a unified compression method for Kolmogorov–Arnold Networks that prunes basis functions, neurons, and numerical precision under learnable gates, achieving up to 73% parameter reduction and significant latency improvements on software and FPGA hardware.
An Embedded RISC-V Evaluation of Kolmogorov--Arnold Networks in Hard-Constrained Recurrent Physics-Informed Models
This paper evaluates Kolmogorov–Arnold Networks (KANs) versus MLPs as residual branches in hard-constrained recurrent physics-informed networks on an embedded RISC-V platform, finding KANs run slower, consume more energy, and are less dependable under INT8 quantization.