In-span learning: adapting reduced-order models using their own predictions

arXiv cs.LG Papers

Summary

Introduces in-span learning, a method to adapt reduced-order models by streaming the model's own predictions through an incremental singular-value decomposition, reweighting and realigning the basis without changing the subspace. The approach is demonstrated on several dynamical systems and proposed as a computational-science analogue of in-context learning.

arXiv:2607.02937v1 Announce Type: new Abstract: Reduced-order models compress high-dimensional dynamics into low-dimensional representations that can be evaluated rapidly, but they lose accuracy when online dynamics drift beyond the training data. Adaptive methods address this by updating the subspace online with external, out-of-span information, such as full-order corrections or sensor snapshots. We discovered that a complementary and previously unexploited in-span adaptation channel exists within the current reduced subspace. By streaming the model's own predictions through an incremental singular-value decomposition with forgetting, we obtain a trajectory-informed spectral preconditioner, in which the subspace is unchanged but the basis is reweighted and realigned toward the modes visited by the dynamics. This enables the model to absorb future out-of-span corrections more effectively. We expose aspects of this mechanism on a three-dimensional spiral and confirm it on viscous Burgers and Fisher-KPP dynamics. We also discuss how in-span learning can be viewed as a dynamical-systems analogue of in-context learning. More broadly, in-span learning suggests a new principle for computational science, revealing that model-generated trajectories contain more usable information than previously recognized.
Original Article
View Cached Full Text

Cached at: 07/07/26, 04:40 AM

# 1 Introduction
Source: [https://arxiv.org/html/2607.02937](https://arxiv.org/html/2607.02937)
In\-span learning: adapting reduced\-order models using their own predictions

Amirpasha Hedayat1,3,\*\*\*Corresponding author:[ahedayat@umich\.edu](https://arxiv.org/html/2607.02937v1/mailto:[email protected])Laura Balzano2,3Karthik Duraisamy1,3

1Department of Aerospace Engineering 2Department of Electrical Engineering and Computer Science 3Michigan Institute for Computational Discovery and Engineering, University of Michigan, Ann Arbor, MI, USA

Abstract Reduced\-order models compress high\-dimensional dynamics into low\-dimensional representations that can be evaluated rapidly, but they lose accuracy when online dynamics drift beyond the training data\. Adaptive methods address this by updating the subspace online with external,*out\-of\-span*information, such as full\-order corrections or sensor snapshots\. We discovered that a complementary and previously unexploited*in\-span*adaptation channel exists within the current reduced subspace\. By streaming the model’s own predictions through an incremental singular\-value decomposition with forgetting, we obtain a*trajectory\-informed spectral preconditioner*, in which the subspace is unchanged but the basis is reweighted and realigned toward the modes visited by the dynamics\. This enables the model to absorb future out\-of\-span corrections more effectively\. We expose aspects of this mechanism on a three\-dimensional spiral and confirm it on viscous Burgers and Fisher–KPP dynamics\. We also discuss how in\-span learning can be viewed as a dynamical\-systems analogue of in\-context learning\. More broadly, in\-span learning suggests a new principle for computational science, revealing that model\-generated trajectories contain more usable information than previously recognized\.

Keywords:In\-span learning, Spectral preconditioning, Solver acceleration, Adaptive model reduction, Incremental SVD, Subspace tracking\.

This is a preprint of a manuscript submitted to*Nature Computational Science*\. The Supplementary Information of the submitted version is included here as Appendices[A](https://arxiv.org/html/2607.02937#A1)–[E](https://arxiv.org/html/2607.02937#A5)\.

Across science and engineering, applications such as aircraft design\[[1](https://arxiv.org/html/2607.02937#bib.bib1)\], weather forecasting\[[2](https://arxiv.org/html/2607.02937#bib.bib2),[3](https://arxiv.org/html/2607.02937#bib.bib3),[4](https://arxiv.org/html/2607.02937#bib.bib4)\], combustion predictions\[[5](https://arxiv.org/html/2607.02937#bib.bib5)\], power\-grid control\[[6](https://arxiv.org/html/2607.02937#bib.bib6)\], uncertainty quantification\[[7](https://arxiv.org/html/2607.02937#bib.bib7),[8](https://arxiv.org/html/2607.02937#bib.bib8)\], and digital twins\[[9](https://arxiv.org/html/2607.02937#bib.bib9),[10](https://arxiv.org/html/2607.02937#bib.bib10)\]all rely on numerical models that require expensive computations\. There is also a need to run these computations repeatedly across parameters, controls, uncertain inputs, or real\-time decisions\. This setting calls for simulators that are accurate enough to trust and inexpensive enough to use freely\.

Reduced\-order models \(ROMs\) address this need by compressing high\-dimensional simulations into low\-dimensional representations\[[11](https://arxiv.org/html/2607.02937#bib.bib11),[12](https://arxiv.org/html/2607.02937#bib.bib12),[13](https://arxiv.org/html/2607.02937#bib.bib13),[14](https://arxiv.org/html/2607.02937#bib.bib14)\]\. Although a discretized physical model may contain millions of degrees of freedom, its relevant trajectories often occupy a much smaller region of state space\. Projection\-based ROMs exploit this structure by constructing a low\-dimensional subspace, commonly from proper orthogonal decomposition \(POD\) of full\-order snapshots\[[15](https://arxiv.org/html/2607.02937#bib.bib15),[16](https://arxiv.org/html/2607.02937#bib.bib16),[17](https://arxiv.org/html/2607.02937#bib.bib17)\], and evolving only the coordinates of the solution in that subspace\[[18](https://arxiv.org/html/2607.02937#bib.bib18)\]\. When the online dynamics remain close to the training data, this compression can deliver orders\-of\-magnitude speed\-ups\[[21](https://arxiv.org/html/2607.02937#bib.bib21)\]\. The same compression also creates the central failure mode of ROMs\. A static ROM is trained offline and deployed with a fixed basis\. It can interpolate accurately within the regime represented by its snapshots, but it loses predictive power when the online trajectory drifts beyond that regime\. This is a form of distribution shift that exists whether the reduced representation is a linear subspace, a nonlinear manifold\[[23](https://arxiv.org/html/2607.02937#bib.bib23)\], or a learned surrogate\[[22](https://arxiv.org/html/2607.02937#bib.bib22)\]\. For projection\-based ROMs considered in this work, this limitation is especially severe for systems with slowly decaying KolmogorovNN\-width, where no fixed low\-dimensional linear subspace can represent the evolving solution uniformly well over long times\[[24](https://arxiv.org/html/2607.02937#bib.bib24),[25](https://arxiv.org/html/2607.02937#bib.bib25)\]\. Transport\-dominated flows, shocks, moving fronts, combustion, and detonation dynamics are typical examples\[[26](https://arxiv.org/html/2607.02937#bib.bib26),[27](https://arxiv.org/html/2607.02937#bib.bib27),[28](https://arxiv.org/html/2607.02937#bib.bib28),[29](https://arxiv.org/html/2607.02937#bib.bib29),[30](https://arxiv.org/html/2607.02937#bib.bib30)\]\. They are also among the settings where fast predictive simulation would be most valuable\.

Adaptive ROMs attempt to overcome this rigidity by allowing the reduced representation to evolve during the online simulation\. Early efforts included interpolation between locally trained bases\[[31](https://arxiv.org/html/2607.02937#bib.bib31),[32](https://arxiv.org/html/2607.02937#bib.bib32),[33](https://arxiv.org/html/2607.02937#bib.bib33),[34](https://arxiv.org/html/2607.02937#bib.bib34)\]\. More recently, incremental basis approaches have gained attention, where the basis is updated online with newly acquired information\[[35](https://arxiv.org/html/2607.02937#bib.bib35),[36](https://arxiv.org/html/2607.02937#bib.bib36),[37](https://arxiv.org/html/2607.02937#bib.bib37),[38](https://arxiv.org/html/2607.02937#bib.bib38),[39](https://arxiv.org/html/2607.02937#bib.bib39),[40](https://arxiv.org/html/2607.02937#bib.bib40),[41](https://arxiv.org/html/2607.02937#bib.bib41)\]\. A related line of work draws on subspace\-tracking ideas\[[42](https://arxiv.org/html/2607.02937#bib.bib42),[43](https://arxiv.org/html/2607.02937#bib.bib43),[44](https://arxiv.org/html/2607.02937#bib.bib44),[45](https://arxiv.org/html/2607.02937#bib.bib45),[46](https://arxiv.org/html/2607.02937#bib.bib46),[47](https://arxiv.org/html/2607.02937#bib.bib47),[48](https://arxiv.org/html/2607.02937#bib.bib48),[49](https://arxiv.org/html/2607.02937#bib.bib49)\], which have motivated geometric basis updates\[[50](https://arxiv.org/html/2607.02937#bib.bib50)\]and history\-aware adaptation\[[51](https://arxiv.org/html/2607.02937#bib.bib51)\]\. These incremental basis\-updating approaches differ in how they obtain new information and how they update the basis, but they share a common premise\. The basis is adapted using information with a nonzero component outside the current reduced subspace\. This external information may come from a full\-order state, a sensor snapshot, or another correction oracle\. We call such data*out\-of\-span*\. The premise is natural because only out\-of\-span information can move the subspace\. A snapshot that lies exactly inside the current subspace has zero residual and therefore appears, from the usual subspace\-update viewpoint, to add no value\.

In this paper, we show that this reasoning misses a complementary adaptation channel\. Between external corrections, a ROM continuously produces predictions of its own state\. By construction, these predictions lie inside the current reduced subspace, and we therefore call them*in\-span*\. They cannot expand the subspace, but they can still reorganize the representation inside it\. We show that when the ROM’s own predictions are streamed through an incremental singular\-value decomposition \(iSVD\)\[[43](https://arxiv.org/html/2607.02937#bib.bib43),[44](https://arxiv.org/html/2607.02937#bib.bib44),[45](https://arxiv.org/html/2607.02937#bib.bib45)\]with forgetting, they rotate the orthonormal basis within the same subspace and reweight its singular spectrum\. The result is a*trajectory\-informed spectral preconditioner*\. It does not change what the ROM can represent at that instant, but it changes how the basis is prepared to absorb the next external correction\. We refer to the resulting adaptive ROM as*SPIN*, for*SpectralPreconditioning viaIN\-span learning*\([Fig\.˜1](https://arxiv.org/html/2607.02937#S1.F1)\)\. Throughout the paper, we use*baseline adaptive ROM*for the iSVD\-based adaptive model that only uses external out\-of\-span corrections and performs no in\-span updates between correction events\. It is notable that the baseline adaptive ROM is itself representative of the state\-of\-the\-art\[[51](https://arxiv.org/html/2607.02937#bib.bib51)\]\.

![Refer to caption](https://arxiv.org/html/2607.02937v1/x1.png)Figure 1:In\-span learning adapts a reduced\-order model from its own predictions\.Three reduced\-order modeling strategies are shown through their offline/online timelines and the corresponding evolution of the reduced representation\.\(a\)Three\-dimensional spiral prediction comparing the exact full\-order model \(FOM\) trajectory, static ROM, baseline adaptive ROM, and SPIN ROM\.\(b\)A static ROM is trained offline and then deployed online with no adaptation\. Its reduced trajectory remains confined to the original static subspace and can lose track of the full\-order trajectory as the dynamics leave the training regime\.\(c\)A baseline adaptive ROM queries external out\-of\-span information during the online phase, such as a correction snapshotqcorrq\_\{\\mathrm\{corr\}\}, and uses it to move the subspace toward the full\-order dynamics\.\(d\)The proposed SPIN ROM uses the same external correction events, but also streams its own intermediate predictions as in\-span information\. These in\-span updates do not move the subspace by themselves, but they reweight and reorient the basis before the next correction arrives, preparing the reduced representation to absorb out\-of\-span information more effectively\.We develop in\-span learning first at the level of the update mechanism, then in a closed\-form spiral example, and finally in nonlinear PDEs where the same mechanism improves long time\-horizon prediction\. Across these examples, the same conclusion emerges\. Reduced models can learn not only from new data outside their span, but also from the trajectory they have already produced inside it\.

## 2 Results

### 2\.1A hidden adaptation channel inside the current subspace

We start with a brief overview of the in\-span learning mechanism, showing how a model’s own predictions can contribute to its adaptation\. A summary of the notation used throughout the paper is provided in[Appendix˜A](https://arxiv.org/html/2607.02937#A1)\. Consider a ROM with orthonormal basis∈RN×r\\Phi\\in\\mathbb\{R\}^\{N\\times r\}and singular values collected in≔diag​\(σ1,…,σr\)\\Sigma\\coloneqq\\mathrm\{diag\}\(\\sigma\_\{1\},\\ldots,\\sigma\_\{r\}\)\. At any time step, the ROM prediction has the formqROM≔a,q\_\{\\mathrm\{ROM\}\}\\coloneqq\\Phi a,wherea∈Rra\\in\\mathbb\{R\}^\{r\}is the reduced coordinate vector\. This prediction lies exactly in the current reduced subspace, so an iSVD update sees zero orthogonal residual and cannot add a new direction\. The point of in\-span learning is that this zero\-residual snapshot can still change the basis state\. LetC≔2C\\coloneqq\{\}^\{2\}denote the current covariance represented in reduced coordinates\. With forgetting factorγin∈\(0,1\]\\gamma\_\{\\rm in\}\\in\(0,1\], the in\-span iSVD update reduces to a rank\-one update of this reduced covariance,

C\+=γin2​C\+a​a⊤\.C^\{\+\}=\\gamma\_\{\\rm in\}^\{2\}C\+aa^\{\\top\}\.\(1\)Diagonalizing this updated smallr×rr\\times rmatrix,C\+=U​U⊤C^\{\+\}=U\\Lambda U^\{\\top\}, gives the new squared singular values through and an orthogonal rotationU∈Rr×rU\\in\\mathbb\{R\}^\{r\\times r\}of the basis inside the same subspace\. Equivalently,

=\+,1/2=\+U,span\(\)\+=span\(\)\.\{\}^\{\+\}=\{\}^\{1/2\},\\qquad\{\}^\{\+\}=\\Phi U,\\qquad\\mathrm\{span\}\(\{\}^\{\+\}\)=\\mathrm\{span\}\(\\Phi\)\.\(2\)Thus, an in\-span update preserves the geometric object that determines what states the ROM can represent, but changes the spectral object that determines the modal weights\. The formal iSVD update, the derivation of Eq\. \([1](https://arxiv.org/html/2607.02937#S2.E1)\), and the proof of Eq\. \([2](https://arxiv.org/html/2607.02937#S2.E2)\) are given in[Section˜4\.4](https://arxiv.org/html/2607.02937#S4.SS4)and[4\.5](https://arxiv.org/html/2607.02937#S4.SS5)\.

Equation \([1](https://arxiv.org/html/2607.02937#S2.E1)\) gives the mechanism a simple interpretation\. The vectoraarecords which directions of the current basis the ROM trajectory is using\. The update discounts the previous spectral state byγin2\\gamma\_\{\\rm in\}^\{2\}and adds the rank\-one contributiona​a⊤aa^\{\\top\}from the current ROM prediction\. A direction that is strongly represented in the recent trajectory can be reinforced, whereas a direction that receives too little trajectory energy can decay\. The outcome is trajectory\-dependent and controlled by the forgetting factor, which sets the memory horizon of in\-span learning\. Withγin\\gamma\_\{\\rm in\}close to one, the ROM accumulates many recent predictions and reorganizes the basis around sustained dynamics\. With smallerγin\\gamma\_\{\\rm in\}, it emphasizes the most recent trajectory and can rapidly suppress inactive directions\. The reinforcement–suppression threshold is derived in[Section˜4\.5](https://arxiv.org/html/2607.02937#S4.SS5)\.

This in\-span update matters because the adaptive ROMs studied here operate at fixed rank\. When the next external correction arrives, the new out\-of\-span information must be merged with the existing basis and then truncated back to rankrr\. The outcome of that truncation depends not only on the incoming correction, but also on the spectral state and orientation of the basis that receives it\. In\-span learning therefore acts as a trajectory\-informed spectral preconditioner for the next out\-of\-span update\. This mechanism uses no additional full\-order information\. Between external corrections, the ROM already produces the states used in the in\-span update\. The only extra operation is a small SVD in the reduced space, followed by a rotation and reweighting of the existing basis and the usual refresh of basis\-dependent quantities in the hyper\-reduced model when needed\. The cost and implementation details are described in[Section˜4\.9](https://arxiv.org/html/2607.02937#S4.SS9)and[4\.7](https://arxiv.org/html/2607.02937#S4.SS7)\.

### 2\.2A toy example to expose a key mechanism

To illustrate in\-span learning in a simple setting, we begin with a three\-dimensional spiral whose full\-order dynamics are known exactly asq​\(t\)≔\[cos⁡tsin⁡tα​t\]Tq\(t\)\\coloneqq\\begin\{bmatrix\}\\cos t\\quad\\sin t\\quad\\alpha t\\end\{bmatrix\}^\{T\}withα=0\.4\.\\alpha=0\.4\.This trajectory solves an affine linear system inR3\\mathbb\{R\}^\{3\}, which we advance with its exact discrete flow\. The full setup is given in[Section˜4\.1](https://arxiv.org/html/2607.02937#S4.SS1)\.

The initial ROM is deliberately minimal\. We form a rank\-22POD basis0from only two full\-order snapshots,q1q^\{1\}andq2q^\{2\}, and project the exact discrete dynamics onto the resulting plane𝒮0:=span\(\)0=span\(q1,q2\)\\mathcal\{S\}\_\{0\}:=\\mathrm\{span\}\(\{\}\_\{0\}\)=\\mathrm\{span\}\(q^\{1\},q^\{2\}\)\. The static ROM trajectory remains confined to𝒮0\\mathcal\{S\}\_\{0\}and drifts as the true spiral leaves this plane\. This small example already contains the essential failure mode of a static ROM, in which the model can evolve only inside the space it was given\.

The in\-span updates use only the ROM trajectory\. At an intermediate online time stepkk, before the next external correction, the ROM producesqROMk≔ak0∈𝒮0,q^\{k\}\_\{\\mathrm\{ROM\}\}\\coloneqq\{\}\_\{0\}a^\{k\}\\in\\mathcal\{S\}\_\{0\},whereak∈R2a^\{k\}\\in\\mathbb\{R\}^\{2\}is the reduced coordinate vector in the initial basis0\. Letn1,…,nsn\_\{1\},\\ldots,n\_\{s\}denote the time indices of thessin\-span ROM predictions streamed since the previous external correction\. After thesessupdates, the reduced covariance is

Cs=γin2​s\+02\\slimits@j=1sγin2​\(s−j\)anj\(anj\)⊤,C\_\{s\}=\\gamma\_\{\\rm in\}^\{2s\}\{\}\_\{0\}^\{2\}\+\\sumop\\slimits@\_\{j=1\}^\{s\}\\gamma\_\{\\rm in\}^\{2\(s\-j\)\}a^\{n\_\{j\}\}\(a^\{n\_\{j\}\}\)^\{\\top\},\(3\)where0contains the initial singular values associated with0\. We use a small valueγin=0\.1\\gamma\_\{\\rm in\}=0\.1to make the spectral contraction visible in the spiral illustration; in the PDE experiments, the in\-span forgetting factors are chosen≈1\\approx 1\. WritingCs=Us​Us⊤sC\_\{s\}=U\_\{s\}\{\}\_\{s\}U\_\{s\}^\{\\top\}gives the preconditioned singular values through1/2s\{\}\_\{s\}^\{1/2\}and the in\-plane basis rotation through=sUs0,\{\}\_\{s\}=\{\}\_\{0\}U\_\{s\},withspan\(\)s=𝒮0\.\\mathrm\{span\}\(\{\}\_\{s\}\)=\\mathcal\{S\}\_\{0\}\.

[Fig\.˜2](https://arxiv.org/html/2607.02937#S2.F2)shows this effect geometrically\. The full\-order spiral continues in three dimensions, while the ROM trajectory evolves inside the initial rank\-2 plane\. In this particular example, the reduced trajectory repeatedly visits one dominant in\-plane direction while leaving the other nearly inactive\. The covariance ellipse therefore rotates toward the visited direction and contracts along the direction that receives little trajectory energy\. The initial singular values=0diag\(2\.92,0\.25\)\{\}\_\{0\}=\\mathrm\{diag\}\(2\.92,\\;0\.25\)are transformed by four in\-span updates into=SPINdiag\(2\.48,0\.03\)\.\{\}\_\{\\mathrm\{SPIN\}\}=\\mathrm\{diag\}\(2\.48,\\;0\.03\)\.The second singular value is reduced by almost an order of magnitude, while the subspace itself is unchanged\.

![Refer to caption](https://arxiv.org/html/2607.02937v1/x2.png)Figure 2:A closed\-form spiral reveals in\-span spectral preconditioning\.\(a\)The exact full\-order spiral trajectory \(FOM\), the rank\-2 ROM trajectory advanced inside its fixed initial subspace𝒮0\\mathcal\{S\}\_\{0\}, and the growing discrepancy \(error\) between them; the two snapshotsq1,q2q^\{1\},q^\{2\}used to build the initial basis are highlighted, and the grey plane marks𝒮0\\mathcal\{S\}\_\{0\}\.\(b\)–\(e\)Covariance ellipses inside𝒮0\\mathcal\{S\}\_\{0\}afters=1,2,3,4s=1,2,3,4in\-span updates, drawn in the fixed𝒮0\\mathcal\{S\}\_\{0\}coordinate frame with axes alongϕ0,1\\bm\{\\phi\}\_\{0,1\}andϕ0,2\\bm\{\\phi\}\_\{0,2\}\. Each ellipse is set by the eigenvectors and eigenvalues of the reduced covarianceCsC\_\{s\}\. Although the in\-span updates use only ROM\-predicted states lying in𝒮0\\mathcal\{S\}\_\{0\}and therefore add no new direction, the spectrum rotates and contracts\. The active direction is reinforced while the unvisited direction is progressively suppressed\. The subspace is unchanged; only the basis orientation and singular spectrum evolve\.Here, we separate two objects that are often conflated\. The*subspace*determines which states the ROM can represent, while the*spectrum*assigns importance to the directions already present within that subspace\. The in\-span recursion leaves the first object unchanged but modifies the second\. On its own, this cannot correct the ROM, because no new direction has entered the span\. Its effect becomes visible when an out\-of\-span correction later arrives\.

### 2\.3In\-span preconditioning changes how the next correction is absorbed

To receive an out\-of\-span correction without having access to the exact full\-order trajectory, we perform a full\-order operator query\. In the spiral example, the exact one\-step flow is the affine mapqk\+1=G​qk\+cq^\{k\+1\}=Gq^\{k\}\+c, whereGGandccare obtained from the exact spiral dynamics in[Section˜4\.1](https://arxiv.org/html/2607.02937#S4.SS1)\. Starting from the ROM stateqROM5q^\{5\}\_\{\\mathrm\{ROM\}\}, this givesqcorr≔G​qROM5\+c\.q\_\{\\mathrm\{corr\}\}\\coloneqq Gq^\{5\}\_\{\\mathrm\{ROM\}\}\+c\.At the first out\-of\-span correction, this snapshot is identical for the baseline adaptive ROM and the SPIN ROM\. Its residual relative to the initial ROM plane has normρ≔\\\|​qcorr−qcorr00⊤​\\\|2=0\.42,\\rho\\coloneqq\\\|q\_\{\\mathrm\{corr\}\}\-\{\}\_\{0\}\{\}\_\{0\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\\\|\_\{2\}=0\.42,so both methods receive the same out\-of\-span information\. The difference is the basis state that receives it\. In the baseline adaptive ROM, the correction is applied to the original spectrum; in the SPIN ROM, it is applied after the ROM trajectory has preconditioned the spectrum\.

We now show that, in this example, in\-span preconditioning acts as a weak\-mode suppressor\. The ROM trajectory has reduced the strength of a nearly inactive in\-plane direction, so the incoming residual faces a smaller modal competitor when the update is truncated back to rankrr\. To quantify this local rank competition, we compare the residual strengthρ2\\rho^\{2\}with the weakest retained in\-plane direction before the residual is added\. For a correction with in\-plane coefficientsα=qcorrpre⊤\\alpha=\{\}\_\{\\mathrm\{pre\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\}, defineCcorr≔γout2\+pre2αα⊤,C\_\{\\rm corr\}\\coloneqq\\gamma\_\{\\rm out\}^\{2\}\{\}\_\{\\mathrm\{pre\}\}^\{2\}\+\\alpha\\alpha^\{\\top\},which is the in\-plane block of the small iSVD core covariance\. We then define the residual\-to\-weakest\-mode ratioη≔ρ2λr​\(Ccorr\)\.\\eta\\coloneqq\\frac\{\\rho^\{2\}\}\{\\lambda\_\{r\}\(C\_\{\\rm corr\}\)\}\.Here,η≪1\\eta\\ll 1indicates that the residual is weak relative to the existing in\-plane core content, whileη≫1\\eta\\gg 1indicates that it can compete for one of the retained rank\-rrslots\. This ratio is used only as a diagnostic of the local rank competition; the actual truncated update is determined by the full core SVD, which is examined in[Appendix˜B](https://arxiv.org/html/2607.02937#A2)\.

For the same correction snapshot, and withγout=1\.0\\gamma\_\{\\rm out\}=1\.0for simplicity, the baseline adaptive update givesλr​\(Ccorr,baseline\)=1\.45\\lambda\_\{r\}\(C\_\{\\mathrm\{corr,\\,baseline\}\}\)=1\.45andηbaseline≈0\.12,\\eta\_\{\\mathrm\{baseline\}\}\\approx 0\.12,whereas the SPIN update givesλr​\(Ccorr,SPIN\)=0\.05\\lambda\_\{r\}\(C\_\{\\mathrm\{corr,\\,SPIN\}\}\)=0\.05andηSPIN≈3\.67\.\\eta\_\{\\mathrm\{SPIN\}\}\\approx 3\.67\.The residual norm has not changed\. The increase inη\\etacomes from the denominator, meaning that the same residual now competes against a much smaller in\-plane core direction\.

The geometric outcome is shown in[Fig\.˜3](https://arxiv.org/html/2607.02937#S2.F3)\. With out\-of\-span adaptation alone, the updated plane changes only modestly and the new residual is mostly discarded\. With in\-span preconditioning, the updated plane swings toward the new local direction of the spiral\. Quantitatively, enabling in\-span learning increases the residual capture from0\.260\.26to0\.800\.80and the plane\-change angle from15\.06∘15\.06^\{\\circ\}to53\.29∘53\.29^\{\\circ\}, while decreasing the correction error from1\.02×10−21\.02\\times 10^\{\-2\}to8\.84×10−48\.84\\times 10^\{\-4\}\. These diagnostics are defined in[Section˜4\.8](https://arxiv.org/html/2607.02937#S4.SS8)\. Full numerical details for the spiral example are provided in[Appendix˜B](https://arxiv.org/html/2607.02937#A2), and a comparison with several alternative fixed\-rank basis updates is available in[Appendix˜C](https://arxiv.org/html/2607.02937#A3)\.

![Refer to caption](https://arxiv.org/html/2607.02937v1/x3.png)Figure 3:The same correction is better absorbed after in\-span preconditioning\.Both adaptive ROMs receive the same correctionqcorrq\_\{\\mathrm\{corr\}\}and use the same truncated iSVD update; only the incoming basis state differs\.\(a,b\)Baseline adaptive and SPIN updates\. In\-span preconditioning rotates and reweights the basis before the correction arrives, so the post\-update plane swings more strongly toward the local dynamics\.\(c\)Modal slot competition, including correction energy,λr​\(C\)\\lambda\_\{r\}\(C\), andη=ρ2/λr​\(C\)\\eta=\\rho^\{2\}/\\lambda\_\{r\}\(C\)\.\(d\)Residual capture, plane\-change angle, and correction error\. In this spiral example, in\-span preconditioning suppresses inactive modal content so the same residual can occupy the weak slot of the fixed\-rank basis\.
### 2\.4SPIN improves nonlinear PDE prediction

The spiral example isolates the mechanism, but it does not test whether the same effect survives the numerical ingredients of a practical ROM\. We therefore consider two nonlinear PDEs, namely viscous Burgers and Fisher–KPP, solved with implicit time integration and hyper\-reduced \(via QDEIM\[[52](https://arxiv.org/html/2607.02937#bib.bib52),[53](https://arxiv.org/html/2607.02937#bib.bib53)\]\) least\-squares Petrov–Galerkin \(LSPG\)\[[54](https://arxiv.org/html/2607.02937#bib.bib54),[19](https://arxiv.org/html/2607.02937#bib.bib19)\]ROMs\. This setting tests in\-span learning within a broadly used framework for nonlinear scientific simulation\. Viscous Burgers dynamics tests transport of a coherent structure, while Fisher–KPP reaction–diffusion tests front propagation and saturation driven by a nonlinear reaction term\. In both cases, all reduced models are initialized from a negligible offline training phase, so the comparison is deliberately extrapolative\.

For both PDEs we compare the full\-order model, a static ROM, the baseline adaptive ROM, and the proposed SPIN ROM\. The two adaptive ROMs use the same rank, QDEIM sample count, correction interval, and full\-order operator query mechanism to receive the correction snapshot\. The only algorithmic difference is that SPIN also updates its basis and singular values between external corrections using the ROM’s own intermediate predictions\. The full discretizations, LSPG–QDEIM formulation, correction procedure, and hyperparameters are given in[Section˜4\.2](https://arxiv.org/html/2607.02937#S4.SS2)and[4\.6](https://arxiv.org/html/2607.02937#S4.SS6)\.

For each adaptive model, the forgetting factors reported here are selected from an ablation sweep that minimizes the mean relativeL2L\_\{2\}error over the online trajectory\. Thus, the comparison is between optimized memory configurations of the two adaptive strategies\. For Burgers, the best baseline adaptive ROM usesγout=0\.01\\gamma\_\{\\rm out\}=0\.01, while the best SPIN ROM uses\(γin,γout\)=\(1\.0,0\.25\)\(\\gamma\_\{\\rm in\},\\gamma\_\{\\rm out\}\)=\(1\.0,0\.25\)\. For Fisher–KPP, the corresponding values areγout=0\.1\\gamma\_\{\\rm out\}=0\.1and\(γin,γout\)=\(0\.9,0\.25\)\(\\gamma\_\{\\rm in\},\\gamma\_\{\\rm out\}\)=\(0\.9,0\.25\)\. The full forgetting\-factor ablations, correction\-interval sweeps, and additional PDE robustness tests are reported in[Appendix˜D](https://arxiv.org/html/2607.02937#A4), with the benchmark parameters summarized in[Appendix˜E](https://arxiv.org/html/2607.02937#A5)for reproduction purposes\.

[Fig\.˜4](https://arxiv.org/html/2607.02937#S2.F4)shows Burgers predictions, where we use a rank\-44ROM withm=4m=4QDEIM sample points, trained from only the first four full\-order snapshots fromt=0t=0tot=0\.004t=0\.004, and evaluated over a500500\-step prediction horizon fromt=0t=0tot=0\.50t=0\.50, with out\-of\-span corrections everyzs=10z\_\{s\}=10time steps\. The static ROM fails quickly because its basis represents only the early offline regime\. The baseline adaptive ROM performs substantially better and follows the advecting pulse reasonably well, showing that the external corrections supply useful missing directions\. Adding the in\-span channel further reduces amplitude and shape errors as the pulse moves across the domain, and the SPIN error remains consistently below the baseline adaptive error without adding full\-order correction steps\.

Fisher–KPP in[Fig\.˜5](https://arxiv.org/html/2607.02937#S2.F5)provides a more demanding test\. A localized initial pulse grows through the reaction term, develops two traveling fronts, and eventually saturates over much of the domain\. We again use a rank\-44LSPG–QDEIM ROM withm=4m=4sample points, trained from only the first four full\-order snapshots fromt=0t=0tot=0\.004t=0\.004, and evaluated over a500500\-step prediction horizon fromt=0t=0tot=0\.50t=0\.50, with out\-of\-span corrections everyzs=25z\_\{s\}=25time steps\. The static ROM misses the expanding front after the solution leaves the training window\. The baseline ROM improves on the static model, but develops visible oscillations in the saturated region and front\-location errors\. In contrast, the SPIN ROM follows both the plateau and the moving fronts more closely, with a larger separation between the adaptive error curves than in Burgers\.

![Refer to caption](https://arxiv.org/html/2607.02937v1/x4.png)Figure 4:SPIN ROM improves viscous Burgers prediction\.Viscous Burgers dynamics with rankr=4r=4andm=4m=4QDEIM sample points\. The offline basis is trained on the initial44time steps fromt=0t=0tot=0\.004t=0\.004, while prediction is evaluated over500500time steps fromt=0t=0tot=0\.50t=0\.50, with external corrections everyzs=10z\_\{s\}=10steps\.\(a\)Solution profilesu​\(x,t\)u\(x,t\)at four reported times\. The static ROM remains tied to the early training regime and drifts away from the transported pulse\. The baseline adaptive ROM follows the FOM more closely, while the SPIN ROM further reduces the amplitude and shape errors\.\(b\)RelativeL2L\_\{2\}error over time\. Faint vertical marks indicate the out\-of\-span correction events\. The SPIN ROM uses the same rank, sample count, correction interval, and number of full\-order correction steps as the baseline adaptive ROM, but maintains a lower error throughout the trajectory\.![Refer to caption](https://arxiv.org/html/2607.02937v1/x5.png)Figure 5:SPIN ROM improves Fisher–KPP front propagation\.Fisher–KPP reaction–diffusion dynamics with rankr=4r=4andm=4m=4QDEIM sample points\. The offline basis is trained on the initial44time steps fromt=0t=0tot=0\.004t=0\.004, while prediction is evaluated over500500time steps fromt=0t=0tot=0\.50t=0\.50, with external corrections everyzs=25z\_\{s\}=25steps\.\(a\)Solution profilesu​\(x,t\)u\(x,t\)at four reported times\. The static ROM misses the expanding fronts after the solution leaves the training window\. The baseline adaptive ROM improves on the static model but develops oscillations in the saturated region, while the SPIN ROM tracks the plateau and moving fronts more closely\.\(b\)Space–time fields and error\. The FOM, baseline adaptive ROM, and SPIN ROM are shown as fields over\(x,t\)\(x,t\), together with the relativeL2L\_\{2\}error history and pointwise absolute error fields\. The SPIN ROM produces a visibly cleaner space–time structure and substantially smaller error over most of the trajectory\.
### 2\.5Spectral diagnostics confirm the in\-span mechanism

The PDE results show that SPIN adaptation improves prediction\. We next examine whether the same spectral mechanism identified in the spiral also appears in these nonlinear systems\. We therefore measure three diagnostics that separate modal reweighting, in\-plane basis rotation, and genuine subspace motion, computed along the online trajectory for the baseline adaptive and SPIN ROMs\. These results are shown in[Fig\.˜6](https://arxiv.org/html/2607.02937#S2.F6)for both PDEs\.

The first diagnostic is the time history of the singular values carried by the adaptive basis\. In a baseline adaptive ROM, these values change only at external correction events\. In a SPIN ROM, they are updated at every intermediate step by the ROM trajectory itself, directly reflecting the reduced covariance update in Eq\. \([1](https://arxiv.org/html/2607.02937#S2.E1)\)\. Unlike the first spiral correction, where one nearly inactive direction is strongly suppressed, the PDE spectra show richer trajectory\-dependent behavior, where several retained modes are repeatedly reinforced between correction events\. This is consistent withγin≈1\.0\\gamma\_\{\\rm in\}\\approx 1\.0for Burgers and Fisher–KPP, which imply little or no in\-span forgetting\. The diagnostic message is therefore that successful in\-span learning makes the spectral state trajectory\-informed\.

The second diagnostic measures basis reorientation through\\\|​I−\\\|Fk\+1⊤k\.\\left\\\|I\-\{\}\_\{k\+1\}^\{\\top\}\{\}\_\{k\}\\right\\\|\_\{F\}\.This quantity is sensitive to changes in the orthonormal coordinate frame\. It can be nonzero even when the two bases span essentially the same subspace\. For the baseline adaptive ROM, the diagnostic is zero between correction events and spikes when an external correction updates the basis\. For the SPIN ROM, it remains nonzero throughout the intervals between corrections\. This confirms that the ROM predictions are not merely rescaling singular values, and they continuously rotate the basis inside the current subspace\.

The third diagnostic isolates genuine subspace change\. We compute the principal anglesθi\\theta\_\{i\}between consecutive subspaces from the singular values ofk\+1k⊤\{\}\_\{k\}^\{\\top\}\{\}\_\{k\+1\}and reportmaxi⁡sin⁡θi\.\\max\_\{i\}\\sin\\theta\_\{i\}\.This quantity is insensitive to a pure rotation of the coordinate frame inside the same subspace\. Between external corrections, it remains close to numerical zero for the SPIN ROM, confirming that in\-span updates preserve the subspace up to numerical precision\. At correction events, it jumps for both adaptive models, because only then does out\-of\-span information enter\. The jump is not identical for the two methods, showing that the same type of external event acts on different preconditioned basis states\.

![Refer to caption](https://arxiv.org/html/2607.02937v1/x6.png)Figure 6:The algebraic fingerprints of in\-span learning in nonlinear ROMs\.Diagnostics for\(a\)Burgers and\(b\)Fisher–KPP, comparing the baseline adaptive and SPIN ROMs\. Panels\(i\),\(ii\),\(iv\)and\(v\)show the retained singular valuesσ1,…,σ4\\sigma\_\{1\},\\ldots,\\sigma\_\{4\}\. Panel\(iii\)shows basis reorientation,\\\|​𝐈−\\\|Fk\+1⊤k\\\|\\mathbf\{I\}\-\{\}\_\{k\+1\}^\{\\top\}\{\}\_\{k\}\\\|\_\{F\}\. Panel\(vi\)shows genuine subspace motion,maxi⁡sin⁡θi\\max\_\{i\}\\sin\\theta\_\{i\}\. In\-span updates continuously reshape and rotate the basis inside an essentially fixed subspace, while out\-of\-span corrections supply the geometric motion\.

## 3 Discussion

Projection\-based ROMs are usually described by their subspace\. That description is correct, but incomplete\. A reduced model also carries a basis spectrum, and in fixed\-rank adaptive ROMs this spectrum shapes how future updates allocate limited modal capacity\. We showed that these two objects can be adapted by different information streams\. Out\-of\-span corrections move the subspace because they contain directions the ROM cannot currently represent, while in\-span predictions reorganize the spectral state inside the existing subspace\. This separation reveals a hidden degree of freedom in adaptive model reduction\. We demonstrated in\-span learning first on a closed\-form spiral, where in\-span update acts as a weak\-mode suppressor, and then on Burgers and Fisher–KPP dynamics, where the same in\-span channel improves hyper\-reduced nonlinear ROM predictions\. Across these examples, the common theme is trajectory awareness\. The ROM’s own predictions are not merely outputs; they are information about how the current representation is being used\.

Several insights follow from this view:

- •In\-span predictions carry adaptive information\.Although they cannot move the trial subspace, they can rotate and reweight the directions inside it\.
- •Spectral preconditioning is memory\-controlled\.In a low\-memory regime, it can suppress inactive directions and open modal capacity, as in the spiral\. In high\-memory regimes, it can instead reinforce several retained modes while still making the basis trajectory\-informed\.
- •In\-span and out\-of\-span learning are complementary\.External corrections supply missing directions, while in\-span updates prepare the spectral state on which those corrections act\.
- •The gains are obtained without additional full\-order queries\.The SPIN ROM uses the same external correction schedule as the baseline adaptive model, but changes how the available information is organized and used\.

These results also clarify where the present framework can be improved\. External information remains necessary, because in\-span updates cannot create directions absent from the current reduced subspace and cannot rescue a ROM whose trajectory is already a poor guide to the local dynamics\. The correction interval and forgetting factors are also decided before the simulation and remain fixed during the online prediction, whereas future methods could choose when to request out\-of\-span information and how strongly to forget based on online indicators such as residual growth or spectral drift\. Higher\-dimensional flows, multiphysics systems, and noisy or partial observations remain important research directions to investigate\.

We can also draw a connection between in\-span learning and in\-context learning in large language models\[[55](https://arxiv.org/html/2607.02937#bib.bib55),[56](https://arxiv.org/html/2607.02937#bib.bib56),[57](https://arxiv.org/html/2607.02937#bib.bib57)\]\. This connection is not just an analogy\. In the linear\-attention view of sequence models, attention layers maintain a state matrix updated by rank\-one outer products of internally generated representations, often discounted by a gate, and use that state to adapt their outputs without changing trained weights\[[58](https://arxiv.org/html/2607.02937#bib.bib58),[59](https://arxiv.org/html/2607.02937#bib.bib59)\]\. The in\-span update has the same basic skeleton\. It accumulates a stateCCfrom outer productsak​ak⊤a\_\{k\}a\_\{k\}^\{\\top\}of the model’s own reduced coordinates, discounts that state byγin2\\gamma\_\{\\rm in\}^\{2\}, and uses it to reorganize a fixed representation\. The shared structure is test\-time adaptation through a decaying outer\-product accumulator over self\-generated representations\. Adaptive ROMs may therefore provide a low\-rank dynamical\-systems setting in which to study how a fixed representation is reorganized by its own context\.

More broadly, in\-span learning extends beyond linear ROMs\. It suggests that linear ROMs, nonlinear manifold models, and scientific machine\-learning surrogates in general may all carry useful self\-generated information in their evolving trajectories, creating an unexploited route toward more adaptive computational models\.

## 4 Methods

### 4\.1Full\-order models and time discretization

We consider three dynamical systems\. The first is a closed\-form spiral inR3\\mathbb\{R\}^\{3\}, providing a detailed and transparent view of the mechanism\. The second and third are nonlinear partial differential equations, namely viscous Burgers dynamics and Fisher–KPP reaction–diffusion, used to test the same mechanism in more practical settings\.

At the fully discrete level, the full\-order model is written as a nonlinear time\-stepping problem for a stateqn∈RNq^\{n\}\\in\\mathbb\{R\}^\{N\}at timetnt\_\{n\},

Rn​\(qn;qn−1\)=0,R^\{n\}\(q^\{n\};q^\{n\-1\}\)=0,\(4\)whereRn:RN→RNR^\{n\}:\\mathbb\{R\}^\{N\}\\rightarrow\\mathbb\{R\}^\{N\}denotes the residual of the chosen time discretization\. For the PDE benchmarks, we use implicit backward Euler,

Rn​\(qn;qn−1\)≔qn−qn−1−t​f​\(qn\),R^\{n\}\(q^\{n\};q^\{n\-1\}\)\\coloneqq q^\{n\}\-q^\{n\-1\}\-\\Delta t\\,f\(q^\{n\}\),\(5\)whereffis the semi\-discrete spatial operator\. The nonlinear system \([5](https://arxiv.org/html/2607.02937#S4.E5)\) is solved by Newton iterations in the full\-order model \(FOM\) and by a sampled least\-squares problem in the ROM\.

The spiral test case is defined by the exact trajectory

q​\(t\)≔\[cos⁡tsin⁡tα​t\],α=0\.4\.q\(t\)\\coloneqq\\begin\{bmatrix\}\\cos t\\\\ \\sin t\\\\ \\alpha t\\end\{bmatrix\},\\qquad\\alpha=0\.4\.\(6\)This trajectory solves the affine linear system

qdot=A​q\+b,A≔\[0−10100000\],b≔\[00α\]\.\\dot\{q\}=Aq\+b,\\qquad A\\coloneqq\\begin\{bmatrix\}0&\-1&0\\\\ 1&0&0\\\\ 0&0&0\\end\{bmatrix\},\\qquad b\\coloneqq\\begin\{bmatrix\}0\\\\ 0\\\\ \\alpha\\end\{bmatrix\}\.\(7\)For time stept=0\.35\\Delta t=0\.35, the exact discrete map is

qk\+1=G​qk\+c,G≔exp⁡\(A​t\),c≔\[00α​t\]\.q^\{k\+1\}=Gq^\{k\}\+c,\\qquad G\\coloneqq\\exp\(A\\Delta t\),\\qquad c\\coloneqq\\begin\{bmatrix\}0\\\\ 0\\\\ \\alpha\\Delta t\\end\{bmatrix\}\.\(8\)The simulation begins att0=4\.0t\_\{0\}=4\.0\. Because Eq\. \([8](https://arxiv.org/html/2607.02937#S4.E8)\) is exact, the spiral experiment contains no time\-integration error\. All discrepancies between the FOM and ROM are therefore caused by the reduced representation and its updates\.

The Burgers benchmark follows the one\-dimensional viscous Burgers equation

∂tu\+u​∂xu=ν​∂x​xu,x∈\[0,1\],\\partial\_\{t\}u\+u\\,\\partial\_\{x\}u=\\nu\\,\\partial\_\{xx\}u,\\qquad x\\in\[0,1\],\(9\)with periodic boundary conditions and viscosityν=10−2\\nu=10^\{\-2\}\. The spatial domain is discretized withNx=1000N\_\{x\}=1000uniform grid points\. The convective term is approximated by a first\-order upwind finite\-difference scheme and the diffusive term by a centred second\-order method\. Time integration uses backward Euler witht=10−3\\Delta t=10^\{\-3\}over a horizon of500500time steps to propagate a Gaussian initial condition\.

The Fisher–KPP benchmark is

∂tu=D​∂x​xu\+β​u​\(1−u\),x∈\[0,1\],\\partial\_\{t\}u=D\\,\\partial\_\{xx\}u\+\\beta u\(1\-u\),\\qquad x\\in\[0,1\],\(10\)with periodic boundary conditions, diffusion coefficientD=10−4D=10^\{\-4\}, and reaction rateβ=20\\beta=20\. The spatial domain is discretized withNx=256N\_\{x\}=256uniform grid points using centred finite differences\. Time integration again uses backward Euler witht=10−3\\Delta t=10^\{\-3\}over500500time steps\. Starting from a localized pulse, the solution develops travelling fronts and then saturates towardu≈1u\\approx 1over much of the domain\.

### 4\.2Reduced\-order representation

All ROMs use an affine, scaled trial representation of the full\-order state,

qn≈qref\+D−1​an,q^\{n\}\\approx q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\\Phi a^\{n\},\(11\)whereqref∈RNq\_\{\\mathrm\{ref\}\}\\in\\mathbb\{R\}^\{N\}is a reference state,D∈RN×ND\\in\\mathbb\{R\}^\{N\\times N\}is a nonsingular diagonal scaling matrix,∈RN×r\\Phi\\in\\mathbb\{R\}^\{N\\times r\}is an orthonormal basis, andan∈Rra^\{n\}\\in\\mathbb\{R\}^\{r\}is the reduced coordinate vector\. The rank satisfiesr≪Nr\\ll N\.

The initial basis is constructed from a short training snapshot matrix

Xtrain≔\[q1−qrefq2−qref⋯qNs−qref\],X\_\{\\mathrm\{train\}\}\\coloneqq\\begin\{bmatrix\}q^\{1\}\-q\_\{\\mathrm\{ref\}\}&q^\{2\}\-q\_\{\\mathrm\{ref\}\}&\\cdots&q^\{N\_\{s\}\}\-q\_\{\\mathrm\{ref\}\}\\end\{bmatrix\},\(12\)whereNsN\_\{s\}is the number of training snapshots\. After scaling, we compute

D​Xtrain=U​V⊤,DX\_\{\\mathrm\{train\}\}=U\\Sigma V^\{\\top\},\(13\)and set equal to the firstrrleft singular vectors\. In all PDE experiments reported in the main text, the offline window contains only four FOM snapshots and the ROM rank isr=4r=4\. The static ROM therefore represents a deliberately minimal offline model, while the adaptive ROMs are tested in a genuinely extrapolative setting\.

For the spiral, the dynamics are linear and the discrete flow is known exactly, so we use a simple Galerkin projection\. The initial rank\-2 basis0is obtained from the two snapshotsq1q^\{1\}andq2q^\{2\}\. The reduced state satisfies

an\+1=Aran\+cr,Ar≔G0⊤,0cr≔c0⊤,a^\{n\+1\}=A\_\{r\}a^\{n\}\+c\_\{r\},\\qquad A\_\{r\}\\coloneqq\{\}\_\{0\}^\{\\top\}G\{\}\_\{0\},\\qquad c\_\{r\}\\coloneqq\{\}\_\{0\}^\{\\top\}c,\(14\)with initial coordinatea2=D0⊤​\(q2−qref\)a^\{2\}=\{\}\_\{0\}^\{\\top\}D\(q^\{2\}\-q\_\{\\mathrm\{ref\}\}\)\. The corresponding ROM state is

qROMn≔qref\+D−1​an0\.q^\{n\}\_\{\\mathrm\{ROM\}\}\\coloneqq q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\{\}\_\{0\}a^\{n\}\.\(15\)Note that in the spiral results, we take a zero reference stateqrefq\_\{\\mathrm\{ref\}\}and an identity scaling matrixDDfor simplicity\. Since the basis is rank two, the ROM trajectory remains in the initial plane

𝒮0≔span\(\)0\.\\mathcal\{S\}\_\{0\}\\coloneqq\\mathrm\{span\}\(\{\}\_\{0\}\)\.\(16\)
For Burgers and Fisher–KPP, since the full\-order models utilize implicit temporal integration, we use a least\-squares Petrov–Galerkin \(LSPG\)\[[54](https://arxiv.org/html/2607.02937#bib.bib54),[19](https://arxiv.org/html/2607.02937#bib.bib19)\]formulation at the fully discrete level\. Substituting the reduced ansatz \([11](https://arxiv.org/html/2607.02937#S4.E11)\) into the FOM residual gives the reduced least\-squares problem

an=arg⁡mina^∈Rr​\\\|​D​Rn​\(qref\+D−1​a^;qROMn−1\)​\\\|22\.a^\{n\}=\\underset\{\\mathaccent 866\{a\}\\in\\mathbb\{R\}^\{r\}\}\{\\arg\\min\}\\left\\\|D\\,R^\{n\}\\left\(q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\\Phi\\mathaccent 866\{a\};q^\{n\-1\}\_\{\\mathrm\{ROM\}\}\\right\)\\right\\\|\_\{2\}^\{2\}\.\(17\)HereqROMn−1≔qref\+D−1​an−1q^\{n\-1\}\_\{\\mathrm\{ROM\}\}\\coloneqq q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\\Phi a^\{n\-1\}is the previous ROM state\. This LSPG formulation minimizes the fully discrete residual and is well\-suited to implicit time stepping\.

To reduce the online cost, we use QDEIM hyper\-reduction\[[52](https://arxiv.org/html/2607.02937#bib.bib52),[53](https://arxiv.org/html/2607.02937#bib.bib53)\]\. LetS∈RN×mS\\in\\mathbb\{R\}^\{N\\times m\}be a sampling matrix that selectsmmresidual entries, withm≪Nm\\ll N\. The sampled LSPG problem is

an=arg⁡mina^∈Rr​\\\|​S⊤​D​Rn​\(qref\+D−1​a^;qROMn−1\)​\\\|22\.a^\{n\}=\\underset\{\\mathaccent 866\{a\}\\in\\mathbb\{R\}^\{r\}\}\{\\arg\\min\}\\left\\\|S^\{\\top\}D\\,R^\{n\}\\left\(q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\\Phi\\mathaccent 866\{a\};q^\{n\-1\}\_\{\\mathrm\{ROM\}\}\\right\)\\right\\\|\_\{2\}^\{2\}\.\(18\)The sample indices are chosen by QDEIM through a column\-pivoted QR factorization of⊤\. In the PDE experiments, we usem=4m=4sample points\.

### 4\.3Information channels in an adaptive ROM

The adaptive ROM receives two kinds of snapshots, distinguished by their relationship to the current reduced subspace\.

###### Definition 1\(Out\-of\-span and in\-span snapshots\)\.

Let∈RN×r\\Phi\\in\\mathbb\{R\}^\{N\\times r\}be the current orthonormal basis, and lety∈RNy\\in\\mathbb\{R\}^\{N\}be a preprocessed snapshot passed to a basis update\. Define the projection coefficient, residual, and residual norm by

w≔y⊤,ry≔y−w,ρ≔\\\|​ry​\\\|2\.w\\coloneqq\{\}^\{\\top\}y,\\qquad r\_\{y\}\\coloneqq y\-\\Phi w,\\qquad\\rho\\coloneqq\\\|r\_\{y\}\\\|\_\{2\}\.\(19\)The snapshot is*in\-span*ifρ=0\\rho=0, equivalentlyy∈span​\(\)y\\in\\mathrm\{span\}\(\\Phi\)\. It is*out\-of\-span*ifρ\>0\\rho\>0\.

In the algorithms studied here, out\-of\-span snapshots are generated by occasional full\-order operator queries\. These snapshots may contain components not represented by the current basis and can therefore move the trial subspace\. In\-span snapshots are the ROM’s own predicted states\. They satisfyy=ay=\\Phi aby construction and therefore cannot introduce a new direction\. The next Methods subsections show that, despite this zero residual, in\-span snapshots still update the spectral state of the basis through the singular values and in\-plane rotations of an iSVD update\.

### 4\.4iSVD update with forgetting

The online basis update used throughout the paper is an iSVD with forgetting\. The update maintains a rank\-rrapproximation of an exponentially weighted snapshot history\.

###### Definition 2\(Truncated iSVD update with forgetting\[[43](https://arxiv.org/html/2607.02937#bib.bib43),[44](https://arxiv.org/html/2607.02937#bib.bib44),[45](https://arxiv.org/html/2607.02937#bib.bib45)\]\)\.

Let∈RN×r\\Phi\\in\\mathbb\{R\}^\{N\\times r\}be an orthonormal basis, let=diag​\(σ1,…,σr\)\\Sigma=\\mathrm\{diag\}\(\\sigma\_\{1\},\\ldots,\\sigma\_\{r\}\)contain the retained singular values associated with , and lety∈RNy\\in\\mathbb\{R\}^\{N\}be a preprocessed incoming snapshot\. Define the projection coefficient, residual, and residual norm as in Eq\. \([19](https://arxiv.org/html/2607.02937#S4.E19)\)\. Ifρ\>0\\rho\>0, setr^≔ry/ρ\\mathaccent 866\{r\}\\coloneqq r\_\{y\}/\\rho\. For a forgetting factorγ∈\(0,1\]\\gamma\\in\(0,1\], form the core matrix

K≔\[γw0⊤ρ\]∈R\(r\+1\)×\(r\+1\)\.K\\coloneqq\\begin\{bmatrix\}\\gamma\\Sigma&w\\\\ 0^\{\\top\}&\\rho\\end\{bmatrix\}\\in\\mathbb\{R\}^\{\(r\+1\)\\times\(r\+1\)\}\.\(20\)Let

K=UK​VK⊤KK=U\_\{K\}\{\}\_\{K\}V\_\{K\}^\{\\top\}\(21\)be its singular\-value decomposition, with singular values in non\-increasing order, obtained from the eigendecomposition of the full core covariance

K​K⊤=\[γ2\+2ww⊤ρ​wρ​w⊤ρ2\]=UK​UK⊤K2\.KK^\{\\top\}=\\begin\{bmatrix\}\\gamma^\{2\}\{\}^\{2\}\+ww^\{\\top\}&\\rho w\\\\ \\rho w^\{\\top\}&\\rho^\{2\}\\end\{bmatrix\}=U\_\{K\}\{\}\_\{K\}^\{2\}U\_\{K\}^\{\\top\}\.\(22\)The rank\-rrupdate is

=\+\[r^\]UK\(:,1:r\),=\+\(1:r,1:r\)K\.\{\}^\{\+\}=\\begin\{bmatrix\}\\Phi&\\mathaccent 866\{r\}\\end\{bmatrix\}U\_\{K\}\(:,1:r\),\\qquad\{\}^\{\+\}=\{\}\_\{K\}\(1:r,1:r\)\.\(23\)Ifρ=0\\rho=0, the residual direction is not defined and the update is interpreted through the reduced core described later in[Theorem˜3](https://arxiv.org/html/2607.02937#Thmstatement3)\.

The update in[Definition˜2](https://arxiv.org/html/2607.02937#Thmstatement2)is equivalent to appending the new snapshot to a weighted history matrix\. LetYkY\_\{k\}denote the exponentially weighted data matrix containing the snapshots assimilated up to update stepkk,

Yk≔\[γk−1​y1γk−2​y2⋯γ​yk−1yk\]\.Y\_\{k\}\\coloneqq\\begin\{bmatrix\}\\gamma^\{k\-1\}y\_\{1\}&\\gamma^\{k\-2\}y\_\{2\}&\\cdots&\\gamma y\_\{k\-1\}&y\_\{k\}\\end\{bmatrix\}\.The current rank\-rrrepresentation approximates this weighted data matrix byYk≈V⊤Y\_\{k\}\\approx\\Phi\\Sigma V^\{\\top\}\. Receiving a new snapshotyygives the augmented weighted history

Yk\+1=\[γ​Yky\]\.Y\_\{k\+1\}=\\begin\{bmatrix\}\\gamma Y\_\{k\}&y\\end\{bmatrix\}\.
The small matrixKKin Eq\. \([20](https://arxiv.org/html/2607.02937#S4.E20)\) contains all information needed to update the left singular vectors of this augmented matrix\. The forgetting factorγ\\gammadiscounts previous information before the new snapshot is added, and acts as a memory valve in this sense\.

Equivalently, the update tracks the dominant eigenspace of an exponentially weighted second\-moment matrix\. IfMk≔Yk​Yk⊤M\_\{k\}\\coloneqq Y\_\{k\}Y\_\{k\}^\{\\top\}denotes the weighted second\-moment matrix in the ambient coordinates, then the weighted\-history update gives

Mk\+1=γ2​Mk\+y​y⊤\.M\_\{k\+1\}=\\gamma^\{2\}M\_\{k\}\+yy^\{\\top\}\.\(24\)

### 4\.5In\-span learning preserves the subspace and reorganizes the spectrum

We now specialize[Definition˜2](https://arxiv.org/html/2607.02937#Thmstatement2)to the case in which the incoming snapshot is a ROM prediction\. In scaled coordinates, such a snapshot has the form

y=a,a∈Rr\.y=\\Phi a,\\qquad a\\in\\mathbb\{R\}^\{r\}\.\(25\)Hence, according to Eq\. \([19](https://arxiv.org/html/2607.02937#S4.E19)\),w=aw=a,ry=0r\_\{y\}=0, andρ=0\\rho=0\. No new ambient direction can be added\. Nevertheless, the singular values and the coordinate frame inside the subspace can change\.

###### Theorem 3\(Subspace\-preserving spectral preconditioning by in\-span learning\)\.

Let∈RN×r\\Phi\\in\\mathbb\{R\}^\{N\\times r\}be orthonormal, let=diag​\(σ1,…,σr\)\\Sigma=\\mathrm\{diag\}\(\\sigma\_\{1\},\\ldots,\\sigma\_\{r\}\), and lety=ay=\\Phi abe an in\-span snapshot\. Applying the iSVD update with forgetting factorγin∈\(0,1\]\\gamma\_\{\\rm in\}\\in\(0,1\]gives

=\+U,=\+,1/2\{\}^\{\+\}=\\Phi U,\\qquad\{\}^\{\+\}=\{\}^\{1/2\},\(26\)whereU∈Rr×rU\\in\\mathbb\{R\}^\{r\\times r\}is orthogonal and

UU⊤=γin2\+2aa⊤\.U\\Lambda U^\{\\top\}=\\gamma\_\{\\rm in\}^\{2\}\{\}^\{2\}\+aa^\{\\top\}\.\(27\)Consequently,

span\(\)\+=span\(\)\.\\mathrm\{span\}\(\{\}^\{\+\}\)=\\mathrm\{span\}\(\\Phi\)\.\(28\)The singular values obey the rank\-one interlacing inequalities

σ1\+≥γin​σ1≥σ2\+≥⋯≥γin​σr−1≥σr\+≥γin​σr\.\\sigma\_\{1\}^\{\+\}\\geq\\gamma\_\{\\rm in\}\\sigma\_\{1\}\\geq\\sigma\_\{2\}^\{\+\}\\geq\\cdots\\geq\\gamma\_\{\\rm in\}\\sigma\_\{r\-1\}\\geq\\sigma\_\{r\}^\{\+\}\\geq\\gamma\_\{\\rm in\}\\sigma\_\{r\}\.\(29\)

###### Proof\.

For an in\-span snapshot,y=ay=\\Phi a\. Thereforew=y⊤=aw=\{\}^\{\\top\}y=aandρ=0\\rho=0\. The core matrix in Eq\. \([20](https://arxiv.org/html/2607.02937#S4.E20)\) has zero last row,

K=\[γina0⊤0\]\.K=\\begin\{bmatrix\}\\gamma\_\{\\rm in\}\\Sigma&a\\\\ 0^\{\\top\}&0\\end\{bmatrix\}\.\(30\)Its nonzero singular values are the singular values of the reduced matrix

Kin=\[γina\]∈Rr×\(r\+1\)\.K\_\{\\mathrm\{in\}\}=\\begin\{bmatrix\}\\gamma\_\{\\rm in\}\\Sigma&a\\end\{bmatrix\}\\in\\mathbb\{R\}^\{r\\times\(r\+1\)\}\.\(31\)Since

KinKin⊤=γin2\+2aa⊤,K\_\{\\mathrm\{in\}\}K\_\{\\mathrm\{in\}\}^\{\\top\}=\\gamma\_\{\\rm in\}^\{2\}\{\}^\{2\}\+aa^\{\\top\},\(32\)the left singular vectors ofKinK\_\{\\mathrm\{in\}\}are the eigenvectors of the reduced covariance in Eq\. \([27](https://arxiv.org/html/2607.02937#S4.E27)\)\. The updated basis is therefore=\+U\{\}^\{\+\}=\\Phi Ufor an orthogonal matrixUU, which proves subspace preservation\. The interlacing inequalities follow from Cauchy’s interlacing theorem for a positive semidefinite rank\-one perturbation of the diagonal matrixγin22\\gamma\_\{\\rm in\}^\{2\}\{\}^\{2\}\. ∎

Afterssconsecutive in\-span updates with reduced coordinatesan1,…,ansa^\{n\_\{1\}\},\\ldots,a^\{n\_\{s\}\}, the reduced covariance is

Cs=γin2​s\+02\\slimits@j=1sγin2​\(s−j\)anj\(anj\)⊤\.C\_\{s\}=\\gamma\_\{\\rm in\}^\{2s\}\{\}\_\{0\}^\{2\}\+\\sumop\\slimits@\_\{j=1\}^\{s\}\\gamma\_\{\\rm in\}^\{2\(s\-j\)\}a^\{n\_\{j\}\}\(a^\{n\_\{j\}\}\)^\{\\top\}\.\(33\)This is the covariance recursion used in the spiral example\. It shows explicitly how the ROM trajectory reshapes the spectrum\. Directions aligned with recent coefficient vectors can receive repeated rank\-one reinforcement, while directions receiving little trajectory energy can be suppressed by forgetting\. Here, we say that a direction is*reinforced*if its post\-update directional energy exceeds its pre\-update value, and*suppressed*if its post\-update directional energy is smaller\.

###### Definition 4\(Directional reinforcement and suppression\)\.

Letξ∈Rr\\xi\\in\\mathbb\{R\}^\{r\}be a unit direction in the current, pre\-update reduced coordinates\. For an in\-span update with reduced coordinateaa, define the pre\-update and post\-update directional energies by

Eξ≔ξ⊤ξ2,Eξ\+≔ξ⊤\(γin2\+2aa⊤\)ξ\.E\_\{\\xi\}\\coloneqq\\xi^\{\\top\}\{\}^\{2\}\\xi,\\qquad E\_\{\\xi\}^\{\+\}\\coloneqq\\xi^\{\\top\}\\left\(\\gamma\_\{\\rm in\}^\{2\}\{\}^\{2\}\+aa^\{\\top\}\\right\)\\xi\.\(34\)We say that the fixed pre\-update directionξ\\xiis*reinforced*ifEξ\+\>EξE\_\{\\xi\}^\{\+\}\>E\_\{\\xi\}and*suppressed*ifEξ\+<EξE\_\{\\xi\}^\{\+\}<E\_\{\\xi\}\.

Using Eq\. \([34](https://arxiv.org/html/2607.02937#S4.E34)\),

Eξ\+−Eξ=\(ξ⊤​a\)2−\(1−γin2\)​Eξ\.E\_\{\\xi\}^\{\+\}\-E\_\{\\xi\}=\(\\xi^\{\\top\}a\)^\{2\}\-\(1\-\\gamma\_\{\\rm in\}^\{2\}\)E\_\{\\xi\}\.\(35\)Therefore the fixed pre\-update directionξ\\xiis reinforced if

\|ξ⊤​a\|\>1−γin2​Eξ,\|\\xi^\{\\top\}a\|\>\\sqrt\{1\-\\gamma\_\{\\rm in\}^\{2\}\}\\,\\sqrt\{E\_\{\\xi\}\},\(36\)and suppressed if the inequality is reversed\. In particular, for a pre\-update singular\-vector directioneie\_\{i\},

Eei\+−Eei=ai2−\(1−γin2\)​σi2,E\_\{e\_\{i\}\}^\{\+\}\-E\_\{e\_\{i\}\}=a\_\{i\}^\{2\}\-\(1\-\\gamma\_\{\\rm in\}^\{2\}\)\\sigma\_\{i\}^\{2\},\(37\)so that this pre\-update direction is reinforced when

\|ai\|\>1−γin2​σi,\|a\_\{i\}\|\>\\sqrt\{1\-\\gamma\_\{\\rm in\}^\{2\}\}\\,\\sigma\_\{i\},\(38\)and suppressed when\|ai\|\|a\_\{i\}\|falls below this threshold\.

This analysis also shows that in\-span spectral preconditioning does not always appear as suppression of the weakest mode\. If the ROM trajectory has enough projected energy in a direction to exceed the threshold, that direction is reinforced even under forgetting\. If the projected energy falls below the threshold, the direction decays\. The spiral example with aggressive forgetting realizes the latter case for one nearly inactive direction, whereas the PDE examples show richer regimes with less forgetting in which several retained directions are reinforced while the basis still rotates and reweights\.

### 4\.6Full\-order operator query

The out\-of\-span channel requires occasional information that is not constrained to the current reduced subspace\. In this work, that information is supplied by a full\-order operator query\. The idea is to let the ROM advance the system most of the time, and to call the full\-order model only at selected correction events\.

Suppose an out\-of\-span event is triggered at time stepn\+1n\+1\. Before the correction, the ROM has produced the state

qROMn≔qref\+D−1​an\.q^\{n\}\_\{\\mathrm\{ROM\}\}\\coloneqq q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\\Phi a^\{n\}\.\(39\)We then initialize one full\-order step from this ROM state and solve

Rn\+1​\(qcorrn\+1;qROMn\)=0\.R^\{n\+1\}\\left\(q^\{n\+1\}\_\{\\mathrm\{corr\}\};q^\{n\}\_\{\\mathrm\{ROM\}\}\\right\)=0\.\(40\)The resulting stateqcorrn\+1q^\{n\+1\}\_\{\\mathrm\{corr\}\}is used as the external correction snapshot\. In scaled coordinates,

ycorr≔D​\(qcorrn\+1−qref\)\.y\_\{\\mathrm\{corr\}\}\\coloneqq D\\left\(q^\{n\+1\}\_\{\\mathrm\{corr\}\}\-q\_\{\\mathrm\{ref\}\}\\right\)\.\(41\)This snapshot is then passed to the out\-of\-span iSVD update with forgetting factorγout\\gamma\_\{\\rm out\}\.

This correction is different from a coarse full\-order lookahead trajectory previously used in\[[51](https://arxiv.org/html/2607.02937#bib.bib51)\]\. A coarse\-FOM oracle advances an auxiliary full\-order state on a larger time step and uses that state as the correction signal\. The full\-order operator query used here instead takes a single fine\-grid full\-order step from the current ROM state\. We use it because it gives a simple hybrid model, where the reduced model carries the trajectory most of the time and occasionally interacts with the full\-order operator to receive a local out\-of\-span correction snapshot\.

For the spiral example, Eq\. \([40](https://arxiv.org/html/2607.02937#S4.E40)\) reduces to one exact full\-order map applied to the ROM state,

qcorr≔G​qROMn\+c\.q\_\{\\mathrm\{corr\}\}\\coloneqq Gq^\{n\}\_\{\\mathrm\{ROM\}\}\+c\.\(42\)For the PDE benchmarks, Eq\. \([40](https://arxiv.org/html/2607.02937#S4.E40)\) is solved with the same backward\-Euler residual used by the FOM, but only at the correction times\.

### 4\.7SPIN algorithm

The complete adaptive procedure \([Algorithm˜1](https://arxiv.org/html/2607.02937#alg1)\) alternates between three operations\. First, the ROM advances one time step using the current basis and sample set\. Second, if the step is not an external correction time, the ROM\-predicted state is used for an in\-span update with forgetting factorγin\\gamma\_\{\\rm in\}\. Third, everyzsz\_\{s\}steps, a full\-order operator query is performed, and the produced snapshot is used for an out\-of\-span update with forgetting factorγout\\gamma\_\{\\rm out\}\.

After any basis update, basis\-dependent quantities must be refreshed\. For the LSPG–QDEIM ROMs, this includes the sampled basis and its pseudoinverse\. After an out\-of\-span update, the QDEIM sample indices are recomputed\. After an in\-span update, the subspace is unchanged but the basis vectors have rotated inside it, so the sampled operators depending on the basis are refreshed\. The reduced coordinates are also transferred to the updated basis by projecting the current reconstructed ROM state onto the new basis\.

Algorithm 1SPIN ROM algorithm1:Initial basis , singular values

σ\\sigma, reference state

qrefq\_\{\\mathrm\{ref\}\}, scaling matrix

DD, sample matrix

SS, reduced state

a0a^\{0\}, update interval

zsz\_\{s\}, forgetting factors

γin\\gamma\_\{\\rm in\}and

γout\\gamma\_\{\\rm out\}, final step

NtN\_\{t\}
2:for

n=0,1,…,Nt−1n=0,1,\\ldots,N\_\{t\}\-1do

3:Advance the sampled ROM one step:

an\+1←ROM\_Step\(,S,an\)a^\{n\+1\}\\leftarrow\\mathrm\{ROM\\\_Step\}\(\\Phi,S,a^\{n\}\)
4:Reconstruct the ROM state:

qROMn\+1←qref\+D−1​an\+1q^\{n\+1\}\_\{\\mathrm\{ROM\}\}\\leftarrow q\_\{\\mathrm\{ref\}\}\+D^\{\-1\}\\Phi a^\{n\+1\}
5:if

\(n\+1\)modzs=0\(n\+1\)\\bmod z\_\{s\}=0then⊳\\trianglerightout\-of\-span adaptation

6:Perform one full\-order operator query:

Rn\+1​\(qcorrn\+1;qROMn\)=0R^\{n\+1\}\\left\(q^\{n\+1\}\_\{\\mathrm\{corr\}\};q^\{n\}\_\{\\mathrm\{ROM\}\}\\right\)=0
7:Preprocess the correction:

y←D​\(qcorrn\+1−qref\)y\\leftarrow D\(q^\{n\+1\}\_\{\\mathrm\{corr\}\}\-q\_\{\\mathrm\{ref\}\}\)
8:Update the basis and singular values by out\-of\-span iSVD:

\(,σ\)←iSVD\(,σ,y,γout\)\(\\Phi,\\sigma\)\\leftarrow\\mathrm\{iSVD\}\(\\Phi,\\sigma,y,\\gamma\_\{\\rm out\}\)
9:Recompute QDEIM sample matrix

SSand sampled operators\.

10:else⊳\\trianglerightin\-span adaptation

11:Preprocess the ROM prediction:

y←D​\(qROMn\+1−qref\)y\\leftarrow D\(q^\{n\+1\}\_\{\\mathrm\{ROM\}\}\-q\_\{\\mathrm\{ref\}\}\)
12:Update the basis and singular values by in\-span iSVD:

\(,σ\)←iSVD\(,σ,y,γin\)\(\\Phi,\\sigma\)\\leftarrow\\mathrm\{iSVD\}\(\\Phi,\\sigma,y,\\gamma\_\{\\rm in\}\)
13:Refresh sampled operators\.

14:endif

15:Transfer the current state to the updated basis:

an\+1←D⊤​\(qROMn\+1−qref\)a^\{n\+1\}\\leftarrow\{\}^\{\\top\}D\(q^\{n\+1\}\_\{\\mathrm\{ROM\}\}\-q\_\{\\mathrm\{ref\}\}\)
16:endfor

The baseline adaptive ROM used for comparison can be obtained from[Algorithm˜1](https://arxiv.org/html/2607.02937#alg1)by omitting the in\-span update in theelsebranch\. The static ROM is obtained by omitting both in\-span and out\-of\-span updates\. The implementation used in this work is available at[https://github\.com/APHedayat/SPIN](https://github.com/APHedayat/SPIN)\.

### 4\.8Metrics and diagnostics

We use two groups of diagnostics\. The first group measures how a single out\-of\-span correction is absorbed by a fixed\-rank update\. Letpreandpostdenote the orthonormal bases immediately before and after the correction update, and letqcorrq\_\{\\mathrm\{corr\}\}be the correction snapshot\. The out\-of\-span residual relative to the pre\-update subspace is

r≔qcorr−qcorrprepre⊤,rhat≔r/\\\|​r​\\\|2\.r\\coloneqq q\_\{\\mathrm\{corr\}\}\-\{\}\_\{\\mathrm\{pre\}\}\{\}\_\{\\mathrm\{pre\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\},\\qquad\\hat\{r\}\\coloneqq r/\\\|r\\\|\_\{2\}\.\(43\)The residual capture is

χres≔\\\|​rhatpost⊤​\\\|2,\\chi\_\{\\mathrm\{res\}\}\\coloneqq\\\|\{\}\_\{\\mathrm\{post\}\}^\{\\top\}\\hat\{r\}\\\|\_\{2\},\(44\)which measures how much of the new residual direction lies in the post\-update subspace\. The plane\-change angle is the largest principal angle between the pre\- and post\-update subspaces,

θplane≔maxiarccos\(ζi\(\)pre⊤post\),\\theta\_\{\\mathrm\{plane\}\}\\coloneqq\\max\_\{i\}\\arccos\\\!\\left\(\\zeta\_\{i\}\(\{\}\_\{\\mathrm\{pre\}\}^\{\\top\}\{\}\_\{\\mathrm\{post\}\}\)\\right\),\(45\)whereζi​\(⋅\)\\zeta\_\{i\}\(\\cdot\)are singular values\. The correction error is

ecorr≔\\\|​qcorr−qcorrpostpost⊤​\\\|2\.e\_\{\\mathrm\{corr\}\}\\coloneqq\\left\\\|q\_\{\\mathrm\{corr\}\}\-\{\}\_\{\\mathrm\{post\}\}\{\}\_\{\\mathrm\{post\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\\right\\\|\_\{2\}\.\(46\)This measures the part of the correction snapshot not represented by the updated subspace\.

The second group of diagnostics measures how the adaptive basis, spectrum, and subspace evolve over the online trajectory\. The first trajectory diagnostic is the singular\-value history,

σ1n,…,σrn\.\\sigma\_\{1\}^\{n\},\\ldots,\\sigma\_\{r\}^\{n\}\.\(47\)These values measure how the adaptive algorithm weights the retained modes\. In the baseline adaptive ROM, they change only at correction events\. In the SPIN ROM, they may change at every time step\.

The second trajectory diagnostic measures basis reorientation between consecutive steps,

dbasisn≔\\\|I−\(\)n\+1⊤\\\|Fn\.d\_\{\\mathrm\{basis\}\}^\{n\}\\coloneqq\\left\\\|I\-\\left\(\{\}^\{n\+1\}\\right\)^\{\\top\}\{\}^\{n\}\\right\\\|\_\{F\}\.\(48\)This quantity is sensitive to changes in the orthonormal frame\. It can be nonzero even when the two bases span the same subspace\.

The third trajectory diagnostic measures genuine subspace change\. Let the singular values of

\(\)n⊤n\+1\\left\(\{\}^\{n\}\\right\)^\{\\top\}\{\}^\{n\+1\}\(49\)bes1,…,srs\_\{1\},\\ldots,s\_\{r\}, withsi=cos⁡θis\_\{i\}=\\cos\\theta\_\{i\}, whereθi\\theta\_\{i\}are the principal angles between the two subspaces\. We report

dsubspacen≔maxi⁡sin⁡θi=1−mini⁡si2\.d\_\{\\mathrm\{subspace\}\}^\{n\}\\coloneqq\\max\_\{i\}\\sin\\theta\_\{i\}=\\sqrt\{1\-\\min\_\{i\}s\_\{i\}^\{2\}\}\.\(50\)This diagnostic is zero when the subspace is unchanged, even if the basis has rotated inside that subspace\. The combination of nonzerodbasisnd\_\{\\mathrm\{basis\}\}^\{n\}and zerodsubspacend\_\{\\mathrm\{subspace\}\}^\{n\}is therefore the numerical signature of a pure in\-span update\.

### 4\.9Computational complexity

The additional cost of in\-span learning is small compared with the cost of obtaining out\-of\-span information from the full\-order operator\. LetNNbe the full\-order dimension,rrthe ROM rank, andmmthe number of sampled residual entries, withr,m≪Nr,m\\ll N\.

We first define the cost of one hyper\-reduced LSPG time step\. A sampled LSPG step solves a nonlinear least\-squares problem inrrunknowns using onlymmsampled residual entries\. Let𝒞eval\(m\)\\mathcal\{C\}\_\{\\mathrm\{eval\}\}^\{\(m\)\}denote the cost of evaluating the sampled residual and sampled Jacobian contributions required by one Newton iteration\. Once these sampled quantities are available, the dense reduced linear algebra scales as

𝒞LSPG≔𝒞eval\(m\)\+𝒪​\(m​r2\+r3\)\\mathcal\{C\}\_\{\\mathrm\{LSPG\}\}\\coloneqq\\mathcal\{C\}\_\{\\mathrm\{eval\}\}^\{\(m\)\}\+\\mathcal\{O\}\(mr^\{2\}\+r^\{3\}\)\(51\)per Newton iteration\. Thus, between correction events, the online simulation remains reduced and sampled\.

The cost of an iSVD basis update is roughly similar for in\-span and out\-of\-span snapshots\. For a general out\-of\-span snapshot, the update projects the snapshot onto the current basis, forms the orthogonal residual, computes the SVD of a small\(r\+1\)×\(r\+1\)\(r\+1\)\\times\(r\+1\)core matrix, and rotates the ambient basis\. The dominant scaling is

𝒞iSVDout≔𝒪​\(N​r2\+r3\)\.\\mathcal\{C\}\_\{\\mathrm\{iSVD\}\}^\{\\mathrm\{out\}\}\\coloneqq\\mathcal\{O\}\(Nr^\{2\}\+r^\{3\}\)\.\(52\)For an in\-span snapshot, the orthogonal residual is zero and the update can be performed through the reduced covariance in Eq\. \([27](https://arxiv.org/html/2607.02937#S4.E27)\)\. This avoids the residual construction, but the small eigendecomposition and the ambient basis rotation remain\. Therefore, the in\-span update costs as

𝒞iSVDin≔𝒪​\(N​r2\+r3\)\.\\mathcal\{C\}\_\{\\mathrm\{iSVD\}\}^\{\\mathrm\{in\}\}\\coloneqq\\mathcal\{O\}\(Nr^\{2\}\+r^\{3\}\)\.\(53\)The in\-span update can be cheaper in implementations that delay the ambient rotation and accumulate the transformation in reduced coordinates, but in the implementation considered for PDE cases the leading order is the same as for an out\-of\-span iSVD update\.

Basis changes may also require refreshing hyper\-reduction quantities\. We denote this cost by𝒞refresh\\mathcal\{C\}\_\{\\mathrm\{refresh\}\}\. If QDEIM sampling points are recomputed from a pivoted QR factorization of⊤, then

𝒞QDEIM≔𝒪​\(N​r2\)\.\\mathcal\{C\}\_\{\\mathrm\{QDEIM\}\}\\coloneqq\\mathcal\{O\}\(Nr^\{2\}\)\.\(54\)In\-span updates preserve the trial subspace, so one may keep the same sampling set between out\-of\-span corrections and update only the sampled basis\-dependent quantities\. If the sampling points are recomputed after every basis rotation, then the same𝒞QDEIM\\mathcal\{C\}\_\{\\mathrm\{QDEIM\}\}cost applies\.

The bottleneck in the adaptive procedure is the full\-order operator query used to obtain an out\-of\-span correction\. For implicit PDE solvers, this query requires nonlinear iterations, residual and Jacobian evaluations, and large linear solves\. We write its cost as

𝒞FOM≔𝒪​\(Nβ\),β\>1,\\mathcal\{C\}\_\{\\mathrm\{FOM\}\}\\coloneqq\\mathcal\{O\}\(N^\{\\beta\}\),\\qquad\\beta\>1,\(55\)whereβ\\betadepends on the discretization, nonlinear solver, linear solver, preconditioner, and sparsity structure\. This term is typically much larger than the reduced dense linear algebra whenNNis large andr,m≪Nr,m\\ll N\.

With these ingredients, the cost of one in\-span update is

𝒞in≔𝒞iSVDin\+𝒞refreshin,\\mathcal\{C\}\_\{\\mathrm\{in\}\}\\coloneqq\\mathcal\{C\}\_\{\\mathrm\{iSVD\}\}^\{\\mathrm\{in\}\}\+\\mathcal\{C\}\_\{\\mathrm\{refresh\}\}^\{\\mathrm\{in\}\},\(56\)whereCrefreshinC\_\{\\mathrm\{refresh\}\}^\{\\mathrm\{in\}\}denotes any update of sampled basis\-dependent quantities performed after the in\-span rotation\. The cost of one out\-of\-span correction event is

𝒞out≔𝒞FOM\+𝒞iSVDout\+𝒞QDEIM\+𝒞refreshout,\\mathcal\{C\}\_\{\\mathrm\{out\}\}\\coloneqq\\mathcal\{C\}\_\{\\mathrm\{FOM\}\}\+\\mathcal\{C\}\_\{\\mathrm\{iSVD\}\}^\{\\mathrm\{out\}\}\+\\mathcal\{C\}\_\{\\mathrm\{QDEIM\}\}\+\\mathcal\{C\}\_\{\\mathrm\{refresh\}\}^\{\\mathrm\{out\}\},\(57\)where𝒞refreshout\\mathcal\{C\}\_\{\\mathrm\{refresh\}\}^\{\\mathrm\{out\}\}denotes the remaining basis\-dependent reduced\-operator or sampled\-operator updates\.

The key comparison is that the SPIN ROM uses the same out\-of\-span correction schedule as the baseline adaptive ROM\. It therefore does not add any𝒞FOM\\mathcal\{C\}\_\{\\mathrm\{FOM\}\}terms\. If the correction interval iszsz\_\{s\}, then between two out\-of\-span corrections the SPIN model adds

\(zs−1\)​𝒞in\(z\_\{s\}\-1\)\\mathcal\{C\}\_\{\\mathrm\{in\}\}\(58\)relative to the baseline adaptive model, but it does not change the number of full\-order operator queries\. In the large\-scale implicit PDE regime,𝒞FOM=𝒪​\(Nβ\)\\mathcal\{C\}\_\{\\mathrm\{FOM\}\}=\\mathcal\{O\}\(N^\{\\beta\}\)is the dominant cost, whereas the in\-span operations are reduced or low\-rank dense linear algebra\.

## Data availability

The data supporting the findings of this work are available from the corresponding author upon request\.

## Code availability

## Acknowledgements

A\.H\.andK\.D\.were supported by the Office of Under Secretary of Defense for Research and Engineering \(OUSD\(RE\)\) grant N00014\-21\-1\-295\.L\.B\.acknowledges NSF award CCF\-2331590 and ARO award W911NF\-26\-1\-A219\.

## Author contributions

A\.H\.:Methodology, Software, Investigation, Data Curation, Writing \- Original Draft, Visualization\.L\.B\.:Conceptualization, Methodology, Writing \- Review & Editing, Supervision\.K\.D\.:Conceptualization, Methodology, Investigation, Writing \- Review & Editing, Supervision, Funding acquisition\.

## Competing interests

The authors declare no competing interests\.

## References

- \[1\]Lyu, Z\., Kenway, G\. K\. W\. & Martins, J\. R\. R\. A\. Aerodynamic shape optimization investigations of the Common Research Model wing benchmark\.*AIAA J\.*53, 968–985 \(2015\)\.
- \[2\]Lam, R\.*et al\.*Learning skillful medium\-range global weather forecasting\.*Science*382, 1416–1421 \(2023\)\.
- \[3\]Kochkov, D\.*et al\.*Neural general circulation models for weather and climate\.*Nature*632, 1060–1066 \(2024\)\.
- \[4\]Bodnar, C\.*et al\.*A foundation model for the Earth system\.*Nature*641, 1180–1187 \(2025\)\.
- \[5\]Swischuk, R\., Kramer, B\., Huang, C\. & Willcox, K\. Learning physics\-based reduced\-order models for a single\-injector combustion process\.*AIAA J\.*58, 2658–2672 \(2020\)\.
- \[6\]Khaloie, H\.*et al\.*Review of machine learning techniques for optimal power flow\.*Appl\. Energy*388, 125637 \(2025\)\.
- \[7\]Xiu, D\. & Karniadakis, G\. E\. Modeling uncertainty in flow simulations via generalized polynomial chaos\.*J\. Comput\. Phys\.*187, 137–167 \(2003\)\.
- \[8\]Degen, D\., Cacace, M\. & Wellmann, F\. 3D multi\-physics uncertainty quantification using physics\-based machine learning\.*Sci\. Rep\.*12, 17491 \(2022\)\.
- \[9\]Niederer, S\. A\., Sacks, M\. S\., Girolami, M\. & Willcox, K\. Scaling digital twins from the artisanal to the industrial\.*Nat\. Comput\. Sci\.*1, 313–320 \(2021\)\.
- \[10\]Kapteyn, M\. G\., Pretorius, J\. V\. R\. & Willcox, K\. E\. A probabilistic graphical model foundation for enabling predictive digital twins at scale\.*Nat\. Comput\. Sci\.*1, 337–347 \(2021\)\.
- \[11\]Antoulas, A\. C\.*Approximation of Large\-Scale Dynamical Systems*\(SIAM, Philadelphia, 2005\)\.
- \[12\]Rowley, C\. W\. & Dawson, S\. T\. M\. Model reduction for flow analysis and control\.*Annu\. Rev\. Fluid Mech\.*49, 387–417 \(2017\)\.
- \[13\]Antoulas, A\. C\., Beattie, C\. A\. & Gügercin, S\.*Interpolatory Methods for Model Reduction*\(SIAM, Philadelphia, 2020\)\.
- \[14\]Kramer, B\., Peherstorfer, B\. & Willcox, K\. Learning nonlinear reduced models from data with operator inference\.*Annu\. Rev\. Fluid Mech\.*56, 521–548 \(2024\)\.
- \[15\]Lumley, J\. L\. The structure of inhomogeneous turbulent flows\. In Yaglom, A\. M\. & Tatarski, V\. I\. \(eds\.\)*Atmospheric Turbulence and Radio Wave Propagation*, 166–178 \(Nauka, Moscow, 1967\)\.
- \[16\]Sirovich, L\. Turbulence and the dynamics of coherent structures\. I–III\.*Quart\. Appl\. Math\.*45, 561–590 \(1987\)\.
- \[17\]Holmes, P\., Lumley, J\. L\. & Berkooz, G\.*Turbulence, Coherent Structures, Dynamical Systems and Symmetry*\(Cambridge Univ\. Press, Cambridge, 1996\)\.
- \[18\]Benner, P\., Gugercin, S\. & Willcox, K\. A survey of projection\-based model reduction methods for parametric dynamical systems\.*SIAM Review*57, 483–531 \(2015\)\.
- \[19\]Carlberg, K\., Barone, M\. & Antil, H\. Galerkin v\. least\-squares Petrov–Galerkin projection in nonlinear model reduction\.*J\. Comput\. Phys\.*330, 693–734 \(2017\)\.
- \[20\]Peherstorfer, B\. & Willcox, K\. Data\-driven operator inference for nonintrusive projection\-based model reduction\.*Comput\. Methods Appl\. Mech\. Eng\.*306, 196–215 \(2016\)\.
- \[21\]Huang, C\., Duraisamy, K\. & Merkle, C\. L\. Component\-based reduced order modeling of large\-scale complex systems\.*Front\. Phys\.*10, 900064 \(2022\)\.
- \[22\]Lee, K\. & Carlberg, K\. T\. Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders\.*J\. Comput\. Phys\.*404, 108973 \(2020\)\.
- \[23\]Geelen, R\., Wright, S\. & Willcox, K\. Operator inference for non\-intrusive model reduction with quadratic manifolds\.*Comput\. Methods Appl\. Mech\. Eng\.*403, 115717 \(2023\)\.
- \[24\]Peherstorfer, B\. Breaking the Kolmogorov barrier with nonlinear model reduction\.*Not\. Am\. Math\. Soc\.*69, 725–733 \(2022\)\.
- \[25\]Barnett, J\. & Farhat, C\. Quadratic approximation manifold for mitigating the Kolmogorov barrier in nonlinear projection\-based model order reduction\.*J\. Comput\. Phys\.*464, 111348 \(2022\)\.
- \[26\]Reiss, J\., Schulze, P\., Sesterhenn, J\. & Mehrmann, V\. The shifted proper orthogonal decomposition: a mode decomposition for multiple transport phenomena\.*SIAM J\. Sci\. Comput\.*40, A1322–A1344 \(2018\)\.
- \[27\]Nair, N\. J\. & Balajewicz, M\. Transported snapshot model order reduction approach for parametric, steady\-state fluid flows containing parameter\-dependent shocks\.*Int\. J\. Numer\. Methods Eng\.*117, 1234–1262 \(2019\)\.
- \[28\]Rim, D\., Peherstorfer, B\. & Mandli, K\. T\. Manifold approximations via transported subspaces: model reduction for transport\-dominated problems\.*SIAM J\. Sci\. Comput\.*45, A170–A199 \(2023\)\.
- \[29\]Mirhoseini, M\. A\. & Zahr, M\. J\. Model reduction of convection\-dominated partial differential equations via optimization\-based implicit feature tracking\.*J\. Comput\. Phys\.*473, 111739 \(2023\)\.
- \[30\]Arnold\-Medabalimi, N\., Huang, C\. & Duraisamy, K\. Large\-eddy simulation and challenges for projection\-based reduced\-order modeling of a gas turbine model combustor\.*Int\. J\. Spray Combust\. Dyn\.*14, 153–175 \(2022\)\.
- \[31\]Amsallem, D\. & Farhat, C\. Interpolation method for adapting reduced\-order models and application to aeroelasticity\.*AIAA J\.*46, 1803–1813 \(2008\)\.
- \[32\]Amsallem, D\. & Farhat, C\. An online method for interpolating linear parametric reduced\-order models\.*SIAM J\. Sci\. Comput\.*33, 2169–2198 \(2011\)\.
- \[33\]Amsallem, D\., Zahr, M\. J\. & Farhat, C\. Nonlinear model order reduction based on local reduced\-order bases\.*Int\. J\. Numer\. Methods Eng\.*92, 891–916 \(2012\)\.
- \[34\]Peherstorfer, B\., Butnaru, D\., Willcox, K\. & Bungartz, H\. J\. Localized discrete empirical interpolation method\.*SIAM J\. Sci\. Comput\.*36, A168–A192 \(2014\)\.
- \[35\]Peherstorfer, B\. & Willcox, K\. Dynamic data\-driven reduced\-order models\.*Comput\. Methods Appl\. Mech\. Eng\.*291, 21–41 \(2015\)\.
- \[36\]Peherstorfer, B\. & Willcox, K\. Online adaptive model reduction for nonlinear systems via low\-rank updates\.*SIAM J\. Sci\. Comput\.*37, A2123–A2150 \(2015\)\.
- \[37\]Peherstorfer, B\. Model reduction for transport\-dominated problems via online adaptive bases and adaptive sampling\.*SIAM J\. Sci\. Comput\.*42, A2803–A2836 \(2020\)\.
- \[38\]Huang, C\. & Duraisamy, K\. Predictive reduced order modeling of chaotic multi\-scale problems using adaptively sampled projections\.*J\. Comput\. Phys\.*491, 112356 \(2023\)\.
- \[39\]Singh, R\., Uy, W\. I\. T\. & Peherstorfer, B\. Lookahead data\-gathering strategies for online adaptive model reduction of transport\-dominated problems\.*Chaos*33, 113112 \(2023\)\.
- \[40\]Mohaghegh, A\. & Huang, C\. Feature\-guided sampling strategy for adaptive model order reduction of convection\-dominated problems\.*J\. Comput\. Phys\.*545, 114468 \(2026\)\.
- \[41\]Hedayat, A\., Padovan, A\. & Duraisamy, K\. Toward adaptive non\-intrusive reduced\-order models: design and challenges\.*Struct\. Multidiscip\. Optim\.*69, 151 \(2026\)\.
- \[42\]Balzano, L\., Chi, Y\. & Lu, Y\. M\. Streaming PCA and subspace tracking: the missing data case\.*Proc\. IEEE*106, 1293–1310 \(2018\)\.
- \[43\]Bunch, J\. R\. & Nielsen, C\. P\. Updating the singular value decomposition\.*Numer\. Math\.*31, 111–129 \(1978\)\.
- \[44\]Brand, M\. Incremental singular value decomposition of uncertain data with missing values\. In*European Conference on Computer Vision \(ECCV\)*, 707–720 \(Springer, 2002\)\.
- \[45\]Brand, M\. Fast low\-rank modifications of the thin singular value decomposition\.*Linear Algebra Appl\.*415, 20–30 \(2006\)\.
- \[46\]Oja, E\. Simplified neuron model as a principal component analyzer\.*J\. Math\. Biol\.*15, 267–273 \(1982\)\.
- \[47\]Balzano, L\., Nowak, R\. & Recht, B\. Online identification and tracking of subspaces from highly incomplete information\. In*Proc\. 48th Annu\. Allerton Conf\.*, 704–711 \(2010\)\.
- \[48\]Yang, B\. Projection approximation subspace tracking\.*IEEE Trans\. Signal Process\.*43, 95–107 \(1995\)\.
- \[49\]Chi, Y\., Eldar, Y\. C\. & Calderbank, R\. PETRELS: parallel subspace estimation and tracking by recursive least squares from partial observations\.*IEEE Trans\. Signal Process\.*61, 5947–5959 \(2013\)\.
- \[50\]Zimmermann, R\., Peherstorfer, B\. & Willcox, K\. Geometric subspace updates with applications to online adaptive nonlinear model reduction\.*SIAM J\. Matrix Anal\. Appl\.*39, 234–261 \(2018\)\.
- \[51\]Hedayat, A\., Mohaghegh, A\., Balzano, L\., Huang, C\. & Duraisamy, K\. History\-aware adaptive reduced\-order models via incremental singular value decomposition\. Preprint at arXiv:2605\.28684 \(2026\)\.
- \[52\]Chaturantabut, S\. & Sorensen, D\. C\. Nonlinear model reduction via discrete empirical interpolation\.*SIAM J\. Sci\. Comput\.*32, 2737–2764 \(2010\)\.
- \[53\]Drmač, Z\. & Gugercin, S\. A new selection operator for the discrete empirical interpolation method\.*SIAM J\. Sci\. Comput\.*38, A631–A648 \(2016\)\.
- \[54\]Carlberg, K\., Bou\-Mosleh, C\. & Farhat, C\. Efficient non\-linear model reduction via a least\-squares Petrov–Galerkin projection and compressive tensor approximations\.*Int\. J\. Numer\. Methods Eng\.*86, 155–181 \(2011\)\.
- \[55\]Brown, T\. B\.*et al\.*Language models are few\-shot learners\. In*Adv\. Neural Inf\. Process\. Syst\. \(NeurIPS\)*\(2020\)\.
- \[56\]Xie, S\. M\., Raghunathan, A\., Liang, P\. & Ma, T\. An explanation of in\-context learning as implicit Bayesian inference\. In*Int\. Conf\. Learn\. Represent\. \(ICLR\)*\(2022\)\.
- \[57\]Akyürek, E\., Schuurmans, D\., Andreas, J\., Ma, T\. & Zhou, D\. What learning algorithm is in\-context learning? Investigations with linear models\. In*Int\. Conf\. Learn\. Represent\. \(ICLR\)*\(2023\)\.
- \[58\]A\. Katharopoulos, A\. Vyas, N\. Pappas, F\. Fleuret\. Transformers are RNNs: fast autoregressive transformers with linear attention\.*ICML*, \(2020\)\.
- \[59\]I\. Schlag, K\. Irie, J\. Schmidhuber\. Linear transformers are secretly fast weight programmers\.*ICML*, \(2021\)\.

## Appendices

The following appendices contain the Supplementary Information accompanying the manuscript\. They provide notation, full numerical details for the spiral example, comparisons with alternative fixed\-rank updates, hyperparameter sensitivity studies for the nonlinear PDE benchmarks, and reproducibility information supporting the main text\.

## Appendix ANotation

[Table˜A1](https://arxiv.org/html/2607.02937#A1.T1)summarizes the main symbols used in the paper\.

Table A1:Notation used in the main text and appendices\.
## Appendix BFull numerical details for the spiral example

The spiral trajectory is

q​\(t\)=\[cos⁡tsin⁡tα​t\],α=0\.4\.q\(t\)=\\begin\{bmatrix\}\\cos t\\\\ \\sin t\\\\ \\alpha t\\end\{bmatrix\},\\qquad\\alpha=0\.4\.\(B\.1\)The time step ist=0\.35\\Delta t=0\.35and the initial time ist0=4\.0t\_\{0\}=4\.0\. The exact discrete dynamics are

qk\+1=G​qk\+c,q^\{k\+1\}=Gq^\{k\}\+c,\(B\.2\)with

G=\[0\.93937271−0\.3428978100\.342897810\.939372710001\],c=\[000\.14\]\.G=\\begin\{bmatrix\}0\.93937271&\-0\.34289781&0\\\\ 0\.34289781&0\.93937271&0\\\\ 0&0&1\\end\{bmatrix\},\\qquad c=\\begin\{bmatrix\}0\\\\ 0\\\\ 0\.14\\end\{bmatrix\}\.\(B\.3\)
The initial rank\-2 basis is obtained from the two snapshotsq1q^\{1\}andq2q^\{2\}:

=0\[−0\.086456250\.99594990−0\.46958378−0\.018889890\.878644630\.08790323\]\.\{\}\_\{0\}=\\begin\{bmatrix\}\-0\.08645625&0\.99594990\\\\ \-0\.46958378&\-0\.01888989\\\\ 0\.87864463&0\.08790323\\end\{bmatrix\}\.\(B\.4\)The associated singular values are

=0diag\(2\.91533718,0\.25061752\)\.\{\}\_\{0\}=\\mathrm\{diag\}\(2\.91533718,\\;0\.25061752\)\.\(B\.5\)
Withγin=0\.1\\gamma\_\{\\rm in\}=0\.1, four in\-span updates give the preconditioned basis

=in,pre\[−0\.40529412−0\.913853140\.42031170−0\.21024705−0\.811834190\.34737389\],\{\}\_\{\\mathrm\{in,pre\}\}=\\begin\{bmatrix\}\-0\.40529412&\-0\.91385314\\\\ 0\.42031170&\-0\.21024705\\\\ \-0\.81183419&0\.34737389\\end\{bmatrix\},\(B\.6\)and singular values

=in,prediag\(2\.47602980,0\.03093119\)\.\{\}\_\{\\mathrm\{in,pre\}\}=\\mathrm\{diag\}\(2\.47602980,\\;0\.03093119\)\.\(B\.7\)The subspace is unchanged:

span\(\)in,pre=span\(\)0\.\\mathrm\{span\}\(\{\}\_\{\\mathrm\{in,pre\}\}\)=\\mathrm\{span\}\(\{\}\_\{0\}\)\.\(B\.8\)
### B\.1Full\-order operator query

The out\-of\-span correction is generated from the ROM state,

qcorr=G​qROM5\+c=\[1\.29594031−0\.629134672\.13998855\]\.q\_\{\\mathrm\{corr\}\}=Gq^\{5\}\_\{\\mathrm\{ROM\}\}\+c=\\begin\{bmatrix\}1\.29594031\\\\ \-0\.62913467\\\\ 2\.13998855\\end\{bmatrix\}\.\(B\.9\)The residual relative to the initial ROM plane is

r=qcorr−qcorr00⊤=\[−0\.010292140\.368094320\.19571200\],r=q\_\{\\mathrm\{corr\}\}\-\{\}\_\{0\}\{\}\_\{0\}^\{\\top\}q\_\{\\mathrm\{corr\}\}=\\begin\{bmatrix\}\-0\.01029214\\\\ 0\.36809432\\\\ 0\.19571200\\end\{bmatrix\},\(B\.10\)with

ρ=\\\|​r​\\\|2=0\.41701624,ρ2=0\.17390255\.\\rho=\\\|r\\\|\_\{2\}=0\.41701624,\\qquad\\rho^\{2\}=0\.17390255\.\(B\.11\)
The correction coefficients in the two pre\-update coordinate systems are

qcorr0⊤=\[2\.063678751\.49068781\],qcorrin,pre⊤=\[−2\.52698551−0\.30864925\]\.\{\}\_\{0\}^\{\\top\}q\_\{\\mathrm\{corr\}\}=\\begin\{bmatrix\}2\.06367875\\\\ 1\.49068781\\end\{bmatrix\},\\qquad\{\}\_\{\\mathrm\{in,pre\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\}=\\begin\{bmatrix\}\-2\.52698551\\\\ \-0\.30864925\\end\{bmatrix\}\.\(B\.12\)

### B\.2Rank\-2 competition

The competition matrices are

Ccorr,out=\+02\(qcorr0⊤\)\(qcorr0⊤\)⊤,C\_\{\\mathrm\{corr,\\,out\}\}=\{\}\_\{0\}^\{2\}\+\(\{\}\_\{0\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\)\(\{\}\_\{0\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\)^\{\\top\},\(B\.13\)and

Ccorr,in=\+in,pre2\(qcorrin,pre⊤\)\(qcorrin,pre⊤\)⊤\.C\_\{\\mathrm\{corr,\\,in\}\}=\{\}\_\{\\mathrm\{in,pre\}\}^\{2\}\+\(\{\}\_\{\\mathrm\{in,pre\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\)\(\{\}\_\{\\mathrm\{in,pre\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\)^\{\\top\}\.\(B\.14\)Their weakest eigenvalues are

λmin​\(Ccorr,out\)=1\.44819350,λmin​\(Ccorr,in\)=0\.04743386\.\\lambda\_\{\\min\}\(C\_\{\\mathrm\{corr,\\,out\}\}\)=1\.44819350,\\qquad\\lambda\_\{\\min\}\(C\_\{\\mathrm\{corr,\\,in\}\}\)=0\.04743386\.\(B\.15\)Thus

ηout=ρ2λmin​\(Ccorr,out\)≈0\.12,ηin=ρ2λmin​\(Ccorr,in\)≈3\.67\.\\eta\_\{\\mathrm\{out\}\}=\\frac\{\\rho^\{2\}\}\{\\lambda\_\{\\min\}\(C\_\{\\mathrm\{corr,\\,out\}\}\)\}\\approx 0\.12,\\qquad\\eta\_\{\\mathrm\{in\}\}=\\frac\{\\rho^\{2\}\}\{\\lambda\_\{\\min\}\(C\_\{\\mathrm\{corr,\\,in\}\}\)\}\\approx 3\.67\.\(B\.16\)

### B\.3Post\-update bases

Applying the same truncated iSVD update \(withγout=1\.0\\gamma\_\{\\rm out\}=1\.0for simplicity\) to both pre\-update states gives

=out,post\[0\.17789643−0\.94264402−0\.39173043−0\.331138170\.902718190\.04206862\],\{\}\_\{\\mathrm\{out,post\}\}=\\begin\{bmatrix\}0\.17789643&\-0\.94264402\\\\ \-0\.39173043&\-0\.33113817\\\\ 0\.90271819&0\.04206862\\end\{bmatrix\},\(B\.17\)and

=in,post\[−0\.458184820\.480870610\.330128480\.87292840−0\.825276840\.08221594\]\.\{\}\_\{\\mathrm\{in,post\}\}=\\begin\{bmatrix\}\-0\.45818482&0\.48087061\\\\ 0\.33012848&0\.87292840\\\\ \-0\.82527684&0\.08221594\\end\{bmatrix\}\.\(B\.18\)
We define the residual capture as\\\|​rhatpost⊤​\\\|2\\\|\{\}\_\{\\mathrm\{post\}\}^\{\\top\}\\hat\{r\}\\\|\_\{2\}, whererhat≔r/\\\|​r​\\\|2\\hat\{r\}\\coloneqq r/\\\|r\\\|\_\{2\}, the plane angle as the largest principal anglemaxiarccos\(ζi\(\)pre⊤post\)\\max\_\{i\}\\arccos\(\\zeta\_\{i\}\(\{\}\_\{\\mathrm\{pre\}\}^\{\\top\}\{\}\_\{\\mathrm\{post\}\}\)\), whereζi​\(⋅\)\\zeta\_\{i\}\(\\cdot\)are singular values, the retained alignment asmaxj⁡\|\(ϕjpost\)⊤​rhat\|\\max\_\{j\}\|\(\\phi^\{\\mathrm\{post\}\}\_\{j\}\)^\{\\top\}\\hat\{r\}\|, whereϕjpost\\phi^\{\\mathrm\{post\}\}\_\{j\}is thejjth column ofpost, and the correction error as\\\|​qcorr−qcorrpostpost⊤​\\\|2\\\|q\_\{\\mathrm\{corr\}\}\-\{\}\_\{\\mathrm\{post\}\}\{\}\_\{\\mathrm\{post\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\\\|\_\{2\}\. The measured outcomes are listed in[Table˜B1](https://arxiv.org/html/2607.02937#A2.T1)\.

Table B1:Main spiral diagnostics for baseline adaptive and SPIN updates\.
### B\.4Core\-matrix interpretation

The same effect can be read directly from the small iSVD core matrix\. For a pre\-update basispreand singular valuespre, write

α=qcorrpre⊤,r=qcorr−αpre,ρ=\\\|​r​\\\|2,rhat=r/ρ\.\\alpha=\{\}\_\{\\mathrm\{pre\}\}^\{\\top\}q\_\{\\mathrm\{corr\}\},\\qquad r=q\_\{\\mathrm\{corr\}\}\-\{\}\_\{\\mathrm\{pre\}\}\\alpha,\\qquad\\rho=\\\|r\\\|\_\{2\},\\qquad\\hat\{r\}=r/\\rho\.The out\-of\-span iSVD update forms the augmented basis\[rhatpre\]\[\{\}\_\{\\mathrm\{pre\}\}\\;\\;\\hat\{r\}\]and the core matrix

K=\[γoutpreα0⊤ρ\]\.K=\\begin\{bmatrix\}\\gamma\_\{\\rm out\}\{\}\_\{\\mathrm\{pre\}\}&\\alpha\\\\ 0^\{\\top\}&\\rho\\end\{bmatrix\}\.\(B\.19\)Here we useγout=1\.0\\gamma\_\{\\rm out\}=1\.0\. The left singular vectors ofKKdetermine how the retained post\-update basis vectors mix the old pre\-update modes with the new residual direction\. Because the update is truncated back to rank two, the first retained vector corresponds to the dominant slot, while the second retained vector is the weak slot where the old weak mode competes with the incoming residual\.

For the baseline adaptive model,=pre0\{\}\_\{\\mathrm\{pre\}\}=\{\}\_\{0\}and=pre0\{\}\_\{\\mathrm\{pre\}\}=\{\}\_\{0\}, giving

Kout=\[2\.9153371802\.0636787500\.250617521\.49068781000\.41701624\]\.K\_\{\\mathrm\{out\}\}=\\begin\{bmatrix\}2\.91533718&0&2\.06367875\\\\ 0&0\.25061752&1\.49068781\\\\ 0&0&0\.41701624\\end\{bmatrix\}\.\(B\.20\)The second retained left singular vector is

uK,out\(2\)=\[0\.27395794−0\.92887308−0\.24928267\]\.u^\{\(2\)\}\_\{K,\\mathrm\{out\}\}=\\begin\{bmatrix\}0\.27395794\\\\ \-0\.92887308\\\\ \-0\.24928267\\end\{bmatrix\}\.\(B\.21\)The entries correspond, respectively, to the old first mode, the old second mode, and the new residual direction\. Thus the weak retained slot is still dominated by the old second mode, with magnitude0\.9290\.929, while only0\.2490\.249of the slot points along the residual direction\.

For the SPIN model,=prein,pre\{\}\_\{\\mathrm\{pre\}\}=\{\}\_\{\\mathrm\{in,pre\}\}and=prein,pre\{\}\_\{\\mathrm\{pre\}\}=\{\}\_\{\\mathrm\{in,pre\}\}, giving

Kin=\[2\.476029800−2\.5269855100\.03093119−0\.30864925000\.41701624\]\.K\_\{\\mathrm\{in\}\}=\\begin\{bmatrix\}2\.47602980&0&\-2\.52698551\\\\ 0&0\.03093119&\-0\.30864925\\\\ 0&0&0\.41701624\\end\{bmatrix\}\.\(B\.22\)The corresponding retained core vector is

uK,in\(2\)=\[0\.10526228−0\.594416070\.79723860\]\.u^\{\(2\)\}\_\{K,\\mathrm\{in\}\}=\\begin\{bmatrix\}0\.10526228\\\\ \-0\.59441607\\\\ 0\.79723860\\end\{bmatrix\}\.\(B\.23\)Now the same weak slot is much more strongly aligned with the residual direction: the residual contribution has magnitude0\.7970\.797, while the old second\-mode contribution has dropped to0\.5940\.594\. The signs are arbitrary because singular vectors are sign\-indeterminate; the magnitudes show how the fixed rank\-two budget is allocated\. In this sense, in\-span preconditioning does not add a third basis vector\. It repurposes the weak retained slot so that the same out\-of\-span correction survives the truncation more effectively\.

## Appendix CAlternative fixed\-rank updates in the spiral example

The spiral also allows comparison with several alternative fixed\-rank update rules\. All methods receive the same correctionqcorrq\_\{\\mathrm\{corr\}\}and use the same rank budget\.

### C\.1Rank\-one interpolation

The rank\-one interpolation update of Ref\.\[[38](https://arxiv.org/html/2607.02937#bib.bib38)\]takes the form

=raw\+\+0r​α⊤α⊤​α,α=qcorr0⊤\.\{\}^\{\+\}\_\{\\mathrm\{raw\}\}=\{\}\_\{0\}\+\\frac\{r\\alpha^\{\\top\}\}\{\\alpha^\{\\top\}\\alpha\},\\qquad\\alpha=\{\}\_\{0\}^\{\\top\}q\_\{\\mathrm\{corr\}\}\.\(C\.1\)This update is constructed so that

αraw\+=α0\+r=qcorr\.\{\}^\{\+\}\_\{\\mathrm\{raw\}\}\\alpha=\{\}\_\{0\}\\alpha\+r=q\_\{\\mathrm\{corr\}\}\.\(C\.2\)Therefore the correction lies exactly in the updated span\. However, exact interpolation of one state does not imply that the updated basis is well aligned with the new residual direction\.

### C\.2Greedy residual replacement

A greedy residual replacement keeps the dominant old mode and replaces the weak mode by the normalized residual:

ϕ1,greedy\+=ϕ10,ϕ2,greedy\+=r^\.\\phi^\{\+\}\_\{1,\\mathrm\{greedy\}\}=\\phi^\{0\}\_\{1\},\\qquad\\phi^\{\+\}\_\{2,\\mathrm\{greedy\}\}=\\mathaccent 866\{r\}\.\(C\.3\)This achieves perfect residual alignment, but discards the in\-plane contribution associated with the second old mode\. In the spiral, the correction error is therefore

\\\|​qcorr−qROM,greedy6​\\\|2=\|α2\|=1\.49068781\.\\\|q\_\{\\mathrm\{corr\}\}\-q^\{6\}\_\{\\mathrm\{ROM,greedy\}\}\\\|\_\{2\}=\|\\alpha\_\{2\}\|=1\.49068781\.\(C\.4\)

### C\.3Optimal one\-slot rotation

If the dominant first mode is fixed and only the weak second slot is allowed to rotate in the plane spanned byϕ20\\phi\_\{2\}^\{0\}andr^\\mathaccent 866\{r\}, the exact\-correction update is

ϕ2,opt\+=α2​ϕ20\+rα22\+ρ2\.\\phi^\{\+\}\_\{2,\\mathrm\{opt\}\}=\\frac\{\\alpha\_\{2\}\\phi\_\{2\}^\{0\}\+r\}\{\\sqrt\{\\alpha\_\{2\}^\{2\}\+\\rho^\{2\}\}\}\.\(C\.5\)This update makes the correction exact while keepingϕ10\\phi\_\{1\}^\{0\}fixed\. Its residual alignment is

ρα22\+ρ2=0\.26940447\.\\frac\{\\rho\}\{\\sqrt\{\\alpha\_\{2\}^\{2\}\+\\rho^\{2\}\}\}=0\.26940447\.\(C\.6\)
The comparison clarifies the role of in\-span learning\. It does not optimize correction interpolation alone, nor residual alignment alone\. Instead, it brings a trajectory\-preconditioned basis into the same truncated update, which allows the weak modal slot to be repurposed without discarding essential in\-plane content\. To compare the alternatives, we use the same residual capture, plane angle, retained alignment, and correction\-error diagnostics defined above\. We also report the slot angle

θslot=arccos⁡\(\|\(ϕ2pre\)⊤​ϕ2post\|\),\\theta\_\{\\mathrm\{slot\}\}=\\arccos\\left\(\\left\|\(\\phi^\{\\mathrm\{pre\}\}\_\{2\}\)^\{\\top\}\\phi^\{\\mathrm\{post\}\}\_\{2\}\\right\|\\right\),whereϕ2pre\\phi^\{\\mathrm\{pre\}\}\_\{2\}is the pre\-update weak mode andϕ2post\\phi^\{\\mathrm\{post\}\}\_\{2\}is the post\-update vector assigned to that weak modal slot\. The absolute value removes the arbitrary sign of basis vectors\. A small slot angle means that the weak slot remains close to its old direction, whereas a large slot angle indicates that the slot has been substantially repurposed\. The resulting comparison is given in[Table˜C1](https://arxiv.org/html/2607.02937#A3.T1)and visualized in[Fig\.˜C1](https://arxiv.org/html/2607.02937#A3.F1)\.

Table C1:Comparison of fixed\-rank updates on the spiral correction\.![Refer to caption](https://arxiv.org/html/2607.02937v1/x7.png)Figure C1:Alternative fixed\-rank updates expose the tradeoff between fitting the correction and retaining the residual\.Rank\-one interpolation and optimal one\-slot rotation can fit the correction exactly, but do not strongly align the basis with the new residual direction\. Greedy residual replacement captures the residual perfectly, but discards important in\-plane content\. The SPIN update occupies a different part of the tradeoff because the basis has already been organized by the ROM trajectory before the correction arrives\.

## Appendix DHyperparameter sensitivity and additional PDE results

The SPIN framework is governed by three main parameters: the in\-span forgetting factorγin\\gamma\_\{\\rm in\}, the out\-of\-span forgetting factorγout\\gamma\_\{\\rm out\}, and the out\-of\-span correction intervalzsz\_\{s\}\. For each benchmark, we tune the forgetting factors by minimizing the mean relativeL2L\_\{2\}error over the online trajectory\. The baseline adaptive is tuned over its ownγout\\gamma\_\{\\rm out\}values, and the SPIN model is tuned over the two\-dimensional\(γin,γout\)\(\\gamma\_\{\\rm in\},\\gamma\_\{\\rm out\}\)grid \([Figs\.˜D7](https://arxiv.org/html/2607.02937#A4.F7)and[D10](https://arxiv.org/html/2607.02937#A4.F10)\)\. The main\-text comparisons therefore use the best\-performing version of each adaptive strategy\.

For Burgers, the best baseline adaptive model usesγout=0\.01\\gamma\_\{\\rm out\}=0\.01, while the best SPIN model uses\(γin,γout\)=\(1\.0,0\.25\)\(\\gamma\_\{\\rm in\},\\gamma\_\{\\rm out\}\)=\(1\.0,0\.25\)\. For Fisher–KPP, the best baseline adaptive model usesγout=0\.1\\gamma\_\{\\rm out\}=0\.1, while the best SPIN model uses\(γin,γout\)=\(0\.9,0\.25\)\(\\gamma\_\{\\rm in\},\\gamma\_\{\\rm out\}\)=\(0\.9,0\.25\)\. These values are reported in the main text and repeated in[Table˜E1](https://arxiv.org/html/2607.02937#A5.T1)\.

The sensitivity maps also clarify the role of in\-span forgetting\. The best SPIN models occur at largeγin\\gamma\_\{\\rm in\}, meaning that the PDE benchmarks do not benefit from aggressive in\-span forgetting\. This is consistent with the spectral diagnostics in the main text: unlike the first spiral correction, the PDE trajectories carry enough energy in the retained modes that the singular values are reinforced rather than suppressed\. The role of in\-span learning in these cases is therefore not to erase a stale mode, but to continuously condition the basis spectrum and orientation using the ROM trajectory\.

The maps show a useful practical pattern\. Whenγin\\gamma\_\{\\rm in\}is large, the model can become sensitive to the out\-of\-span forgetting factorγout\\gamma\_\{\\rm out\}, and poor choices ofγout\\gamma\_\{\\rm out\}may lead to much larger errors\. Whenγin\\gamma\_\{\\rm in\}is smaller, the performance is often more robust acrossγout\\gamma\_\{\\rm out\}, although not always optimal\. Thus, aggressive in\-span memory can produce the best models when paired with a suitable out\-of\-span forgetting factor, while smallerγin\\gamma\_\{\\rm in\}may provide a safer but more conservative operating regime\.

The correction intervalzsz\_\{s\}controls how long the ROM evolves between external corrections\. Largerzsz\_\{s\}reduces the number of full\-order operator queries, but gives the ROM more time to drift; smallerzsz\_\{s\}provides more frequent out\-of\-span information but increases the hybrid cost\.[Fig\.˜D7](https://arxiv.org/html/2607.02937#A4.F7)shows that adding the in\-span channel shifts this tradeoff\. For a fixed target error, the SPIN ROM can use a substantially largerzsz\_\{s\}than the baseline adaptive ROM, meaning that it can evolve for longer on its own before requiring new external information\. This supports the central interpretation of in\-span learning as trajectory\-informed basis preparation: between correction events, the ROM uses its own predictions to keep the basis better organized, so external corrections can be queried less frequently for the same accuracy level\. The interval cannot be made arbitrarily large, however, because if the ROM trajectory drifts too far, its in\-span predictions no longer provide a reliable guide to the local dynamics\.

\{subcaptionblock\}

0\.32![Refer to caption](https://arxiv.org/html/2607.02937v1/x8.png)\{subcaptionblock\}0\.32![Refer to caption](https://arxiv.org/html/2607.02937v1/x9.png)\{subcaptionblock\}0\.32![Refer to caption](https://arxiv.org/html/2607.02937v1/x10.png)

Figure D1:Burgers:γin\\gamma\_\{\\rm in\}Figure D2:Burgers:zsz\_\{s\}Figure D3:Burgers:γin×γout\\gamma\_\{\\rm in\}\\times\\gamma\_\{\\rm out\}\{subcaptionblock\}

0\.32![Refer to caption](https://arxiv.org/html/2607.02937v1/x11.png)\{subcaptionblock\}0\.32![Refer to caption](https://arxiv.org/html/2607.02937v1/x12.png)\{subcaptionblock\}0\.32![Refer to caption](https://arxiv.org/html/2607.02937v1/x13.png)

Figure D4:Fisher–KPP:γin\\gamma\_\{\\rm in\}Figure D5:Fisher–KPP:zsz\_\{s\}Figure D6:Fisher–KPP:γin×γout\\gamma\_\{\\rm in\}\\times\\gamma\_\{\\rm out\}Figure D7:Sensitivity to in\-span forgetting and correction interval\.Whenγin\\gamma\_\{\\rm in\}is close to one, in\-span forgetting is weak and the ROM retains a longer memory of its own trajectory; whenγin\\gamma\_\{\\rm in\}is small, the in\-span update emphasizes recent states more aggressively\. The most useful regime balances trajectory memory, spectral reweighting and stability between correction events\. In theγin×γout\\gamma\_\{\\rm in\}\\times\\gamma\_\{\\rm out\}maps \(panels c and f\), the reference value reported in the title is the best baseline adaptive error obtained by sweeping its out\-of\-span forgetting factor \([Fig\.˜D10](https://arxiv.org/html/2607.02937#A4.F10)\)\.\{subcaptionblock\}0\.49![Refer to caption](https://arxiv.org/html/2607.02937v1/x14.png)\{subcaptionblock\}0\.49![Refer to caption](https://arxiv.org/html/2607.02937v1/x15.png)

Figure D8:BurgersFigure D9:Fisher–KPPFigure D10:Out\-of\-span forgetting for the baseline adaptive model\.The baseline adaptive model’s mean relativeL2L\_\{2\}error as a function of its out\-of\-span forgetting factorγout\\gamma\_\{\\rm out\}\(swept on a logarithmic axis\), with the SPIN error shown as a dashed reference line\. The optimal out\-of\-span forgetting is problem\-dependent—nearγout≈0\.01\\gamma\_\{\\rm out\}\\approx 0\.01for Burgers andγout≈0\.1\\gamma\_\{\\rm out\}\\approx 0\.1for Fisher–KPP—but in both cases the best\-tuned baseline adaptive ROM remains substantially less accurate than the SPIN ROM\.[Fig\.˜D15](https://arxiv.org/html/2607.02937#A4.F15)reports additional Burgers and Fisher–KPP diagnostics, including robustness across initial conditions and final\-time profiles for representative cases\.

\{subcaptionblock\}

0\.49![Refer to caption](https://arxiv.org/html/2607.02937v1/x16.png)\{subcaptionblock\}0\.49![Refer to caption](https://arxiv.org/html/2607.02937v1/x17.png)

Figure D11:Burgers: initial\-condition robustnessFigure D12:Fisher–KPP: initial\-condition robustness\{subcaptionblock\}

0\.99![Refer to caption](https://arxiv.org/html/2607.02937v1/x18.png)

Figure D13:Burgers: final\-time profiles across initial conditions\{subcaptionblock\}

0\.99![Refer to caption](https://arxiv.org/html/2607.02937v1/x19.png)

Figure D14:Fisher–KPP: final\-time profiles across initial conditionsFigure D15:Additional PDE results support the main\-text comparisons\.Initial\-condition robustness tests for Burgers and Fisher–KPP\. All ROMs are trained with rankr=4r=4andm=4m=4QDEIM sample points, with offline basis trained on the initial44time steps fromt=0t=0tot=0\.004t=0\.004, while prediction is evaluated over500500time steps fromt=0t=0tot=0\.50t=0\.50, with external corrections everyzs=10z\_\{s\}=10steps\. Across these additional cases, the SPIN ROM uses the same out\-of\-span correction mechanism as the baseline adaptive ROM, but produces smaller errors and more accurate final\-time profiles\.
## Appendix EReproducibility information

The main numerical settings used to generate the spiral, Burgers, and Fisher–KPP results are collected in[Table˜E1](https://arxiv.org/html/2607.02937#A5.T1)\. Together with the model definitions, update rules, and diagnostics described in the Methods and appendices above, as well as the source code available at[https://github\.com/APHedayat/SPIN](https://github.com/APHedayat/SPIN), these parameters specify the benchmark configurations used for all results reported in the main text and appendices\.

Table E1:Main benchmark parameters\.

Similar Articles

In-Context Learning Operates as Concept Subspace Learning

arXiv cs.LG

This paper proposes that in-context learning in LLMs operates through low-dimensional concept subspaces, where task-relevant information concentrates in a small fraction of the representation space, supported by experiments on Llama-3-8B and Qwen2.5-7B.

Catching a Moving Subspace: Low-Rank Bandits Beyond Stationarity

arXiv cs.LG

This paper studies piecewise-stationary low-rank linear contextual bandits, proposes the SPSC algorithm that achieves dynamic regret scaling with the intrinsic rank instead of the ambient dimension, and characterizes the identification boundary for subspace recovery under scalar feedback.

An Optimal Transport-driven Approach for Cultivating Latent Space in Online Incremental Learning

Hugging Face Daily Papers

This paper introduces MMOT, an online mixture model learning framework based on optimal transport theory that addresses incremental learning with distributional shifts through dynamic centroid updates and improved class similarity estimation. The approach includes a Dynamic Preservation strategy to mitigate catastrophic forgetting and maintain class separability in latent space.