AdaptNTK: Adaptive Uncertainty Quantification and Active Learning for Neural Network Potentials
Summary
AdaptNTK introduces an adaptive uncertainty quantification framework using neural tangent kernels to enable efficient active learning in neural network potentials, reducing computational cost while maintaining accuracy in molecular dynamics simulations.
View Cached Full Text
Cached at: 09/02/26, 06:15 AM
# AdaptNTK: Adaptive Uncertainty Quantification and Active Learning for Neural Network Potentials Source: [https://arxiv.org/html/2609.00488](https://arxiv.org/html/2609.00488) Shuwen YueAffiliation:R\. F\. Smith School of Chemical and Biomolecular Engineering, Cornell University, Ithaca, NY, USAAffiliation:Corresponding author:[shuwen\.yue@cornell\.edu](mailto:[email protected]) ###### Abstract Machine learning interatomic potentials bridge the gap between quantum chemical precision and classical computational speed, enabling molecular dynamics simulations with first\-principles accuracy\. Their reliability is often improved through active learning, which iteratively expands the training set by identifying uncertain, out\-of\-distribution configurations\. Existing uncertainty\-quantification methods often involve a trade\-off between computational cost and reliability, and generally cannot account for redundancy as an acquisition batch is assembled\. Here, we introduce AdaptNTK, a single\-model framework that measures uncertainty as a regularized Mahalanobis distance in empirical neural tangent kernel \(NTK\) feature space\. With the NTK features fixed during acquisition, the uncertainty depends on the acquired configurations but not their reference labels\. This allows the uncertainty to be updated recursively after each selection without retraining, reducing redundancy within an acquisition batch\. On held\-out rMD17 data, AdaptNTK achieves the highest mean correlations with force errors \(Spearman0\.680\.68, Pearson0\.710\.71\) and matches a three\-member ensemble in error retention\. In active learning experiments, AdaptNTK achieves the lowest force errors across rMD17 and Transition\-1X, with particularly strong performance on transition\-state configurations in Transition\-1X\. AdaptNTK is2\.6×2\.6\\timesfaster per Transition\-1X cycle than the ensemble, providing efficient single\-model uncertainty estimation with sequential updates for data\-efficient active learning\. ## 1Introduction Molecular dynamics \(MD\) simulations are widely used to study chemical processes at atomistic resolution\. Their accuracy and range, however, have traditionally been limited by a trade\-off between computational cost and the quality of the underlying potential\-energy surface \(PES\)\. Electronic\-structure methods accurately describe bond breaking, charge redistribution, and small energy differences but remain computationally costly, whereas empirical force fields can access larger length and timescales but often do not generalize to new chemical environments\. Machine learning interatomic potentials \(MLIPs\) address this limitation by learning potentials from reference calculations and approximating first\-principles energies and forces at computational costs that can scale linearly with system size\([Behler and Parrinello, 2007](https://arxiv.org/html/2609.00488#bib.bib1);[Bartók et al\., 2010](https://arxiv.org/html/2609.00488#bib.bib2);[Unke et al\., 2021](https://arxiv.org/html/2609.00488#bib.bib3);[Batzner et al\., 2022](https://arxiv.org/html/2609.00488#bib.bib4);[Batatia et al\., 2022](https://arxiv.org/html/2609.00488#bib.bib5);[Musaelian et al\., 2023](https://arxiv.org/html/2609.00488#bib.bib6)\)\. Despite their efficiency, MLIPs are strongly dependent on their training data\. They generally interpolate well within regions of configuration space represented in the training set, but their predictions can deteriorate when trajectories encounter configurations outside these regions\. Such extrapolation errors can lead to inaccurate forces and, consequently, incorrect trajectories\. Reliable uncertainty estimates are therefore important for identifying configurations for which model predictions may not be trustworthy\. Gaussian\-process \(GP\) potentials naturally provide uncertainty estimates through their posterior variance, which depends on the training configurations but not their reference labels\. This enables uncertainty to be evaluated and updated analytically as the training set changes\. Neural\-network potentials, on the other hand, are more expressive but generally lack comparable closed\-form uncertainty estimates\. Their uncertainty is typically approximated using ensembles\([Seung et al\., 1992](https://arxiv.org/html/2609.00488#bib.bib15);[Smith et al\., 2018](https://arxiv.org/html/2609.00488#bib.bib12)\)or approximate Bayesian methods\([Gal and Ghahramani, 2016](https://arxiv.org/html/2609.00488#bib.bib16);[Maddox et al\., 2019](https://arxiv.org/html/2609.00488#bib.bib17);[Amini et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib18);[Soleimany et al\., 2021](https://arxiv.org/html/2609.00488#bib.bib19)\), which can be computationally expensive or unreliable outside the training distribution\. Developing reliable and efficient uncertainty estimates for a single trained MLIP therefore remains an important challenge\. Active learning is a natural downstream application of uncertainty quantification\. Configurations with high uncertainty can be selected for reference labeling and added to the training set\([Podryabinkin and Shapeev, 2017](https://arxiv.org/html/2609.00488#bib.bib7);[Smith et al\., 2018](https://arxiv.org/html/2609.00488#bib.bib12);[Vandermause et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib13);[Zhang et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib14)\)\. When multiple configurations are selected in a batch, however, uncertainty estimates computed only once at the beginning of the batch do not account for configurations that have already been selected, potentially leading to redundant acquisitions\. GP posterior variance naturally supports updating the uncertainty after each selection without requiring the corresponding reference label\([Vandermause et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib13)\)\. Achieving a similar capability for neural\-network potentials is more challenging, because conventional uncertainty estimates generally require additional model fitting or retraining to incorporate newly selected configurations\. Parameter\-gradient features associated with the neural tangent kernel \(NTK\)\([Jacot et al\., 2018](https://arxiv.org/html/2609.00488#bib.bib20)\)provide a principled framework for recovering this GP\-like capability in trained neural\-network potentials\. Here we introduce AdaptNTK, a framework for uncertainty quantification and active learning in neural\-network potentials\. AdaptNTK represents each configuration using the gradient of its predicted energy with respect to all model parameters and assigns a regularized distance from the training data in this tangent\-feature space\. Because the uncertainty depends on the selected configurations but not their reference labels, it can be updated analytically after each selection without retraining the network while the acquisition batch is being assembled\. Our contributions are as follows: - •We connect regularized empirical\-NTK uncertainty to feature\-space geometry, evaluate its ranking, retention, and calibration, and prove a Gaussian\-sketch guarantee controlled by the ridge effective dimension\. - •We use a label\-free rank\-one update to condition the remaining uncertainty scores after each selection, reducing within\-batch redundancy without additional model retraining\. - •We benchmark AdaptNTK’s force\-error ranking, error retention, uncertainty calibration, and active\-learning performance against ensemble and single\-model baselines on rMD17\([Christensen and von Lilienfeld, 2020](https://arxiv.org/html/2609.00488#bib.bib9)\)and Transition\-1X\([Schreiner et al\., 2022](https://arxiv.org/html/2609.00488#bib.bib10)\)\. Overall, AdaptNTK achieves the highest mean correlations with force error among the evaluated uncertainty quantification methods and the lowest force errors in the active\-learning experiments on rMD17 and Transition\-1X\. Its normalized risk–coverage performance is comparable to that of a three\-member ensemble, while its wall\-clock cost is less than half that of the ensemble in the reported Transition\-1X timing experiment\. Together, these results show that sketched empirical\-NTK uncertainty provides a practical single\-model foundation for data\-efficient active learning of neural\-network potentials\. ## 2Related Work Several uncertainty\-quantification methods have been developed for estimating predictive uncertainty in deep neural networks\([Seung et al\., 1992](https://arxiv.org/html/2609.00488#bib.bib15);[Gal and Ghahramani, 2016](https://arxiv.org/html/2609.00488#bib.bib16);[Lakshminarayanan et al\., 2017](https://arxiv.org/html/2609.00488#bib.bib36);[Maddox et al\., 2019](https://arxiv.org/html/2609.00488#bib.bib17);[Amini et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib18);[Soleimany et al\., 2021](https://arxiv.org/html/2609.00488#bib.bib19)\)\. These approaches have also been adapted to atomistic machine learning, particularly through ensembles and query\-by\-committee \(QBC\) methods\([Smith et al\., 2018](https://arxiv.org/html/2609.00488#bib.bib12);[Podryabinkin and Shapeev, 2017](https://arxiv.org/html/2609.00488#bib.bib7);[Zhang et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib14);[Kahle and Zipoli, 2022](https://arxiv.org/html/2609.00488#bib.bib25)\)\. More recent work has developed single\-model or reduced\-cost alternatives based on dropout and learned\-feature distributions\([Wen and Tadmor, 2020](https://arxiv.org/html/2609.00488#bib.bib37);[Zhu et al\., 2023](https://arxiv.org/html/2609.00488#bib.bib28);[Bigi et al\., 2024](https://arxiv.org/html/2609.00488#bib.bib29);[Chong et al\., 2025](https://arxiv.org/html/2609.00488#bib.bib30)\), evidential regression\([Xu et al\., 2026](https://arxiv.org/html/2609.00488#bib.bib33)\), shared\-backbone ensembles\([Kellner and Ceriotti, 2024](https://arxiv.org/html/2609.00488#bib.bib27);[Beck et al\., 2025](https://arxiv.org/html/2609.00488#bib.bib41)\), variational inference\([Coscia et al\., 2026](https://arxiv.org/html/2609.00488#bib.bib43);[Mamun et al\., 2026](https://arxiv.org/html/2609.00488#bib.bib8)\), and post\-hoc uncertainty estimation and calibration\([Vita et al\., 2025](https://arxiv.org/html/2609.00488#bib.bib38);[Perez et al\., 2025](https://arxiv.org/html/2609.00488#bib.bib39);[Ho et al\., 2026](https://arxiv.org/html/2609.00488#bib.bib42)\)\. However, these approaches often involve a trade\-off between computational scalability and the reliability of their uncertainty estimates\([Tan et al\., 2023](https://arxiv.org/html/2609.00488#bib.bib26);[Bilbrey et al\., 2025](https://arxiv.org/html/2609.00488#bib.bib40)\)\. More recently,[Wilson et al\. \(2025\)](https://arxiv.org/html/2609.00488#bib.bib35)showed that uncertainty quantification based on empirical neural tangent kernels \(NTKs\) can match or outperform deep ensembles at substantially lower computational cost in general regression settings\. Their approach is post\-hoc and sampling\-based, constructing ensembles through gradient\-descent sampling of linearized networks, whereas our uncertainty estimate is obtained directly from a closed\-form regularized quadratic form in empirical NTK feature space\. Batch active\-learning methods have also been extensively studied across machine\-learning applications, including image classification and tabular regression\. Last\-layer and gradient\-feature representations are commonly paired with diversity criteria for batch acquisition\([Holzmüller et al\., 2023](https://arxiv.org/html/2609.00488#bib.bib32);[Ash et al\., 2020](https://arxiv.org/html/2609.00488#bib.bib24);[Sener and Savarese, 2018](https://arxiv.org/html/2609.00488#bib.bib23)\), with related approaches developed for interatomic potentials\([Zaverkin et al\., 2022](https://arxiv.org/html/2609.00488#bib.bib31)\)\. Concurrent work by[Varga\-Umbrich et al\. \(2026a\)](https://arxiv.org/html/2609.00488#bib.bib44)and[Varga\-Umbrich et al\. \(2026b\)](https://arxiv.org/html/2609.00488#bib.bib34)also uses neural tangent kernel features and diversity\-aware selection for active learning in MLIPs\. These works demonstrate the utility of feature\-based representations and within\-batch diversification for selecting informative training data\. Their primary focus, however, is fixed\-budget acquisition, where feature scores are used to rank candidates rather than to provide a quantitative, calibrated uncertainty for each configuration\. Our focus is complementary: we use empirical NTK features to construct a pointwise uncertainty measure that can be calibrated and updated adaptively as configurations are acquired\. This distinction is important for molecular simulations, where uncertainty needs to be evaluated on individual configurations as the trajectory evolves\. Such estimates can identify departures from the training distribution, provide stopping criteria for data acquisition, and indicate when model predictions may not be reliable during long\-running simulations\. ## 3Background ### 3\.1Gaussian processes A Gaussian Process \(GP\) defines a prior over functionsf:ℝd→ℝf:\\mathbb\{R\}^\{d\}\\to\\mathbb\{R\}with mean functionm\(⋅\)m\(\\cdot\)and covariance kernelk\(⋅,⋅\)k\(\\cdot,\\cdot\)\([Rasmussen and Williams, 2006](https://arxiv.org/html/2609.00488#bib.bib22)\)\. Given a dataset𝒟=\(𝐗,𝐲\)\\mathcal\{D\}=\(\\mathbf\{X\},\\mathbf\{y\}\)with observation noiseσ2\\sigma^\{2\}, the posterior predictive distribution at a test input𝐱⋆\\mathbf\{x\}^\{\\star\}is Gaussian with variance Σ\(𝐱⋆\)=k\(𝐱⋆,𝐱⋆\)−k𝐱⋆,𝐗\(𝐊𝐗,𝐗\+σ2𝐈\)−1k𝐗,𝐱⋆\\Sigma\(\\mathbf\{x\}^\{\\star\}\)=k\(\\mathbf\{x\}^\{\\star\},\\mathbf\{x\}^\{\\star\}\)\-k\_\{\\mathbf\{x\}^\{\\star\},\\mathbf\{X\}\}\\left\(\\mathbf\{K\}\_\{\\mathbf\{X\},\\mathbf\{X\}\}\+\\sigma^\{2\}\\mathbf\{I\}\\right\)^\{\-1\}k\_\{\\mathbf\{X\},\\mathbf\{x\}^\{\\star\}\}In this work, we focus on the predictive variance, which serves as a measure of uncertainty and forms the basis for our acquisition strategy\. ### 3\.2Neural tangent kernels Consider a neural networkf\(⋅,𝜽\):ℝd→ℝf\(\\cdot;\\boldsymbol\{\\theta\}\):\\mathbb\{R\}^\{d\}\\to\\mathbb\{R\}parameterized by𝜽∈ℝP\\boldsymbol\{\\theta\}\\in\\mathbb\{R\}^\{P\}\. Its neural tangent feature map at parameters𝜽\\boldsymbol\{\\theta\}isϕ𝜽\(𝐱\)=∇𝜽f\(𝐱,𝜽\)∈ℝP,\\phi\_\{\\boldsymbol\{\\theta\}\}\(\\mathbf\{x\}\)=\\nabla\_\{\\boldsymbol\{\\theta\}\}f\(\\mathbf\{x\};\\boldsymbol\{\\theta\}\)\\in\\mathbb\{R\}^\{P\},which induces the empirical neural tangent kernel \(NTK\)𝒦𝜽\(𝐱,𝐱′\)=ϕ𝜽\(𝐱\)⊤ϕ𝜽\(𝐱′\)\.\\mathcal\{K\}\_\{\\boldsymbol\{\\theta\}\}\(\\mathbf\{x\},\\mathbf\{x\}^\{\\prime\}\)=\\phi\_\{\\boldsymbol\{\\theta\}\}\(\\mathbf\{x\}\)^\{\\top\}\\phi\_\{\\boldsymbol\{\\theta\}\}\(\\mathbf\{x\}^\{\\prime\}\)\.In the infinite\-width limit, the NTK converges to a deterministic kernel, and, under standard assumptions, neural\-network training can be described by the corresponding kernel dynamics\([Jacot et al\., 2018](https://arxiv.org/html/2609.00488#bib.bib20);[Lee et al\., 2019](https://arxiv.org/html/2609.00488#bib.bib21)\)\. Here, we instead use the empirical NTK of a finite, trained network\. Treating this kernel as a Gaussian\-process covariance yields a predictive uncertainty that can be written directly in terms of the tangent\-feature matrix𝚽∈ℝn×P\\mathbf\{\\Phi\}\\in\\mathbb\{R\}^\{n\\times P\}\. This construction corresponds to a local linearization around the learned parameters and does not assume that the model operates in the infinite\-width regime\. ## 4Methods ### 4\.1Motivation and theoretical analysis We first develop a geometric interpretation of predictive uncertainty by relating Gaussian\-process \(GP\) variance induced by the empirical neural tangent kernel \(NTK\) to distances in NTK feature space\. Let𝚽∈ℝn×P\\mathbf\{\\Phi\}\\in\\mathbb\{R\}^\{n\\times P\}denote the empirical NTK feature matrix for the training dataset, where each row corresponds to the tangent feature representation of a training configuration\. Treating the empirical NTK as the covariance kernel of the locally linearized neural network, the predictive variance at a query point𝐱\\mathbf\{x\}is given by 𝕍\[f\(𝐱\)\]=ϕ\(𝐱\)⊤ϕ\(𝐱\)−ϕ\(𝐱\)⊤𝚽⊤\(𝚽𝚽⊤\+σ2𝐈n\)−1𝚽ϕ\(𝐱\),\\mathbb\{V\}\[f\(\\mathbf\{x\}\)\]=\\phi\(\\mathbf\{x\}\)^\{\\top\}\\phi\(\\mathbf\{x\}\)\-\\phi\(\\mathbf\{x\}\)^\{\\top\}\\mathbf\{\\Phi\}^\{\\top\}\\left\(\\mathbf\{\\Phi\}\\mathbf\{\\Phi\}^\{\\top\}\+\\sigma^\{2\}\\mathbf\{I\}\_\{n\}\\right\)^\{\-1\}\\mathbf\{\\Phi\}\\phi\(\\mathbf\{x\}\),\(1\)whereσ2\>0\\sigma^\{2\}\>0denotes the GP observation\-noise or regularization parameter\. While Eq\. \([1](https://arxiv.org/html/2609.00488#S4.E1)\) is expressed in the data space, it can be expressed in an equivalent formulation in the parameter space\. Using the Woodbury identity in its push\-through form, we rewrite the predictive variance as 𝕍\[f\(𝐱\)\]=ϕ\(𝐱\)⊤\[𝐈P−𝐅\(𝐅\+σ2𝐈P\)−1\]ϕ\(𝐱\),\\mathbb\{V\}\[f\(\\mathbf\{x\}\)\]=\\phi\(\\mathbf\{x\}\)^\{\\top\}\\left\[\\mathbf\{I\}\_\{P\}\-\\mathbf\{F\}\\left\(\\mathbf\{F\}\+\\sigma^\{2\}\\mathbf\{I\}\_\{P\}\\right\)^\{\-1\}\\right\]\\phi\(\\mathbf\{x\}\),\(2\)where𝐅=𝚽⊤𝚽∈ℝP×P\\mathbf\{F\}=\\mathbf\{\\Phi\}^\{\\top\}\\mathbf\{\\Phi\}\\in\\mathbb\{R\}^\{P\\times P\}is the empirical feature covariance matrix\. Equation \([2](https://arxiv.org/html/2609.00488#S4.E2)\) motivates a direct geometric interpretation in the interpolative limitσ2→0\+\\sigma^\{2\}\\to 0^\{\+\}\. In this limit, 𝐅\(𝐅\+σ2𝐈P\)−1⟶𝐏∥=𝐅\+𝐅,\\mathbf\{F\}\\left\(\\mathbf\{F\}\+\\sigma^\{2\}\\mathbf\{I\}\_\{P\}\\right\)^\{\-1\}\\longrightarrow\\mathbf\{P\}\_\{\\parallel\}=\\mathbf\{F\}^\{\+\}\\mathbf\{F\},\(3\)where𝐅\+\\mathbf\{F\}^\{\+\}denotes the Moore–Penrose pseudoinverse and𝐏∥\\mathbf\{P\}\_\{\\parallel\}is the orthogonal projector onto the subspace spanned by the training features\. Consequently, the residual operator converges to the orthogonal projector onto the complementary subspace,𝐏⟂=𝐈P−𝐏∥\.\\mathbf\{P\}\_\{\\perp\}=\\mathbf\{I\}\_\{P\}\-\\mathbf\{P\}\_\{\\parallel\}\.Substituting this limiting form into Eq\. \([2](https://arxiv.org/html/2609.00488#S4.E2)\) gives limσ2→0\+𝕍\[f\(𝐱\)\]=ϕ\(𝐱\)⊤𝐏⟂ϕ\(𝐱\)=‖𝐏⟂ϕ\(𝐱\)‖22\.\\lim\_\{\\sigma^\{2\}\\to 0^\{\+\}\}\\mathbb\{V\}\[f\(\\mathbf\{x\}\)\]=\\phi\(\\mathbf\{x\}\)^\{\\top\}\\mathbf\{P\}\_\{\\perp\}\\phi\(\\mathbf\{x\}\)=\\left\\\|\\mathbf\{P\}\_\{\\perp\}\\phi\(\\mathbf\{x\}\)\\right\\\|\_\{2\}^\{2\}\.Thus, in the noiseless limit, GP predictive uncertainty corresponds to the squared Euclidean distance of the query featureϕ\(𝐱\)\\phi\(\\mathbf\{x\}\)from the subspace spanned by the training features in NTK feature space\. A query whose tangent representation lies entirely within this subspace has vanishing uncertainty, whereas components orthogonal to the training\-feature subspace contribute directly to the predictive variance\. For any finiteσ2\>0\\sigma^\{2\}\>0, Eq\. \([2](https://arxiv.org/html/2609.00488#S4.E2)\) can equivalently be written as 𝕍\[f\(𝐱\)\]=σ2ϕ\(𝐱\)⊤\(𝐅\+σ2𝐈P\)−1ϕ\(𝐱\)\.\\mathbb\{V\}\[f\(\\mathbf\{x\}\)\]=\\sigma^\{2\}\\phi\(\\mathbf\{x\}\)^\{\\top\}\\left\(\\mathbf\{F\}\+\\sigma^\{2\}\\mathbf\{I\}\_\{P\}\\right\)^\{\-1\}\\phi\(\\mathbf\{x\}\)\.\(4\)The quadratic form in Eq\. \([4](https://arxiv.org/html/2609.00488#S4.E4)\) can be interpreted as a regularized squared Mahalanobis norm of the feature representationϕ\(𝐱\)\\phi\(\\mathbf\{x\}\), with the metric determined by the regularized empirical feature covariance matrix\. This provides a continuous extension of the subspace\-distance interpretation above: feature\-space directions that are weakly represented by the training data contribute more strongly to the uncertainty, whereas directions that are well represented are increasingly suppressed\. Motivated by this form, we define the empirical NTK uncertainty as U\(𝐱\)=λϕ\(𝐱\)⊤\(𝐅\+λ𝐈P\)−1ϕ\(𝐱\),U\(\\mathbf\{x\}\)=\\lambda\\phi\(\\mathbf\{x\}\)^\{\\top\}\\left\(\\mathbf\{F\}\+\\lambda\\mathbf\{I\}\_\{P\}\\right\)^\{\-1\}\\phi\(\\mathbf\{x\}\),\(5\)whereλ\>0\\lambda\>0is a tunable regularization parameter\. For conservative neural\-network potentials, we takeϕ\(𝐱\)=∇θE\(𝐱,θ\)\\phi\(\\mathbf\{x\}\)=\\nabla\_\{\\theta\}E\(\\mathbf\{x\};\\theta\)whereE\(𝐱,θ\)E\(\\mathbf\{x\};\\theta\)denotes the predicted energy andθ\\thetathe model parameters\. Since forces are obtained by differentiating the predicted energy with respect to atomic coordinates, these energy\-gradient features encode the structure\-dependent sensitivity of the learned potential\-energy surface to perturbations in parameter space\. Although they do not directly represent force errors, we empirically find that the resulting uncertainty correlates strongly with force prediction error\. Direct evaluation of Eq\. \([5](https://arxiv.org/html/2609.00488#S4.E5)\) in the full parameter space is computationally expensive becauseϕ\(𝐱\)∈ℝP\\phi\(\\mathbf\{x\}\)\\in\\mathbb\{R\}^\{P\}is high\-dimensional for over\-parametrized neural\-network potentials\. We therefore introduce a randomized sketch that projects the NTK feature map into a lower\-dimensional space while approximately preserving the geometry relevant to the uncertainty score\. ###### Theorem 4\.1\(Regularization\-aware preservation of NTK uncertainty\)\. LetΦ∈ℝn×P\\Phi\\in\\mathbb\{R\}^\{n\\times P\}have rowsϕ\(xi\)⊤\\phi\(x\_\{i\}\)^\{\\top\}, letF=Φ⊤ΦF=\\Phi^\{\\top\}\\Phi, and let𝒳\\mathcal\{X\}be a fixed set ofmmqueries\. For eachx∈𝒳x\\in\\mathcal\{X\}, letZxZ\_\{x\}beΦ\\Phiwith the rowϕ\(x\)⊤\\phi\(x\)^\{\\top\}appended, and define dλ=maxx∈𝒳tr\[ZxZx⊤\(ZxZx⊤\+λIn\+1\)−1\]\.d\_\{\\lambda\}=\\max\_\{x\\in\\mathcal\{X\}\}\\operatorname\{tr\}\\\!\\left\[Z\_\{x\}Z\_\{x\}^\{\\top\}\\bigl\(Z\_\{x\}Z\_\{x\}^\{\\top\}\+\\lambda I\_\{n\+1\}\\bigr\)^\{\-1\}\\right\]\.LetS∈ℝp×PS\\in\\mathbb\{R\}^\{p\\times P\}have independentSij∼𝒩\(0,1/p\)S\_\{ij\}\\sim\\mathcal\{N\}\(0,1/p\), setϕ~\(x\)=Sϕ\(x\)\\widetilde\{\\phi\}\(x\)=S\\phi\(x\)andF~=SFS⊤\\widetilde\{F\}=SFS^\{\\top\}, and defineU~\(x\)=λϕ~\(x\)⊤\(F~\+λIp\)−1ϕ~\(x\)\\widetilde\{U\}\(x\)=\\lambda\\widetilde\{\\phi\}\(x\)^\{\\top\}\(\\widetilde\{F\}\+\\lambda I\_\{p\}\)^\{\-1\}\\widetilde\{\\phi\}\(x\)\. There is an absolute constantCCsuch that, for0<ϵ<10<\\epsilon<1, if p≥Cϵ−2\(dλ\+logmδ\),p\\geq C\\epsilon^\{\-2\}\\\!\\left\(d\_\{\\lambda\}\+\\log\\frac\{m\}\{\\delta\}\\right\),then with probability at least1−δ1\-\\delta, simultaneously for allx∈𝒳x\\in\\mathcal\{X\}, \|U~\(x\)−U\(x\)\|≤ϵ\(λ\+U\(x\)\)\.\|\\widetilde\{U\}\(x\)\-U\(x\)\|\\leq\\epsilon\\bigl\(\\lambda\+U\(x\)\\bigr\)\. Theorem[4\.1](https://arxiv.org/html/2609.00488#S4.Thmtheorem1)shows that, for a fixed set of queries, a Gaussian sketch of dimension controlled by the ridge effective dimension is sufficient to preserve the full\-space NTK uncertainty uniformly, up to a regularization\-aware error of orderϵ\(λ\+U\(x\)\)\\epsilon\(\\lambda\+U\(x\)\)\. The effective dimension is a sum of shrinkage factorssj2/\(sj2\+λ\)s\_\{j\}^\{2\}/\(s\_\{j\}^\{2\}\+\\lambda\)and may be far below bothPPand the feature rank\. This allowsU\(x\)U\(x\)to be evaluated in a substantially lower\-dimensional space while closely preserving the full\-space uncertainty\. ###### Corollary 4\.2\(AdaptNTK decision stability\)\. For aBB\-step full\-space greedy path, augmentΦ\\Phiwith previously selected features and letdλALd\_\{\\lambda\}^\{\\rm AL\}be the maximum ridge effective dimension over all steps and remaining candidates\. ReplacemmbyBmBmanddλd\_\{\\lambda\}bydλALd\_\{\\lambda\}^\{\\rm AL\}in Theorem[4\.1](https://arxiv.org/html/2609.00488#S4.Thmtheorem1)\. IfUt\(1\)U\_\{t\}^\{\(1\)\}andUt\(2\)U\_\{t\}^\{\(2\)\}are the two largest full\-space scores at stepttand mint<BUt\(1\)−Ut\(2\)2λ\+Ut\(1\)\+Ut\(2\)\>ϵ,\\min\_\{t<B\}\\frac\{U\_\{t\}^\{\(1\)\}\-U\_\{t\}^\{\(2\)\}\}\{2\\lambda\+U\_\{t\}^\{\(1\)\}\+U\_\{t\}^\{\(2\)\}\}\>\\epsilon,then the sketched and full\-space rules select the same ordered batch\. Corollary[4\.2](https://arxiv.org/html/2609.00488#S4.Thmtheorem2)gives the corresponding active\-learning consequence\. Once the sketch error is smaller than the relevant gaps between acquisition scores, the sketched and full\-space rules select the same ordered batch\. Thus, beyond a sufficient sketch dimension, increasingppneed not change the selected configurations, consistent with our experiments \(Table[3](https://arxiv.org/html/2609.00488#A2.T3)\)\. Full proofs are provided in Appendix[A](https://arxiv.org/html/2609.00488#A1)\. ### 4\.2Sequential acquisition with rank\-one updates Common uncertainty\-based active\-learning \(AL\) strategies, such as query\-by\-committee \(QBC\), score candidate configurations using uncertainty estimates from the current model\. Selecting the top\-BBconfigurations according to these fixed scores does not account for redundancy among selected points, since acquiring an informative configuration can reduce the uncertainty of nearby configurations\. This issue is particularly relevant for trajectory\-generated candidate pools, where configurations are often strongly correlated\. Accounting for this reduction after each acquisition would require updating the uncertainty estimate sequentially, which for conventional neural\-network uncertainty methods generally entails repeated model fitting or inference and can be computationally expensive\. We address this limitation with a greedy acquisition strategy that updates uncertainty after each selected configuration without retraining the network\. Our approach builds on the Mahalanobis characterization of predictive uncertainty in NTK feature space \(Section[4\.1](https://arxiv.org/html/2609.00488#S4.SS1)\), which provides a geometric description of how uncertainty changes as configurations are incorporated\. Directly recomputing this quantity after every selection would require repeated inversion of the feature covariance matrix, with𝒪\(p3\)\\mathcal\{O\}\(p^\{3\}\)cost per update\. Instead, we exploit the rank\-one structure induced by each newly selected configuration and derive an efficient recursive update using the Sherman–Morrison identity\. Let𝐂k=𝐅k\+λ𝐈P\\mathbf\{C\}\_\{k\}=\\mathbf\{F\}\_\{k\}\+\\lambda\\mathbf\{I\}\_\{P\}denote the regularized feature covariance at iterationkk\. The predictive uncertainty for a query𝐱\\mathbf\{x\}is estimated asUk\(𝐱\)=λϕ\(𝐱\)⊤𝐂k−1ϕ\(𝐱\)U\_\{k\}\(\\mathbf\{x\}\)=\\lambda\\phi\(\\mathbf\{x\}\)^\{\\top\}\\mathbf\{C\}\_\{k\}^\{\-1\}\\phi\(\\mathbf\{x\}\), whereλ\\lambdais calibrated on the validation set\. Upon acquiring a new point𝐱new\\mathbf\{x\}\_\{new\}, the covariance updates as 𝐂k\+1=𝐂k\+ϕ\(𝐱new\)ϕ\(𝐱new\)⊤\.\\mathbf\{C\}\_\{k\+1\}=\\mathbf\{C\}\_\{k\}\+\\phi\(\\mathbf\{x\}\_\{new\}\)\\phi\(\\mathbf\{x\}\_\{new\}\)^\{\\top\}\. Applying the Sherman–Morrison identity yields: 𝐂k\+1−1=𝐂k−1−𝐂k−1ϕ\(𝐱new\)ϕ\(𝐱new\)⊤𝐂k−11\+ϕ\(𝐱new\)⊤𝐂k−1ϕ\(𝐱new\)\.\\mathbf\{C\}\_\{k\+1\}^\{\-1\}=\\mathbf\{C\}\_\{k\}^\{\-1\}\-\\frac\{\\mathbf\{C\}\_\{k\}^\{\-1\}\\phi\(\\mathbf\{x\}\_\{new\}\)\\phi\(\\mathbf\{x\}\_\{new\}\)^\{\\top\}\\mathbf\{C\}\_\{k\}^\{\-1\}\}\{1\+\\phi\(\\mathbf\{x\}\_\{new\}\)^\{\\top\}\\mathbf\{C\}\_\{k\}^\{\-1\}\\phi\(\\mathbf\{x\}\_\{new\}\)\}\.\(6\) Substituting into the definition ofUk\+1\(𝐱\)U\_\{k\+1\}\(\\mathbf\{x\}\)gives the recursive update: Uk\+1\(𝐱\)=Uk\(𝐱\)−U~k\(𝐱,𝐱new\)2λ\+Uk\(𝐱new\),U\_\{k\+1\}\(\\mathbf\{x\}\)=U\_\{k\}\(\\mathbf\{x\}\)\-\\frac\{\\widetilde\{U\}\_\{k\}\(\\mathbf\{x\},\\mathbf\{x\}\_\{new\}\)^\{2\}\}\{\\lambda\+U\_\{k\}\(\\mathbf\{x\}\_\{new\}\)\},\(7\)whereU~k\(𝐱,𝐱new\)=λϕ\(𝐱\)⊤𝐂k−1ϕ\(𝐱new\)\\widetilde\{U\}\_\{k\}\(\\mathbf\{x\},\\mathbf\{x\}\_\{new\}\)=\\lambda\\phi\(\\mathbf\{x\}\)^\{\\top\}\\mathbf\{C\}\_\{k\}^\{\-1\}\\phi\(\\mathbf\{x\}\_\{new\}\)\. This yields an𝒪\(p2\)\\mathcal\{O\}\(p^\{2\}\)update for sequential active learning, where uncertainty is reduced according to the squared geometric correlation between the query and the newly acquired configuration\. Updating𝐂k−1\\mathbf\{C\}\_\{k\}^\{\-1\}costs𝒪\(p2\)\\mathcal\{O\}\(p^\{2\}\)\. Once𝐂k−1ϕ~\(𝐱new\)\\mathbf\{C\}\_\{k\}^\{\-1\}\\widetilde\{\\phi\}\(\\mathbf\{x\}\_\{\\mathrm\{new\}\}\)is computed, rescoring a pool ofmmremaining configurations requires only𝒪\(mp\)\\mathcal\{O\}\(mp\)\. ## 5Experiments We first demonstrate that NTK\-based uncertainty identifies large prediction errors, retains low\-error predictions under selective retention, and can be calibrated\. We then use AdaptNTK to show that this uncertainty remains effective when used as a sequential acquisition rule, followed by analyses of sketch size and computational cost\. All methods use the same MACE architecture and training loss\. For the active\-learning comparisons, we use a fixed data split and random seeds shared across methods\. Full experimental protocols are provided in Appendix[C](https://arxiv.org/html/2609.00488#A3)\. ### 5\.1Uncertainty quantification To evaluate uncertainty quality, we compare the NTK\-based uncertainty with standard approaches based on deep ensembles, Monte Carlo dropout \(MCD\), evidential deep learning \(EDL\), and stochastic weight averaging\-Gaussian \(SWAG\) on held\-out configurations from the rMD17 dataset\. For each method, the estimated uncertainty is compared with the per\-configuration force RMSE of the corresponding model\. Table[1](https://arxiv.org/html/2609.00488#S5.T1)reports error correlation, error\-retention performance, and post\-hoc calibration\. Table 1:Performance of uncertainty\-quantification methods on held\-out configurations from the rMD17 dataset\. Metrics are computed against each method’s corresponding model and averaged across molecules\. AURCnis normalized by oracle and random retention orderings, and ENCE is computed after out\-of\-fold recalibration; both are therefore comparable across rows\. Bold indicates the best value in each column\.The NTK\-based uncertainty shows the strongest linear and rank association with prediction error \(ρp=0\.706\\rho\_\{p\}=0\.706,ρs=0\.683\\rho\_\{s\}=0\.683\)\. Its rank correlation is slightly higher than that of the three\-member ensemble \(0\.6420\.642\), while its AURCnis comparable \(0\.3120\.312versus0\.3100\.310\)\. These results indicate that a single trained network can provide uncertainty discrimination comparable to an ensemble\. The differences relative to SWAG, MCD, and EDL are larger for both correlation and error\-retention performance\. Calibration and discrimination measure different properties\. MCD achieves the best ENCE after two\-parameter recalibration, yet itsρs=0\.348\\rho\_\{s\}=0\.348and AURCn=0\.633\{\}\_\{n\}=0\.633indicate substantially weaker ranking performance\. A low ENCE can therefore coexist with limited acquisition utility, since recalibration can correct the overall uncertainty scale but does not alter the ranking\. The NTK\-based uncertainty is the only method that ranks among the top two for both discrimination metrics and ENCE\. Figure[1](https://arxiv.org/html/2609.00488#S5.F1)further illustrates that the NTK\-based uncertainty and the ensemble maintain a broader and more ordered spread of uncertainty values\. \(a\)NTK \(b\)Ensemble \(c\)MC dropout \(d\)Evidential \(e\)SWAG Figure 1:Per\-configuration force error versus predicted uncertainty on held\-out aspirin configurations from rMD17\. Each point is one configuration; both axes are logarithmic and in kcal mol\-1Å\-1, the uncertainty having been recalibrated onto the error scale, so the dashed line marksy=xy=x\. Insets give the Spearman correlationρs\\rho\_\{s\}, which is invariant to calibration\. Panel \(d\) uses a scale\-only calibration \(Appendix[C\.5](https://arxiv.org/html/2609.00488#A3.SS5.SSS0.Px2)\), and each method is scored against its own trained model\. ### 5\.2Comparison of data efficiency Figure 2:Active\-learning performance for atomic force prediction\. AdaptNTK is compared with established active\-learning baselines \(QBC, MCD, EDL, and SWAG\) for four molecules from the rMD17 dataset\. The y\-axis \(log scale\) shows force RMSE \(kcal mol\-1Å\-1\) on a holdout set as the training\-set size increases\. Shaded areas represent standard deviations in force errors averaged across three runs\. AdaptNTK achieves faster convergence and lower absolute error than the baseline methods in all cases\.#### 5\.2\.1Active learning on rMD17 We next evaluate AdaptNTK’s greedy sequential updates for active\-learning acquisition\. For each rMD17 molecule, 25,000 configurations are held out for testing, 50 fixed configurations initialize the training set, and the remaining configurations form the candidate pool\. We report 20 checkpoints, including the initial model, as the labeled set grows from 50 to 1,000 configurations in increments of 50\. All methods use the same fixed seeds, data split, architecture, and optimization schedule\. Across acquisition budgets, AdaptNTK attains the lowest mean force RMSE for aspirin, naphthalene, paracetamol, and salicylic acid \(Figure[2](https://arxiv.org/html/2609.00488#S5.F2)\)\. Its advantage is largest at small and intermediate label budgets, where accounting for redundancy among selected configurations is most beneficial\. The gap narrows at 1,000 labels, as all methods obtain broader coverage of the candidate pool\. #### 5\.2\.2Reactive configurations in Transition\-1X The rMD17 candidate pool and test set are drawn from the same molecular trajectories\. To evaluate whether AdaptNTK can identify rare reactive configurations and support generalization across diverse molecules, we test performance on the Transition\-1X dataset\. We report results on both the general test split and a transition\-state split, which isolates configurations near chemical transitions whose errors can be obscured when averaged over the broader test distribution\. AdaptNTK reduces force error most rapidly across the acquisition budget \(Figure[3\(a\)](https://arxiv.org/html/2609.00488#S5.F3.sf1)\)\. It reaches a force RMSE of approximately44kcal mol\-1Å\-1with about 450 labeled configurations; QBC requires close to 1,000, while the remaining baselines do not reach this level within the displayed budget\. At 1,000 configurations, AdaptNTK reaches approximately11kcal mol\-1Å\-1, compared with roughly44for QBC,66–77for MCD and SWAG, and1111for EDL\. Performance on the transition\-state split shows the same ordering for both energy and force errors \(Figure[3\(b\)](https://arxiv.org/html/2609.00488#S5.F3.sf2)\)\. Values quoted here are rounded from the plotted curves for readability; all evaluations use the corresponding unrounded values\. \(a\)Learning curves \(b\)Transition\-state metrics Figure 3:Active\-learning performance on Transition\-1X\. AdaptNTK outperforms standard uncertainty\-based active\-learning methods, reaching comparable accuracy with less than half the labeled data required by the competing approaches\. Transition\-state error metrics are shown at 1,000 training configurations\. The logarithmic vertical axes report force RMSE inkcalmol−1Å−1\\mathrm\{kcal\\,mol^\{\-1\}\\,\\mathring\{A\}^\{\-1\}\}and energy MAE inkcalmol−1\\mathrm\{kcal\\,mol^\{\-1\}\}on the held\-out test set\. #### 5\.2\.3Ablations To assess the contribution of recursive uncertainty updates, we compare AdaptNTK with a non\-adaptive top\-BBbaseline that scores the candidate pool once per 50\-configuration batch and does not update uncertainty after selection\. Sequential AdaptNTK performs consistently better throughout acquisition on Transition\-1X, reaching a force RMSE of approximately1\.21\.2versus33kcal mol\-1Å\-1for the non\-adaptive baseline \(Figure[4](https://arxiv.org/html/2609.00488#A2.F4)in Appendix[B](https://arxiv.org/html/2609.00488#A2)\)\. The non\-adaptive variant also consistently outperforms QBC at nearly all acquisition budgets, reflecting the stronger correlation between NTK uncertainty and prediction error\. Random acquisition performs worse than both variants and QBC throughout the acquisition budget\. We also vary the sketch dimension fromp=128p=128to20482048\. Final force RMSE ranges from1\.221\.22to1\.341\.34kcal mol\-1Å\-1, with overlapping one\-standard\-deviation intervals and no monotonic improvement at larger sketch dimensions \(Table[3](https://arxiv.org/html/2609.00488#A2.T3)in Appendix[B](https://arxiv.org/html/2609.00488#A2)\), consistent with Corollary[4\.2](https://arxiv.org/html/2609.00488#S4.Thmtheorem2)\. ### 5\.3Computational overhead AdaptNTK completes the reported timing run in 2,423 s, compared with 6,225 s for QBC, corresponding to a2\.57×2\.57\\timesreduction in total runtime\. This saving is driven primarily by model training and uncertainty evaluation: training a single model and computing its tangent features requires 1,748 s, whereas training the three\-member QBC ensemble and evaluating all three models on every candidate structure requires 6,063 s\. The label\-free rank\-one updates require no additional model fitting, and sequentially rescoring a candidate pool of approximately 75,000 structures after each selection requires only 676 s\. Despite performing these adaptive updates throughout acquisition, AdaptNTK remains computationally competitive with other single\-model approaches: its total runtime is within 6% of MCD and 2% of SWAG, while substantially reducing the cost relative to QBC\. Combined with the stronger learning curves in Figures[2](https://arxiv.org/html/2609.00488#S5.F2)and[3\(a\)](https://arxiv.org/html/2609.00488#S5.F3.sf1), these results show that AdaptNTK achieves improved data efficiency while retaining the computational advantages of a single\-model approach\. Table 2:Computational overhead of active\-learning methods\. Execution time \(in seconds\) for pretraining and uncertainty quantification \(UQ\), batch selection, and the total active\-learning cycle on the Transition\-1X dataset\. ## 6Limitations The experiments have several important limitations\. First, we evaluate uncertainty quality and active\-learning performance for gas\-phase molecules; extending this analysis to periodic systems is an important next step\. Second, the uncertainty is constructed from energy\-gradient features, which relate to force errors only indirectly\. Features based on force\-parameter Jacobians would provide a more direct representation, but are substantially larger\. Third, force errors can be poor indicators of downstream simulation performance, and the relationship between uncertainty in predicted forces and uncertainty in simulation observables remains to be characterized\. Finally, our active\-learning comparisons focus on uncertainty\-based methods and do not include dedicated diversity\-based or chemistry\-informed acquisition strategies\. Diversity could, for example, be incorporated after uncertainty filtering by clustering or selecting diverse structures among the most uncertain configurations\. Thus, our experiments demonstrate that NTK\-based uncertainty provides an effective signal for active learning, rather than establishing AdaptNTK as superior to acquisition strategies that incorporate chemical intuition or other post\-hoc selection heuristics\. ## 7Conclusion The NTK\-based uncertainty converts a trained neural potential into a post\-hoc, pointwise uncertainty estimate without a committee or learned uncertainty head\. It achieves the strongest error correlations across the four rMD17 molecules and nearly matches the three\-member ensemble in error retention\. AdaptNTK provides the downstream active\-learning demonstration: the same uncertainty can be updated within an acquisition batch without reference labels or additional model fitting, and achieves the lowest reported errors in the rMD17 and Transition\-1X studies\. The top\-BBablation supports the value of sequential updates, while the sketch\-dimension sweep shows no observed benefit beyondp=128p=128\. Comparisons with broader acquisition baselines and extensions to periodic systems remain important directions for future work\. ## Acknowledgments We acknowledge startup funding from Cornell University and computing resources provided by the Cornell University Center for Advanced Computing \(CAC\)\. ## References - Aminiet al\.\(2020\)A\. Amini, W\. Schwarting, A\. Soleimany, and D\. RusDeep evidential regression\.InAdvances in Neural Information Processing Systems,Vol\.33,pp\. 14927–14937\.Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p3.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Ashet al\.\(2020\)J\. T\. Ash, C\. Zhang, A\. Krishnamurthy, J\. Langford, and A\. AgarwalDeep batch active learning by diverse, uncertain gradient lower bounds\.InInternational Conference on Learning Representations \(ICLR\),Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p2.1)\. - Bartóket al\.\(2010\)A\. P\. Bartók, M\. C\. Payne, R\. Kondor, and G\. CsányiGaussian approximation potentials: the accuracy of quantum mechanics, without the electrons\.Physical Review Letters104\(13\),pp\. 136403\.Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p1.1)\. - Batatiaet al\.\(2022\)I\. Batatia, D\. P\. Kovács, G\. N\. C\. Simm, C\. Ortner, and G\. CsányiMACE: higher order equivariant message passing neural networks for fast and accurate force fields\.InAdvances in Neural Information Processing Systems,Vol\.35,pp\. 11423–11436\.External Links:2206\.07697Cited by:[§C\.3](https://arxiv.org/html/2609.00488#A3.SS3.p1.1),[§1](https://arxiv.org/html/2609.00488#S1.p1.1)\. - Batzneret al\.\(2022\)S\. Batzner, A\. Musaelian, L\. Sun, M\. Geiger, J\. P\. Mailoa, M\. Kornbluth, N\. Molinari, T\. E\. Smidt, and B\. KozinskyE\(3\)\-equivariant graph neural networks for data\-efficient and accurate interatomic potentials\.Nature Communications13,pp\. 2453\.Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p1.1)\. - Becket al\.\(2025\)H\. Beck, P\. Simko, L\. L\. Schaaf, O\. Marsalek, and C\. SchranMulti\-head committees enable direct uncertainty prediction for atomistic foundation models\.The Journal of Chemical Physics163\(23\),pp\. 234103\.Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Behler and Parrinello \(2007\)J\. Behler and M\. ParrinelloGeneralized neural\-network representation of high\-dimensional potential\-energy surfaces\.Physical Review Letters98\(14\),pp\. 146401\.Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p1.1)\. - Bigiet al\.\(2024\)F\. Bigi, S\. Chong, M\. Ceriotti, and F\. GrasselliA prediction rigidity formalism for low\-cost uncertainties in trained neural networks\.Machine Learning: Science and Technology5\(4\),pp\. 045018\.Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Bilbreyet al\.\(2025\)J\. A\. Bilbrey, J\. S\. Firoz, M\. Lee, and S\. ChoudhuryUncertainty quantification for neural network potential foundation models\.npj Computational Materials11,pp\. 109\.Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Chonget al\.\(2025\)S\. Chong, F\. Bigi, F\. Grasselli, P\. Loche, M\. Kellner, and M\. CeriottiPrediction rigidities for data\-driven chemistry\.Faraday Discussions256,pp\. 322–344\.Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Christensen and von Lilienfeld \(2020\)A\. S\. Christensen and O\. A\. von LilienfeldRevised MD17 dataset \(rMD17\)\.Materials Cloud Archive\.Note:Materials Cloud Archive 2020\.82[https://doi\.org/10\.24435/materialscloud:wy\-kn](https://doi.org/10.24435/materialscloud:wy-kn)External Links:[Document](https://dx.doi.org/10.24435/materialscloud%3Awy-kn)Cited by:[3rd item](https://arxiv.org/html/2609.00488#S1.I1.i3.p1.1)\. - Cosciaet al\.\(2026\)D\. Coscia, P\. D\. Haan, and M\. WellingBLIPs: bayesian learned interatomic potentials\.InForty\-third International Conference on Machine Learning,Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Gal and Ghahramani \(2016\)Y\. Gal and Z\. GhahramaniDropout as a Bayesian approximation: representing model uncertainty in deep learning\.InProceedings of the 33rd International Conference on Machine Learning \(ICML\),PMLR, Vol\.48,pp\. 1050–1059\.Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p3.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Hoet al\.\(2026\)C\. H\. Ho, C\. Ortner, and Y\. WangFlexible uncertainty calibration for machine\-learned interatomic potentials\.npj Computational Materials\.Note:arXiv:2510\.00721External Links:[Document](https://dx.doi.org/10.1038/s41524-026-02080-3)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Holzmülleret al\.\(2023\)D\. Holzmüller, V\. Zaverkin, J\. Kästner, and I\. SteinwartA framework and benchmark for deep batch active learning for regression\.Journal of Machine Learning Research24\(164\),pp\. 1–81\.External Links:[Link](https://www.jmlr.org/papers/v24/22-0937.html)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p2.1)\. - Jacotet al\.\(2018\)A\. Jacot, F\. Gabriel, and C\. HonglerNeural tangent kernel: convergence and generalization in neural networks\.InAdvances in Neural Information Processing Systems,Vol\.31\.External Links:1806\.07572Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p4.1),[§3\.2](https://arxiv.org/html/2609.00488#S3.SS2.p1.1)\. - Kahle and Zipoli \(2022\)L\. Kahle and F\. ZipoliQuality of uncertainty estimates from neural network potential ensembles\.Physical Review E105\(1\),pp\. 015311\.External Links:[Document](https://dx.doi.org/10.1103/PhysRevE.105.015311)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Kellner and Ceriotti \(2024\)M\. Kellner and M\. CeriottiUncertainty quantification by direct propagation of shallow ensembles\.Machine Learning: Science and Technology5\(3\),pp\. 035006\.External Links:[Document](https://dx.doi.org/10.1088/2632-2153/ad594a)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Koltchinskii and Lounici \(2017\)V\. Koltchinskii and K\. LouniciConcentration inequalities and moment bounds for sample covariance operators\.Bernoulli23\(1\),pp\. 110–133\.External Links:[Document](https://dx.doi.org/10.3150/15-BEJ730),[Link](https://doi.org/10.3150/15-BEJ730)Cited by:[Appendix A](https://arxiv.org/html/2609.00488#A1.p2.4)\. - Lakshminarayananet al\.\(2017\)B\. Lakshminarayanan, A\. Pritzel, and C\. BlundellSimple and scalable predictive uncertainty estimation using deep ensembles\.InAdvances in Neural Information Processing Systems,Vol\.30\.Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Leeet al\.\(2019\)J\. Lee, L\. Xiao, S\. S\. Schoenholz, Y\. Bahri, R\. Novak, J\. Sohl\-Dickstein, and J\. PenningtonWide neural networks of any depth evolve as linear models under gradient descent\.InAdvances in Neural Information Processing Systems,Vol\.32\.Cited by:[§3\.2](https://arxiv.org/html/2609.00488#S3.SS2.p1.1)\. - Maddoxet al\.\(2019\)W\. J\. Maddox, P\. Izmailov, T\. Garipov, D\. P\. Vetrov, and A\. G\. WilsonA simple baseline for Bayesian uncertainty in deep learning\.InAdvances in Neural Information Processing Systems,Vol\.32\.Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p3.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Mamunet al\.\(2026\)O\. Mamun, C\. Yang, and S\. YueDeep graph kernel learning for material & atomic level uncertainty quantification in adsorption energy prediction\.Digital Discovery5\(4\),pp\. 1568–1578\.External Links:[Document](https://dx.doi.org/10.1039/D6DD00020G)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Musaelianet al\.\(2023\)A\. Musaelian, S\. Batzner, A\. Johansson, L\. Sun, C\. J\. Owen, M\. Kornbluth, and B\. KozinskyLearning local equivariant representations for large\-scale atomistic dynamics\.Nature Communications14,pp\. 579\.External Links:[Document](https://dx.doi.org/10.1038/s41467-023-36329-y)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p1.1)\. - Perezet al\.\(2025\)D\. Perez, A\. P\. Subramanyam, I\. Maliyov, and T\. D\. SwinburneUncertainty quantification for misspecified machine learned interatomic potentials\.npj Computational Materials\.External Links:[Document](https://dx.doi.org/10.1038/s41524-025-01758-4)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Podryabinkin and Shapeev \(2017\)E\. V\. Podryabinkin and A\. V\. ShapeevActive learning of linearly parametrized interatomic potentials\.Computational Materials Science140,pp\. 171–180\.External Links:[Document](https://dx.doi.org/10.1016/j.commatsci.2017.08.031)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p4.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Rasmussen and Williams \(2006\)C\. E\. Rasmussen and C\. K\. I\. WilliamsGaussian processes for machine learning\.MIT Press\.Cited by:[§3\.1](https://arxiv.org/html/2609.00488#S3.SS1.p1.1)\. - Schreineret al\.\(2022\)M\. Schreiner, A\. Bhowmik, T\. Vegge, J\. Busk, and O\. WintherTransition1x — a dataset for building generalizable reactive machine learning potentials\.Scientific Data9\(1\),pp\. 779\.External Links:[Document](https://dx.doi.org/10.1038/s41597-022-01870-w)Cited by:[3rd item](https://arxiv.org/html/2609.00488#S1.I1.i3.p1.1)\. - Sener and Savarese \(2018\)O\. Sener and S\. SavareseActive learning for convolutional neural networks: a core\-set approach\.InInternational Conference on Learning Representations \(ICLR\),Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p2.1)\. - Seunget al\.\(1992\)H\. S\. Seung, M\. Opper, and H\. SompolinskyQuery by committee\.InProceedings of the Fifth Annual Workshop on Computational Learning Theory \(COLT\),pp\. 287–294\.External Links:[Document](https://dx.doi.org/10.1145/130385.130417)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p3.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Smithet al\.\(2018\)J\. S\. Smith, B\. Nebgen, N\. Lubbers, O\. Isayev, and A\. E\. RoitbergLess is more: sampling chemical space with active learning\.The Journal of Chemical Physics148\(24\),pp\. 241733\.External Links:[Document](https://dx.doi.org/10.1063/1.5023802)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p3.1),[§1](https://arxiv.org/html/2609.00488#S1.p4.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Soleimanyet al\.\(2021\)A\. P\. Soleimany, A\. Amini, S\. Goldman, D\. Rus, S\. N\. Bhatia, and C\. W\. ColeyEvidential deep learning for guided molecular property prediction and discovery\.ACS Central Science7\(8\),pp\. 1356–1367\.External Links:[Document](https://dx.doi.org/10.1021/acscentsci.1c00546)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p3.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Tanet al\.\(2023\)A\. R\. Tan, S\. Urata, S\. Goldman, J\. C\. B\. Dietschreit, and R\. Gómez\-BombarelliSingle\-model uncertainty quantification in neural network potentials does not consistently outperform model ensembles\.npj Computational Materials9,pp\. 225\.External Links:[Document](https://dx.doi.org/10.1038/s41524-023-01180-8)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Unkeet al\.\(2021\)O\. T\. Unke, S\. Chmiela, H\. E\. Sauceda, M\. Gastegger, I\. Poltavsky, K\. T\. Schütt, A\. Tkatchenko, and K\. MüllerMachine learning force fields\.Chemical Reviews121\(16\),pp\. 10142–10186\.External Links:[Document](https://dx.doi.org/10.1021/acs.chemrev.0c01111)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p1.1)\. - Vandermauseet al\.\(2020\)J\. Vandermause, S\. B\. Torrisi, S\. Batzner, Y\. Xie, L\. Sun, A\. M\. Kolpak, and B\. KozinskyOn\-the\-fly active learning of interpretable bayesian force fields for atomistic rare events\.npj Computational Materials6,pp\. 20\.External Links:[Document](https://dx.doi.org/10.1038/s41524-020-0283-z)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p4.1)\. - Varga\-Umbrichet al\.\(2026a\)E\. Varga\-Umbrich, S\. Surana, P\. Duckworth, J\. Tilly, O\. Peltre, and Z\. Weller\-DaviesPretrained model representations as acquisition signals for active learning of MLIPs\.arXiv preprint arXiv:2605\.03964\.External Links:[Link](https://arxiv.org/abs/2605.03964)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p2.1)\. - Varga\-Umbrichet al\.\(2026b\)E\. Varga\-Umbrich, Z\. Weller\-Davies, P\. Duckworth, J\. Tilly, O\. Peltre, and S\. SuranaForce\-aware neural tangent kernels for scalable and robust active learning of MLIPs\.External Links:2605\.13788Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p2.1)\. - Vitaet al\.\(2025\)J\. A\. Vita, A\. Samanta, F\. Zhou, and V\. LordiLTAU\-FF: loss trajectory analysis for uncertainty in atomistic force fields\.Machine Learning: Science and Technology6\(1\),pp\. 015048\.Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Wen and Tadmor \(2020\)M\. Wen and E\. B\. TadmorUncertainty quantification in molecular simulations with dropout neural network potentials\.npj Computational Materials6,pp\. 124\.External Links:[Document](https://dx.doi.org/10.1038/s41524-020-00390-8)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Wilsonet al\.\(2025\)J\. Wilson, C\. van der Heide, L\. Hodgkinson, and F\. RoostaUncertainty quantification with the empirical neural tangent kernel\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Xuet al\.\(2026\)H\. Xu, T\. Cui, C\. Tang, J\. Ma, D\. Zhou, Y\. Li, X\. Gao, X\. Gong, W\. Ouyang, S\. Zhang, and M\. SuEvidential deep learning for interatomic potentials\.Nature Communications17,pp\. 937\.External Links:[Document](https://dx.doi.org/10.1038/s41467-025-67663-y)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Zaverkinet al\.\(2022\)V\. Zaverkin, D\. Holzmüller, I\. Steinwart, and J\. KästnerExploring chemical and conformational spaces by batch mode deep active learning\.Digital Discovery1\(5\),pp\. 605–620\.External Links:[Document](https://dx.doi.org/10.1039/D2DD00034B)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p2.1)\. - Zhanget al\.\(2020\)Y\. Zhang, H\. Wang, W\. Chen, J\. Zeng, L\. Zhang, H\. Wang, and W\. EDP\-GEN: a concurrent learning platform for the generation of reliable deep learning based potential energy models\.Computer Physics Communications253,pp\. 107206\.External Links:[Document](https://dx.doi.org/10.1016/j.cpc.2020.107206)Cited by:[§1](https://arxiv.org/html/2609.00488#S1.p4.1),[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. - Zhuet al\.\(2023\)A\. Zhu, S\. Batzner, A\. Musaelian, and B\. KozinskyFast uncertainty estimates in deep learning interatomic potentials\.The Journal of Chemical Physics158\(16\),pp\. 164111\.External Links:[Document](https://dx.doi.org/10.1063/5.0136574)Cited by:[§2](https://arxiv.org/html/2609.00488#S2.p1.1)\. ## Supplementary Information Appendix[A](https://arxiv.org/html/2609.00488#A1)gives the complete proof of the Gaussian\-sketch theorem and its active\-learning corollary\. Appendix[B](https://arxiv.org/html/2609.00488#A2)separates the effect of sequential score updates from that of the sketch dimension\. Appendix[C](https://arxiv.org/html/2609.00488#A3)records the data splits, active\-learning protocol, model and training settings, uncertainty baselines, evaluation metrics, calibration procedure, and timing protocol\. ## Appendix AProof of the sketch\-preservation result This appendix proves Theorem[4\.1](https://arxiv.org/html/2609.00488#S4.Thmtheorem1)and Corollary[4\.2](https://arxiv.org/html/2609.00488#S4.Thmtheorem2)\. Fixx∈𝒳x\\in\\mathcal\{X\}, abbreviateZ=ZxZ=Z\_\{x\}, and set K=ZZ⊤,M=K\+λI,H=M−1/2Z\.K=ZZ^\{\\top\},\\qquad M=K\+\\lambda I,\\qquad H=M^\{\-1/2\}Z\.Writing the rows ofSSasgj⊤/pg\_\{j\}^\{\\top\}/\\sqrt\{p\}withgj∼𝒩\(0,IP\)g\_\{j\}\\sim\\mathcal\{N\}\(0,I\_\{P\}\)gives M−1/2\(ZS⊤SZ⊤−K\)M−1/2\\displaystyle M^\{\-1/2\}\(ZS^\{\\top\}SZ^\{\\top\}\-K\)M^\{\-1/2\}=H\(S⊤S−IP\)H⊤\\displaystyle=H\(S^\{\\top\}S\-I\_\{P\}\)H^\{\\top\}=1p∑j=1p\(Hgj\)\(Hgj\)⊤−HH⊤\.\\displaystyle=\\frac\{1\}\{p\}\\sum\_\{j=1\}^\{p\}\(Hg\_\{j\}\)\(Hg\_\{j\}\)^\{\\top\}\-HH^\{\\top\}\.\(8\)The vectorsHgjHg\_\{j\}are Gaussian with covarianceΣ=HH⊤=M−1/2KM−1/2\\Sigma=HH^\{\\top\}=M^\{\-1/2\}KM^\{\-1/2\}\. Its eigenvalues lie in\[0,1\]\[0,1\], and tr\(Σ\)=tr\[K\(K\+λI\)−1\]=:dλ\(Z\)\.\\operatorname\{tr\}\(\\Sigma\)=\\operatorname\{tr\}\\\!\\left\[K\(K\+\\lambda I\)^\{\-1\}\\right\]=:d\_\{\\lambda\}\(Z\)\.Gaussian sample\-covariance concentration in effective dimension\([Koltchinskii and Lounici, 2017](https://arxiv.org/html/2609.00488#bib.bib11)\)therefore implies, for an absolute constantCC, that p≥Cϵ−2\(dλ\(Z\)\+log1η\)⟹‖H\(S⊤S−IP\)H⊤‖2≤ϵp\\geq C\\epsilon^\{\-2\}\\\!\\left\(d\_\{\\lambda\}\(Z\)\+\\log\\frac\{1\}\{\\eta\}\\right\)\\quad\\Longrightarrow\\quad\\left\\\|H\(S^\{\\top\}S\-I\_\{P\}\)H^\{\\top\}\\right\\\|\_\{2\}\\leq\\epsilonwith probability at least1−η1\-\\eta\. Takingη=δ/m\\eta=\\delta/mand a union bound yields this event simultaneously for allx∈𝒳x\\in\\mathcal\{X\}\. Equivalently, withK~=ZS⊤SZ⊤\\widetilde\{K\}=ZS^\{\\top\}SZ^\{\\top\}andM~=K~\+λI\\widetilde\{M\}=\\widetilde\{K\}\+\\lambda I, \(1−ϵ\)M⪯M~⪯\(1\+ϵ\)M\.\(1\-\\epsilon\)M\\preceq\\widetilde\{M\}\\preceq\(1\+\\epsilon\)M\.\(9\) It remains to translate \([9](https://arxiv.org/html/2609.00488#A1.E9)\) into a score bound\. The rows ofZZexcept the last areΦ\\Phi; write K=\[K0kxkx⊤κx\],K0=ΦΦ⊤,kx=Φϕ\(x\),κx=‖ϕ\(x\)‖22\.K=\\begin\{bmatrix\}K\_\{0\}&k\_\{x\}\\\\ k\_\{x\}^\{\\top\}&\\kappa\_\{x\}\\end\{bmatrix\},\\quad K\_\{0\}=\\Phi\\Phi^\{\\top\},\\quad k\_\{x\}=\\Phi\\phi\(x\),\\quad\\kappa\_\{x\}=\\\|\\phi\(x\)\\\|\_\{2\}^\{2\}\.The Woodbury identity gives κx−kx⊤\(K0\+λI\)−1kx=λϕ\(x\)⊤\(Φ⊤Φ\+λIP\)−1ϕ\(x\)=U\(x\)\.\\kappa\_\{x\}\-k\_\{x\}^\{\\top\}\(K\_\{0\}\+\\lambda I\)^\{\-1\}k\_\{x\}=\\lambda\\phi\(x\)^\{\\top\}\(\\Phi^\{\\top\}\\Phi\+\\lambda I\_\{P\}\)^\{\-1\}\\phi\(x\)=U\(x\)\.Hence the Schur complement of the upper\-left block ofMMiss=λ\+U\(x\)s=\\lambda\+U\(x\); the corresponding sketched Schur complement iss~=λ\+U~\(x\)\\widetilde\{s\}=\\lambda\+\\widetilde\{U\}\(x\)\. Inverting \([9](https://arxiv.org/html/2609.00488#A1.E9)\), taking its last diagonal entry, and using\(M−1\)−1,−1=s−1\(M^\{\-1\}\)\_\{\-1,\-1\}=s^\{\-1\}yields \(1−ϵ\)s≤s~≤\(1\+ϵ\)s\.\(1\-\\epsilon\)s\\leq\\widetilde\{s\}\\leq\(1\+\\epsilon\)s\.After subtractingλ\\lambda, this is exactly \|U~\(x\)−U\(x\)\|≤ϵ\(λ\+U\(x\)\),\|\\widetilde\{U\}\(x\)\-U\(x\)\|\\leq\\epsilon\(\\lambda\+U\(x\)\),which proves Theorem[4\.1](https://arxiv.org/html/2609.00488#S4.Thmtheorem1)\.□\\square For Corollary[4\.2](https://arxiv.org/html/2609.00488#S4.Thmtheorem2), fix the ordered greedy path obtained with the full features\. At steptt, augmentΦ\\Phiwith the previously selected features and apply the preceding argument to every remaining candidate\. A union bound over at mostBmBmstep–candidate pairs, together with the definition ofdλALd\_\{\\lambda\}^\{\\rm AL\}, gives the same score bound everywhere along this fixed path\. Letxt⋆x\_\{t\}^\{\\star\}be its maximiser\. Then U~At\(xt⋆\)\\displaystyle\\widetilde\{U\}\_\{A\_\{t\}\}\(x\_\{t\}^\{\\star\}\)≥Ut\(1\)−ϵ\(λ\+Ut\(1\)\),\\displaystyle\\geq U\_\{t\}^\{\(1\)\}\-\\epsilon\(\\lambda\+U\_\{t\}^\{\(1\)\}\),maxx≠xt⋆U~At\(x\)\\displaystyle\\max\_\{x\\neq x\_\{t\}^\{\\star\}\}\\widetilde\{U\}\_\{A\_\{t\}\}\(x\)≤Ut\(2\)\+ϵ\(λ\+Ut\(2\)\)\.\\displaystyle\\leq U\_\{t\}^\{\(2\)\}\+\\epsilon\(\\lambda\+U\_\{t\}^\{\(2\)\}\)\.The first quantity is strictly larger whenever the stated normalised gap exceedsϵ\\epsilon\. Induction onttthen shows that the sketched procedure follows the full\-space ordered path\.□\\square ## Appendix BAblation studies We report two controlled analyses: one isolates the contribution of the sequential update, and the other tests sensitivity to the Gaussian\-sketch dimension\. Figure 4:Sequential\-update ablation on Transition\-1X\. AdaptNTK updates all remaining scores after each selection\. “NTK” denotes the non\-adaptive top\-BBablation: it uses the same NTK score but selects the 50 highest\-scoring configurations without within\-batch updates\. QBC and Random baselines are included as context\. All curves use the same initial 50 configurations, fixed transition\-state\-only test split, fixed seeds and 20\-checkpoint budget ending at 1,000 labels\. Shaded areas represent standard deviation in force errors averaged across 3 runs\.Table 3:Gaussian\-sketch ablation on Transition\-1X\. Final force RMSE on the test split after the same 20\-checkpoint active\-learning protocol, with every setting ending atN=1,000N=1\{,\}000\.The maximum difference among point estimates is0\.120\.12kcal mol\-1Å\-1, and the ordering is non\-monotone\. Thus the reported run provides no evidence that a larger sketch improves final force error beyondp=128p=128\. This empirical plateau is consistent with Corollary[4\.2](https://arxiv.org/html/2609.00488#S4.Thmtheorem2): acquisition becomes insensitive topponce sketch error is below the relevant score gaps\. ## Appendix CExperimental details ### C\.1Datasets and splits Uncertainty\-quality experiments use four rMD17 molecular datasets: aspirin, naphthalene, paracetamol, and salicylic acid\. Each dataset contains configurations sampled from anab initiomolecular\-dynamics trajectory\. Energies are reported in kcal mol\-1and forces in kcal mol\-1Å\-1\. For each molecule, we draw 1,000 training configurations and 100 validation configurations\. From the remaining configurations, we draw disjoint fixed evaluation and calibration subsets of 2,000 configurations each\. All partitions use the same fixed seeds, every method is evaluated on identical configurations, and we verify disjointness by hashing coordinates\. For active learning, 25,000 configurations are held out once for testing, 50 fixed configurations initialize training, and every remaining configuration forms the initial acquisition pool\. The 20 plotted checkpoints include this initial fit and then add 50 configurations at a time, ending at 1,000 labeled configurations\. For Transition\-1X, an additional evaluation set is constructed from the dataset’s transition\-state split\. These configurations are excluded from pretraining\. This deliberately tests whether the acquisition strategy improves the region of chemical space most relevant to reactivity, rather than allowing the metric to be dominated by more numerous non\-transition configurations\. The learning curves use the same fixed seeds and are reported through 1,000 labeled configurations\. ### C\.2Active\-learning loop At every checkpoint, the current training set is used to fit the potential and the method\-specific uncertainty estimator\. Each method then selects the next 50 configurations from its remaining pool\. AdaptNTK constructs the batch sequentially: after each choice it applies Eq\. \([7](https://arxiv.org/html/2609.00488#S4.E7)\) to the remaining scores, but does not use the selected configuration’s label\. The baselines rank the pool under their fitted uncertainty and take the highest\-scoring batch\. Once the batch is complete, its dataset labels are revealed, appended to the training set, and the potential is retrained\. The data split, initial configurations, random seed, architecture, label budget, and evaluation set are held fixed across methods; only the acquisition rule changes\. For the top\-BBablation, the same NTK\-based score is evaluated once at the beginning of each acquisition batch and the 50 largest values are selected without applying Eq\. \([7](https://arxiv.org/html/2609.00488#S4.E7)\)\. For the sketch ablation, onlyppchanges; the data, model, regularization, acquisition budget, and fixed seed are unchanged\. ### C\.3Interatomic potential and training All methods use the same MACE architecture\([Batatia et al\., 2022](https://arxiv.org/html/2609.00488#bib.bib5)\)\(ScaleShiftMACE\): a 6\.0 Å cutoff, hidden irreps128×0e\+128×1o128\\times 0e\+128\\times 1o, two interaction layers, correlation order 3, 8 Bessel radial basis functions, polynomial cutoff order 5, andℓmax=3\\ell\_\{\\max\}=3, giving 724,240 parameters\. Models are trained for 500 epochs with AdamW at a constant learning rate of10−410^\{\-4\}and batch size 16, minimizing0\.01ℒE\+0\.99ℒF0\.01\\,\\mathcal\{L\}\_\{E\}\+0\.99\\,\\mathcal\{L\}\_\{F\}where both terms are mean squared errors\. The checkpoint with the lowest validation loss is retained\. Energy shift and scale are set from the per\-atom training energy statistics\. ### C\.4Uncertainty methods Each method reduces a configuration to a single scalar uncertaintyuu\. ##### NTK\-based uncertainty: Energy gradientsϕ\(x\)=∇θE\(x,θ\)\\phi\(x\)=\\nabla\_\{\\theta\}E\(x;\\theta\)are extracted from the trained model and projected top=512p=512dimensions with a fixed Gaussian sketch \(Theorem[4\.1](https://arxiv.org/html/2609.00488#S4.Thmtheorem1)\)\. The score is the regularized Mahalanobis formU\(x\)=λϕ~\(x\)⊤\(F~\+λIp\)−1ϕ~\(x\)U\(x\)=\\lambda\\,\\tilde\{\\phi\}\(x\)^\{\\top\}\(\\tilde\{F\}\+\\lambda I\_\{p\}\)^\{\-1\}\\tilde\{\\phi\}\(x\), whereF~\\tilde\{F\}is the sketched feature covariance of the training set\. ##### Ensemble \(QBC\): Three models are trained with identical settings, but different random seeds\. The score is the standard deviation of predicted force components across members, averaged over atoms and Cartesian directions\. The error target for this method uses the ensemble\-mean forces\. ##### MCD: The model is trained with dropout \(p=0\.1p=0\.1\), applied after the non\-linearity of each readout block, and dropout remains active at inference time\. The uncertainty score is the standard deviation of the predicted forces across 20 stochastic forward passes\. ##### SWAG: Weight snapshots are collected over the final 25% of training epochs \(at most 20 retained\) to form a Gaussian posterior with diagonal plus low\-rank covariance\. The score is the across\-sample standard deviation of predicted forces over 30 posterior draws\. ##### Evidential: A normal\-inverse\-gamma head is fitted post hoc on the frozen backbone, mapping mean\-pooled invariant \(ℓ=0\\ell=0\) node features to\(γ,ν,α,β\)\(\\gamma,\\nu,\\alpha,\\beta\)by minimizing the NIG negative log\-likelihood with evidence regularization\. Targets and features are standardised before fitting; without this the likelihood is minimized byν→0\\nu\\to 0, which inflates the epistemic term by many orders of magnitude while leaving it nearly constant across configurations\. The score is the epistemic varianceβ/\(ν\(α−1\)\)\\beta/\(\\nu\(\\alpha\-1\)\)\. ### C\.5Error target and metrics For each configurationiithe error is the force RMSE over all atoms and Cartesian components,ei=\[13N∑a,c\(Facpred−Factrue\)2\]1/2e\_\{i\}=\\big\[\\tfrac\{1\}\{3N\}\\sum\_\{a,c\}\(F^\{\\text\{pred\}\}\_\{ac\}\-F^\{\\text\{true\}\}\_\{ac\}\)^\{2\}\\big\]^\{1/2\}, in kcal mol\-1Å\-1\. Each method is evaluated against the predictions of the model it is defined on; consequently the mean error differs by method\. Spearman and Pearson coefficients are computed betweenuuandee\. ##### AURCn\. Configurations are ranked byuuand progressively removed in decreasing order of uncertainty\. The RMSE of the retained set is tracked against the retained fraction, and AURC is the area under this curve\. Because a more accurate model lowers this area irrespective of uncertainty quality, we report the normalised quantityAURCn=\(AURC−AURCoracle\)/\(AURCrandom−AURCoracle\)\\text\{AURC\}\_\{n\}=\(\\text\{AURC\}\-\\text\{AURC\}\_\{\\text\{oracle\}\}\)/\(\\text\{AURC\}\_\{\\text\{random\}\}\-\\text\{AURC\}\_\{\\text\{oracle\}\}\), where the oracle ranks by true error and the random baseline averages five permutations, both computed from the sameee\. Thus00denotes a perfect ranking and11no better than chance, and the measure is comparable across methods whose models differ in accuracy\. ##### Recalibration and ENCE\. Raw scores are not commensurate with the error: some are variances, some standard deviations, and the NTK\-based score carries an arbitrary scale throughλ\\lambda\. We therefore fitσ2=au\+b2\\sigma^\{2\}=a\\,u\+b^\{2\}by minimizing theχ2\\chi^\{2\}negative log\-likelihood∑ilogσi2\+ei2/σi2\\sum\_\{i\}\\log\\sigma\_\{i\}^\{2\}\+e\_\{i\}^\{2\}/\\sigma\_\{i\}^\{2\}, in whichaaabsorbs the unit conversion andb2b^\{2\}captures the irreducible error a purely epistemic term cannot represent\. Parameters are fitted by two\-fold cross\-fitting within the scored set and applied only to the held\-out fold, so the reported ENCE is not self\-graded\. ENCE is the mean over ten equal\-countσ\\sigmabins of\|RMV−RMSE\|/RMV\|\\text\{RMV\}\-\\text\{RMSE\}\|/\\text\{RMV\}\. For evidential regression, the fitted floorb=1\.19b=1\.19is close to the mean error1\.231\.23and compresses the display; Figure[1\(d\)](https://arxiv.org/html/2609.00488#S5.F1.sf4)therefore usesσ2=au\\sigma^\{2\}=a\\,ufor display only\. This monotone change leaves ranks unchanged, while Table[1](https://arxiv.org/html/2609.00488#S5.T1)uses the two\-parameter ENCE\. All timing measurements in Table[2](https://arxiv.org/html/2609.00488#S5.T2)use one NVIDIA A100 GPU per method\. The reported wall\-clock components cover pretraining plus uncertainty construction and batch selection\. They exclude the cost of obtaining reference labels, which is identical for a fixed acquisition count but is the quantity reduced when one method reaches a target error with fewer acquisitions\.
Similar Articles
Scalable Uncertainty Quantification for Extreme Weather Forecasting via Empirical Neural Tangent Kernels
The paper proposes Neural Tangent Kernel-based uncertainty quantification for deterministic deep learning weather models, achieving sharper adaptive prediction intervals during extreme events without retraining.
Kernel Reboot: Breaking the Boundaries of Neural Tangent Kernels for Neural Fields
This paper develops NTK-KIP, MetaQuill, and MetaQuill-KIP algorithms to improve neural field reconstruction from sparse observations, making NTK-driven neural fields non-linear and meta-learnable for efficient few-shot adaptation.
Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials
Researchers from MIT, University of Warwick, and NVIDIA introduce Stein Kernelized Molecular Dynamics (SKMD), an enhanced sampling method that uses interacting particle dynamics to acquire informative training configurations for active learning and fine-tuning of machine learning interatomic potentials (MLIPs). SKMD is a stochastic variant of Stein variational gradient descent adapted for molecular dynamics, preserving the Boltzmann distribution while achieving higher model accuracy in fewer training iterations compared to baselines.
Uncertainty Quantification of Engineering Structures by Polynomial Chaos Expansion and Multivariate Active Learning
This paper presents a generalized adaptive sequential sampling method for constructing polynomial chaos expansion surrogate models to improve uncertainty quantification in multi-output engineering structures, balancing variance contribution and spatial exploration.
State-Space NTK Collapse Near Bifurcations
This paper develops a local theory of gradient descent near bifurcations in dynamical models, showing that the state-space neural tangent kernel collapses to a rank-one operator that dominates learning dynamics, making optimization effectively low-dimensional and predictable from normal forms.