Threshold-Aware Conformal Routing
Summary
The paper introduces Threshold-Aware Conformal Routing (TACR), a method that learns input-dependent interval scales to decide when a neural surrogate can replace an expensive scientific simulator, reducing simulator deferrals by 14–75% while preserving distribution-free marginal coverage guarantees.
View Cached Full Text
Cached at: 10/05/26, 10:05 AM
# Threshold-Aware Conformal Routing
Source: [https://arxiv.org/html/2610.02487](https://arxiv.org/html/2610.02487)
###### Abstract
High\-fidelity simulations are essential to scientific and engineering design, but can be expensive to run repeatedly\. Learned surrogates offer a faster alternative, yet their higher errors may alter downstream decisions\. This accuracy\-speed tradeoff creates a need to determine whether a surrogate can be used or the full simulator remains necessary\. We study decisions determined by whether a scalar quantity of interest lies above or below a fixed threshold\. For each input, we use the surrogate when its conformal interval lies entirely on one side of the threshold and route the input to simulation when the interval intersects it\. Standard conformal prediction constructs intervals without reference to the downstream decision threshold: even a narrow interval near the threshold can cross it and trigger simulation, whereas a wider interval farther away can remain entirely on one side and require no simulation\. We introduce Threshold\-Aware Conformal Routing \(TACR\), which learns an input\-dependent scale using a threshold\-aware objective that concentrates interval tightness near the decision boundary\. Exact split\-conformal calibration on held\-out data preserves distribution\-free marginal coverage, which also upper\-bounds the probability of an incorrect threshold decision that is not routed\. Across various scientific and engineering datasets,TACRreduces simulator deferrals by 14–75% relative to standard conformal prediction at the same coverage target\. Against a variant without threshold\-local weighting but with similar predictor accuracy,TACRfurther reduces deferrals by 10–24% on four datasets\. These results show that optimizing interval allocation for routing can reduce simulator calls without weakening the standard conformal guarantee\.
## 1Introduction
Engineering simulations, e\.g\., computational fluid dynamics \(CFD\), finite element analysis \(FEA\), and electronic design automation \(EDA\), are cornerstones of modern design workflows\. The cost of high\-fidelity simulation varies substantially with the physical problem, numerical method, resolution, hardware, and implementation\. Reported scientific and engineering workflows commonly require minutes to days per simulation, which makes repeated simulator calls in a design loop a major computational bottleneck\([Bonnet et al\., 2022](https://arxiv.org/html/2610.02487#bib.bib32);[Ashton et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib33);[Ananthan et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib31);[Jiang et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib37);[Chai et al\., 2023](https://arxiv.org/html/2610.02487#bib.bib36)\)\.
Recently, deep learning surrogates, including GNN\-based MeshGraphNets\([Pfaff et al\., 2021](https://arxiv.org/html/2610.02487#bib.bib24);[Nabian et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib25)\), Transformer\-based neural fields\([Adams et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib27);[Wu et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib26);[Luo et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib28);[Alkin et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib29)\), and Neural Operators\([Li et al\., 2021](https://arxiv.org/html/2610.02487#bib.bib22);[Li et al\., 2023](https://arxiv.org/html/2610.02487#bib.bib23);[Ranade et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib34)\), have been developed to accelerate high\-fidelity simulations\. Once trained, these models can generally evaluate new inputs more cheaply than conventional simulators on the order of milliseconds to seconds\. Avoiding even a fraction of simulator calls can yield substantial computational savings\.
In scientific and engineering applications, particularly in safety\-critical settings, realizing the computational savings from a neural surrogate requires knowing when the surrogate is sufficiently reliable for the downstream decision\. Blindly relying on the surrogate’s predictions risks missing engineering violations that the full simulator can identify\. This motivates a per\-input routing problem: use the surrogate when its prediction is sufficiently decisive for the downstream threshold test, and otherwise defer the input to the high\-fidelity simulator\. The two outcomes have asymmetric costs: simulation incurs substantial computation, whereas relying on an erroneous surrogate prediction can lead to an incorrect downstream decision\.
Contributions\.Our contributions are as follows: \(i\) We formulate the surrogate\-simulation handoff as threshold routing under conformal coverage and identify the flexibility of the nonconformity score as an opportunity to optimize interval allocation for routing rather than uncertainty estimation \(§[3\.1](https://arxiv.org/html/2610.02487#S3.SS1)\); \(ii\) We propose Threshold\-Aware Conformal Routing \(TACR\), whose threshold\-awareσ\\sigma\-shaping objective concentrates interval tightness near the decision boundary through importance weighting \(§[3\.2](https://arxiv.org/html/2610.02487#S3.SS2)\); \(iii\) We show that, across various scientific and engineering datasets,TACRreduces simulator deferrals by14–75%relative to standard conformal prediction at the same coverage target\. Against a variant without threshold\-local weighting but with similar predictor accuracy,TACRfurther reduces deferrals by10–24%on four datasets, showing an additional benefit from threshold\-local weighting \(§[4\.2](https://arxiv.org/html/2610.02487#S4.SS2)\); \(iv\) We further show that a deep\-ensemble baseline targeting predictive uncertainty leads to more deferrals, providing empirical evidence that uncertainty estimation and routing\-efficient interval allocation need not share the same objective \(§[4\.2](https://arxiv.org/html/2610.02487#S4.SS2)\)\.
## 2Related Work
Related work spans calibrated uncertainty for scientific surrogates, conformal prediction \(CP\), conformalized quantile regression \(CQR\), conformal efficiency optimization, decision\-aware conformal methods, and selective prediction or model routing\. Existing conformal methods provide coverage guarantees or optimize the generic set size\. Decision\-aware and deferral methods incorporate downstream utility or fallback decisions\. To our knowledge, existing methods do not jointly learn to allocate conformal interval width according to distance from a fixed decision threshold while explicitly routing ambiguous inputs to a high\-fidelity simulator\. Our Threshold\-Aware Conformal Routing \(TACR\) combines these elements: it retains split\-conformal marginal coverage, optimizes interval allocation for the downstream routing decision, and invokes simulation when the calibrated interval intersects the threshold\. Table[1](https://arxiv.org/html/2610.02487#S2.T1)gives a compact comparison\. \(See Appendix[A](https://arxiv.org/html/2610.02487#A1)for details\.\)
Table 1:Comparison of related approaches\.Representative methods cover subsets of the components combined byTACR\. “Guarantee” denotes a distribution\-free coverage or risk guarantee, whose target differs across rows; “CP efficiency” denotes direct optimization of conformal set size or interval width; and “abstain / route” indicates methods whose primary problem formulation is selective prediction, deferral, or model routing\.
## 3Threshold\-Aware Conformal Routing \(TACR\)
Figure 1:Overview of Threshold\-Aware Conformal Routing\.The calibrated interval determines whether to use the surrogate decision or route to simulation\.TACRallocates interval width relative toτ\\tauto reduce simulator calls while retaining conformal coverage\.Figure[1](https://arxiv.org/html/2610.02487#S3.F1)illustrates the key idea ofTACR: conformal intervals determine whether to use the surrogate or route to simulation, while interval width is allocated relative to the decision thresholdτ\\tauto reduce simulator calls\. We next formalize the routing objective, training objective, and split\-conformal calibration procedure\.
### 3\.1Problem Formulation and Routing Objective
A broad class of downstream engineering decisions can be expressed as threshold tests on scalar\-valued functionals of high\-dimensional fields produced by simulations\. These functionals may take the form of integrals, extrema, percentiles, or other task\-specific summaries of the full field\. This enables decisions such as whether drag or peak stress exceeds a prescribed limit\. We focus on this class of specification\-driven decisions\. Letxxdenote the simulator input,yythe high\-fidelity output, andy^=fθ\(x\)\\hat\{y\}=f\_\{\\theta\}\(x\)the surrogate prediction\. A functionalg\(⋅\)g\(\\cdot\)maps each output to a scalar decision quantity, giving the true valueg\(y\)g\(y\)and surrogate estimateg^\(x\)=g\(fθ\(x\)\)\\hat\{g\}\(x\)=g\(f\_\{\\theta\}\(x\)\)\. Bothggand the decision thresholdτ\\tauare specified before training\. For notational convenience, define the true and surrogate threshold decisions asd\(y\)=𝟙\[g\(y\)≤τ\]d\(y\)=\\mathbb\{1\}\[g\(y\)\\leq\\tau\]andd^\(x\)=𝟙\[g^\(x\)≤τ\]\\hat\{d\}\(x\)=\\mathbb\{1\}\[\\hat\{g\}\(x\)\\leq\\tau\], respectively\.
We augment the surrogate with a positive, sample\-dependent scaleσ\(x\)\>0\\sigma\(x\)\>0\. After split\-conformal calibration, this scale defines the interval
C\(x\)=\[g^\(x\)−q^σ\(x\),g^\(x\)\+q^σ\(x\)\],C\(x\)=\[\\hat\{g\}\(x\)\-\\hat\{q\}\\sigma\(x\),\\,\\hat\{g\}\(x\)\+\\hat\{q\}\\sigma\(x\)\],\(1\)whereq^\\hat\{q\}is computed on held\-out calibration data\. IfC\(x\)C\(x\)lies entirely above or belowτ\\tau, we use the surrogate’s threshold decision; if it crossesτ\\tau, we route the sample to simulation\. Equivalently,
r\(x\)=\[\|g^\(x\)−τ\|≤q^σ\(x\)\],r\(x\)=\\mathbb\{1\}\\\!\\left\[\|\\hat\{g\}\(x\)\-\\tau\|\\leq\\hat\{q\}\\sigma\(x\)\\right\],\(2\)wherer\(x\)=1r\(x\)=1denotes routing to simulation\.
The routing rule links conformal coverage to decision safety\. Wheneverr\(x\)=0r\(x\)=0andg\(y\)∈C\(x\)g\(y\)\\in C\(x\), the entire interval and the true decision quantity lie on the same side ofτ\\tau, sod^\(x\)=d\(y\)\\hat\{d\}\(x\)=d\(y\)\. Consequently, a wrong decision that is not routed can occur only when the conformal interval fails to coverg\(y\)g\(y\)\(see Section[3\.3](https://arxiv.org/html/2610.02487#S3.SS3)for formalization of the resulting risk bound\)\.
Our goal is to reduce the expected routing rate while retaining split\-conformal coverage at a prescribed level1−α1\-\\alpha:
minθ,ϕ𝔼\[r\(X\)\]subject toPr\(g\(Y\)∈C\(X\)\)≥1−α,\\min\_\{\\theta,\\phi\}\\;\\mathbb\{E\}\[r\(X\)\]\\qquad\\text\{subject to\}\\qquad\\Pr\\\!\\left\(g\(Y\)\\in C\(X\)\\right\)\\geq 1\-\\alpha,\(3\)whereϕ\\phiparameterizesσ\\sigma\(§[3\.2](https://arxiv.org/html/2610.02487#S3.SS2)\)\. The coverage constraint is enforced after training by standard split\-conformal calibration, rather than by treatingα\\alphaas a direct budget on decision errors\. Directly optimizing the routing rate is difficult because the routing indicator in Eq\.[2](https://arxiv.org/html/2610.02487#S3.E2)is discrete andq^\\hat\{q\}is determined only after training\. We use a differentiable training objective designed to reduce routing\. The key observation is that routing depends on the average interval width and where that width is allocated, i\.e\., width nearτ\\taucan trigger simulation, whereas samples farther fromτ\\taucan tolerate wider intervals without changing the decision\. This motivatesTACRto concentrate interval tightness near the decision boundary rather than requiringσ\\sigmato represent predictive uncertainty\.
### 3\.2Threshold\-Aware Training Objective
Objective overview\.Letℬ\\mathcal\{B\}denote a training mini\-batch\. For eachi∈ℬi\\in\\mathcal\{B\}, we define
g^i=g\(fθ\(xi\)\),σi=σ\(xi\)\.\\hat\{g\}\_\{i\}=g\(f\_\{\\theta\}\(x\_\{i\}\)\),\\qquad\\sigma\_\{i\}=\\sigma\(x\_\{i\}\)\.\(4\)The complete training objective and its two scale\-learning terms are
ℒ\\displaystyle\\mathcal\{L\}=ℒpred\+λ\(ℒroute\+μℒscale\),\\displaystyle=\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\+\\lambda\\left\(\\mathcal\{L\}\_\{\\mathrm\{route\}\}\+\\mu\\mathcal\{L\}\_\{\\mathrm\{scale\}\}\\right\),\(5\)ℒroute\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{route\}\}=q~ℬ1\|ℬ\|∑i∈ℬ\(1\+βproxi\)σi,\\displaystyle=\\tilde\{q\}\_\{\\mathcal\{B\}\}\\frac\{1\}\{\|\\mathcal\{B\}\|\}\\sum\_\{i\\in\\mathcal\{B\}\}\\left\(1\+\\beta\\mathrm\{prox\}\_\{i\}\\right\)\\sigma\_\{i\},\(6\)ℒscale\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{scale\}\}=1\|ℬ\|∑i∈ℬ\(σi\+1σi\)\.\\displaystyle=\\frac\{1\}\{\|\\mathcal\{B\}\|\}\\sum\_\{i\\in\\mathcal\{B\}\}\\left\(\\sigma\_\{i\}\+\\frac\{1\}\{\\sigma\_\{i\}\}\\right\)\.\(7\)Here,ℒpred\\mathcal\{L\}\_\{\\mathrm\{pred\}\}denotes the surrogate’s prediction objective, which may vary across architectures and datasets\. The quantityq~ℬ\\tilde\{q\}\_\{\\mathcal\{B\}\}approximates the conformal multiplier during training, andproxi\\mathrm\{prox\}\_\{i\}measures the proximity of sampleiito the decision threshold\. The coefficientλ≥0\\lambda\\geq 0weights the two scale\-learning terms relative to prediction,μ≥0\\mu\\geq 0controls scale regularization, andβ≥0\\beta\\geq 0controls the additional emphasis near the threshold\. We defineq~ℬ\\tilde\{q\}\_\{\\mathcal\{B\}\}andproxi\\mathrm\{prox\}\_\{i\}next\.
Differentiable conformal width\.For each sample, define the normalized score
si=\|g\(yi\)−g^i\|/σi\.s\_\{i\}=\|g\(y\_\{i\}\)\-\\hat\{g\}\_\{i\}\|/\\sigma\_\{i\}\.\(8\)The final conformal multiplierq^\\hat\{q\}is unavailable during training because it is computed later on held\-out calibration data\. We construct a differentiable mini\-batch approximation from the normalized scores\{si\}i∈ℬ\\\{s\_\{i\}\\\}\_\{i\\in\\mathcal\{B\}\}:
q~ℬ=SoftQuantile1−α\(\{si\}i∈ℬ\)\.\\tilde\{q\}\_\{\\mathcal\{B\}\}=\\operatorname\{SoftQuantile\}\_\{1\-\\alpha\}\\\!\\left\(\\\{s\_\{i\}\\\}\_\{i\\in\\mathcal\{B\}\}\\right\)\.\(9\)This approximation is computed separately for each training mini\-batch and is used only for optimization; implementation details are given in Appendix[E](https://arxiv.org/html/2610.02487#A5)\. Includingq~ℬ\\tilde\{q\}\_\{\\mathcal\{B\}\}couples the learned scales to the calibration mechanism, makingq~ℬσi\\tilde\{q\}\_\{\\mathcal\{B\}\}\\sigma\_\{i\}a training\-time approximation to the calibrated half\-width\. The objective can shape the relative allocation of calibrated width rather than shrink raw scales without accounting for recalibration\.
Threshold\-local weighting\.We define
proxi=exp\(−\(stopgrad\(g^i\)−τ\)22bw2\),\\mathrm\{prox\}\_\{i\}=\\exp\\\!\\left\(\-\\frac\{\\left\(\\operatorname\{stopgrad\}\(\\hat\{g\}\_\{i\}\)\-\\tau\\right\)^\{2\}\}\{2\\,\\mathrm\{bw\}^\{2\}\}\\right\),\(10\)wherebw\>0\\mathrm\{bw\}\>0controls the neighborhood around the threshold and is fixed during training \(see Section[4\.1](https://arxiv.org/html/2610.02487#S4.SS1)for the setting used in our experiments\)\. The weight approaches11nearτ\\tauand decays toward00with distance\. Withβ≥0\\beta\\geq 0, the factor1\+βproxi1\+\\beta\\mathrm\{prox\}\_\{i\}applies baseline width pressure to every sample and additional pressure near the decision boundary, where calibrated width is most likely to change the routing decision\.
Stop\-gradient in the proximity weight\.The dependence ofproxi\\mathrm\{prox\}\_\{i\}ong^i\\hat\{g\}\_\{i\}can create a shortcut when differentiated end to end\. Becauseproxi\\mathrm\{prox\}\_\{i\}decreases as\|g^i−τ\|\|\\hat\{g\}\_\{i\}\-\\tau\|grows, the predictor can reduce the additional weight assigned to a sample by pushing its decision value away from the threshold, even when doing so does not improve prediction accuracy\. We stop gradients throughg^i\\hat\{g\}\_\{i\}when computingproxi\\mathrm\{prox\}\_\{i\}, which blocks this degenerate shortcut\.
Objective interpretation\.Routing occurs when the calibrated half\-widthq^σi\\hat\{q\}\\sigma\_\{i\}equals or exceeds the predicted threshold margin\|g^i−τ\|\|\\hat\{g\}\_\{i\}\-\\tau\|\. Accordingly,ℒroute\\mathcal\{L\}\_\{\\mathrm\{route\}\}minimizes a threshold\-weighted average of the training\-time calibrated half\-widthsq~ℬσi\\tilde\{q\}\_\{\\mathcal\{B\}\}\\sigma\_\{i\}as a differentiable proxy for routing efficiency\. Ignoring the numerical stabilizer used in implementation, a uniform rescalingσi↦cσi\\sigma\_\{i\}\\mapsto c\\sigma\_\{i\}changes the normalized\-score quantile asq~ℬ↦q~ℬ/c\\tilde\{q\}\_\{\\mathcal\{B\}\}\\mapsto\\tilde\{q\}\_\{\\mathcal\{B\}\}/c, leaving this calibrated\-width term unchanged\. The scale regularizer breaks the resulting global scale indeterminacy and discourages extreme values ofσi\\sigma\_\{i\}\.
Scale\-head instantiation\.We parameterize the positive scale asσ\(x\)=σϕ\(hθ\(x\)\)\\sigma\(x\)=\\sigma\_\{\\phi\}\(h\_\{\\theta\}\(x\)\), wherehθ\(x\)h\_\{\\theta\}\(x\)is the surrogate’s penultimate backbone representation andϕ\\phidenotes the scale\-head parameters\. The lightweight head reuses backbone features and outputs one positive scale per sample\. See Appendix[E](https://arxiv.org/html/2610.02487#A5)for details on the architectural specifications\.
Training schedule\.The scale head and threshold\-aware objective build on the predictor’s outputs and backbone features\. We train in two stages: first optimizing the predictor withℒpred\\mathcal\{L\}\_\{\\mathrm\{pred\}\}, then activating the scale head and jointly optimizing Eq\.[5](https://arxiv.org/html/2610.02487#S3.E5)\. We use this schedule for all datasets, including CircuitNet, whose ResNet18 encoder is initialized from ImageNet weights\. See Appendix[E](https://arxiv.org/html/2610.02487#A5)for the stage lengths and optimization settings\.
### 3\.3Calibration and Deployment
After training, we freeze the predictor and scale function and perform standard split\-conformal calibration on a held\-out set indexed byℐcal\\mathcal\{I\}\_\{\\mathrm\{cal\}\}, withncal=\|ℐcal\|n\_\{\\mathrm\{cal\}\}=\|\\mathcal\{I\}\_\{\\mathrm\{cal\}\}\|\. For every calibration sample, we compute
si=\|g\(yi\)−g^\(xi\)\|/σ\(xi\),i∈ℐcal\.s\_\{i\}=\|g\(y\_\{i\}\)\-\\hat\{g\}\(x\_\{i\}\)\|/\\sigma\(x\_\{i\}\),\\qquad i\\in\\mathcal\{I\}\_\{\\mathrm\{cal\}\}\.\(11\)Lets\(1\)≤⋯≤s\(ncal\)s\_\{\(1\)\}\\leq\\cdots\\leq s\_\{\(n\_\{\\mathrm\{cal\}\}\)\}denote the sorted calibration scores\. The finite\-sample corrected conformal multiplier is
k=⌈\(ncal\+1\)\(1−α\)⌉,q^=s\(k\),k=\\left\\lceil\(n\_\{\\mathrm\{cal\}\}\+1\)\(1\-\\alpha\)\\right\\rceil,\\qquad\\hat\{q\}=s\_\{\(k\)\},\(12\)with the standard conventionq^=∞\\hat\{q\}=\\inftyifk\>ncalk\>n\_\{\\mathrm\{cal\}\}\. At deployment, we formC\(x\)C\(x\)using Eq\.[1](https://arxiv.org/html/2610.02487#S3.E1)and apply the routing rule in Eq\.[2](https://arxiv.org/html/2610.02487#S3.E2)\.
Under the standard exchangeability assumptions of split conformal prediction, the resulting interval satisfies distribution\-free marginal coverage,
Pr\(g\(Y\)∈C\(X\)\)≥1−α\.\\Pr\\\!\\left\(g\(Y\)\\in C\(X\)\\right\)\\geq 1\-\\alpha\.\(13\)Since a wrong threshold decision that is not routed implies noncoverage,
Pr\(d^\(X\)≠d\(Y\),r\(X\)=0\)\\displaystyle\\Pr\\\!\\left\(\\hat\{d\}\(X\)\\neq d\(Y\),\\,r\(X\)=0\\right\)=Pr\(d^\(X\)≠d\(Y\),r\(X\)=0,g\(Y\)∉C\(X\)\)\\displaystyle=\\Pr\\\!\\left\(\\hat\{d\}\(X\)\\neq d\(Y\),\\,r\(X\)=0,\\,g\(Y\)\\notin C\(X\)\\right\)\(14\)≤Pr\(g\(Y\)∉C\(X\)\)≤α\.\\displaystyle\\leq\\Pr\\\!\\left\(g\(Y\)\\notin C\(X\)\\right\)\\leq\\alpha\.The first inequality can be strict: a value outside the interval may still lie on the same side ofτ\\tauas the surrogate decision\. Thus,α\\alphaspecifies an interval\-coverage level and provides a conservative upper bound on the unconditional miss probability; it is not a miss budget that the method is expected to exhaust\. Importantly, the guarantee does not requireσ\\sigmaitself to estimate predictive uncertainty\.
## 4Empirical Evaluation
We first describe the datasets, baselines, metrics, and evaluation protocol\. We then compare routing performance and study sensitivity to the decision threshold, backbone, and threshold\-local weighting strength\.
### 4\.1Experimental Design
Datasets\.We evaluateTACRon six datasets spanning EDA, fluid mechanics, and structural mechanics, with convolutional, graph, transformer, and MLP surrogates: CircuitNet\([Jiang et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib37)\), Darcy Flow\([Takamoto et al\., 2022](https://arxiv.org/html/2610.02487#bib.bib35)\), AirfRANS\([Bonnet et al\., 2022](https://arxiv.org/html/2610.02487#bib.bib32)\), AhmedML\([Ashton et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib33)\), ShapeNet\-Car\([Umetani and Bickel, 2018](https://arxiv.org/html/2610.02487#bib.bib38)\), and a synthetic parametric\-beam dataset \(Table[2](https://arxiv.org/html/2610.02487#S4.T2)\)\. For field\-valued tasks,ggextracts the scalar decision quantity from the predicted field; for Beams, the surrogate predicts log\-transformed peak stress directly\. This diversity tests whetherTACRgeneralizes across backbones and output representations\.
Table 2:Datasets and decision tasks\.NNis the number of samples; p95 denotes the 95th percentile\. IC, EDA, and CFD denote integrated circuit, electronic design automation, and computational fluid dynamics;CLC\_\{L\}andCDC\_\{D\}are lift and drag coefficients\.Baselines\.Within each dataset, all methods use the same predictor backbone, with method\-specific training objectives and output heads where required:Standard conformal prediction \(Standard CP\)uses a constant scale,σ=1\\sigma\{=\}1;Conformalized Quantile Regression \(CQR\)\([Romano et al\., 2019](https://arxiv.org/html/2610.02487#bib.bib4)\)uses conditional\-quantile heads withσ=\(qhi−qlo\)/2\\sigma=\(q\_\{hi\}\-q\_\{lo\}\)/2;Threshold\-Weighted Uncertainty Quantification \(TW\-UQ\)adds a threshold\-weighted MSE on the scalar decision quantity and trains a scale head with Gaussian negative log likelihood;Uniformis identical toTACRexcept that it setsβ=0\\beta\{=\}0, removing threshold\-local weighting;Deep Ensemble\([Lakshminarayanan et al\., 2017](https://arxiv.org/html/2610.02487#bib.bib19)\)uses the predictive standard deviation of five predictor members asσ\\sigma; and ourTACRuses Eq\.[5](https://arxiv.org/html/2610.02487#S3.E5)withβ=16\\beta\{=\}16by default\. Together, these baselines distinguish the effects of learned input\-dependent scaling, threshold\-local weighting beyond the Uniform objective, and uncertainty\-oriented scaling for routing efficiency\. See Appendix[E](https://arxiv.org/html/2610.02487#A5)for the full optimization settings\.
Metrics\.We report the simulation rate \(Sim%\), the percentage of test inputs routed to simulation, corresponding to the eventr\(X\)=1r\(X\)=1; the miss rate \(Miss%\), the percentage for which the surrogate decision is incorrect and the input is not routed, corresponding tod^\(X\)≠d\(Y\),r\(X\)=0\\hat\{d\}\(X\)\\neq d\(Y\),r\(X\)=0; andgg\-MAE, the test\-set mean of\|g^\(x\)−g\(y\)\|\|\\hat\{g\}\(x\)\-g\(y\)\|, which measures error in the scalar decision quantity\.Sim% is our primary efficiency metric because it directly measures the fraction of inputs that incur a high\-fidelity simulator call and serves as a direct proxy for simulation cost, whileMiss% quantifies the accompanying decision risk\. For additional routing diagnostics, we defineNeeds% as the method\-specific percentage of test inputs satisfyingd^\(X\)≠d\(Y\)\\hat\{d\}\(X\)\\neq d\(Y\)\. See Appendix[C](https://arxiv.org/html/2610.02487#A3)for metric definitions and for routing precision, recall, and F1 metrics, where we treatd^\(X\)≠d\(Y\)\\hat\{d\}\(X\)\\neq d\(Y\)as the positive class\.
Training and calibration\.The data splits are fixed before model training, with dataset\-specific proportions reported in Appendix[E](https://arxiv.org/html/2610.02487#A5)\. The calibration set is used only to compute the final conformal multiplier, while the training\-time interpolated quantile is computed exclusively from training mini\-batches\. We setα=0\.1\\alpha=0\.1, corresponding to 90% target coverage, and use the 70th percentile of the training\-set decision quantity as the default threshold unless otherwise noted\. To avoid dataset\-specific tuning, we use the same global heuristic settings for the routing\-loss coefficients and threshold bandwidth across all datasets and seeds\. ForTACR, all datasets use predictor\-only training followed by joint optimization of the predictor and scale head\. See Appendix[E](https://arxiv.org/html/2610.02487#A5)for the exact split sizes, baseline objectives, hyperparameters, and optimization settings\.
Reporting protocol\.We evaluate each non\-ensemble method over five random seeds, and report the mean and standard deviation\. The diagnostic controls use the seed counts stated in their captions\. Deep Ensemble uses five independently initialized predictors per dataset and is substantially more expensive than the single\-model methods because all five predictors must be trained and evaluated\([Mouli et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib39)\)\. We report point estimates rather than seed variation since the results comprise one five\-member ensemble run per dataset\.
### 4\.2Main Results
Table[3](https://arxiv.org/html/2610.02487#S4.T3)shows the results at the common nominal coverage level1−α=90%1\-\\alpha=90\\%using a fixed decision threshold for each dataset\. We prioritizeSim% because every routed input incurs a high\-fidelity simulator call, which makes it a direct proxy for simulation cost\.TACRlowers the meanSim% relative to Standard CP on all six datasets and attains the lowest mean on four\.Miss% provides the corresponding decision\-risk measure and is theoretically upper\-bounded by the noncoverage rate\. ForTACR, it remains below 1% on five datasets and is 2\.38% on AhmedML, which is well below the nominal 10% noncoverage level\. Thegg\-MAE diagnostic measures the accuracy of the scalar decision quantity, which can affect routing efficiency by changing how accurately the surrogate resolves the threshold decision\.TACRhas the lowest or second\-lowest meangg\-MAE on five of six datasets, with Beams as the exception\. We distinguish below between the overall gains relative to Standard CP and the contribution of threshold\-local interval allocation\. Section[4\.4](https://arxiv.org/html/2610.02487#S4.SS4)compares the methods across multiple values ofα\\alpha\.
Table 3:Main routing results across six scientific and engineering datasets\.Sim%, the fraction of inputs sent to high\-fidelity simulation, is our primary cost metric;Miss% measures incorrect surrogate decisions that escape simulation\. At the common 90% coverage target,TACRreducesSim% relative to Standard CP on all six datasets, attains the lowest meanSim% on four, and keepsMiss% below 2\.5% throughout\. The decision\-quantity mean absolute error,gg\-MAE, is an auxiliary diagnostic of predictor accuracy\. Entries are mean±\\pmstd over five seeds; the ensemble uses one five\-member run\. Lower is better\. Bold and underline mark the lowest and second\-lowest mean within each dataset and metric, respectively; exact ties share the same formatting\. On Darcy,†\\daggermarks CQR andTACR, whose meanSim% values differ by less than either reported standard deviation\.Threshold\-local weighting contributes to the routing gains\.Table[3](https://arxiv.org/html/2610.02487#S4.T3)provides our primary evidence that threshold\-local weighting contributes beyond changes in predictor accuracy\. Relative to Uniform,TACRreducesSim% by 10–24% on CircuitNet, Darcy, AirfRANS, and Beams\. The differences on AhmedML and ShapeNet\-Car are smaller than the reported standard deviations for both methods\. Uniform retainsTACR’s decision\-level training signal but removes threshold\-local weighting, while attaining similargg\-MAE andNeeds% \(see Table[9](https://arxiv.org/html/2610.02487#A3.T9)in Appendix[C](https://arxiv.org/html/2610.02487#A3)\)\. Because the two methods have similar predictor accuracy, their routing difference on the first four datasets is unlikely to result from predictor quality alone\. In contrast, the comparison with Standard CP reflects both changes in predictor accuracy and interval allocation\. An additional control in Appendix[B](https://arxiv.org/html/2610.02487#A2)shows that adding explicitgg\-level supervision to the baselines does not reproduce the routing gains on CircuitNet and AirfRANS\. Together, these comparisons identify threshold\-local interval allocation as a contributor to the routing gains\.
Figure 2:Routing relative to the zero\-miss reference\.Compared with Standard CP,TACRrequires less excess routing on all six datasets\. The dashed line,Sim%=Needs%\\textsc\{Sim\}\\%=\\textsc\{Needs\}\\%, marks the minimum routing rate under zero\-miss oracle routing for each fixed surrogate\.Predictive\-uncertainty scales do not reduce simulator use\.CQR,TW\-UQ, and Deep Ensemble adapt interval width using conditional quantiles, a likelihood\-based scale, and ensemble dispersion, respectively\. These constructions are designed to reflect predictive uncertainty, but they do not explicitly optimize interval allocation around the decision thresholdτ\\tau\. We see in Table[3](https://arxiv.org/html/2610.02487#S4.T3)that at the common coverage target,TW\-UQroutes more inputs thanTACRon all six datasets, and CQR and Deep Ensemble do so on five of the six\. Uncertainty\-aware scaling need not reduceSim%\.
TACRhas less excess routing above the zero\-miss bound\.For a fixed surrogate, the oracle zero\-miss router routes exactly those inputs on which the surrogate makes an incorrect threshold decision\. This yieldsSim%=Needs%\\textsc\{Sim\}\\%=\\textsc\{Needs\}\\%, which is the minimum simulation rate achievable with zero misses\. Figure[2](https://arxiv.org/html/2610.02487#S4.F2)shows thatTACRhas less excess routing above this bound than Standard CP on all six datasets; Figure[4](https://arxiv.org/html/2610.02487#A3.F4)in Appendix[C](https://arxiv.org/html/2610.02487#A3)includes all evaluated methods\. Since the evaluated methods allow nonzeroMiss%, this bound serves as a diagnostic reference rather than an equal\-safety operating point\.
### 4\.3Robustness and sensitivity analyses
We examine whether the routing gains persist across changes in the decision threshold, threshold\-local weighting strength, and surrogate backbone\.
TACRremains effective across decision thresholds\.The thresholdτ\\tauis an application specification fixed before deployment\. Table[4](https://arxiv.org/html/2610.02487#S4.T4)varies it over the 50th, 70th, 90th, and 95th percentiles of the training\-set decision quantity on CircuitNet and AirfRANS\.TACRattains the lowest meanSim% in seven of eight settings and ties Uniform in the remaining one, showing that its routing gains are not specific to the p70 threshold used in the main experiments\.
Table 4:Sensitivity to the decision threshold\.Threshold\-local weighting remains effective as the threshold changes:TACRattains the lowest meanSim% in seven of eight settings and ties Uniform in the remaining setting\. Thresholds are percentiles of the training\-set decision quantity\. Reported results are mean±\\pmstd over five seeds, and the main experiments use p70\.*CircuitNet*
*AirfRANS*
Sensitivity to threshold\-local weighting\.Table[6](https://arxiv.org/html/2610.02487#S4.T6)variesβ\\betaon CircuitNet while holding all other settings fixed\. MeanSim% decreases monotonically from 13\.4% atβ=4\\beta=4to 9\.7% atβ=64\\beta=64\.Miss% remains between 0\.28% and 0\.44% without a monotonic increase\. This dose\-response pattern provides additional evidence that stronger threshold\-local weighting systematically improves routing efficiency, rather than the gain at the defaultβ=16\\beta=16arising from a single favorable operating point\. We retain the prespecifiedβ=16\\beta=16used throughout the main experiments\. The sweep is intended to characterize sensitivity rather than to tuneβ\\betafor individual datasets\.
Routing gains are consistent across two surrogate backbones\.Table[6](https://arxiv.org/html/2610.02487#S4.T6)compares GraphSAGE with a four\-head Graph Transformer on AirfRANS\. The method ordering is preserved, withTACRattaining the lowest meanSim% under both backbones\. This provides evidence that the observed routing gains are not specific to the GraphSAGE backbone used in the main AirfRANS experiments\.
Table 5:Sensitivity to threshold\-local weighting\.Stronger weighting monotonically reduces meanSim% on CircuitNet from 13\.4% to 9\.7%, whileMiss% shows no monotonic increase\. Results are mean±\\pmstd over five seeds; the main experiments useβ=16\\beta=16, and bold marks the lowest mean in each metric\.
Table 6:Sensitivity to the surrogate backbone\.TACRretains the lowest meanSim% when the AirfRANS backbone changes from GraphSAGE to a four\-head Graph Transformer, providing evidence of transfer across these architectures\.Sim% is mean±\\pmstd over five seeds, andMiss% is a percentage\.
### 4\.4Post\-hoc cost\-risk trade\-offs
The main results use models trained withα=0\.1\\alpha=0\.1\. We next examine whether a model trained at this single coverage level can still support useful deployment\-time trade\-offs through recalibration alone\. Without retraining, we recompute the exact conformal quantileq^\(α\)\\hat\{q\}\(\\alpha\)overα∈\[0\.02,0\.30\]\\alpha\\in\[0\.02,0\.30\]and evaluate the resultingSim%–Miss% operating points\. Figure[3](https://arxiv.org/html/2610.02487#S4.F3)shows that changing the calibration level produces substantial variation in simulator use and decision risk\. This indicates that a fixed trained model can be adapted post hoc to different deployment requirements\. Smallerα\\alphagenerally produces wider intervals and more routing, while empiricalMiss% may decrease\. Since conformal ranks and test\-set counts are discrete, the curves are stepwise and empiricalMiss% need not vary monotonically\. The relative ordering is dataset\- and operating\-point\-dependent, with crossings betweenTACRand Uniform in some regimes\. Sinceα\\alphaalso enters the training\-time soft quantile, these curves characterize the post\-hoc flexibility of models trained atα=0\.1\\alpha=0\.1, rather than separately optimized performance at each coverage level\.
Figure 3:Post\-hoc cost–risk trade\-offs\.Models are trained once withα=0\.1\\alpha=0\.1and then recalibrated overα∈\[0\.02,0\.30\]\\alpha\\in\[0\.02,0\.30\]by recomputing only the exact conformal quantile, without retraining\. Trade\-offs vary by dataset and operating point: learned\-scale methods often require fewer simulator calls than Standard CP at comparableMiss%, while crossings betweenTACRand Uniform show that neither uniformly dominates across all recalibrated operating points\. Curves aggregate five seeds; the lower left is preferred\. The dotted horizontal line marks a 1% miss rate\. For AhmedML, Standard CP and Uniform use a learning rate of10−310^\{\-3\}rather than the5×10−45\\times 10^\{\-4\}used in the main table\.
## 5Conclusion
Learned surrogates can reduce the cost of high\-fidelity simulation, but their errors can alter downstream decisions\. We formulate the surrogate\-simulator handoff for fixed scalar thresholds as threshold\-aware routing with split\-conformal coverage\. Exploiting conformal validity for any nonconformity score fixed before calibration, our proposedTACRmethod learns to allocate interval width according to its effect on routing\. Across various scientific and engineering datasets,TACRreduces the fraction of inputs routed to simulation by 14–75% relative to standard conformal prediction at the same nominal coverage target\. Against a variant without threshold\-local weighting but with similar predictor accuracy,TACRfurther reduces deferrals by 10–24% on four datasets\. These results show that routing\-aware interval allocation can reduce simulator calls without weakening the standard conformal guarantee\.
Limitations and future work\.TACRcurrently addresses decisions defined by a fixed scalar threshold\. Extending it to multiple simultaneous specifications would require a joint routing rule and an appropriate calibration target\. In addition, its guarantee is marginal rather than conditional, so the stratified results in Appendix[D](https://arxiv.org/html/2610.02487#A4)are empirical diagnostics and do not establish local risk control\. Routing efficiency depends on surrogate accuracy and on the distribution of decision quantities around the threshold, and may vary across tasks\. Extensions to group\-conditional calibration, multi\-constraint decisions, and online updating with newly simulated samples are promising future directions\.
### Reproducibility statement
Sections[3](https://arxiv.org/html/2610.02487#S3)and[4\.1](https://arxiv.org/html/2610.02487#S4.SS1)specify the method, calibration and routing procedures, datasets, baselines, metrics, and evaluation protocol; Section[3\.3](https://arxiv.org/html/2610.02487#S3.SS3)states the assumptions underlying the finite\-sample guarantee\. Appendix[E](https://arxiv.org/html/2610.02487#A5)provides the exact data splits and preprocessing, dataset\-specific architectures and scale heads, prediction objectives, hyperparameters, optimization schedules, and calibration details\. Dataset and backbone sources are cited in Section[4\.1](https://arxiv.org/html/2610.02487#S4.SS1)and Table[2](https://arxiv.org/html/2610.02487#S4.T2), and the captions identify the seed aggregation and evaluation settings used for the reported results\.
### AI use statement
In this work, we used generative AI tools to retrieve and organize relevant literature; assist with code development, code auditing, result aggregation, and figure preparation; and polish portions of the manuscript\. The authors reviewed all AI\-assisted text, checked cited literature against the original sources, and inspected and tested AI\-assisted code and numerical outputs\. Generative AI was not used to generate synthetic datasets or prove mathematical claims\. We take responsibility for the final content of this work, including text, claims, code, and artifacts produced with the aid of generative AI\.
## References
- Adamset al\.\(2025\)C\. Adams, R\. Ranade, R\. Cherukuri, and S\. ChoudhryGeotransolver: learning physics on irregular domains using multi\-scale geometry aware physics attention transformer\.arXiv preprint arXiv:2512\.20399\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Alkinet al\.\(2025\)B\. Alkin, M\. Bleeker, R\. Kurle, T\. Kronlachner, R\. Sonnleitner, M\. Dorfer, and J\. BrandstetterAB\-UPT: scaling neural CFD surrogates for high\- fidelity automotive aerodynamics simulations via anchored\- branched universal physics transformers\.Transactions on Machine Learning Research\.Note:External Links:ISSN 2835\-8856Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Aminiet al\.\(2020\)A\. Amini, W\. Schwarting, A\. Soleimany, and D\. RusDeep evidential regression\.Advances in neural information processing systems33,pp\. 14927–14937\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p2.1)\.
- Ananthanet al\.\(2024\)V\. Ananthan, N\. Ashton, N\. Chadwick, M\. Lizarraga, D\. Maddix, S\. Maheswaran, P\. H\. Moreno, P\. M\. Shabestari, S\. Sovani, S\. Subramanian,et al\.Machine learning for road vehicle aerodynamics\.InWCX SAE World Congress Experience 288443,Cited by:[§1](https://arxiv.org/html/2610.02487#S1.p1.1)\.
- Angelopoulos and Bates \(2023\)A\. N\. Angelopoulos and S\. BatesConformal prediction: a gentle introduction\.Foundations and Trends in Machine Learning16\(4\),pp\. 494–591\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1)\.
- Ashtonet al\.\(2024\)N\. Ashton, D\. C\. Maddix, S\. Gundry, and P\. M\. ShabestariAhmedML: high\-fidelity computational fluid dynamics dataset for incompressible, low\-speed bluff body aerodynamics\.arXiv preprint arXiv:2407\.20801\.Cited by:[§1](https://arxiv.org/html/2610.02487#S1.p1.1),[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p1.1)\.
- Bonnetet al\.\(2022\)F\. Bonnet, J\. Mazari, P\. Cinnella, and P\. GallinariAirfRANS: high fidelity computational fluid dynamics dataset for approximating reynolds\-averaged navier–stokes solutions\.Advances in Neural Information Processing Systems35,pp\. 23463–23478\.Cited by:[§1](https://arxiv.org/html/2610.02487#S1.p1.1),[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p1.1)\.
- Chaiet al\.\(2023\)Z\. Chai, Y\. Zhao, W\. Liu, Y\. Lin, R\. Wang, and R\. HuangCircuitNet: an open\-source dataset for machine learning in vlsi cad applications with improved domain\-specific evaluation metric and learning strategies\.IEEE Transactions on Computer\-Aided Design of Integrated Circuits and Systems42\(12\),pp\. 5034–5047\.Cited by:[§1](https://arxiv.org/html/2610.02487#S1.p1.1)\.
- Cortes\-Gomezet al\.\(2025\)S\. Cortes\-Gomez, C\. Patino, Y\. Byun, S\. Wu, E\. Horvitz, and B\. WilderUtility\-directed conformal prediction: a decision\-aware framework for actionable uncertainty quantification\.InInternational Conference on Learning Representations,Vol\.2025,pp\. 4227–4246\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p5.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Gal and Ghahramani \(2016\)Y\. Gal and Z\. GhahramaniDropout as a bayesian approximation: representing model uncertainty in deep learning\.Ininternational conference on machine learning,pp\. 1050–1059\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p2.1)\.
- Jianget al\.\(2024\)X\. Jiang, Y\. Zhao, Y\. Lin, R\. Wang, R\. Huang,et al\.Circuitnet 2\.0: an advanced dataset for promoting machine learning innovations in realistic chip design environment\.InThe Twelfth International Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2610.02487#S1.p1.1),[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p1.1)\.
- Lakshminarayananet al\.\(2017\)B\. Lakshminarayanan, A\. Pritzel, and C\. BlundellSimple and scalable predictive uncertainty estimation using deep ensembles\.Advances in neural information processing systems30\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p2.1),[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p2.1)\.
- Lei and Bellotti \(2023\)H\. Lei and A\. BellottiReliable prediction intervals with directly optimized inductive conformal regression for deep learning\.Neural Networks168,pp\. 194–205\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Lekeufacket al\.\(2024\)J\. Lekeufack, A\. N\. Angelopoulos, A\. Bajcsy, M\. I\. Jordan, and J\. MalikConformal decision theory: safe autonomous decisions from imperfect predictions\.In2024 IEEE International Conference on Robotics and Automation \(ICRA\),pp\. 11668–11675\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p5.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Liet al\.\(2021\)Z\. Li, N\. B\. Kovachki, K\. Azizzadenesheli, B\. Liu, K\. Bhattacharya, A\. Stuart, and A\. AnandkumarFourier neural operator for parametric partial differential equations\.InInternational Conference on Learning Representations,Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Liet al\.\(2023\)Z\. Li, N\. Kovachki, C\. Choy, B\. Li, J\. Kossaifi, S\. Otta, M\. A\. Nabian, M\. Stadler, C\. Hundt, K\. Azizzadenesheli,et al\.Geometry\-informed neural operator for large\-scale 3d pdes\.Advances in Neural Information Processing Systems36,pp\. 35836–35854\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Luoet al\.\(2025\)H\. Luo, H\. Wu, H\. Zhou, L\. Xing, Y\. Di, J\. Wang, and M\. LongTransolver\+\+: an accurate neural solver for PDEs on million\-scale geometries\.InProceedings of the 42nd International Conference on Machine Learning,A\. Singh, M\. Fazel, D\. Hsu, S\. Lacoste\-Julien, F\. Berkenkamp, T\. Maharaj, K\. Wagstaff, and J\. Zhu \(Eds\.\),Proceedings of Machine Learning Research, Vol\.267,pp\. 41432–41449\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Maet al\.\(2024\)Z\. Ma, D\. Pitt, K\. Azizzadenesheli, and A\. AnandkumarCalibrated uncertainty quantification for operator learning via conformal prediction\.Transactions on Machine Learning Research\.Note:External Links:ISSN 2835\-8856Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Madraset al\.\(2018\)D\. Madras, T\. Pitassi, and R\. ZemelPredict responsibly: improving fairness and accuracy by learning to defer\.Advances in neural information processing systems31\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p2.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Magnaniet al\.\(2025\)E\. Magnani, N\. Krämer, R\. Eschenhagen, L\. Rosasco, and P\. HennigApproximate bayesian neural operators: uncertainty quantification for parametric PDEs\.Transactions on Machine Learning Research\.Note:External Links:ISSN 2835\-8856Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1)\.
- Mouliet al\.\(2024\)S\. C\. Mouli, D\. C\. Maddix, S\. Alizadeh, G\. Gupta, A\. Stuart, M\. W\. Mahoney, and B\. WangUsing uncertainty quantification to characterize and improve out\-of\-domain learning for PDEs\.InProceedings of the 41st International Conference on Machine Learning,R\. Salakhutdinov, Z\. Kolter, K\. Heller, A\. Weller, N\. Oliver, J\. Scarlett, and F\. Berkenkamp \(Eds\.\),Proceedings of Machine Learning Research, Vol\.235,pp\. 36372–36418\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p5.1)\.
- Mozannar and Sontag \(2020\)H\. Mozannar and D\. SontagConsistent estimators for learning to defer to an expert\.InInternational conference on machine learning,pp\. 7076–7087\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p2.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Nabianet al\.\(2024\)M\. A\. Nabian, C\. Liu, R\. Ranade, and S\. ChoudhryX\-meshgraphnet: scalable multi\-scale graph neural networks for physics simulation\.arXiv preprint arXiv:2411\.17164\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Nooraniet al\.\(2026\)S\. Noorani, O\. Romero, N\. Dal Fabbro, H\. Hassani, and G\. J\. PappasConformal risk minimization with variance reduction\.InProceedings of the 42nd Conference on Uncertainty in Artificial Intelligence,E\. Perković and D\. Malinsky \(Eds\.\),Proceedings of Machine Learning Research, Vol\.337,pp\. 4972–5002\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Papadopouloset al\.\(2002\)H\. Papadopoulos, K\. Proedrou, V\. Vovk, and A\. GammermanInductive confidence machines for regression\.InEuropean conference on machine learning,pp\. 345–356\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1)\.
- Pfaffet al\.\(2021\)T\. Pfaff, M\. Fortunato, A\. Sanchez\-Gonzalez, and P\. BattagliaLearning mesh\-based simulation with graph networks\.InInternational Conference on Learning Representations,Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Qinet al\.\(2024\)X\. Qin, Y\. Xia, A\. Zutshi, C\. Fan, and J\. V\. DeshmukhStatistical verification using surrogate models and conformal inference and a comparison with risk\-aware verification\.ACM Transactions on Cyber\-Physical Systems8\(2\),pp\. 1–25\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Ranadeet al\.\(2025\)R\. Ranade, M\. A\. Nabian, K\. Tangsali, A\. Kamenev, O\. Hennigh, R\. Cherukuri, and S\. ChoudhryDoMINO: a decomposable multi\-scale iterative neural operator for modeling large scale engineering simulations\.arXiv preprint arXiv:2501\.13350\.Cited by:[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Romanoet al\.\(2019\)Y\. Romano, E\. Patterson, and E\. CandesConformalized quantile regression\.Advances in neural information processing systems32\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1),[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p2.1)\.
- Sokolet al\.\(2026\)A\. Sokol, N\. Moniz, and N\. V\. ChawlaConformalized selective regression\.Discover Data4\(1\),pp\. 14\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p2.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Stutzet al\.\(2022\)D\. Stutz, K\. D\. Dvijotham, A\. T\. Cemgil, and A\. DoucetLearning optimal conformal classifiers\.InInternational Conference on Learning Representations,Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Suet al\.\(2026\)X\. Su, Z\. Zhou, and R\. LuoCo\-optimization for adaptive conformal prediction\.arXiv preprint arXiv:2603\.01719\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Takamotoet al\.\(2022\)M\. Takamoto, T\. Praditia, R\. Leiteritz, D\. MacKinlay, F\. Alesiani, D\. Pflüger, and M\. NiepertPdebench: an extensive benchmark for scientific machine learning\.Advances in neural information processing systems35,pp\. 1596–1611\.Cited by:[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p1.1)\.
- Uddinet al\.\(2026\)I\. Uddin, M\. Khider, and A\. BauerProactive routing to interpretable surrogates with distribution\-free safety guarantees\.arXiv preprint arXiv:2603\.14623\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p3.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Umetani and Bickel \(2018\)N\. Umetani and B\. BickelLearning three\-dimensional flow for interactive aerodynamic design\.ACM Transactions on Graphics \(TOG\)37\(4\),pp\. 1–10\.Cited by:[§4\.1](https://arxiv.org/html/2610.02487#S4.SS1.p1.1)\.
- Vovket al\.\(2005\)V\. Vovk, A\. Gammerman, and G\. ShaferAlgorithmic learning in a random world\.Springer\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Wuet al\.\(2024\)H\. Wu, H\. Luo, H\. Wang, J\. Wang, and M\. LongTransolver: a fast transformer solver for PDEs on general geometries\.InProceedings of the 41st International Conference on Machine Learning,R\. Salakhutdinov, Z\. Kolter, K\. Heller, A\. Weller, N\. Oliver, J\. Scarlett, and F\. Berkenkamp \(Eds\.\),Proceedings of Machine Learning Research, Vol\.235,pp\. 53681–53705\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p6.1),[§1](https://arxiv.org/html/2610.02487#S1.p2.1)\.
- Xieet al\.\(2024\)R\. Xie, R\. F\. Barber, and E\. J\. CandèsBoosted conformal prediction intervals\.Advances in Neural Information Processing Systems37,pp\. 71868–71899\.Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p4.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
- Yehet al\.\(2025\)C\. Yeh, N\. Christianson, A\. Wu, A\. Wierman, and Y\. YueEnd\-to\-end conformal calibration for optimization under uncertainty\.Transactions on Machine Learning Research\.Note:External Links:ISSN 2835\-8856Cited by:[Appendix A](https://arxiv.org/html/2610.02487#A1.p5.1),[Table 1](https://arxiv.org/html/2610.02487#S2.T1.6.11.1.1.1)\.
## Appendix AExtended Related Work
This section expands the comparison in Section[2](https://arxiv.org/html/2610.02487#S2)and distinguishes the statistical targets and modeling objectives of the most closely related approaches\.
Selective prediction and model routing\.Selective prediction allows a model to withhold its prediction when it is unreliable, optionally deferring to a fallback model or expert\. Learning\-to\-defer methods jointly learn when to predict and when to delegate to a downstream expert, accounting for both model and expert performance in the system objective\([Madras et al\., 2018](https://arxiv.org/html/2610.02487#bib.bib11);[Mozannar and Sontag, 2020](https://arxiv.org/html/2610.02487#bib.bib12)\)\. Conformalized selective regression instead uses conformalized interval width as an input\-dependent rejection score\([Sokol et al\., 2026](https://arxiv.org/html/2610.02487#bib.bib13)\)\. More generally, deep ensembles\([Lakshminarayanan et al\., 2017](https://arxiv.org/html/2610.02487#bib.bib19)\), MC\-Dropout\([Gal and Ghahramani, 2016](https://arxiv.org/html/2610.02487#bib.bib20)\), and evidential regression\([Amini et al\., 2020](https://arxiv.org/html/2610.02487#bib.bib21)\)provide uncertainty estimates that can serve as deferral scores when incorporated into a routing system\. Learning\-to\-defer methods optimize the system\-level handoff but do not construct conformal intervals, whereas conformalized selective regression and the uncertainty\-quantification methods above use generic uncertainty measures for rejection\. None of these approaches trains conformal interval allocation specifically around a downstream decision threshold\.
Most closely related to our setting,[Uddin et al\. \(2026\)](https://arxiv.org/html/2610.02487#bib.bib14)train an input\-based gate that chooses between an interpretable surrogate and a reference model before either model is evaluated\. They train the gate to distinguish safe from unsafe inputs and calibrate its routing threshold on held\-out data to ensure, with probability at least1−δ1\-\\delta, that the violation rate among inputs routed to the surrogate is at mostα\\alpha\. This guarantee concerns performance degradation conditional on routing, whereas our conformal interval provides marginal coverage for the simulator\-derived decision quantity\. Their method also does not learn how the interval width should be allocated around a downstream specification threshold\.
Conformal efficiency optimization\.Split conformal prediction \(CP\) provides finite\-sample marginal coverage under exchangeability\([Vovk et al\., 2005](https://arxiv.org/html/2610.02487#bib.bib1);[Papadopoulos et al\., 2002](https://arxiv.org/html/2610.02487#bib.bib2)\);[Angelopoulos and Bates \(2023\)](https://arxiv.org/html/2610.02487#bib.bib3)give a modern introduction\. Conformalized Quantile Regression \(CQR\) adapts interval width to heteroscedasticity by conformalizing learned conditional quantiles\([Romano et al\., 2019](https://arxiv.org/html/2610.02487#bib.bib4)\)\. Other methods optimize conformal efficiency more directly\. ConfTr differentiates through a mini\-batch approximation to conformal prediction to optimize the size and composition of classification sets\([Stutz et al\., 2022](https://arxiv.org/html/2610.02487#bib.bib6)\), while VR\-ConfTr reduces the variance of its gradient estimates\([Noorani et al\., 2026](https://arxiv.org/html/2610.02487#bib.bib7)\)\. For regression, DOICR directly minimizes average interval width\([Lei and Bellotti, 2023](https://arxiv.org/html/2610.02487#bib.bib8)\); Boosted Conformal Intervals uses gradient boosting to refine a predefined conformity score for shorter intervals or improved conditional coverage\([Xie et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib10)\); and CoCP jointly learns interval centers and radii\([Su et al\., 2026](https://arxiv.org/html/2610.02487#bib.bib9)\)\. These methods optimize conformal efficiency or other interval\-quality objectives, but their objectives are not localized by distance to an externally specified downstream decision threshold\.
Decision\-aware conformal prediction\.A growing line of work connects conformal methods with downstream decisions\. Conformal Decision Theory calibrates decisions directly to control their realized average loss \(decision risk\), without first constructing prediction sets\([Lekeufack et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib15)\)\. Utility\-Directed CP incorporates a downstream cost function into the construction of classification prediction sets while retaining standard coverage guarantees\([Cortes\-Gomez et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib16)\)\. End\-to\-end conformal calibration for optimization learns uncertainty sets for conditional robust optimization using the downstream decision loss\([Yeh et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib17)\)\. These methods show how conformal procedures can account for decision risk or utility, but they do not study when to invoke a high\-fidelity simulator according to whether a scalar conformal interval crosses a fixed specification threshold\.
Scientific surrogates and calibrated uncertainty\.Scientific surrogate modeling spans neural operators such as FNO\([Li et al\., 2021](https://arxiv.org/html/2610.02487#bib.bib22)\)and GINO\([Li et al\., 2023](https://arxiv.org/html/2610.02487#bib.bib23)\), graph\-based simulators such as MeshGraphNet\([Pfaff et al\., 2021](https://arxiv.org/html/2610.02487#bib.bib24)\)and X\-MeshGraphNet\([Nabian et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib25)\), and transformer\-based models such as Transolver\([Wu et al\., 2024](https://arxiv.org/html/2610.02487#bib.bib26)\), Transolver\+\+\([Luo et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib28)\), GeoTransolver\([Adams et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib27)\), and AB\-UPT\([Alkin et al\., 2025](https://arxiv.org/html/2610.02487#bib.bib29)\)\. Complementary work studies uncertainty quantification and calibration for these surrogates\.[Magnani et al\. \(2025\)](https://arxiv.org/html/2610.02487#bib.bib18)develop an approximate Bayesian framework for uncertainty quantification in neural operators\.[Mouli et al\. \(2024\)](https://arxiv.org/html/2610.02487#bib.bib39)evaluate several uncertainty\-quantification methods for neural operators under out\-of\-domain inputs and introduce DiverseNO, a multi\-head model designed to approximate the uncertainty benefits of an ensemble at lower computational cost\.[Ma et al\. \(2024\)](https://arxiv.org/html/2610.02487#bib.bib5)provide distribution\-free, finite\-sample calibration for function\-valued operator outputs, targeting the expected fraction of domain points covered by the uncertainty band, and[Qin et al\. \(2024\)](https://arxiv.org/html/2610.02487#bib.bib30)use surrogate models and conformal inference to provide probabilistic guarantees for the satisfaction of formal system specifications\. These methods quantify or calibrate surrogate outputs and formal properties, but they do not learn threshold\-local conformal interval allocation for selective simulator invocation\.
Table[1](https://arxiv.org/html/2610.02487#S2.T1)condenses these distinctions\. Because the cited methods establish different statistical statements, a checkmark in the guarantee column indicates the presence of a distribution\-free coverage or risk guarantee, not that the guaranteed quantities are equivalent\.
## Appendix BAdditional decision\-level supervision diagnostic
The comparison with Uniform in Section[4\.2](https://arxiv.org/html/2610.02487#S4.SS2)is our primary evidence for separating the benefit of threshold\-local weighting from changes in predictor quality\. As an additional check, Table[7](https://arxiv.org/html/2610.02487#A2.T7)augments each baseline with an extra unweightedgg\-level MSE loss while leavingTACRwithout this auxiliary term\. On both CircuitNet and AirfRANS,TACRroutes fewer samples than every baseline in this comparison\. Thus, adding this direct supervision of the decision quantity does not by itself reproduce the routing efficiency ofTACRon these two datasets\.
Table 7:Explicit decision\-level supervision does not reproduceTACR’s routing gains: without auxiliarygg\-MSE,TACRattains the lowest meanSim% on both datasets\. Values are percentages reported as mean±\\pmstd over five seeds; bold marks the lowest mean\.
## Appendix CFull per\-dataset metrics
Table[8](https://arxiv.org/html/2610.02487#A3.T8)summarizes the core notation and gives plain\-language interpretations of the reported metrics\.Sim% andMiss% form the primary cost–risk pair, whereasgg\-MAE andNeeds% diagnose predictor accuracy and the surrogate\-specific zero\-miss routing reference, respectively\.
Table 8:Core notation and evaluation metrics\. Each quantity is paired with its operational role in conformal routing; percentages are computed over test inputs\.NotationDefinitionDescriptiong^\(x\)\\hat\{g\}\(x\)g\(fθ\(x\)\)g\(f\_\{\\theta\}\(x\)\)Surrogate estimate of the scalar decision quantity used for routing\.τ\\tauFixed decision thresholdApplication\-specified limit against which the decision quantity is compared, such as a maximum allowable stress or a minimum required lift coefficient\.σ\(x\)\\sigma\(x\)Positive input\-dependent scaleLearned relative\-width factor that allows interval width to vary across inputs\.q^\\hat\{q\}Calibration multiplier in Eq\.[12](https://arxiv.org/html/2610.02487#S3.E12)Value computed from held\-out calibration scores to obtain the conformal coverage guarantee\.C\(x\)C\(x\)\[g^\(x\)−q^σ\(x\),\[\\hat\{g\}\(x\)\-\\hat\{q\}\\sigma\(x\),g^\(x\)\+q^σ\(x\)\]\\hat\{g\}\(x\)\+\\hat\{q\}\\sigma\(x\)\]Calibrated prediction interval for the scalar decision quantity\.Sim%100Pr\(r\(X\)=1\)100\\Pr\(r\(X\)=1\)Inputs that still require a high\-fidelity simulator call; the primary cost metric\.Miss%100Pr\(d^\(X\)≠d\(Y\)CLOSE,100\\Pr\(\\hat\{d\}\(X\)\\neq d\(Y\),OPENr\(X\)=0\)r\(X\)=0\)Wrong surrogate threshold decisions that escape simulation; the accompanying risk metric\.gg\-MAE𝔼\[\|g^\(X\)−g\(Y\)\|\]\\mathbb\{E\}\[\|\\hat\{g\}\(X\)\-g\(Y\)\|\]Average error in the scalar decision quantity; a diagnostic of predictor accuracy\.Needs%100Pr\(d^\(X\)≠d\(Y\)\)100\\Pr\(\\hat\{d\}\(X\)\\neq d\(Y\)\)Inputs the surrogate alone would classify incorrectly; for a fixed surrogate, the zero\-miss oracle routing rate\.Table[9](https://arxiv.org/html/2610.02487#A3.T9)reports the complete metric set for every method on every dataset \(mean over five seeds for non\-ensemble methods; ensemble single run\)\. Precision, recall, and F1 score \(Prec, Rec, and F1\) evaluate routing as a detector of theNeeds% event, andρ\\rhois the Spearman correlation betweenσ\\sigmaand absolute prediction error\. The training objective does not directly optimize this correlation\.
Table 9:Uniform andTACRhave closely matchedgg\-MAE and Needs% across datasets, making their routing differences informative about threshold\-local interval allocation rather than predictor quality\. Prec, Rec, and F1 denote routing precision, recall, and F1 score\. Needs,Sim%, andMiss% are percentages, whereas Prec, Rec, F1, andρ\\rhoare fractions\. Bold marks the best value within each dataset and metric: lower forgg\-MAE, Needs,Sim%, andMiss%, and higher for Prec, Rec, F1, andρ\\rho\. Displayed ties are all bolded\.Figure 4:Routing relative to the zero\-miss reference across all methods\.The dashed line,Sim%=Needs%\\textsc\{Sim\}\\%=\\textsc\{Needs\}\\%, marks the minimum routing rate under zero\-miss oracle routing for each fixed surrogate\. Color denotes method, and marker shape denotes dataset; “Std\. CP” and “Deep Ens\.” denote Standard CP and Deep Ensemble\.
## Appendix DConditional behavior nearτ\\tau
Although split conformal calibration controls marginal noncoverage, routing depends on where that noncoverage occurs\. Nearτ\\tau, tighter intervals are less likely to cross the threshold and can reduceSim%, particularly when the predicted decision quantity is accurate; noncoverage there, however, is also the most likely to produce a wrong unrouted decision\. Far fromτ\\tau, noncoverage is often decision\-benign becauseg\(y\)g\(y\)can fall outside the interval while remaining on the same side of the threshold asg^\\hat\{g\}\. Thus, allocating noncoverage to near\-threshold or far\-threshold inputs can respectively improve routing efficiency or use the error budget where it is less likely to increaseMiss%\. Figure[5](https://arxiv.org/html/2610.02487#A4.F5)examines this behavior by stratifying test samples according to either the predicted margin\|g^−τ\|\|\\hat\{g\}\-\\tau\|or the ground\-truth distance\|g\(y\)−τ\|\|g\(y\)\-\\tau\|\.
Figure 5:Distance\-stratified misses and noncoverage forTACR\.Bars pool five seeds for each displayed dataset\. The top row reports miss and the bottom row noncoverage \(100%−coverage100\\%\-\\mathrm\{coverage\}\); columns bin by the predicted margin \(left\) or ground\-truth distance \(right\), normalized by the standard deviation ofg\(y\)g\(y\)\. The dashed line marks the marginalα=0\.1\\alpha=0\.1noncoverage target, not a bandwise constraint\.The bars show that noncoverage is not distributed uniformly across distance bands: it is often elevated near the threshold or in the farthest bands relative to intermediate distances\. Misses, by contrast, are concentrated nearτ\\tauand vanish in most farther bands\. Darcy provides the clearest example of the second effect: far\-band noncoverage reaches approximately 65–80%, yet no misses are observed there because the uncovered targets remain on the correct side of the threshold\. This separation between noncoverage and decision error is consistent with the intended allocation of interval width: the resulting allocation can trade local coverage behavior for reduced routing where the decision is difficult, while noncoverage far fromτ\\tauis comparatively inexpensive in decision risk\. These stratified results are diagnostic rather than a conditional guarantee; applications requiring coverage within prespecified regions would need group\-conditional or another locally valid calibration procedure\.
## Appendix EImplementation details
Data splits\.Table[10](https://arxiv.org/html/2610.02487#A5.T10)reports the exact splits used in all finalized experiments\. Each dataset is partitioned into training, calibration, and test sets, with no separate validation set\. The split is generated once with seed 42 and held fixed across run seeds, so repeated runs differ only in model initialization and training stochasticity rather than data membership\. Models are trained for fixed epoch counts and evaluated at the final epoch, without early stopping or checkpoint selection\. The calibration partition is reserved exclusively for conformal calibration\.
Table 10:Exact data splits used in the experiments\. A dash indicates that no separate validation partition is used\.DatasetTotalTrainValidationCalibrationTestCircuitNet3,4562,073–519864Darcy10,0006,000–2,0002,000AirfRANS1,000600–200200AhmedML498298–99101ShapeNet\-Car888532–177179Beams2,0001,200–400400Dataset preprocessing\.No cases are filtered from CircuitNet or Darcy\. Darcy’s inputs and targets are standardized\. AirfRANS subsamples 5,000 surface and volume points per geometry and constructs radius graphs with radius 0\.05 and at most 64 neighbors\. AhmedML uses 48,000 points per geometry during training and 64,000 during calibration and testing\. ShapeNet\-Car uses point coordinates and surface normals, standardized across the dataset\. The beams dataset is generated with seed 42 and contains five input features\.
Backbones and scale heads\.Table[11](https://arxiv.org/html/2610.02487#A5.T11)summarizes the dataset\-specific architectures and optimization settings\. CircuitNet uses ResNet18\-UNet\+\+ with its encoder initialized from ImageNet weights; all other backbones are initialized from scratch\. AirfRANS uses three GraphSAGE layers with input dimension 7 and hidden, latent, and scale\-projection dimensions of 64\. Beams uses a three\-layer MLP with width 64\. AhmedML and ShapeNet\-Car use GeoTransolver with hidden dimension 160, 20 layers, 128 slices, and eight heads\.
For Uniform,TW\-UQ, andTACR, we parameterizeσ\(x\)=σϕ\(hθ\(x\)\)\\sigma\(x\)=\\sigma\_\{\\phi\}\(h\_\{\\theta\}\(x\)\), wherehθ\(x\)h\_\{\\theta\}\(x\)is the predictor’s penultimate backbone representation\. The scale head projects the spatial, node, or latent features to a lower\-dimensional representation, pools them into one vector per sample, and applies a small MLP with a Softplus output to ensure positivity\. It attaches to the encoder bottleneck for convolutional models, pools node or point features for graph\- and transformer\-based models, and uses the shared MLP trunk for beams\. Thus, the scale head reuses features already computed for prediction and introduces no separate feature extractor\.
Table 11:Dataset\-specific configurations\. Batch sizes are shown as training/calibration/test\.E1E\_\{1\}andE2E\_\{2\}denote the two stages used by Uniform,TW\-UQ, andTACR; single\-stage methods train forE1E\_\{1\}epochs\. All optimizers use weight decay10−410^\{\-4\}and cosine learning\-rate decay within each stage\. For AhmedML, the two learning rates denoteTACRand the baselines, respectively\.Prediction objectives\.For Standard CP, Uniform, andTACR, the prediction objective is mean\-squared error on the predicted field for CircuitNet, Darcy, AirfRANS, AhmedML, and ShapeNet\-Car, and mean\-squared error on the scalarlog10\\log\_\{10\}peak\-stress target for beams\. CQR replaces the standard prediction head with two conditional\-quantile outputs and optimizes the pinball loss\. Each Deep Ensemble member uses the corresponding dataset\-level prediction objective\.
TW\-UQobjective\.This baseline augments the dataset\-level prediction loss with a threshold\-weighted error on the scalar decision quantity and a Gaussian negative\-log\-likelihood objective for a positive scaleσi\\sigma\_\{i\}produced by a Softplus head\. Letgi=g\(yi\)g\_\{i\}=g\(y\_\{i\}\)andϵ=10−8\\epsilon=10^\{\-8\}, and define
wiTW=1\+2exp\(−\(sg\[g^i\]−τ\)22bw2\),w\_\{i\}^\{\\mathrm\{TW\}\}=1\+2\\exp\\\!\\left\(\-\\frac\{\(\\operatorname\{sg\}\[\\hat\{g\}\_\{i\}\]\-\\tau\)^\{2\}\}\{2\\,\\mathrm\{bw\}^\{2\}\}\\right\),\(15\)wheresg\\operatorname\{sg\}denotes stop\-gradient\. During joint training, the minibatch objective is
ℒTW\-UQ\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{TW\\text\{\-\}UQ\}\}=ℒpred\+12ℒg,IW\+12ℒNLL,\\displaystyle=\\mathcal\{L\}\_\{\\mathrm\{pred\}\}\+\\tfrac\{1\}\{2\}\\mathcal\{L\}\_\{g,\\mathrm\{IW\}\}\+\\tfrac\{1\}\{2\}\\mathcal\{L\}\_\{\\mathrm\{NLL\}\},\(16\)ℒg,IW\\displaystyle\\mathcal\{L\}\_\{g,\\mathrm\{IW\}\}=1\|ℬ\|∑i∈ℬwiTW\(g^i−gi\)2,\\displaystyle=\\frac\{1\}\{\|\\mathcal\{B\}\|\}\\sum\_\{i\\in\\mathcal\{B\}\}w\_\{i\}^\{\\mathrm\{TW\}\}\(\\hat\{g\}\_\{i\}\-g\_\{i\}\)^\{2\},\(17\)ℒNLL\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{NLL\}\}=1\|ℬ\|∑i∈ℬ\[log\(σi\+ϵ\)\+sg\[gi−g^i\]22σi2\+ϵ\]\.\\displaystyle=\\frac\{1\}\{\|\\mathcal\{B\}\|\}\\sum\_\{i\\in\\mathcal\{B\}\}\\left\[\\log\(\\sigma\_\{i\}\+\\epsilon\)\+\\frac\{\\operatorname\{sg\}\[g\_\{i\}\-\\hat\{g\}\_\{i\}\]^\{2\}\}\{2\\sigma\_\{i\}^\{2\}\+\\epsilon\}\\right\]\.\(18\)The stopped residual prevents the likelihood term from directly updating the mean prediction, while the weighted scalar error emphasizes prediction accuracy nearτ\\tau\. The predictor\-only warm\-up usesℒpred\\mathcal\{L\}\_\{\\mathrm\{pred\}\}alone\. At calibration and deployment,TW\-UQusessi=\|gi−g^i\|/\(σi\+ϵ\)s\_\{i\}=\|g\_\{i\}\-\\hat\{g\}\_\{i\}\|/\(\\sigma\_\{i\}\+\\epsilon\)and the same split\-conformal interval\[g^i−q^σi,g^i\+q^σi\]\[\\hat\{g\}\_\{i\}\-\\hat\{q\}\\sigma\_\{i\},\\hat\{g\}\_\{i\}\+\\hat\{q\}\\sigma\_\{i\}\]as the other learned\-scale methods\. The objective and its coefficients are shared across all six datasets\.
Decision quantities on the CFD datasets\.For AirfRANS, AhmedML, and ShapeNet\-Car, the routing quantity is computed by integrating the predicted surface pressure\. AirfRANS uses the lift coefficientCLC\_\{L\}, whereas AhmedML and ShapeNet\-Car use the drag coefficientCDC\_\{D\}\. ShapeNet\-Car additionally provides surface normals, which are required for the drag calculation\.
Training\-time soft quantile\.Within each training mini\-batch,SoftQuantile\\operatorname\{SoftQuantile\}is implemented as a linearly interpolated empirical quantile of the normalized scores\. After sorting them=\|ℬ\|m=\|\\mathcal\{B\}\|scores, we evaluate the quantile at the continuous zero\-based rank\(1−α\)\(m−1\)\(1\-\\alpha\)\(m\-1\)by interpolating between the adjacent order statistics\. This approximation is used only during optimization and is distinct from the exact rank\-based calibration rule in Eq\.[12](https://arxiv.org/html/2610.02487#S3.E12)\.
Conformal calibration\.We useα=0\.1\\alpha=0\.1, corresponding to 90% target marginal coverage\. After training, the conformal multiplier is computed on the held\-out calibration set using the exact order statistic in Eq\.[12](https://arxiv.org/html/2610.02487#S3.E12)\. The calibration set is disjoint from both training and testing and is not used for model fitting or for the training\-time soft quantile\.
Hyperparameter selection\.All routing\-objective hyperparameters are fixed globally rather than tuned separately for individual datasets\. We useλ=0\.5\\lambda=0\.5,β=16\\beta=16, andμ=10−2\\mu=10^\{\-2\}for every dataset and seed, and setbw=0\.3⋅stdtrain\(g\(y\)\)\\mathrm\{bw\}=0\.3\\cdot\\operatorname\{std\}\_\{\\mathrm\{train\}\}\(g\(y\)\), where the standard deviation is computed over the training labels\. These values are heuristic defaults and are not selected through dataset\-specific search or by calibration\- or test\-set performance\. Theβ\\betasweep in Table[6](https://arxiv.org/html/2610.02487#S4.T6)is reported only as a sensitivity analysis and is not used to select the default setting\. Uniform follows the same architecture, scale\-head parameterization, routing objective, and training schedule asTACR, with the sole changeβ=0\\beta=0to remove threshold\-local weighting\.
Table[E](https://arxiv.org/html/2610.02487#A5)summarizes the settings shared across the main experiments\.
Table 12:Shared settings for the main experiments\. The loss coefficients describeTACR, and Uniform uses the same routing objective withβ=0\\beta=0\. The two\-stage schedule applies to Uniform,TW\-UQ, andTACR\. LetEEandη\\etadenote the dataset\-specific base epoch count and learning rate\.Training schedules\.Uniform,TW\-UQ, andTACRuse the same two\-stage schedule\. Stage 1 optimizes the predictor alone for the dataset\-specific base durationEE\. Stage 2 jointly fine\-tunes the predictor and the method\-specific scale head forE/2E/2epochs, using one tenth of the base learning rate for predictor parameters and the base learning rate for scale\-head parameters\.
Standard CP and CQR use a single stage ofEEepochs\. CQR replaces the prediction head with two conditional\-quantile outputs and optimizes the pinball loss\. Each Deep Ensemble member is trained independently forEEepochs, using member seeds 100–104\. Standard CP uses absolute residuals as nonconformity scores, CQR conformalizes its learned quantile interval, and Uniform,TW\-UQ, andTACRuse the positive Softplus scale head described above\.Similar Articles
CRC-Router: Risk-Constrained Routing for Medical Agentic AI Systems
CRC-Router is a risk-constrained, uncertainty-aware routing module for medical agentic AI systems that uses conformal risk control to calibrate acceptance thresholds, improving safety in autonomous clinical decision-making.
Conformal Calibration Transfer
This paper introduces Transported Conformal Calibration (TCC), a method to transfer conformal prediction calibration from a labeled source domain to an unlabeled target domain using paired observations, ensuring coverage guarantees with label-free diagnostics.
TRACER: Trace-Based Adaptive Cost-Efficient Routing for LLM Classification
TRACER is an open-source system that trains lightweight ML surrogates on production traces from LLM classification endpoints, routing requests through a parity gate that activates surrogates only when agreement with the original model exceeds a specified threshold. This approach achieves 83-100% surrogate coverage on intent classification benchmarks while maintaining interpretability into handling boundaries and failure modes.
Dynamic Regime-Aware Conformal Calibration for Reliable Economic Forecast Intervals under Multiple Distribution Shifts
The paper introduces DRACP, a conformal prediction method that unifies multiple adaptation mechanisms for reliable economic forecast intervals under distribution shifts, achieving calibration with wider intervals.
Adaptive Computation with Conformal Certification
该论文提出了一种名为 Conformal Adaptation 的框架,通过共形风险控制(conformal risk control)在低分辨率下认证预测信号,再对已认证区域进行精细化计算,从而在 3D 医学图像分割、星系流量预测和钙信号预测等任务上实现 2.5–72 倍的墙钟加速,同时保留不确定性估计。