Error Aware Distribution Prediction for Lightweight Implicit Neural Representations

# Error Aware Distribution Prediction for Lightweight Implicit Neural Representations
Source: [https://arxiv.org/html/2607.10068](https://arxiv.org/html/2607.10068)
\\onlineid

1275\\vgtccategoryResearch

Jake D\. Balla University of Arizonae\-mail: jakeballa@arizona\.eduJoshua A\. Levine University of Arizonae\-mail: josh@cs\.arizona\.edu

###### Abstract

Implicit neural representations \(INRs\) offer compact encoding of volumes, but as lossy approximators, inevitably have prediction errors\. We consider INRs that can simultaneously encode relative error scales by predicting distributions using tools from uncertainty estimation\. Typically, uncertainty estimation relies on computationally expensive approaches or on predefined parametric assumptions about the predictive distribution \(e\.g\., Gaussian\)\. In this study, we propose a lightweight method that reformulates regression\-based INR training as a classification task by discretizing continuous targets into bins, enabling flexible distribution modeling to capture complex multimodal behaviors\. We analyze the trade\-off between regression and classification for INR training and demonstrate that the classification setting tends to achieve high reconstruction quality and competitive error awareness through uncertainty estimation, compared to regression\-based approaches\.

###### keywords:

Scientific Visualization, Implicit Neural Representation, Uncertainty Quantification

\\teaser![[Uncaptioned image]](https://arxiv.org/html/2607.10068v1/x1.png)

Error and uncertainty fields for classification\- and regression\-based methods on the aneurism dataset\. From left to right:cross\-entropy\(CE\), cross\-entropy\+ mean\-squared\-error \(CE\+MSE\), mean\-squared\-error \(MSE\) in the classification setting, heterocadastic regression, and evidential regression in the regression setting\. For volume reconstructed from the heteroscedastic and evidential regression, the corresponding uncertainty fields fail to capture critical features in the error field, indicating the potential limitation of using their predicted uncertainty for error analysis\. In contrast, the uncertainty fields produced by CE and CE\+MSE show better alignment with the error fields\.

Introduction

Implicit neural representations \(INRs\) have emerged as a powerful tool for compactly representing scientific data, such as 3D volumes and time\-varying scalar fields, due to their flexibility and expressiveness\. As approximations of the data, INRs achieve impressive compression ratios\[gu2023nervi,11264349,han2022coordnet,han2025dcinr,han2023kd,lu2021compressive,tang2024ecnr,yang2025meta\]and outperform prior state\-of\-the\-art lossy compression methods\[ballester2019tthresh\]\. However, their approximating nature introduces errors that can affect the reliability of downstream scientific analysis and raise concerns among domain experts about their use in scientific workflows\.

Common error metrics, such as peak signal\-to\-noise ratio \(PSNR\), provide a global error estimate for the data approximation but fail to capture localized inaccuracies that are critical for scientific interpretation\. Without access to the raw data, which is often unavailable, measuring prediction error is challenging\. Recently, prediction uncertainty has been used as a potential indicator of the relative error scale of INR predictions\[saklani2024uncertainty,xiong2024regularized\]\. Classical uncertainty quantification approaches, such as deep ensemble\[lakshminarayanan2017simple\]and Monte Carlo dropout\[gal2016dropout\]provide uncertainty estimates but introduce significant computational overhead or may compromise prediction accuracy\. Lightweight solutions, heteroscedastic\[kendall2017uncertainties,seitzer2022pitfalls\]or evidential regression\[amini2020deep\], enable single\-pass uncertainty estimation but rely on restrictive distribution assumptions, limiting their ability to model complex scientific data with long\-tailed or multi\-modal distributions\.

In this study, we propose a new lightweight approach for INR\-based scientific data modeling that does not rely on predefined parametric assumptions\. Our solution formulates the regression task as a classification problem by discretizing continuous signals into bins and training with a cross\-entropy objective\. Compared with regression\-based approaches, the classification formulation yields a discrete predictive distribution that can model complex behavior\.

We compare our approach with regression\-based methods in terms of reconstruction quality and uncertainty estimation to assess its ability to capture and reflect prediction errors\. Experimental results reveal a trade\-off among methods, and our method tends to achieve a high reconstruction quality\. Furthermore, the error awareness exhibits a complementary relationship, with each approach performing better under different conditions depending on the dataset properties\. Overall, these findings suggest that classification\-based INR training offers a practical and effective alternative for jointly achieving accurate reconstruction and meaningful uncertainty estimation in scientific data modeling\. We summarize our contribution as follows:

- •A new training framework for implicit neural representations that uses the classification objective for implicit neural representation training\.
- •A comparative study showing that the classification approach provides complementary performance in reconstruction quality and uncertainty estimates compared with regression\-based solutions\.

## 1Related Work

Prior literature\[han2022coordnet,lu2021compressive,reiser2021kilonerf,saragadam2022miner,tang2023ecnr\]on INR studies largely focus on improving compression performance or computational efficiency, while overlooking the characterization of prediction error\. Here, we review the prior work on uncertainty estimation in the context of INRs for scientific data modeling\.

Model prediction uncertainty is important for ensuring the reliability of neural model decisions\[potter2025navigating\]\. Various methods have been proposed to quantify prediction uncertainty in INR training, each motivated by different objectives\. One line of work uses uncertainty as a proxy to indicate whether a region has high or low error\. Saklani et al\.\[saklani2024uncertainty\]have evaluated the uncertainty of deep ensemble and Monte Carlo dropout over INR for volume visualization tasks\. Xiong et al\.\[xiong2024regularized\]proposed RMDSRN, which uses a multi\-head decoder to predict variance for uncertainty and evaluate the quality of uncertainty by calculating the Pearson correlation with model prediction error\. Unlike the deep ensemble, RMDSRN is designed with a shared encoder to reduce the number of model training runs\. These methods are computationally intense due to the additional model training/inference or introduce additional training complexity\.

Another line of work focuses on modeling data that inherently contains uncertainty, such as ensemble simulation outputs\. In this setting, it is critical to distinguish between different sources of uncertainty, such as aleatoric and epistemic uncertainty\. ConfEviSurrogate\[duan2025confevisurrogate\]builds on the evidential regression\[amini2020deep\]to develop a generative surrogate model for scientific simulation\. REV\-INR\[saklani2026rev\]integrates evidential and heteroscedastic regression\[kendall2017uncertainties\]with a shared\-encoder framework\[xiong2024regularized\], resulting in multiple architectures for uncertainty quantification\. Surroflow\[shen2024surroflow\]leverages normalizing flows to enable invertible input\-output mappings for simulation surrogate modeling and provides uncertainty estimates for predicted output\.

Our study focuses on using uncertainty to characterize prediction errors\. Rather than extending prior approaches, we introduce a lightweight training framework that reformulates INR training using a classification objective\.

![Refer to caption](https://arxiv.org/html/2607.10068v1/x2.png)Figure 1:The training configuration of heteroscedastic, evidential, and classification\.
## 2Background

INRs tend to learn low\-frequency features but struggle to capture high\-frequency details due to spectral bias\[rahaman2019spectral\]\. To address this limitation, techniques like Siren\[sitzmann2020implicit\]and position encoding\[muller2022instant,tancik2020fourier\]approaches have been proposed to improve model performance\. As illustrated in Fig\.[1](https://arxiv.org/html/2607.10068#S1.F1), our study adopts Fourier position encoding\[tancik2020fourier\]in combination with the ReLU activation across different training settings\. Our experiment uses a 5\-layer multi\-layer perceptron \(MLP\) with a width of 256 neurons per layer\. Beyond standard regression\-based INR training, we apply the same framework to model predictive uncertainty using two representative approaches: heteroscedastic and evidential regression\.

Heteroscedastic Regression\[kendall2017uncertainties\]formulates regression as a Gaussian maximum\-likelihood \(equation[1](https://arxiv.org/html/2607.10068#S2.E1)\) estimation problem\. Given an inputxix\_\{i\}and targetyiy\_\{i\}, the model predicts both a meanμθ​\(xi\)\\mu\_\{\\theta\}\(x\_\{i\}\)and varianceσθ2​\(xi\)\\sigma^\{2\}\_\{\\theta\}\(x\_\{i\}\), whereθ\\thetadenotes the network parameters\.Instead of minimizing the mean squared error, the negative log likelihood loss jointly optimizes both prediction error and uncertainty\(σθ2​\(xi\)\\sigma^\{2\}\_\{\\theta\}\(x\_\{i\}\)\) at the same time\.

ℒH​e​t​e​NLL=−log⁡\(p​\(yi∣xi\)\)=12​log⁡\(σθ2​\(xi\)\)\+\(yi−μθ​\(xi\)\)22​σθ2​\(xi\)\\mathcal\{L\}\_\{Hete\\mathrm\{NLL\}\}=\-\\log\(p\(y\_\{i\}\\mid x\_\{i\}\)\)=\\frac\{1\}\{2\}\\log\(\\sigma\_\{\\theta\}^\{2\}\(x\_\{i\}\)\)\+\\frac\{\(y\_\{i\}\-\\mu\_\{\\theta\}\(x\_\{i\}\)\)^\{2\}\}\{2\\sigma\_\{\\theta\}^\{2\}\(x\_\{i\}\)\}\(1\)
Evidential Regression\[amini2020deep\]models uncertainty by placing a Normal Inverse\-Gamma prior over the Gaussian likelihood function\. The likelihood isp​\(yi∣μi,σi2\)=𝒩​\(yi∣μi,σi2\)p\(y\_\{i\}\\mid\\mu\_\{i\},\\sigma\_\{i\}^\{2\}\)=\\mathcal\{N\}\(y\_\{i\}\\mid\\mu\_\{i\},\\sigma\_\{i\}^\{2\}\)\. It assumes prior distributions overμi\\mu\_\{i\}andσi\\sigma\_\{i\}\. Theσi\\sigma\_\{i\}follows the Inv\-Gamma\(α,β\)\(\\alpha,\\beta\)distribution andμi\\mu\_\{i\}follows the gaussian distribution𝒩​\(γ,σ2λ\)\\mathcal\{N\}\\\!\\left\(\\gamma,\\,\\frac\{\\sigma^\{2\}\}\{\\lambda\}\\right\)\.

Evidential regression predicts the parameters\{αθ\(xi\)\\\{\\alpha\_\{\\theta\}\(x\_\{i\}\),βθ​\(xi\)\\beta\_\{\\theta\}\(x\_\{i\}\),γθ​\(xi\)\\gamma\_\{\\theta\}\(x\_\{i\}\)λθ\(xi\)\}\\lambda\_\{\\theta\}\(x\_\{i\}\)\\\}which define a Student’stt\-distribution\. Its negative log\-likelihood is:

ℒiNLL​\(𝐰\)\\displaystyle\\mathcal\{L\}\_\{i\}^\{\\text\{NLL\}\}\(\\mathbf\{w\}\)=12​log⁡\(πλθ​\(xi\)\)−αθ​\(xi\)​log⁡\(Ωθ​\(xi\)\)\\displaystyle=\\frac\{1\}\{2\}\\log\\left\(\\frac\{\\pi\}\{\\lambda\_\{\\theta\}\(x\_\{i\}\)\}\\right\)\-\\alpha\_\{\\theta\}\(x\_\{i\}\)\\log\\left\(\\Omega\_\{\\theta\}\(x\_\{i\}\)\\right\)\(2\)\+\(αθ​\(xi\)\+12\)​log⁡\(\(yi−γθ​\(xi\)\)2​λθ​\(xi\)\+Ωθ​\(xi\)\)\\displaystyle\\quad\+\\left\(\\alpha\_\{\\theta\}\(x\_\{i\}\)\+\\frac\{1\}\{2\}\\right\)\\log\\left\(\(y\_\{i\}\-\\gamma\_\{\\theta\}\(x\_\{i\}\)\)^\{2\}\\lambda\_\{\\theta\}\(x\_\{i\}\)\+\\Omega\_\{\\theta\}\(x\_\{i\}\)\\right\)\+log⁡\(Γ​\(αθ​\(xi\)\)Γ​\(αθ​\(xi\)\+12\)\)\\displaystyle\\quad\+\\log\\left\(\\frac\{\\Gamma\(\\alpha\_\{\\theta\}\(x\_\{i\}\)\)\}\{\\Gamma\\left\(\\alpha\_\{\\theta\}\(x\_\{i\}\)\+\\frac\{1\}\{2\}\\right\)\}\\right\)
whereΩθ​\(xi\)=2​βθ​\(xi\)​\(1\+λθ​\(xi\)\)\\Omega\_\{\\theta\}\(x\_\{i\}\)=2\\,\\beta\_\{\\theta\}\(x\_\{i\}\)\\left\(1\+\\lambda\_\{\\theta\}\(x\_\{i\}\)\\right\)\. In this study, the predicted mean is given byγθ​\(xi\)\\gamma\_\{\\theta\}\(x\_\{i\}\), the aleatoric uncertainty byβθ​\(xi\)αθ​\(xi\)−1\\frac\{\\beta\_\{\\theta\}\(x\_\{i\}\)\}\{\\alpha\_\{\\theta\}\(x\_\{i\}\)\-1\}, and the epistemic uncertainty byβθ​\(xi\)λθ​\(xi\)​\(αθ​\(xi\)−1\)\\frac\{\\beta\_\{\\theta\}\(x\_\{i\}\)\}\{\\lambda\_\{\\theta\}\(x\_\{i\}\)\(\\alpha\_\{\\theta\}\(x\_\{i\}\)\-1\)\}\.Since distinguishing between uncertainty sources is not the primary focus, we combine aleatoric and epistemic uncertainty into a single measureβθ​\(xi\)​\(1\+λθ​\(xi\)\)λθ​\(xi\)​\(αθ​\(xi\)−1\)\\frac\{\\beta\_\{\\theta\}\(x\_\{i\}\)\\bigl\(1\+\\lambda\_\{\\theta\}\(x\_\{i\}\)\\bigr\)\}\{\\lambda\_\{\\theta\}\(x\_\{i\}\)\\bigl\(\\alpha\_\{\\theta\}\(x\_\{i\}\)\-1\\bigr\)\}\.

For high\-quality uncertainty estimation, predictions with higher uncertainty should correspond to larger errors\. To evaluate how well uncertainty reflects error, we use the AUSE metric:

AUSE=∫01\(E​\(p\)−E∗​\(p\)\)​𝑑p\\mathrm\{AUSE\}=\\int\_\{0\}^\{1\}\\left\(E\(p\)\-E^\{\*\}\(p\)\\right\)\\,dpwhereE​\(p\)E\(p\)denotes the prediction error after removing a fractionppof the most uncertain predictions, andE∗​\(p\)E^\{\*\}\(p\)denotes the error after removing a fractionppof the highest\-error predictions \(oracle\)\. This metric measures how well uncertainty aligns with true prediction error\[lind2024uncertainty\]\. A lower AUSE indicates better error awareness\.

## 3Classification Setting for INR Training

Using classification to address regression problems has shown promise in several fields, including computer vision\[pintea2023step,rothe2015dex\]and reinforcement learning\[lagoudakis2003reinforcement\]\. In this work, we reformulate regression as a classification problem in the INRs setting to model scientific data without restrictive parametric assumptions\.

To transform a regression task into a classification problem, the continuous signal must be discretized into bins\. We adopt an equal\-range binning strategy, in which values are first normalized to the range\[0,1\]\[0,1\]and then uniformly partitioned intonnbins\. The bin size is defined asbs=1nb\_\{s\}=\\frac\{1\}\{n\}\. Theii\-th bin corresponds to the interval\[bs×\(i−1\),bs×i\)\[b\_\{s\}\\times\(i\-1\),b\_\{s\}\\times i\), and its representative value is taken as the midpointbi=bs×\(i−1\)\+bs×i2b\_\{i\}=\\frac\{b\_\{s\}\\times\(i\-1\)\+b\_\{s\}\\times i\}\{2\}\. We use the midpoint as the bin value because it typically yields better reconstruction quality than using the left or right bin boundaries\. In the classification setting, the target label corresponds to the bin containing the ground\-truth value\. Unless otherwise specified, we use 256 bins by default\(Appendix A provides a further investigation on the bin configuration\)\.

In standard classification tasks, models predict a single discrete label corresponding to the highest probability\. However, in the INR setting for continuous signal modeling, neighboring bins can also receive relatively high probabilities\. As a result, small deviations into adjacent bins still correspond to close numerical values, allowing the model to maintain accurate approximations despite minor prediction shifts\.Rather than representing INR outputs using the value of the target bin, we compute the expected value of the predicted distribution,∑i=1Cbi​pi\\sum\_\{i=1\}^\{C\}b\_\{i\}p\_\{i\}, wherepip\_\{i\}denotes the probability assigned to binii, and C is the number of bins\.

During training, the cross\-entropy loss encourages high probability for the target label and low probability for all other bins\. This formulation promotes the learning of a meaningful probability distribution that reflects the underlying ground\-truth value\. The uncertainty of the classification network is captured by the output distribution after the softmax normalization\. We quantify prediction uncertainty by computing the variance of this distribution\.Our study mainly focuses on using distribution variance for uncertainty estimation, given that variance quantifies how far a prediction may deviate from its expected value, providing an intuitive measure of error awareness\. In contrast, uncertainty measures such as entropy are often less directly interpretable in terms of prediction error \(check Appendix C\)\.

Var​\(y\)=∑i=1npi​\(bi−μ\)2,μ=∑i=1npi​bi\.\\mathrm\{Var\}\(y\)=\\sum\_\{i=1\}^\{n\}p\_\{i\}\(b\_\{i\}\-\\mu\)^\{2\},\\mu=\\sum\_\{i=1\}^\{n\}p\_\{i\}b\_\{i\}\.\(3\)
Consistent with prior work, we observe that using cross\-entropy loss alone can lead to salt\-and\-pepper noise\[han2025towards\]\. To mitigate this issue, we introduce a mean squared error \(MSE\) regularization term to anchor the expected value of the predicted distribution to the ground truth\.This regularization reduces noise, quantization error, improves reconstruction quality, and preserves the uncertainty information captured by the cross\-entropy objective\(Appendix B provides a brief overview of the impact ofλ\\lambda\):

ℒ=ℒ​CE\+λ⋅ℒ​MSE\.\\mathcal\{L\}=\\mathcal\{L\}\{\\mathrm\{CE\}\}\+\\lambda\\cdot\\mathcal\{L\}\{\\mathrm\{MSE\}\}\.\(4\)

## 4Reconstruction Performance Comparison

To compare reconstruction quality, we evaluate four datasets: two simulation datasets \(Rayleigh–Taylor instability and magnetic reconnection\) and two CT datasets \(Bonsai and aneurism\), all obtained from the Open Scientific Visualization Datasets\[klacansky2020open\]\. To ensure a fair comparison, we design the experimental setup such that each model uses an MLP with approximately the same number of parameters\. In the classification setting, the final layer corresponds to the discretized bins\. In the regression setting, an additional layer is introduced to maintain a comparable parameter count, resulting in slightly more parameters than in the classification model\. All models are trained using the Adam optimizer with a learning rate of10−310^\{\-3\}and a batch size of 20,000\. Each model is trained for 20,000 steps\. Experiments are conducted on an NVIDIA GeForce V100 GPU with 16 GB of memory\.

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/multi-moda-distribution.png)Figure 2:Predicted distributions from CE\+λ\\lambdaMSE and heteroscedastic regression\. CE\+λ\\lambdaMSE exhibits lower error than the heteroscedastic approach\. It predicts a two\-peak, multimodal distribution, whereas heteroscedastic regression is constrained by the Gaussian assumption\.### 4\.1Performance Comparison between Classification and Regression

Underquantitative evaluationusing PSNR, classification\-based approaches achieve comparable or even better performance than regression\-based methods\. The results are summarized in Table[1](https://arxiv.org/html/2607.10068#S4.T1), which groups methods into classification\- and regression\-based categories\. The table also reports the compression ratio between the original dataset size and the network model size\. Here, CE denotes cross\-entropy loss, while CE \+λ\\lambdaMSE represents the combination of cross\-entropy and mean squared error \(MSE\) loss\. Steel\-blue highlights indicate the highest reconstruction quality for each volume, all of which correspond to classification\-based \(discrete distribution\) methods\.

Cross\-entropy \(CE\) loss achieves stronger PSNR performance compared with both evidential and heteroscedastic regression\. For simulation datasets, CE performs slightly better than regression\-based approaches; however, the performance gap becomes much more pronounced for the CT datasets\. On the Bonsai dataset, classification\-based methods outperform evidential regression by 2 dB and heteroscedastic regression by approximately 5 dB\. A similar trend is observed for the aneurism dataset\. As discussed above, combining cross\-entropy with MSE further improves performance over using CE alone\. In this study,λ=50\\lambda=50is selected empirically\. With MSE regularization, the results are generally better than those obtained with pure CE loss\. In Table[1](https://arxiv.org/html/2607.10068#S4.T1), we also report the PSNR of MSE under regression\-based methods as a reference\.MSE\-based objectives favor reconstruction accuracy, while CE\-based and evidential objectives generally provide more informative uncertainty estimates\. The selection of the preferred method depends on whether the downstream task prioritizes reconstruction accuracy or reliable identification of erroneous regions\.

![Refer to caption](https://arxiv.org/html/2607.10068v1/x3.png)Figure 3:A qualitative comparison between classification\-based and regression\-based approaches over aneurism dataset\. Both heteroscedastic and evidential regression struggle to fit thin vessels and small branches, which are fine\-grained and high\-frequency features\.Table 1:Data description of evaluation data and related PSNR value under each training setting\. We highlight the best and the second\-best performance model\. The regular MSE regression solution without uncertainty awareness is used as a reference, but not included for performance comparison\.Table 2:The AUSE score for error\-awareness comparison\. A small value is better than a large one\.Classification\-BasedRegression\-BasedDataRatioCECE\+λ\\lambdaMSEMSEEvidentialHeteroscedasticRayleigh\-Taylor Instability \(5123512^\{3\}\)384x2\.21×10−32\.21\\times 10^\{\-3\}2\.29×10−32\.29\\times 10^\{\-3\}5\.75×10−35\.75\\times 10^\{\-3\}2\.89×10−32\.89\\times 10^\{\-3\}3\.58×10−33\.58\\times 10^\{\-3\}Magnetic Reconnection Simulation \(5123512^\{3\}\)384x2\.46×10−42\.46\\times 10^\{\-4\}2\.45×10−42\.45\\times 10^\{\-4\}2\.72×10−42\.72\\times 10^\{\-4\}1\.91×10−41\.91\\times 10^\{\-4\}7\.95×10−47\.95\\times 10^\{\-4\}bonsai \(2563256^\{3\}\)12x2\.61×10−42\.61\\times 10^\{\-4\}9\.48×10−49\.48\\times 10^\{\-4\}2\.65×10−42\.65\\times 10^\{\-4\}7\.03×10−47\.03\\times 10^\{\-4\}5\.47×10−45\.47\\times 10^\{\-4\}aneurism \(2563256^\{3\}\)12x3\.44×10−63\.44\\times 10^\{\-6\}5\.13×10−65\.13\\times 10^\{\-6\}4\.16×10−44\.16\\times 10^\{\-4\}2\.36×10−52\.36\\times 10^\{\-5\}2\.24×10−42\.24\\times 10^\{\-4\}Beyond quantitative analysis, thequalitativeresults show that INR trained with classification settings enable the reconstruction of high\-quality 3D volumes while effectively capturing high\-frequency features better than heteroscedastic and evidential regression\. In Fig\.[3](https://arxiv.org/html/2607.10068#S4.F3), the visualization of the aneurism data from the classification\-based methods captures the thin vessel and their relative small branches feature\. The same features are absent or inadequately captured in heteroscedastic and evidential regression settings\. Notably, these fine structures can be captured by MSE\-based regression; however, they are not well preserved in heteroscedastic and evidential regression\. The uncertainty estimation in these approaches relies on restrictive distributional assumptions \(e\.g\., Gaussian or Student’stt\-distributions\), which constrain their representational flexibility\. As a result, these methods introduce a trade\-off between uncertainty estimation and prediction accuracy, limiting their ability to model fine\-grained features\.

To provide a concrete example, Fig\.[2](https://arxiv.org/html/2607.10068#S4.F2)shows a predicted output distribution of a single point, which is located at a sharp gradient change region, from the heteroscedastic and the classification setting\. The distribution output from the classification setting is flexible and multi\-modal, and has a lower error than the heteroscedastic regression\. Instead, heteroscedastic regression is forced to model the output as a Gaussian distribution, which only captures one peak of the multi\-modal distribution\.

## 5Error\-Awareness Evaluation

To evaluate prediction uncertainty in terms of error awareness, classification\-based methods exhibit performance comparable to regression\-based approaches\. As shown in Table[2](https://arxiv.org/html/2607.10068#S4.T2), the lowest AUSE scores are achieved by cross\-entropy \(CE\) and evidential regression methods\. Classification\-based approaches account for most of the low AUSE scores, except for the Magnetic Reconnection simulation dataset, where evidential regression outperforms the other methods\.

In a classification\-based setting, the performance trends differ from those observed under PSNR\-based evaluation\. Models trained with the cross\-entropy loss typically achieve the lowest AUSE score, where the MSE loss often leads to the highest, and the CE\+λ\\lambdaMSE yields intermediate performance\. The MSE loss does not explicitly optimize the output distribution to assign meaningful probabilities; instead, it primarily focuses on minimizing mean squared error\. Unsurprisingly, it results in lower\-quality uncertainty estimates compared with the cross\-entropy loss function\. A similar effect can be observed from theC​E\+λ​M​S​ECE\+\\lambda MSEloss, where the uncertainty estimation degrades because of theM​S​EMSEregularization term\. In the regression\-based approach, evidential regression outperforms heteroscedastic on simulation datasets but underperforms in the CT dataset\.

AUSE score provides a statistical summary of the quality of uncertainty estimation, but it is critical to assess whether the predicted uncertainty fields help identify error regions in the predicted volume\. To verify this, we compare the error and uncertainty fields of two training settings using the aneurism dataset\. Since uncertainty indicates the region with high or low error rather than an absolute error scale, we normalize the error and uncertainty field to the range \[0,1\] for comparison\. The results in Fig\.[Abstract](https://arxiv.org/html/2607.10068#abstract1)show a qualitative comparison across different training settings\. With the same transfer function, the visualization of the uncertainty fields from heteroscedastic and evidential regressions is sparse and missing fine\-grain vessel detail compared with the error field\.

## 6Conclusion and Future Works

In this study, we introduce a lightweight implicit neural representation for scientific data modeling\. Our approach reformulates INR regression training as a classification task, enabling high\-quality data reconstruction and effective uncertainty estimation for error awareness across multiple datasets\. In future work, we will investigate why the uncertainty framework here captures error awareness, in particular, since the data is not inherently uncertain, and explore using classification\-based models to train INRs in settings where the sources of uncertainty are different, e\.g\., ensembles\.

###### Acknowledgements\.

This research was supported by the U\.S\. Department of Energy under grants DE\-SC\-0023320 \(Vanderbilt University\) and DE\-SC\-0023319 \(University of Arizona\)\. The authors also gratefully acknowledge Matthew Berger for numerous valuable discussions during the preparation of this paper\.

## References

## Appendix

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/The_effect_of_lambda_Skull.png)

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/The_effect_of_lambda_Miranda.png)

Figure 4:The selection of the lambda parameter balances the accuracy of reconstruction and uncertainty quality\. Increasing the lambda parameter will improve the reconstruction accuracy \(PSNR\); however, exceeding a certain threshold decreases the uncertainty quality and increases the AUSE score\.![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/psnr_vs_uncertainty_miranda.png)

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/psnr_vs_uncertainty_skull.png)

Figure 5:PSNR trends constructed using entropy, variance, maximum softmax probability, and margin probability\. Across both datasets, the PSNR curve based on variance consistently lies above that based on entropy and other uncertainty metrics, indicating a stronger correlation with prediction error\.
## Appendix AThe configuration of Bin Size for Classification Training

### A\.1Use midpoint to represent bin value

Number of Binsaffects the reconstruction quality of model predictions\. In this study, we use the midpoint representation \(Table\.[3](https://arxiv.org/html/2607.10068#A1.T3)\) for bin values, as it yields high reconstruction quality\.

Table 3:PSNR performance for different choices of representative values per bin \(256\)\.
### A\.2How does bin size affect the training performance

We present an experiment in which networks with widths of 64, 128, 256, 512, and 1024 are trained using different bin sizes\. As shown in Fig\.[6](https://arxiv.org/html/2607.10068#A1.F6), performance plateaus at a bin size of around 128\. For classification\-based training, performance generally continues to improve as the bin size increases, with the exception of the MSE loss\.

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/miranda-64.png)

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/miranda-128.png)

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/miranda-256.png)

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/miranda-512.png)

![Refer to caption](https://arxiv.org/html/2607.10068v1/figs/appendix/miranda-1024.png)

Figure 6:The impact of bin size on classification\-based network training\. The PSNR often plateaus with 128 bins except for the MSE loss\. For the AUSE score, a similar trend can be found in all training settings\.

## Appendix BThe impact ofλ\\lambdaon accuracy and uncertainty

To study the effect of the hyperparameterλ\\lambda, we evaluate its impact on the Skull and Miranda dataset\. Results are shown in Fig\.[4](https://arxiv.org/html/2607.10068#Ax1.F4)\. For relatively small values ofλ\\lambda, the PSNR score improves while the uncertainty measured by the AUSE score remains unchanged\. As the value increases beyond a certainty threshold, the AUSE score begins to deteriorate, indicating a reduction in uncertainty quality\. Across both datasets,λ<100\\lambda<100has a negligible effect on the uncertainty quality while still providing reconstruction benefits\. In our study, we adopt a conservative setting of theλ=50\\lambda=50throughout our experiments\.

## Appendix CComparing Entropy and Variance for Error Awareness

We use two datasets to compare the effectiveness of entropy, variance, maximum softmax probability, and margin probability in capturing prediction error under the cross\-entropy training framework\. The comparison is based on the PNSR trend, which is generated by progressively adding back the lowest\-uncertainty components to the 3D volume and calculating the corresponding PSNR score\. In the PSNR equation[5](https://arxiv.org/html/2607.10068#A3.E5), where\(MAX\)\(\\mathrm\{MAX\}\)denotes the maximum possible voxel value\. Since all volumes are normalized to the range \(\[0,1\]\), \(MAX=1\\mathrm\{MAX\}=1\), and thus the PSNR is primarily determined by the MSE\. Here,IiI\_\{i\}andI^i\\hat\{I\}\_\{i\}denote the ground\-truth and predicted voxel values, respectively\.

As shown in Fig\.[5](https://arxiv.org/html/2607.10068#Ax1.F5), the PSNR curves constructed using variance consistently lie above those constructed using entropy for both the Miranda and Skull datasets\. This result indicates that variance more effectively identifies components associated with prediction error, leading to faster reconstruction quality improvement as low\-uncertainty components are progressively incorporated\. Consequently, variance exhibits a stronger correlation with prediction error and serves as a more informative uncertainty metric than entropy and other uncertainty estimation in this setting\.

PSNR=10​log10⁡\(MAX2MSE\),\\mathrm\{PSNR\}=10\\log\_\{10\}\\left\(\\frac\{\\mathrm\{MAX\}^\{2\}\}\{\\mathrm\{MSE\}\}\\right\),\(5\)
MSE=1N​∑i=1N\(Ii−I^i\)2,\\mathrm\{MSE\}=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\left\(I\_\{i\}\-\\hat\{I\}\_\{i\}\\right\)^\{2\},\(6\)