ELVAE: Evidential Learning-Based Variational Autoencoder for Uncertainty-Aware Generation

arXiv cs.LG Papers

Summary

Introduces ELVAE, a VAE with evidential learning that models latent coordinates with normal-inverse-gamma posteriors to obtain explicit uncertainty estimates. Experiments on MNIST show that within-class uncertainty ranking can stratify synthetic sample reliability and stress-testing, though results require class-wise normalization and vary across seeds.

arXiv:2608.10398v1 Announce Type: new Abstract: Variational autoencoders generate samples from probabilistic latent representations but do not distinguish uncertainty about the latent location from variability around it. We formulate ELVAE, an evidential learning-based VAE in which each latent coordinate is governed by an input-dependent normal-inverse-gamma posterior. This hierarchy yields an explicit latent-location uncertainty that can be used during generation, not merely reported after inference: low-uncertainty anchors support more reliable synthetic samples, while high-uncertainty anchors can be deliberately exploited for stress testing. The objective is an exact evidence lower bound, and we show that direct regularization of the full hierarchy is required, since the marginalized latent law alone cannot identify the uncertainty decomposition. In an MNIST generation pilot with a frozen external classifier, this uncertainty clearly stratified the semantic reliability of generated digits. A zero-displacement control revealed that most of the effect reflects how reliably an anchor can be re-generated, while a smaller but distinct component is attributable to uncertainty-scaled perturbation itself. The effect holds only under within-class uncertainty ranking, and its magnitude varies across seeds. These findings support the learned latent-location uncertainty as a practical control variable for uncertainty-aware generation, separating anchor reliability from perturbation-induced failure.
Original Article
View Cached Full Text

Cached at: 08/12/26, 08:29 AM

# 1 Introduction
Source: [https://arxiv.org/html/2608.10398](https://arxiv.org/html/2608.10398)
ELVAE: Evidential Learning\-Based Variational Autoencoder for Uncertainty\-Aware Generation

Ge Wang

Biomedical Imaging Center, Rensselaer Polytechnic Institute, Troy, New York, USA

Abstract:Variational autoencoders \(VAEs\) generate samples from probabilistic latent representations but do not explicitly distinguish uncertainty in the latent location from variability around that location\. We formulate ELVAE, an evidential learning\-based VAE in which each latent coordinate is governed by an input\-dependent normal\-inverse\-gamma \(NIG\) posterior\. The hierarchy yields an explicit latent\-location uncertainty,uepi=β/\[ν​\(α−1\)\]u\_\{\\mathrm\{epi\}\}=\\beta/\[\\nu\(\\alpha\-1\)\], that can stratify posterior anchors and modulate generation\. In a 10,000\-image MNIST pilot, samples were ranked by within\-classuepiu\_\{\\mathrm\{epi\}\}and evaluated with a classifier trained only on real MNIST\. Classifier error increased from 26\.30% in the bottom 20% of uncertainty to 37\.80% in the top 20% \(1\.437×\\times, 95% bootstrap CI 1\.33–1\.58\)\. A zero\-displacement control,z=γz=\\gamma, retained most of this contrast \(1\.395×\\times\), showing that the dominant effect reflects anchor re\-generation reliability\. Among anchors correctly re\-generated atz=γz=\\gamma, an uncertainty\-scaled perturbation induced semantic failure in 1\.97% of the low\-uepiu\_\{\\mathrm\{epi\}\}group versus 5\.92% of the high\-uepiu\_\{\\mathrm\{epi\}\}group \(3\.01×\\times, 95% CI 2\.03–4\.75\)\. Two caveats are reported alongside the headline: under unnormalized globaluepiu\_\{\\mathrm\{epi\}\}ranking the contrast is essentially null \(1\.015×\\times\), so within\-class normalization is not cosmetic, and across three random seeds the headline ratio ranges from 1\.126 to 1\.437\. The formulation is also mathematically well posed: the ELVAE objective is an exact ELBO for the corresponding hierarchical generative model, and direct NIG\-to\-NIG regularization identifies an uncertainty decomposition that the marginalized Student\-ttlatent law alone does not\. These results supportuepiu\_\{\\mathrm\{epi\}\}as a useful variable for posterior\-anchored uncertainty\-aware generation, while distinguishing anchor reliability from perturbation\-attributable failure\.

Keywords:evidential learning; variational autoencoder; uncertainty\-aware generation; synthetic data; stress testing; normal\-inverse\-gamma; epistemic uncertainty; generative AI\.

Generative AI is typically evaluated by realism, fidelity, diversity, or downstream usefulness\. For training\-data generation and robustness testing, however, a second question is equally important: how uncertain is the model about the latent state from which a particular synthetic image is generated? Two generated images can both look plausible while one lies in a well\-constrained latent region and the other is produced from a latent location for which the model has weak evidence\.

A conventional VAE models

qϕ​\(z∣y\)=𝒩​\(μϕ​\(y\),diag⁡σϕ2​\(y\)\),q\_\{\\phi\}\(z\\mid y\)=\\mathcal\{N\}\\\!\\left\(\\mu\_\{\\phi\}\(y\),\\operatorname\{diag\}\\sigma\_\{\\phi\}^\{2\}\(y\)\\right\),\(1\)whereμϕ\\mu\_\{\\phi\}andσϕ2\\sigma\_\{\\phi\}^\{2\}are deterministic network outputs\[[2](https://arxiv.org/html/2608.10398#bib.bib2)\]\. This provides stochastic generation, but the model has only one level of latent uncertainty\. Evidential learning suggests a richer construction: place a distribution over the latent mean and variance themselves\[[4](https://arxiv.org/html/2608.10398#bib.bib4)\]\. We call the resulting model ELVAE\.

> ELVAE turns uncertainty into a generation control variable: low uncertainty can identify more reliable synthetic samples, while high uncertainty can be deliberately retained to create difficult stress\-test samples\.

This is particularly attractive for scientific and medical generation, where synthetic images may be used to enlarge scarce training sets or to probe failure modes of a downstream network\.

#### Relation to prior evidential and autoencoder work\.

Autoencoders have been used for representation learning since\[[1](https://arxiv.org/html/2608.10398#bib.bib1)\], and the variational formulation of\[[2](https://arxiv.org/html/2608.10398#bib.bib2)\]made the latent code an explicit probabilistic object\. Evidential learning replaces a point prediction with parameters of a higher\-order distribution, first for classification through a Dirichlet output\[[3](https://arxiv.org/html/2608.10398#bib.bib3)\]and then for regression through the NIG family\[[4](https://arxiv.org/html/2608.10398#bib.bib4)\]; the latter supplies the hierarchy used here\. Itkina et al\.\[[7](https://arxiv.org/html/2608.10398#bib.bib7)\]apply an evidential treatment to the discrete latent distribution of a conditional VAE to prune implausible modes, while Baykal et al\.\[[8](https://arxiv.org/html/2608.10398#bib.bib8)\]use a Dirichlet evidential distribution over discrete VQ\-VAE codebook assignments to mitigate codebook collapse\. Catoni et al\.\[[9](https://arxiv.org/html/2608.10398#bib.bib9)\]study uncertainty representations in continuous VAEs and introduce an Explaining\-Away VAE with an additional global scaling latent variable; they evaluate latent uncertainty on natural, MNIST, and medical\-image domains\. ELVAE addresses a different question: it places a coordinate\-wise NIG hierarchy directly over continuous latent location and variance, identifies the higher\-order uncertainty decomposition through NIG\-to\-NIG regularization, and exposes the latent\-location varianceuepiu\_\{\\mathrm\{epi\}\}as a variable for posterior\-anchored generation\. Known pathologies of evidential regression objectives\[[5](https://arxiv.org/html/2608.10398#bib.bib5),[6](https://arxiv.org/html/2608.10398#bib.bib6)\]remain relevant and motivate direct regularization of the full NIG hierarchy\.

Figure[1](https://arxiv.org/html/2608.10398#S2.F1)summarizes the training and generation pipeline\. The present study makes four contributions\. First, we formulate a continuous NIG hierarchy for VAE latent variables and define an explicit latent\-location uncertaintyuepiu\_\{\\mathrm\{epi\}\}\. Second, we show that direct NIG regularization is required to identify the uncertainty decomposition and that the resulting training objective is an exact ELBO\. Third, we perform a direct generation pilot: ELVAE generates labeled MNIST variants from posterior anchors, low\- and high\-uepiu\_\{\\mathrm\{epi\}\}images are displayed, and one frozen classifier quantifies whether high\-uepiu\_\{\\mathrm\{epi\}\}generated samples are more likely to lose their intended semantic class\. Fourth, we separate that effect into an anchor\-quality component and a generation\-attributable component by means of az=γz=\\gammacontrol, and report both\.

## 2Methodology

### 2\.1Evidential latent hierarchy

For each latent coordinatek=1,…,Kk=1,\\ldots,K, the encoder predicts four NIG parameters

\(γk,νk,αk,βk\),νk\>0,αk\>1,βk\>0,\(\\gamma\_\{k\},\\nu\_\{k\},\\alpha\_\{k\},\\beta\_\{k\}\),\\qquad\\nu\_\{k\}\>0,\\ \\alpha\_\{k\}\>1,\\ \\beta\_\{k\}\>0,\(2\)which define

σk2∣y∼InvGamma⁡\(αk,βk\),μk∣σk2,y∼𝒩​\(γk,σk2νk\),zk∣μk,σk2∼𝒩​\(μk,σk2\)\.\\sigma\_\{k\}^\{2\}\\mid y\\sim\\operatorname\{InvGamma\}\(\\alpha\_\{k\},\\beta\_\{k\}\),\\qquad\\mu\_\{k\}\\mid\\sigma\_\{k\}^\{2\},y\\sim\\mathcal\{N\}\\\!\\left\(\\gamma\_\{k\},\\frac\{\\sigma\_\{k\}^\{2\}\}\{\\nu\_\{k\}\}\\right\),\\qquad z\_\{k\}\\mid\\mu\_\{k\},\\sigma\_\{k\}^\{2\}\\sim\\mathcal\{N\}\(\\mu\_\{k\},\\sigma\_\{k\}^\{2\}\)\.\(3\)
\(a\) TrainingyyEncoderqϕ​\(μ,σ2∣y\)=NIG​\(γ,ν,α,β\)q\_\{\\phi\}\(\\mu,\\sigma^\{2\}\\mid y\)=\\mathrm\{NIG\}\(\\gamma,\\nu,\\alpha,\\beta\)zzsampleDecodery^\\hat\{y\}NIG priorp0p\_\{0\}:LNIG=1K​∑kDKL​\(qϕ∥p0\)L\_\{\\mathrm\{NIG\}\}=\\tfrac\{1\}\{K\}\\sum\_\{k\}D\_\{\\mathrm\{KL\}\}\(q\_\{\\phi\}\\\|p\_\{0\}\)LreconL\_\{\\mathrm\{recon\}\}\(b\) Generationanchor\(yi,ci\)\(y\_\{i\},c\_\{i\}\)Encoderγi,uepi,i\\gamma\_\{i\},\\ u\_\{\\mathrm\{epi\},i\}uncertainty\-scaled perturbationz=γi\+τepi​uepi,i⊙ϵz=\\gamma\_\{i\}\+\\tau\_\{\\mathrm\{epi\}\}\\sqrt\{u\_\{\\mathrm\{epi\},i\}\}\\odot\\epsilonDecoderfrozen classifierci→c^ic\_\{i\}\\to\\hat\{c\}\_\{i\}?xigenx\_\{i\}^\{\\mathrm\{gen\}\}control:τepi=0⇒z=γi\\tau\_\{\\mathrm\{epi\}\}=0\\Rightarrow z=\\gamma\_\{i\}uepiu\_\{\\mathrm\{epi\}\}retained for rankingFigure 1:ELVAE training and the posterior\-anchored generation pilot\. \(a\) Training: the encoder predicts a NIG posterior over latent location and variance, regularized toward a fixed NIG prior\. \(b\) Generation: the pilot uses the NIG\-deriveduepiu\_\{\\mathrm\{epi\}\}both to rank anchors and to scale a controlled Gaussian perturbation, and a frozen classifier tests whether the intended class survives\. The dashed control branch setsτepi=0\\tau\_\{\\mathrm\{epi\}\}=0, yieldingz=γiz=\\gamma\_\{i\}, while retaininguepiu\_\{\\mathrm\{epi\}\}for ranking\.Thus

qϕ​\(μk,σk2∣y\)=NIG​\(γk,νk,αk,βk\)\.q\_\{\\phi\}\(\\mu\_\{k\},\\sigma\_\{k\}^\{2\}\\mid y\)=\\mathrm\{NIG\}\(\\gamma\_\{k\},\\nu\_\{k\},\\alpha\_\{k\},\\beta\_\{k\}\)\.\(4\)We enforce positivity by softplus transforms, with the standard\+1\+1offset onα\\alphaso that𝔼​\[σ2\]\\mathbb\{E\}\[\\sigma^\{2\}\]exists\[[4](https://arxiv.org/html/2608.10398#bib.bib4)\]\.

The hierarchy separates two statistically different sources of latent spread:

uvar,k\\displaystyle u\_\{\\mathrm\{var\},k\}≡𝔼​\[σk2∣y\]=βkαk−1,\\displaystyle\\equiv\\mathbb\{E\}\[\\sigma\_\{k\}^\{2\}\\mid y\]=\\frac\{\\beta\_\{k\}\}\{\\alpha\_\{k\}\-1\},\(5\)uepi,k\\displaystyle u\_\{\\mathrm\{epi\},k\}≡Var⁡\(μk∣y\)=βkνk​\(αk−1\),\\displaystyle\\equiv\\operatorname\{Var\}\(\\mu\_\{k\}\\mid y\)=\\frac\{\\beta\_\{k\}\}\{\\nu\_\{k\}\(\\alpha\_\{k\}\-1\)\},\(6\)Var⁡\(zk∣y\)\\displaystyle\\operatorname\{Var\}\(z\_\{k\}\\mid y\)=uvar,k\+uepi,k\.\\displaystyle=u\_\{\\mathrm\{var\},k\}\+u\_\{\\mathrm\{epi\},k\}\.\(7\)In this paper we call Eq\. \([6](https://arxiv.org/html/2608.10398#S2.E6)\) epistemic latent uncertainty because it quantifies uncertainty in the latent location itself, while Eq\. \([5](https://arxiv.org/html/2608.10398#S2.E5)\) quantifies variability around that location\. For one image we summarize

uepi​\(y\)=1K​∑k=1Kuepi,k​\(y\)\.u\_\{\\mathrm\{epi\}\}\(y\)=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}u\_\{\\mathrm\{epi\},k\}\(y\)\.\(8\)

### 2\.2Training objective

WithPPinput pixels andKKlatent coordinates, we use

LELVAE​\(y\)=Lrecon​\(y\)\+λNIG​LNIG​\(y\),L\_\{\\mathrm\{ELVAE\}\}\(y\)=L\_\{\\mathrm\{recon\}\}\(y\)\+\\lambda\_\{\\mathrm\{NIG\}\}L\_\{\\mathrm\{NIG\}\}\(y\),\(9\)where

Lrecon=1P​𝔼​‖y−gθ​\(z\)‖22,L\_\{\\mathrm\{recon\}\}=\\frac\{1\}\{P\}\\,\\mathbb\{E\}\\\|y\-g\_\{\\theta\}\(z\)\\\|\_\{2\}^\{2\},\(10\)and

LNIG=1K​∑k=1KDKL​\[NIG​\(γk,νk,αk,βk\)∥NIG​\(γ0,ν0,α0,β0\)\]\.L\_\{\\mathrm\{NIG\}\}=\\frac\{1\}\{K\}\\sum\_\{k=1\}^\{K\}D\_\{\\mathrm\{KL\}\}\\\!\\left\[\\mathrm\{NIG\}\(\\gamma\_\{k\},\\nu\_\{k\},\\alpha\_\{k\},\\beta\_\{k\}\)\\,\\\|\\,\\mathrm\{NIG\}\(\\gamma\_\{0\},\\nu\_\{0\},\\alpha\_\{0\},\\beta\_\{0\}\)\\right\]\.\(11\)The NIG KL directly regularizes the higher\-order quantities to which uncertainty meaning is assigned\. BecauseLNIGL\_\{\\mathrm\{NIG\}\}is the coordinate average, the total higher\-order KL isK​LNIGKL\_\{\\mathrm\{NIG\}\}\. Forq=NIG​\(γ,ν,α,β\)q=\\mathrm\{NIG\}\(\\gamma,\\nu,\\alpha,\\beta\)andp0=NIG​\(γ0,ν0,α0,β0\)p\_\{0\}=\\mathrm\{NIG\}\(\\gamma\_\{0\},\\nu\_\{0\},\\alpha\_\{0\},\\beta\_\{0\}\)under the inverse\-gamma parameterization of Eq\. \([3](https://arxiv.org/html/2608.10398#S2.E3)\), the coordinate\-wise divergence is

DKL​\(q∥p0\)=\\displaystyle D\_\{\\mathrm\{KL\}\}\(q\\\|p\_\{0\}\)=\{\}α0​log⁡ββ0−log⁡Γ​\(α\)\+log⁡Γ​\(α0\)\+\(α−α0\)​ψ​\(α\)−α\+α​β0β\\displaystyle\\alpha\_\{0\}\\log\\frac\{\\beta\}\{\\beta\_\{0\}\}\-\\log\\Gamma\(\\alpha\)\+\\log\\Gamma\(\\alpha\_\{0\}\)\+\(\\alpha\-\\alpha\_\{0\}\)\\psi\(\\alpha\)\-\\alpha\+\\frac\{\\alpha\\beta\_\{0\}\}\{\\beta\}\+12​\[log⁡νν0\+ν0ν−1\+ν0​α​\(γ−γ0\)2β\],\\displaystyle\+\\frac\{1\}\{2\}\\left\[\\log\\frac\{\\nu\}\{\\nu\_\{0\}\}\+\\frac\{\\nu\_\{0\}\}\{\\nu\}\-1\+\\frac\{\\nu\_\{0\}\\alpha\(\\gamma\-\\gamma\_\{0\}\)^\{2\}\}\{\\beta\}\\right\],\(12\)whereψ\\psiis the digamma function\. This is the KL between the inverse\-gamma factors plus the expected KL between the conditional normal distributions ofμ\\mu\.

### 2\.3ELBO interpretation and determination of the NIG weight

Starting directly from Eq\. \([9](https://arxiv.org/html/2608.10398#S2.E9)\), the only apparent free balance isλNIG\\lambda\_\{\\mathrm\{NIG\}\}, which weights the NIG regularizer relative to the reconstruction term\. This weight has a likelihood interpretation rather than being an arbitrary tuning parameter\. Consider the hierarchical generative model

p​\(μ,σ2\)=p0,p​\(z∣μ,σ2\)=𝒩​\(μ,σ2\),p​\(y∣z\)=𝒩​\(gθ​\(z\),s2​IP\),p\(\\mu,\\sigma^\{2\}\)=p\_\{0\},\\qquad p\(z\\mid\\mu,\\sigma^\{2\}\)=\\mathcal\{N\}\(\\mu,\\sigma^\{2\}\),\\qquad p\(y\\mid z\)=\\mathcal\{N\}\\\!\\left\(g\_\{\\theta\}\(z\),s^\{2\}I\_\{P\}\\right\),\(13\)with inference modelq​\(μ,σ2,z∣y\)=qϕ​\(μ,σ2∣y\)​p​\(z∣μ,σ2\)q\(\\mu,\\sigma^\{2\},z\\mid y\)=q\_\{\\phi\}\(\\mu,\\sigma^\{2\}\\mid y\)p\(z\\mid\\mu,\\sigma^\{2\}\)\. The scalars2s^\{2\}is the homoscedastic observation variance in image space\.

For this model, the negative ELBO is

−ELBO⁡\(y\)=P2​log⁡\(2​π​s2\)\+P2​s2​Lrecon​\(y\)\+KLNIG⁡\(y\)\.\-\\operatorname\{ELBO\}\(y\)=\\frac\{P\}\{2\}\\log\(2\\pi s^\{2\}\)\+\\frac\{P\}\{2s^\{2\}\}L\_\{\\mathrm\{recon\}\}\(y\)\+\\operatorname\{KL\}\_\{\\mathrm\{NIG\}\}\(y\)\.\(14\)The chain\-rule KL reduces toDKL​\[qϕ​\(μ,σ2∣y\)∥p0\]D\_\{\\mathrm\{KL\}\}\[q\_\{\\phi\}\(\\mu,\\sigma^\{2\}\\mid y\)\\\|p\_\{0\}\]becauseq​\(z∣μ,σ2\)q\(z\\mid\\mu,\\sigma^\{2\}\)is chosen to equalp​\(z∣μ,σ2\)p\(z\\mid\\mu,\\sigma^\{2\}\)\. The Gaussian observation model supplies the first two terms in Eq\. \([14](https://arxiv.org/html/2608.10398#S2.E14)\)\.

Multiplying Eq\. \([9](https://arxiv.org/html/2608.10398#S2.E9)\) byP/\(2​s2\)P/\(2s^\{2\}\)gives

P2​s2​LELVAE=P2​s2​Lrecon\+P​λNIG2​s2​LNIG\.\\frac\{P\}\{2s^\{2\}\}L\_\{\\mathrm\{ELVAE\}\}=\\frac\{P\}\{2s^\{2\}\}L\_\{\\mathrm\{recon\}\}\+\\frac\{P\\lambda\_\{\\mathrm\{NIG\}\}\}\{2s^\{2\}\}L\_\{\\mathrm\{NIG\}\}\.\(15\)Matching the coefficient ofLNIGL\_\{\\mathrm\{NIG\}\}in Eqs\. \([14](https://arxiv.org/html/2608.10398#S2.E14)\) and \([15](https://arxiv.org/html/2608.10398#S2.E15)\) gives

λNIG=2​s2​KP,or equivalentlys2=P​λNIG2​K\.\\lambda\_\{\\mathrm\{NIG\}\}=\\frac\{2s^\{2\}K\}\{P\},\\qquad\\text\{or equivalently\}\\qquad s^\{2\}=\\frac\{P\\lambda\_\{\\mathrm\{NIG\}\}\}\{2K\}\.\(16\)ThusλNIG\\lambda\_\{\\mathrm\{NIG\}\}and the assumed image\-space residual variance are two parameterizations of the same relative weighting\. Fixing one determines the other\.

The observation variance can itself be estimated from reconstruction residuals\. Ifs2s^\{2\}is treated as an unknown scalar and Eq\. \([14](https://arxiv.org/html/2608.10398#S2.E14)\) is minimized with respect tos2s^\{2\}while the encoder and decoder are held fixed, then

s^2=1P​𝔼y,z​‖y−gθ​\(z\)‖22=Lrecon,\\widehat\{s\}^\{2\}=\\frac\{1\}\{P\}\\mathbb\{E\}\_\{y,z\}\\\|y\-g\_\{\\theta\}\(z\)\\\|\_\{2\}^\{2\}=L\_\{\\mathrm\{recon\}\},\(17\)whereLreconL\_\{\\mathrm\{recon\}\}denotes the reconstruction MSE averaged over the data distribution and latent sampling\. Substituting Eq\. \([17](https://arxiv.org/html/2608.10398#S2.E17)\) into Eq\. \([16](https://arxiv.org/html/2608.10398#S2.E16)\) yields the practical calibration

λ^NIG=2​KP​Lrecon\.\\widehat\{\\lambda\}\_\{\\mathrm\{NIG\}\}=\\frac\{2K\}\{P\}L\_\{\\mathrm\{recon\}\}\.\(18\)Therefore, once the reconstruction MSE is measured,λNIG\\lambda\_\{\\mathrm\{NIG\}\}can be determined from the likelihood model instead of selected independently\. The relevant quantity is the dataset\-averaged, approximately converged reconstruction MSE, not the error of one image or one mini\-batch\. BecauseλNIG\\lambda\_\{\\mathrm\{NIG\}\}also affects training, a fully self\-consistent implementation can use a short warm\-up, estimateLreconL\_\{\\mathrm\{recon\}\}, updateλNIG\\lambda\_\{\\mathrm\{NIG\}\}using Eq\. \([18](https://arxiv.org/html/2608.10398#S2.E18)\), and optionally repeat; an even cleaner alternative is to learnlog⁡s2\\log s^\{2\}jointly in the unscaled ELBO of Eq\. \([14](https://arxiv.org/html/2608.10398#S2.E14)\)\.

Because Eq\. \([18](https://arxiv.org/html/2608.10398#S2.E18)\) is a testable identity rather than a recommendation, we report the test\. On the trained pilot model the held\-out reconstruction MSE under the sampled hierarchy isLrecon=0\.0408L\_\{\\mathrm\{recon\}\}=0\.0408, so Eq\. \([18](https://arxiv.org/html/2608.10398#S2.E18)\) givesλ^NIG=8\.33×10−4\\widehat\{\\lambda\}\_\{\\mathrm\{NIG\}\}=8\.33\\times 10^\{\-4\}, whereas the fixed value used for training is5×10−45\\times 10^\{\-4\}\(equivalentlys2=0\.0245s^\{2\}=0\.0245\)\. The fixed weight is therefore roughly a factor of 1\.67 smaller than its own likelihood\-consistent value: the pilot places somewhat less weight on the NIG regularizer than the observation model would imply\. We retain the fixed setting used in the reported pilot and flag the discrepancy explicitly rather than leaving Eq\. \([18](https://arxiv.org/html/2608.10398#S2.E18)\) as an unverified claim\. Closing the gap by one fixed\-point iteration is an important next step for a study in whichλNIG\\lambda\_\{\\mathrm\{NIG\}\}is varied deliberately\.

### 2\.4Why the full NIG hierarchy must be regularized

Marginalizing\(μ,σ2\)\(\\mu,\\sigma^\{2\}\)yields a Student\-ttlatent distribution\. However, that marginal does not identify the decomposition in Eqs\. \([5](https://arxiv.org/html/2608.10398#S2.E5)\)–\([6](https://arxiv.org/html/2608.10398#S2.E6)\)\.

Proposition 1 \(Marginal non\-identifiability\)\.Under Eq\. \([3](https://arxiv.org/html/2608.10398#S2.E3)\),zkz\_\{k\}is Student\-ttwith2​α2\\alphadegrees of freedom, locationγ\\gamma, and squared scaleβ​\(1\+1/ν\)/α\\beta\(1\+1/\\nu\)/\\alpha\. Therefore the marginal depends on\(ν,β\)\(\\nu,\\beta\)only throughc=β​\(1\+1/ν\)c=\\beta\(1\+1/\\nu\)\. Along the curveβ​\(1\+1/ν\)=c\\beta\(1\+1/\\nu\)=c, the marginal distribution ofzzis unchanged while

uvar=cα−1​ν1\+ν,uepi=cα−1​11\+νu\_\{\\mathrm\{var\}\}=\\frac\{c\}\{\\alpha\-1\}\\frac\{\\nu\}\{1\+\\nu\},\\qquad u\_\{\\mathrm\{epi\}\}=\\frac\{c\}\{\\alpha\-1\}\\frac\{1\}\{1\+\\nu\}\(19\)can trade continuously against one another\.

The practical consequence is important for generation: ifuepiu\_\{\\mathrm\{epi\}\}is to control which images are treated as reliable or challenging, the hierarchy that definesuepiu\_\{\\mathrm\{epi\}\}must itself be constrained\. A loss written only on the marginalizedp​\(z\)p\(z\)cannot supply that identification\[[5](https://arxiv.org/html/2608.10398#bib.bib5),[6](https://arxiv.org/html/2608.10398#bib.bib6)\]\.

### 2\.5Prior and pilot architecture

We use

\(γ0,ν0,α0,β0\)=\(0,1,3,1\)\.\(\\gamma\_\{0\},\\nu\_\{0\},\\alpha\_\{0\},\\beta\_\{0\}\)=\(0,1,3,1\)\.\(20\)This gives𝔼​\[σ2\]=1/2\\mathbb\{E\}\[\\sigma^\{2\}\]=1/2,Var⁡\(μ\)=1/2\\operatorname\{Var\}\(\\mu\)=1/2, and henceVar⁡\(z\)=1\\operatorname\{Var\}\(z\)=1, preserving the familiar centered unit\-variance latent convention while explicitly separating the two components\.

The pilot ELVAE uses an MLP encoder784→128→64784\\to 128\\to 64, latent dimensionK=8K=8, and a mirrored decoder\. It is trained for four epochs with Adam, learning rate10−310^\{\-3\}, batch size 1024, andλNIG=5×10−4\\lambda\_\{\\mathrm\{NIG\}\}=5\\times 10^\{\-4\}\. WithP=784P=784andK=8K=8, Eq\. \([16](https://arxiv.org/html/2608.10398#S2.E16)\) shows that this fixed weight corresponds to an assumed observation variances2=0\.0245s^\{2\}=0\.0245\. The goal is not maximum MNIST generation quality; it is a compact test of whether the learneduepiu\_\{\\mathrm\{epi\}\}provides useful generation stratification\.

## 3Uncertainty\-Aware Generation

### 3\.1Uncertainty\-scaled posterior\-anchored generation

For a labeled anchor\(yi,ci\)\(y\_\{i\},c\_\{i\}\), the encoder gives\(γi,νi,αi,βi\)\(\\gamma\_\{i\},\\nu\_\{i\},\\alpha\_\{i\},\\beta\_\{i\}\)and the coordinate\-wise uncertainty vector

uepi,i=βi⊘\[νi⊙\(αi−1\)\],u\_\{\\mathrm\{epi\},i\}=\\beta\_\{i\}\\oslash\[\\nu\_\{i\}\\odot\(\\alpha\_\{i\}\-1\)\],\(21\)where⊘\\oslashand⊙\\odotdenote elementwise division and multiplication\. The exact NIG marginal of the latent locationμi\\mu\_\{i\}is Student\-tt\. To isolateuepiu\_\{\\mathrm\{epi\}\}as a generation\-control amplitude without introducing the ordinaryz∣μ,σ2z\\mid\\mu,\\sigma^\{2\}variability, the pilot instead uses the variance\-matched Gaussian perturbation

ziepi=γi\+uepi,i⊙ϵ,ϵ∼𝒩​\(0,I\),z\_\{i\}^\{\\mathrm\{epi\}\}=\\gamma\_\{i\}\+\\sqrt\{u\_\{\\mathrm\{epi\},i\}\}\\odot\\epsilon,\\qquad\\epsilon\\sim\\mathcal\{N\}\(0,I\),\(22\)followed by

xigen=gθ​\(ziepi\)\.x\_\{i\}^\{\\mathrm\{gen\}\}=g\_\{\\theta\}\(z\_\{i\}^\{\\mathrm\{epi\}\}\)\.\(23\)Equation \([22](https://arxiv.org/html/2608.10398#S3.E22)\) is therefore not an exact sample from the NIG/Student\-ttposterior\. It is a controlled Gaussian perturbation centered atγi\\gamma\_\{i\}whose coordinate\-wise variance matchesVar⁡\(μi∣yi\)=uepi,i\\operatorname\{Var\}\(\\mu\_\{i\}\\mid y\_\{i\}\)=u\_\{\\mathrm\{epi\},i\}\. This deliberate construction tests whether the learned uncertainty is useful as a generation variable while keeping the reported pilot simple and interpretable\.

For exact posterior generation one can instead drawσ2∼InvGamma⁡\(α,β\)\\sigma^\{2\}\\sim\\operatorname\{InvGamma\}\(\\alpha,\\beta\), thenμ∼𝒩​\(γ,σ2/ν\)\\mu\\sim\\mathcal\{N\}\(\\gamma,\\sigma^\{2\}/\\nu\)andz∼𝒩​\(μ,σ2\)z\\sim\\mathcal\{N\}\(\\mu,\\sigma^\{2\}\)\. For control\-oriented generation, the variance\-matched rule can be generalized to

z=γ\+τepi​uepi⊙ϵepi\+τvar​uvar⊙ϵvar,z=\\gamma\+\\tau\_\{\\mathrm\{epi\}\}\\sqrt\{u\_\{\\mathrm\{epi\}\}\}\\odot\\epsilon\_\{\\mathrm\{epi\}\}\+\\tau\_\{\\mathrm\{var\}\}\\sqrt\{u\_\{\\mathrm\{var\}\}\}\\odot\\epsilon\_\{\\mathrm\{var\}\},\(24\)with two interpretable amplitudes\. This second expression is likewise a variance\-matched control parameterization rather than an exact draw from the hierarchical posterior\. Lowτepi\\tau\_\{\\mathrm\{epi\}\}favors conservative posterior\-anchored variation, whereas increasingτepi\\tau\_\{\\mathrm\{epi\}\}deliberately probes sensitivity to latent\-location uncertainty\.

### 3\.2Separating anchor reliability from perturbation\-attributable effects

Equation \([22](https://arxiv.org/html/2608.10398#S3.E22)\) makesuepiu\_\{\\mathrm\{epi\}\}serve two distinct roles: it is \(i\) an uncertainty score computed from the NIG posterior and used to rank anchors, and \(ii\) the scale of the random displacement applied toγ\\gamma\. A raw comparison of classifier error between low\- and high\-uepiu\_\{\\mathrm\{epi\}\}populations therefore cannot say which role produced the difference\. Anchors with largeuepiu\_\{\\mathrm\{epi\}\}may simply be atypical digits that the encoder–decoder pair represents poorly, in which case the decoded image can lose its class even with no uncertainty\-scaled displacement\.

The distinction can be written explicitly as

uepi=βν​\(α−1\)⏟estimated for every anchorand retained for rankingversusτepi​uepi​ϵ⏟use of that uncertaintyin perturbation\\underbrace\{u\_\{\\mathrm\{epi\}\}=\\frac\{\\beta\}\{\\nu\(\\alpha\-1\)\}\}\_\{\\begin\{subarray\}\{c\}\\text\{\\small estimated for every anchor\}\\\\\[\-1\.0pt\] \\text\{\\small and retained for ranking\}\\end\{subarray\}\}\\qquad\\text\{versus\}\\qquad\\underbrace\{\\tau\_\{\\mathrm\{epi\}\}\\sqrt\{u\_\{\\mathrm\{epi\}\}\}\\,\\epsilon\\vphantom\{\\frac\{\\beta\}\{\\nu\(\\alpha\-1\)\}\}\}\_\{\\begin\{subarray\}\{c\}\\text\{\\small use of that uncertainty\}\\\\\[\-1\.0pt\] \\text\{\\small in perturbation\}\\end\{subarray\}\}Settingz=γz=\\gammaswitches off only the second quantity by settingτepi=0\\tau\_\{\\mathrm\{epi\}\}=0\. It does not setuepi=0u\_\{\\mathrm\{epi\}\}=0, and it does not prevent the decoder from generatinggθ​\(γ\)g\_\{\\theta\}\(\\gamma\)\.

We therefore use three conditions, all sharing one trained ELVAE, one frozen classifier, and one realization ofϵ\\epsilon:

\(A\) Uncertainty\-scaled generation\.z=γ\+uepi⊙ϵz=\\gamma\+\\sqrt\{u\_\{\\mathrm\{epi\}\}\}\\odot\\epsilon, i\.e\. Eq\. \([22](https://arxiv.org/html/2608.10398#S3.E22)\)\. This is the primary uncertainty\-scaled generation condition\.

\(C\) Zero\-displacement control\.z=γz=\\gamma, equivalentlyτepi=0\\tau\_\{\\mathrm\{epi\}\}=0in Eq\. \([24](https://arxiv.org/html/2608.10398#S3.E24)\) \(withτvar=0\\tau\_\{\\mathrm\{var\}\}=0in this pilot\)\. The encoder still producesuepiu\_\{\\mathrm\{epi\}\}for each anchor and the samples are still ranked byuepiu\_\{\\mathrm\{epi\}\}; only uncertainty\-scaled displacement is disabled\. Any low/high stratification surviving here is therefore associated with anchor representation/re\-generation reliability rather than with uncertainty\-scaled perturbation\.

\(I\) Generation\-attributable failure\.Restrict attention to anchors whose condition\-\(C\) generation is already classified correctly, and measure the failure rate under condition \(A\)\. Every failure counted here was induced by uncertainty\-scaled perturbation\.

Condition \(C\) is the required zero\-displacement baseline\. Statistic \(I\) isolates the part of the result attributable to the uncertainty\-scaled perturbation\.

### 3\.3Low\-uncertainty augmentation and high\-uncertainty stress testing

For a class\-conditional or posterior\-anchored application, generated samples can be divided byuepiu\_\{\\mathrm\{epi\}\}:

High\-uepiu\_\{\\mathrm\{epi\}\}images are not automatically “bad” images\. They are images generated from an anchor whose latent location ELVAE estimates less precisely\. Some remain semantically correct; others cross a task boundary\. The value ofuepiu\_\{\\mathrm\{epi\}\}is therefore statistical stratification, not deterministic rejection\. Because much of the low/high contrast is inherited from the anchor, the table is best read as a policy over anchors to be re\-generated, with the additional sampling\-induced risk quantified separately by statistic \(I\)\.

## 4Generation Pilot on MNIST

### 4\.1Study design

The 70,000 MNIST digit images\[[10](https://arxiv.org/html/2608.10398#bib.bib10)\]were pooled and partitioned into 60,000 training images and 10,000 held\-out images\. ELVAE is trained without using digit labels\. The labels are used only to define the intended semantic identity of each posterior anchor and to evaluate the generated images\.

A separate MLP classifier784→256→128→10784\\to 256\\to 128\\to 10is trained only on the real 60,000\-image training set for three epochs and then frozen\. It achieves 96\.85% accuracy on the held\-out real images\. No generated image is used to train or tune this classifier\.

For each held\-out anchor, one image is generated using Eq\. \([22](https://arxiv.org/html/2608.10398#S3.E22)\)\. The scalaruepiu\_\{\\mathrm\{epi\}\}is the mean of the eight coordinate\-wise uncertainties from Eq\. \([8](https://arxiv.org/html/2608.10398#S2.E8)\)\. A generation error occurs when the frozen classifier prediction differs from the anchor label\. Because the baseline scale ofuepiu\_\{\\mathrm\{epi\}\}differs across digit classes, uncertainty is ranked within the intended digit class before pooling\. This prevents an intrinsically high\-uncertainty but easy class from dominating the high\-uepiu\_\{\\mathrm\{epi\}\}group\.

Ifuepiu\_\{\\mathrm\{epi\}\}is instead ranked globally across all 10,000 held\-out images, the bottom\-versus\-top 20% contrast is 26\.70% versus 27\.10%, a ratio of 1\.015×\\times—essentially no effect\. All of the reported stratification therefore lives within digit classes and none of it survives pooling across classes\. The reason is that the class\-level mean ofuepiu\_\{\\mathrm\{epi\}\}and class\-level digit difficulty are not aligned, so global ranking mixes an easy high\-uepiu\_\{\\mathrm\{epi\}\}class into the high\-uncertainty group and cancels the within\-class trend\. This is a legitimate use of stratification rather than a selection effect, but it means the unconditional model produces auepiu\_\{\\mathrm\{epi\}\}scale that is only comparable within a class\. A conditional ELVAE would be required for applications in which anchors of different classes must be ranked against each other\.

The primary quantitative comparison is classifier error in the bottom and top 20% of within\-classuepiu\_\{\\mathrm\{epi\}\}\. A class\-stratified bootstrap with 800 replicates gives confidence intervals\. We also report error across ten within\-class uncertainty deciles\. Every quantity is additionally reported under conditions \(A\), \(C\), and \(I\) of Sec\. 3\.2, and the whole pilot is repeated for three random seeds so that run\-to\-run spread is visible\.

![Refer to caption](https://arxiv.org/html/2608.10398v1/figures/fig2.png)Figure 2:Visualization of posterior\-anchored uncertainty\-aware generation\. Top row: condition \(C\), the measured zero\-displacement controlz=γz=\\gammawithτepi=0\\tau\_\{\\mathrm\{epi\}\}=0; the displayeduepiu\_\{\\mathrm\{epi\}\}values remain the NIG\-derived uncertainty scores used for ranking\. The top\-row anchors are at the median within\-classuepiu\_\{\\mathrm\{epi\}\}of each class\. Middle row: approximately the 10th within\-classuepiu\_\{\\mathrm\{epi\}\}percentile\. Bottom row: approximately the 90th percentile\. Each image reports intended class and frozen\-classifier result asc→c^c\\to\\hat\{c\}, together with itsuepiu\_\{\\mathrm\{epi\}\}value; red titles mark generations whose class was lost\.
### 4\.2Qualitative visualization

Figure[2](https://arxiv.org/html/2608.10398#S4.F2)shows three rows of empirical ELVAE generations\. The top row is theτepi=0\\tau\_\{\\mathrm\{epi\}\}=0zero\-displacement control: the decoder is evaluated atz=γz=\\gammafor an anchor at the median within\-classuepiu\_\{\\mathrm\{epi\}\}of each digit class\. The encoder still computes a nonzerouepiu\_\{\\mathrm\{epi\}\}for each anchor; that score is shown above each image but is not used to perturbzz\. Atz=γz=\\gammathe frozen classifier errs on 28\.28% of the 10,000 anchors, reflecting information loss in the deliberately small MLP encoder–decoder\. The second and third rows are empirical ELVAE generations selected at approximately the 10th and 90th within\-classuepiu\_\{\\mathrm\{epi\}\}percentiles\. Their titles give intended class→\\tofrozen\-classifier prediction and the absoluteuepiu\_\{\\mathrm\{epi\}\}value\. These rows are selected by uncertainty percentile only, not by classifier outcome\.

### 4\.3Quantitative result with a fixed classifier

Table[1](https://arxiv.org/html/2608.10398#S4.T1)collects the pilot results\. Across all 10,000 generated images, the frozen classifier error was 29\.06%\. Uncertainty stratified this error\. In the bottom 20% of within\-classuepiu\_\{\\mathrm\{epi\}\}, classifier error was 26\.30%; in the top 20%, it was 37\.80%\. Thus the high\-uepiu\_\{\\mathrm\{epi\}\}group had an 11\.50 percentage\-point higher error, or a 1\.437×\\timeserror rate\. The class\-stratified bootstrap gave a 95% CI of 8\.99–14\.53 percentage points for the difference and 1\.33–1\.58 for the ratio\. A two\-proportion chi\-square test gavep=6\.56×10−15p=6\.56\\times 10^\{\-15\}\.

Table 1:Generation pilot result\.Table[2](https://arxiv.org/html/2608.10398#S4.T2)places the result next to the controls and changes how it should be read\. Under condition \(C\), with uncertainty\-scaled displacement removed entirely, the bottom\-versus\-top contrast is 26\.30% versus 36\.70%, a ratio of 1\.395×\\times\. Almost the whole condition\-\(A\) stratification is therefore already present*before uncertainty\-scaled perturbation is applied*\. This does not mean “before generation” and does not meanuepi=0u\_\{\\mathrm\{epi\}\}=0: the decoder still generatesgθ​\(γ\)g\_\{\\theta\}\(\\gamma\), and the encoder\-deriveduepiu\_\{\\mathrm\{epi\}\}is still used to define the low/high groups\. Uncertainty\-scaled perturbation raises overall error only from 28\.28% to 29\.06%\. The appropriate reading is thatuepiu\_\{\\mathrm\{epi\}\}ranks anchors by how faithfully the model can re\-encode and re\-decode them, which is a useful property of the evidential posterior but is not, by itself, a perturbation\-induced effect\.

The generation\-attributable statistic \(I\) isolates what uncertainty\-scaled perturbation does\. Among anchors that condition \(C\) already classifies correctly, the perturbation causes failure in 1\.97% of the low\-uepiu\_\{\\mathrm\{epi\}\}group and 5\.92% of the high\-uepiu\_\{\\mathrm\{epi\}\}group, a ratio of 3\.01×\\times\(95% CI 2\.03–4\.75\)\. The relative effect is larger than the headline ratio, but the base rate is small, so the number of images actually destabilized by uncertainty\-scaled perturbation is modest\. Figure[4](https://arxiv.org/html/2608.10398#S5.F4)gives the corresponding decile trend\. A stress\-testing protocol built on Eq\. \([22](https://arxiv.org/html/2608.10398#S3.E22)\) atτepi=1\\tau\_\{\\mathrm\{epi\}\}=1will therefore produce hard examples at a low yield\. Increasingτepi\\tau\_\{\\mathrm\{epi\}\}is the natural next experiment\.

Table 2:The same trained model and frozen classifier under conditions \(A\), \(C\), and \(I\)\. Condition \(C\) keepsuepiu\_\{\\mathrm\{epi\}\}as the ranking variable but disables its sampling role by settingτepi=0\\tau\_\{\\mathrm\{epi\}\}=0\.Figure[3](https://arxiv.org/html/2608.10398#S4.F3)gives the full decile trend with the condition\-\(C\) curve overlaid\. The curve is not strictly monotone in every low\-uncertainty bin, but the upper uncertainty range shows a clear increase and the highest decile has the largest error\. The lowest decile is also elevated relative to deciles 2–4, and this shape reproduces across seeds; a plausible reading is that the very lowest\-uepiu\_\{\\mathrm\{epi\}\}coordinates are those closest to the prior mean, where the decoder has the least anchor\-specific information to work with\. Because decile 1 sits inside the bottom\-20% group, it dilutes the reference level and makes the headline ratio conservative\. On a sample\-by\-sample basis the association is modest: the AUROC of within\-classuepiu\_\{\\mathrm\{epi\}\}percentile for classifier failure is 0\.556, and Spearman correlation with the binary failure indicator is 0\.088\. These values are safeguards against overclaiming\. The result supports population\-level uncertainty stratification, not a claim thatuepiu\_\{\\mathrm\{epi\}\}alone perfectly predicts which individual image will fail\.

![Refer to caption](https://arxiv.org/html/2608.10398v1/figures/fig3.png)Figure 3:Frozen\-classifier error versus within\-class ELVAE epistemic\-uncertainty decile\. The dashed control curve isz=γz=\\gammaand tracks the uncertainty\-scaled\-generation curve closely\. In this controlτepi=0\\tau\_\{\\mathrm\{epi\}\}=0whileuepiu\_\{\\mathrm\{epi\}\}is retained for ranking\. The top uncertainty decile reaches 43\.00% error\.Table 3:Seed\-to\-seed variability of the pilot\. Each row repeats the entire pipeline from a different random key\.

## 5Discussion and Conclusion

The pilot supports a focused and testable claim\. ELVAE produces a continuous uncertainty variable that can be attached to the generation process, and populations selected by that variable differ substantially in semantic reliability\. Thez=γz=\\gammacontrol shows that most of the low/high difference survives when uncertainty\-scaled perturbation is switched off, even thoughuepiu\_\{\\mathrm\{epi\}\}itself is still measured and used for ranking\. Thus this dominant component is best described as an anchor representation/re\-generation reliability effect, whereas only the smaller component isolated by statistic \(I\) is caused by uncertainty\-scaled perturbation itself\. Both components are useful: the anchor\-level component can help decide which examples are safer to re\-generate for augmentation, whereas the generation\-attributable component informs how hard to push the sampler for stress testing\.

The low/high comparison should not be interpreted as a universal threshold\. First,uepiu\_\{\\mathrm\{epi\}\}is class dependent in the present unconditional model, which is why the pilot uses within\-class rankings; the effect does not survive global ranking\. A conditional ELVAE is therefore a prerequisite for cross\-class use rather than a minor refinement\. Second, the association is probabilistic and modest at the single\-image level\. Third, classifier error is only a semantic proxy for image utility; medical imaging applications would require task\-specific validity checks, physics constraints, or expert review\. Fourth, the current MLP generator is intentionally small and generates blurry digits, and its lossiness is exactly what makes the condition\-\(C\) error rate as high as 28\.28%; a stronger decoder would lower that baseline and would let condition \(I\) be measured on a much larger population of correctly re\-generated anchors\. A stronger decoder or a hybrid ELVAE\-conditioning mechanism for modern diffusion or flow models could preserve the same uncertainty principle while greatly improving image fidelity\. Fifth, as Table[3](https://arxiv.org/html/2608.10398#S4.T3)shows, the headline ratio varies from 1\.126 to 1\.437 across three seeds, so single\-seed reporting of a number like 1\.437×\\timesoverstates the precision of the pilot\.

The experiment also clarifies what high uncertainty should mean operationally\. High\-uepiu\_\{\\mathrm\{epi\}\}images should not simply be discarded\. If the objective is trusted augmentation, they can be down\-weighted or rejected\. If the objective is robustness analysis, those same samples are valuable because they are more likely to induce semantic instability\. This turns one uncertainty quantity into two complementary data\-generation policies\.

A natural next experiment is downstream retraining: train one classifier with an equal number of low\-uepiu\_\{\\mathrm\{epi\}\}synthetic images and another with unfiltered synthetic images, then compare real\-test accuracy and robustness\. A second extension is to varyτepi\\tau\_\{\\mathrm\{epi\}\}in Eq\. \([24](https://arxiv.org/html/2608.10398#S3.E24)\) and measure whether task error increases smoothly as uncertainty\-scaled perturbation is strengthened; given the small base rate of condition \(I\) atτepi=1\\tau\_\{\\mathrm\{epi\}\}=1, this is the most informative single experiment remaining, since it directly tests whetheruepiu\_\{\\mathrm\{epi\}\}acts as a usable generation knob rather than only as an anchor\-quality score\. In medical imaging, the same framework could generate low\-uncertainty anatomy for augmentation and high\-uncertainty anatomy or acquisition conditions for controlled stress testing\.

ELVAE replaces the deterministic latent mean and variance outputs of a conventional VAE with an input\-dependent NIG posterior over latent location and latent variance\. This produces an explicit latent\-location uncertaintyuepi=β/\[ν​\(α−1\)\]u\_\{\\mathrm\{epi\}\}=\\beta/\[\\nu\(\\alpha\-1\)\]that is mathematically identified by direct higher\-order regularization and can be used as a generation control variable\. The likelihood analysis in Sec\. 2\.3 further shows thatλNIG\\lambda\_\{\\mathrm\{NIG\}\}need not be regarded as an arbitrary balance parameter: under the homoscedastic Gaussian observation model it is determined by the residual variance, which can in turn be estimated by the converged reconstruction MSE\.

In conclusion, the MNIST pilot establishes two separable findings\. First,uepiu\_\{\\mathrm\{epi\}\}stratifies posterior anchors by re\-generation reliability: the top 20% uncertainty group has 37\.80% classification error against 26\.30% in the bottom 20%, a 1\.437×\\timesincrease, of which a 1\.395×\\timesratio remains whenτepi=0\\tau\_\{\\mathrm\{epi\}\}=0\. In that controluepiu\_\{\\mathrm\{epi\}\}is still present and used for ranking; only uncertainty\-scaled perturbation is absent\. Second, uncertainty\-scaled perturbation itself induces semantic failure 3\.01×\\timesmore often in high\-uepiu\_\{\\mathrm\{epi\}\}anchors than in low\-uepiu\_\{\\mathrm\{epi\}\}anchors\. The first finding is the larger anchor\-reliability effect; the second is the specifically sampling\-attributable generation effect\. Together they support ELVAE as a framework that can stratify anchors and, to a lesser but measurable degree, control generation by model uncertainty\.

![Refer to caption](https://arxiv.org/html/2608.10398v1/figures/fig4.png)Figure 4:Generation\-attributable failure rate by within\-classuepiu\_\{\\mathrm\{epi\}\}decile, condition \(I\)\. Only anchors already classified correctly atz=γz=\\gammaare counted, so every failure shown was induced by uncertainty\-scaled perturbation\. The relative trend is steeper than in Fig\.[3](https://arxiv.org/html/2608.10398#S4.F3), but on a much smaller base rate\.#### Reproducibility\.

The pilot uses the publicly available MNIST dataset\[[10](https://arxiv.org/html/2608.10398#bib.bib10)\], partitioned into 60,000 training and 10,000 held\-out images\. The ELVAE encoder is an MLP784→128→64784\\to 128\\to 64withK=8K=8latent coordinates and a mirrored decoder, trained for four epochs with Adam, learning rate10−310^\{\-3\}, batch size 1024, andλNIG=5×10−4\\lambda\_\{\\mathrm\{NIG\}\}=5\\times 10^\{\-4\}\. The frozen evaluation classifier is an MLP784→256→128→10784\\to 256\\to 128\\to 10trained for three epochs on the real training split only\. Confidence intervals use a class\-stratified bootstrap with 800 replicates\. Results in Tables[1](https://arxiv.org/html/2608.10398#S4.T1)and[2](https://arxiv.org/html/2608.10398#S4.T2)use random key 20260809; Table[3](https://arxiv.org/html/2608.10398#S4.T3)repeats the entire pipeline for keys 1 and 2\.

#### Author–AI Collaboration\.

The author conceptualized ELVAE and the uncertainty\-aware generation study and made the methodological decisions, interpreted the results, and takes responsibility for the content\. Generative AI tools were used to assist with discussion, mathematical checking, computational analysis, drafting, and editing\.

## References

- \[1\]G\. E\. Hinton and R\. R\. Salakhutdinov, “Reducing the Dimensionality of Data with Neural Networks,”*Science*, vol\. 313, no\. 5786, pp\. 504–507, 2006\.
- \[2\]D\. P\. Kingma and M\. Welling, “Auto\-Encoding Variational Bayes,” in*International Conference on Learning Representations*, 2014\.
- \[3\]M\. Sensoy, L\. Kaplan, and M\. Kandemir, “Evidential Deep Learning to Quantify Classification Uncertainty,” in*Advances in Neural Information Processing Systems*, vol\. 31, 2018\.
- \[4\]A\. Amini, W\. Schwarting, A\. Soleimany, and D\. Rus, “Deep Evidential Regression,” in*Advances in Neural Information Processing Systems*, vol\. 33, 2020\.
- \[5\]V\. Bengs, E\. Hüllermeier, and W\. Waegeman, “Pitfalls of Epistemic Uncertainty Quantification through Loss Minimisation,” in*Advances in Neural Information Processing Systems*, vol\. 35, 2022\.
- \[6\]N\. Meinert, J\. Gawlikowski, and A\. Lavin, “The Unreasonable Effectiveness of Deep Evidential Regression,” in*Proceedings of the AAAI Conference on Artificial Intelligence*, vol\. 37, pp\. 9134–9142, 2023\.
- \[7\]M\. Itkina, B\. Ivanovic, R\. Senanayake, M\. J\. Kochenderfer, and M\. Pavone, “Evidential Sparsification of Multimodal Latent Spaces in Conditional Variational Autoencoders,” in*Advances in Neural Information Processing Systems*, vol\. 33, 2020\.
- \[8\]G\. Baykal, M\. Kandemir, and G\. Unal, “EdVAE: Mitigating Codebook Collapse with Evidential Discrete Variational Autoencoders,”*Pattern Recognition*, vol\. 156, Art\. no\. 110792, 2024\.
- \[9\]J\. Catoni, D\. Martos, F\. Csikor, E\. Ferrante, D\. H\. Milone, B\. Meszéna, G\. Orbán, and R\. Echeveste, “Remedying Uncertainty Representations in Visual Inference through Explaining\-Away Variational Autoencoders,” arXiv:2404\.15390, 2024 \(revised 2026\)\.
- \[10\]Y\. LeCun, L\. Bottou, Y\. Bengio, and P\. Haffner, “Gradient\-Based Learning Applied to Document Recognition,”*Proceedings of the IEEE*, vol\. 86, no\. 11, pp\. 2278–2324, 1998\.

Similar Articles

Variational lossy autoencoder

OpenAI Blog

OpenAI researchers present a Variational Lossy Autoencoder (VLAE) that combines VAEs with neural autoregressive models (RNN, MADE, PixelRNN/CNN) to learn controllable global representations, achieving state-of-the-art results on MNIST, OMNIGLOT, and Caltech-101 Silhouettes density estimation tasks.

Variational Inference for Evidential Deep Learning

arXiv cs.LG

A mathematically principled framework, Variational Inference Evidential Deep Learning (VI-EDL), is proposed to address limitations in conventional Evidential Deep Learning by reformulating it through variational inference, deriving an Evidence Lower Bound, establishing a generalization bound, and achieving state-of-the-art performance on visual and medical datasets.

Variational option discovery algorithms

OpenAI Blog

OpenAI researchers introduce VALOR, a variational inference method for option discovery that connects option learning to variational autoencoders, and propose a curriculum learning approach that stabilizes training by dynamically increasing context complexity.

Understanding VQ-VAE (DALL-E Explained Pt. 1)

ML at Berkeley

An educational blog post explaining the Vector Quantized Variational Autoencoder (VQ-VAE) architecture, a key component of OpenAI's DALL-E image generation model.