Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels
Summary
This paper introduces the neural codebook channel diagnostic for VAEs, which measures encoder-decoder disagreement and provides a certificate bounded by the variational gap, enabling detection of mismatched decoding in deep generative models.
Similar Articles
On the quantitative analysis of decoder-based generative models
This paper proposes using Annealed Importance Sampling to evaluate log-likelihoods for decoder-based generative models (VAEs, GANs, etc.), addressing the challenge of intractable likelihood estimation. The authors validate their method and provide evaluation code to analyze model performance, overfitting, and mode coverage.
Variational lossy autoencoder
OpenAI researchers present a Variational Lossy Autoencoder (VLAE) that combines VAEs with neural autoregressive models (RNN, MADE, PixelRNN/CNN) to learn controllable global representations, achieving state-of-the-art results on MNIST, OMNIGLOT, and Caltech-101 Silhouettes density estimation tasks.
ELVAE: Evidential Learning-Based Variational Autoencoder for Uncertainty-Aware Generation
Introduces ELVAE, a VAE with evidential learning that models latent coordinates with normal-inverse-gamma posteriors to obtain explicit uncertainty estimates. Experiments on MNIST show that within-class uncertainty ranking can stratify synthetic sample reliability and stress-testing, though results require class-wise normalization and vary across seeds.
Data-Driven Variational Basis Learning Beyond Neural Networks: A Non-Neural Framework for Adaptive Basis Discovery
This paper introduces Data-Driven Variational Basis Learning (DVBL), a non-neural framework that learns basis functions directly from data through variational optimization, offering interpretability and mathematical transparency compared to neural networks.
Interpretable EEG Microstate Discovery via Variational Deep Embedding: A Systematic Architecture Search with Multi-Quadrant Evaluation
This paper presents Conv-VaDE, a variational deep embedding model for interpretable EEG microstate discovery that jointly learns topographic reconstruction and probabilistic soft clustering. It includes a systematic architecture search evaluated on resting-state EEG data to determine optimal model configurations for stability and interpretability.