Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors [R]
Summary
This paper introduces a bidirectional latent diffusion model that steps dynamical systems forward or backward in time, using round-trip consistency as a self-supervised test-time error signal to predict rollout errors without ground truth or ensembles.
Similar Articles
Temporal Difference Learning for Diffusion Models
This paper introduces a temporal difference (TD) learning objective for diffusion models that enforces cross-time consistency along the denoising trajectory. It reformulates denoising as a reinforcement learning policy evaluation problem, showing significant improvements in sample quality (FID), especially for few-step samplers.
Differencing the Diffusion Trajectory toward Uncertain Components for Time Series Forecasting
This paper proposes DiffDiff, a diffusion framework for probabilistic time series forecasting that embeds predictability asymmetry into the diffusion trajectory, outperforming six diffusion baselines on seven benchmarks across four prediction horizons.
Unsure but Certain: Uncovering the Representation-Confidence Gap in Diffusion Language Models
This paper identifies a 'representation confidence gap' in diffusion language models: internal states detect input noise accurately but reported confidence stays high and answer ranking degrades under noise. It introduces a lightweight, training-free extraction tool that leverages hidden states to improve ranking without modifying the base model.
Analyzing Learning-Dynamics Across Loss and Prediction Choices for Diffusion Models
This paper systematically analyzes the nine combinations of prediction spaces (x, ε, v) and loss spaces in diffusion models, showing loss-space changes equal timestep reweighting and that low-rank bottlenecks impose irreducible error floors for noise/velocity prediction while clean-data prediction exploits low-dimensional structure. Experiments with U-Net and JiT across CIFAR-10, Imagenette, and ImageNet-256 validate the theoretical predictions.
Prefix-Denoising Consistency: Test-Time Verification for Diffusion Language Models
This paper introduces Prefix-Denoising Consistency (PDC), a test-time verification method for Diffusion Language Models that improves performance on reasoning tasks by using prefix-conditioned regeneration and majority voting.