Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors [R]

Reddit r/MachineLearning Papers

Summary

This paper introduces a bidirectional latent diffusion model that steps dynamical systems forward or backward in time, using round-trip consistency as a self-supervised test-time error signal to predict rollout errors without ground truth or ensembles.

Whether generating CELEBV-HQ videos or turbulent plasma fields (digital twins), autoregressive models (such as latent diffusion or flow models) accumulate error over long rollouts, yet at deployment there is no ground truth to measure against. I train a single conditional latent diffusion model that steps a dynamical system forward or backward in time via a direction flag, and show that this bidirectionality supplies a measurement-free test-time error signal: rolling forward steps and then backward steps must return the model to its start, so the round-trip discrepancy is a self-supervised proxy for the unobservable rollout error: no ensembles, no held-out data, no governing equations, for one extra rollout. Furthermore, training both directions in one network is shown to beat two specialist models in both directions. Paper: https://arxiv.org/abs/2608.00675 Code (data generation, training, analysis): https://github.com/alexscheinker/round-trip-consistency Project page: https://alexscheinker.github.io/roundtrip.html
Original Article

Similar Articles

Temporal Difference Learning for Diffusion Models

arXiv cs.LG

This paper introduces a temporal difference (TD) learning objective for diffusion models that enforces cross-time consistency along the denoising trajectory. It reformulates denoising as a reinforcement learning policy evaluation problem, showing significant improvements in sample quality (FID), especially for few-step samplers.

Analyzing Learning-Dynamics Across Loss and Prediction Choices for Diffusion Models

arXiv cs.LG

This paper systematically analyzes the nine combinations of prediction spaces (x, ε, v) and loss spaces in diffusion models, showing loss-space changes equal timestep reweighting and that low-rank bottlenecks impose irreducible error floors for noise/velocity prediction while clean-data prediction exploits low-dimensional structure. Experiments with U-Net and JiT across CIFAR-10, Imagenette, and ImageNet-256 validate the theoretical predictions.