Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors [R]

Reddit r/MachineLearning 08/06/26, 12:10 PM Papers

diffusion-models bidirectional rollout-error self-supervised latent-diffusion dynamical-systems

Summary

This paper introduces a bidirectional latent diffusion model that steps dynamical systems forward or backward in time, using round-trip consistency as a self-supervised test-time error signal to predict rollout errors without ground truth or ensembles.

Whether generating CELEBV-HQ videos or turbulent plasma fields (digital twins), autoregressive models (such as latent diffusion or flow models) accumulate error over long rollouts, yet at deployment there is no ground truth to measure against. I train a single conditional latent diffusion model that steps a dynamical system forward or backward in time via a direction flag, and show that this bidirectionality supplies a measurement-free test-time error signal: rolling forward steps and then backward steps must return the model to its start, so the round-trip discrepancy is a self-supervised proxy for the unobservable rollout error: no ensembles, no held-out data, no governing equations, for one extra rollout. Furthermore, training both directions in one network is shown to beat two specialist models in both directions. Paper: https://arxiv.org/abs/2608.00675 Code (data generation, training, analysis): https://github.com/alexscheinker/round-trip-consistency Project page: https://alexscheinker.github.io/roundtrip.html

Original Article

Similar Articles

Temporal Difference Learning for Diffusion Models

arXiv cs.LG

This paper introduces a temporal difference (TD) learning objective for diffusion models that enforces cross-time consistency along the denoising trajectory. It reformulates denoising as a reinforcement learning policy evaluation problem, showing significant improvements in sample quality (FID), especially for few-step samplers.

Differencing the Diffusion Trajectory toward Uncertain Components for Time Series Forecasting

arXiv cs.AI

This paper proposes DiffDiff, a diffusion framework for probabilistic time series forecasting that embeds predictability asymmetry into the diffusion trajectory, outperforming six diffusion baselines on seven benchmarks across four prediction horizons.

Unsure but Certain: Uncovering the Representation-Confidence Gap in Diffusion Language Models

arXiv cs.CL

This paper identifies a 'representation confidence gap' in diffusion language models: internal states detect input noise accurately but reported confidence stays high and answer ranking degrades under noise. It introduces a lightweight, training-free extraction tool that leverages hidden states to improve ranking without modifying the base model.

Prefix-Denoising Consistency: Test-Time Verification for Diffusion Language Models

arXiv cs.LG

This paper introduces Prefix-Denoising Consistency (PDC), a test-time verification method for Diffusion Language Models that improves performance on reasoning tasks by using prefix-conditioned regeneration and majority voting.

Understanding Rollout Error in Graph World Models