FFJORD: Free-form continuous dynamics for scalable reversible generative models

OpenAI Blog Papers

Summary

FFJORD introduces a scalable reversible generative model using continuous dynamics and Hutchinson's trace estimator to enable unbiased log-density estimation without architectural constraints. The method achieves state-of-the-art results on density estimation and image generation while maintaining efficient sampling.

No content available
Original Article
View Cached Full Text

Cached at: 04/20/26, 02:45 PM

# FFJORD: Free-form continuous dynamics for scalable reversible generative models Source: [https://openai.com/index/ffjord/](https://openai.com/index/ffjord/) ## Abstract A promising class of generative models maps points from a simple distribution to a complex distribution through an invertible neural network\. Likelihood\-based training of these models requires restricting their architectures to allow cheap computation of Jacobian determinants\. Alternatively, the Jacobian trace can be used if the transformation is specified by an ordinary differential equation\. In this paper, we use Hutchinson's trace estimator to give a scalable unbiased estimate of the log\-density\. The result is a continuous\-time invertible generative model with unbiased density estimation and one\-pass sampling, while allowing unrestricted neural network architectures\. We demonstrate our approach on high\-dimensional density estimation, image generation, and variational inference, achieving the state\-of\-the\-art among exact likelihood methods with efficient sampling\.

Similar Articles

Representation Fréchet Loss for Visual Generation

Papers with Code Trending

This paper introduces FD-loss, a method to optimize Fréchet Distance as a training objective for visual generation by decoupling population and batch sizes. It demonstrates that this approach improves generator quality and suggests FID may not always accurately reflect visual quality.