Geometry-Aware Image Flow Matching

Hugging Face Daily Papers Papers

Summary

This paper introduces geometry-aware flow matching for natural images by treating them as points on a hypersphere, proposing SOT-CFM and SFM methods that improve generative modeling by leveraging the spherical structure of image data.

Recent advances in generative models highlight the power of geometry-aware modeling in manifold-constrained settings. Yet, for natural images, the field remains confined to Euclidean assumptions, failing to exploit the potential of intrinsic geometric structures within the data. In this work, we investigate the geometry of natural images and observe that semantic information is predominantly encoded in directional components, while norm components can be approximated by the global average. This property holds across both RGB and latent spaces, suggesting that natural images can be effectively modeled on a hypersphere. Building on this finding, we introduce Spherical Optimal Transport Flow Matching (SOT-CFM), which utilizes angular distance, and Spherical Flow Matching (SFM), which constrains dynamics directly on the manifold. Our experiments demonstrate that these geometry-aware methods achieve superior performance against Euclidean baselines. Ultimately, this work provides a novel perspective that bridges the gap between Riemannian manifold-based modeling and natural image generation.
Original Article
View Cached Full Text

Cached at: 05/26/26, 02:41 AM

Paper page - Geometry-Aware Image Flow Matching

Source: https://huggingface.co/papers/2605.25294 TL;DR: Natural images live on a hypersphere — and treating them that way improves flow matching. Geometry-aware generative modeling has worked well on known manifolds (molecules, crystals, proteins), but natural images have stayed stuck in Euclidean space because nobody knew what manifold they lived on.

We show a surprisingly simple answer: their semantic content is almost entirely in the direction, not the norm. Projecting images (both RGB and VAE latents) onto a sphere of the dataset’s mean radius leaves them perceptually indistinguishable from the originals.

Building on this, we propose SOT-CFM (angular OT cost) and SFM (fully Riemannian flow matching on the sphere). SFM is, to our knowledge, the first successful application of a fully manifold-based generative framework to large-scale natural images.

Similar Articles

MeshFlow: Mesh Generation with Equivariant Flow Matching

Hugging Face Daily Papers

MeshFlow introduces an equivariant optimal-transport flow matching model for direct triangle mesh generation, achieving state-of-the-art quality while providing approximately 18x inference speedup over autoregressive methods.

Language Modeling with Hyperspherical Flows

arXiv cs.LG

This paper introduces S-FLM, a novel flow-based language model that operates in a hyperspherical latent space to address the computational costs and semantic limitations of existing discrete diffusion and continuous flow models.