Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifolds

Generative AI & LLMs
Published: arXiv: 2510.21608v1
Authors

Oscar Davis Michael S. Albergo Nicholas M. Boffi Michael M. Bronstein Avishek Joey Bose

Abstract

Geometric data and purpose-built generative models on them have become ubiquitous in high-impact deep learning application domains, ranging from protein backbone generation and computational chemistry to geospatial data. Current geometric generative models remain computationally expensive at inference -- requiring many steps of complex numerical simulation -- as they are derived from dynamical measure transport frameworks such as diffusion and flow-matching on Riemannian manifolds. In this paper, we propose Generalised Flow Maps (GFM), a new class of few-step generative models that generalises the Flow Map framework in Euclidean spaces to arbitrary Riemannian manifolds. We instantiate GFMs with three self-distillation-based training methods: Generalised Lagrangian Flow Maps, Generalised Eulerian Flow Maps, and Generalised Progressive Flow Maps. We theoretically show that GFMs, under specific design decisions, unify and elevate existing Euclidean few-step generative models, such as consistency models, shortcut models, and meanflows, to the Riemannian setting. We benchmark GFMs against other geometric generative models on a suite of geometric datasets, including geospatial data, RNA torsion angles, and hyperbolic manifolds, and achieve state-of-the-art sample quality for single- and few-step evaluations, and superior or competitive log-likelihoods using the implicit probability flow.

Paper Summary

Problem
The main problem this research addresses is the high computational cost of inference in geometric generative models. These models, which are used in various high-impact applications like protein backbone generation and computational chemistry, require many steps of complex numerical simulation to generate high-quality samples. This makes them computationally expensive and limits their scalability.
Key Innovation
The key innovation in this research is the development of Generalised Flow Maps (GFM), a new class of few-step generative models that can perform inference on arbitrary Riemannian manifolds. GFM generalises the Flow Map framework, which is commonly used in Euclidean spaces, to geometric settings. This allows for the creation of more efficient and scalable geometric generative models.
Practical Impact
This research has the potential to significantly impact various high-impact applications that rely on geometric generative models. By reducing the computational cost of inference, GFM can enable faster and more efficient generation of high-quality samples. This can lead to breakthroughs in fields like protein design, material science, and geospatial analysis.
Analogy / Intuitive Explanation
Imagine you're trying to navigate a complex maze. Traditional geometric generative models are like trying to find the shortest path through the maze by simulating many steps and calculating the distance at each step. GFM is like having a map that shows you the shortest path directly, allowing you to navigate the maze much faster and more efficiently. Let me know if this summary meets your expectations.
Paper Information
Categories:
cs.LG
Published Date:

arXiv ID:

2510.21608v1

Quick Actions