[2606.14334] Riemannian Metric Matching for Scalable Geometric Modeling of Distributions
Abstract:High-dimensional datasets often concentrate near low-dimensional structures, but estimating their geometry from samples typically relies on graphs and kernels that scale poorly with dataset size and dimension. We propose Riemannian metric matching: a denoising probabilistic framework for learning the Riemannian geometry of data using neural networks. Specifically, we learn the carré du champ operator, which, using diffusion geometry, gives us access to the Riemannian geometry toolkit for downstream machine learning and statistical tasks. Our key observation is that the carré du champ operator can be formulated as a conditional expectation over random perturbations of the data, which can be exploited for sample-wise training and constant cost, amortized inference without explicit kernel construction. Empirically, metric matching rivals or improves the accuracy of $k$-NN-based diffusion geometry estimators, while enabling amortized inference that is up to $400\times$ faster, and supports graph-free geometric analysis on high-dimensional images where nearest neighbors break down.
View PDF HTML (experimental) Abstract:High-dimensional datasets often concentrate near low-dimensional structures, but estimating their geometry from samples typically relies on graphs and kernels that scale poorly with dataset size and dimension. We propose Riemannian metric matching: a denoising probabilistic framework for learning the Riemannian geometry of data using neural networks. Specifically, we learn the carré du champ operator, which, using diffusion geometry, gives us access to the Riemannian geometry toolkit for downstream machine learning and statistical tasks. Our key…
saved by
related reading
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- Diffusion Meets Flow Matchingdiffusionflow.github.io
- Regularized by Score Matching (LeCun)papers.nips.cc
- David Duvenaudcs.toronto.edu
- arxiv.org/pdf/2511.08544arxiv.org
- Yang Songyang-song.net
- Beyond Message Passing: a Physics-Inspired Paradigm for Graph Neural Networksthegradient.pub
- Gregory Gundersengregorygundersen.com
- Neural Manifold Ordinary Differential Equationsarxiv.org
- Sliced Score Matching: A Scalable Approach to Density and Score Estimation | Yang Songyang-song.github.io
- Diffusion models from scratchchenyang.co
- Deep Energy Estimator.pdfarxiv.org