[2606.14334] Riemannian Metric Matching for Scalable Geometric Modeling of Distributions
Abstract:High-dimensional datasets often concentrate near low-dimensional structures, but estimating their geometry from samples typically relies on graphs and kernels that scale poorly with dataset size and dimension. We propose Riemannian metric matching: a denoising probabilistic framework for learning the Riemannian geometry of data using neural networks. Specifically, we learn the carré du champ operator, which, using diffusion geometry, gives us access to the Riemannian geometry toolkit for downstream machine learning and statistical tasks. Our key observation is that the carré du champ operator can be formulated as a conditional expectation over random perturbations of the data, which can be exploited for sample-wise training and constant cost, amortized inference without explicit kernel construction. Empirically, metric matching rivals or improves the accuracy of $k$-NN-based diffusion geometry estimators, while enabling amortized inference that is up to $400\times$ faster, and supports graph-free geometric analysis on high-dimensional images where nearest neighbors break down.
View PDF HTML (experimental) Abstract:High-dimensional datasets often concentrate near low-dimensional structures, but estimating their geometry from samples typically relies on graphs and kernels that scale poorly with dataset size and dimension. We propose Riemannian metric matching: a denoising probabilistic framework for learning the Riemannian geometry of data using neural networks. Specifically, we learn the carré du champ operator, which, using diffusion geometry, gives us access to the Riemannian geometry toolkit for downstream machine learning and statistical tasks. Our key…
saved by
related reading
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- Modular Manifolds - Thinking Machines Labthinkingmachines.ai
- Neural Manifold Ordinary Differential Equationsarxiv.org
- Denoising Density Estimatorsarxiv.org
- Deep Energy Estimator.pdfarxiv.org
- Regularized by Score Matching (LeCun)papers.nips.cc
- [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
- [2604.04891] Muon Dynamics as a Spectral Wasserstein Flowarxiv.org
- [2010.02502] Denoising Diffusion Implicit Modelsarxiv.org
- Learning the integral of a diffusion model – Sander Dielemansander.ai
- Diffusion Meets Flow Matchingdiffusionflow.github.io
- Sliced Score Matching: A Scalable Approach to Density and Score Estimation | Yang Songyang-song.github.io