[2402.14730] Clifford-Steerable Convolutional Neural Networks
Abstract:We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance, $\mathrm{E}(3)$-equivariance on $\mathbb{R}^3$ and Poincaré-equivariance on Minkowski spacetime $\mathbb{R}^{1,3}$. Our approach is based on an implicit parametrization of $\mathrm{O}(p,q)$-steerable kernels via Clifford group equivariant neural networks. We significantly and consistently outperform baseline methods on fluid dynamics as well as relativistic electrodynamics forecasting tasks.
View PDF HTML (experimental) Abstract:We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance, $\mathrm{E}(3)$-equivariance on $\mathbb{R}^3$ and Poincaré-equivariance on Minkowski spacetime $\mathbb{R}^{1,3}$. Our approach is based on an implicit parametrization of $\mathrm{O}(p,q)$-steerable kernels via Clifford group equivariant neural networks. We significantly and consistently outperform baseline methods on fluid…
saved by
related reading
- 1802.08219arxiv.org
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- Naturally Occurring Equivariance in Neural Networksdistill.pub
- 10. Equivariant Neural Networks — deep learning for molecules & materialsdmol.pub
- Scale-invariant-CNNs/docs/Report/Implementation.md at master · ruoqizzz/Scale-invariant-CNNsgithub.com
- Verifying your browser | OpenReviewopenreview.net
- Convolutional Neural Networks, Explained | Towards Data Sciencetowardsdatascience.com
- Modeling Symmetries | Mark Neumannmarkneumann.xyz
- proceedings.mlr.press/v202/ma23a/ma23a.pdfproceedings.mlr.press
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- [2404.19756] KAN: Kolmogorov-Arnold Networksarxiv.org
- David Duvenaudcs.toronto.edu