✳flâneur — a map of the web's best reading
GraphGPS: Navigating Graph Transformers | by Michael Galkin | Towards Data Science
towardsdatascience.com · 3,218 words · saved by 1 readers
Recipes for cooking the best graph transformers
GraphGPS: Navigating Graph Transformers | Towards Data Science Skip to content Artificial Intelligence GraphGPS: Navigating Graph Transformers Recipes for cooking the best graph transformers Michael Galkin Jun 14, 2022 15 min read Share Recent Advances in Graph ML In 2021, graph transformers (GT) won recent molecular property prediction challenges thanks to alleviating many issues pertaining to vanilla message passing GNNs. Here, we try to organize numerous freshly developed GT models into a single GraphGPS framework to enable general, powerful, and scalable graph transformers with linear comp
Explore this link on the map →related reading
- [2205.12454] Recipe for a General, Powerful, Scalable Graph Transformerarxiv.org
- A Gentle Introduction to Graph Neural Networksdistill.pub
- Beyond Message Passing: a Physics-Inspired Paradigm for Graph Neural Networksthegradient.pub
- Understanding Convolutions on Graphsdistill.pub
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
- Transformers from Scratche2eml.school
- geometricdeeplearning.com/book/graphs.htmlgeometricdeeplearning.com
- The Annotated Transformernlp.seas.harvard.edu
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- Graph Convolutional Networks | Thomas Kipf | Google DeepMindtkipf.github.io
- transformer_attention.pdfarxiv.org