Compute Trends Across Three Eras of Machine Learning – Epoch AI

epochai.org · 2,243 words · saved by 1 readers

We’ve compiled a dataset of the training compute for over 120 machine learning models, highlighting novel trends and insights into the development of AI since 1952, and what to expect going forward.

Compute trends across three eras of machine learning | Epoch AI Summary: We have collected a dataset and analysed key trends in the training compute of machine learning models since 1950. We identify three major eras of training compute - the pre-Deep Learning Era, the Deep Learning Era, and the Large-Scale Era. Furthermore, we find that the training compute has grown by a factor of 10 billion since 2010, with a doubling rate of around 5-6 months. See our recent paper, Compute Trends Across Three Eras of Machine Learning , for more details. Introduction It is well known that progress in machin

Compute Trends Across Three Eras of Machine Learning – Epoch AI

related reading