A friendly introduction to machine learning compilers and optimizers

[Twitter thread, Hacker News discussion]

[ Twitter thread , Hacker News discussion ] I have a confession to make. I cried during the compiler class in college. I became a machine learning engineer so that I wouldn’t have to worry about compilers. However, as I learned more about bringing ML models into production, the topic of compilers kept coming up. In many use cases, especially when running an ML model on the edge, the model’s success still depends on the hardware it runs on , which makes it important for people working with ML models in production to understand how their models are compiled and optimized to run on different hard

saved by

• Gustavo Delazeri
• Karan MJ
• Varun Shenoy
• Julian Quevedo
• Raayan Dhar
• Jianmin Chen
• Chih-Yi Lin
• Franklyn Wang
• João Araújo
• Aryan Musharaf

related reading

• Making Deep Learning go Brrrr From First Principleshorace.io
• Horace He: Building Machine Learning Systems for a Trillion Trillion Floating Point Operationsyoutube.com
• How To Scale Your Modeljax-ml.github.io
• Compilers - What Every Programmer Should Know About Compiler Optimizations | Microsoft Learnlearn.microsoft.com
• Compiling ML models to C for fun | Max Bernsteinbernsteinbear.com
• Large Language Models for Compiler Optimizationarxiv.org
• A Gentle Introduction to LLVM IR · mcyoungmcyoung.xyz
• Building a Language and Compiler for Machine Learningjulialang.org
• UW PLSE | How does torch.compile work?uwplse.org
• Lecture 117:Building a GPU Compiler from Scratchyoutube.com
• Tiny TPUtinytpu.com
• Advancements in machine learning for machine learningblog.research.google