✳flâneur — a map of the web's best reading
Machine learning is going real-time
huyenchip.com · 4,357 words · saved by 1 readers
[Twitter thread]
[ Twitter thread ] For a follow up of this post, see Real-time machine learning: challenges and solutions (2022). After talking to machine learning and infrastructure engineers at major Internet companies across the US, Europe, and China, I noticed two groups of companies. One group has made significant investments (hundreds of millions of dollars) into infrastructure to allow real-time machine learning and has already seen returns on their investments. Another group still wonders if there’s value in real-time ML. There seems to be little consensus on what real-time ML means, and there hasn’t
Explore this link on the map →related reading
- Real-time machine learning: challenges and solutionshuyenchip.com
- Introduction to streaming for data scientistshuyenchip.com
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- Improving Composer through real-time RL · Cursorcursor.com
- The Little Book of Deep Learningfleuret.org
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- Anatomy of a Modern Finetuning APIbenanderson.work
- Reiner Pope – The math behind how LLMs are trained and serveddwarkesh.com
- The Continual Learning Problemjessylin.com
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- What's new with ML in production | ✰Vicki Boykis✰vickiboykis.com
- 静水铭室 Silent Water and Curved Mountainliuliu.me