What's new with ML in production | ★❤✰ Vicki Boykis ★❤✰
In 2023, I wrote two pieces on machine learning engineering for The Pragmatic Programmer. (Part 1 and Part 2). However, since I started working with LLMs recently, neural architectures have changed some of those assumptions. To be clear, most of machine learning in production is still not related to large language models or generative AI, and even deep learning projects, of which LLMs are a small subset, make up no more than 10% of the market, at most. But it’s still helpful to compare and contrast classical ML systems with their LLM counterparts, because this is where we’re going in the future. At its core, a machine learning model is an algorithm that performs compression on a corpus of data. In the first half of the 20th century, when digital communication in the then-nascent telephone industry exploded,scientists and engineers at Bell Labs started studying the projection and representation of information. In developing this field, scientists like Harry Nyquist,Ralph Hartley, and Cl
What's new with ML in production | ✰Vicki Boykis✰ What's new with ML in production Jan 15 2024 Image with some help from Dingboard. In 2023, I wrote two pieces on machine learning engineering for The Pragmatic Programmer . ( Part 1 and Part 2 ). However, since I started working with LLMs recently , neural architectures have changed some of those assumptions. To be clear, most of machine learning in production is still not related to large language models or generative AI, and even deep learning projects, of which LLMs are a small subset, make up no more than 10% of the market, at most. But it'
Explore this link on the map →related reading
- GenAI Handbookgenai-handbook.github.io
- [2309.10668] Language Modeling Is Compressionarxiv.org
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- Can gzip be a language model?nathan.rs
- AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com
- 2025: The year in LLMssimonwillison.net
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- Things we learned about LLMs in 2024simonwillison.net
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelsarxiv.org