The State of ML in 2023 – Non_Interactive – Software & ML
I’ve been trying to figure out how to best write this article for most of the last year. Today, I’ve decided to just write down something, rather than continue trying to wordsmith exactly what I mean. I am tremendously excited by everything that is going on in ML right now. The breadth of the problem space to which we can apply generalist learning techniques seems virtually unbounded, and every time we scale something up, we see new capabilities start to emerge. With all that being said, I think it’s worth considering from time to time what we haven’t achieved. Lets take a quick tour or the current state of the art: The image space I know quite well. With DALL-E 3, we cracked spelling (most of the time), which was a major capability gap of text-to-image models when compared to humans. We still have a lot of problems. These models can’t tell left from right, can’t count past three, and still have a hard time getting pose and positions of body parts right. We still have to take hacky app
I’ve been trying to figure out how to best write this article for most of the last year. Today, I’ve decided to just write down something , rather than continue trying to wordsmith exactly what I mean. I am tremendously excited by everything that is going on in ML right now. The breadth of the problem space to which we can apply generalist learning techniques seems virtually unbounded, and every time we scale something up, we see new capabilities start to emerge. With all that being said, I think it’s worth considering from time to time what we haven’t achieved. Lets ta
Explore this link on the map →related reading
- GPT-4openai.com
- ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
- The Scaling Hypothesis · Gwern.netgwern.net
- gpt-4.pdfcdn.openai.com
- larger language models may disappoint you [or, an eternally unfinished draft] — LessWronglesswrong.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- GenAI Handbookgenai-handbook.github.io
- AI progress is about to speed up | Epoch AIepoch.ai
- The Future of Everything is Lies, I Guessaphyr.com
- A Primer on Generative AI (GenAI) - by Arun Raohashcollision.substack.com
- Things we learned about LLMs in 2024simonwillison.net
- Artificial General Intelligence Is Already Herenoemamag.com