AI's Hardware Problem - by Jon Y
If you want to watch the video first, it is below: I worked on this video long before ChatGPT blew up the world so it had yet to come to my attention. But since then, AI has become a way bigger deal. I have been thinking of a good follow up to it. Got any suggestions? Reply to this email or shoot me an email at jon@asianometry.com
If you want to watch the video first, it is below: I worked on this video long before ChatGPT blew up the world so it had yet to come to my attention. But since then, AI has become a way bigger deal. I have been thinking of a good follow up to it. Got any suggestions? Reply to this email or shoot me an email at jon@asianometry.com Recently, I was listening to a podcast interview with OpenAI chief scientist Ilya Sutskever and one of those things that I found interesting was that he doesn’t think that hardware compute is a limitation for AI research. He also touches on the concepts…
related reading
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- Why AGI Will Not Happen - Tim Dettmerstimdettmers.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- 2403.14123arxiv.org
- My picture of the present in AI — LessWronglesswrong.com
- Memory bandwidth constraints imply economies of scale in AI inference — LessWronglesswrong.com
- Majestic Labsmajestic-labs.ai
- Memory makes computation universal, remember?thinks.lol
- 2009.06489arxiv.org
- Ushering in the Thermodynamic Future | Extropicextropic.ai
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- The Moon Should Be a Computerpalladiummag.com