Hardware for Transformative AI - LessWrong
I recently saw A breakdown of AI Chip companies linked on LessWrong. I thought it was interesting, and it inspired me to add my 2 cents on what AI chips might be used in the case of transformative AI…
x Hardware for Transformative AI — LessWrong AI World Modeling Frontpage 17 Hardware for Transformative AI by MrThink 22nd Jun 2021 3 min read 7 17 I recently saw A breakdown of AI Chip companies linked on LessWrong. I thought it was interesting, and it inspired me to add my 2 cents on what AI chips might be used in the case of transformative AI in the relatively near future. Background Undoubtedly Nvidia is the leader when it comes to AI chips, by far Nvidia GPUs are the most common way of training large neural nets. For example GPT-3 was trained on Nvidia V100 GPUs. According to A breakdown
Explore this link on the map →related reading
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- How To Scale Your Modeljax-ml.github.io
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- My picture of the present in AI — LessWronglesswrong.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Can AI scaling continue through 2030? | Epoch AIepoch.ai
- Transformer Math 101 | EleutherAI Blogblog.eleuther.ai
- AI Is Slowing Downwheresyoured.at
- Compute Forecast — AI 2027ai-2027.com
- How much does it cost to train frontier AI models? | Epoch AIepoch.ai