The Future of Compute: NVIDIA's Crown is Slipping
mohitdagarwal.substack.com · 5,792 words · saved by 1 readers
Demand consolidation, changing compute mix, custom silicon, and distributed training will hurt NVIDIA's pole position.
The Future of Compute: NVIDIA's Crown is Slipping Demand consolidation, changing compute mix, custom silicon, and distributed training will hurt NVIDIA's pole position. Mohit Agarwal Oct 25, 2024 118 12 Share Jensen Huang delivering the world's first DGX-1 server to OpenAI in 2016. Credit: Tom’s Hardware No one has benefitted from the scaling hypothesis quite like NVIDIA. On the back of an AI boom and GPU monopoly , they’ve become the fastest scaling hardware company in history–adding $2T of value in 13 months with SaaS-like margins . While the H100 generation likely represents peak pricing po
related reading
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- The Future of Compute: NVIDIA's Crown is Slippingmohitdagarwal.substack.com
- Nvidia Envy: understanding the GPU gold rushblog.johnluttig.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️gpus.llm-utils.org
- AI Chip Architecturesjacobpeake.com
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- Computational Power and AI - AI Now Instituteainowinstitute.org
- AI Chip Owners Documentation – Methodology | Epoch AIepoch.ai
- Multi-Datacenter Training: OpenAI's Ambitious Plan To Beat Google's Infrastructuresemianalysis.com
- Nvidia’s Plans To Crush Competition – B100, “X100”, H200, 224G SerDes, OCS, CPO, PCIe 7.0, HBM3Esemianalysis.com
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io