Inside the AI Chip Race with Groq

How is Groq positioning itself in response to NVIDIA's dominance? What companies are running profitable AI inference workloads today? How are geopolitics shaping the AI compute infrastructure?

Yesterday, I hosted a Spaces with Jonathan, Sunny, and Gavin from Groq, to discuss the current landscape of AI chips and inference. You can listen to the conversation below: Timestamps and topics covered: (0:00 - 9:50) Jonathan Ross shares his journey from high school dropout to creating Google's Tensor Processing Unit (TPU), which eventually led him to found Groq. (9:50 - 14:29) How Groq tackles AI hardware challenges by focusing on compilers and specialized hardware, and how their chips balance efficiency with adaptability. (14:29 - 28:08) NVIDIA's dominance in training, its moat-like…

related reading

• The Future of AI Compute: A Conversation With Jonathan Rosschamath.substack.com
• Our chat with Groq's Chief Evangelist, Mark Heaps (Pt. 2)cerebralvalley.beehiiv.com
• Groq Inference Tokenomics: Speed, But At What Cost?semianalysis.com
• AI Chip Architecturesjacobpeake.com
• Chip design from the bottom up – Reiner Popeyoutube.com
• The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
• The chip made for the AI inference era – the Google TPUuncoveralpha.com
• The Two Harvard Dropouts Who Raised $800M to Take on NVIDIAyoutube.com
• AI Chip Architecturesjepeake.com
• Reiner Pope of MatX on accelerating AI with transformer-optimized chipscheekypint.substack.com
• Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
• Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaperyoutube.com