Google’s biggest quarter ever
chamath.substack.com · 1,143 words · saved by 1 readers
A summary of the interesting content that I consumed this past week…
Continuing our weekly questions this week… How to think about the distillation and banning open source debate? Distillation means running someone else’s model at scale: you fire up someone else’s model, ask it questions, watch the answers, and use those answers to train your own model. Do that tens of millions of times and you’ve exfiltrated trillions of question-and-answer pairs. The labs frame this as industrial-scale theft that warrants government protection. I think it is a red herring. If you actually wanted to stop it, you’d KYC your customers. Force a real identity, put them…
related reading
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- Stratechery by Ben Thompson – On the business, strategy, and impact of technology.stratechery.com
- Who’s Afraid of Chinese Models? – Stratechery by Ben Thompsonstratechery.com
- How (some) Chinese AI Practitioners View Model Distillationgeopolitechs.org
- The Ai Decoupling | Vintage Datavintagedata.org
- Bernie’s bad bet on OpenAIsubstack.com
- Yiping Wang (@ypwang61) on Xx.com
- Our position on open-weights models \ Anthropicanthropic.com
- What comes next with open models - by Nathan Lambertinterconnects.ai
- Detecting and preventing distillation attacks \ Anthropicanthropic.com
- Training Imperativesdan.io
- Chamath Palihapitiya (@chamath) on Xx.com