✳flâneur — a map of the web's best reading

Sam Altman Wants $7 Trillion - by Scott Alexander

astralcodexten.com · 2,082 words · saved by 1 readers

[All numbers here are very rough and presented in a sloppy way. For the more rigorous versions of this, read Tom Davidson, Yafah Edelman, and EpochAI) I. Sam Altman wants $7 trillion. In one sense, this isn’t news. Everyone wants $7 trillion. I want $7 trillion. I’m not going to get it, and Sam Altman probably won’t either. Still, the media treats this as worthy of comment, and I agree. It’s a useful reminder of what it will take for AI to scale in the coming years. The basic logic: GPT-1 cost approximately nothing to train. GPT-2 cost $40,000. GPT-3 cost $4 million. GPT-4 cost $100 million. Details about GPT-5 are still secret, but one extremely unreliable estimate says $2.5 billion, and this seems the right order of magnitude given the $8 billion that Microsoft gave OpenAI. So each GPT costs between 25x and 100x the last one. Let’s say 30x on average. That means we can expect GPT-6 to cost $75 billion, and GPT-7 to cost $2 trillion. (Unless they slap the name “GPT-6” on a model that

Sam Altman Wants $7 Trillion Machine Alignment Monday 2/12/24 Scott Alexander Feb 13, 2024 248 415 13 Share [All numbers here are very rough and presented in a sloppy way. For the more rigorous versions of this, read Tom Davidson , Yafah Edelman , and EpochAI ) I. Sam Altman wants $7 trillion . In one sense, this isn’t news. Everyone wants $7 trillion. I want $7 trillion. I’m not going to get it, and Sam Altman probably won’t either. Still, the media treats this as worthy of comment, and I agree. It’s a useful reminder of what it will take for AI to scale in the coming years. The basic logic:

Explore this link on the map →

related reading