What Will Transformers Transform? – Rodney Brooks
Generative Pre-trained Transformer models (GPTs) are now all the rage and have inspired op-eds being written by everyone from Henry Kissinger (WSJ) to Noam Chomsky (NYTimes) in just the last month. That sure is some hype level. Way back in the early history of GPTs, January 1st this year, I wrote briefly about them and said: Calm down people. We neither have super powerful AI around the corner, nor the end of the world caused by AI about to come down upon us. I stick with that advice, but in this post I want to say why, and talk about where these systems will have impact. In short, there will be valuable tools produced, and at the same time lots of damaging misuse. What triggers me to write here in more detail is both the continued hype, and the release of GPT-4 during the week of March 13th, and the posting of the “GPT-4 Technical Report” by many hundreds of authors at OpenAI. [[The linked PDF is 98 pages long and contains two papers, one titled “GPT-4 Technical Report” that fills the
Generative Pre-trained Transformer models (GPTs) are now all the rage and have inspired op-eds being written by everyone from Henry Kissinger (WSJ) to Noam Chomsky (NYTimes) in just the last month. That sure is some hype level. Way back in the early history of GPTs, January 1 st this year, I wrote briefly about them and said: Calm down people. We neither have super powerful AI around the corner, nor the end of the world caused by AI about to come down upon us. I stick with that advice, but in this post I want to say why, and talk about where these systems will have impact. In short, there will
Explore this link on the map →related reading
- gpt-4.pdfcdn.openai.com
- GPT-4openai.com
- Simulators — LessWronglesswrong.com
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
- ChatGPT Is Dumber Than You Think - The Atlantictheatlantic.com
- gpt-4-system-card.pdfcdn.openai.com
- GPT-3 - Wikipediaen.wikipedia.org
- AI #77: A Few Upgrades - by Zvi Mowshowitzthezvi.substack.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- Cyborgism — LessWronglesswrong.com
- Want to predict/explain/control the output of GPT-4? Then learn about the world, not about transformers. — LessWronglesswrong.com