GPT-4's Secret Has Been Revealed - by Alberto Romero
thealgorithmicbridge.substack.com · 366 words · saved by 1 readers
Unraveling OpenAI's masterful ploy
GPT-4 was the most anticipated AI model in history. Yet when OpenAI released it in March they didn’t tell us anything about its size, data, internal structure, or how they trained and built it. A true black box. As it turns out, they didn’t conceal those critical details because the model was too innovative or the architecture too moat-y to share. The opposite seems to be true if we’re to believe the latest rumors: GPT-4 is, technically and scientifically speaking, hardly a breakthrough. That’s not necessarily bad—GPT-4 is, after all, the best language model in existence—just… somewhat…
related reading
- GPT-4openai.com
- gpt-4.pdfcdn.openai.com
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- Shocking leak details the intricate mind behind OpenAI and ChatGPT - Notebookcheck Newsnotebookcheck.net
- GPT-4: We Are in a Major Technological Changejnd.org
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- Non-determinism in GPT-4 is caused by Sparse MoE - 152334H152334h.github.io
- gpt-4-system-card.pdfcdn.openai.com
- Pre-training isn't dead, it’s just restingtmychow.substack.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- Why didn't DeepMind build GPT3?rootnodes.substack.com
- How AI Is Learning to Think in Secretnickandresen.substack.com