Grok 4 Various Things — LessWrong
xAI was given a goal. They were to release something that could, ideally with a straight face, be called ‘the world’s smartest artificial intelligence.’ On that level, well, congratulations to Elon Musk and xAI. You have successfully found benchmarks that enable you to make that claim. xAI: We just unveiled Grok 4, the world’s smartest artificial intelligence. Grok 4 outperforms all other models on the ARC-AGI benchmark, scoring 15.9% – nearly double that of the next best model – and establishing itself as the most intelligent AI to date. Humanity’s Last Exam (HLE) is a rigorous intelligence benchmark featuring over 2500 problems crafted by experts in mathematics, natural sciences, engineering, and humanities. Most models score single-digit accuracy. Grok 4 and Grok 4 Heavy outperform all others. Okay, sure. Fair enough. Elon Musk prioritized being able to make this claim, and now he can make this claim sufficiently to use it to raise investment. Well played. I would currently assign t
x Grok 4 Various Things — LessWrong AI Personal Blog 52 Grok 4 Various Things by Zvi 15th Jul 2025 Don't Worry About the Vase 39 min read 4 52 Yesterday I covered a few rather important Grok incidents. Today is all about Grok 4’s capabilities and features. Is it a good model, sir? It’s not a great model. It’s not the smartest or best model. But it’s at least an okay model. Probably a ‘good’ model. Talking a Big Game xAI was given a goal. They were to release something that could, ideally with a straight face, be called ‘the world’s smartest artificial intelligence.’ On that level, well, congra
Explore this link on the map →saved by
related reading
- GPT-4openai.com
- gpt-4.pdfcdn.openai.com
- Report: xAI Business Breakdown & Founding Story | Contrary Researchresearch.contrary.com
- AI progress is about to speed up | Epoch AIepoch.ai
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- AI #77: A Few Upgrades - by Zvi Mowshowitzthezvi.substack.com
- AI in 2025: gestalt — LessWronglesswrong.com
- My picture of the present in AI — LessWronglesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Is Grok Basically Just an OpenAI Wrapper? | Hacker Newsnews.ycombinator.com
- Import AIjack-clark.net
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai