flâneur — a map of the web's best reading

Grok 4 Various Things — LessWrong

lesswrong.com · 9,553 words · saved by 1 readers

xAI was given a goal. They were to release something that could, ideally with a straight face, be called ‘the world’s smartest artificial intelligence.’ On that level, well, congratulations to Elon Musk and xAI. You have successfully found benchmarks that enable you to make that claim. xAI: We just unveiled Grok 4, the world’s smartest artificial intelligence. Grok 4 outperforms all other models on the ARC-AGI benchmark, scoring 15.9% – nearly double that of the next best model – and establishing itself as the most intelligent AI to date. Humanity’s Last Exam (HLE) is a rigorous intelligence benchmark featuring over 2500 problems crafted by experts in mathematics, natural sciences, engineering, and humanities. Most models score single-digit accuracy. Grok 4 and Grok 4 Heavy outperform all others. Okay, sure. Fair enough. Elon Musk prioritized being able to make this claim, and now he can make this claim sufficiently to use it to raise investment. Well played. I would currently assign t

x Grok 4 Various Things — LessWrong AI Personal Blog 52 Grok 4 Various Things by Zvi 15th Jul 2025 Don't Worry About the Vase 39 min read 4 52 Yesterday I covered a few rather important Grok incidents. Today is all about Grok 4’s capabilities and features. Is it a good model, sir? It’s not a great model. It’s not the smartest or best model. But it’s at least an okay model. Probably a ‘good’ model. Talking a Big Game xAI was given a goal. They were to release something that could, ideally with a straight face, be called ‘the world’s smartest artificial intelligence.’ On that level, well, congra

Explore this link on the map →

saved by

related reading