flâneur

How to reason from first principles – Casey Handmer's blog

caseyhandmer.wordpress.com · 1,568 words · saved by 4 readers

This post is a follow up on my general questions on AI post, and expands on ideas I published here and here in the ancient times. Every time one of the labs releases an updated model I give it a thorough shakedown on physics, in the style of the oral examination that is still used in Europe and a few other places. Claude, Grok, Gemini, and GPT are all advancing by leaps and bounds on a wide variety of evals, some of which include rather advanced or technical questions in both math and science, including Physics Olympiad-style problems, or grad school qualifying exams. And yet, none of these models would be able to pass the physicist Turing test. It’s not even a matter of knowledge, I know of reasonably talented middle schoolers with no specialized physics training who could reason and infer on some of these basic questions in a much more fluent and intuitive way. For context, I competed in the IPhO in 2005, and still have a copy of my notes (they are short, rough, and not 100% accurate

This post is a follow up on my general questions on AI post , and expands on ideas I published here and here in the ancient times. Every time one of the labs releases an updated model I give it a thorough shakedown on physics, in the style of the oral examination that is still used in Europe and a few other places. Claude, Grok, Gemini, and GPT are all advancing by leaps and bounds on a wide variety of evals, some of which include rather advanced or technical questions in both math and science, including Physics Olympiad-style problems , or grad school qualifying exams . And yet, none of these

saved by

related reading