flâneur

State of Data — Sean Cai, Independent / State of Data - YouTube

youtube.com · 3,649 words · saved by 1 readers

Follow along using the transcript. Follow along using the transcript.

GPT 5.5 and Opus 4.8 landed within three points on the same finance benchmark while failing in opposite directions. GPT got the arithmetic right. Opus got the methodology right. One leaderboard number flattened both failures into a single noisy sample, exactly what happens when benchmarks reward one scaffold and vendors sell the data used to climb the tests they designed. The scarce asset is no longer another isolated answer. It is process data: the reasoning trace, sequence of decisions, state changes, failures, recoveries, and verified outcomes that turn general competence into real…

saved by

related reading