✳flâneur — a map of the web's best reading

How AI evals are changing product management

manialabs.substack.com · 2,866 words · saved by 1 readers

The last time there was a seminal change in product management was 2008. Analytics defined a new generation of product leaders and those who didn’t embrace it were left behind. We can learn much from that era about exactly how AI evals will change the PM craft today. The launch of Apple’s app store and 3rd party apps on Facebook gave birth to thousands of high growth startups and a new skill set for PMs - product analytics. The birth of the growth hacking movement was seeded by the very first examples of cohorted retention analysis and AARRR metric frameworks. At first, the top PMs and growth hackers were those who learnt some SQL. By 2012, Facebook’s famous 7-friends-in-10-days heuristic was driving the adoption of new self-serve analytics tools for PMs like Amplitude. Today, no good product team would be caught without north star metrics. Every job-to-be-done shipped has adoption goals. Every UX funnel of behavioral events has its drop offs dissected. AI products haven’t changed the

AI evals are changing the PM craft And SaaS product leaders need to plan ahead Sandhya Hegde and Justin Bauer Nov 13, 2025 40 3 2 Share The last time there was a seminal change in product management was 2008. Analytics defined a new generation of product leaders and those who didn’t embrace it were left behind. We can learn much from that era about exactly how AI evals will change the PM craft today. The launch of Apple’s app store and 3rd party apps on Facebook gave birth to thousands of high growth startups and a new skill set for PMs - product analytics. The birth of the growth hacking move

Explore this link on the map →

saved by

related reading