Hard Truths From the AI Trenches - Jason Liu
jxnl.github.io · 1,405 words · saved by 1 readers
A collection of hard truths from the AI trenches.
Hard Truths From the AI Trenches ¶ I never planned to become a consultant. But somewhere between building machine learning systems and growing my Twitter following, companies started sliding into my DMs with the same message: "Help, our AI isn't working." So I started charging to join their stand-ups. Sometimes I didn't even code. I just asked uncomfortable questions. Here's what I've learned watching companies burn millions on AI. Your AI problems aren't AI problems ¶ The head of AI at a major company once showed me their evaluation framework. They had 23 evals. One of them tested i
saved by
related reading
- Agentic Evals Pyramidrwilinski.ai
- Your AI Product Needs Evals – Hamel's Blog - Hamel Husainhamel.dev
- How to Build a Truly Useful AI Productevery.to
- Convictionconviction.com
- My picture of the present in AI — LessWronglesswrong.com
- Musings on Building a Generative AI Productlinkedin.com
- Convictionconviction.com
- Generative AI’s Act Two | Sequoia Capitalsequoiacap.com
- AI Design Field Guideaidesignfieldguide.com
- Things I learned at OpenAI - by Karina Nguyen - sémaphoresemaphore.substack.com
- Thoughts — Jason Weijasonwei.net
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com