AI founders will learn the bitter lesson | Hacker News
No matter how good the AI gets, it can't answer about what it doesn't know. It can't perform a process for which it doesn't know the steps or the rules. No LLM is going to know enough about some new drug in a pharma's pipeline, for example, because it doesn't know about the internal resources spread across multiple systems in an enterprise. (And if you've ever done a systems integration in any sufficiently large enterprise, you know that this is a "people problem" and usually not a technical problem). I think the startups that succeed will understand that it all comes down to classic ETL: identify the source data, understand how to navigate systems integration, pre-process and organize the knowledge, train or fine-tune a model or have the right retrieval model to provide the context. There's fundamentally no other way. AI is not magic; it can't know about trial ID 1354.006 except for what it was trained on and what it can search for. Even coding assistants like Cursor are really solvin
AI founders will learn the bitter lesson | Hacker News Hacker News new | past | comments | ask | show | jobs | submit login AI founders will learn the bitter lesson ( lukaspetersson.com ) 337 points by gsky on Jan 12, 2025 | hide | past | favorite | 263 comments CharlieDigital on Jan 12, 2025 | next [–] There's only one core problem in AI worth solving for most startups building AI powered software: context. No matter how good the AI gets, it can't answer about what it doesn't know. It can't perform a process for which it doesn't know the steps or the rules. No LLM is going to know enough abou
Explore this link on the map →related reading
- Convictionconviction.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Convictionconviction.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
- My picture of the present in AI — LessWronglesswrong.com
- Things I Don't Know About AI - by Elad Gil - Elad Blogblog.eladgil.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com
- AI progress is about to speed up | Epoch AIepoch.ai
- 35 Thoughts About AGI and 1 About GPT-5 - by Steve Newmansecondthoughts.ai