The hidden danger that kills search products
Having seen search solutions birthed (and die) since 2012, I have to warn you: there be dragons! What was a nice niche (good site search) with a meaty, but defined market (big e-commerce, job search, etc companies), now has exploded with AI and RAG. I’m often asked how to think about the “vector DB” and adjacent space by investors, product companies, and customers. There’s a range of companies: some provide components targeting developers - just the search engine / vector DB. Others sell the full solution of “good search” for your RAG, etc app. Just give us your data and set a few things up, you get great, relevant search results for your product. Or so it’s promised. I want to focus on this latter area - the temptation to “solve search” with your product, only to end up humbled by the amount of custom, per-customer work you’ll need to take on. Solution providers face a major challenge - the complete invisibility and subjectivity of “relevant search”. Customers don’t see the algorithmi
Having seen search solutions birthed (and die) since 2012, I have to warn you: there be dragons! What was a nice niche (good site search) with a meaty, but defined market (big e-commerce, job search, etc companies), now has exploded with AI and RAG. I’m often asked how to think about the “vector DB” and adjacent space by investors, product companies, and customers. There’s a range of companies: some provide components targeting developers - just the search engine / vector DB. Others sell the full solution of “good search” for your RAG, etc app. Just give us your data and set a few things up, y
saved by
related reading
- I could do that in a weekend!danluu.com
- Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
- Convictionconviction.com
- NEEDLE: The benchmark your search engine can't memorize - Keenable.aikeenable.ai
- Convictionconviction.com
- Search Wars: Episode 2 | Andreessen Horowitza16z.com
- Excuse me, is there a problem?longform.asmartbear.com
- RAG and Generative AI - Azure AI Search | Microsoft Learnlearn.microsoft.com
- Building Enterprise AI: Hard-Won Lessons from 1200+ Hours of RAG Developmentbytevagabond.com
- The Future of Search Is Boutique | Futurefuture.com
- How To Validate Product Ideas Before (And After) Building Themtraining.kalzumeus.com
- How bad are search results? Let's compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPTdanluu.com