Semantic Search Without Embeddings
When I need to stay warm, I search for “long johns” or “long underwear”. But modern outdoors clothing stores label this a “base layer”. For a waterproof jacket I search for “slickers” or a “ski jacket”, not realizing what I should search for is a “shell.” Despite my outdated terminology, search still works. I’m somehow understood and shown the right content. We call this semantic search. When you hear that, you might think embeddings. Today I want to stretch your thinking beyond. Fantasize and semanticize. Some teams wrongly assume semantic search equates to only “vector search”. You have more options, some that might better align to your domain and existing organizational skills. LLMs simplify classic ways of organizing search queries and information. Let’s contrast different approaches, and maybe you’ll see there’s another approach that might be a better fit for you. In semantic search, content and query map to a shared representation. This space has a similarity function that scores
When I need to stay warm, I search for “long johns” or “long underwear”. But modern outdoors clothing stores label this a “base layer”. For a waterproof jacket I search for “slickers” or a “ski jacket”, not realizing what I should search for is a “shell.” Despite my outdated terminology, search still works. I’m somehow understood and shown the right content. We call this semantic search . When you hear that, you might think embeddings. Today I want to stretch your thinking beyond. Fantasize and semanticize. Some teams wrongly assume semantic search equates to only “vector search”. You have mor
related reading
- Semantic Search - Sentence Transformers documentationsbert.net
- Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
- From grep to SPLADE: A Journey Through Semantic Search - Elicitblog.elicit.com
- Embeddings: What they are and why they mattersimonwillison.net
- Beyond embeddings: Navigating the shift to completions-only RAGsensible.so
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Read in smrysmry.ai
- Prism: mapping interpretable concepts and features in a latent space of language | thesephist.comthesephist.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- Training an LLM-RecSys Hybrid for Steerable Recs with Semantic IDseugeneyan.com
- Introduction to Text Embeddingstxt.cohere.com
- Our AI Research: How We Evaluate Semantic Search Technology | Exa Blogexa.ai