Semantic Search — Sentence Transformers documentation
Semantic search seeks to improve search accuracy by understanding the semantic meaning of the search query and the corpus to search over. Semantic search can also perform well given synonyms, abbreviations, and misspellings, unlike keyword search engines that can only find documents based on lexical matches. The idea behind semantic search is to embed all entries in your corpus, whether they be sentences, paragraphs, or documents, into a vector space. At search time, the query is embedded into the same vector space and the closest embeddings from your corpus are found. These entries should have a high semantic similarity with the query. A critical distinction for your setup is symmetric vs. asymmetric semantic search: For symmetric semantic search your query and the entries in your corpus are of about the same length and have the same amount of content. An example would be searching for similar questions: Your query could for example be “How to learn Python online?” and you want to fin
Semantic Search - Sentence Transformers documentation Usage Semantic Search Edit on GitHub Semantic Search Semantic search seeks to improve search accuracy by understanding the semantic meaning of the search query and the corpus to search over. Semantic search can also perform well given synonyms, abbreviations, and misspellings, unlike keyword search engines that can only find documents based on lexical matches. Background The idea behind semantic search is to embed all entries in your corpus, whether they be sentences, paragraphs, or documents, into a vector space. At search time, the qu
saved by
related reading
- Transformers from Scratche2eml.school
- Semantic Search Without Embeddingssoftwaredoug.com
- Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
- From grep to SPLADE: A Journey Through Semantic Search - Elicitblog.elicit.com
- Sentence Embeddings. Introduction to Sentence Embeddings – hackerllamaosanseviero.github.io
- Comparison of different Word Embeddings on Text Similarity — A use case in NLP | by Intellica.AI | Mediumintellica-ai.medium.com
- Training and Finetuning Reranker Models with Sentence Transformershuggingface.co
- Improving document retrieval with sparse semantic encoders - OpenSearchopensearch.org
- Retrieval | OpenAI APIplatform.openai.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Semantic Word Embeddingsoffconvex.org
- Announcing ScaNN: Efficient Vector Similarity Searchai.googleblog.com