Text Embeddings Visually Explained
We take a visual approach to gain an intuition behind text embeddings, what use cases they are good for, and how they can be customized using finetuning.
When you hear about large language models (LLMs), probably the first thing that comes to mind is the text generation capability, such as writing an essay or creating marketing copy. Another thing you can get is text representation: a set of numbers that represent what the text means and capture the semantics of the text. These numbers are called text embeddings. Text generation outputs text, while text representation outputs embeddings Text embeddings give you the ability to turn unstructured text data into a structured form. With embeddings, you can compare two or more pieces of text, be…
saved by
related reading
- Embeddings: What they are and why they mattersimonwillison.net
- Introducing text and code embeddings | OpenAIopenai.com
- Vector embeddings | OpenAI APIdevelopers.openai.com
- Comparison of different Word Embeddings on Text Similarity — A use case in NLP | by Intellica.AI | Mediumintellica-ai.medium.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Word Embeddingslena-voita.github.io
- Vector embeddings | OpenAI APIplatform.openai.com
- An intuitive introduction to text embeddings - Stack Overflowstackoverflow.blog
- An intuitive introduction to text embeddings - Stack Overflowstackoverflow.blog
- The Illustrated Word2vec – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
- Sentence Embeddings. Introduction to Sentence Embeddings – hackerllamaosanseviero.github.io
- Meet AI’s multitool: Vector embeddings | Google Cloud Blogcloud.google.com