Embeddings: What they are and why they matter

If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023. This article represents an improved version of that talk, which should stand alone even without watching the video. If you’re not yet familiar with embeddings I hope to give you everything you need to get started applying them to real-world problems. In this article: Here’s a video of the talk that I gave at PyBay: The audio quality of the official video wasn’t great due to an issue with the microphone, but I ran that audio through Adobe’s Enhance Speech tool and uploaded my own video with the enhanced audio to YouTube. Embeddings are a technology that’s adjacent to the wider field of Large Language Models—the technology behind ChatGPT and Bard and Claude. Embeddings are based around one trick: take a piece of content—in this case a blog entry—and turn that piece of content into an array of floating

Embeddings: What they are and why they matter Simon Willison’s Weblog Subscribe Sponsored by: Microsoft - Agent projects stall between demo and production. Microsoft's MVP checklist closes that gap. Try it Embeddings: What they are and why they matter 23rd October 2023 Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023 . This article represents an improved version of

saved by

• Wei Chun Tan

related reading

• Vector embeddings | OpenAI APIplatform.openai.com
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Introducing text and code embeddings | OpenAIopenai.com
• Vector embeddings | OpenAI APIdevelopers.openai.com
• Meet AI’s multitool: Vector embeddings | Google Cloud Blogcloud.google.com
• Sentence Embeddings. Introduction to Sentence Embeddings – hackerllamaosanseviero.github.io
• Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
• Leveraging Vector Embeddings and Similarity Search to Supplement ChatGPT’s Training Data - DEV Communitydev.to
• The Illustrated Word2vec – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• An intuitive introduction to text embeddings - Stack Overflowstackoverflow.blog
• An intuitive introduction to text embeddings - Stack Overflowstackoverflow.blog
• Semantic Search - Sentence Transformers documentationsbert.net