Embeddings: What they are and why they matter

If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023. This article represents an improved version of that talk, which should stand alone even without watching the video. If you’re not yet familiar with embeddings I hope to give you everything you need to get started applying them to real-world problems. In this article: Here’s a video of the talk that I gave at PyBay: The audio quality of the official video wasn’t great due to an issue with the microphone, but I ran that audio through Adobe’s Enhance Speech tool and uploaded my own video with the enhanced audio to YouTube. Embeddings are a technology that’s adjacent to the wider field of Large Language Models—the technology behind ChatGPT and Bard and Claude. Embeddings are based around one trick: take a piece of content—in this case a blog entry—and turn that piece of content into an array of floating

Embeddings: What they are and why they matter Simon Willison’s Weblog Subscribe Sponsored by: Microsoft - Agent projects stall between demo and production. Microsoft's MVP checklist closes that gap. Try it Embeddings: What they are and why they matter 23rd October 2023 Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023 . This article represents an improved version of

saved by

• William S
• Wei Chun Tan

related reading

• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Vector embeddings | OpenAI APIplatform.openai.com
• Introducing text and code embeddings | OpenAIopenai.com
• Vector embeddings | OpenAI APIdevelopers.openai.com
• Meet AI’s multitool: Vector embeddings | Google Cloud Blogcloud.google.com
• Sentence Embeddings. Introduction to Sentence Embeddings – hackerllamaosanseviero.github.io
• Introduction to Text Embeddingstxt.cohere.com
• Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
• The Illustrated Word2vec – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Beyond embeddings: Navigating the shift to completions-only RAGsensible.so
• Leveraging Vector Embeddings and Similarity Search to Supplement ChatGPT’s Training Data - DEV Communitydev.to
• Voyage AI | Homevoyageai.com