Embeddings: What they are and why they matter

simonwillison.net · 5,200 words · saved by 2 readers

If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023. This article represents an improved version of that talk, which should stand alone even without watching the video. If you’re not yet familiar with embeddings I hope to give you everything you need to get started applying them to real-world problems. In this article: Here’s a video of the talk that I gave at PyBay: The audio quality of the official video wasn’t great due to an issue with the microphone, but I ran that audio through Adobe’s Enhance Speech tool and uploaded my own video with the enhanced audio to YouTube. Embeddings are a technology that’s adjacent to the wider field of Large Language Models—the technology behind ChatGPT and Bard and Claude. Embeddings are based around one trick: take a piece of content—in this case a blog entry—and turn that piece of content into an array of floating

Embeddings: What they are and why they matter Simon Willison’s Weblog Subscribe Sponsored by: Microsoft - Agent projects stall between demo and production. Microsoft's MVP checklist closes that gap. Try it Embeddings: What they are and why they matter 23rd October 2023 Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023 . This article represents an improved version of

Embeddings: What they are and why they matter

saved by

related reading