Getting creative with embeddings
In defiance of the “AI will write everything for us” narrative, I’ve been noodling on a writing app, PenPal, focused on the opposite: making us better writers. My process has involved a lot of research into how great writing instructors work. There’s one concept I find especially appealing: making the implicit explicit. Much of the work of becoming a better writer doesn’t involve writing, but instead taking a magnifying glass to others’ writing. Can PenPal make it easy to see Hemingway’s style, to compare Stephen King to John Steinbeck, or even to compare your writing style to Roald Dahl’s? This actually isn’t a completely new idea for me. After seeing a popular example of the power of diverse sentence lengths, I create an app that highlights each sentence based on its length. This was an easy add! Just loop over every sentence and map the character count to a color scale. But I remembered an essay from Robin Sloan I had squirreled away in my notes a few years ago: Week 4, ladder of ab
Getting creative with embeddings In defiance of the “AI will write everything for us” narrative, I’ve been noodling on a writing app, PenPal, focused on the opposite: making us better writers. My process has involved a lot of research into how great writing instructors work. There’s one concept I find especially appealing: making the implicit explicit. Much of the work of becoming a better writer doesn’t involve writing, but instead taking a magnifying glass to others’ writing. Can PenPal make it easy to see Hemingway’s style, to compare Stephen King to John Steinbeck, or even to compare your
Explore this link on the map →related reading
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- Embeddings: What they are and why they mattersimonwillison.net
- Vector embeddings | OpenAI APIplatform.openai.com
- Vector embeddings | OpenAI APIdevelopers.openai.com
- Contra Labs - Powered by Contracontralabs.com
- trees are harlequins, words are harlequins - hydrogen jukeboxes: on the crammed poetics of...nostalgebraist.tumblr.com
- Sentence Embeddings. Introduction to Sentence Embeddings – hackerllamaosanseviero.github.io
- Introducing text and code embeddings | OpenAIopenai.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Prism: mapping interpretable concepts and features in a latent space of language | thesephist.comthesephist.com
- Here comes the Muybridge camera moment but for text. Photoshop too (Interconnected)interconnected.org
- GitHub - EveryInc/compound-engineering-plugin: Official Compound Engineering plugin for Claude Code, Codex, Cursor, and more · GitHubgithub.com