The pain points of building a copilot - Austin Z. Henley
This post is an informal summary of our paper, "Building Your Own Product Copilot: Challenges, Opportunities, and Needs". See the preprint for more details. Thanks to my collaborators at Microsoft: Chris Parnin, Gustavo Soares, Rahul Pandita, Jessica Rich, and Sumit Gulwani. Companies everywhere are launching copilots—AI assistants that leverage LLMs to assist with tasks. For example, Office Copilot helps you with Word and Excel, GitHub Copilot helps you write code, Intuit Assist helps with filing taxes in TurboTax, Adobe Firefly helps you generate and edit images, and Dropbox AI answers questions about your documents. Towards this, we conducted semi-structured interviews with 26 developers from a variety of companies that are working on copilots. We qualitatively analyzed their responses to identify themes. Then we conducted two focus group sessions with tool builders that involved reviewing our interview findings and brainstorming possible solutions. Given the nondeterministic nature
The pain points of building a copilot - Austin Z. Henley Austin Z. Henley I build tools for people austin.henley@microsoft.com @austinzhenley github/AZHenley Home | Publications | Teaching | Blog The pain points of building a copilot 2/4/2024 See the discussion of this post on Hacker News . This post is a summary of our SANER'25 paper, "Building Your Own Product Copilot: Challenges, Opportunities, and Needs". See the paper for more details. Thanks to my collaborators at Microsoft: Chris Parnin, Gustavo Soares, Rahul Pandita, Jessica Rich, and Sumit Gulwani. Companies everywhere are launching c
Explore this link on the map →related reading
- AI Horseless Carriages | koomen.devkoomen.dev
- The Future of Programming: Copilots vs. Agents (Part I)eastwind.substack.com
- Malleable software in the age of LLMsgeoffreylitt.com
- Here’s how I use LLMs to help me write codesimonwillison.net
- How I use LLMs as a staff engineerseangoedecke.com
- Your job is to deliver code you have proven to worksimonwillison.net
- Building Effective AI Agents \ Anthropicanthropic.com
- Building Effective AI Agents \ Anthropicanthropic.com
- Musings on Building a Generative AI Productlinkedin.com
- Build your personal AI copilot - by Tal Ravivlennysnewsletter.com
- Developer Tools 2.0 | Sequoia Capitalsequoiacap.com
- Developer Tools 2.0 | Sequoia Capitalsequoiacap.com