Building LLM applications for production

[Hacker News discussion, LinkedIn discussion, Twitter thread]

[ Hacker News discussion , LinkedIn discussion , Twitter thread ] Update: My upcoming book, AI Engineering (late 2024/early 2025) will cover building aplications with foundation models in depth. A question that I’ve been asked a lot recently is how large language models (LLMs) will change machine learning workflows. After working with several companies who are working with LLM applications and personally going down a rabbit hole building my applications, I realized two things: It’s easy to make something cool with LLMs, but very hard to make something production-ready with them. LLM limitation

related reading

• What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
• What We Learned from a Year of Building with LLMs (Part I) – O’Reillyoreilly.com
• Productizing Large Language Modelsblog.replit.com
• Prompt Engineering Guide | Prompt Engineering Guidepromptingguide.ai
• Building Effective AI Agents \ Anthropicanthropic.com
• The architecture of today's LLM applications - The GitHub Bloggithub.blog
• Things we learned about LLMs in 2024simonwillison.net
• What We Learned from a Year of Building with LLMs (Part II) – O’Reillyoreilly.com
• The Foundation Understanding LLMs and Prompt Engineering, and Why It All Mattersleeboonstra.dev