Patterns for Building LLM-based Systems & Products

Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.

Patterns for Building LLM-based Systems & Products eugeneyan Start Here Writing Speaking Prototyping About Patterns for Building LLM-based Systems & Products [ llm engineering production 🔥 ] · 66 min read Discussions on HackerNews , Twitter , and LinkedIn “There is a large class of problems that are easy to imagine and build demos for, but extremely hard to make products out of. For example, self-driving: It’s easy to demo a car self-driving around a block, but making it into a product takes a decade.” - Karpathy This write-up is about practical patterns for integrating large language models

saved by

• Yung-Hsuan Yang
• Kevin Wang
• Daniel Bashir
• Evan Cater
• Proby Shandilya
• Benedict Neo
• William S
• Wei Chun Tan
• Nazmi Asri

related reading

• Your AI Product Needs Evals – Hamel's Blog - Hamel Husainhamel.dev
• LLM Evaluation doesn't need to be complicatedphilschmid.de
• GenAI Handbookgenai-handbook.github.io
• Fine-Tuning Llama-2: Tailoring Models to Unique Applicationsanyscale.com
• The Llama Hitchiking Guide to Local LLMs – hackerllamaosanseviero.github.io
• The bitter lesson of LLM evalsparsed.com
• Retrieval-Augmented Generation for Large Language Models: A Surveyarxiv.org
• What We Learned from a Year of Building with LLMs (Part I) – O’Reillyoreilly.com
• The 2025 AI Engineering Reading List - Latent.Spacelatent.space
• LLM evaluation: a beginner's guideevidentlyai.com
• Building RAG-based LLM Applications for Productionanyscale.com
• Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com