The architecture of today's LLM applications - The GitHub Blog

Here’s everything you need to know to build your first LLM app and problem spaces you can start exploring today. We want to empower you to experiment with LLM models, build your own applications, and discover untapped problem spaces. That’s why we sat down with GitHub’s Alireza Goudarzi, a senior machine learning researcher, and Albert Ziegler, a principal machine learning engineer, to discuss the emerging architecture of today’s LLMs. In this post, we’ll cover five major steps to building your own LLM app, the emerging architecture of today’s LLM apps, and problem areas that you can start exploring today. Building software with LLMs, or any machine learning (ML) model, is fundamentally different from building software without them. For one, rather than compiling source code into binary to run a series of commands, developers need to navigate datasets, embeddings, and parameter weights to generate consistent and accurate outputs. After all, LLM outputs are probabilistic and don’t produ

The architecture of today's LLM applications - The GitHub Blog Nicole Choi · @nicchoi29 October 30, 2023 | Updated February 7, 2024 | 13 minutes Share: We want to empower you to experiment with LLM models, build your own applications, and discover untapped problem spaces. That’s why we sat down with GitHub’s Alireza Goudarzi , a senior machine learning researcher, and Albert Ziegler , a principal machine learning engineer, to discuss the emerging architecture of today’s LLMs. In this post, we’ll cover five major steps to building your own LLM app, the emerging architecture of today’

related reading

• What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Emerging Architectures for LLM Applications | Andreessen Horowitza16z.com
• Building LLM applications for productionhuyenchip.com
• Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
• LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
• What We Learned from a Year of Building with LLMs (Part I) – O’Reillyoreilly.com
• Building an LLM evaluation framework: best practices | Datadogdatadoghq.com
• The Developer's Guide to Production-Grade LLM Appsbuildingaistuff.com
• What We Learned from a Year of Building with LLMs (Part II) – O’Reillyoreilly.com
• Building Effective AI Agents \ Anthropicanthropic.com
• Evaluating LLM Applicationshumanloop.com