The architecture of today's LLM applications - The GitHub Blog
Here’s everything you need to know to build your first LLM app and problem spaces you can start exploring today. We want to empower you to experiment with LLM models, build your own applications, and discover untapped problem spaces. That’s why we sat down with GitHub’s Alireza Goudarzi, a senior machine learning researcher, and Albert Ziegler, a principal machine learning engineer, to discuss the emerging architecture of today’s LLMs. In this post, we’ll cover five major steps to building your own LLM app, the emerging architecture of today’s LLM apps, and problem areas that you can start exploring today. Building software with LLMs, or any machine learning (ML) model, is fundamentally different from building software without them. For one, rather than compiling source code into binary to run a series of commands, developers need to navigate datasets, embeddings, and parameter weights to generate consistent and accurate outputs. After all, LLM outputs are probabilistic and don’t produ
The architecture of today's LLM applications - The GitHub Blog Nicole Choi · @nicchoi29 October 30, 2023 | Updated February 7, 2024 | 13 minutes Share: We want to empower you to experiment with LLM models, build your own applications, and discover untapped problem spaces. That’s why we sat down with GitHub’s Alireza Goudarzi , a senior machine learning researcher, and Albert Ziegler , a principal machine learning engineer, to discuss the emerging architecture of today’s LLMs. In this post, we’ll cover five major steps to building your own LLM app, the emerging architecture of today’
Explore this link on the map →related reading
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Emerging Architectures for LLM Applications | Andreessen Horowitza16z.com
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Building LLM applications for productionhuyenchip.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- What We Learned from a Year of Building with LLMs (Part I) – O’Reillyoreilly.com
- Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
- Building an LLM evaluation framework: best practices | Datadogdatadoghq.com
- The Developer's Guide to Production-Grade LLM Appsbuildingaistuff.com
- GenAI Handbookgenai-handbook.github.io
- What We Learned from a Year of Building with LLMs (Part II) – O’Reillyoreilly.com
- Evaluating LLM Applicationshumanloop.com