flâneur

The architecture of today's LLM applications - The GitHub Blog

github.blog · 3,047 words · saved by 1 readers

Here’s everything you need to know to build your first LLM app and problem spaces you can start exploring today. We want to empower you to experiment with LLM models, build your own applications, and discover untapped problem spaces. That’s why we sat down with GitHub’s Alireza Goudarzi, a senior machine learning researcher, and Albert Ziegler, a principal machine learning engineer, to discuss the emerging architecture of today’s LLMs. In this post, we’ll cover five major steps to building your own LLM app, the emerging architecture of today’s LLM apps, and problem areas that you can start exploring today. Building software with LLMs, or any machine learning (ML) model, is fundamentally different from building software without them. For one, rather than compiling source code into binary to run a series of commands, developers need to navigate datasets, embeddings, and parameter weights to generate consistent and accurate outputs. After all, LLM outputs are probabilistic and don’t produ

The architecture of today's LLM applications - The GitHub Blog Nicole Choi · @nicchoi29 October 30, 2023 | Updated February 7, 2024 | 13 minutes Share: We want to empower you to experiment with LLM models, build your own applications, and discover untapped problem spaces. That’s why we sat down with GitHub’s Alireza Goudarzi , a senior machine learning researcher, and Albert Ziegler , a principal machine learning engineer, to discuss the emerging architecture of today’s LLMs. In this post, we’ll cover five major steps to building your own LLM app, the emerging architecture of today’

related reading