flâneur

hackerllama - The Llama Hitchiking Guide to Local LLMs

osanseviero.github.io · 3,062 words · saved by 3 readers

LocalLlama: A Reddit community of practitioners, researchers, and hackers doing all kinds of crazy things with ML models. LLM: A Large Language Model. Usually a transformer-based model with a lot of parameters…billions or even trillions. Transformer: A type of neural network architecture that is very good at language tasks. It is the basis for most LLMs. GPT: A type of transformer that is trained to predict the next token in a sentence. GPT-3 is an example of a GPT model…who could tell?? 4.1 Auto-regressive: A type of model that generates text one token at a time. It is auto-regressive because it uses its own predictions to generate the next token. For example, the model might receive as input “Today’s weather” and generate the next token, “is”. It will then use “Today’s weather is” as input and generate the next token, “sunny”. It will then use “Today’s weather is sunny” as input and generate the next token, “and”. And so on. Token: Models don’t understand words. They understand numbe

The Llama Hitchiking Guide to Local LLMs – hackerllama Here are some terms that are useful to know when joining the Local LLM community. LocalLlama: A Reddit community of practitioners, researchers, and hackers doing all kinds of crazy things with ML models. LLM: A Large Language Model. Usually a transformer-based model with a lot of parameters…billions or even trillions. Transformer: A type of neural network architecture that is very good at language tasks. It is the basis for most LLMs. GPT: A type of transformer that is trained to predict the next token in a sentence. GPT-3 is an example of

saved by

related reading