hackerllama - The Llama Hitchiking Guide to Local LLMs
LocalLlama: A Reddit community of practitioners, researchers, and hackers doing all kinds of crazy things with ML models. LLM: A Large Language Model. Usually a transformer-based model with a lot of parameters…billions or even trillions. Transformer: A type of neural network architecture that is very good at language tasks. It is the basis for most LLMs. GPT: A type of transformer that is trained to predict the next token in a sentence. GPT-3 is an example of a GPT model…who could tell?? 4.1 Auto-regressive: A type of model that generates text one token at a time. It is auto-regressive because it uses its own predictions to generate the next token. For example, the model might receive as input “Today’s weather” and generate the next token, “is”. It will then use “Today’s weather is” as input and generate the next token, “sunny”. It will then use “Today’s weather is sunny” as input and generate the next token, “and”. And so on. Token: Models don’t understand words. They understand numbe
The Llama Hitchiking Guide to Local LLMs – hackerllama Here are some terms that are useful to know when joining the Local LLM community. LocalLlama: A Reddit community of practitioners, researchers, and hackers doing all kinds of crazy things with ML models. LLM: A Large Language Model. Usually a transformer-based model with a lot of parameters…billions or even trillions. Transformer: A type of neural network architecture that is very good at language tasks. It is the basis for most LLMs. GPT: A type of transformer that is trained to predict the next token in a sentence. GPT-3 is an example of
Explore this link on the map →saved by
related reading
- GenAI Handbookgenai-handbook.github.io
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- LLM Resourcesforrestbicker.com
- Catching up on the weird world of LLMssimonwillison.net
- The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities (Version 1.0)arxiv.org
- Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
- How LLMs Actually Work | 0xkato0xkato.xyz
- Fine-Tuning Llama-2: Tailoring Models to Unique Applicationsanyscale.com
- Large Language Diffusion Modelsarxiv.org
- Llama 2 · Hugging Facehuggingface.co