Schedule - Large Language Models: Methods and Applications / Fall 2024

5000 Forbes Ave Pittsburgh, PA 15213

Lecture 08/27/2024 Tuesday Building blocks of modern LLMs Lecture 08/29/2024 Thursday Transformer architecture and pre-training learning objectives Assignment 09/01/2024 Sunday Assignment #1 released Lecture 09/03/2024 Tuesday Pre-training data curation and tokenization Lecture 09/05/2024 Thursday Architecture Advancement on Transformers Lecture 09/10/2024 Tuesday Automatic evaluation of LLMs Due 09/10/2024 14:00 Tuesday Assignment #1 due Lecture 09/12/2024 Thursday In-context learning, task-oriented finetuning, and parameter-efficient tuning methods…

saved by

• Annie Zhou

related reading

• GenAI Handbookgenai-handbook.github.io
• RLHF & Post-Training Course by Nathan Lambertrlhfbook.com
• Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
• LLM Resourcesforrestbicker.com
• Stanford CS336 | Language Modeling from Scratchcs336.stanford.edu
• ARENA - AI Safety Curriculumlearn.arena.education
• Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
• What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
• Things we learned about LLMs in 2024simonwillison.net
• The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities (Version 1.0)arxiv.org
• The Iliad Intensive Course Materials — LessWronglesswrong.com
• The Llama Hitchiking Guide to Local LLMs – hackerllamaosanseviero.github.io