Understanding Large Language Models - by Sebastian Raschka

A Cross-Section of the Most Relevant Literature To Get Up to Speed

Understanding Large Language Models A Cross-Section of the Most Relevant Literature To Get Up to Speed Sebastian Raschka, PhD Apr 16, 2023 966 52 51 Share Large language models have taken the public attention by storm – no pun intended. In just half a decade large language models – transformers – have almost completely changed the field of natural language processing. Moreover, they have also begun to revolutionize fields such as computer vision and computational biology. Since transformers have such a big impact on everyone’s research agenda, I wanted to flesh out a short reading list (an ext

related reading

• Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
• Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
• GenAI Handbookgenai-handbook.github.io
• [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• LLM Resourcesforrestbicker.com
• Recent Advances in Language Model Fine-tuningruder.io
• Generalized Language Models | Lil'Loglilianweng.github.io
• A History of Large Language Modelsgregorygundersen.com
• Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrouai.googleblog.com
• The Llama Hitchiking Guide to Local LLMs – hackerllamaosanseviero.github.io
• Large Language Diffusion Modelsarxiv.org