Modern Pretraining Strategies: A Hands-On Guide

Finetuning Sessions · Lab 1 / 8

Modern Pretraining Strategies: A Hands-On Guide Finetuning Sessions · Lab 1 / 8 Miguel Otero Pedrido and Antonio Zarauz Moreno Feb 13, 2026 ∙ Paid 40 7 5 Share Welcome to Lab 1 of the Finetuning Sessions ! After a comprehensive, introductory article about Transformers, attention mechanisms, and language model training pipeline, it's time to get our hands dirty and run experiments! 📕 If you haven't read Lesson 1's article, make sure to review it before going forward! The Finetuning Landscape - A Map of Modern LLM Training Miguel Otero Pedrido and Antonio Zarauz Moreno · Feb 11 Read full story

saved by

• Clementine Yang

related reading

• frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
• Recent Advances in Language Model Fine-tuningruder.io
• Composer2.pdfcursor.com
• GenAI Handbookgenai-handbook.github.io
• Anatomy of a Modern Finetuning APIbenanderson.work
• The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities (Version 1.0)arxiv.org
• The Continual Learning Problemjessylin.com
• Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
• MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
• Fine-tuning LLMs Guide | Unsloth Documentationdocs.unsloth.ai
• The Llama Hitchiking Guide to Local LLMs – hackerllamaosanseviero.github.io
• Fine-tuning (deep learning) - Wikipediaen.wikipedia.org