Transfer Learning

Introduction to Transfer Learning and Pretrained Models (ELMo, BERT, GPT).

Transfer Learning p { text-align: justify; } ⇤ NLP Course | For You Transfer Learning What is Transfer Learning? Recap: Word Embeddings Pretrained Models • Words ↦ Words in Context • CoVe: Context Vectors • ELMo: Embeddings from LM • Task-Specific Model ↦ Unified • GPT: Generative Pretraining • BERT: Bidirectional Encoder Benchmarks --> (A Bit of) Adapters (A Note on) Benchmarks Analysis and Interpretability Research Thinking --> Related Papers --> Have Fun! ☰ --> --> (Introduction to) Transfer Learning Lena : Transfer Learning is huge: therefore, it is not

saved by

• Fernando Silva

related reading

• SenseBERT: Driving Some Sense into BERT - ACL Anthologyaclanthology.org
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Generalized Language Models | Lil'Loglilianweng.github.io
• NLP's ImageNet moment has arrivedthegradient.pub
• Recent Advances in Language Model Fine-tuningruder.io
• Transformers from Scratche2eml.school
• Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
• Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
• TOD-Bertarxiv.org
• How do Transformers work? · Hugging Facehuggingface.co
• Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com