The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.

Discussions: Hacker News (98 points, 19 comments), Reddit r/MachineLearning (164 points, 20 comments) Translations: Chinese (Simplified), French, Japanese, Korean, Persian, Russian 2021 Update: I created this brief and highly accessible video intro to BERT The year 2018 has been an inflection point for machine learning models handling text (or more accurately, Natural Language Processing or NLP for short). Our conceptual understanding of how best to represent words and sentences in a way that best captures underlying meanings and relationships is rapidly evolving. Moreover, the NLP community has been putting forward incredibly powerful components that you can freely download and use in your own models and pipelines (It’s been referred to as NLP’s ImageNet moment, referencing how years ago similar developments accelerated the development of machine learning in Computer Vision tasks).

The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) Discussions: Hacker News (98 points, 19 comments) , Reddit r/MachineLearning (164 points, 20 comments) Translations: Chinese (Simplified) , French 1 , French 2 , Japanese , Korean , Persian , Russian , Spanish 2021 Update: I created this brief and highly accessible video intro to BERT The year 2018 has been an inflection point for machine learning models handling text (or more accurately, Natural Language Processing or NLP for short). Our conceptual understanding of how best to represent words and sentences in a way that b

saved by

• Rongfei Lu

related reading

• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Transfer Learninglena-voita.github.io
• Generalized Language Models | Lil'Loglilianweng.github.io
• NLP's ImageNet moment has arrivedthegradient.pub
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Transformers from Scratche2eml.school
• What is it - bert-as-service 1.6.1 documentationbert-as-service.readthedocs.io
• Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
• How do Transformers work? · Hugging Facehuggingface.co
• Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
• Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
• Transformer Architectures · Hugging Facehuggingface.co