Finetune DistilBERT for multi-label text classsification task | by Dhaval Taunk | Analytics Vidhya | Medium

In one of my last blog post, How to fine-tune bert on text classification task, I had explained fine-tuning BERT for a multi-class text…

Finetune DistilBERT for multi-label text classsification task Dhaval Taunk 6 min read · Sep 17, 2020 -- 4 Listen Share Press enter or click to view image in full size Source — https://developer.nvidia.com/blog/efficient-bert-finding-your-optimal-model-with-multimetric-bayesian-optimization-part-1/ In one of my last blog post, How to fine-tune bert on text classification task , I had explained fine-tuning BERT for a multi-class text classification task. In this post, I will be explaining how to fine-tune DistilBERT for a multi-label text classification task. I have made a GitHub repo as well co

saved by

• Jay Chou

related reading

• 1810.04805arxiv.org
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• The Annotated Transformernlp.seas.harvard.edu
• FinBERT: Financial Sentiment Analysis with BERT | by Zulkuf Genc | Prosus AI Tech Blog | Mediummedium.com
• TOD-Bertarxiv.org
• Recent Advances in Language Model Fine-tuningruder.io
• Generalized Language Models | Lil'Loglilianweng.github.io
• Text Classification with OpenAI and Pydantic - Instructorpython.useinstructor.com
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• 2403.09611.pdfarxiv.org
• Distillation Walkthroughvladfeinberg.com
• Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformerai.googleblog.com