Finetune DistilBERT for multi-label text classsification task | by Dhaval Taunk | Analytics Vidhya | Medium

In one of my last blog post, How to fine-tune bert on text classification task, I had explained fine-tuning BERT for a multi-class text…

Finetune DistilBERT for multi-label text classsification task Dhaval Taunk 6 min read · Sep 17, 2020 -- 4 Listen Share Press enter or click to view image in full size Source — https://developer.nvidia.com/blog/efficient-bert-finding-your-optimal-model-with-multimetric-bayesian-optimization-part-1/ In one of my last blog post, How to fine-tune bert on text classification task , I had explained fine-tuning BERT for a multi-class text classification task. In this post, I will be explaining how to fine-tune DistilBERT for a multi-label text classification task. I have made a GitHub repo as well co

saved by

• Jay Chou

related reading

• Text Classification with OpenAI and Pydantic - Instructorpython.useinstructor.com
• On-Policy Distillation - Thinking Machines Labthinkingmachines.ai
• FinBERT: Financial Sentiment Analysis with BERT | by Zulkuf Genc | Prosus AI Tech Blog | Mediummedium.com
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• TOD-Bertarxiv.org
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• The Annotated Transformernlp.seas.harvard.edu
• Generalized Language Models | Lil'Loglilianweng.github.io
• Recent Advances in Language Model Fine-tuningruder.io
• Introduction · Hugging Facehuggingface.co
• Processing the data · Hugging Facehuggingface.co
• Transfer Learninglena-voita.github.io