Sequence Modeling with CTC
A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and other sequence problems.
Sequence Modeling with CTC Sequence Modeling With CTC A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and other sequence problems. How CTC collapsing works For an input, like speech Predict a sequence of tokens Use return to input a blank ( ϵ ) (\epsilon) ( ϵ ) Merge repeats, drop ϵ \epsilon ϵ Final output Authors Affiliations Awni Hannun Stanford University Published Nov. 27, 2017 DOI 10.23915/distill.00008 Introduction Consider speech recognition. We have a dataset of audio clips and corre
Explore this link on the map →saved by
related reading
- Connectionist temporal classification - Wikipediaen.wikipedia.org
- Audio Deep Learning Made Simple: Automatic Speech Recognition (ASR), How it Works | Towards Data Sciencetowardsdatascience.com
- The Unreasonable Effectiveness of Recurrent Neural Networkskarpathy.github.io
- The Little Book of Deep Learningfleuret.org
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- transformer_attention.pdfarxiv.org
- Transformers from Scratche2eml.school
- The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
- Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
- Continuous Thought Machinespub.sakana.ai
- Encoder-Decoder Seq2Seq Models, Clearly Explained!! | by Kriz Moses | Analytics Vidhya | Mediummedium.com
- Seq2seq and Attentionlena-voita.github.io