Evolution of Learning Automata in Natural Language Processing (NLP) | by Anshumaan Phukan | Medium

Introduction

Evolution of Learning Automata in Natural Language Processing (NLP) Anshumaan Phukan 10 min read · Jan 22, 2022 -- 2 Listen Share Introduction NLP — Natural Language Processing is a generic word that relates to technology that alters natural language, including such as speech and text, autonomously. The theory of automata is important in giving answers to a variety of difficulties in NLP. Speech recognition, information retrieval, and spelling correction are just a few examples. Because the modeling of facts using rules has several features for language modeling, finite-state approaches are ve

related reading

• Finite-state transducer - Wikipediaen.wikipedia.org
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• Chomsky hierarchy - Wikipediaen.wikipedia.org
• Natural Language Autoencoders \ Anthropicanthropic.com
• [1609.08144] Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translationarxiv-vanity.com
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• Rycolabrycolab.io
• NLP's ImageNet moment has arrivedthegradient.pub
• Natural Language Processing Course | Stanford Onlineonline.stanford.edu
• To Understand Language is to Understand Generalization | Eric Jangevjang.com