Evolution of Learning Automata in Natural Language Processing (NLP) | by Anshumaan Phukan | Medium

Introduction

Evolution of Learning Automata in Natural Language Processing (NLP) Anshumaan Phukan 10 min read · Jan 22, 2022 -- 2 Listen Share Introduction NLP — Natural Language Processing is a generic word that relates to technology that alters natural language, including such as speech and text, autonomously. The theory of automata is important in giving answers to a variety of difficulties in NLP. Speech recognition, information retrieval, and spelling correction are just a few examples. Because the modeling of facts using rules has several features for language modeling, finite-state approaches are ve

related reading

• Yudhister Kumaryudhister.me
• Finite-state transducer - Wikipediaen.wikipedia.org
• Chomsky hierarchy - Wikipediaen.wikipedia.org
• Natural Language Autoencoders \ Anthropicanthropic.com
• Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• A History of Large Language Modelsgregorygundersen.com
• Retrieval Augmented Generation: Streamlining the creation of intelligent natural language processing modelsai.facebook.com
• [1609.08144] Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translationarxiv-vanity.com
• radford2018improving.pdfcs.ubc.ca
• Generalized Language Models | Lil'Loglilianweng.github.io