Neural Turing Machine

Rylan Schaeffer

Neural Turing Machine $\DeclareMathOperator*{\argmax}{argmax}$ I've found that the overwhelming majority of online information on artificial intelligence research falls into one of two categories: the first is aimed at explaining advances to lay audiences, and the second is aimed at explaining advances to other researchers. I haven't found a good resource for people with a technical background who are unfamiliar with the more advanced concepts and are looking for someone to fill them in. This is my attempt to bridge that gap, by providing approachable yet (relatively) detailed explanations. In

related reading

• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• The Unreasonable Effectiveness of Recurrent Neural Networkskarpathy.github.io
• transformer_attention.pdfarxiv.org
• What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
• Attention and Augmented Recurrent Neural Networksdistill.pub
• The Annotated Transformernlp.seas.harvard.edu
• NL.pdfabehrouz.github.io
• Continuous Thought Machinespub.sakana.ai
• Understanding LSTM Networks -- colah's blogcolah.github.io
• The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• A History of Large Language Modelsgregorygundersen.com
• nn-notes.pdfboris-hanin.github.io