How to Write a Spelling Corrector

I figured they, and others, could benefit from an explanation. The full details of an industrial-strength spell corrector are quite complex (you can read a little about it here or here). But I figured that in the course of a transcontinental plane ride I could write and explain a toy spelling corrector that achieves 80 or 90% accuracy at a processing speed of at least 10 words per second in about half a page of code.

How to Write a Spelling Corrector Feb 2007 to August 2016 How to Write a Spelling Corrector One week in 2007, two friends (Dean and Bill) independently told me they were amazed at Google's spelling correction. Type in a search like [speling] and Google instantly comes back with Showing results for: spelling . I thought Dean and Bill, being highly accomplished engineers and mathematicians, would have good intuitions about how this process works. But they didn't, and come to think of it, why should they know about something so far outisde their specialty? I figured they, and others, could benefi

saved by

• Selene Xu
• Amos You
• Noah T

related reading

• The Unreasonable Effectiveness of Recurrent Neural Networkskarpathy.github.io
• What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
• Coding Models Are Doing Too Much | whnrehiew.github.io
• A Recipe for Training Neural Networkskarpathy.github.io
• The Annotated Transformernlp.seas.harvard.edu
• The Annotated Transformernlp.seas.harvard.edu
• microgptkarpathy.github.io
• Let's build GPT: from scratch, in code, spelled out.youtube.com
• 1301.3781arxiv.org
• Writing Toy Software Is A Joyblog.jsbarretto.com
• GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
• Can gzip be a language model?nathan.rs