DL towards the unaligned Recursive Self-Optimization attractor - LessWrong

Consider this abridged history of recent ML progress: …

x DL towards the unaligned Recursive Self-Optimization attractor — LessWrong Optimization AI Safety Public Materials AI Risk AI Frontpage 32 DL towards the unaligned Recursive Self-Optimization attractor by jacob_cannell 18th Dec 2021 5 min read 22 32 Consider this abridged history of recent ML progress: A decade or two ago, computer vision was a field that employed dedicated researchers who designed specific increasingly complex feature recognizers (SIFT, SURF, HoG, etc.) These were usurped by deep CNNs with fully learned features in the 2010's [1] , which subsequently saw success in speech r

related reading

• Lil'Loglilianweng.github.io
• NL.pdfabehrouz.github.io
• Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
• The Annotated Transformernlp.seas.harvard.edu
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• The Decade of Deep Learning | Leo Gaobmk.sh
• You can’t imitation-learn how to continual-learn — LessWronglesswrong.com
• Tensor-Transformer Variants are Surprisingly Performant — LessWronglesswrong.com
• Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
• A History of Large Language Modelsgregorygundersen.com
• Non_Interactive – Software & MLnonint.com
• Deep learning as program synthesis — LessWronglesswrong.com