Interpretability Creationism | Objective Funk

Nothing in Deep Learning Makes Sense Except in the Light of SGD.

Interpretability Creationism Jun 7, 2022 · Naomi Saphra · 7 min read For centuries, Europeans agreed that the presence of a cuckoo egg was a great honor to a nesting bird, as it granted an opportunity to exhibit Christian hospitality. The devout bird enthusiastically fed her holy guest, even more so than she would her own (evicted) chicks (Davies, 2015) . In 1859, Charles Darwin’s studies of another occasional brood parasite, finches, called into question any rosy, cooperative view of bird behavior (Darwin, 1859) . Without considering the evolution of the cuckoo’s role, it would have been diff

related reading

• The Parable of the Prinia's Egg: An Allegory for AI Science | Naomi Saphransaphra.net
• Transformer Circuits Threadtransformer-circuits.pub
• Dario Amodei — The Urgency of Interpretabilitydarioamodei.com
• A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
• How Can Interpretability Researchers Help AGI Go Well? — AI Alignment Forumalignmentforum.org
• A Pragmatic Vision for Interpretability — LessWronglesswrong.com
• On Optimism for Interpretabilitygoodfire.ai
• Intentionally Designing the Future of AIgoodfire.ai
• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• The Hitchhiker's Guide to Actionable Interpretabilityactionable-interpretability-guide.github.io
• Assessing skeptical views of interpretability research | Christopher Pottsweb.stanford.edu
• A Comprehensive Mechanistic Interpretability Explainer & Glossary — Neel Nandaneelnanda.io