Interpretability Creationism | Objective Funk

Nothing in Deep Learning Makes Sense Except in the Light of SGD.

Interpretability Creationism Jun 7, 2022 · Naomi Saphra · 7 min read For centuries, Europeans agreed that the presence of a cuckoo egg was a great honor to a nesting bird, as it granted an opportunity to exhibit Christian hospitality. The devout bird enthusiastically fed her holy guest, even more so than she would her own (evicted) chicks (Davies, 2015) . In 1859, Charles Darwin’s studies of another occasional brood parasite, finches, called into question any rosy, cooperative view of bird behavior (Darwin, 1859) . Without considering the evolution of the cuckoo’s role, it would have been diff

related reading

• The Parable of the Prinia's Egg: An Allegory for AI Science | Naomi Saphransaphra.net
• Transformer Circuits Threadtransformer-circuits.pub
• Dario Amodei — The Urgency of Interpretabilitydarioamodei.com
• A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
• On Optimism for Interpretabilitygoodfire.ai
• Intentionally Designing the Future of AIgoodfire.ai
• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• How Can Interpretability Researchers Help AGI Go Well? — AI Alignment Forumalignmentforum.org
• Faithful, Interpretable Model Explanations via Causal Abstraction | SAIL Blogai.stanford.edu
• The Hitchhiker's Guide to Actionable Interpretabilityactionable-interpretability-guide.github.io
• Neel Nanda on Mechanistic Interpretability: Progress, Limits, and Paths to Safer AI — EA Forumforum.effectivealtruism.org
• Why I'm bearish on mechanistic interpretability: the shards are not in the network — LessWronglesswrong.com