Towards a better circuit prior: Improving on ELK state-of-the-art - LessWrong

This post is the result of joint work with Kate Woolverton. Thanks to Paul Christiano for useful comments and feedback. …

x Towards a better circuit prior: Improving on ELK state-of-the-art — LessWrong Eliciting Latent Knowledge AI Frontpage 23 Towards a better circuit prior: Improving on ELK state-of-the-art by evhub , kcwoolverton 29th Mar 2022 AI Alignment Forum 17 min read 0 23 Ω 13 Thanks to Paul Christiano for useful comments and feedback. The basic circuit prior setup We’ll start with the basic setup that we’re trying to improve upon, which is trying to solve ELK via the use of a Boolean circuit size prior . Previously, Evan summarized Paul, Mark, and Ajeya’s argument for why this might work as follows : A

saved by

• Denizhan Akar

related reading

• Musings on the Speed Prior — AI Alignment Forumalignmentforum.org
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
• Eliciting Latent Knowledge (ELK) - Distillation/Summary — AI Alignment Forumalignmentforum.org
• Language Model Circuits Are Sparse in the Neuron Basis | Transluce AItransluce.org
• What if not Circuits? — LessWronglesswrong.com
• The generalization phase diagram — LessWronglesswrong.com
• Weight-Sparse Circuits May Be Interpretable Yet Unfaithful — LessWronglesswrong.com
• the-illusion-of-thinking.pdfml-site.cdn-apple.com
• Extending Context is Hard | kaiokendevkaiokendev.github.io
• Better priors as a safety problem — LessWronglesswrong.com
• Mediumai-alignment.com