Circuits Updates — May 2023

We report a number of developing ideas on the Anthropic interpretability team, which might be of interest to researchers working actively in this space. Some of these are emerging strands of research where we expect to publish more on in the coming months. Others are minor points we wish to share, since we're unlikely to ever write a paper about them. We'd ask you to treat these results like those of a colleague sharing some thoughts or preliminary experiments for a few minutes at a lab meeting, rather than a mature paper. Short Research Notes Updates We are often asked about where our work on superposition is going. Over the last few months, we've run several more ad-hoc experiments on superposition in real models (which sometimes produced interesting, but inconclusive results), as well as exploring a variety of questions related to the theory of superposition like our recent memorization paper. Our ad-hoc experiments have persuaded us that solutions to superposition won't be extremel

Circuits Updates — May 2023 Transformer Circuits Thread Circuits Updates — May 2023 We report a number of developing ideas on the Anthropic interpretability team, which might be of interest to researchers working actively in this space. Some of these are emerging strands of research where we expect to publish more on in the coming months. Others are minor points we wish to share, since we're unlikely to ever write a paper about them. We'd ask you to treat these results like those of a colleague sharing some thoughts or preliminary experiments for a few minutes at a lab meeting, rather than a m

related reading

• Toy Models of Superpositiontransformer-circuits.pub
• Circuits Updates - July 2024transformer-circuits.pub
• Circuits Updates - January 2024transformer-circuits.pub
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• Interpretability Dreamstransformer-circuits.pub
• Transformer Circuits Threadtransformer-circuits.pub
• Circuits Updates - April 2024transformer-circuits.pub
• What Would Non-Linear Features Actually Look Like? — Liv Gortonlivgorton.com
• Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
• Lucius Bushnaq's Shortform — LessWronglesswrong.com