Circuits Updates - January 2024

We report a number of developing ideas on the Anthropic interpretability team, which might be of interest to researchers working actively in this space. Some of these are emerging strands of research where we expect to publish more on in the coming months. Others are minor points we wish to share, since we're unlikely to ever write a paper about them. We'd ask you to treat these results like those of a colleague sharing some thoughts or preliminary experiments for a few minutes at a lab meeting, rather than a mature paper. Short Research Notes Updates As our team has grown, we have gotten more bandwidth to focus on a wider range of directions. In light of this and our recent results on dictionary learning, our plan over the coming months is to focus on three areas: In our investigations of attention superposition (see our previous discussion as well as Larson and Greenspan & Wynroe), one toy model we’ve studied has shown geometry which is strongly reminiscent of that in Toy Models of S

Circuits Updates - January 2024 Transformer Circuits Thread Circuits Updates - January 2024 We report a number of developing ideas on the Anthropic interpretability team, which might be of interest to researchers working actively in this space. Some of these are emerging strands of research where we expect to publish more on in the coming months. Others are minor points we wish to share, since we're unlikely to ever write a paper about them. We'd ask you to treat these results like those of a colleague sharing some thoughts or preliminary experiments for a few minutes at a lab meeting, rather

related reading

• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• Transformer Circuits Threadtransformer-circuits.pub
• Toy Models of Superpositiontransformer-circuits.pub
• Circuits Updates — May 2023transformer-circuits.pub
• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org
• Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• On the Biology of a Large Language Modeltransformer-circuits.pub
• Circuits Updates - July 2024transformer-circuits.pub
• Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub