flâneur

Circuit Tracing: Revealing Computational Graphs in Language Models

transformer-circuits.pub · 29,625 words · saved by 20 readers

We describe an approach to tracing the “step-by-step” computation involved when a model responds to a single prompt.

Circuit Tracing: Revealing Computational Graphs in Language Models × Transformer Circuits Thread Circuit Tracing: Revealing Computational Graphs in Language Models Circuit Tracing: Revealing Computational Graphs in Language Models We introduce a method to uncover mechanisms underlying behaviors of language models. We produce graph descriptions of the model’s computation on prompts of interest by tracing individual computational steps in a “replacement model”. This replacement model substitutes a more interpretable component (here, a “cross-layer transcoder”) for parts of the underlying model (

saved by

related reading