Trenton Bricken – Interested in Machine Learning, Neuroscience, and Original Glazed Krispy Kreme Doughnuts.
Backpacking forces you to walk; Solitude isolates your thoughts. The combination results in a meditative state. Searching beyond the streetlight finds a plethora of important cerebellar functions. Why Holographic Reduced Representations cannot be used to “Recast Self Attention”. How Hopfield Networks are a special case of the biologically plausible Sparse Distributed Memory. A simple modification to improve Elastic Weight Consolidation and Synaptic Intelligence continual learning baselines. It is absurd that the second year of my PhD has come to an end. I am taking a minute to reflect on what I have learnt and want to improve upon. Talent is a conversation starter on the under discussed topic of how to identify talent but not much more. Having a non-linear uptick in utility avoids the Repugnant Conclusion. Ted Chiang creates emotionally resonant and novel perspectives on deep questions about life and technology. Working out how much memory it takes to train a Transformer GPT2 Model. Ho
Trenton Bricken Hi, I'm Trenton. I'm a Member of Technical Staff on the Alignment Science team at Anthropic . I'm currently enabling Claude to automatically audit and detect misalignment . About Me I have a PhD in Systems Biology from Harvard. My thesis was on "Sparse Representations in Biological and Artificial Neural Networks" in the Kreiman Lab with support from the NSF Graduate Research Fellowship. I also spent time at the Berkeley Redwood Center for Theoretical Neuroscience as a visiting researcher. I graduated from Duke University in May 2020 with a self-made major in "Minds and Machines
Explore this link on the map →related reading
- LessWronglesswrong.com
- Transformer Circuits Threadtransformer-circuits.pub
- Gap Mapgap-map.org
- On the Biology of a Large Language Modeltransformer-circuits.pub
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- Nicholas Carlininicholas.carlini.com
- LLM Resourcesforrestbicker.com
- Mapping the Mind of a Large Language Model \ Anthropicanthropic.com
- Interpretability Dreamstransformer-circuits.pub
- Circuits Updates - July 2024transformer-circuits.pub
- Neuronpedianeuronpedia.org
- School 2.0 / Bio Pagebio.school2point0.site