Sandra Luo
2 followers · 3 following · 310 views
on the atlas · 20
- Dr. R. W. Hamming's Advice on Research14 savers
- Anna Karenina | Project Gutenberg1 savers
- 1.-Of-Mice-Men-Full-Text.pdf1 savers
- "Surely You're Joking, Mr. Feynman!": Adventures of a Curious Character1 savers
- In-context Learning and Induction Heads14 savers
- a635abfdd007c9a698410c8bbe5ebc33-Paper-Conference.pdf1 savers
- What Harvard (almost) stole from me - Julia Alvarenga6 savers
- Post 42: When You Already Know the Answer — Neel Nanda5 savers
- Choose Good Quests - by Trae Stephens and Markie Wagner44 savers
- Staring into the abyss as a core life skill88 savers
- An Opinionated Guide to ML Research59 savers
- What I Wish Someone Had Told Me - Sam Altman52 savers
- Childhoods of exceptional people - by Henrik Karlsson70 savers
- How can I prevent my macbook from going into sleep mode during several hour download? : r/mac1 savers
- A Mathematical Framework for Transformer Circuits40 savers
- Thought Branches: Interpreting LLM Reasoning Requires Resampling1 savers
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forum3 savers
- Curius / Onboarding2704 savers
- The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophe9 savers
- [2512.11949] Neural Chameleons: Language Models Can Learn to Hide Their Thoughts from Unseen Activation Monitors3 savers
highlights · 18
An interesting future direction would be to reverse engineer what algorithmic solutions are imple- mented by these models to generate the next state, e.g. by decomposing the logit outputs as in
a635abfdd007c9a698410c8bbe5ebc33-Paper-Conference.pdfIt's in lock screen settings now "turn display off on power adapter when inactive
How can I prevent my macbook from going into sleep mode during several hour download? : r/macThis setting is now located in Settings -> Battery -> Options
How can I prevent my macbook from going into sleep mode during several hour download? : r/macUnder Settings -> Display Scroll all the way to the bottom, click “Advanced.” Turn on “Prevent automatic sleep on power adapter when the screen turns off.” This will work while the Mac is plugged in. Also useful if you have external drives and want them to not eject tall the time.
How can I prevent my macbook from going into sleep mode during several hour download? : r/macIn particular, the term seems to often help represent bigram statistics which aren’t described by more general grammatical rules, such as the fact that “Barack” is often followed by “Obama”.
A Mathematical Framework for Transformer CircuitsTerms of the form will occur in the expanded form of equations for every transformer, corresponding to the “direct path” where a token embedding flows directly down the residual stream to the unembedding, without going through any layers
A Mathematical Framework for Transformer Circuitsattention layers as several completely independent attention heads which operate completely in parallel and each add their output back into the residual stream
A Mathematical Framework for Transformer CircuitsOnce added, information persists in a subspace unless another layer actively deletes it.
A Mathematical Framework for Transformer CircuitsAn attention head is really applying two linear operations, and , which operate on different dimensions and act independently.
A Mathematical Framework for Transformer CircuitsWe find off-policy interventions yield small and unstable effects compared to resampling in decision-making tasks
Thought Branches: Interpreting LLM Reasoning Requires Resamplingwhen a model states a reason for its action, does that reason actually cause the action? In “agentic misalignment” scenarios, we resample specific sentences to measure their downstream effects
Thought Branches: Interpreting LLM Reasoning Requires ResamplingCoT text can causally impact behavior even if it does not straightforwardly “explain” model internals.
Thought Branches: Interpreting LLM Reasoning Requires Resamplingon-policy resampling produces larger and more reliable effects
Thought Branches: Interpreting LLM Reasoning Requires Resamplingnormative self-preservation sentences have small and non-resilient causal impact on models’ final decisions. This raises questions about the degree self-preservation genuinely influences model behavio
Thought Branches: Interpreting LLM Reasoning Requires ResamplingAdapting causal mediation analysis, we find that hints that have a causal effect on the output without being explicitly mentioned exert a subtle and cumulative influence on the CoT that persists even if the hint is removed.
Thought Branches: Interpreting LLM Reasoning Requires ResamplingCritical planning statements resist removal but have large effects when eliminated
Thought Branches: Interpreting LLM Reasoning Requires ResamplingWe introduce a resilience metric that repeatedly resamples to prevent similar content from reappearing downstream
Thought Branches: Interpreting LLM Reasoning Requires ResamplingStarting [at a young age] he’s read everything that he could find about business. The subject that interests him, he’s read newspapers, biographies, trade press. He went over to his grandfather who was a grocer and he read the progressive grocer magazine, and he read articles on how to stock a meat department... What he’s really done is he’s created this immense vertical filing cabinet in his brain of layers and layers and layers of files of information that he can draw back on now for more than 70 years worth of data.
Curius / Onboarding