2404.15758

N/A

Let’s Think Dot by Dot: Hidden Computation in Transformer Language Models Jacob Pfau, William Merrill & Samuel R. Bowman Center for Data Science New York University NY, NY 10012, USA {jp6263,willm,bowman}@nyu.edu arXiv:2404.15758v1 [cs.CL] 24 Apr 2024…

related reading

• [2404.15758] Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelsarxiv.org
• Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelsarxiv.org
• 2402.12875arxiv.org
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• 2305.18654arxiv.org
• [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
• Exact Expressive Power of Transformers with Paddingarxiv.org
• Can LLMs Be Computers?percepta.ai
• [2412.06769] Training Large Language Models to Reason in a Continuous Latent Spacearxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org