[2402.12875] Chain of Thought Empowers Transformers to Solve Inherently Serial Problems

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2402.12875] Chain of Thought Empowers Transformers to Solve Inherently Serial Problems --> Computer Science > Machine Learning arXiv:2402.12875 (cs) [Submitted on 20 Feb 2024 ( v1 ), last revised 21 Sep 2024 (this version, v4)] Title: Chain of Thought Empowers Transformers to Solve Inherently Serial Problems Authors: Zhiyuan Li , Hong Liu , Denny Zhou , Tengyu Ma View a PDF of the paper titled Chain of Thought Empowers Transformers to Solve Inherently Serial Problems, by Zhiyuan Li and 3 other authors View PDF HTML (experimental) Abstract: Instructing the model to generate a sequence of inter

saved by

• OIeg Viatkin

related reading

• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• [2305.18654] Faith and Fate: Limits of Transformers on Compositionalityarxiv.org
• Transformer Circuits Threadtransformer-circuits.pub
• the-illusion-of-thinking.pdfml-site.cdn-apple.com
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Transformers from Scratche2eml.school
• [2510.24941] Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtarxiv.org
• (Some of) The Models, They Just Don't Want to Learn | Tildeblog.tilderesearch.com
• Chain-of-Thought Promptinglearnprompting.org
• Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
• Explore | alphaXivalphaxiv.org
• The Unintelligibility is Ours: Notes on Chain of Thought1a3orn.com