[2402.12875] Chain of Thought Empowers Transformers to Solve Inherently Serial Problems

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2402.12875] Chain of Thought Empowers Transformers to Solve Inherently Serial Problems --> Computer Science > Machine Learning arXiv:2402.12875 (cs) [Submitted on 20 Feb 2024 ( v1 ), last revised 21 Sep 2024 (this version, v4)] Title: Chain of Thought Empowers Transformers to Solve Inherently Serial Problems Authors: Zhiyuan Li , Hong Liu , Denny Zhou , Tengyu Ma View a PDF of the paper titled Chain of Thought Empowers Transformers to Solve Inherently Serial Problems, by Zhiyuan Li and 3 other authors View PDF HTML (experimental) Abstract: Instructing the model to generate a sequence of inter

saved by

• OIeg Viatkin

related reading

• 2402.12875arxiv.org
• [2412.06769] Training Large Language Models to Reason in a Continuous Latent Spacearxiv.org
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• [2305.18654] Faith and Fate: Limits of Transformers on Compositionalityarxiv.org
• Chain of Draft: Thinking Faster by Writing Lessarxiv.org
• [2507.11473] Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetyarxiv.org
• [2512.19428] Attention Is Not What You Needarxiv.org
• [2510.27338] Reasoning Models Sometimes Output Illegible Chains of Thoughtarxiv.org
• [2508.12773] Online Ensemble Transformer for Accurate Cloud Workload Forecasting in Predictive Auto-Scalingarxiv.org
• [2305.04388] Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingarxiv.org
• [2510.24941] Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtarxiv.org
• [2406.02061] Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Modelsarxiv.org