[2405.18915] Towards Faithful Chain-of-Thought: Large Language Models are Bridging Reasoners

Large language models (LLMs) suffer from serious unfaithful chain-of-thought (CoT) issues. Previous work attempts to measure and explain it but lacks in-depth analysis within CoTs and does not consider the interactions…

Towards Faithful Chain-of-Thought: Large Language Models are Bridging Reasoners Jiachun Li 1,2 , Pengfei Cao 1,2 , Yubo Chen 1,2 , Kang Liu 1,2 , Jun Zhao 1,2 1 School of Artificial Intelligence, University of Chinese Academy of Sciences 2 The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences {jiachun.li, pengfei.cao, yubo.chen, kliu, jzhao} @nlpr.ia.ac.cn Abstract Large language models (LLMs) suffer from serious unfaithful chain-of-thought (CoT) issues. Previous work attempts to measure and explain it but lacks in-depth

related reading

• Towards Faithful Chain-of-Thought: Large Language Models are Bridging Reasonersarxiv.org
• Measuring Faithfulness in Chain-of-Thought Reasoning \ Anthropicanthropic.com
• the case for CoT unfaithfulness is overstated — LessWronglesswrong.com
• [2305.04388] Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingarxiv.org
• Tracing the thoughts of a large language model \ Anthropicanthropic.com
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Thought Branches: Interpreting LLM Reasoning Requires Resamplingarxiv.org
• [2510.24941] Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtarxiv.org
• Reasoning models don't always say what they think \ Anthropicanthropic.com
• Thought Anchors: Which LLM Reasoning Steps Matter? — LessWronglesswrong.com
• Reasoning as Trajectoriesslhleosun.github.io
• [2505.05410] Reasoning Models Don't Always Say What They Thinkarxiv.org