Reasoning as Trajectories
slhleosun.github.io · 1,061 words · saved by 1 readers
LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals
Reasoning as Trajectories LLM Reasoning as Trajectories : Step-Specific Representation Geometry and Correctness Signals Lihao Sun , Hang Dong , Bo Qiao , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan Microsoft ACL 2026 (Main) Paper arXiv Code Chain-of-thought reasoning in LLMs traces structured trajectories through representation space. Step-specific regions become linearly separable with depth, late-step geometry predicts correctness, and trajectory-based steering enables both error correction and reasoning length control at inference time. Step-specific representation structure across layer
saved by
related reading
- the-illusion-of-thinking.pdfml-site.cdn-apple.com
- [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
- As Rocks May Think | Eric Jangevjang.com
- DeepSeek-R1arxiv.org
- Tracing the thoughts of a large language model \ Anthropicanthropic.com
- [2603.07267] How to Steal Reasoning Without Reasoning Tracesarxiv.org
- Is AI Reasoning Right for the Wrong Reasons? | Quanta Magazinequantamagazine.org
- dennyzhou.github.io/LLM-Reasoning-Stanford-CS-25.pdfdennyzhou.github.io
- [2510.24941] Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thoughtarxiv.org
- Training Large Language Models to Reason in a Continuous Latent Spacearxiv.org
- [2203.14465] STaR: Bootstrapping Reasoning With Reasoningarxiv.org
- Thought Anchors: Which LLM Reasoning Steps Matter? — LessWronglesswrong.com