✳flâneur — a map of the web's best reading

Why We Think | Lil'Log

lilianweng.github.io · 8,625 words · saved by 22 readers

Special thanks to John Schulman for a lot of super valuable feedback and direct edits on this post. Test time compute (Graves et al. 2016, Ling, et al. 2017, Cobbe et al. 2021) and Chain-of-thought (CoT) (Wei et al. 2022, Nye et al. 2021), have led to significant improvements in model performance, while raising many research questions. This post aims to review recent developments in how to effectively use test-time compute (i.e. “thinking time”) and why it helps.

Table of Contents Motivation Analogy to Psychology Computation as a Resource Latent Variable Modeling Thinking in Tokens Branching and Editing Parallel Sampling Sequential Revision RL for Better Reasoning External Tool Use Thinking Faithfully Does the Model Tell What it Thinks Faithfully Optimization Pressure on CoT: Good or Bad? Thinking in Continuous Space Recurrent Architecture Thinking Tokens Thinking as Latent Variables Expectation-Maximization Iterative Learning Scaling Laws for Thinking Time What's for Future Citation References Special thanks to John Schulman for a lot of super valuabl

Explore this link on the map →

saved by

related reading