[2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Models

Abstract:We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning. In particular, we show how such reasoning abilities emerge naturally in sufficiently large language models via a simple method called chain of thought prompting, where a few chain of thought demonstrations are provided as exemplars in prompting. Experiments on three large language models show that chain of thought prompting improves performance on a range of arithmetic, commonsense, and symbolic reasoning tasks. The empirical gains can be striking. For instance, prompting a 540B-parameter language model with just eight chain of thought exemplars achieves state of the art accuracy on the GSM8K benchmark of math word problems, surpassing even finetuned GPT-3 with a verifier.

# link_hv3ugsn3dh.pdf ## Metadata - PDFFormatVersion=1.5 - IsLinearized=false - IsAcroFormPresent=false - IsXFAPresent=false - IsCollectionPresent=false - IsSignaturesPresent=false - CreationDate=D:20230112010630Z - Creator=LaTeX with hyperref - ModDate=D:20230112010630Z - Custom.PTEX.Fullbanner=This is pdfTeX, Version 3.14159265-2.6-1.40.21 (TeX Live 2020) kpathsea version 6.3.2 - Producer=pdfTeX-1.40.21 - Trapped=False ## Contents ### Page 1 Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter Fei Xia Ed H. C

saved by

• Eric Chang
• Jacky Zhao
• Lydia Nottingham

related reading

• [2201.11903] Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Language Models Perform Reasoning via Chain of Thoughtai.googleblog.com
• DeepSeek-R1arxiv.org
• Tracing the thoughts of a large language model \ Anthropicanthropic.com
• Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrouai.googleblog.com
• the-illusion-of-thinking.pdfml-site.cdn-apple.com
• Do Large Language Models (LLMs) reason? | Shapedshaped.ai
• [2205.11916] Large Language Models are Zero-Shot Reasonersarxiv.org
• Reasoning as Trajectoriesslhleosun.github.io
• Chain-of-Thought Promptinglearnprompting.org
• The Unintelligibility is Ours: Notes on Chain of Thought1a3orn.com
• Reasoning Models Reason Well, Until They Don'tarxiv.org