Teaching LLMs to reason like Bayesians

Google researchers demonstrate how Bayesian teaching through supervised fine-tuning enables LLMs to approximate optimal probabilistic reasoning and generalize to new domains.

Teaching LLMs to reason like Bayesians Skip to main content Teaching LLMs to reason like Bayesians March 4, 2026 Sjoerd van Steenkiste and Tal Linzen, Research Scientists, Google Research We teach LLMs to reason in a Bayesian manner by training them to mimic the predictions of an optimal Bayesian model. Quick links Paper Share Copy link × AI systems based on large language models (LLMs) are increasingly used as agents that interact with users and the world. To do this successfully, LLMs need to construct internal representations of the world and estimate the probability that each of these repr

saved by

• Shubhaankar Sharma

related reading

• DeepSeek-R1arxiv.org
• State of RL for reasoning LLMs | A. Weersaweers.de
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
• The State of Reinforcement Learning for LLM Reasoningmagazine.sebastianraschka.com
• Modifying LLM Beliefs with Synthetic Document Finetuningalignment.anthropic.com
• GenAI Handbookgenai-handbook.github.io
• [2502.19402] General Reasoning Requires Learning to Reason from the Get-goar5iv.labs.arxiv.org
• The State of Reinforcement Learning for LLM Reasoningsebastianraschka.com
• How LLMs Work, Explained Without Math - miguelgrinberg.comblog.miguelgrinberg.com
• Reasoning as Trajectoriesslhleosun.github.io
• As Rocks May Think | Eric Jangevjang.com