[2506.09501] Give Me FP32 or Give Me Death? Challenges and Solutions for Reproducible Reasoning
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack
[2506.09501] Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inference Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Computation and Language arXiv:2506.09501 (cs) [Submitted on 11 Jun 2025 ( v1 ), last revised 24 Oct 2025 (this version, v2)] Title: Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inference Authors: Jiayi Yuan , Hao Li , Xinheng Ding , Wenya Xie , Yu-Jhe Li , Wentian Zhao , Kun Wan , Jing Shi , Xia Hu , Zirui Liu Vie
Explore this link on the map →related reading
- Defeating Nondeterminism in LLM Inference - Thinking Machines Labthinkingmachines.ai
- [2506.09501] Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inferencearxiv.org
- Non-Determinism of “Deterministic” LLM Settingsarxiv.org
- Prompt Repetition Improves Non-Reasoning LLMsarxiv.org
- State of RL for reasoning LLMs | A. Weersaweers.de
- 2025: The year in LLMssimonwillison.net
- [2406.02061] Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Modelsarxiv.org
- Reasoning as Trajectoriesslhleosun.github.io
- The State of Reinforcement Learning for LLM Reasoningmagazine.sebastianraschka.com
- Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com
- Optimizing inference · Hugging Facehuggingface.co
- The bitter lesson of LLM evalsparsed.com