Position: It's Time to Optimize for Self-Consistency

N/A

# link_axau4agk3j.pdf ## Metadata - PDFFormatVersion=1.5 - IsLinearized=true - IsAcroFormPresent=false - IsXFAPresent=false - IsCollectionPresent=false - IsSignaturesPresent=false - Author=Itamar Pres, Belinda Z. Li, Laura Ruis, Zifan Carl Guo, Keya Hu, Mehul Damani, Isha Puri, Ekdeep Singh Lubana, Jacob Andreas - CreationDate=D:20260305233138Z - Creator=LaTeX with hyperref - Keywords=Machine Learning, ICML - ModDate=D:20260305233138Z - Custom.PTEX.Fullbanner=This is pdfTeX, Version 3.141592653-2.6-1.40.26 (TeX Live 2024) kpathsea version 6.4.0 - Producer=pdfTeX-1.40.26 - Subject=Proceedings o

saved by

• Vincent Huang
• Christine Ye

related reading

• Self-Adapting Language Modelsarxiv.org
• NL.pdfabehrouz.github.io
• [2510.27062] Consistency Training Helps Stop Sycophancy and Jailbreaksarxiv.org
• [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• pdfopenreview.net
• [2607.14111] Introspection Fine-Tuning (IFT): Training Small LLMs to Introspectarxiv.org
• Training Language Models to Explain Their Own Computationsarxiv.org
• [2605.15220] Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Timearxiv.org
• Self-CTRL: Self-Consistency Training with Reinforcement Learningarxiv.org
• [2602.17616] Stable Asynchrony: Variance-Controlled Off-Policy RL for LLMsarxiv.org