irmckenzie.co.uk/round2

At the end of the second and final round of the Inverse Scaling Prize, we’re awarding 7 more Third Prizes. The Prize aimed to identify important tasks on which language models (LMs) perform worse the larger they are (“inverse scaling”). Inverse scaling may reveal cases where LM training actively encourages behaviors that are misaligned with human preferences. The contest started on June 27th and concluded on October 27th, 2022 – thanks to everyone who participated! Across the two rounds, we had over 80 unique submissions and gave out a total of 11 Third Prizes. We are also accepting updates to two previous prize-winners (quote-repetition and redefine-math). For more details on the first round winners, see the Round 1 Announcement Post. We didn't find the kind of robust, major long-term-relevant problems that would have warranted a grand prize, but these submissions represent interesting tests of practically important issues and that help contribute to our scientific understanding of la

Inverse Scaling Prize: Second Round Winners At the end of t he second and final round of the Inverse Scaling Prize , we're awarding 7 more Third Prizes. The Prize aimed to identify important tasks on which language models (LMs) perform worse the larger they are ("inverse scaling"). Inverse scaling may reveal cases where LM training actively encourages behaviors that are misaligned with human preferences. The contest started on June 27th and concluded on October 27th , 2022 - thanks to everyone who participated! Across the two rounds, we had over 80 unique submissions and gave out a total of 11

related reading

• GitHub - inverse-scaling/prize: A prize for finding tasks that cause large language models to show inverse scalinggithub.com
• Announcing the Inverse Scaling Prize ($250k Prize Pool) — AI Alignment Forumalignmentforum.org
• Recursive Language Models | Alex L. Zhangalexzhang13.github.io
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• machine learning imindslice.substack.com
• [2602.05970] Inverse Depth Scaling From Most Layers Being Similararxiv.org
• Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• [2607.14111] Introspection Fine-Tuning (IFT): Training Small LLMs to Introspectarxiv.org
• Thoughts on the Alignment Implications of Scaling Language Models | Leo Gaobmk.sh
• Language Models can Solve Computer Tasksarxiv.org