nverse-scaling/prize: A prize for finding tasks that cause large language models to show inverse scaling

A prize for finding tasks that cause large language models to show inverse scaling

TL;DR: Win up to $100,000 for finding an important task where larger language models do worse. Submissions due August 27, 2022 (Round 1) and October 27, 2022 (Round 2). The contest has ended! Results: Round 1, Round 2. Recent changes 11 October, 2023 Added Modus Tollens caveat to data-release README 21 March, 2023 Updated prize pool info 1 March, 2023 Released data for all winning tasks 17 December, 2022 Updated prize eligibility for FAR employees 12 December, 2022 Added prize terms update to the ‘Prize information’ section Updated ‘About us’ 9 October, 2022 Added Huggingface…

saved by

• Sheldon Huang

related reading

• Announcing the Inverse Scaling Prize ($250k Prize Pool) — AI Alignment Forumalignmentforum.org
• irmckenzie.co.uk/round2irmckenzie.co.uk
• The Scaling Hypothesis · Gwern.netgwern.net
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• GitHub - openai/parameter-golf: Train the smallest LM you can that fits in 16MB. Best model wins!github.com
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• [2210.11416] Scaling Instruction-Finetuned Language Modelsarxiv.org
• [2602.05970] Inverse Depth Scaling From Most Layers Being Similararxiv.org
• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
• Thoughts on the Alignment Implications of Scaling Language Models | Leo Gaobmk.sh