[2303.13360] Towards the Scalable Evaluation of Cooperativeness in Language Models

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2303.13360] Towards the Scalable Evaluation of Cooperativeness in Language Models Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Computation and Language arXiv:2303.13360 (cs) [Submitted on 16 Mar 2023] Title: Towards the Scalable Evaluation of Cooperativeness in Language Models Authors: Alan Chan , Maxime Riché , Jesse Clifton View a PDF of the paper titled Towards the Scalable Evaluation of Cooperativeness in Language Models, by Alan Chan and 2 other authors View PDF Abstract:

related reading

• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
• Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
• Group | Sherry Tongshuang Wucs.cmu.edu
• The bitter lesson of LLM evalsparsed.com
• Unsupervised Elicitationalignment.anthropic.com
• [2212.09251] Discovering Language Model Behaviors with Model-Written Evaluationsarxiv.org
• Agent Evaluation: A Detailed Guidecameronrwolfe.substack.com
• Language Models can Solve Computer Tasksarxiv.org
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• [2412.00543] Evaluating the Consistency of LLM Evaluatorsarxiv.org
• When Chain of Thought is Necessary, Language Models Struggle to Evade Monitorsarxiv.org
• [2602.12316] GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theoryarxiv.org