Mixed Motive Settings
As mentioned in the introductory section, cooperative AI uses many tools and concepts from game theory, a mathematical framework for modelling strategic interactions. In this section, we’ll introduce you to some of the most important tools and concepts, and use these to get a sense for the kind of problems, settings and systems that the field of cooperative AI tends to focus on, and why. Tooltip Text In game theory, multi-agent settings can be classified into three categories: Virtually all interactions you have with other human beings could be described as mixed-motive. In a family, a sports team, a classroom or a workplace you will have different people with different goals that are not perfectly aligned with each other, but neither perfectly opposed. Fully cooperative and fully competitive settings are popular research topics in AI (for example, some of the most talked about breakthroughs in recent AI history are to do with performance in zero-sum games like Go). There are m
Curriculum Curriculum As mentioned in the introductory section, cooperative AI uses many tools and concepts from game theory, a mathematical framework for modelling strategic interactions. In this section, we’ll introduce you to some of the most important tools and concepts, and use these to get a sense for the kind of problems, settings and systems that the field of cooperative AI tends to focus on, and why. Tooltip Text Learning Objectives: Distinguish between fully cooperative, fully competitive, and mixed-motive settings, and explain why most real-world interactions fall along a…
saved by
related reading
- Cooperative AI Competitions Without Spiteful Incentivescooperativeai.com
- Approval-directed agency and the decision theory of Newcomb-like problemslink.springer.com
- Multiverse-wide cooperation in a nutshell — EA Forumforum.effectivealtruism.org
- Embedded Agency (full-text version) — LessWronglesswrong.com
- Ultimate Guide to Game Theory: Principles and Applicationsinvestopedia.com
- The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
- Game theory - Wikipediaen.wikipedia.org
- Towards a scale-free theory of intelligent agencymindthefuture.info
- Cooperative and uncooperative institution designs: Surprises and problems in open-source game theoryarxiv.org
- Core (game theory) - Wikipediaen.wikipedia.org
- [2608.03958] A game theory for foundation models shows new paths to rational cooperation through similarity inferencearxiv.org
- Non-cooperative game theory - Wikipediaen.wikipedia.org