Attack discrimination with smarter machine learning
This page is a companion to a recent paper by Hardt, Price, Srebro, which discusses ways to define and remove discrimination by improving machine learning systems. As machine learning is increasingly used to make important decisions across core social domains, the work of ensuring that these decisions aren't discriminatory becomes crucial. Here we discuss "threshold classifiers," a part of some machine learning systems that is critical to issues of discrimination. A threshold classifier essentially makes a yes/no decision, putting things in one category or another. We look at how these classifiers work, ways they can potentially be unfair, and how you might turn an unfair classifier into a fairer one. As an illustrative example, we focus on loan granting scenarios where a bank may grant or deny a loan based on a single, automatically computed number such as a credit score. In the diagram above, dark dots represent people who would pay off a loan, and the light dots those who wouldn't.
People + AI Research We are Designers People + AI Research (PAIR) is a multidisciplinary team at Google that explores the human side of AI by doing fundamental research, building tools, creating design frameworks, and working with diverse communities. We believe that for machine learning to achieve its positive potential, it needs to be participatory, involving the communities it affects and guided by a diverse set of citizens, policy-makers, activists, artists and more. Check out our work People + AI Guidebook A friendly, practical guide that lays out some best practices for creating
Explore this link on the map →related reading
- Automated Weak-to-Strong Researcheralignment.anthropic.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Google Research: Themes from 2021 and Beyondai.googleblog.com
- Fair AI Tooldesign.google
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- CSET-AI-Triad-Report.pdfcset.georgetown.edu
- Power to the People? Opportunities and Challenges for Participatory AIarxiv.org
- Design in the Era of the Algorithm | Big Mediumbigmedium.com
- Play with AI - No Coding, Train Your Own Modeldesign.google
- Participation is not a Design Fix for Machine Learningarxiv.org
- [AN #70]: Agents that help humans who are still learning about their own preferences — LessWronglesswrong.com
- Survival of the Best Fitsurvivalofthebestfit.com