Supervise Process, not Outcomes | Ought
ought.org · 3,108 words · saved by 1 readers
Machine learning systems are on a spectrum from process-based to outcome-based. This post explains why Ought is devoted to process-based systems.
Supervise Process, not Outcomes | Ought ought Table of Contents The spectrum Supervising outcomes Supervising process In between process and outcomes It’s better to supervise process than outcomes Differential capabilities: Supervising process helps with long-horizon tasks Alignment: Supervising process is safety by construction In the long run, differential capabilities and alignment converge Two attractors: The race between process- and outcome-based systems Outcome-based optimization is an attractor Process-based optimization could be an attractor, too The state of the race Conclusion Appen
saved by
related reading
- The Plan for Elicit | Oughtought.org
- On-Policy Distillation - Thinking Machines Labthinkingmachines.ai
- Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
- Oversight Assistants: Turning Compute into Understandingbounded-regret.ghost.io
- Simulators — LessWronglesswrong.com
- What failure looks like — LessWronglesswrong.com
- What failure looks like — AI Alignment Forumalignmentforum.org
- The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
- Let's Verify Step by Steparxiv.org
- The Universe from an Intentional Stancecasparoesterheld.com
- ML Systems Will Have Weird Failure Modesbounded-regret.ghost.io
- You can’t imitation-learn how to continual-learn — LessWronglesswrong.com