Behavior Cloning is Miscalibrated - AI Alignment Forum
Behavior cloning (BC) is, put simply, when you have a bunch of human expert demonstrations and you train your policy to maximize likelihood over the human expert demonstrations. It’s the simplest pos…
x Behavior Cloning is Miscalibrated — AI Alignment Forum Calibration Machine Learning (ML) Outer Alignment Reinforcement learning AI Frontpage 36 Behavior Cloning is Miscalibrated by leogao 5th Dec 2021 4 min read 3 36 Behavior cloning (BC) is, put simply, when you have a bunch of human expert demonstrations and you train your policy to maximize likelihood over the human expert demonstrations. It’s the simplest possible approach under the broader umbrella of Imitation Learning, which also includes more complicated things like Inverse Reinforcement Learning or Generative Adversarial Imitation L
saved by
related reading
- Behavior Cloning is Miscalibrated — LessWronglesswrong.com
- Simulators — LessWronglesswrong.com
- Behavioral cloning mysteryseohong.me
- Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
- State of Robot Learning, December 2025vedder.io
- The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
- Alignment Faking Mitigationsalignment.anthropic.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- How hard is it to inoculate against misalignment generalization? — LessWronglesswrong.com
- How far does alignment midtraining generalize?alignment.openai.com
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- You can’t imitation-learn how to continual-learn — LessWronglesswrong.com