flâneur

Why I’m optimistic about our alignment approach

aligned.substack.com · 6,588 words · saved by 1 readers

Some arguments in favor and responses to common objections

Why I’m optimistic about our alignment approach Some arguments in favor and responses to common objections Jan Leike Dec 05, 2022 62 16 2 Share OpenAI’s approach to alignment research involves perfecting RLHF , AI-assisted human evaluation , and automated alignment research . Why is this a good strategy? What are the reasons to be optimistic about it? My optimism stems from five sources: Positive updates about AI. A lot of developments over the last few years have made AI systems more favorable to alignment than they looked initially, both in terms of how the AI tech tree is shaking out and th

related reading