flâneur — a map of the web's best reading

why assume AGIs will optimize for fixed goals? — LessWrong

lesswrong.com · 13,014 words · saved by 1 readers

When I read posts about AI alignment on LW / AF/ Arbital, I almost always find a particular bundle of assumptions taken for granted: …

x why assume AGIs will optimize for fixed goals? — LessWrong Goal-Directedness AI Frontpage 161 [ Question ] why assume AGIs will optimize for fixed goals? by nostalgebraist 10th Jun 2022 AI Alignment Forum 5 min read A 8 61 161 Ω 45 When I read posts about AI alignment on LW / AF/ Arbital, I almost always find a particular bundle of assumptions taken for granted: An AGI has a single terminal goal [1] . The goal is a fixed part of the AI's structure. The internal dynamics of the AI, if left to their own devices, will never modify the goal. The "outermost loop" of the AI's internal dynamics is

Explore this link on the map →

related reading