✳flâneur — a map of the web's best reading
Separating Prediction from Goal-Seeking — LessWrong
lesswrong.com · 957 words · saved by 1 readers
tl;dr: Mixing goal-directedness into cognitive processes that are working to truth-seek about possible futures tends to undermine both truth-seeking…
x Separating Prediction from Goal-Seeking — LessWrong Agency Group Rationality Negotiation Trust and Reputation Rationality Frontpage 34 Separating Prediction from Goal-Seeking by plex 19th Mar 2026 2 min read 0 34 tl;dr: Mixing goal-directedness into cognitive processes that are working to truth-seek about possible futures tends to undermine both truth-seeking and effective pursuit of your goals. Cleanly separating them has nice properties. [Epistemic Status: Mostly empirically observed rather than rigorously justified, but have seen it many times across different people and within myself so
Explore this link on the map →related reading
- The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
- Goal Factoring — LessWronglesswrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- How to Predict the Future - by Santi Ruiz - Statecraftstatecraft.pub
- Why AIs aren't power-seeking yet — LessWronglesswrong.com
- The Parable of Predict-O-Matic — LessWronglesswrong.com
- Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com
- Recursive forecasting: Eliciting long-term forecasts from myopic fitness-seekers — AI Alignment Forumalignmentforum.org
- Intrinsic Power-Seeking: AI Might Seek Power for Power’s Saketurntrout.com
- [1902.09469] Embedded Agencyarxiv.org
- Thinking in Predictions — LessWronglesswrong.com