Autarkic Agency Will Likely Migrate Upwards
Epistemic status: Interesting as a mechanism and trend, but obviously highly variable over short timescales and ultimately speculative. On a plane recently I ended up noodling back around to my original concepts of amortised vs direct optimization and also Rudolf’s sequence on wisdom as amortised optimisation. The question that I...
Epistemic status: Interesting as a mechanism and trend, but obviously highly variable over short timescales and ultimately speculative. On a plane recently I ended up noodling back around to my original concepts of amortised vs direct optimization and also Rudolf’s sequence on wisdom as amortised optimisation. The question that I was pondering was how the balance of amortised s direct amortisation is likely to shift in the future, especially a highly polytheistic AI future. In this case, what seems likely to me is that amortised optimisation is broadly likely to increasingly dominate (as…
saved by
related reading
- By default, capital will matter more than ever after AGI — LessWronglesswrong.com
- Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
- BCIs and the ecosystem of modular mindsberen.io
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- Towards a scale-free theory of intelligent agencymindthefuture.info
- Persistent Path-Dependence: Why Our Actions Matter Long-Termforethought.org
- What fully automated firms will look likedwarkeshpatel.com
- Solipsistic Superintelligence is Unlikely to be Cooperativearxiv.org
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- [2206.13353] Is Power-Seeking AI an Existential Risk?arxiv.org
- Coasean economics of agent swarmspathwaysai.org