Autarkic Agency Will Likely Migrate Upwards
Epistemic status: Interesting as a mechanism and trend, but obviously highly variable over short timescales and ultimately speculative. On a plane recently I ended up noodling back around to my original concepts of amortised vs direct optimization and also Rudolf’s sequence on wisdom as amortised optimisation. The question that I...
Epistemic status: Interesting as a mechanism and trend, but obviously highly variable over short timescales and ultimately speculative. On a plane recently I ended up noodling back around to my original concepts of amortised vs direct optimization and also Rudolf’s sequence on wisdom as amortised optimisation. The question that I was pondering was how the balance of amortised s direct amortisation is likely to shift in the future, especially a highly polytheistic AI future. In this case, what seems likely to me is that amortised optimisation is broadly likely to increasingly dominate (as…
saved by
related reading
- The Future Worth Building Is Human - Thinking Machines Labthinkingmachines.ai
- An Apple-Picking Model of AI R&D | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- By default, capital will matter more than ever after AGI — LessWronglesswrong.com
- What fully automated firms will look likedwarkeshpatel.com
- Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
- Alex Imas and Phil Trammell – What remains scarce after AGI?dwarkesh.com
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- Towards a scale-free theory of intelligent agencymindthefuture.info
- BCIs and the ecosystem of modular mindsberen.io
- musings and rough draftsmusingsandroughdrafts.com