Universal Inductors — AI Alignment Forum
Now that the Logical Induction paper is out, I am directing my attention towards decision theory. The approach I currently think will be most fruitful is attempting to make a logically updateless version of Wei Dai's Updateless Decision Theory. Abram Demski has posted on here about this, but I think Logical Induction provides a new angle with which we can attack the problem. This post will present an alternate way of viewing Logical Induction which I think will be especially helpful for building a logical UDT. (The Logical Induction paper is a prerequisite for this post.) This post will make several informal claims without proof. Many of the claims are analogous to things proven in the Logical Induction paper, and the math is not substantially difficult. I might extend the paper to have a section talking about the following concepts more formally. A Universal Inductor is an infinite sequence { P n } of probability distributions on infinite bit strings. Satisfying the following two pr
x Universal Inductors — AI Alignment Forum Personal Blog 6 Universal Inductors by Scott Garrabrant 14th Sep 2016 2 min read 0 6 Now that the Logical Induction paper is out, I am directing my attention towards decision theory. The approach I currently think will be most fruitful is attempting to make a logically updateless version of Wei Dai's Updateless Decision Theory . Abram Demski has posted on here about this, but I think Logical Induction provides a new angle with which we can attack the problem. This post will present an alternate way of viewing Logical Induction which I think will be es
related reading
- An Intuitive Explanation of Solomonoff Induction — LessWronglesswrong.com
- UDT shows that decision theory is more puzzling than ever — LessWronglesswrong.com
- UDT shows that decision theory is more puzzling than ever — AI Alignment Forumalignmentforum.org
- Martin Soto - Constructing Logically Updateless Decision Theory - PIBBSS Symposium '23youtube.com
- Operationalizing FDT — LessWronglesswrong.com
- Towards a scale-free theory of intelligent agencymindthefuture.info
- On The Independence Axiom — LessWronglesswrong.com
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- Probabilities are not the right concept — LessWronglesswrong.com
- A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org
- In (highly contingent!) defense of interpretability-in-the-loop ML training — AI Alignment Forumalignmentforum.org
- Geometric UDT — LessWronglesswrong.com