What does the universal prior actually look like? | Ordinary Ideas
Suppose that we use the universal prior for sequence prediction, without regard for computational complexity. I think that the result is going to be really weird, and that most people don’t appreciate quite how weird it will be. I’m not sure whether this matters at all. I do think it’s an interesting question, and that there is meaningful philosophical progress to be made by thinking about these topics. I’m not sure where that progress matters either, but it’s also interesting and there is some reasonable chance that it will turn out to be useful in a hard-to-anticipate way. (Warning: this post is quite weird, and not very clearly written. It’s basically a more rigorous version of this post from 4 years ago.) Suppose that it’s the year 2020 and that we build a camera for our AI to use, collect a sequence of bits from the camera, and then condition the universal prior on that sequence. Moreover, suppose that we are going to use those predictions to make economically significant decision
Suppose that we use the universal prior for sequence prediction, without regard for computational complexity. I think that the result is going to be really weird , and that most people don’t appreciate quite how weird it will be. I’m not sure whether this matters at all. I do think it’s an interesting question, and that there is meaningful philosophical progress to be made by thinking about these topics. I’m not sure where that progress matters either, but it’s also interesting and there is some reasonable chance that it will turn out to be useful in a hard-to-ant
Explore this link on the map →related reading
- The Solomonoff Prior is Malign — LessWronglesswrong.com
- Universal prior — LessWronglesswrong.com
- An Intuitive Explanation of Solomonoff Induction — LessWronglesswrong.com
- Probabilities are not the right concept — LessWronglesswrong.com
- Better priors as a safety problem — LessWronglesswrong.com
- Towards a better circuit prior: Improving on ELK state-of-the-art — LessWronglesswrong.com
- The Absolute Self-Selection Assumption — LessWronglesswrong.com
- A Semitechnical Introductory Dialogue on Solomonoff Induction — LessWronglesswrong.com
- A Semitechnical Introductory Dialogue on Solomonoff Induction — AI Alignment Forumalignmentforum.org
- [1709.08568] The Consciousness Priorarxiv.org
- Pascal's Mugging: Tiny Probabilities of Vast Utilities — LessWronglesswrong.com
- Priors and Prejudice — EA Forumforum.effectivealtruism.org