Research update: Towards a Law of Iterated Expectations for Heuristic Estimators — LessWrong
Last week, ARC released a paper called Towards a Law of Iterated Expectations for Heuristic Estimators, which follows up on previous work on formalizing the presumption of independence. Most of the work described here was done in 2023. A brief table of contents for this post: In "Formalizing the Presumption of Independence", we defined a heuristic estimator to be a hypothetical algorithm that estimates the values of mathematical expression based on arguments. That is, a heuristic estimator is an algorithm G that takes as input -- and outputs an estimate of the value of Y that incorporates the information provided by π 1 , … , π m . We denote this estimate by G ( Y ∣ π 1 , … , π m ) .[1] In that paper, we introduced the following question: is there a computationally efficient heuristic estimator that formalizes intuitively valid reasoning about the values of mathematical quantities based on arguments? We studied the question by introducing intuitively desirable coherence propertie
x Research update: Towards a Law of Iterated Expectations for Heuristic Estimators — LessWrong World Modeling AI Frontpage 87 Research update: Towards a Law of Iterated Expectations for Heuristic Estimators by Eric Neyman 7th Oct 2024 AI Alignment Forum 27 min read 2 87 Ω 38 Last week, ARC released a paper called Towards a Law of Iterated Expectations for Heuristic Estimators , which follows up on previous work on formalizing the presumption of independence . Most of the work described here was done in 2023. A brief table of contents for this post: What is a heuristic estimator? (One example a
related reading
- Research update: Towards a Law of Iterated Expectations for Heuristic Estimators — Alignment Research Centeralignment.org
- Competing with sampling — Alignment Research Centeralignment.org
- ARC progress update: Competing with sampling — LessWronglesswrong.com
- As Rocks May Think | Eric Jangevjang.com
- A Mike's-Eye View of ARC's Research — Alignment Research Centeralignment.org
- On The Independence Axiom — LessWronglesswrong.com
- Words of estimative probability - Wikipediaen.wikipedia.org
- How To Think Real Good | Meta-rationalitymetarationality.com
- Gregory Gundersengregorygundersen.com
- Formal verification, heuristic explanations and surprise accounting — Alignment Research Centeralignment.org
- A bird's eye view of ARC's research — Alignment Research Centeralignment.org
- [2605.05179] Estimating the expected output of wide random MLPs more efficiently than samplingarxiv.org