Brain Efficiency: Much More than You Wanted to Know — LessWrong
What if the brain is highly efficient? To be more specific, there are several interconnected key measures of efficiency for physical learning machines: Why should we care? Brain efficiency matters a great deal for AGI timelines and takeoff speeds, as AGI is implicitly/explicitly defined in terms of brain parity. If the brain is about 6 OOM away from the practical physical limits of energy efficiency, then roughly speaking we should expect about 6 OOM of further Moore's Law hardware improvement past the point of brain parity: perhaps two decades of progress at current rates, which could be compressed into a much shorter time period by an intelligence explosion - a hard takeoff. But if the brain is already near said practical physical limits, then merely achieving brain parity in AGI at all will already require using up most of the optimizational slack, leaving not much left for a hard takeoff - thus a slower takeoff. In worlds where brains are efficient, AGI is first feasible only near
x Brain Efficiency: Much More than You Wanted to Know — LessWrong AI Takeoff Biology Physics AI Frontpage 218 Brain Efficiency: Much More than You Wanted to Know by jacob_cannell 6th Jan 2022 34 min read 103 218 What if the brain is highly efficient ? To be more specific, there are several interconnected key measures of efficiency for physical learning machines: energy efficiency in ops/J spatial efficiency in ops/mm^2 or ops/mm^3 speed efficiency in time/delay for key learned tasks circuit/compute efficiency in size and steps for key low level algorithmic tasks [1] learning/data efficiency in
Explore this link on the map →related reading
- AI Timelines via Cumulative Optimization Power: Less Long, More Short — LessWronglesswrong.com
- Why AGI Will Not Happen - Tim Dettmerstimdettmers.com
- The Unbearable Slowness of Beingarxiv.org
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- INTELLIGENCEstacks.stanford.edu
- Neuralink and the Brain's Magical Future — Wait But Whywaitbutwhy.com
- The Scaling Hypothesis · Gwern.netgwern.net
- GPUs vs Brains. Hardware and Architectureberen.io
- What If We Had Bigger Brains? Imagining Minds beyond Ours-Stephen Wolfram Writingswritings.stephenwolfram.com
- Tick, tock, tick, tock… BING | vetta projectvetta.org
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- Fermi estimate of future training runsdanieldewey.net