Cached Thoughts
One of the single greatest puzzles about the human brain is how the damn thing works at all when most neurons fire 10–20 times per second, or 200Hz tops. In neurology, the “hundred-step rule” is that any postulated operation has to complete in at most 100 sequential steps—you can be as parallel as you like, but you can’t postulate more than 100 (preferably fewer) neural spikes one after the other. Can you imagine having to program using 100Hz CPUs, no matter how many of them you had? You’d also need a hundred billion processors just to get anything done in realtime. If you did need to write realtime programs for a hundred billion 100Hz processors, one trick you’d use as heavily as possible is caching. That’s when you store the results of previous operations and look them up next time, instead of recomputing them from scratch. And it’s a very neural idiom—recognition, association, completing the pattern. It’s a good guess that the actual majority of human cognition consists of cache loo
Cached Thoughts Source Markdown · Talk Home About Search Contents Cached Thoughts ❦ One of the single greatest puzzles about the human brain is how the damn thing works at all when most neurons fire 10–20 times per second, or 200Hz tops. In neurology, the “hundred-step rule” is that any postulated operation has to complete in at most 100 sequential steps—you can be as parallel as you like, but you can’t postulate more than 100 (preferably fewer) neural spikes one after the other. Can you imagine having to program using 100Hz CPUs, no matter how many of them you had? You’d also need a hundred b
Explore this link on the map →saved by
related reading
- Cached Thoughts — LessWronglesswrong.com
- The Unbearable Slowness of Beingarxiv.org
- Neuralink and the Brain's Magical Future — Wait But Whywaitbutwhy.com
- A Pattern Recognition Theory of Mind - Forte Labsfortelabs.com
- Notes on Puzzles — Nabeel S. Qureshinabeelqu.co
- Mental Models: The Best Way to Make Intelligent Decisions (~100 Models Explained)fs.blog
- How To Understand Things - Nabeel S. Qureshinabeelqu.substack.com
- https://io0.github.ioio0.github.io
- How to Think | MIT Technology Reviewtechnologyreview.com
- Continuous Thought Machinespub.sakana.ai
- Tuning your Cognitive Strategies — LessWronglesswrong.com
- "How could I have thought that faster?" — LessWronglesswrong.com