✳flâneur — a map of the web's best reading

The Use of Knowledge in (AGI) Society

lukedrago.substack.com · 1,457 words · saved by 1 readers

The AI labs are aiming to create AGI that could obsolete all human labor, severing the dependency that powerful actors have on the regular people. If they achieve this, they risk triggering the intelligence curse, leaving humans irrelevant and severing the social contract between regular people and powerful actors. The most ambitious labs are further aiming for a singleton—a single superintelligent system or steering committee with total control over the world—which would further cause unprecedented power concentration and create a single point of failure. We’ve previously argued that you have to build your way out of this problem. We think we now know how. We already have narrowly superintelligent human systems, defined as collections of people that together perform far better than the people within them could perform without the system. They work in large part because they are not single, solitary minds. The best example is markets. Markets are made of different actors that pursue bo

The Use of Knowledge in (AGI) Society How to build to break the intelligence curse Luke Drago and Rudolf Laine Apr 09, 2025 61 21 11 Share Cross-posted by Luke Drago "An avenue for building tech to break the intelligence curse & the concerns discussed in Capital, AGI & Human Ambition." - Rudolf Laine John Henry First Encounters the Steam Drill by Nick Danzi The AI labs are aiming to create AGI that could obsolete all human labor, severing the dependency that powerful actors have on the regular people. If they achieve this, they risk triggering the intelligence curse, leaving humans irrelevant

Explore this link on the map →

related reading