Comments - Give AIs a stake in the future

dwarkesh.com · 710 words · saved by 1 readers

This manages to almost completely ignore the problem while jumping to policy recommendation (no regulation, accelerate). 1. Stability of the political system: stability of state redistributing the AI generated wealth likely requires humans keep very large influence in the political system and some form of control over the state. Examples where some group lost all econ power but kept political power seem rare or nonexistent (cf european aristocracy). US government governing Apple is not particularly strong argument: one fact about economy which have not changed for more than a century is labour share on GDP. Given the fact that humans are the dominant factor in the economy, government also needs them as power base. Unfortunately we are discussing a scenario where this changes, leading to risk of state becoming misaligned (cf https://gradual-disempowerment.ai/misaligned-states, https://intelligence-curse.ai/) 2. Indexing is hard / Capital ownership will not prevent human disempowerment h

Enjoyed the post. Related ideas in Salib/Goldstein’s paper on ‘AI Rights for Human Safety’ and Batell’s ‘Rewriting the Game Between Humans and AGI’ on the need for incentive alignment as a backup plan in case technical alignment doesn’t pan out: “Historically, the primary (but still severely underinvested) approach to this challenge has been technical: to proactively align AGIs' internal goals or values with human goals or values. Despite acceleration across multiple fronts (interpretability, red-teaming, constitutional AI, RLHF), many researchers remain concerned these techniques won't…

Comments - Give AIs a stake in the future

related reading