flâneur

The Biosingularity Alignment Problem Seems Harder than AI Alignment

beren.io · 5,002 words · saved by 3 readers

One alternative to the AI-driven singularity that is sometimes proposed is effectively the biosingularity, specifically focused on human intelligence augmentation. The idea here is that we first create what is effectively a successor species of highly enhanced humans and then these transhumans are better placed to solve the alignment problem....

One alternative to the AI-driven singularity that is sometimes proposed is effectively the biosingularity, specifically focused on human intelligence augmentation. The idea here is that we first create what is effectively a successor species of highly enhanced humans and then these transhumans are better placed to solve the alignment problem. To create these high IQ transhumans, the typical plan would involve something like iterated embryo selection for IQ and likely other traits which, in theory, by simply removing deleterious-for-IQ mutations and adding IQ-benefiting mutations, could…

saved by

related reading