✳flâneur — a map of the web's best reading

kh's Shortform — LessWrong

lesswrong.com · 3,406 words · saved by 1 readers

Comment by Kaarel - Positives of a future with human capability improvement over an AI future. Beren Millidge has an essay arguing for the claim that a future in which humanity proceeds with biological capability increasing is scarier than a future in which we develop AGI. Here are some concluding sentences from his essay: [...] I disagree with his thesis — I think that instead of creating AIs smarter than humans, it would be much better to proceed with increasing the capabilities of humans (for at least the next 100 years). [1] [2] Millidge's claim that the only potential positive of a biofoom is that it starts later seems clearly false. In this note, I will list other imo important (pro tanto) positives of a human foom. I agree with Millidge that there are also positives of the AGI path; [3] these won't be discussed in the present note. To assess which path is better overall, one could want to compare the positives of the human path to the positives of the AGI path, [4] but I will not do that here. The rest of this note is the list of positives. [5] more similar entity => more similar values an argument in favor of the human path: * assumption 1. it makes sense to speak of the values of an entity, and the values of an entity are some sort of kinda-smooth function of the entity's structure/constitution * assumption 2. humanity (taken as an entity) currently has pretty good values * conclusion. somewhat modified humanity will still have pretty good values. in particular, a somewhat bioenhanced humanity will still have pretty good values * in contrast: an AGI future will involve the-process-happening-on-earth changing a lot more from what it is now, certainly by each point in time, but also by the time each higher capability level is reached we can also give a similar argument for single humans: * assumption 1. it makes sense to speak of the values of an entity, and the values of an entity are some sort of kinda-smooth function of the entity's structure/constitution * ass

x kh's Shortform — LessWrong kh's Shortform by Kaarel 6th Jul 2022 1 min read 46 2 This is a special post for quick takes by Kaarel . Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page . Rendering 0 / 46 comments, sorted by top scoring (show more) Click to highlight new comments since: Today at 7:20 AM Moderation Log More from Kaarel View more Curated and popular this week 46 Comments 46 Comment Permalink Kaarel 3mo * 65 46 Positives of a future with human capability improvement over an AI future. Beren Millidge has an essay arguing fo

Explore this link on the map →

related reading