byrnemluke.com/ideas/questions-about-AI#what-do-humans-spend-their-time-on-in-a-post-agi-world
This is a list of questions I have about AI inspired by conversations with technologists, founders, investors, and researchers. It is also inspired by other lists that I find interesting. It is an evergreen list that I'll continue to update as I learn more about AI - it is very much a list of questions - not answers. Please keep this in mind while you're reading! If you have thoughts about any of these questions, I would love to hear them. GPT-4, Opus and similar models were trained on vast amounts of the world’s public data. What percentage of all usable data does their training set amount to? My intuition says low-double-digit percentage points. Another question is how much high-quality data exists in the world; my suspicion is GPT-4’s training set is a significantly larger percentage of that number. What are the major untapped data silos? Is somebody keeping a list of them somewhere? Examples: Generating useful synthetic data using simulation engines has shown promising results in s
This is a list of questions I have about AI inspired by conversations with technologists, founders, investors, and researchers. It is also inspired by other lists that I find interesting. It is an evergreen list that I'll continue to update as I learn more about AI - it is very much a list of questions - not answers. Please keep this in mind while you're reading! If you have thoughts about any of these questions, I would love to hear them. GPT-4, Opus and similar models were trained on vast amounts of the world’s public data. What percentage of all usable data does their training set amount to