The Great Data Integration Schlep — LessWrong
This is a little rant I like to give, because it’s something I learned on the job that I’ve never seen written up explicitly. There are a bunch of buzzwords floating around regarding computer technology in an industrial or manufacturing context: “digital transformation”, “the Fourth Industrial Revolution”, “Industrial Internet of Things”. What do those things really mean? Do they mean anything at all? The answer is yes, and what they mean is the process of putting all of a company’s data on computers so it can be analyzed. This is the prerequisite to any kind of “AI” or even basic statistical analysis of that data; before you can start applying your fancy algorithms, you need to get that data in one place, in a tabular format. Each of these machines in a semiconductor fab probably stores its data locally. The team that operates one machine might not be able to see the data from the next one over. In a manufacturing context, a lot of important data is not on computers. Some data is not
x The Great Data Integration Schlep — LessWrong Economic Consequences of AGI World Modeling Curated 279 The Great Data Integration Schlep by sarahconstantin 13th Sep 2024 Rough Diamonds 10 min read 20 279 Midjourney, “Fourth Industrial Revolution Digital Transformation” This is a little rant I like to give, because it’s something I learned on the job that I’ve never seen written up explicitly. There are a bunch of buzzwords floating around regarding computer technology in an industrial or manufacturing context: “ digital transformation” , “ the Fourth Industrial Revolution ”, “ Industrial Inte
saved by
related reading
- The Great Data Integration Schlep - by Sarah Constantinsarahconstantin.substack.com
- The Great Data Integration Schlepsarahconstantin.substack.com
- State of Data (Jan 2026)seancai.com
- Convictionconviction.com
- Convictionconviction.com
- A Stargate for Data - by willdepue - Will DePuewilldepue.substack.com
- Why transformative artificial intelligence is really, really hard to achievethegradient.pub
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- will depue on X: "A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core x.com
- Data bottlenecks won’t prevent an intelligence explosionnewsletter.forethought.org
- Solve Everythingsolveeverything.org
- Many Small Steps for Robots, One Giant Leap for Mankindnotboring.co