Software at Scale 13 - Emma Tang: ex Data Infrastructure Lead, Stripe
softwareatscale.dev · 10,042 words · saved by 1 readers
Listen now | Effective Management of Big Data Platforms
Emma Tang was the Engineering Manager of the Data Infrastructure team at Stripe. She was also a Lead Software Engineer at Aggregate Knowledge, where she worked on the data platform. We explore the technological and organizational challenges of maintaining big data platforms. We discuss when a company would require a “Big Data” system, what the properties of a good system look like, how some of these systems look like today, some of the tools/frameworks that work well, hiring the right engineers, and unsolved problems in the field. Apple Podcasts | Spotify | Google Podcasts Share Software…
related reading
- What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com
- Big Data is Deadmotherduck.com
- Building and operating a pretty big storage system called S3 | All Things Distributedallthingsdistributed.com
- From Spark to Databricks: Spark's Origins, Innovations, and What's Next - with Reynold Xinsudipchakrabarti.substack.com
- How to design resilient and large scale data systemsblog.dataengineer.io
- Inside Stripe’s Engineering Culture - Part 1newsletter.pragmaticengineer.com
- Contract-driven Data Platform | Andrew Jones, Modern Data 101moderndata101.substack.com
- Databricks (Pre IPO) Primer and a Requiem for Hadoopnewsletter.tidalwaveresearch.com
- How the Community Turned Into a SaaS Commercialluminousmen.com
- Home - Confessions of a Data Guyconfessionsofadataguy.com
- The Great Data Integration Schlep — LessWronglesswrong.com
- How Scale Kills Data Teamsdataproducts.substack.com