Software at Scale 13 - Emma Tang: ex Data Infrastructure Lead, Stripe

Listen now | Effective Management of Big Data Platforms

Emma Tang was the Engineering Manager of the Data Infrastructure team at Stripe. She was also a Lead Software Engineer at Aggregate Knowledge, where she worked on the data platform. We explore the technological and organizational challenges of maintaining big data platforms. We discuss when a company would require a “Big Data” system, what the properties of a good system look like, how some of these systems look like today, some of the tools/frameworks that work well, hiring the right engineers, and unsolved problems in the field. Apple Podcasts | Spotify | Google Podcasts Share Software…

related reading

• Building and operating a pretty big storage system called S3 | All Things Distributedallthingsdistributed.com
• Inside Stripe’s Engineering Culture - Part 1newsletter.pragmaticengineer.com
• What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com
• Scaling Uber with Thuan Pham (Uber’s first CTO)youtube.com
• Inside Stripe’s Engineering Culture: Part 2newsletter.pragmaticengineer.com
• How to design resilient and large scale data systemsblog.dataengineer.io
• From Spark to Databricks: Spark's Origins, Innovations, and What's Next - with Reynold Xinsudipchakrabarti.substack.com
• From Spark to Databricks: Spark's Origins, Innovations, and What's Next - with Reynold Xinsudipchakrabarti.substack.com
• Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Paymentsdwarkeshpatel.com
• I was laid off by Atlassianyoutube.com
• Compliance at scale and why TAM is a distraction with Christina Cacioppo of Vantacheekypint.substack.com
• Patrick Collison on programming languages, AI, and Stripe's biggest engineering decisionsyoutube.com