Building and operating a pretty big storage system called S3 | All Things Distributed

Three distinct perspectives on scale that come along with building and operating a storage system the size of S3.

Building and operating a pretty big storage system called S3 | All Things Distributed Building and operating a pretty big storage system called S3 July 27, 2023 • 6277 words Today, I am publishing a guest post from Andy Warfield , VP and distinguished engineer over at S3. I asked him to write this based on the Keynote address he gave at USENIX FAST '23 that covers three distinct perspectives on scale that come along with building and operating a storage system the size of S3. In today's world of short-form snackable content, we're very fortunate to get an excellent in-depth exposé. It's o

saved by

• Ratan Kaliani
• Adithya V
• Maanav Khaitan
• Information Flow
• Zi T
• pl4nty
• Jianmin Chen

related reading

• Century-Scale Storagelil.law.harvard.edu
• How to Rack 30 Petabytes of Storage | blogsi.inc
• Git at any scalecursor.com
• NYSRGnotes.ekzhang.com
• How to Rack 30 Petabytes of Storage | blogsi.inc
• 10 Lessons from 10 Years of Amazon Web Services | All Things Distributedallthingsdistributed.com
• Notes on Distributed Systems for Young Bloods – Something Similarsomethingsimilar.com
• GitHub - donnemartin/system-design-primer: Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.github.com
• The Distributed Computing Manifesto | All Things Distributedallthingsdistributed.com
• On-demand Container Loading in AWS Lambdaarxiv.org
• homepages.cwi.nl/~boncz/lsde/papers/p215-dageville-snowflake.pdfhomepages.cwi.nl
• I could do that in a weekend!danluu.com