Files are hard
I haven't used a desktop email client in years. None of them could handle the volume of email I get without at least occasionally corrupting my mailbox. Pine, Eudora, and outlook have all corrupted my inbox, forcing me to restore from backup. How is it that desktop mail clients are less reliable than gmail, even though my gmail account not only handles more email than I ever had on desktop clients, but also allows simultaneous access from multiple locations across the globe? Distributed systems have an unfair advantage, in that they can be robust against total disk failure in a way that desktop clients can't, but none of the file corruption issues I've had have been from total disk failure. Why has my experience with desktop applications been so bad? Well, what sort of failures can occur? Crash consistency (maintaining consistent state even if there's a crash) is probably the easiest property to consider, since we can assume that everything, from the filesystem to the disk, works corre
Files are hard I haven't used a desktop email client in years. None of them could handle the volume of email I get without at least occasionally corrupting my mailbox. Pine, Eudora, and outlook have all corrupted my inbox, forcing me to restore from backup. How is it that desktop mail clients are less reliable than gmail, even though my gmail account not only handles more email than I ever had on desktop clients, but also allows simultaneous access from multiple locations across the globe? Distributed systems have an unfair advantage, in that they can be robust against total disk failure in a
Explore this link on the map →saved by
related reading
- How to do distributed locking - Martin Kleppmann's blogmartin.kleppmann.com
- Durability & Consistency - ZeroFS Documentationzerofs.net
- How To Corrupt An SQLite Database Filesqlite.org
- CS111 Assignment 2: Journaling File System and OS Trustweb.stanford.edu
- A Distributed Systems Reading Listferd.ca
- NYSRGnotes.ekzhang.com
- Operating Systems: Three Easy Piecespages.cs.wisc.edu
- Notes on Distributed Systems for Young Bloods – Something Similarsomethingsimilar.com
- Century-Scale Storagelil.law.harvard.edu
- Linux File System - GeeksforGeeksgeeksforgeeks.org
- On rebooting: the unreasonable effectiveness of turning computers off and on again - Keunwoo Lee's Minimum Viable Homepagekeunwoo.com
- CS111 Section 2: Filesystem Crash Recovery and System Callsweb.stanford.edu