How Discord Stores Trillions of Messages

Engineer Bo Ingram shares insight into how Discord shoulders its traffic and provides a platform for our users to communicate.

How Discord Stores Trillions of Messages Lorem ipsum dolor sit > Mi neque maecenas Engineering & Developers How Discord Stores Trillions of Messages Bo Ingram March 6, 2023 In 2017, we wrote a blog post on how we store billions of messages. We shared our journey of how we started out using MongoDB but migrated our data to Cassandra because we were looking for a database that was scalable, fault-tolerant, and relatively low maintenance. We knew we’d be growing, and we did! We wanted a database that grew alongside us, but hopefully, its maintenance needs wouldn’t grow alongside our storage needs

related reading

• How to Rack 30 Petabytes of Storage | blogsi.inc
• Everything I know about good system designseangoedecke.com
• From Single-Node to Multi-GPU Clusters: How Discord Made Distributed Compute Easy for ML Engineersdiscord.com
• Building and operating a pretty big storage system called S3 | All Things Distributedallthingsdistributed.com
• Making 768 servers look like 1 — PlanetScaleplanetscale.com
• Scaling PostgreSQL to power 800 million ChatGPT users | OpenAIopenai.com
• Building a web search engine from scratch in two months with 3 billion neural embeddingsblog.wilsonl.in
• Report: Discord Business Breakdown & Founding Story | Contrary Researchresearch.contrary.com
• How to design resilient and large scale data systemsblog.dataengineer.io
• Why Discord is switching from Go to Rustdiscord.com
• Production Twitter on One Machine? 100Gbps NICs and NVMe are fast - Tristan Humethume.ca
• An Overview of Distributed PostgreSQL... | Crunchy Data Blogcrunchydata.com