flâneur

Production Twitter on One Machine? 100Gbps NICs and NVMe are fast - Tristan Hume

thume.ca · 8,545 words · saved by 4 readers

In this post I’ll attempt the fun stunt of designing a system that could serve the full production load of Twitter with most of the features intact on a single (very powerful) machine. I’ll start by showing off a Rust prototype of the core tweet distribution data structure handling 35x full load by fitting the hot set in RAM and parallelizing with atomics, and then do math around how modern high-performance storage and networking might let you serve a close-to-fully-featured Twitter on one machine.

Production Twitter on One Machine? 100Gbps NICs and NVMe are fast - Tristan Hume Tristan Hume Github Resume + Project List Blog Production Twitter on One Machine? 100Gbps NICs and NVMe are fast --> In this post I’ll attempt the fun stunt of designing a system that could serve the full production load of Twitter with most of the features intact on a single (very powerful) machine. I’ll start by showing off a Rust prototype of the core tweet distribution data structure handling 35x full load by fitting the hot set in RAM and parallelizing with atomics, and then do math around how modern high-per

saved by

related reading