On benchmarking — PlanetScale
planetscale.com · 2,620 words · saved by 1 readers
Benchmarking is hard. Done wrong it is very misleading, and unfortunately it is frequently done wrong. Let's explore how not to make silly mistakes.
On benchmarking Ben Dicken [ @ BenjDicken ] | May 5, 2026 Benchmarking is hard. There are many ways to do it wrong and few to do it right. But zooming out from any single system or harness, there are broad principles that should be applied to all benchmarking. Using these correctly makes it difficult to produce biased results. Am I the world's best benchmarker? Certainly not. I invented the language balls , after all. But correctness and precision are important parts of PlanetScale's culture. We've spent considerable time learning the art of benchmarking, and are here to share best-practices.
saved by
related reading
- Benchmarking How Workflow Execution Scales on Postgres | DBOSdbos.dev
- abseil / Performance Hintsabseil.io
- Making 768 servers look like 1 — PlanetScaleplanetscale.com
- An Overview of Distributed PostgreSQL... | Crunchy Data Blogcrunchydata.com
- Napkinsirupsen.com
- Notes on Distributed Systems for Young Bloods – Something Similarsomethingsimilar.com
- Growth Benchmarks Are (Mostly) Useless - Brian Balfourbrianbalfour.com
- sled theoretical performance guide | sled-rs.github.iosled.rs
- sled theoretical performance guide | sled-rs.github.iosled.rs
- Scaling PostgreSQL to power 800 million ChatGPT users | OpenAIopenai.com
- Analysesjepsen.io
- Why Percentiles Don’t Work the Way You Think - SolarWinds Blogorangematter.solarwinds.com