Why is observability so expensive?
It’s no secret that observability costs are top of mind for many organizations in the post-zero interest rate phenomenon (ZIRP) era (see here, here, and here for example discussions, though similar sentiments can be found far and wide). Organizations are frustrated with the percentage of infrastructure spend (sometimes > 25%!) allocated towards logging, metrics, and traces, and are struggling to understand how much of this data is actually utilized (i.e., yields real business value) once stored. Meanwhile vendors are tripping over each other trying to come up with the next great incremental innovation in pricing models and overall cost reduction techniques for storing logs, metrics, and traces. To be clear, there is some innovative and exciting work happening in areas like: These techniques will possibly lead to better customer experience and lower bills over time. Yet, they are still a small iteration on the basic formula that we have been using for distributed system monitoring and o
It’s no secret that observability costs are top of mind for many organizations in the post-zero interest rate phenomenon (ZIRP) era (see here , here , and here for example discussions, though similar sentiments can be found far and wide). Organizations are frustrated with the percentage of infrastructure spend ( sometimes > 25%! ) allocated towards logging, metrics, and traces, and are struggling to understand how much of this data is actually utilized (i.e., yields real business value) once stored. Meanwhile vendors are tripping over each other trying to come up with the next great incrementa
saved by
related reading
- All you need is Wide Events, not “Metrics, Logs and Traces”isburmistrov.substack.com
- The Problem with OpenTelemetrycra.mr
- Monitoring is a Painmatduggan.com
- How data observability fits into the different stages in the data pipeline | by Mikkel Dengsøe | Mediummedium.com
- How to Rack 30 Petabytes of Storage | blogsi.inc
- Observability Data Lake | Criblcribl.io
- Datadog costs that high? : r/kubernetesreddit.com
- Notes on Vendor Neutral Observability Instrumentationericmustin.substack.com
- Grafana Labs at KubeCon: What is the Future of Observability?grafana.com
- What Full-Stack Observability Requires Todaynewrelic.com
- The Cost of Cloud, a Trillion Dollar Paradox | Andreessen Horowitza16z.com
- OpenTelemetry: A Guide to Observability with Go | Blog | Luca Cavallinlucavall.in