The motivation behind CDC | solution-architecture-patterns
Applications start with a small data footprint. Initially, a single database fulfils every data need of the application. When applications evolve, they need to support different data models and data access patterns. For example, they might need a search index to perform full-text searches, a cache to speed up the reads, and a data warehouse for complex analytics on data. Eventually, that simple architecture evolves into something like this.  Practically speaking, no one database can satisfy all those needs simultaneously. Consequently, applications have to use different data storage technologies such as indexes, caches, and warehouses together in their architecture. That forces them to keep their data in multiple places, in a redundant and denormalised manner. When you have multiple versions of the same data set, you need to appoint one as the source of truth, or the authoritative version. That means, when there’s a discrepancy across versions, the source
The motivation behind CDC | solution-architecture-patterns Skip to the content. The motivation behind CDC Applications start with a small data footprint. Initially, a single database fulfils every data need of the application. When applications evolve, they need to support different data models and data access patterns. For example, they might need a search index to perform full-text searches, a cache to speed up the reads, and a data warehouse for complex analytics on data. Eventually, that simple architecture evolves into something like this.  Practically speaki
Explore this link on the map →related reading
- Flink CDC for Postgres: Lessons Learned | sap1ens.comsap1ens.com
- Building data-centric apps with a reactive relational databaseriffle.systems
- Track every PostgreSQL data change using Debezium - DEV Communitydev.to
- Reliable Microservices Data Exchange With the Outbox Patterndebezium.io
- Databricks Change Data Feed (CDF) Explained - dateonic.dateonic.com
- A More Human Approach To Databasesccorcos.github.io
- The Distributed Computing Manifesto | All Things Distributedallthingsdistributed.com
- learning-notes/books/designing-data-intensive-applications.md at master · keyvanakbary/learning-notes · GitHubgithub.com
- GitHub - debezium/debezium: Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues. · GitHubgithub.com
- Introducing Husky, Datadog’s third-generation event store | Datadogdatadoghq.com
- PostgreSQL CDC - RisingWavedocs.risingwave.com
- Cleaned-up transcript of Rich Hickey's talk "Deconstructing the Database" · GitHubgist.github.com