Patching the PostgreSQL JDBC Driver
Contributing to the PostgreSQL JDBC Driver to address the issue of runaway WAL growth in Logical Replication Software Engineer This blog post describes a recent contribution from Zalando to the Postgres JDBC driver to address a long-standing issue with the driver’s integration with Postgres’ logical replication that resulted in runaway Write-Ahead Log (WAL) growth. We will describe the issue, how it affected us at Zalando, and detail the fix made upstream in the JDBC driver that fixes the issue for Debezium and all other clients of the Postgres JDBC driver. Builders at Zalando have access to a low-code solution that allows them to declare event streams that source from Postgres databases. Each event stream declaration provisions a micro application, powered by Debezium Engine, that uses Postgres Logical Replication to publish table-level change events as they occur. Capable of publishing events to a variety of different technologies, with arbitrary event transformations via AWS Lambda,
Introduction This blog post describes a recent contribution from Zalando to the Postgres JDBC driver to address a long-standing issue with the driver’s integration with Postgres’ logical replication that resulted in runaway Write-Ahead Log (WAL) growth. We will describe the issue, how it affected us at Zalando, and detail the fix made upstream in the JDBC driver that fixes the issue for Debezium and all other clients of the Postgres JDBC driver. Postgres Logical Replication at Zalando Builders at Zalando have access to a low-code solution that allows them to declare event streams that source f
saved by
related reading
- Overcoming Pitfalls of Postgres Logical Decodingblog.peerdb.io
- Exploring versions of the Postgres logical replication protocolblog.peerdb.io
- Postgres WAL Files and Sequence Numbers | Crunchy Data Blogcrunchydata.com
- PostgreSQL: Documentation: 18: 54.5. Logical Streaming Replication Protocolpostgresql.org
- 28.3. Write-Ahead Logging (WAL)postgresql.org
- The Insatiable Postgres Replication Slot - Gunnar Morlingmorling.dev
- Schedule | POSETTE: An Event for Postgres 2024 - Citus Datacitusdata.com
- Ingest data from self-hosted PostgreSQL | Materialize Documentationmaterialize.com
- debezium-examples/postgres-toast at main · debezium/debezium-examplesgithub.com
- Flink CDC for Postgres: Lessons Learned | sap1ens.comsap1ens.com
- PostgreSQL CDC - RisingWavedocs.risingwave.com
- 8.20. pg_lsn Typepostgresql.org