Ingest data from PostgreSQL CDC - RisingWave
Change Data Capture (CDC) refers to the process of identifying and capturing data changes in a database, and then delivering the changes to a downstream service in real time. RisingWave supports ingesting CDC data from PostgreSQL. Versions 10, 11, 12, 13, 14, 15, and 16 of PostgreSQL are supported. You can ingest CDC data from PostgreSQL into RisingWave in two ways: By default, it is replica. For CDC, you will need to set it to logical in the database configuration file (postgresql.conf) or via a psql command. The following command will change the wal_level. Keep in mind that changing the wal_level requires a restart of the PostgreSQL instance and can affect database performance. NOTE If you choose to create multiple CDC tables without using a shared source, be sure to set max_wal_senders to be greater than or equal to the number of synced tables. By default, max_wal_senders is 10. You can use the following statement to check the privileges of the user to the tables: An example result:
PostgreSQL CDC - RisingWave Documentation Index Fetch the complete documentation index at: /llms.txt Use this file to discover all available pages before exploring further. Skip to main content Need help generating SQL? Use Claude Code or Cursor with the RisingWave MCP server to generate and run SQL interactively. This guide explains how to connect RisingWave to a PostgreSQL database to ingest data changes in real time using the native PostgreSQL CDC source connector. RisingWave’s PostgreSQL CDC connector is compatible with any PostgreSQL-compliant database that supports logical replication, a
Explore this link on the map →saved by
related reading
- Ingest data from self-hosted PostgreSQL | Materialize Documentationmaterialize.com
- Flink CDC for Postgres: Lessons Learned | sap1ens.comsap1ens.com
- Schedule | POSETTE: An Event for Postgres 2024 - Citus Datacitusdata.com
- Debezium and TimescaleDBdebezium.io
- debezium-examples/postgres-toast at main · debezium/debezium-examples · GitHubgithub.com
- Track every PostgreSQL data change using Debezium - DEV Communitydev.to
- Scaling PostgreSQL to power 800 million ChatGPT users | OpenAIopenai.com
- GitHub - toluaina/pgsync: Postgres to Elasticsearch/OpenSearch sync · GitHubgithub.com
- GlassFlow | ClickHouse Data Ingestion: CDC, Backfill & Schema Evolutionglassflow.dev
- Querying Postgres Tables Directly from DuckDB – DuckDBduckdb.org
- How we migrated our PostgreSQL database with 11 seconds downtime – Government Digital Servicegds.blog.gov.uk
- Benchmarking How Workflow Execution Scales on Postgres | DBOSdbos.dev