Ingest data from self-hosted PostgreSQL | Materialize Documentation
This page shows you how to stream data from a self-hosted PostgreSQL database to Materialize using the PostgreSQL source. Make sure you are running PostgreSQL 11 or higher. Make sure you have access to your PostgreSQL instance via psql, or your preferred SQL client. Materialize uses PostgreSQL’s logical replication protocol to track changes in your database and propagate them to Materialize. Enable your PostgreSQL’s logical replication. As a superuser, use psql (or your preferred SQL client) to connect to your PostgreSQL database. Check if logical replication is enabled; that is, check if the wal_level is set to logical: If wal_level setting is not set to logical: In the database configuration file (postgresql.conf), set wal_level value to logical. Restart the database in order for the new wal_level to take effect. Restarting can affect database performance. In the SQL client connected to PostgreSQL, verify that replication is now enabled (i.e., verify wal_level setting is set to logic
Ingest data from self-hosted PostgreSQL | Materialize Documentation All Topics Home / Ingest data / PostgreSQL Ingest data from self-hosted PostgreSQL View as Markdown This page shows you how to stream data from a self-hosted PostgreSQL database to Materialize using the PostgreSQL source . 💡 Tip: For help getting started with your own data, you can schedule a free guided trial . Before you begin Make sure you are running PostgreSQL 11 or higher. Make sure you have access to your PostgreSQL instance via psql , or your preferred SQL client. A. Configure PostgreSQL 1. Enable logical replication
saved by
related reading
- Exploring versions of the Postgres logical replication protocolblog.peerdb.io
- PostgreSQL CDC - RisingWavedocs.risingwave.com
- Overcoming Pitfalls of Postgres Logical Decodingblog.peerdb.io
- PostgreSQL: Documentation: 18: 54.5. Logical Streaming Replication Protocolpostgresql.org
- Postgres WAL Files and Sequence Numbers | Crunchy Data Blogcrunchydata.com
- debezium-examples/postgres-toast at main · debezium/debezium-examplesgithub.com
- Patching the PostgreSQL JDBC Driverengineering.zalando.com
- Debezium and TimescaleDBdebezium.io
- Schedule | POSETTE: An Event for Postgres 2024 - Citus Datacitusdata.com
- Flink CDC for Postgres: Lessons Learned | sap1ens.comsap1ens.com
- An Overview of Distributed PostgreSQL... | Crunchy Data Blogcrunchydata.com
- Making 768 servers look like 1 — PlanetScaleplanetscale.com