Ingest data from self-hosted PostgreSQL | Materialize Documentation
This page shows you how to stream data from a self-hosted PostgreSQL database to Materialize using the PostgreSQL source. Make sure you are running PostgreSQL 11 or higher. Make sure you have access to your PostgreSQL instance via psql, or your preferred SQL client. Materialize uses PostgreSQL’s logical replication protocol to track changes in your database and propagate them to Materialize. Enable your PostgreSQL’s logical replication. As a superuser, use psql (or your preferred SQL client) to connect to your PostgreSQL database. Check if logical replication is enabled; that is, check if the wal_level is set to logical: If wal_level setting is not set to logical: In the database configuration file (postgresql.conf), set wal_level value to logical. Restart the database in order for the new wal_level to take effect. Restarting can affect database performance. In the SQL client connected to PostgreSQL, verify that replication is now enabled (i.e., verify wal_level setting is set to logic
Ingest data from self-hosted PostgreSQL | Materialize Documentation All Topics Home / Ingest data / PostgreSQL Ingest data from self-hosted PostgreSQL View as Markdown This page shows you how to stream data from a self-hosted PostgreSQL database to Materialize using the PostgreSQL source . 💡 Tip: For help getting started with your own data, you can schedule a free guided trial . Before you begin Make sure you are running PostgreSQL 11 or higher. Make sure you have access to your PostgreSQL instance via psql , or your preferred SQL client. A. Configure PostgreSQL 1. Enable logical replication
Explore this link on the map →saved by
related reading
- PostgreSQL CDC - RisingWavedocs.risingwave.com
- Schedule | POSETTE: An Event for Postgres 2024 - Citus Datacitusdata.com
- Debezium and TimescaleDBdebezium.io
- Flink CDC for Postgres: Lessons Learned | sap1ens.comsap1ens.com
- PostgreSQL: Documentation: 18: 54.5. Logical Streaming Replication Protocolpostgresql.org
- debezium-examples/postgres-toast at main · debezium/debezium-examples · GitHubgithub.com
- Scaling PostgreSQL to power 800 million ChatGPT users | OpenAIopenai.com
- How we migrated our PostgreSQL database with 11 seconds downtime – Government Digital Servicegds.blog.gov.uk
- Streaming ingestion to a materialized view - Amazon Redshiftdocs.aws.amazon.com
- GitHub - toluaina/pgsync: Postgres to Elasticsearch/OpenSearch sync · GitHubgithub.com
- Track every PostgreSQL data change using Debezium - DEV Communitydev.to
- GitHub - sdw-online/postgres-dwh: A Postgres data warehouse for processing synthetic data using IAC principles · GitHubgithub.com