flâneur

Querying Postgres Tables Directly From DuckDB - DuckDB

duckdb.org · 2,526 words · saved by 1 readers

TL;DR: DuckDB can now directly query tables stored in PostgreSQL and speed up complex analytical queries without duplicating data. PostgreSQL is the world’s most advanced open source database (self-proclaimed). From its interesting beginnings as an academic DBMS, it has evolved over the past 30 years into a fundamental workhorse of our digital environment. PostgreSQL is designed for traditional transactional use cases, “OLTP”, where rows in tables are created, updated and removed concurrently, and it excels at this. But this design decision makes PostgreSQL far less suitable for analytical use cases, “OLAP”, where large chunks of tables are read to create summaries of the stored data. Yet there are many use cases where both transactional and analytical use cases are important, for example when trying to gain the latest business intelligence insights into transactional data. There have been some attempts to build database management systems that do well on both workloads, “HTAP”, but in

Querying Postgres Tables Directly from DuckDB – DuckDB Querying Postgres Tables Directly from DuckDB Hannes Mühleisen 2022-09-30 · 14 min TL;DR: DuckDB can now directly query tables stored in PostgreSQL and speed up complex analytical queries without duplicating data. Introduction PostgreSQL is the world's most advanced open source database ( self-proclaimed ). From its interesting beginnings as an academic DBMS , it has evolved over the past 30 years into a fundamental workhorse of our digital environment. PostgreSQL is designed for traditional transactional use cases, "OLTP" , where r

related reading