✳flâneur — a map of the web's best reading
Functional Data Engineering — a modern paradigm for batch data processing | by Maxime Beauchemin | Medium
maximebeauchemin.medium.com · 3,528 words · saved by 1 readers
Batch data processing — historically known as ETL — is extremely challenging. It’s time-consuming, brittle, and often unrewarding. Not only…
Functional Programming Data Engineering Data Warehouse Data Warehousing Data Science Functional Data Engineering — a modern paradigm for batch data processing Maxime Beauchemin 15 min read · Jan 8, 2018 -- 26 Listen Share Batch data processing — historically known as ETL — is extremely challenging . It’s time-consuming, brittle, and often unrewarding. Not only that, it’s hard to operate, evolve, and troubleshoot. In this post, we’ll explore how applying the functional programming paradigm to data engineering can bring a lot of clarity to the process. This post distills fragments of wisdom accu
Explore this link on the map →related reading
- ETL: Core concepts, use sases, and FAQs | dbt Labsgetdbt.com
- Understanding ELT: extract, load, transform | dbt Labsgetdbt.com
- The Distributed Computing Manifesto | All Things Distributedallthingsdistributed.com
- What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com
- Bash-Script vs. Stored Procedure vs. Traditional ETL Tools vs. Python-Script - 📖 Patterns of Data Engineeringdedp.online
- Data transformation: methods, workflows, and best practices | dbt Labsgetdbt.com
- Kimball's Dimensional Data Modeling | The Analytics Setup Guidebookholistics.io
- From Data Engineer to YAML Engineerjuhache.substack.com
- Building a Data Engineering Center of Excellence | Towards Data Sciencetowardsdatascience.com
- Temporal Primer - Building Long-Running Systemsarpitbhayani.me
- Modular data modeling techniques with dbt | dbt Labsgetdbt.com
- Introduction to streaming for data scientistshuyenchip.com