Building a Data Engineering CoE by Richie Bachala | Towards Data Science
As data continues to grow in importance and become more complex, the need for skilled data engineers has never been greater. But what is data engineering, and why is it so important? In this blog post, we will discuss the essential components of a functioning data engineering practice and why data engineering is becoming increasingly critical for businesses today, and how you can build your very own Data Engineering Center of Excellence! I've had the privilege to build, manage, lead, and foster a sizeable high-performing team of data warehouse & ELT engineers for many years. With the help of my team, I have spent a considerable amount of time every year consciously planning and preparing to manage the growth of our data month-over-month and address the changing reporting and analytics needs for our 20000+ global data consumers. We built many data warehouses to store and centralize massive amounts of data generated from many OLTP sources. We've implemented Kimball methodology by creatin
Building a Data Engineering Center of Excellence | Towards Data Science Analytics Building a Data Engineering Center of Excellence The essential components of what it takes to build a functioning data engineering practice relevant to the current day at scale. Richie Bachala Mar 1, 2022 12 min read Share Image by Author As data continues to grow in importance and become more complex, the need for skilled data engineers has never been greater. But what is data engineering, and why is it so important? In this blog post, we will discuss the essential components of a functioning data engineering pr
saved by
related reading
- What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com
- What is analytics engineering? | dbt Labsgetdbt.com
- Things I Wish I Knew When I Was Building a Data Team | Towards Data Sciencetowardsdatascience.com
- What is analytics engineering? | dbt Labsgetdbt.com
- ETL: Core concepts, use sases, and FAQs | dbt Labsgetdbt.com
- Modular data modeling techniques with dbt | dbt Labsgetdbt.com
- Data transformation: methods, workflows, and best practices | dbt Labsgetdbt.com
- From Data Engineer to YAML Engineerjuhache.substack.com
- Writing an engineering strategy. | Irrational Exuberancelethain.com
- How data observability fits into the different stages in the data pipeline | by Mikkel Dengsøe | Mediummedium.com
- The Essential Guide to Enterprise DataOps | eBookrivery.io
- Efficient Data Engineering with Versatile Data Kit - Open Source Blogblogs.vmware.com