✳flâneur — a map of the web's best reading

What we learned after running Airflow on Kubernetes for 2 years | by Alexandre Magno Lima Martins | Apache Airflow | Medium

medium.com · 3,061 words · saved by 1 readers

Apache Airflow is one of the most important components in our Data Platform, used by different teams inside the business. It powers all of…

What we learned after running Airflow on Kubernetes for 2 years Alexandre Magno Lima Martins 13 min read · Feb 6, 2024 -- 27 Listen Share Press enter or click to view image in full size Apache Airflow is one of the most important components in our Data Platform, used by different teams inside the business. It powers all of our data transformations, fraud detection mechanisms, data science initiatives, and many housekeeping and internal tasks we run at Teya. To put it in perspective, we have over 300 DAGs in production, running more than 5.000 tasks per day, on average. So I would say that we h

Explore this link on the map →

saved by

related reading