DAG Runs — Airflow Documentation
A DAG Run is an object representing an instantiation of the DAG in time. Any time the DAG is executed, a DAG Run is created and all tasks inside it are executed. The status of the DAG Run depends on the tasks states. Each DAG Run is run separately from one another, meaning that you can have many runs of a DAG at the same time. A DAG Run status is determined when the execution of the DAG is finished. The execution of the DAG depends on its containing tasks and their dependencies. The status is assigned to the DAG Run when all of the tasks are in the one of the terminal states (i.e. if there is no possible transition to another state) like success, failed or skipped. The DAG Run is having the status assigned based on the so-called “leaf nodes” or simply “leaves”. Leaf nodes are the tasks with no children. There are two possible terminal states for the DAG Run: success if all of the leaf nodes states are either success or skipped, failed if any of the leaf nodes state is either failed or
Dag Runs - Airflow 3.3.0 Documentation Content Version: 3.3.0 Search docs ⌘ K Content Overview Quick Start Installation of Airflow® Security Tutorials How-to Guides UI Overview Core Concepts Architecture Overview Dags Dag Runs Dag Run Status Data Interval Manual Triggering and Data Intervals Re-run Dag Catchup Backfill UI CLI Re-run Tasks Task Instance History External Triggers Passing Parameters when triggering Dags Wait for a Dag Run Using CLI To Keep in Mind Tasks Operators Sensors TaskFlow Resumable Tasks Executor Auth manager Multi-Team Object Storage Backfill Message Queues XComs Variabl
Explore this link on the map →related reading
- What I know about Apache Airflow so Faraaronlelevier.github.io
- Using Apache Airflow to monitor data pipelinesbiomadeira.github.io
- A guide on Airflow best practicesayc-data.com
- What we learned after running Airflow on Kubernetes for 2 years | by Alexandre Magno Lima Martins | Apache Airflow | Mediummedium.com
- Airflow Architecture: Key Components & Best Practiceshevodata.com
- Manage task and task group dependencies in Airflow | Astronomer Documentationastronomer.io
- Cookbookcookbook.openai.com
- Pass data between tasks | Astronomer Documentationastronomer.io
- Airflow Executors | Astronomer Documentationastronomer.io
- Introduction to Airflow decorators | Astronomer Documentationdocs.astronomer.io
- Durable Execution Solutions | Temporaltemporal.io
- Prefect Cloudapp.prefect.cloud