Scheduling
a
batch
job using
airflow
has many benefits. some of them are:-
1. Airflow is completely
open
source
and
free
to use and can be deployed on VM, docker, and Kubernetes.
2. Airflow provides a nice
UI
, using which a user can manage jobs, secrets, connections, etc.
3. Airflow UI shows the previous DAG runs in
graphical
representation
. Users can also check the logs for the failed job.
4. Users can define the airflow job in the form of code check-in to any
version
control
system like
git
.
5. User can enable airflow to sync the DAG from
GitHub
automatically.
6. Users can easily set up
slack
or
email
notifications
in the airflow job.
7.
Complex
task dependencies can be easily written using a few lines of code in apache airflow.
Click to learn more