Deployment of Airflow DAG
Deployment of Airflow
For deployment of Airflow we need the Kubernetes Environment.
Step 1: clone the git repo for airflow , and update the values.yaml as per the requirement.
Step 2: update the git repository url and subpath for the directory in values.yaml
Here we have updated as
repo: "https://github.com/pmidc-digit/utilities.git ”
repoSubPath: "egov-national-dashboard-accelerator/dag
branch: "develop
Step 3: change the directory to airflow and update the helm .update the helm repo on local and add the airflow repo to Helm using below command
helm repo add apache-airflow https://airflow.apache.org
The above command will pull airflow repo and it will be added to your local helm repository.
Step 4: Installing apache airflow after updating helm repositories
helm install airflow apache-airflow/airflow --namespace egov
The above command will take the updated
Step 5: to upgrade the changes we made to values.yaml use below command.
helm upgrade --install airflow apache-airflow/airflow -n airflow -f values.yaml
The above command will update the git repo, subpath and branch while deployment.
Step 6: Deployment is done pods service will start running with updated values.yaml
Latest files for the deployment:
Attached is the final "values.yaml" file. It syncs both the plugins and dags from repo.