/
Deployment of Airflow DAG

Deployment of Airflow DAG

Deployment of Airflow

For deployment of Airflow we need the Kubernetes Environment.

Step 1: clone the git repo for airflow , and update the values.yaml  as per the requirement.

Step 2: update the git repository url and subpath for the directory in values.yaml

Here we have updated  as 

repo: "https://github.com/pmidc-digit/utilities.git

repoSubPath: "egov-national-dashboard-accelerator/dag

branch: "develop

Step 3: change the directory to airflow and update the helm .update the helm repo on local and add the airflow repo to Helm using below command

helm repo add apache-airflow https://airflow.apache.org

The above command will pull airflow repo and it will be added to your local helm repository.

Step 4: Installing apache airflow after updating helm repositories

 helm install airflow apache-airflow/airflow --namespace egov

The above command will take the updated

Step 5: to upgrade the changes we made to values.yaml use below command.

helm upgrade --install airflow apache-airflow/airflow -n airflow -f values.yaml

The above command will update the git repo, subpath and branch while deployment.

Step 6: Deployment is done pods service will start running with updated values.yaml

 

Latest files for the deployment:

Attached is the final "values.yaml" file. It syncs both the plugins and dags from repo.

Airflow Deployment

Related content

How to trigger Airflow DAG
How to trigger Airflow DAG
More like this
Prerequisite for enabling Adaptor
Prerequisite for enabling Adaptor
More like this
Configure Airflow
Configure Airflow
More like this
Important Links and Credentials
Important Links and Credentials
Read with this
Setup the environment's specific env.yaml
Setup the environment's specific env.yaml
More like this
National Dashboard Adaptor Service
National Dashboard Adaptor Service
Read with this