National Dashboard Adaptor Service
- anika mehrotra
- Priyanka Samantaroy
Overview
Provides a detailed walk through of how to setup, configure and deploy Airflow DAGs on the state side to extract data from the Elastic Search server to push to National Dashboard Adaptor.
Scope:
Design and develop an adaptor service which will extract data from the state DIGIT installations and push onto the National Dashboard instance periodically.
List of task for this have been tracked for the Adaptor
● Adaptor to be deployed on state DIGIT installations
● Periodically, the adaptor extracts data and aggregates it from the different DIGIT modules.
● Posts the data to the National Dashboard for the state.
● Bookkeeping done for every adaptor data extract and push for audit and debugging
● Out of scope: Extraction from non-DIGIT sources
A national dashboard adaptor extracts data from the state DSS at a scheduled time which can be configured and then would ingest it in the National Dashboard.The adaptor ingest data at state/ULB/Ward level for each module on a daily basis.The adapter send the data in batch size of 50 to the national dashboard
