Revenue Maximisation
Druid digit
https://druid-qa.ifix.org.in/unified-console.html#load-data
Metabase digit
https://metabase-qa.ifix.org.in/
eGov@4321
Code base:
https://github.com/pmidc-digit/utilities/tree/develop/egov-revenue-maximization
Command for executing the DAG:
{"start":"01-04-2022","end":"04-04-2022"}
Select the rev_max DAG right now deployed in the punjab production
https://airflow.mseva.lgpunjab.gov.in/home
Click the trigger with config option
The DAG has 3 steps:
collect-data step:
The data is collected from ES and is converted to the json file.
join_data step:
The json file is converted to csv.
The tables are joined like water and trade,water and property and trade and property.
The outcome are csv files.
upload_data step:
The csv files which are created are then uploaded to the druid by using the API.
The csv files are converted to the format as expected by the API and then uploaded to druid tables.
Postman collection for posting the data:
https://www.getpostman.com/collections/74fcabc976b2b9baac93