Re- index IFIX master data from mGramseva to Ifix

BackUp Data for Reindex : -

• Take backup of existing data present in Index - ifix-fiscal-events

  GET ifix-fiscal-events/_search
  POST _reindex { "source": { "index": "ifix-fiscal-events" }, "dest": { "index": "ifix-fiscal-events-backup" } }

  Delete the data of existing index as the backup data is added in index - ifix-fiscal-events-backup

  POST /ifix-fiscal-events/_delete_by_query { "query": { "match_all": {} } }

• Take backup of Db tables - event_posting_detail(mgramseva) and eg_ifix_fiscal_event(ifix)

  create table event_posting_detail25012024 as ( select * from event_posting_detail); create table eg_ifix_fiscal_event25012024 as ( select * from eg_ifix_fiscal_event);

  Delete the data from existing tables

  delete * from event_posting_detail; delete from eg_ifix_fiscal_event;

• Take backup of Currently running services builds

• Increase the pods of Collection-Service,mgramseva-ifix-adapter service and Billing-service.

Payment Data Push :-

• Check the count of payment data in egcl_payment table according to transactiondate.

  select min(transactiondate) from egcl_payment; // 1638861976698 select max(transactiondate) from egcl_payment; // 1707205840034 select count(*) from egcl_payment where transactiondate between 1638861976698 and 1648714591000; // 10035

• Port-forwarding mgramseva-ifix-adapter.

  kubectl port-forward mgramseva-ifix-adapter-5d8f8f8c4c-48ccn 8082:8080 -n mgramseva --kubeconfig /home/admin1/.kube/mgramseva-prod&

• Hit the payment data transfer api by provide fromDate and toDate to push the data wrt transactiondate.

  curl --location 'http://localhost:8082/mgramseva-ifix-adapter/mGramsevaAdopter/v1/_paymentdatatransfer?tenantId=pb.testing&businessService=WS&limit=20000&offset=0&fromDate=1638861976698&toDate=1648714591000' \ --header 'Content-Type: application/json' \ --data '{ "RequestInfo": { "apiId": "Rainmaker", "ver": ".01", "ts": null, "action": "", "did": "1", "key": "", "msgId": "20170310130900|en_IN", "authToken": null, "correlationId": null, "userInfo": { "id": 1238, "userName": "230566|6nazOXejetsSwLcRS5aclEJD/4e7SzmimN4=", "name": "230566|kBzPQAXbCiQzR3NUY/cLPTzdnmw63ho=", "type": "SYSTEM", "mobileNumber": "230566|6nazOXejetsSwLcRS5aclEJD/4e7SzmimN4=", "emailId": null, "roles": [ { "id": null, "name": "Employee", "code": "EMPLOYEE", "tenantId": "pb" }, { "id": null, "name": "System user", "code": "SYSTEM", "tenantId": "pb" } ], "tenantId": "pb.testing", "uuid": "47ff55dc-c9d0-4f86-8f82-b4d7a24ba59e" } } }'

• check the logs of mgramseva-ifix-adapter for failures.

• the data will be saved in event_posting_detail table where all the entries will show whether it's a success or failure.

  select DISTINCT tenant_id,event_type,count(*) from event_posting_detail group by tenant_id,event_type;

• the data which is success/pushed will be seen into eg_ifix_fiscal_event table.

  select DISTINCT tenantid,eventtype,count(*) from eg_ifix_fiscal_event group by tenantid,eventtype; select count(*) from eg_ifix_fiscal_event where eventtime between 1638861976698 and 1648714591000; //10035

• Check the data pushed in kibana index

  GET ifix-fiscal-events/_search

Demand Data Push :-

• The demand data is pushed according to tenant id’s and businesservice.

• The data will push in two types of eventtype : Demand and Bill.

• For ‘WS' businessservice,the eventtype will be Demand and for 'EXPENSE’ businessservice,the eventtype will be Bill.

• In demand table,check all the demands wrt businesservice where status is ACTIVE.

  select distinct businessservice,count(*) from egbs_demand_v1 where status='ACTIVE' group by businessservice;

  The businessservice includes :
  EXPENSE.CHLORINATION , EXPENSE.ELECTRICITY_BILL , EXPENSE.INCENTIVES ,EXPENSE.MACHINERY_REPAIR, EXPENSE.NEW_MACHINERY , EXPENSE.NEW_PIPELINE EXPENSE.OTHERS , EXPENSE.PIPELINE_REPAIR , EXPENSE.SALARY EXPENSE.WATER_TREATMENT , WS

• Check the data for each of the tenant wrt businessservice.
  
  

  select DISTINCT tenantid,count(*) from egbs_demand_v1 where status='ACTIVE' and businessservice='WS' group by tenantid; select count(*) from egbs_demand_v1 where status='ACTIVE' and businessservice='WS' and tenantid IN ('pb.balluanahjgefi', 'pb.balnauhjbabf', 'pb.balokihjbahg', 'pb.baloli', 'pb.balonhjheii', 'pb.balowalhjhbic', 'pb.balsuahiffid', 'pb.balwarkhurdhjfijg', 'pb.bamalhjfghh', 'pb.bambihabhaihjibga', 'pb.bambihahjggid', 'pb.bamhjiffa', 'pb.bamnarahjedfc', 'pb.banahjhdbb', 'pb.banbhaurihjfgdb', 'pb.bandalanaubombhiidij', 'pb.bandalapuranahiieah', 'pb.banginihalsinghhjghha', 'pb.bangirulduhjghff');

• Add businessservice and tenantid’s in api.

  curl --location 'http://localhost:8083/mgramseva-ifix-adapter/mGramsevaAdopter/v1/_legacydatatransfer?businessService=WS' \ --header 'Content-Type: application/json' \ --data '{ "RequestInfo": { "apiId": "Rainmaker", "ver": ".01", "ts": null, "action": "", "did": "1", "key": "", "msgId": "20170310130900|en_IN", "authToken": null, "correlationId": null, "userInfo": { "id": 1238, "userName": "230566|6nazOXejetsSwLcRS5aclEJD/4e7SzmimN4=", "name": "230566|kBzPQAXbCiQzR3NUY/cLPTzdnmw63ho=", "type": "SYSTEM", "mobileNumber": "230566|6nazOXejetsSwLcRS5aclEJD/4e7SzmimN4=", "emailId": null, "roles": [ { "id": null, "name": "Employee", "code": "EMPLOYEE", "tenantId": "pb" }, { "id": null, "name": "System user", "code": "SYSTEM", "tenantId": "pb" } ], "uuid": "47ff55dc-c9d0-4f86-8f82-b4d7a24ba59e" } }, "tenantIds": [ "pb.balluanahjgefi", "pb.balnauhjbabf", "pb.balokihjbahg", "pb.baloli", "pb.balonhjheii", "pb.balowalhjhbic", "pb.balsuahiffid", "pb.balwarkhurdhjfijg", "pb.bamalhjfghh", "pb.bambihabhaihjibga", "pb.bambihahjggid", "pb.bamhjiffa", "pb.bamnarahjedfc", "pb.banahjhdbb", "pb.banbhaurihjfgdb", "pb.bandalanaubombhiidij", "pb.bandalapuranahiieah", "pb.banginihalsinghhjghha", "pb.bangirulduhjghff" ] }'

• Port-forward mgramseva-ifix-adapter service and hit the api.

• Check the count is matching with the tenants count.Also match the count in event_posting_detail table and eg_ifix_fiscal_event table.

  select DISTINCT tenant_id,event_type,count(*) from event_posting_detail group by (tenant_id,event_type); select DISTINCT tenantid,eventtype,count(*) from eg_ifix_fiscal_event group by tenantid,eventtype;

• Check the data pushed in kibana index.

  GET ifix-fiscal-events/_search { "query": { "match": { "Data.eventType.keyword": "Demand" } } }

• Follow the same steps for other businessservices.