/
iFIX ElasticSearch Pipeline

iFIX ElasticSearch Pipeline

Overview

iFIX ElasticSearch Pipeline is a pipeline service which listens onto legacy as well as new fiscal events, enriches them, performs pre-computations and then pushes fiscal events onto indexer for indexing them onto ElasticSearch.

Pre-requisites

  1. Prior Knowledge of Java/J2EE.

  2. Prior Knowledge of SpringBoot.

  3. Prior Knowledge of Kafka.

  4. Prior Knowledge of REST APIs and related concepts like path parameters, headers, JSON etc.

Key Functionalities And Configurations

This pipeline service listens onto legacy as well as new fiscal events, denormalizes hierarchy information in order to create a simple hierarchyMap, performs certain pre-computations in order to enable ES query optimizations and writing simple queries.

Consumer Details

  1. This service has a single consumer which listens onto both legacy migration and new records, enriches hierarchy map by denormalizing ancestry array and enriches certain pre-computed fields for query optimization and making the queries simple to write.

Related content

iFIX Migration Toolkit
iFIX Migration Toolkit
More like this
iFIX: Migration from Druid/Metabase to ElasticSearch/DSS
iFIX: Migration from Druid/Metabase to ElasticSearch/DSS
More like this
Integration Testing
Integration Testing
Read with this
iFIX Transition document
iFIX Transition document
More like this
Workflow Service
Workflow Service
Read with this
IFIX Core Fiscal Event Service v2.1
IFIX Core Fiscal Event Service v2.1
More like this