iFIX ElasticSearch Pipeline

Owned by Shashwat Mishra
Sept 29, 2022
1 min read

Overview

iFIX ElasticSearch Pipeline is a pipeline service which listens onto legacy as well as new fiscal events, enriches them, performs pre-computations and then pushes fiscal events onto indexer for indexing them onto ElasticSearch.

Pre-requisites

  1. Prior Knowledge of Java/J2EE.

  2. Prior Knowledge of SpringBoot.

  3. Prior Knowledge of Kafka.

  4. Prior Knowledge of REST APIs and related concepts like path parameters, headers, JSON etc.

Key Functionalities And Configurations

This pipeline service listens onto legacy as well as new fiscal events, denormalizes hierarchy information in order to create a simple hierarchyMap, performs certain pre-computations in order to enable ES query optimizations and writing simple queries.

Consumer Details

  1. This service has a single consumer which listens onto both legacy migration and new records, enriches hierarchy map by denormalizing ancestry array and enriches certain pre-computed fields for query optimization and making the queries simple to write.