Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. name: Index name on the elasticsearch. (Index will be created if it doesn't exist with this name.)

  2. type: Document type within that index to which the index json has to go. (Elasticsearch uses the structure of index/type/docId to locate any file within index/type with id = docId)

  3. id: Takes comma separated JsonPaths. The JSONPath is applied on the record received on the queue, the values hence obtained are appended and used as id for the record.

  4. jsonPath: Key to be used in case of indexing a part of the input JSON and in case of indexing a custom json where the values for custom json are to be fetched from this part of the input.

  5. timeStampField: JSONPath of the field in the input which can be used to obtain the timestamp of the input.

  6. i) indexMapping: A skeleton/mapping of the JSON that is to be indexed. Note that, this JSON must always contain a key called "Data" at the top-level and the custom mapping begins within this key. This is only a convention to smoothen dashboarding on Kibana when data from multiple indexes have to be fetched for a single dashboard.

     ii) fieldMapping: Contains a list of configurations. Each configuration contains keys to identify the field of the input JSON that has to be mapped to the fields of the index json which is mentioned in the key 'indexMapping' in the config. Has the following keys:

    1. inJsonPath: JSONPath of the field from the input.

    2. outJsonPath: JSONPath of the field of the index json.

            iii) externalUriMapping: Contains a list of configurations. Each configuration contains keys to identify the field of the input JSON that are to be enriched using APIs from the external services. The confiugration configuration for those APIs also is a part of this. Uses the following keys:

...