Data discovery

AND INGESTION

Data discovery and ingestion is the first stage of the pipeline. This is where we get the data from outside GX’s ecosystem to within our data storage.

This is the part of the process where we execute our ingestion algorithms like custom web crawlers and data feeders to continuously monitor raw data sources.

Data

TRANSFORMATION

Data transformation is the second stage of the pipeline where the raw data sourced from multiple data sources is engineered and validated as per GX standards.

Multiple transformation algorithms are executed for detection, automated correction and supervised repair of the pipelines.

Data

ONTOLOGY

Data ontology is the third stage of the pipeline where the data is made meaningful by leveraging intelligent metadata to build a complete, consistent and reliable view of all data irrespective of source or format.

The transformed data is connected to the target data model as per the custom defined harmonisation rules. The ontologised data is validated for various use-case based rules.

Data

ANALYSIS

Data analysis is the fourth stage of the pipeline where the transformed raw data, credentialed and enriched ontologised data and analyses configurations are used to generate standard analyses and build new analyses on the platform.

Data

SPREAD

Data spread is the final stage of the pipeline where the transformed raw data, fully connected and ontologised data and analyses built on data are spread to downstream systems. The connectivity to downstream systems is enabled via the platform and APIs via microservices.