Lorem ipsum dolor sit . Proin gravida nibh vel vealiquete sollicitudin, lorem quis bibendum auctonisilin sequat. Nam nec tellus a odio tincidunt auctor ornare.

Stay Connected & Follow us

What are you looking for?

Simply enter your keyword and we will help you find what you need.
PBT GroupDataIKU ETL Processing

DataIKU ETL Processing

The Company

A multi-national manufacturing organisation.

The Business Challenge

In order to do stock optimisation simulation this organisations data needs to be transformed and validated in a series of complex steps.

The Solution

DataIKU was already being used as data science platform to wrangle the data into the shape needed for the eventual solution. It was discovered that a repetitive validation and selection process was being followed for each of the various input sources, but that these processes varied in quality and steps, based on each persons style and skills. The solution had to address the inconsistencies that resulted. Applying Data Engineering techniques, a few processing patterns were designed, and implemented as DataIKU plugins and macros. Using the DataIKU public API, this now provides the client with a few standardised options to automatically apply standard validation and selection processed.

The Value Proposition

Using the DataIKU API, these repetitive steps could be automatically generated, which reduced the validation and selection development time by an order of magnitude, while also automatically taking care of naming standards and best practises across all validation processes.

Technology

Related Cases

No posts were found.

Top