Blog

A data pipeline is a computing practice where one or multiple datasets are modified through a series of chronological steps. The steps are strictly sequential with each feeding the next with their amended version of the dataset. Once the data has been through all the steps the pipeline is complete

Pipeline scheduling is considered a crucial part of data pipeline development.

Our first lesson learnt as we leave development and turn our attention to a growing userbase.