Pipeline

A pipeline is a yaml file that defines a serie of step where:

• the first step called the supplier step:
  • selects data resources
  • and send them to the next step
• and the following steps called intermediate steps:
  • accept the output (target) of the previous step as source
  • and produce target (output) resources.

Syntax

The syntax of a pipeline script is the following

pipeline:
    - name: supplierStep1 # first operation of a pipeline is a supplier step
      .....
    - name: intermediateStep2 # next operation are called intermediate and works on the resource returned from the supplier
      .....

where each name is the name of a step

Execution

You can execute a pipeline with the flow execute command