Data Operation - Enrich

A propos

enrich is a data operation that adds one or several virtual columns to a data resource.

Example

A pipeline with an enrich operation

pipeline:
  - name: 'Select'
    operation: select
    args:
      data-selector: 'data/metadata/*.yml@cd'
      attributes:
        outputFormat: json
  - name: 'Enrich'
    operation: enrich
    args:
      virtual-column:
        id: logical_name
  - name: 'Transfer'
    operation: transfer
    args:
      target-uri: 'yaml_$1@sqlite'
      transfer-operation: insert
      target-operation: replace