Tabli - Data Fill (with generated data)

Undraw Windows

About

The Tabli data fill command from the table module insert generated data into a content resource (file, sql table).

Syntax

tabli data fill --help
Tabli data fill
===============

Load generated data into data resources.

You select the data resources to be filled with:
   * the data selector argument (`target-selector...`)
   * and optionally the dependency option (`--with-dependencies`)

For more control on the data generated, you can add the data resource generators (`*--datagen.yml`)
by selecting them with the generator selector option (--generator-selector)

This is an alias to the `transfer` command where:
  * the targets are the selected data resources
  * the sources are generated from the generator data resources and/of target metadatas

The default transfer operation is `upsert`.



Examples
--------

 1 - To load the table `D_TIME` from the connection `sqlite` with auto-generated data:


    tabli data fill D_TIME@sqlite


 2 - To load the table `D_TIME` with the data generation file `D_TIME--datagen.yml` present in the current directory:


    tabli data fill --generator-selector D_TIME D_TIME@connection


 3 - To load all data in the whole schema with the data generation file in the dir directory:


    tabli data fill --generator-selector dir/* *@connection


 4 - Load auto generated data into the table F_SALES and its dependencies


    tabli data fill--with-dependencies F_SALES@sqlite




Syntax
------


    tabli data fill [options|flags] <target-selector...>


where:


  Arguments:

    <target-selector...>                                    One or more data selectors that will select the target data resources to be filled.


  Cross Data Transfer Options:

    -bs,--buffer-size <bufferSize>                          defines the size of the memory buffer between the source and target threads

    -mdu,--metrics-data-uri <metricsDataUri>                defines a target data uri where the data metrics should be exported

    -sfs,--source-fetch-size <fetchSize>                    defines the fetch size against the source connection

    -tbs,--target-batch-size <batchSize>                    defines the batch size against the target data resource

    -tcf,--target-commit-frequency <commitFrequency>        defines the commit frequency in number of batches against the target data resource

    -tw,--target-worker <targetWorkerCount>                 defines the target number of thread against the target connection

    -wbv,--with-bind-variables                              defines if bind variables are used in the SQL statement


  Fill Options:

    -gs,--generator-selector <generatorSelector...>         One or more data selector that selects one or more data resource generator ( --datagen.yml )

    -mrc,--max-record-count <maxRecordCount>                This option defines the maximum total number of record that the data resource(s) must have when no data resource generator was found.


  Data Definition Options:

    -ta,--target-attribute <attributeName=value>            Set a target data resource attribute


  Transfer Operation Options:

    -to,--target-operation <targetDataOperation>            defines the data operations (replace, truncate) on the existing target before transfer.

    -op,--transfer-operation <transferOperation>            defines the transfer operation (insert, update, delete, upsert, merge, move, copy). Default to `copy` for a file system and `insert` for a database.


  Selection Options:

    -wd,--with-dependencies                                 If this flag is present, the dependencies of the selected target tables (ie parent/foreign tables) will be also be filled with data


  Global Options:

    -cf,--conf <path>                                       The path to a configuration file

    -cv,--connection-vault <path>                           The path where the connection vault is located

    -h,--help                                               Print this help

    -l,--log-level <error|warning|tip|info|fine>            Set the log level

    -ns,--not-strict                                        A minor error will not stop the process.

    -odu,--output-data-uri <outputDataUri>                  defines the output data uri for the feedback data (default: console)

    -oo,--output-operation <dataOperation>                  defines the data operations (replace, truncate) on an existing output resource before transfer.

    -oop,--output-transfer-operation <transferOperation>    defines the output transfer operation (insert, update, merge, copy). Default to `copy` for a file system and `insert` for a database.

    -pp,--passphrase <passphrase>                           A passphrase (master password) to decrypt the encrypted values




Related HowTo
Undraw Windows
Learning Tabulify - Step 9 - How to fill a data resource with generated data ?

Tabulify integrates natively a data generator. You can generate realistic production data and start working on your project right away. anonymize production data in your development environment because...
Undraw Windows
This topic does not exist yet

This how-to will show you how to define the generation of data via a data definition file and load it into a table via the tabli data fill operation.

Task Runner