Creating Pipelines

Ingestion pipelines are configured in Data Factory Studio app.

This task shows you how to:

Create a pipeline for each .csv file.

Creating the Source Code Files

The .csv files enable you to customize the app installation according to the customer needs. You need three .csv files:

  • ItemQuality.csv
  • ItemUsage.csv
  • ProductivityStatus.csv

  1. In Excel, create a sheet for each .csv file.
  2. For the Quality item, enter the following information:

    • The Customer Value. It can be Good, Scrap or Fail.
    • The Standard Value. It can be Good, Scrap or Fail.
    • The Standard Value Index.

  3. Save the Quality sheet as ItemQuality.csv in an ItemQuality folder on your local environment.
  4. For the Usage Item, enter the following information:

    • The Customer Value. It can be Add, Remove, Produce or Handle.
    • The Standard Value. It can be Add, Remove, Produce or Handle.
    • The Standard Value Index.

  5. Save the Usage sheet as ItemUsage.csv in an ItemUsage folder on your local environment.
  6. For the Productivity Status item, enter the following information:

    • The Customer Value. It contains the operation scheduling information.
    • The Standard Value. It contains the operation scheduling information.
    • The Standard Value Index.
    • The Track. It can be True or False.

  7. Save the Productivity Status sheet as ProductivityStatus.csv in an ProductivityStatus folder on your local environment.

Creating Pipelines

Before you begin: The .csv files should be available in Amazon Web Services S3 repository.

Create a folder for each file.

  1. From the Data Factory Studio homepage, click Create Pipeline.
    The Add New Pipeline panel appears.
  2. Click Create Pipeline.

    Note: If a pipeline is already created, you can insert an existing pipeline.

  3. Select the Index Tabular data type, and then enter the pipeline name.
  4. In the Folder Path Prefix box, enter the path to the .csv file. For example, if you are creating a pipeline for the quality item, enter the path to the ItemQuality.csv file.
  5. In the Scheduling section, define the scheduling.
  6. In the Target scetion, define the target class.
  7. In the destination tab, select the ManufacturingIndex index unit.
  8. Select the FRI package.
  9. Select the class corresponding to the CSV file, for example ItemQuality.
  10. Click Save.
    The pipeline is created.
  11. Click on Export to reuse this configuration, or click Run to run the pipeline.