Data Factory Studio

As a Data Engineer, Data Factory Studio allows you to import raw data from the Data lake, send it through a preprocessing pipeline, and index it. Data is then ready for the Data Analyst in charge of creating data experiences with Data Perspective Studio.

The goal of this app is to federate data coming from the virtual world (for example, an ENOVIA object) and the real world (for example, IOT data). Data Factory Studio makes this consolidation using a data graph relying on the Semantic Graph Index search platform, and RDF ontologies. It also allows you to upload binary data (images, videos) on the 3DEXPERIENCE platform DFS Object Storage service.

This page discusses:

See Also
Basic Concepts
Main Workflows

Capabilities

  • Configure the data storage by selecting a storage type:

    • Semantic Graph Index Units for tabular data.
    • Semantic Graph Index Units for event order data.
    • Object Storage Buckets for binary data (such as images or videos) that must be stored in the 3DEXPERIENCE platform DFS Object Storage service.
  • Define an external S3 bucket and reference it as many times as necessary in your various ingestion pipelines.

  • Configure the ingestion by selecting between 3 types of pipelines:

    • Index data coming from tabular files (CSV, JSON, and Parquet stored on a Simple Storage Service, like Amazon S3), into a Semantic Graph Index Unit. You can add processing to transform the values to index.
    • Index event data serialized in JSON files in a Semantic Graph Index Unit.
    • Copy object data from one source to another.
  • Export and import storage configurations.
  • Export and import ingestion pipeline configurations.
  • Schedule the indexing of source data in pipelines.
  • Run the pipeline configuration to index data.

Data Science Experience Apps



Ontology Editor allows you to browse large ontologies. This app also allows you to define, develop, and validate your ontologies.

Role: Data Steward

Datasets Governance is a data catalog that allows you to discover data. It helps you understand and establish trust in the data.

Role: Data Steward

Data Factory Studio allows you to import raw data from the Data lake, send it through a preprocessing pipeline, and index it with the Semantic Graph Index.

Role: Data Engineer

Data Perspective Studio allows you to design analytics applications that we call Data Perspectives. You configure screens with visualizations, to show the data indexed with Data Factory Studio.

Role: Data Analyst

Data Perspectives allows you to view Data Perspectives in a 3DDashboard.

Role: Data Viewer

Data Perspective Governance allows you to monitor the license usage of your pre-packaged Data Perspectives, and specific Data Perspectives by verifying their token consumption.

Roles: Data Analyst, Data Steward, Platform Manager