Preparing the Source S3 for Amazon

To fetch data from your Source Amazon S3, create a dedicated user account on the S3, and grant this account with the allow permissions required by Data Factory Studio to fetch data.

See Also
Appendix - About Sources
Main Workflows
Configuring the Ingestion Pipeline
Configuring the Data Storage
  1. On the source S3, create a user account dedicated to the fetch of data with Data Factory Studio, for example, dscrawluser.
  2. In the user policy, grant the following mandatory allow permissions to the user account. 

    {
   "Version":"2012-10-17",
   "Statement":[
      {
         "Effect":"Allow",
         "Action": "s3:ListAllMyBuckets",
         "Resource":"arn:aws:s3:::*"
      },
      {
         "Effect":"Allow",
         "Action": "s3:ListBucket",
         "Resource":"arn:aws:s3:::awsexamplebucket1"
      },
      {
         "Effect":"Allow",
         "Action": "s3:GetObject",
         "Resource":"arn:aws:s3:::awsexamplebucket1/*"
      }
   ]
}

    Permission Action Description
    ListAllMyBuckets

    This permission is optional. It lists all the buckets defined with the ListBucket permission. This is useful when you configure the source buckets in Data Factory Studio.
    ListBucket

    Defines the buckets that will be accessible.
    GetObject

    Defines the buckets and the data to crawl within them.

    For more information, see https://docs.aws.amazon.com/AmazonS3/latest/userguide/user-policies.html

  3. Put your data in the S3 buckets.