S3

This is for all S3 connectors of any format.

Parameters

Required Parameters:

  • S3 Bucket
  • S3 Directory: Fake directoy that will be appended to the key name to mimic a directory like structure
  • S3 Key name: Prefix for the key name, then 10 unique digits and extension are added.

Optional Parameters:

  • S3 Local File Path: Where to store on local machines temporary created files before being pushed to S3
  • S3 Region
  • S3 Access Key ID: If not set use default one provided in configuration or use credentials passed at data generation
  • S3 Access Key Secret: If not set use default one provided in configuration or use credentials passed at data generation