Skip to main content

Amazon S3 as a source and target

Zuora

Amazon S3 as a source and target

  1. Last updated
  2. Save as PDF

You can create meters for Amazon S3 in the following methods:

Meter with Amazon S3 as a source

To create a meter with Amazon S3 as the source, follow the instructions below:

  1. Create a Custom Meter. For more information, see Create a new meter using custom method.
  2. Select the Amazon S3 as the source.
    The Amazon S3 settings page is displayed.
  3. Click Select to select an Event Definition on the Amazon S3 setting page.
    You can create or select an existing Event Definition or import an Event Definition. For more information, see Event Definitions.
  4. Under the Amazon S3 Settings section, perform the following:

Task

Description

Connection

Select S3 from the Connection drop-down which includes the S3 bucket, credentials, and base path.

To set up a connection, contact Zuora Support.

Folder

Add the path to the main folder in the Folder field where you want to read data from Amazon S3.

Note that when you add a folder to read data also grants read access to all the subfolders and files under the main folder.

Incremental Mode

The Incremental Model checkbox gives the following options:

  • If checked, will allow mediation to monitor and process new files added to the Folder you specified in the S3 source.  This means that the Meter will continue to function.
  • If unchecked (the default), the meter will process the currently existing files in the folder, and the job will be completed once the process is complete. The Meter will operate in batch mode and must be triggered with each new file upload.

File Format

Click the File Format drop-down to select a file format.

Note that all of the files in the folder you chose must be in the same format, or the ingestion of a file in a different format will fail.
  1. Click Save to save the Amazon S3 source settings.

Meter with Amazon S3 as a target

To create a meter with Amazon S3 as the target, follow the instructions below:

  1. Create a Custom Meter. For more information, see Create a new meter using custom method.
  2. Select the Amazon S3 as the target.
    The Amazon S3 settings page is displayed.
  3. Under the Amazon S3 Settings section, perform the following:

Task

Description

Connection

Select S3 from the Connection drop-down which includes the S3 bucket, credentials, and base path.

To set up a connection, contact Zuora Support.

Folder

Add the path to the main folder in the Folder field where you want to read data from Amazon S3.

Note that when you add a folder to read data also grants read access to all the subfolders and files under the main folder.

File Format

Click the File Format drop-down to select a file format.

Note that all of the files in the folder you chose must be in the same format, or the ingestion of a file in a different format will fail.

Advanced Settings

Select the values for excluded fields, rolling file size, and partition by fields.

  • Fields Excluded - Allows you select the fields to be excluded from the export file.
  • Rolling File Size - Allows you to specify the export file size. The export file size cannot exceed this limit.
  • Partition By - Allows you to set the partition for the export data file into different folder groups by selecting one or more fields. When you select multiple fields, the first selected field is set as the first level folder, the second selected field as the second level folder and so on.

  1. Click Save to save the Amazon S3 target settings.