Using the Amazon S3 Destination Component

The Amazon S3 Destination Component is an SSIS data flow pipeline component that can be used to write data to Amazon S3. There are three pages of configuration:

  • General
  • Columns
  • Error Handling

The General page is used to specify general settings for the Amazon S3 Destination Component. The Columns page is used to manage columns from the upstream component. The Error Handling page allows you to specify how errors should be handled when they occur. 

General page

The General page allows you to specify general settings for the component. 

SSIS AWS S3 Destination

Connection Manager

The Amazon S3 Destination Component requires a connection. The Connection Manager drop-down will show a list of connection managers that are available within the package.

Action

The Action specifies how you want to write to Amazon S3 specified in the selected Connection Manager. There are 3 Actions: 

  • CreateFolder - Creates folders
  • Delete - Deletes specified items
  • Upload - Uploads files
Chunk Size (in MB)

Specify the Chunk Size to upload large files to Amazon S3 in parts. The default chunk size setting is 10MB.

Refresh Component Button

Clicking the Refresh Component button causes the component to retrieve the latest metadata and update each field to its most recent metadata.

Map Unmapped Fields Button

By clicking this button, the component will try to map any unmapped attributes by matching their names with the input columns from upstream components.

Clear All Mappings Button 

By clicking this button, the component will reset (clear) all your mappings in the destination component.

Columns page

The Columns page of the Amazon S3 Destination Component allows you to map the columns from upstream components to the Amazon S3 Fields. 

In the Columns page, you would see a grid that contains four columns as shown below.

SSIS AWS S3 Destination - Columns

  • Input Column - You can select an input column from an upstream component for the corresponding Amazon S3 Field. 
  • Amazon S3 Field - Specifies how to write the current item to the specified Amazon S3.
  • Data Type - This column indicates the type of value for the current field.
  • Unmap - This column can be used to unmap the field from the upstream input column, or otherwise it can be used to map the field to an upstream input column by matching its name if the field is not currently mapped.
Error Handling page

The Error Handling page allows you to specify how errors should be handled when they happen. 

SSIS AWS S3 Destination - Error Handling

There are three options available. 

  1. Fail on error
  2. Redirect rows to error output
  3. Ignore error

When the Redirect rows to error output option is selected, rows that failed to write to Amazon S3 will be redirected to the 'Error Output' output of the Destination Component. As indicated in the screenshot below, the blue output connection represent rows that were successfully written, and the red 'Error Output' connection represents rows that were erroneous. The 'ErrorMessage' output column found in the 'Error Output' may contain the error message that was reported by server or the component itself.

SSIS AWS S3 Destination - Error Output