AWS S3 sinks data as gzip compressed objects to an AWS S3 bucket.

The sink automatically organizes objects by the year, month, and day the data was processed in the object path. Each object can be optionally prefixed with a static or dynamic string.

Interpretation Methods

The sink supports these interpretation methods:

  • object
  • data

Settings

FieldTypeDescriptionRequired
bucketstringthe AWS S3 bucket that data is written to.Yes
prefixstringthe prefix prepended to the object path.

defaults to no prefix.
No
prefix_keystringretrieves a value from an object that is used as the prefix prepended to the S3 object path.

if used, then this overrides prefix.
No