Amazon S3 Source Connector for Confluent Platform

The Kafka Connect Amazon S3 Source connector reads data from Amazon S3 and publishes it to Kafka topics. The connector is available in two variants. Choose the variant that matches how you store the data in S3.

• Generalized: Reads data from files that use any naming convention in an S3 bucket, as long as the files are in a supported format, such as JSON, Avro, or Byte Array.

• Backup and Restore: Reads data that the Amazon S3 Sink connector exported to S3 and publishes it back to Kafka topics. Depending on the format and partitioner used to write the data, the connector can keep the original partitions and message order.

AMAZON S3 SOURCE CONNECTOR

• Generalized S3 Source
• Backup and Restore S3 Source
• Configure
• Changelog
• Third Party Libraries
• Glossary