Google Cloud Storage Source Connector for Confluent Platform

The Kafka Connect Google Cloud Storage (GCS) Source connector reads data from GCS and publishes it to Kafka topics. The connector is available in two variants. Choose the variant that matches how you store the data in GCS.

• Generalized: Reads data from files that use any naming convention in a GCS bucket, as long as the files are in a supported format, such as JSON, Avro, or Byte Array.

• Backup and Restore: Reads data that the Kafka Connect GCS Sink connector exported to GCS and publishes it back to Kafka topics. Depending on the format and partitioner used to write the data, the connector can keep the original partitions and message order.

GOOGLE CLOUD STORAGE SOURCE

• Generalized GCS Source
• Backup and Restore GCS Source
• Configure
• Changelog
• Third Party Libraries
• Glossary