Google Firebase Connector (Source and Sink) for Confluent Platform¶
The Kafka Connect Google Firebase Source connector enables users to read data from a Google Firebase Realtime Database and persist the data in Apache Kafka® topics. The Kafka Connect Google Firebase Sink Connector enables users to read data from multiple Kafka topics and write them to Google Firebase Realtime Database.
The following are required to run the Kafka Connect Firebase Connector:
- Kafka Broker: Confluent Platform 3.3.0 or above, or Kafka 0.11.0 or above
- Connect: Confluent Platform 4.0.0 or above, or Kafka 1.0.0 or above
- Java 1.8
- A GCP service account with role
Firebase Realtime Database Viewerfor source connector and
Firebase Realtime Database Adminfor sink connector is required. You can create this service account in the Google Cloud Console. For creating a service account, refer creating and managing service accounts.
Install the Google Firebase Connector¶
You can install this connector by using the Confluent Hub client (recommended) or you can manually download the ZIP file.
Install the connector using Confluent Hub¶
- Confluent Hub Client must be installed. This is installed by default with Confluent Enterprise.
Navigate to your Confluent Platform installation directory and run the following command to install the latest (
latest) connector version. The connector must be installed on every machine where Connect will run.
confluent-hub install confluentinc/kafka-connect-firebase:latest
You can install a specific version by replacing
latest with a version number. For example:
confluent-hub install confluentinc/kafka-connect-firebase:1.1.0-preview
You can use this connector for a 30-day trial period without a license key.
After 30 days, this connector is available under a Confluent enterprise license. Confluent issues enterprise license keys to subscribers, along with providing enterprise-level support for Confluent Platform and your connectors. If you are a subscriber, please contact Confluent Support at firstname.lastname@example.org for more information.
For a complete list of configuration properties for the source connector, see Google Firebase Source Connector Configuration Properties.
For a complete list of configuration properties for the sink connector, see Google Firebase Sink Connector Configuration Properties.