Configure Replicator

Confluent Replicator replicates topics from one Apache Kafka® cluster to another. Beyond copying messages, Replicator creates topics as needed and preserves the source cluster’s topic configuration, including:

  • Partition count

  • Replication factor

  • Any per-topic configuration overrides

Confluent Replicator runs as a Kafka Connect connector. Deploy Replicator in Confluent for Kubernetes using the Connect Custom Resource Definition (CRD) to define a custom resource (CR). The CR specifies the cp-enterprise-replicator Docker image, which contains the Replicator JARs. For details on deploying and configuring Connect, see Configure Kafka Connect.

For example:

apiVersion: platform.confluent.io/v1beta1
kind: Connect
metadata:
  name: replicator
  namespace: destination
spec:
  replicas: 2
  image:
    application: confluentinc/cp-enterprise-replicator:8.3.0
    init: confluentinc/confluent-init-container:3.4.0

This is a change from Confluent Operator 1.x, where Replicator had a Helm sub-Chart and a section in the values.yaml for configuration.

See the comprehensive example for configuring and deploying Confluent Replicator for the detailed steps and an example CR.