Configure Replicator
Confluent Replicator replicates topics from one Apache Kafka® cluster to another. Beyond copying messages, Replicator creates topics as needed and preserves the source cluster’s topic configuration, including:
Partition count
Replication factor
Any per-topic configuration overrides
Confluent Replicator runs as a Kafka Connect connector. Deploy Replicator in Confluent for Kubernetes
using the Connect Custom Resource Definition (CRD) to define a custom
resource (CR). The CR specifies the cp-enterprise-replicator Docker
image, which contains the Replicator JARs. For details on deploying and
configuring Connect, see Configure Kafka Connect.
For example:
apiVersion: platform.confluent.io/v1beta1
kind: Connect
metadata:
name: replicator
namespace: destination
spec:
replicas: 2
image:
application: confluentinc/cp-enterprise-replicator:8.3.0
init: confluentinc/confluent-init-container:3.4.0
This is a change from Confluent Operator 1.x, where Replicator had a Helm sub-Chart
and a section in the values.yaml for configuration.
See the comprehensive example for configuring and deploying Confluent Replicator for the detailed steps and an example CR.