Confluent Platform Upgrade Checklist
Upgrading to Confluent Platform 6.0+
enables you to leverage the latest innovative features that bring a powerful
cloud-native experience to your event streaming platform. Here are some of the
exciting new features that enhance your event streaming use cases with greater
elasticity, improved cost-effectiveness, increased reliability, and global
- Proactive Support: Minimize the risk of downtime by identifying problems
before an outage occurs with our expert-tested algorithms, gained from running
over 5,000 clusters in Confluent Cloud.
- Tiered Storage: Greatly reduce your cluster’s infrastructure footprint
& costs, and achieve infinite retention by offloading data to a more cost-efficient
- Self-Balancing Clusters: Automate partition rebalances to improve your cluster’s performance,
elasticity, and ease of operations.
- Multi-Region Clusters with Automatic Observer Promotion:
Simplify disaster recovery operations and minimize business disruption and
downtime costs with automated client failover.
- Cluster Linking (preview): Deploy hybrid cloud and
multi-cloud architectures with applications that span multiple environments
by bridging independent clusters to one another with fully offset-preserving
The following checklist provides a quick guide for how to upgrade to the latest
version. For detailed guidance, see Upgrade Confluent Platform.
Step 0: Prepare for the upgrade
Here’s what you need to get started:
- An existing Confluent Platform deployment. If you’re starting with a new deployment, follow
the steps in On-Premises Deployments.
- An upgrade plan that matches your specific requirements and environment. You
should not start working through this checklist on a live cluster. Review the
Upgrade Guide fully and draft an upgrade plan.
If you’re running a Confluent Platform version that’s lower than 5.5.1,
upgrade to 5.5.1
before upgrading to 6.1.x and higher.
Step 1: Upgrade ZooKeeper
- Back up all configuration files before upgrading.
- Back up ZooKeeper data from the leader. In case of an upgrade failure, this backup
gets you back to the latest committed state.
For more information, see Upgrade ZooKeeper.
Step 2: Upgrade Kafka brokers
You have these options for upgrading your Kafka brokers:
- Downtime upgrade: If downtime is acceptable for your business case, you can
take down the entire cluster, upgrade each Kafka broker individually, and restart
- Rolling upgrade: In a rolling upgrade scenario, you upgrade one Kafka broker
at a time while the cluster continues to run. To avoid downtime for end users,
follow the recommendations in rolling restarts.
For more information, see Upgrade Kafka brokers.
Step 3: Upgrade Confluent Platform components
In this step, you will upgrade the Confluent Platform components. For a
rolling upgrade, you can do this on one server at a
time while the cluster continues to run. The details depend on your environment,
but the steps are the same.
- Stop the Confluent Platform components.
- Back up configuration files, for example in
- Remove existing packages and their dependencies.
- Install new packages.
- Restart the Confluent Platform components.
You should upgrade Confluent Control Center as the final Confluent Platform component.
For more information, see:
Upgrade steps for individual Confluent Platform components:
Step 4: Update configuration files
Some configuration settings change from one version to the next. The following
sections describe changes that are required for specific versions.
When you upgrade to Confluent Platform 5.4.x and later, add the
configuration parameter to the
server.properties file. Confluent Platform 5.4.x and
later requires the
confluent.license setting to start. For more information,
see Confluent Platform Licenses.
When you upgrade to Confluent Platform 5.4.x and later, update the authorizer class in the
Starting with Confluent Platform 5.4.x, the new authorizer class,
kafka.security.auth.SimpleAclAuthorizer. In the
change existing instances of
kafka.security.authorizer.AclAuthorizer. For more information, see
Replication factor for Self-Balancing Clusters
In Confluent Platform 6.0.0, the
confluent.balancer.topic.replication.factor setting was
added for Self-Balancing configuration. Ensure that its value is less than or equal to
the total number of brokers.
For more information, see confluent.balancer.topic.replication.factor.
Step 5: Enable Proactive Support
Proactive Support enables you to identify issues before downtime occurs,
ensuring high availability for your event streaming applications.
- Enable Telemetry – The Confluent Telemetry Reporter is
a plugin that runs inside each Confluent Platform service to push metadata about the service
to Confluent. Telemetry Reporter enables product features based on the metadata,
like Proactive Support. Telemetry is limited to metadata required to provide
Proactive Support (for example, no topic data) and is used solely to assist
Confluent in the provisioning of support services.
- Enable Proactive Support – After you enable
Telemetry Reporter, you can activate Proactive Support, which provides ongoing,
real-time analysis of performance and configuration data for your Confluent Platform deployment.
While enabling Telemetry and Proactive Support is highly encouraged and
beneficial to minimize downtime, it is not mandatory in order to upgrade
to Confluent Platform 6.0+. Speak with your Confluent account team if you have any questions
about the features.
Step 6: Rebuild applications
If you have applications that use Kafka producers and consumers against the new
6.1.x libraries, rebuild and redeploy them. For more information,
see Application Development.
You can upgrade Kafka Streams applications independently, without requiring
Kafka brokers to be upgraded first. Follow the instructions in the
Kafka Streams Upgrade Guide to upgrade your
applications to use the latest version of Kafka Streams.
For more information, see Upgrade other client applications.