Migrate to Confluent Server¶
Confluent Platform includes a commercial component named confluent-server
. This includes Kafka broker
with support for commercial features, Kafka Java client, Kafka Streams, Kafka Connect. This also
includes proprietary plugins for security features including Confluent LDAP Authorizer
and Authorization using Role-Based Access Control. Confluent Platform also includes a version of
confluent-kafka
, which is an open source Apache 2.0 licensed component. Both confluent-community
and
confluent-platform
packages have a dependency on confluent-kafka
. You can replace confluent-kafka
with
confluent-server
package to use commercial features not available in confluent-kafka
.
For more information about the packages, see Confluent Platform Packages.
Note
If you have already installed some packages using confluent-kafka
, you must remove this package
before installing confluent-server
. You may need to run yum autoremove
or apt autoremove
to remove packages installed as dependencies by a previous install.
Upgrade from 5.2.x to 5.3.x¶
If using confluent-kafka 5.2.x only¶
If you are currently using confluent-kafka
5.2.x and are not using commercial features like LDAP authorizer,
you can upgrade confluent-kafka
using the regular Upgrade process.
If using confluent-kafka 5.2.x and confluent-security 5.2.x¶
Important
Note that confluent-security
5.2.x is not compatible with confluent-kafka
5.3.x, so you must uninstall or upgrade confluent-security
when upgrading confluent-kafka
.
If you are using the existing commercially-licensed LDAP authorizer
from confluent-security
5.2.x and want to upgrade to 5.3.x, you must install confluent-server
,
which contains the LDAP authorizer. You must first uninstall 5.2.x versions of confluent-kafka
and
confluent-security
and then install the new confluent-server
package. This can be done on one server
at a time for rolling upgrades.
Debian packages via APT
Backup all configuration files from
/etc
, including, for example,/etc/kafka
.Stop the broker and remove the existing packages and their dependencies.
# stop the current kafka broker process sudo kafka-server-stop # uninstall existing 5.2.x confluent-kafka sudo apt-get remove confluent-kafka-2.12 # uninstall existing 5.2.x confluent-security sudo apt-get remove confluent-security # To remove Confluent Platform and all its dependencies at once, run the following after stopping all services sudo apt-get autoremove confluent-platform-2.12
Remove the repository files of the previous version
sudo add-apt-repository -r "deb https://packages.confluent.io/deb/5.2 stable main"
Add the 5.3 repository to
/etc/apt/sources.list
.sudo add-apt-repository "deb https://packages.confluent.io/deb/5.3 stable main"
Refresh repository metadata.
sudo apt-get update
Install
confluent-server
. (Note that if you modified the configuration files, apt will prompt you to resolve the conflicts. You should keep your original configuration.)sudo apt-get install confluent-server
Start the Kafka broker. If no additional features are being used (e.g., RBAC), no changes are required for the existing
server.properties
file.kafka-server-start -daemon /etc/kafka/server.properties
RPM packages via Yum
Backup all configuration files from
/etc
, including/etc/kafka
.Stop the broker and remove the existing packages and their dependencies.
# stop the current kafka broker process sudo kafka-server-stop # uninstall existing 5.2.x confluent-kafka sudo yum remove confluent-kafka-2.12 # uninstall existing 5.2.x confluent-security sudo yum remove confluent-security # To remove Confluent Platform and all its dependencies at once, run the following after stopping all services sudo yum autoremove confluent-platform-2.12
Remove the repository files of the previous version
sudo rm /etc/yum.repos.d/confluent.repo
Add the 5.3 repository to directory in a file named
confluent-5.3.repo
.[confluent-5.3] name=Confluent repository for 5.3.x packages baseurl=https://packages.confluent.io/rpm/5.3 gpgcheck=1 gpgkey=https://packages.confluent.io/rpm/5.3/archive.key enabled=1
Refresh repository metadata.
sudo yum clean all
Install
confluent-server
. Note that yum may override your existing configuration files, so you must restore them from backup after installing the packages.sudo yum install confluent-server
Restore any updated configuration files and start Kafka broker. If no additional features are being used (e.g., RBAC), no changes are required for the existing
server.properties
file.kafka-server-start -daemon /etc/kafka/server.properties
TAR or ZIP archives
Follow Upgrade instructions to upgrade your broker using TAR or ZIP archives.
Use confluent-5.3.1-2.12.tar.gz
or the zip archive confluent-5.3.1-2.12.zip
to install Kafka when using commercial features like LDAP authorizer.
Upgrade confluent-kafka and Remove confluent-security¶
If you are currently using confluent-kafka
with LDAP authorizer
from confluent-security
5.2.x, but do not intend to upgrade to the commercially licensed confluent-server
package, you can upgrade confluent-kafka
and use it without the LDAP authorizer. You can use the built-in
SimpleAclAuthorizer
for authorization using ACLs as described in Authorization using ACLs. You must replace
group-based ACLs with equivalent user-based ACLs to ensure that all your existing authorization rules are applied.
Note that you must remove or upgrade confluent-security
when you upgrade confluent-kafka
.