Migrate to Confluent Server¶

Confluent Platform includes a commercial component named confluent-server. This includes Kafka broker with support for commercial features, Kafka Java client, Kafka Streams, Kafka Connect. This also includes proprietary plugins for security features including Confluent LDAP Authorizer and Authorization using Role-Based Access Control. Confluent Platform also includes a version of confluent-kafka, which is an open source Apache 2.0 licensed component. Both confluent-community and confluent-platform packages have a dependency on confluent-kafka. You can replace confluent-kafka with confluent-server package to use commercial features not available in confluent-kafka. For more information about the packages, see Confluent Platform Packages.

Note

If you have already installed some packages using confluent-kafka, you must remove this package before installing confluent-server. You may need to run yum autoremove or apt autoremove to remove packages installed as dependencies by a previous install.

Upgrade from 5.2.x to 5.3.x¶

If using confluent-kafka 5.2.x only¶

If you are currently using confluent-kafka 5.2.x and are not using commercial features like LDAP authorizer, you can upgrade confluent-kafka using the regular Upgrade process.

If using confluent-kafka 5.2.x and confluent-security 5.2.x¶

Important

Note that confluent-security 5.2.x is not compatible with confluent-kafka 5.3.x, so you must uninstall or upgrade confluent-security when upgrading confluent-kafka.

If you are using the existing commercially-licensed LDAP authorizer from confluent-security 5.2.x and want to upgrade to 5.3.x, you must install confluent-server, which contains the LDAP authorizer. You must first uninstall 5.2.x versions of confluent-kafka and confluent-security and then install the new confluent-server package. This can be done on one server at a time for rolling upgrades.

Debian packages via APT

Backup all configuration files from /etc, including, for example, /etc/kafka.

Stop the broker and remove the existing packages and their dependencies.

# stop the current kafka broker process
  sudo kafka-server-stop

# uninstall existing 5.2.x confluent-kafka
  sudo apt-get remove confluent-kafka-2.12

# uninstall existing 5.2.x confluent-security
  sudo apt-get remove confluent-security

# To remove Confluent Platform and all its dependencies at once, run the following after stopping all services
  sudo apt-get autoremove confluent-platform-2.12

Remove the repository files of the previous version

sudo add-apt-repository -r "deb https://packages.confluent.io/deb/5.2 stable main"

Add the 5.3 repository to /etc/apt/sources.list.

sudo add-apt-repository "deb https://packages.confluent.io/deb/5.3 stable main"

Refresh repository metadata.
```
sudo apt-get update
```
Install confluent-server. (Note that if you modified the configuration files, apt will prompt you to resolve the conflicts. You should keep your original configuration.)
```
sudo apt-get install confluent-server
```
Start the Kafka broker. If no additional features are being used (e.g., RBAC), no changes are required for the existing server.properties file.
```
kafka-server-start -daemon /etc/kafka/server.properties
```

RPM packages via Yum

Backup all configuration files from /etc, including /etc/kafka.

Stop the broker and remove the existing packages and their dependencies.

# stop the current kafka broker process
  sudo kafka-server-stop

# uninstall existing 5.2.x confluent-kafka
  sudo yum remove confluent-kafka-2.12

# uninstall existing 5.2.x confluent-security
  sudo yum remove confluent-security

# To remove Confluent Platform and all its dependencies at once, run the following after stopping all services
  sudo yum autoremove confluent-platform-2.12

Remove the repository files of the previous version
```
sudo rm /etc/yum.repos.d/confluent.repo
```

Add the 5.3 repository to directory in a file named confluent-5.3.repo.

[confluent-5.3]
name=Confluent repository for 5.3.x packages
baseurl=https://packages.confluent.io/rpm/5.3
gpgcheck=1
gpgkey=https://packages.confluent.io/rpm/5.3/archive.key
enabled=1

Refresh repository metadata.
```
sudo yum clean all
```
Install confluent-server. Note that yum may override your existing configuration files, so you must restore them from backup after installing the packages.
```
sudo yum install confluent-server
```
Restore any updated configuration files and start Kafka broker. If no additional features are being used (e.g., RBAC), no changes are required for the existing server.properties file.
```
kafka-server-start -daemon /etc/kafka/server.properties
```

TAR or ZIP archives

Follow Upgrade instructions to upgrade your broker using TAR or ZIP archives. Use confluent-5.3.1-2.12.tar.gz or the zip archive confluent-5.3.1-2.12.zip to install Kafka when using commercial features like LDAP authorizer.

Upgrade confluent-kafka and Remove confluent-security¶

If you are currently using confluent-kafka with LDAP authorizer from confluent-security 5.2.x, but do not intend to upgrade to the commercially licensed confluent-server package, you can upgrade confluent-kafka and use it without the LDAP authorizer. You can use the built-in SimpleAclAuthorizer for authorization using ACLs as described in Authorization using ACLs. You must replace group-based ACLs with equivalent user-based ACLs to ensure that all your existing authorization rules are applied. Note that you must remove or upgrade confluent-security when you upgrade confluent-kafka.