System Requirements

Hardware

On-Premise

The following machine recommendations are for installing individual Confluent Platform components:

Component Nodes Storage Memory CPU
Control Center 1 300 GB, preferably SSDs 32 GB RAM 8 cores or more
Kafka Broker 3
  • 12 X 1 TB disk. RAID 10 is optional
  • Separate OS disks from Kafka storage
64 GB RAM Dual 12 core sockets
Kafka Connect 2 Only required for installation 0.5 - 4 GB heap size depending on connectors Typically not CPU- bound. More cores is better than faster cores.
KSQL 2 Use SSD. Sizing depends on the number of concurrent queries and the aggregation performed. 20 GB RAM 4 cores
Rest Proxy 2 Only required for installation 1 GB overhead plus 64 MB per producer and 16 MB per consumer 16 cores to handle HTTP requests in parallel and background threads for consumers and producers.
Schema Registry 2 Only required for installation 1 GB heap size Typically not CPU- bound. More cores is better than faster cores.
ZooKeeper 3-5
  • Transaction log: 512 GB SSD
  • Storage: 2 X 1 TB SATA, RAID 10
32 GB RAM 2-4 Cores

Cloud

Amazon AWS EC2

The following machine recommendations are for installing individual Confluent Platform components:

Component Node type Storage Memory CPU Network
Control Center m5.2xlarge Use EBS (SSD, optimized) 32 GB 8 vCPU Up to 2,120 Mbps
Kafka Broker r4.xlarge Use SSD-based EBS storage. Recommend configuring the instances as “ebs optimized” 30.5 GB 4 vCPU Up to 10 Gigabit
Kafka Connect c5.xlarge Use EBS 8 GB 4 vCPU Up to 2,250 Mbps
KSQL i3.xlarge or r4.xlarge Use EBS (SSD, optimized) 30.5 GB 4 vCPU Up to 10 Gigabit
Rest Proxy c5.xlarge Use EBS 8 GB 4 vCPU Up to 2,250 Mbps
Schema Registry m5.large Use EBS 8 GB 2 vCPU Up to 2,120 Mbps
ZooKeeper m5.large 1 x 32 GB SSD 8 GB 2 vCPU Up to 2,120 Mbps

Software

Operating Systems

Operating System 1.0.0 2.0.x 3.0.x 3.1.x 3.2.x 3.3.x 4.0.x 4.1.x
Red Hat Enterprise Linux/CentOS 6.x yes yes yes yes yes yes yes yes
Red Hat Enterprise Linux/CentOS 7.x yes yes yes yes yes yes yes yes
Debian 7 yes yes yes no no no no no
Debian 8 yes yes yes yes yes yes yes yes
Ubuntu 12.04 LTS yes yes yes no no no no no
Ubuntu 14.04 LTS yes yes yes yes yes yes yes yes
Ubuntu 16.04 LTS no no no yes yes yes yes yes
  • Windows is not currently supported. Windows users can download and use the ZIP and TAR archives, but must run the JAR files directly.
  • macOS is supported for testing and development purposes only.

Java

Java 1.7 and 1.8 are supported in this version of Confluent Platform (Java 1.9 is currently not supported). You should run with the Garbage-First (G1) garbage collector. For more information, see the Supported Versions and Interoperability.

Docker

Optional: Docker version 1.11 or later. This is required if you are installing Confluent Platform by using the Docker images.

Ports

By default the Confluent Platform components use these ports to communicate. These ports must be open.

Component Port
Apache Kafka brokers (plain text) 9092
Confluent Control Center 9021
Kafka Connect REST API 8083
KSQL Server REST API 8088
REST Proxy 8082
Schema Registry REST API 8081
ZooKeeper 2181