Important

You are viewing documentation for an older version of Confluent Platform. For the latest, click here.

System Requirements

Hardware

On-Premise

The following machine recommendations are for installing individual Confluent Platform components:

Component Nodes Storage Memory CPU
Control Center 1 300 GB, preferably SSDs 32 GB RAM (JVM default 6 GB) 8 cores or more
Broker 3
  • 12 X 1 TB disk. RAID 10 is optional
  • Separate OS disks from Apache Kafka® storage
 64 GB RAM Dual 12 core sockets
Connect 2 Only required for installation 0.5 - 4 GB heap size depending on connectors Typically not CPU- bound. More cores is better than faster cores.
KSQL 2 Use SSD. Sizing depends on the number of concurrent queries and the aggregation performed. 20 GB RAM 4 cores
REST Proxy 2 Only required for installation 1 GB overhead plus 64 MB per producer and 16 MB per consumer 16 cores to handle HTTP requests in parallel and background threads for consumers and producers.
Schema Registry 2 Only required for installation 1 GB heap size Typically not CPU- bound. More cores is better than faster cores.
ZooKeeper 3-5
  • Transaction log: 512 GB SSD
  • Storage: 2 X 1 TB SATA, RAID 10

Each write to ZooKeeper must be persisted in the transaction log before the client gets an ack. Using SSD reduces the ZooKeeper write latency.

 32 GB RAM 2-4 Cores

Cloud

Tip

If you don’t see your region listed, contact Confluent. Additional regions can be supported by request.

Description Confluent Cloud Enterprise Confluent Cloud
Amazon Web Services (AWS)

Supported in these regions:

  • ap-southeast-1 (Singapore)
  • ap-southeast-2 (Sydney)
  • ca-central-1 (Canada Central)
  • eu-west-1 (Ireland)
  • eu-central-1 (Frankfurt)
  • us-east-1 (N. Virginia)
  • us-east-2 (Ohio)
  • us-west-1 (N. California)
  • us-west-2 (Oregon)

Supported in these regions:

  • ap-southeast-1 (Singapore)
  • ap-southeast-2 (Sydney)
  • ca-central-1 (Canada Central)
  • eu-west-1 (Ireland)
  • eu-central-1 (Frankfurt)
  • us-east-1 (N. Virginia)
  • us-east-2 (Ohio)
  • us-west-1 (N. California)
  • us-west-2 (Oregon)
AWS multi-zone high availability

Supported in these regions:

  • us-east-1
  • us-east-2
  • us-west-1
  • us-west-2
  • eu-west-1
  • eu-central-2
  • ap-southeast-1
  • ap-southeast-2
 Not supported
GCP (Google Cloud Platform)

Supported in these regions:

  • asia-east2 (Hong Kong)
  • australia-southeast1 (Sydney)
  • europe-north (Finland)
  • europe-west1 (Belgium)
  • europe-west2 (London)
  • europe-west3 (Frankfurt)
  • us-central1 (Iowa)
  • us-east4 (N. Virginia)
  • us-west2 (Los Angeles)

Supported in these regions:

  • asia-east2 (Hong Kong)
  • australia-southeast1 (Sydney)
  • europe-north (Finland)
  • europe-west1 (Belgium)
  • europe-west2 (London)
  • europe-west3 (Frankfurt)
  • us-central1 (Iowa)
  • us-east4 (N. Virginia)
  • us-west2 (Los Angeles)
GCP multi-zone high availability

Supported in these regions:

  • us-central1
  • us-east4
  • europe-west1
  • europe-west2
 Not supported
Microsoft Azure Contact Confluent Contact Confluent

Software

Operating Systems

Operating System 5.2.x 5.1.x 5.0.x 4.1.x 4.0.x 3.3.x 3.2.x 3.1.x 3.0.x 2.0.x 1.0.0
RHEL/CentOS 6.x yes yes yes yes yes yes yes yes yes yes yes
RHEL/CentOS 7.x yes yes yes yes yes yes yes yes yes yes yes
Debian 7 no no no no no no no no yes yes yes
Debian 8 yes yes yes yes yes yes yes yes yes yes yes
Ubuntu 12.04 LTS no no no no no no no no yes yes yes
Ubuntu 14.04 LTS yes yes yes yes yes yes yes yes yes yes yes
Ubuntu 16.04 LTS yes yes yes yes yes yes yes yes no no no
  • Windows is not currently supported. Windows users can download and use the ZIP and TAR archives, but must run the JAR files directly.
  • macOS 10.13 and later is supported for testing and development purposes only.
  • Control Center requires many open RocksDB files. Set the ulimit for the number of open files (ulimit -n) to a minimum value of 16384.

Java

Java 8 and Java 11 are supported in this version of Confluent Platform (Java 9 and 10 are not supported). For more information, see Java supported versions.

Docker

Optional: Docker version 1.11 or later running on a supported operating system. This is required if you are installing Confluent Platform by using the Docker images.

Network

Control Center relies heavily on Kafka, so a fast and reliable network is important for performance. Modern datacenter networking speed of 1 GbE, 10 GbE should be sufficient.

Ports

By default the Confluent Platform components use these ports to communicate. These ports must be open.

Component Port
Kafka brokers (plain text) 9092
Confluent Control Center 9021
Kafka Connect REST API 8083
KSQL Server REST API 8088
REST Proxy 8082
Schema Registry REST API 8081
ZooKeeper 2181