Important

You are viewing documentation for an older version of Confluent Platform. For the latest, click here.

Kafka Operations

In this document, you will learn how to manage a Kafka cluster.

Here, we will cover three main topics:

• Deploying your cluster to production, including best practices and important configuration that should (or should not!) be changed
• Performing post-deployment logistics, such as a rolling restart or backup of your cluster
• Monitoring your cluster’s vital statistics, understanding which behaviors are normal and which should be cause for alarm, and interpreting various stats provided by Kafka

• Running Kafka in Production
  • Hardware
    • Memory
    • CPUs
    • Disks
    • Network
    • Filesystem
    • General considerations
  • JVM
  • Production Configuration Options
    • General configs
    • Replication configs
  • File descriptors and mmap
  • Multi-node Configuration
• Post Deployment
  • Changing configs dynamically
    • cleanup.policy
    • flush.messages
    • flush.ms
    • max.message.bytes
    • min.insync.replicas
    • retention.bytes
    • retention.ms
    • segment.bytes
    • segment.jitter.ms
    • segment.ms
    • unclean.leader.election.enable
  • Logging
  • Admin operations
  • Rolling Restart
  • Performance Tips
  • Software Updates
  • Backup and Restoration
• Auto Data Balancing
  • Requirements
  • Quickstart
    • Start a Kafka cluster
    • Create topics and produce data
    • Execute the rebalancer
    • Check status and finish
    • Leader balance
    • Decommissioning brokers
    • Limiting Bandwidth Usage during Data Migration
  • Licensing
  • Configuration Options
    • Configuration Options for the rebalancer tool
• Monitoring Kafka
  • Server Metrics
    • Broker Metrics
    • ZooKeeper Metrics
  • Producer Metrics
    • Global Request Metrics
    • Global Connection Metrics
    • Per-Broker Metrics
    • Per-Topic Metrics
  • New Consumer Metrics
    • Fetch Metrics
    • Topic-level Fetch Metrics
    • Consumer Group Metrics
    • Global Request Metrics
    • Global Connection Metrics
    • Per-Broker Metrics
  • Old Consumer Metrics
• Confluent Metrics Reporter
  • Installation
  • Configuration
    • Message size
  • Configuration Options
    • Security
    • Authentication
    • Authorization
  • Verification