Manage Kafka Clusters Using Confluent Platform

• Overview
  • Related content
• Kafka Metadata Management
  • Metadata Management in Kafka
  • KRaft Overview
    • Why move to KRaft?
    • Migrate from ZooKeeper to KRaft
    • Configure Confluent Platform with KRaft
    • Limitations and known issues
    • Related content
  • Configure KRaft
    • Hardware and JVM requirements
    • Configuration options
    • Settings for other components
    • Generate and format IDs
    • Tools for debugging KRaft mode
    • Monitor KRaft
    • Related content
  • Configure ZooKeeper
    • Supported version
    • Hardware
    • JVM
    • Configuration Options
    • Monitoring
    • Multi-node Setup
    • Post Deployment
    • Migrating to KRaft
• Manage Self-Balancing Clusters
  • Overview
    • How Self-Balancing simplifies Kafka operations
    • Self-Balancing vs. Auto Data Balancer
    • How it works
    • Configuration and monitoring
    • Replica placement and rack configurations
    • Security considerations
    • Troubleshooting
    • Related content
  • Quick Start
    • About the demo
    • Setup and what’s included
    • Start the services
    • Run the demo scenarios
    • Teardown
    • Related content
  • Tutorial: Adding and Remove Brokers
    • KRaft and ZooKeeper
    • Prerequisites
    • Configure Kafka brokers
    • Configure Control Center with REST endpoints and advertised listeners
    • Start Confluent Platform, create topics, and generate test data
    • Use the command line
    • Use Control Center
    • Shutdown and cleanup tasks
    • Related content
  • Configure
    • Self-Balancing configurations on the brokers
    • Self-Balancing internal topics
    • Required Configurations for Control Center
    • Examples: Update broker configurations on the fly
    • Monitoring the balancer with kafka-rebalance-cluster
    • kafka-remove-brokers
    • Related content
  • Performance and Resource Usage
    • Add brokers to expand a small cluster with a high partition count
    • Test scalability of a large cluster with many partitions
    • Repeatedly bounce the controller
• Auto Data Balancing
  • Overview
  • Quick Start
    • Requirements and Limitations
    • Confluent Auto Data Balancer Quick Start
    • Licensing
    • Suggested Reading
  • Tutorial: Add and Remove Brokers
    • Installing and Running Docker
    • Docker Client: Setting Up a Three Node Kafka Cluster
  • Configure
    • confluent-rebalancer command flags
    • Using a command-config file to talk to Kafka
    • Specifying Auto Data Balancer properties in a config-file
    • Example: Run the rebalancer with Security, Metrics, and License Configurations
    • Example: Run the rebalancer with a Separate Metrics Cluster
    • ACLs for Auto Data Balancing
• Tiered Storage
  • Enabling Tiered Storage on a broker
    • AWS
    • GCS
    • Azure
    • Pure Storage FlashBlade
    • Nutanix Objects
    • NetApp Object Storage
    • Dell EMC ECS
    • MinIO
    • Hitachi Content Platform Object Storage
  • Configuring Tiered Storage to support compacted topics
  • Creating a topic with Tiered Storage
  • Sending test messages to experiment with data storage
  • Best practices and recommendations
    • Tuning
    • Time interval for topic deletes
    • Log segment sizes
    • ACLs on Tiered Storage internal topics
    • TLS settings and troubleshooting certificates
  • Sizing brokers with Tiered Storage
    • Tier archiver metrics
    • Tier fetcher metrics
    • Kafka log of tier size per partition
  • Example performance test
  • Supported platforms and features
  • Known limitations
  • Disabling Tiered Storage
  • Related content