Apache Kafka

• Overview
• Introduction to Kafka
  • Events and event streaming
  • Use cases
  • Terminology
    • Brokers
    • Topics
    • Producers
    • Consumers
    • Partitions
    • Replication
  • Components
    • Kafka Connect
    • Kafka Streams
  • Learn more
• Kafka FAQ
  • What is Kafka?
  • What is Kafka used for?
  • How does Kafka work?
  • What are the benefits of using Kafka?
  • How is Kafka different from traditional messaging systems?
  • What are Kafka topics and partitions?
  • What is a Kafka broker?
  • What are Kafka producers and consumers?
  • What is Kafka replication?
  • What are Kafka Connect and Kafka Streams?
  • How do I get started with Kafka?
  • Next steps
• Get Started with Kafka
  • Quick start options
  • Related content
• Kafka APIs
  • Producer API
  • Consumer API
  • Admin Client API
  • Connect API
  • Kafka Streams API
    • Kafka Streams DSL
    • Processor API
  • Related content
• Kafka Design
  • Design Overview
    • Topics in this section
    • Learn more
  • Kafka and the File System
    • Why the file system?
    • Kafka and the JVM
    • Persistent queue and constant time
    • Related content
  • Batch Processing for Efficiency
    • Avoids excessive byte copying
    • Batches I/O operations
    • End-to-end batch compression
    • Related content
  • Producer Design
    • What is a producer?
    • Producer load balancing
    • Batching
    • Related content
  • Consumer Design
    • What is a consumer?
    • Push versus pull design
    • Consumer groups and group IDs
    • Consumer rebalance protocols and partition assignments
    • Tracking consumer position
    • Consumer offsets
    • Consumer position illustrated
    • Related content
  • Kafka Message Delivery Guarantees
    • Semantic guarantees
    • Producer delivery
    • Consumer receipt
    • Exactly once support
    • Related content
  • Replication
    • Replication overview
    • In-sync replicas and producer acks
    • Replicated logs: quorums, ISRs, and state machines
    • Unclean leader election and partition loss
    • Replica management
    • Related content
  • Kafka Log Compaction
    • Topic compaction
    • Retention example
    • Compaction in action
      • Compaction enables deletes
      • View of compaction
      • Topic compaction video
    • Compaction guarantees
    • Configure compaction
    • Related content
  • Quotas
    • Why are quotas necessary?
    • Client groups
    • Quota configuration
    • Network bandwidth quotas
    • Request rate quotas
    • Enforcement
    • Related content
• Kafka Tools and Operations
  • Kafka Command-Line Interface (CLI) Tools
    • Search by tool name
    • Manage Kafka and configure metadata
      • kafka-server-start.sh
      • kafka-server-stop.sh
      • kafka-storage.sh
      • kafka-cluster.sh
      • kafka-features.sh
      • kafka-broker-api-versions.sh
      • kafka-metadata-quorum.sh
      • kafka-metadata-shell.sh
      • kafka-configs.sh
    • Manage topics, partitions, and replication
      • kafka-topics.sh
      • kafka-configs.sh
      • kafka-get-offsets.sh
      • kafka-leader-election.sh
      • kafka-transactions.sh
      • kafka-reassign-partitions.sh
      • kafka-delete-records.sh
      • kafka-log-dirs.sh
      • kafka-replica-verification.sh
      • kafka-mirror-maker.sh
      • connect-mirror-maker.sh
    • Client, producer, and consumer tools
      • kafka-client-metrics.sh
      • kafka-verifiable-consumer.sh
      • kafka-configs.sh
      • kafka-verifiable-producer.sh
      • kafka-verifiable-share-consumer.sh
      • kafka-console-consumer.sh
      • kafka-console-producer.sh
      • kafka-console-share-consumer.sh
      • kafka-producer-perf-test.sh
      • kafka-groups.sh
      • kafka-consumer-groups.sh
      • kafka-consumer-perf-test.sh
      • kafka-share-consumer-perf-test.sh
      • kafka-share-groups.sh
    • Manage Kafka Connect
      • connect-distributed.sh
      • connect-standalone.sh
      • connect-mirror-maker.sh
    • Manage Kafka Streams
      • kafka-streams-application-reset.sh
      • kafka-streams-groups.sh
    • Manage security
      • kafka-acls
      • kafka-delegation-tokens.sh
    • Test and troubleshoot
      • kafka-e2e-latency.sh
      • kafka-dump-log.sh
      • kafka-jmx.sh
      • trogdor.sh
      • kafka-run-class.sh
      • Related content
  • Topic Operations
    • Add a topic
    • Describe a topic
    • Change the retention value for a topic
    • Increase partitions for a topic
    • Delete a topic
    • Related content
  • Choose and Change Partition Count
    • Partition formula
    • Partitions and message keys
    • Change the number of partitions
    • Related content
  • How to Use Kafka Tools With Confluent Cloud
    • Create a configuration file
    • Call the tool
    • Related content
  • View Consumer Group Info
    • Check consumer position
    • List groups and view offsets
    • Related content