1. Home

Apache Kafka

• Introduction to Kafka
  • Use cases
  • Terminology
    • Brokers
    • Topics
    • Producers
    • Consumers
    • Partitions
    • Replication
  • Components
    • Kafka Connect
    • Kafka Streams
  • Learn more
• Kafka Design
  • Design Overview
    • Topics in this section
    • Learn more
  • Kafka and the File System
    • Kafka and the JVM
    • Persistent queue and constant time
  • Batch Processing for Efficiency
    • Avoids excessive byte copying
    • Batches I/O operations
    • End-to-end batch compression
  • Producer Design
    • Producer load balancing
    • Batching
    • Additional reading
  • Consumer Design
    • Push versus pull
    • Track consumer position
    • Learn more
  • Message Delivery Guarantees
    • Producer delivery
    • Consumer receipt
    • Exactly once support
    • Learn more
  • Replication
    • Committed message guarantees
    • Replicated logs: quorums, ISRs, and state machines
    • Unclean leader election and partition loss
    • Replica management
  • Log Compaction
    • Compaction in action
    • Compaction guarantees
    • Configure compaction
  • Quotas
    • Why are quotas necessary?
    • Client groups
    • Quota configuration
    • Network bandwidth quotas
    • Request rate quotas
    • Enforcement
• Kafka Tools and Operations
  • Kafka Command-Line Tools
    • Tools to start and stop Kafka and configure metadata
    • Topic, partition, and replica tools
    • Client, producer, and consumer tools
    • Connect tools
    • Kafka Streams tools
    • Security tools
    • Addition testing and miscellaneous tools
  • Topic Operations
    • Add a topic
    • Modify a topic
    • Delete a topic
  • Choose and Change Partition Count
    • Partition formula
    • Partitions and message keys
    • Change the number of partitions
  • Manage Consumer Groups
    • Check consumer position
    • View consumer group info