documentation
Get Started Free
  • Get Started Free
  • Stream
      Confluent Cloud

      Fully-managed data streaming platform with a cloud-native Kafka engine (KORA) for elastic scaling, with enterprise security, stream processing, governance.

      Confluent Platform

      An on-premises enterprise-grade distribution of Apache Kafka with enterprise security, stream processing, governance.

  • Connect
      Managed

      Use fully-managed connectors with Confluent Cloud to connect to data sources and sinks.

      Self-Managed

      Use self-managed connectors with Confluent Platform to connect to data sources and sinks.

  • Govern
      Managed

      Use fully-managed Schema Registry and Stream Governance with Confluent Cloud.

      Self-Managed

      Use self-managed Schema Registry and Stream Governance with Confluent Platform.

  • Process
      Managed

      Use Flink on Confluent Cloud to run complex, stateful, low-latency streaming applications.

      Self-Managed

      Use Flink on Confluent Platform to run complex, stateful, low-latency streaming applications.

Stream
Confluent Cloud

Fully-managed data streaming platform with a cloud-native Kafka engine (KORA) for elastic scaling, with enterprise security, stream processing, governance.

Confluent Platform

An on-premises enterprise-grade distribution of Apache Kafka with enterprise security, stream processing, governance.

Connect
Managed

Use fully-managed connectors with Confluent Cloud to connect to data sources and sinks.

Self-Managed

Use self-managed connectors with Confluent Platform to connect to data sources and sinks.

Govern
Managed

Use fully-managed Schema Registry and Stream Governance with Confluent Cloud.

Self-Managed

Use self-managed Schema Registry and Stream Governance with Confluent Platform.

Process
Managed

Use Flink on Confluent Cloud to run complex, stateful, low-latency streaming applications.

Self-Managed

Use Flink on Confluent Platform to run complex, stateful, low-latency streaming applications.

Learn
Get Started Free
  1. Home
  2. Apache Kafka

CONFLUENT PRODUCTS

  • Apache Kafka
    • Overview
    • Introduction to Kafka
    • Get Started with Kafka
    • Kafka APIs
    • Kafka Design
      • Design Overview
      • Kafka and the File System
      • Batch Processing for Efficiency
      • Producer Design
      • Consumer Design
      • Message Delivery Guarantees
      • Replication
      • Log Compaction
      • Quotas
    • Kafka Tools and Operations
      • Kafka Command-Line Interface (CLI) Tools
      • Topic Operations
      • Choose and Change Partition Count
      • How to Use Kafka Tools With Confluent Cloud
      • View Consumer Group Info
  • Apache Kafka Clients
    • Overview
    • Use Kafka Clients with Confluent Cloud
    • Use Kafka Clients with Confluent Platform

Kafka Design¶

  • Design Overview
    • Topics in this section
    • Learn more
  • Kafka and the File System
    • Kafka and the JVM
    • Persistent queue and constant time
  • Batch Processing for Efficiency
    • Avoids excessive byte copying
    • Batches I/O operations
    • End-to-end batch compression
  • Producer Design
    • Producer load balancing
    • Batching
    • Additional reading
  • Consumer Design
    • Push versus pull design
    • Consumer groups and group IDs
    • Consumer rebalance protocols and partition assignments
    • Tracking consumer position
    • Consumer offsets
    • Consumer position illustrated
    • Related content
  • Message Delivery Guarantees
    • Producer delivery
    • Consumer receipt
    • Exactly once support
    • Learn more
  • Replication
    • In-sync replicas and producer acks
    • Replicated logs: quorums, ISRs, and state machines
    • Unclean leader election and partition loss
    • Replica management
  • Log Compaction
    • Retention example
    • Compaction in action
    • Compaction guarantees
    • Configure compaction
  • Quotas
    • Why are quotas necessary?
    • Client groups
    • Quota configuration
    • Network bandwidth quotas
    • Request rate quotas
    • Enforcement

Was this doc page helpful?

Give us feedback

Do you still need help?

Confluent support portal Ask the community
Thank you. We'll be in touch!
Be the first to get updates and new content

By clicking "SIGN UP" you agree that your personal data will be processed in accordance with our Privacy Policy.

  • Confluent
  • About
  • Careers
  • Contact
  • Professional Services
  • Product
  • Confluent Cloud
  • Confluent Platform
  • Connectors
  • Flink
  • Stream Governance
  • Developer
  • Free Courses
  • Tutorials
  • Event Streaming Patterns
  • Documentation
  • Blog
  • Podcast
  • Community
  • Forum
  • Meetups
  • Kafka Summit
  • Catalysts
Terms & Conditions Privacy Policy Do Not Sell My Information Modern Slavery Policy Cookie Settings Feedback

Copyright © Confluent, Inc. 2014- Apache®️, Apache Kafka®️, Kafka®️, Apache Flink®️, Flink®️, Apache Iceberg®️, Iceberg®️ and associated open source project names are trademarks of the Apache Software Foundation

On this page: