>
Confluent
  • Product
    • KSQLLearn about KSQL, Streaming SQL for Apache Kafka and what it can do.
      Play
    • Confluent Platform
    • KSQL
    • Confluent Hub
    • Subscription
    • Professional Services
    • Training
    • Customers
  • Cloud
    • Confluent Cloud
    • Support
    • Sign Up
    • Log In
    • Cloud FAQ
  • Developers
    • What is Kafka?
    • Resources
    • Events
    • Online Talks
    • Meetups
    • Kafka Summit
    • Kafka Tutorials
  • About Us
    • What is Apache Kafka
    • Company
    • Partners
    • News
    • Events
    • Careers
    • Contact
  • Blog
  • Docs
  • Download
  • What is the Confluent Platform?
    • What is included in the Confluent Platform?
      • Apache Kafka
        • Confluent’s Commitment to Open Source
      • Kafka Connect
      • Kafka Connect JDBC Connector
      • Kafka Connect HDFS Connector
      • C/C++ library: librdkafka
      • Proactive Support
      • Schema Registry
      • REST Proxy
      • Camus
    • Migrating an existing Kafka deployment
  • Confluent Platform 2.0.1 Release Notes
    • What’s New in CP 2.0.1?
      • New Java consumer
      • Compatibility
      • Security
      • Performance/memory usage
      • Topic deletion
    • What’s New in 2.0?
      • Security
      • Kafka Connect
      • User Defined Quotas
      • New Consumer
      • New Client Library - librdkafka
      • Proactive Support
        • Compatibility Notes
    • How to Download
    • Questions?
  • Data Serialization and Evolution
    • Avro
      • Backward Compatibility
      • Forward Compatibility
      • Full Compatibility
  • Installation
    • Requirements
    • zip and tar archives
    • deb packages via apt
    • rpm packages via yum
    • deb/rpm packages with installer script
    • jars via maven repository
    • Available Packages
  • Upgrade
    • Preparation
    • Step-by-step Guide
      • Upgrade All Kafka Brokers
      • Upgrade Schema Registry, Rest Proxy and Camus
  • Confluent Quickstart
  • Application Development
    • Java Applications: Serializers
    • Non-Java Applications: REST Proxy
  • Operations
  • Kafka Security
    • Encryption and Authentication using SSL
      • Generate SSL key and certificate for each Kafka broker
      • Creating your own CA
      • Signing the certificate
      • Configuring Kafka Brokers
      • Configuring Kafka Clients
      • Enabling SSL Logging
    • Authentication using SASL
      • Prerequisites
        • Kerberos
        • Kerberos Principals
        • All hosts must be reachable using hostnames
      • Configuring Kafka Brokers
      • Configuring Kafka Clients
      • Enabling Logging for SASL
    • Authorization and ACLs
      • Overview
        • Common cases:
        • Further configuration:
      • Command Line Interface
        • Adding ACLs
        • Removing ACLs
        • List ACLs
        • Adding or Removing a Principal as Producer or Consumer
        • Enabling Authorizer Logging for Debugging
    • Adding Security to a Running Cluster
    • ZooKeeper Authentication
      • New clusters
      • Migrating clusters
      • Migrating the ZooKeeper ensemble
    • Kafka Security & the Confluent Platform
      • Other Observations
  • Kafka Connect
    • Kafka Connect
      • Quickstart
      • Requirements
    • System Design
      • Motivation
      • Architecture
    • User Guide
      • Getting Started
      • Connectors, Tasks, and Workers
        • Offsets
        • Workers
          • Standalone Mode
          • Distributed Mode
      • Configuring Connectors
      • Installing Connector Plugins
      • Configuring Workers
        • Common Worker Configs
        • Standalone Worker Configuration
        • Distributed Worker Configuration
        • Overriding Producer & Consumer Settings
      • REST Interface
        • Content Types
        • Statuses & Errors
        • Connectors
    • Connectors
      • JDBC Connector
        • Quickstart
        • Features
          • Incremental Query Modes
        • Configuration
          • JDBC Drivers
          • Examples
          • Configuration Options
      • HDFS Connector
        • Quickstart
        • Features
        • Configuration
          • Example
          • Format and Partitioner
          • Hive Integration
          • Secure HDFS and Hive Metastore
          • Configuration Options
        • Schema Evolution
    • Developer Guide
      • Core Concepts and APIs
        • Connectors and Tasks
        • Partitions and Records
        • Dynamic Connectors
      • Developing a Simple Connector
        • Connector Example
        • Task Example - Source Task
        • Sink Tasks
        • Resuming from Previous Offsets
      • Dynamic Input/Output Partitions
      • Working with Schemas
      • Testing
    • Javadocs
  • Kafka Clients
    • Kafka Consumers
      • Concepts
      • Configuration
      • Administration
        • List Groups
        • Describe Group
      • Examples
        • Initial Setup
        • Basic Poll Loop
        • Shutdown with Wakeup
        • Synchronous Commits
        • Asynchronous Commits
    • Kafka Producers
      • Concepts
      • Configuration
      • Examples
        • Initial Setup
        • Asynchronous Writes
        • Synchronous Writes
    • API Docs
  • Schema Registry
    • Schema Registry
      • Quickstart
      • Installation
      • Deployment
      • Development
      • Requirements
      • Contribute
      • License
    • Changelog
      • Version 2.0.1
        • Schema Registry
      • Version 2.0.0
        • Schema Registry
        • Serializers, Formatters, and Converters
    • API Reference
      • Overview
        • Compatibility
        • Content Types
        • Errors
      • Schemas
      • Subjects
      • Compatibility
      • Config
    • Configuration Options
    • Design Overview
      • Batch ID Allocation
      • Kafka Backend
      • Single Master Architecture
    • Operations
      • Production Deployment
        • Hardware
          • Memory
          • CPUs
          • Disks
          • Network
        • JVM
        • Important Configuration Options
        • Don’t Touch These Settings!
          • Storage settings
        • Kafka & ZooKeeper
        • Multi-DC Setup
          • Overview
          • Recommended Deployment
          • Important Settings
          • Setup
          • Run Book
      • Monitoring
        • Global Metrics
        • Per-Endpoint Metrics
        • Endpoints
    • Serializer and Formatter
      • Serializer
      • Formatter
  • Kafka REST Proxy
    • Kafka REST Proxy
      • Quickstart
        • Inspect Topic Metadata
        • Produce and Consume Avro Messages
        • Produce and Consume JSON Messages
        • Produce and Consume Binary Messages
      • Features
      • Installation
      • Deployment
      • Development
      • Requirements
      • Contribute
      • License
    • Changelog
      • Version 2.0.1
      • Version 2.0.0
    • API Reference
      • Overview
        • Content Types
        • Errors
      • Topics
      • Partitions
      • Consumers
      • Brokers
    • Configuration Options
    • Operations
      • Production Deployment
        • Hardware
          • Memory
          • CPUs
          • Disks
          • Network
        • JVM
        • Deployment
        • Important Configuration Options
        • Don’t Touch These Settings!
        • Post Deployment
      • Monitoring
        • Global Metrics
        • Per-Endpoint Metrics
        • Endpoints
  • Camus
    • Camus
      • Key Features
      • Quickstart
      • Installation
      • Deployment
      • Development
      • Requirements
      • Contribute
      • License
    • Changelog
      • Version 2.0.1
      • Version 2.0.0
    • Configuration Options
      • Schema Registry Configuration
      • Camus Job Configuration
      • Kafka Configuration
      • Example Configuration
    • Design
    • Operations
      • Important Configuration Options
  • Confluent Proactive Support
    • Confluent Proactive Support
      • What is Proactive Support?
      • How it works
      • Which metadata is collected?
        • Anonymous metadata collection (default)
        • Metadata collection for licensed Confluent Customers
      • Which metadata and data is not being collected?
      • Enabling or disabling the Metrics feature
      • Recommended Proactive Support configuration settings for licensed Confluent customers
      • Proactive Support configuration settings
      • Network ports used by Proactive Support
      • Sharing Proactive Support Metadata with Confluent manually
    • Privacy Policy
  • Previous Versions
  • Operations
  • Docs
  • Kafka Clients
  • View page source

Kafka Clients¶

This section discusses the Kafka clients included with the Confluent Platform including the standard Java client and the high-performance C/C++ client, librdkafka.

  • Kafka Consumers
    • Concepts
    • Configuration
    • Administration
      • List Groups
      • Describe Group
    • Examples
      • Initial Setup
      • Basic Poll Loop
      • Shutdown with Wakeup
      • Synchronous Commits
      • Asynchronous Commits
  • Kafka Producers
    • Concepts
    • Configuration
    • Examples
      • Initial Setup
      • Asynchronous Writes
      • Synchronous Writes
  • API Docs

© Copyright 2019, Confluent, Inc. Privacy Policy | Terms & Conditions. Apache, Apache Kafka, Kafka and the Kafka logo are trademarks of the Apache Software Foundation. All other trademarks, servicemarks, and copyrights are the property of their respective owners.

Please report any inaccuracies on this page or suggest an edit.

Next Previous

Last updated on Aug 29, 2019.

Built with Sphinx using a theme provided by Read the Docs.
    Expand Content v.--