Tutorials and Resources¶
Demos¶
- Using Confluent Platform to monitor Kafka streaming ETL deployments
- This Docker-based demo shows you how to monitor Kafka streaming ETL deployments using Control Center. You can follow along with the playbook and watch the video tutorials.
- Confluent Platform Demos and Code Example Repository
- Demo applications and code examples for Confluent Platform and Apache Kafka.
- Kafka Streams Example Repository
- Demo applications and code examples for Apache Kafka’s Streams API.
- Docker images for Confluent Platform
- Docker images for deploying and running the Confluent Platform.
- Security Tutorial
- This tutorial is a step-by-step guide to configuring the Confluent Platform with SSL encryption, SASL authentication, and authorization
- Designing Event Driven Systems (Microservices) Demo
- This project goes hand in hand with the book ‘Designing Event Driven Systems’, demonstrating how you can build a small microservices application with Kafka and Kafka Streams.
Technical Blogs¶
The Confluent blog contains many technical blog posts, including:
- Introducing Kafka Streams: Stream Processing Made Simple
- Describes the major new features in Apache Kafka v0.10: Kafka’s Streams API. The Streams API, available as a Java library that is part of the official Kafka project, is the easiest way to write mission-critical real-time applications and microservices with all the benefits of Kafka’s server-side cluster technology.
- Putting Apache Kafka To Use: A Practical Guide to Building a Streaming Platform
- A two part post that discusses our experience with real-time data streams and what is required to be successful with this new area of technology. All of this is based on real experience: we spent the last five years building Apache Kafka, transitioning LinkedIn to a fully stream-based architecture, and helping a number of Silicon Valley tech companies do the same thing.
- Introducing the Kafka Consumer: Getting Started with the New Apache Kafka 0.9 Consumer Client
- This blog describes how we redesigned the producer and consumer clients to support many use cases that were hard or impossible with the old clients and establish a set of APIs we could support over the long haul.
- How to choose the number of topics/partitions in a Kafka cluster?
- This blog explains a few important determining factors and provides simple formulas to use when choosing the number of topics and partitions in a Kafka cluster.
- Exactly-once Semantics are Possible: Here’s How Kafka Does it
- This blog discusses what exactly-once semantics mean in Apache Kafka, why it is a hard problem, and how the new idempotence and transactions features in Kafka enable correct exactly-once stream processing using Kafka’s Streams API.
Video Tutorials and Screencasts¶
The Confluent YouTube channel provides a great resource, including tutorials, how-tos, customer use cases, and general Confluent education. This content is frequently updated and so it is recommended that you subscribe.
- Intro to Streams | Apache Kafka Streams API
- The Streams API of Apache Kafka is the easiest way to write mission-critical real-time applications and microservices with all the benefits of Kafka’s server-side cluster technology. It allows you to build standard Java or Scala applications.
- KSQL from Confluent | Streaming SQL for Apache Kafka
- KSQL is an open source streaming SQL engine that implements continuous, interactive queries against Apache Kafka. KSQL makes it easy to read, write and process streaming data in real-time, at scale, using SQL-like semantics.
- Neha Narkhede | Kafka Summit 2017 Keynote (Go Against the Flow: Databases and Stream Processing)
- Neha Narkhede is co-founder and CTO at Confluent. Prior to founding Confluent, Neha led streams infrastructure at LinkedIn, where she was responsible for LinkedIn’s streaming infrastructure built on top of Apache Kafka® and Apache Samza.
- Microservices Explained by Confluent
- Microservices architectures enable organizations to evolve their systems away from the slow and unresponsive shared-state architectures of the past. Confluent provides a streaming platform for incorporating data in flight into a lightweight, efficient, and responsive microservices architecture.
- Introducing the Confluent CLI
- The Confluent Command Line Interface (CLI) helps you speed up development by making it easy to get up and running. You will be able to iterate more quickly when implementing your apps and interact with the entire Confluent ecosystem.
White Papers¶
You can find the Confluent white papers at https://www.confluent.io/resources/, including:
- Confluent Enterprise Reference Architecture
- This white paper describes the reference architecture of Confluent Platform, which is the most complete platform to build enterprise-scale streaming pipelines using Apache Kafka and to simplify the development of stream processing applications.
- Optimizing Your Apache Kafka Deployment
- This white paper discusses how to optimize your Apache Kafka deployment for various services goals including throughput, latency, durability and availability. It is intended for Kafka administrators and developers planning to deploy Kafka in production.
- Microservices in the Apache Kafka Ecosystem
- This white paper provides a brief overview of how microservices can be built in the Apache Kafka ecosystem.
- Disaster Recovery for Multi-Datacenter Kafka Deployments
- This white paper provides a practical guide to configuring multiple Apache Kafka clusters so that if a disaster scenario strikes, you have a plan for failover, failback, and ultimately successful recovery.