.. _tutorials:

Videos, Demos, and Reading Material
===================================

If you're new to stream processing, |ak-tm|, or |cp|, here is a curated list of resources to get you started.

.. tip:: The new `Confluent Developer site <https://developer.confluent.io/>`__ provides numerous
         resources to get started with |ak|, |cp|, and |ccloud|. It includes video tutorials, sample
         code, the entire collection of guided |ak| tutorials, podcast episodes, and info about |ak|
         meetups.

------
Videos
------

Collection
~~~~~~~~~~

`Confluent YouTube channel <https://www.youtube.com/channel/UCmZz-Gj3caLLzEWBtbYUXaA/>`_
    The Confluent YouTube channel is a great resource for tutorials, how-tos, customer use cases, and general Confluent education. This content is frequently updated and so it is recommended that you subscribe.


Event Streaming Platform
~~~~~~~~~~~~~~~~~~~~~~~~

`The Event Streaming Platform Explained <https://www.youtube.com/watch?v=T3Qkl59okjo&feature=youtu.be>`__
    Jay Kreps discusses key trends and concepts which are at the heart of a revolution happening in data infrastructure and application architectures.

`Why Kafka? <https://videos.confluent.io/watch/rTFdJzd2478FT1iV2GEwkW>`__
    Why |ak| has become the event-driven, real-time architecture for enterprises. 

`Neha Narkhede | Kafka Summit 2018 Keynote (The Present and Future of the Streaming Platform) <https://www.youtube.com/watch?v=eublKlalobg>`_
    Neha Narkhede is co-founder and CTO at Confluent. Prior to founding Confluent, Neha led streams infrastructure at LinkedIn, where she was responsible for LinkedIn’s streaming infrastructure built on top of |ak| and Apache Samza.

`Confluent Essentials for Apache Kafka <https://cloud.contentraven.com/confluent/self-userpackage>`_
    In this free 1 hour video, learn about the basic concepts driving the use cases and functionality of |ak-tm|. (In the link above, scroll to the target video)

`Microservices Explained by Confluent <https://www.youtube.com/watch?v=aWI7iU36qv0>`_
    Microservices architectures enable organizations to evolve their systems away from the slow and unresponsive shared-state architectures of the past. Confluent provides a streaming platform for incorporating data in flight into a lightweight, efficient, and responsive microservices architecture.


Stream Processing
~~~~~~~~~~~~~~~~~

`Intro to Streams | Kafka Streams API <https://www.youtube.com/watch?v=Z3JKCLG3VP4>`_
    The :ref:`Streams API of Apache <kafka_streams>` |ak| is the easiest way to write mission-critical real-time applications and microservices with all the benefits of |ak|'s server-side cluster technology. It allows you to build standard Java or Scala applications.

`Intro to KSQL | Streaming SQL for Apache Kafka <https://www.youtube.com/playlist?list=PLa7VYi0yPIH2eX8q3mPpZAn3qCS1eDX8W>`_
    |cksql-full| is the streaming SQL engine that implements continuous, Interactive Queries against |ak|. KSQL makes it easy to read, write and process streaming data in real-time, at scale, using SQL-like semantics.


-----
Demos
-----

GitHub Repos for Examples
~~~~~~~~~~~~~~~~~~~~~~~~~

`Main Repo with 20+ Demos <https://github.com/confluentinc/examples>`_
    End-to-end demos and examples showcasing stream processing on |cp|.

`Kafka Streams Examples <https://github.com/confluentinc/kafka-streams-examples>`_
    Demo applications and code examples for |ak|'s Streams API.

:devx-examples:`Kafka Client Application Examples|clients`
    Client examples for Java producers, Java consumers, and other clients connecting to on-prem or |ccloud|.


Highlights
~~~~~~~~~~

The best demo to start with is :ref:`cp-demo`, also known as `cp-demo`.
This demo spins up a |ak| event streaming application using KSQL for stream processing, with many security features enabled, in an end-to-end streaming ETL pipeline with a source connector pulling from live IRC channels and a sink connector connecting to Elasticsearch and Kibana for visualizations.
`cp-demo` also comes with a playbook and is a great configuration reference for |cp|.

:ref:`cp-demo`
    This demo shows you how to deploy an |ak-tm| streaming ETL using KSQL for stream processing and :ref:`Control Center <control_center>` for monitoring, with security enabled end-to-end. You can follow along with the playbook and watch the video tutorials.

:ref:`Stream Processing to Confluent Cloud <quickstart-demos-ccloud>`
    This |ccloud| demo is the automated version of the :ref:`KSQL Tutorial <ksql_quickstart-local>`, but instead of KSQL stream processing on your local install, it runs on your |ccloud| cluster. You can follow along with the playbook.

:ref:`Security Tutorial <security_tutorial>`
    This tutorial is a step-by-step guide to configuring |cp| with SSL encryption, SASL authentication, and authorization.

:ref:`Designing Event Driven Systems (Microservices) Demo <event_driven_apps_tutorial>`
    This project goes hand in hand with the book 'Designing Event Driven Systems', demonstrating how you can build a small microservices application with |ak| and |kstreams|.

`Real-Time Streaming ETL from Oracle Transactional Data <https://www.confluent.io/blog/ksql-in-action-real-time-streaming-etl-from-oracle-transactional-data/>`_
    Replace batch extracts with event streams, and batch transformations with
    in-flight transformation of event streams. Take a stream of data from a
    transactional system built on Oracle, transform it, and stream it into
    Elasticsearch. Use KSQL to filter streams of events in real-time from a
    database and join between events from two database tables to create rolling
    aggregates on the data.

`Write a User Defined Function (UDF) for KSQL <https://www.confluent.io/blog/build-udf-udaf-ksql-5-0>`_
    Build, deploy, and test a user-defined function (UDF) to extend the set of
    available functions in your KSQL code. Write Java code within the UDF to
    convert a timestamp from String to BigInt.

:ref:`Monitoring Kafka in Confluent Control Center <ksql-demo-3>`
    Use the |cksql-full| CLI and |c3| to view streams and throughput
    of incoming records for persistent KSQL queries.



.. _cp_reading:

----------------
Reading Material
----------------

Books
~~~~~

`Making Sense of Stream Processing <https://www.confluent.io/stream-processing/>`__

`Kafka: The Definitive Guide <https://www.confluent.io/resources/kafka-the-definitive-guide/>`__

`Designing Event-Driven Systems <https://www.confluent.io/designing-event-driven-systems>`__

`Kafka Streams in Action <https://www.confluent.io/blog/kafka-streams-action>`__

`I Heart Logs: Event Data, Stream Processing, and Data Integration <https://www.confluent.io/ebook/i-heart-logs-event-data-stream-processing-and-data-integration/>`__


Smaller Bites
~~~~~~~~~~~~~

`Introducing Kafka Streams: Stream Processing Made Simple <https://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple/>`__

`Journey to Event Driven – Four-part blog series <https://www.confluent.io/blog/journey-to-event-driven-part-1-why-event-first-thinking-changes-everything>`__

`Building a Real-Time Streaming ETL Pipeline in 20 Minutes <https://www.confluent.io/blog/building-real-time-streaming-etl-pipeline-20-minutes/>`__

`Data Wrangling with Apache Kafka and KSQL <https://www.confluent.io/blog/data-wrangling-apache-kafka-ksql>`__

`Apache Kafka vs. Enterprise Service Bus (ESB) – Friends, Enemies or Frenemies? <https://www.confluent.io/blog/apache-kafka-vs-enterprise-service-bus-esb-friends-enemies-or-frenemies>`__

.. toctree::
    :maxdepth: 1
    :hidden:

    cp-demo/docs/index
    examples/ccloud/docs/index
    examples/microservices-orders/docs/index
    examples/kubernetes/gke-base/docs/index
    examples/kubernetes/replicator-gke-cc/docs/index
    examples/replicator-schema-translation/docs/index
    examples/security/rbac/docs/index
    examples/cloud-etl/docs/index