Documentation
Self-Managed Connectors on Confluent Cloud Overview
Search the docs or ask a question
/
Confluent Developer
Marketplace
Get started
Home
Confluent Cloud
Confluent Platform
Connectors
Clients
Home
Cloud
Connect External Services to Confluent Cloud
Ask
Copy as markdown
View as plain text
Self-Managed Connectors on Confluent Cloud Overview
Overview
Table of contents
CLOUD
Overview
Get Started
Overview
Free Trial
Create and Manage Your Account
Regions and Availability
Quick Start: Confluent Cloud
Quick Start: REST API
Manage Schemas
Tutorials and Examples
Overview
Tutorial: Use Replicator to Copy Kafka Data to Cloud
Example: Create Fully Managed Services
Use Docs with AI Tools
Use Kafka Clusters
Overview
Resilience
Cluster Deletion Protection
Multi-Tenancy and Client Quotas
Overview
Quick Start
Manage Clusters
Create a Cluster
View Clusters
Update a Cluster
Delete a Cluster
Resize a Dedicated Cluster
Manage Configuration Settings
Migrate Clusters
Migrate to Confluent Cloud
Migrate with kcp
Copy and Share Data
Cluster Linking
Overview
Quick Start
Configure, Manage, and Monitor
Configure and Manage Cluster Links
Manage Mirror Topics
Manage Private Networking
Manage Security
Monitor Metrics
Use Cases and Tutorials
Share Data Across Clusters, Regions, and Clouds
Disaster Recovery and Failover
Disaster Recovery Overview
Automatic Failover (Active-Passive)
Manual Switchover (Active-Active)
Manual Switchover (Active-Passive)
Create Hybrid Cloud and Bridge-to-Cloud Deployments
Use Tiered Separation of Critical Workloads
Migrate Data
Manage Audit Logs
Troubleshooting
Replicator
Quick Start
Use Replicator to Migrate Topics
Connect Confluent Platform and Cloud Environments
Overview
Connect Self-Managed Gateway to Cloud
Confluent Cloud Gateway Overview
Configure and Deploy
Overview
Docker Deployment
Deploy using Docker
Secure Docker Deployments
Troubleshoot Docker Deployments
CFK Deployment
Deploy using CFK
Secure CFK Deployments
Enforce Centralized Governance
Overview
Configure Centralized Governance
Migrate Kafka Clusters
Migrate Topics with Topic-Based Routing
Set up Network Isolation and Custom Domains
Monitor Gateway Metrics
Connect Self-Managed Control Center to Cloud
Connect Self-Managed Clients to Cloud
Connect Self-Managed Connect to Cloud
Connect Self-Managed REST Proxy to Cloud
Connect Self-Managed ksqlDB to Cloud
Connect Self-Managed MQTT to Cloud
Connect Self-Managed Schema Registry to Cloud
Connect Self-Managed Streams to Cloud
Example: Autogenerate Self-Managed Component Configs for Cloud
Automate with Infrastructure as Code
Create Clusters with Terraform
Terraform Security Best Practices
Create Clusters with Pulumi
FAQ
Build Client Applications
Overview
Architectural Considerations
Client Quick Start
Configure Clients
Consumer
Share Consumers
Producer
Configuration Properties
Test and Monitor a Client
Test
Monitor
Overview
Monitoring with JMX
Configure JMX
Producer Metrics
Consumer Metrics
Share Consumer Metrics
Reset Offsets
Optimize and Tune
Overview
Throughput
Latency
Durability
Availability
Freight
Client Guides
Python
.NET Client
JavaScript Client
Go Client
C++ Client
Java Client
Kafka Client APIs for Confluent Cloud
Python Client API
.NET Client API
JavaScript Client API
Go Client API
C++ Client API
Java Client API
Deprecated Client APIs
Client Examples
Overview
Python Client
.NET Client
JavaScript Client
Go Client
C++ Client
Java
Spring Boot
KafkaProducer
REST
Clojure
Groovy
Kafka Connect Datagen
kafkacat
Kotlin
Ruby
Rust
Scala
Confluent Plugin for JetBrains IDEs
VS Code Extension
Connect to a Kafka Cluster with VS Code
Browse Messages with VS Code
Work with Schemas in VS Code
Clients FAQ
Build Kafka Streams Applications
Overview
Quick Start
Metrics
Monitor Applications
FAQ
Upgrade Guide
ksqlDB
Create Stream Processing Apps with ksqlDB
Quick Start
Enable ksqlDB Integration with Schema Registry
ksqlDB Cluster API Quick Start
Monitor ksqlDB
Manage ksqlDB by using the CLI
Manage Connectors With ksqlDB
Develop ksqlDB Applications
SQL Reference (Confluent Platform)
Pull Queries
Grant Role-Based Access
Migrate ksqlDB Applications on Confluent Cloud
AI and ML
Overview
Build AI with Confluent Intelligence
Overview
Streaming Agents
Overview
Agent Runtime Guide
Call Tools
Create and Run Streaming Agents
Manage Agents in the Console
Reflection Workflows
Monitor Streaming Agents
Debug Streaming Agents
Examples
Real-Time Context Engine
Overview
Get Started
Manage
Query Data
Lightning Queries
Billing
Manage Access
Private Networking
Support and Limitations
Built-in AI/ML Functions
Overview
Analyze Sentiment
Detect Anomalies
Detect PII
Forecast Trends
Invoke a Tool in an AI Workflow
ML Preprocessing Functions
Model Inference Functions
Create Embeddings
Overview
Create Embeddings
Run a Managed AI Model
Run a Remote AI Model
Search External Tables
Overview
Key Search with External Sources
Text Search with External Sources
Vector Search with External Sources
FAQ
Use AI Tools with Confluent
Overview
Access Confluent Cloud with the Managed MCP Servers
Build with the Open-Source MCP Server
Build with Agent Skills
Manage Topics
Overview
Configuration Reference
Message Browser
Share Streams
Overview
Provide Stream Shares
Consume Stream Shares
Tableflow
Overview
Concepts
Overview
Storage
Schemas
Materialize Change Data Capture Streams
Billing
Write Modes
Get Started
Overview
Quick Start with Managed Storage
Quick Start Using Your Storage and AWS Glue
Quick Start Using Your Storage on Google Cloud
Quick Start with Delta Lake Tables
How-to Guides
Overview
Configure Storage
Encrypt Sensitive Fields
Integrate Catalogs
Overview
Integrate with AWS Glue Catalog
Integrate with Lakehouse Runtime Catalog
Integrate with Snowflake Horizon Catalog
Integrate with Snowflake Open Catalog
Integrate with Unity Catalog
User-defined namespaces
Query Data
Overview
Query with AWS
Query with DuckDB
Query with Flink
Query with Snowflake
Query with Trino
Operate
Overview
Configure
Grant Role-Based Access
Monitor
Use Private Networking
Use Private Networking with Azure
Real-Time Context Engine
FAQ
Manage and Monitor Resources with USM
Overview
Register Confluent Platform with USM
Overview
Set Up Payment Method
Configure Private Networking
Overview
AWS
Azure
Configure a Service Account
Deploy the USM Agent
Complete the Cluster Registration
Register Connect Cluster with USM
Overview
Confluent Platform Kafka as the Metadata Cluster
Confluent Cloud Kafka as the Metadata Cluster
Deregister a Connect Cluster
Monitor Confluent Platform Resources
Overview
Clusters
Topics
Connectors on Confluent Platform Kafka
Connectors on Confluent Cloud Kafka
Consumer Lag
Clients
Kafka Streams
Alerts
Data Governance for Confluent Platform
Remove the USM Agent
Troubleshoot
Govern Data Streams
Overview
Stream Governance
Manage Governance Packages
Data Portal
Track Data with Stream Lineage
Manage Stream Catalog
Stream Catalog User Guide
REST API Catalog Usage and Examples Guide
GraphQL API Catalog Usage and Examples Guide
Manage Schemas
Overview
Manage Schemas
Delete Schemas and Manage Storage
Use Broker-Side Schema ID Validation
Schema Linking
Schema Registry Tutorial
Fundamentals
Key Concepts
Schema Evolution and Compatibility
Schema Formats
Serializers and Deserializers Overview
Avro
Protobuf
JSON Schema
Data Contracts
Security Considerations
Enable Private Networking
Enable Private Networking with Schema Registry PrivateLink
Enable Private Networking for Schema Registry with a Public Endpoint
Reference
Overview
Configure Clients
Schema Registry C++ Client (libschemaregistry)
Maven Plugin
REST API Usage Examples
Use AsyncAPI to Describe Topics and Schemas
FAQ
Connect to External Services
Overview
Install Connectors
ActiveMQ Source
AlloyDB Sink
Amazon CloudWatch Logs Source
Amazon CloudWatch Metrics Sink
Amazon DocumentDB Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Amazon DynamoDB CDC Source
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Amazon DynamoDB Sink
Amazon Kinesis Source
Amazon Redshift Sink
Amazon S3 Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Amazon S3 Source
Amazon SQS Source
AWS Lambda Sink
Azure Blob Storage Sink
Configure and Launch
Configure with Azure Egress Private Link Endpoints
Azure Blob Storage Source
Azure Cognitive Search Sink
Azure Cosmos DB Sink [Deprecated]
Azure Cosmos DB Sink V2
Azure Cosmos DB Source [Deprecated]
Azure Cosmos DB Source V2
Azure Data Explorer (Kusto) Database Sink
Azure Data Lake Storage Gen2 Sink
Azure Event Hubs Source
Azure Functions Sink
Azure Log Analytics Sink
Azure Log Analytics Sink V2
Azure Service Bus Source
Azure Synapse Analytics Sink
ChromaDB Sink
ClickHouse Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Couchbase Source
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with GCP Egress Private Service Connect Endpoints
Couchbase Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with GCP Egress Private Service Connect Endpoints
Databricks Delta Lake Sink
Set up Databricks Delta Lake (AWS) Sink Connector for Confluent Cloud
Configure and launch the connector
Datadog Metrics Sink
Datagen Source (development and testing)
DataStax Sink
Elasticsearch Service Sink [Deprecated]
Elasticsearch Service Sink V2
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Configure with Azure Egress Private Link Endpoints
GitHub Source
Google BigQuery Source (JDBC)
Google BigQuery Sink [End of Life]
Google BigQuery Sink V2
Google Cloud BigTable Sink
Google Cloud Dataproc Sink [End of Life]
Google Cloud Firestore Sink
Google Cloud Functions Gen 2 Sink
Google Cloud Functions Sink [End of Life]
Google Cloud Pub/Sub Source
Google Cloud Spanner CDC Source (Debezium)
Google Cloud Spanner Sink
Google Cloud Storage Sink
Google Cloud Storage Source
HTTP Sink
HTTP Sink V2
HTTP Source
HTTP Source V2
IBM Db2 Source (JDBC)
IBM MQ Sink
IBM MQ Source
InfluxDB 2 Sink
InfluxDB 2 Source
InfluxDB 3 Sink
Jira Source
MariaDB CDC Source (Debezium)
Marketo Sink
Microsoft Dynamics 365 CRM Source
Microsoft SQL Server CDC Source (Debezium) [End of Life]
Microsoft SQL Server CDC Source V2 (Debezium)
Configure and launch the connector
Backward incompatibility considerations
Microsoft SQL Server Sink (JDBC)
Microsoft SQL Server Source (JDBC)
MongoDB Atlas Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Egress Private Service Connect Endpoints
MongoDB Atlas Source
MongoDB CDC Source (Debezium)
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Egress Private Service Connect Endpoints
Monitoring
MQTT Sink
MQTT Source
MySQL CDC Source (Debezium) [End of Life]
MySQL CDC Source V2 (Debezium)
Configure and Launch the connector
Backward Incompatible Changes
MySQL Sink (JDBC)
MySQL Source (JDBC)
Neo4j Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Google Cloud Private Service Connect Endpoints
New Relic Metrics Sink
OpenSearch Sink
Oracle XStream CDC Source
Overview
Configure and Launch the connector
Oracle Database Prerequisites
Downstream Capture
Cascading Downstream Capture
Change Events
Signals and Actions
Examples
Troubleshooting
Monitoring
Oracle CDC Source
Overview
Configure and Launch the connector
Horizontal Scaling
Oracle Database Prerequisites
SMT Examples
DDL Changes
Troubleshooting
Oracle Database Sink (JDBC)
Oracle Database Source (JDBC)
PagerDuty Sink [End of Life]
Pinecone Sink
PostgreSQL CDC Source (Debezium) [End of Life]
PostgreSQL CDC Source V2 (Debezium)
Configure and Launch the connector
Backward Incompatible Changes
PostgreSQL Sink (JDBC)
PostgreSQL Source (JDBC)
RabbitMQ Sink
RabbitMQ Source
Redis Sink [Deprecated]
Redis Kafka Sink
Redis Kafka Source
Salesforce Bulk API 2.0 Sink
Salesforce Bulk API 2.0 Source
Salesforce Bulk API Source
Salesforce CDC Source
Salesforce Platform Event Sink
Salesforce Platform Event Source
Salesforce PushTopic Source
Salesforce SObject Sink
Salesforce Source V2
ServiceNow Sink
ServiceNow Source (Legacy) [Deprecated]
ServiceNow Source V2
SFTP Sink
SFTP Source
Snowflake Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Snowflake Source
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Solace Sink
Solace Source
Splunk Sink
Zendesk Source
Self-Managed Connectors on Confluent Cloud
Overview
Confluent Marketplace
Overview
Component Archive Specification
Contribute
Install Custom Plugins and Custom Connectors
Overview
Quick Start
Manage Custom Connectors
Limitations and Support
API and CLI
Manage Client-Side Encryption
Manage Provider Integration
Secret Manager Integration
Overview
Azure Key Vault Integration
AWS Secrets Manager Integration
Google Cloud Secret Manager Integration
Networking and DNS
Overview
AWS Egress PrivateLink Endpoints for First-Party Services
AWS Egress PrivateLink Endpoints for Self-Managed Services
AWS Egress PrivateLink Endpoints for Amazon RDS
AWS Egress PrivateLink Endpoints for Amazon DocumentDB
Azure Egress Private Link Endpoints for First-Party Services
Azure Egress Private Link Endpoints for Self-Managed Services
Google Cloud Private Service Connect Endpoints for First-Party Services
Google Cloud Private Service Connect Endpoints for Self-Managed Services
Connect API Usage
Manage Public Egress IP Addresses
Sample Connector Output
Configure Single Message Transformations
Configure Custom SMTs
Quick Start
Manage Custom SMT APIs
Enable External Network Calls
Limitations and Support
View Connector Events
Interpret Connector Statuses
Manage Service Accounts
Configure RBAC
View Errors in the Dead Letter Queue
Connector Limits
Manage Offsets
Migrate Self-Managed Connectors
Transforms List
Overview
AdjustPrecisionAndScale
BytesToString
Cast
ChangeTopicCase
Drop
DropHeaders
EventRouter
ExtractChangedRecordState
ExtractField
ExtractNestedField
ExtractTimeStamp
ExtractTopic
Filter (Kafka)
Filter (Confluent)
Flatten (Kafka)
Flatten (Confluent)
HeaderFrom
HeaderToValue
HoistField
InsertField
InsertHeader
KeyToValue
MaskField
MessageTimestampRouter
ReplaceField (Kafka)
ReplaceField (Confluent)
SetMaximumPrecision
SetSchemaMetadata
TimestampConverter
TimestampNow
TimestampNowField
TimestampRouter
TimescaleDB
TimezoneConverter
ToLogicalTopicRouter
TombstoneHandler
TopicRegexRouter
ValueToKey
Reference
Additional Connector Configuration
Confluent AI-Assisted Troubleshooting
Integrate with Confluent Cloud
Overview
Connect with Confluent Program
Reuse Connections with External Services
Overview
Supported External Services
Manage Connections
Integrate with Cloud Service Providers
Overview
Create an AWS Provider Integration
Create an Azure Provider Integration
Create a Google Cloud Provider Integration
Manage a Provider Integration
Process Data with Flink
Overview
Get Started
Overview
Quick Start with Cloud Console
Quick Start with SQL Shell in Confluent CLI
Quick Start with Java Table API
Quick Start with Python Table API
Concepts
Overview
Autopilot
Batch and Stream Processing
Billing
Comparison with Apache Flink
Compute Pools
Delivery Guarantees and Latency
Determinism
External Tables
Materialized Tables
Private Networking
Process Table Functions
Schema and Statement Evolution
Security Controls
Snapshot Queries
Statements
Statement CFU Metrics
Tables and Topics
Time and Watermarks
User-defined Functions
How-To Guides
Overview
Aggregate a Stream in a Tumbling Window
Combine Streams and Track Most Recent Records
Compare Current and Previous Values in a Stream
Configure a Dead Letter Queue
Convert the Serialization Format of a Topic
Create a Process Table Function
Create a UDF
Deduplicate Rows in a Table
Deploy a Statement with CI/CD
Evolve a Streaming Pipeline
Generate Custom Sample Data
Handle Late-Arriving Data
Handle Multiple Event Types
Log Debug Messages in UDFs
Mask Fields in a Table
Move a Statement to a Different Compute Pool
Read and Write Custom Changelog Formats
Read Records without a Schema ID Prefix
Profile a Query
Resolve Statement Issues
Scan and Summarize Tables
Run a Snapshot Query
Set a Baseline CFU for a Statement
Transform a Topic
Use Client-Side Field Level Encryption
View Schema Metadata in the Catalog Browser
View Time Series Data
Operate and Deploy
Overview
Carry-over Offsets
Deploy with dbt
dbt Adapter Reference
Deploy Table API Programs
Development Lifecycle
Enable Private Networking
Generate a Flink API Key
Grant Role-Based Access
Manage Compute Pools
Manage Connections
Manage with Terraform
Monitor and Manage Statements
Move SQL Statements to Production
Use the Query Profiler
REST API
Flink Reference
Overview
SQL Syntax
DDL Statements
Statements Overview
ALTER AGENT
ALTER CONNECTION
ALTER MODEL
ALTER MATERIALIZED TABLE
ALTER TABLE
ALTER TOOL
ALTER VIEW
CREATE AGENT
CREATE CONNECTION
CREATE FUNCTION
CREATE MATERIALIZED TABLE
CREATE MODEL
CREATE OR ALTER MATERIALIZED TABLE
CREATE TABLE
CREATE TOOL
CREATE VIEW
DESCRIBE
DROP AGENT
DROP CONNECTION
DROP FUNCTION
DROP MATERIALIZED TABLE
DROP MODEL
DROP TABLE
DROP TOOL
DROP VIEW
EXPLAIN
RESET
SET
SHOW
USE CATALOG
USE database_name
Queries
Queries Overview
Deduplication
Group Aggregation
HINTS
INSERT INTO FROM SELECT
INSERT VALUES
Joins
LIMIT
Pattern Recognition
ORDER BY
OVER Aggregation
SELECT
Set Logic
EXECUTE STATEMENT SET
Top-N
Window Aggregation
Window Deduplication
Window Join
Window Top-N
Window Table-Valued Function
WITH
Functions
AI Model Inference
Aggregate
Changelog Conversion
Collections
Comparison
Conditional
Datetime
Flink SQL Functions
Hashing
JSON
ML Preprocessing
Numeric
Search
String
Table API
Data Types
Data Type Mappings
Time Zone
Keywords
Information Schema
Example Streams
SQL Examples
Table API
CLI Reference
Get Help
FAQ
Manage Networking
Confluent Cloud Networking Overview
Networking on AWS
AWS Networking Overview
Public Networking on AWS
Confluent Cloud Network on AWS
PrivateLink on AWS
PrivateLink Overview
Inbound PrivateLink for Dedicated Clusters
Inbound PrivateLink for Serverless Products
Outbound PrivateLink for Dedicated Clusters
Outbound PrivateLink for Serverless Products
VPC Peering on AWS
Transit Gateway on AWS
Private Network Interface on AWS
DNS Forwarding on AWS
Networking on Azure
Azure Networking Overview
Public Networking on Azure
Confluent Cloud Network on Azure
Private Link on Azure
Private Link Overview
Inbound Private Link for Dedicated Clusters
Inbound Private Link for Serverless Products
Outbound Private Link for Dedicated Clusters
Outbound Private Link for Serverless Products
VNet Peering on Azure
Networking on Google Cloud
Google Cloud Networking Overview
Public Networking on Google Cloud
Confluent Cloud Network on Google Cloud
Private Service Connect on Google Cloud
Private Service Connect Overview
Inbound Private Service Connect for Dedicated Clusters
Inbound Private Service Connect for Serverless Products
Outbound Private Service Connect for Dedicated Clusters
VPC Peering on Google Cloud
Connectivity for Confluent Resources
Overview
Public Egress IP Address for Connectors and Cluster Linking
Cluster Linking using AWS PrivateLink
Follower Fetching using AWS VPC Peering
Use the Confluent Cloud Console with Private Networking
Test Connectivity
Networking FAQ
Log and Monitor
Overview
Metrics
Integrate Third-Party Monitoring Tools
Manage Notifications
Monitor Consumer Lag
Monitor Dedicated Clusters
Manage Performance and Expansion
Track Usage by Team
Export Logs to Third-Party Tools
Tutorials and Examples
Run Example Queries
Observability for Kafka Clients
FAQ
Manage Security
Overview
Manage Authentication
Overview
Manage User Identities
Overview
Manage User Accounts
Overview
Authentication Security Protections
Manage Local User Accounts
Multi-factor Authentication
Manage SSO User Accounts
Manage User Identity Providers
Overview
Use Single Sign-On (SSO)
Manage SAML Single Sign-On (SSO)
Manage Azure Marketplace SSO
Just-in-time User Provisioning
SCIM User Provisioning
Group Mapping
Overview
Enable Group Mapping
Manage Group Mappings
Troubleshooting
Best Practices
Manage Trusted Domains
Manage SSO provider
Troubleshoot SSO
Manage Workload Identities
Overview
Manage Workload Identities
Manage Service Accounts and API Keys
Overview
Create Service Accounts
Manage Service Accounts
Manage API Keys
Overview
Manage API keys
Best Practices
Troubleshoot
Manage OAuth/OIDC Identity Providers
Overview
Add an OIDC Identity Provider
Use OAuth Identity Pools and Filters
Manage Identity Provider Configurations
Manage the JWKS URI
Configure OAuth Clients
Overview
Go Clients
Java Clients
JavaScript Clients
.NET Clients
Python Clients
Configuration Reference
Configure UAMI
Configure AWS IAM Java Client Plugin
Configure AWS IAM Python Client Plugin
Configure AWS IAM .NET Client Plugin
Access Kafka REST APIs
Use Confluent STS Tokens with REST APIs
Best Practices
Troubleshoot OAuth Issues
Manage mTLS Identity Providers
Overview
Configure mTLS
Manage Certificate Authorities
Manage Certificate Identity Pools
Create CEL Filters for mTLS
Create JSON payloads for mTLS
Manage Certificate Revocation
Troubleshoot mTLS Issues
Identity FAQ
Control Access
Overview
Resource Hierarchy
Overview
Organizations
Overview
Manage Multiple Organizations
Environments
Confluent Resource Names (CRNs)
Manage Role-Based Access Control
Overview
Predefined RBAC Roles
Manage Role Bindings
Use ACLs with RBAC
Manage IP Filtering
Overview
Manage IP Groups
Manage IP Filters
Best Practices
Manage Access Control Lists
Overview
Operations
Examples
Troubleshoot
Reference
Use the Confluent CLI with multiple credentials on Confluent Cloud
Encrypt and Protect Data
Overview
Manage Data in Transit With TLS
Use Self-Managed Encryption Keys
Overview
Use Self-Managed Encryption Keys on AWS
Use Self-Managed Encryption Keys on Azure
Use Self-Managed Encryption Keys on Google Cloud
Use Self-Managed Encryption Keys with Tableflow
Use Confluent CLI for Self-Managed Encryption Keys
Use BYOK API for Self-Managed Encryption Keys
Revoke Access to Data at Rest
Best Practices
Troubleshoot Key Policy Issues
Use Client-Side Field Level Encryption
Overview
Manage CSFLE using Confluent Cloud Console
Use Client-side Field Level Encryption
Configuration Settings
Manage Encryption Keys
Manage Multiple Encryption Rules
Quick Start
Implement a Custom KMS Driver
Process Encrypted Data with Apache Flink
Code examples
Troubleshoot
FAQ
Use Client-Side Payload Encryption
Advanced Security Add-on
Monitor Activity
Concepts
Audit Log Event Categories
Audit Log Event Records
Audit Log Event Schema
Auditable Event Methods
Access Transparency
Connector
Custom Connector Plugin
Endpoints
Flink Management and Operations
Flink Authentication and Authorization
IP Filter Authorization
IP Filter and IP Group Management
Kafka Cluster Management and Operations
Kafka Cluster Authentication and Authorization
ksqlDB Cluster Authentication and Authorization
Networking
Notifications Service
OAuth-OIDC Identity Provider and Identity Pool
Organization
Role-Based Access Control
Real-Time Context Engine
Schema Registry Management and Operations
Schema Registry Authentication and Authorization
SCIM
Tableflow Control Plane
Tableflow Data Plane
Unified Stream Manager Control Plane
Access and Consume Audit Logs
Access Transparency
Retain Audit Logs
Best Practices
Troubleshoot
Access Management Tutorial
Security FAQ
Manage Billing
Overview
Billing Dimensions
Invoices and Costs
Cost Allocation
Amazon Web Services
Pay As You Go
Commitments
Google Cloud
Pay as you Go
Commitments
Professional Services
Microsoft Azure
Pay As You Go
Commitments
Jio Commitments
Professional Services
Marketplace Organization Suspension and Deactivation
Troubleshoot Billing
FAQ
Legacy Billing Reference
Manage Service Quotas
Overview
Service Quotas
View Service Quotas Using Confluent CLI
Service Quotas API
APIs
Overview
Confluent Cloud API Usage and Reference
Overview
Confluent Cloud API Reference
Metrics API Reference
Admin and Produce REST API Usage
Connect API Usage
Provider Integration API Usage
Stream Catalog REST API Usage
Service Quotas API Usage
Kafka Client API Reference
Overview
.NET Client API Reference
C++ Client API Reference
Go Client API Reference
Java Client API Reference
JavaScript Client API Reference
Python Client API Reference
Flink Client API Usage and Reference
GraphQL API Usage and Reference
Confluent CLI
Query Data with Lightning Tables
Overview
Get Started
Manage Lightning Tables
Query a Lightning Table
Overview
SQL Reference
Private Networking
Release Notes & FAQ
Release Notes
FAQ
Upgrade Policy
Compliance
Generate a HAR file for Troubleshooting
AI Assistant
Support
Glossary
Self-Managed Connectors on Confluent Cloud Overview
Get started
Search the docs or ask a question
Home
Confluent Cloud
Confluent Platform
Connectors
Clients
CLOUD
Overview
Get Started
Overview
Free Trial
Create and Manage Your Account
Regions and Availability
Quick Start: Confluent Cloud
Quick Start: REST API
Manage Schemas
Tutorials and Examples
Overview
Tutorial: Use Replicator to Copy Kafka Data to Cloud
Example: Create Fully Managed Services
Use Docs with AI Tools
Use Kafka Clusters
Overview
Resilience
Cluster Deletion Protection
Multi-Tenancy and Client Quotas
Overview
Quick Start
Manage Clusters
Create a Cluster
View Clusters
Update a Cluster
Delete a Cluster
Resize a Dedicated Cluster
Manage Configuration Settings
Migrate Clusters
Migrate to Confluent Cloud
Migrate with kcp
Copy and Share Data
Cluster Linking
Overview
Quick Start
Configure, Manage, and Monitor
Configure and Manage Cluster Links
Manage Mirror Topics
Manage Private Networking
Manage Security
Monitor Metrics
Use Cases and Tutorials
Share Data Across Clusters, Regions, and Clouds
Disaster Recovery and Failover
Disaster Recovery Overview
Automatic Failover (Active-Passive)
Manual Switchover (Active-Active)
Manual Switchover (Active-Passive)
Create Hybrid Cloud and Bridge-to-Cloud Deployments
Use Tiered Separation of Critical Workloads
Migrate Data
Manage Audit Logs
Troubleshooting
Replicator
Quick Start
Use Replicator to Migrate Topics
Connect Confluent Platform and Cloud Environments
Overview
Connect Self-Managed Gateway to Cloud
Confluent Cloud Gateway Overview
Configure and Deploy
Overview
Docker Deployment
Deploy using Docker
Secure Docker Deployments
Troubleshoot Docker Deployments
CFK Deployment
Deploy using CFK
Secure CFK Deployments
Enforce Centralized Governance
Overview
Configure Centralized Governance
Migrate Kafka Clusters
Migrate Topics with Topic-Based Routing
Set up Network Isolation and Custom Domains
Monitor Gateway Metrics
Connect Self-Managed Control Center to Cloud
Connect Self-Managed Clients to Cloud
Connect Self-Managed Connect to Cloud
Connect Self-Managed REST Proxy to Cloud
Connect Self-Managed ksqlDB to Cloud
Connect Self-Managed MQTT to Cloud
Connect Self-Managed Schema Registry to Cloud
Connect Self-Managed Streams to Cloud
Example: Autogenerate Self-Managed Component Configs for Cloud
Automate with Infrastructure as Code
Create Clusters with Terraform
Terraform Security Best Practices
Create Clusters with Pulumi
FAQ
Build Client Applications
Overview
Architectural Considerations
Client Quick Start
Configure Clients
Consumer
Share Consumers
Producer
Configuration Properties
Test and Monitor a Client
Test
Monitor
Overview
Monitoring with JMX
Configure JMX
Producer Metrics
Consumer Metrics
Share Consumer Metrics
Reset Offsets
Optimize and Tune
Overview
Throughput
Latency
Durability
Availability
Freight
Client Guides
Python
.NET Client
JavaScript Client
Go Client
C++ Client
Java Client
Kafka Client APIs for Confluent Cloud
Python Client API
.NET Client API
JavaScript Client API
Go Client API
C++ Client API
Java Client API
Deprecated Client APIs
Client Examples
Overview
Python Client
.NET Client
JavaScript Client
Go Client
C++ Client
Java
Spring Boot
KafkaProducer
REST
Clojure
Groovy
Kafka Connect Datagen
kafkacat
Kotlin
Ruby
Rust
Scala
Confluent Plugin for JetBrains IDEs
VS Code Extension
Connect to a Kafka Cluster with VS Code
Browse Messages with VS Code
Work with Schemas in VS Code
Clients FAQ
Build Kafka Streams Applications
Overview
Quick Start
Metrics
Monitor Applications
FAQ
Upgrade Guide
ksqlDB
Create Stream Processing Apps with ksqlDB
Quick Start
Enable ksqlDB Integration with Schema Registry
ksqlDB Cluster API Quick Start
Monitor ksqlDB
Manage ksqlDB by using the CLI
Manage Connectors With ksqlDB
Develop ksqlDB Applications
SQL Reference (Confluent Platform)
Pull Queries
Grant Role-Based Access
Migrate ksqlDB Applications on Confluent Cloud
AI and ML
Overview
Build AI with Confluent Intelligence
Overview
Streaming Agents
Overview
Agent Runtime Guide
Call Tools
Create and Run Streaming Agents
Manage Agents in the Console
Reflection Workflows
Monitor Streaming Agents
Debug Streaming Agents
Examples
Real-Time Context Engine
Overview
Get Started
Manage
Query Data
Lightning Queries
Billing
Manage Access
Private Networking
Support and Limitations
Built-in AI/ML Functions
Overview
Analyze Sentiment
Detect Anomalies
Detect PII
Forecast Trends
Invoke a Tool in an AI Workflow
ML Preprocessing Functions
Model Inference Functions
Create Embeddings
Overview
Create Embeddings
Run a Managed AI Model
Run a Remote AI Model
Search External Tables
Overview
Key Search with External Sources
Text Search with External Sources
Vector Search with External Sources
FAQ
Use AI Tools with Confluent
Overview
Access Confluent Cloud with the Managed MCP Servers
Build with the Open-Source MCP Server
Build with Agent Skills
Manage Topics
Overview
Configuration Reference
Message Browser
Share Streams
Overview
Provide Stream Shares
Consume Stream Shares
Tableflow
Overview
Concepts
Overview
Storage
Schemas
Materialize Change Data Capture Streams
Billing
Write Modes
Get Started
Overview
Quick Start with Managed Storage
Quick Start Using Your Storage and AWS Glue
Quick Start Using Your Storage on Google Cloud
Quick Start with Delta Lake Tables
How-to Guides
Overview
Configure Storage
Encrypt Sensitive Fields
Integrate Catalogs
Overview
Integrate with AWS Glue Catalog
Integrate with Lakehouse Runtime Catalog
Integrate with Snowflake Horizon Catalog
Integrate with Snowflake Open Catalog
Integrate with Unity Catalog
User-defined namespaces
Query Data
Overview
Query with AWS
Query with DuckDB
Query with Flink
Query with Snowflake
Query with Trino
Operate
Overview
Configure
Grant Role-Based Access
Monitor
Use Private Networking
Use Private Networking with Azure
Real-Time Context Engine
FAQ
Manage and Monitor Resources with USM
Overview
Register Confluent Platform with USM
Overview
Set Up Payment Method
Configure Private Networking
Overview
AWS
Azure
Configure a Service Account
Deploy the USM Agent
Complete the Cluster Registration
Register Connect Cluster with USM
Overview
Confluent Platform Kafka as the Metadata Cluster
Confluent Cloud Kafka as the Metadata Cluster
Deregister a Connect Cluster
Monitor Confluent Platform Resources
Overview
Clusters
Topics
Connectors on Confluent Platform Kafka
Connectors on Confluent Cloud Kafka
Consumer Lag
Clients
Kafka Streams
Alerts
Data Governance for Confluent Platform
Remove the USM Agent
Troubleshoot
Govern Data Streams
Overview
Stream Governance
Manage Governance Packages
Data Portal
Track Data with Stream Lineage
Manage Stream Catalog
Stream Catalog User Guide
REST API Catalog Usage and Examples Guide
GraphQL API Catalog Usage and Examples Guide
Manage Schemas
Overview
Manage Schemas
Delete Schemas and Manage Storage
Use Broker-Side Schema ID Validation
Schema Linking
Schema Registry Tutorial
Fundamentals
Key Concepts
Schema Evolution and Compatibility
Schema Formats
Serializers and Deserializers Overview
Avro
Protobuf
JSON Schema
Data Contracts
Security Considerations
Enable Private Networking
Enable Private Networking with Schema Registry PrivateLink
Enable Private Networking for Schema Registry with a Public Endpoint
Reference
Overview
Configure Clients
Schema Registry C++ Client (libschemaregistry)
Maven Plugin
REST API Usage Examples
Use AsyncAPI to Describe Topics and Schemas
FAQ
Connect to External Services
Overview
Install Connectors
ActiveMQ Source
AlloyDB Sink
Amazon CloudWatch Logs Source
Amazon CloudWatch Metrics Sink
Amazon DocumentDB Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Amazon DynamoDB CDC Source
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Amazon DynamoDB Sink
Amazon Kinesis Source
Amazon Redshift Sink
Amazon S3 Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Amazon S3 Source
Amazon SQS Source
AWS Lambda Sink
Azure Blob Storage Sink
Configure and Launch
Configure with Azure Egress Private Link Endpoints
Azure Blob Storage Source
Azure Cognitive Search Sink
Azure Cosmos DB Sink [Deprecated]
Azure Cosmos DB Sink V2
Azure Cosmos DB Source [Deprecated]
Azure Cosmos DB Source V2
Azure Data Explorer (Kusto) Database Sink
Azure Data Lake Storage Gen2 Sink
Azure Event Hubs Source
Azure Functions Sink
Azure Log Analytics Sink
Azure Log Analytics Sink V2
Azure Service Bus Source
Azure Synapse Analytics Sink
ChromaDB Sink
ClickHouse Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Couchbase Source
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with GCP Egress Private Service Connect Endpoints
Couchbase Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with GCP Egress Private Service Connect Endpoints
Databricks Delta Lake Sink
Set up Databricks Delta Lake (AWS) Sink Connector for Confluent Cloud
Configure and launch the connector
Datadog Metrics Sink
Datagen Source (development and testing)
DataStax Sink
Elasticsearch Service Sink [Deprecated]
Elasticsearch Service Sink V2
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Configure with Azure Egress Private Link Endpoints
GitHub Source
Google BigQuery Source (JDBC)
Google BigQuery Sink [End of Life]
Google BigQuery Sink V2
Google Cloud BigTable Sink
Google Cloud Dataproc Sink [End of Life]
Google Cloud Firestore Sink
Google Cloud Functions Gen 2 Sink
Google Cloud Functions Sink [End of Life]
Google Cloud Pub/Sub Source
Google Cloud Spanner CDC Source (Debezium)
Google Cloud Spanner Sink
Google Cloud Storage Sink
Google Cloud Storage Source
HTTP Sink
HTTP Sink V2
HTTP Source
HTTP Source V2
IBM Db2 Source (JDBC)
IBM MQ Sink
IBM MQ Source
InfluxDB 2 Sink
InfluxDB 2 Source
InfluxDB 3 Sink
Jira Source
MariaDB CDC Source (Debezium)
Marketo Sink
Microsoft Dynamics 365 CRM Source
Microsoft SQL Server CDC Source (Debezium) [End of Life]
Microsoft SQL Server CDC Source V2 (Debezium)
Configure and launch the connector
Backward incompatibility considerations
Microsoft SQL Server Sink (JDBC)
Microsoft SQL Server Source (JDBC)
MongoDB Atlas Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Egress Private Service Connect Endpoints
MongoDB Atlas Source
MongoDB CDC Source (Debezium)
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Egress Private Service Connect Endpoints
Monitoring
MQTT Sink
MQTT Source
MySQL CDC Source (Debezium) [End of Life]
MySQL CDC Source V2 (Debezium)
Configure and Launch the connector
Backward Incompatible Changes
MySQL Sink (JDBC)
MySQL Source (JDBC)
Neo4j Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Google Cloud Private Service Connect Endpoints
New Relic Metrics Sink
OpenSearch Sink
Oracle XStream CDC Source
Overview
Configure and Launch the connector
Oracle Database Prerequisites
Downstream Capture
Cascading Downstream Capture
Change Events
Signals and Actions
Examples
Troubleshooting
Monitoring
Oracle CDC Source
Overview
Configure and Launch the connector
Horizontal Scaling
Oracle Database Prerequisites
SMT Examples
DDL Changes
Troubleshooting
Oracle Database Sink (JDBC)
Oracle Database Source (JDBC)
PagerDuty Sink [End of Life]
Pinecone Sink
PostgreSQL CDC Source (Debezium) [End of Life]
PostgreSQL CDC Source V2 (Debezium)
Configure and Launch the connector
Backward Incompatible Changes
PostgreSQL Sink (JDBC)
PostgreSQL Source (JDBC)
RabbitMQ Sink
RabbitMQ Source
Redis Sink [Deprecated]
Redis Kafka Sink
Redis Kafka Source
Salesforce Bulk API 2.0 Sink
Salesforce Bulk API 2.0 Source
Salesforce Bulk API Source
Salesforce CDC Source
Salesforce Platform Event Sink
Salesforce Platform Event Source
Salesforce PushTopic Source
Salesforce SObject Sink
Salesforce Source V2
ServiceNow Sink
ServiceNow Source (Legacy) [Deprecated]
ServiceNow Source V2
SFTP Sink
SFTP Source
Snowflake Sink
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Snowflake Source
Configure and Launch
Configure with AWS Egress PrivateLink Endpoints
Configure with Azure Egress Private Link Endpoints
Configure with Google Cloud Private Service Connect Endpoints
Solace Sink
Solace Source
Splunk Sink
Zendesk Source
Self-Managed Connectors on Confluent Cloud
Overview
Confluent Marketplace
Overview
Component Archive Specification
Contribute
Install Custom Plugins and Custom Connectors
Overview
Quick Start
Manage Custom Connectors
Limitations and Support
API and CLI
Manage Client-Side Encryption
Manage Provider Integration
Secret Manager Integration
Overview
Azure Key Vault Integration
AWS Secrets Manager Integration
Google Cloud Secret Manager Integration
Networking and DNS
Overview
AWS Egress PrivateLink Endpoints for First-Party Services
AWS Egress PrivateLink Endpoints for Self-Managed Services
AWS Egress PrivateLink Endpoints for Amazon RDS
AWS Egress PrivateLink Endpoints for Amazon DocumentDB
Azure Egress Private Link Endpoints for First-Party Services
Azure Egress Private Link Endpoints for Self-Managed Services
Google Cloud Private Service Connect Endpoints for First-Party Services
Google Cloud Private Service Connect Endpoints for Self-Managed Services
Connect API Usage
Manage Public Egress IP Addresses
Sample Connector Output
Configure Single Message Transformations
Configure Custom SMTs
Quick Start
Manage Custom SMT APIs
Enable External Network Calls
Limitations and Support
View Connector Events
Interpret Connector Statuses
Manage Service Accounts
Configure RBAC
View Errors in the Dead Letter Queue
Connector Limits
Manage Offsets
Migrate Self-Managed Connectors
Transforms List
Overview
AdjustPrecisionAndScale
BytesToString
Cast
ChangeTopicCase
Drop
DropHeaders
EventRouter
ExtractChangedRecordState
ExtractField
ExtractNestedField
ExtractTimeStamp
ExtractTopic
Filter (Kafka)
Filter (Confluent)
Flatten (Kafka)
Flatten (Confluent)
HeaderFrom
HeaderToValue
HoistField
InsertField
InsertHeader
KeyToValue
MaskField
MessageTimestampRouter
ReplaceField (Kafka)
ReplaceField (Confluent)
SetMaximumPrecision
SetSchemaMetadata
TimestampConverter
TimestampNow
TimestampNowField
TimestampRouter
TimescaleDB
TimezoneConverter
ToLogicalTopicRouter
TombstoneHandler
TopicRegexRouter
ValueToKey
Reference
Additional Connector Configuration
Confluent AI-Assisted Troubleshooting
Integrate with Confluent Cloud
Overview
Connect with Confluent Program
Reuse Connections with External Services
Overview
Supported External Services
Manage Connections
Integrate with Cloud Service Providers
Overview
Create an AWS Provider Integration
Create an Azure Provider Integration
Create a Google Cloud Provider Integration
Manage a Provider Integration
Process Data with Flink
Overview
Get Started
Overview
Quick Start with Cloud Console
Quick Start with SQL Shell in Confluent CLI
Quick Start with Java Table API
Quick Start with Python Table API
Concepts
Overview
Autopilot
Batch and Stream Processing
Billing
Comparison with Apache Flink
Compute Pools
Delivery Guarantees and Latency
Determinism
External Tables
Materialized Tables
Private Networking
Process Table Functions
Schema and Statement Evolution
Security Controls
Snapshot Queries
Statements
Statement CFU Metrics
Tables and Topics
Time and Watermarks
User-defined Functions
How-To Guides
Overview
Aggregate a Stream in a Tumbling Window
Combine Streams and Track Most Recent Records
Compare Current and Previous Values in a Stream
Configure a Dead Letter Queue
Convert the Serialization Format of a Topic
Create a Process Table Function
Create a UDF
Deduplicate Rows in a Table
Deploy a Statement with CI/CD
Evolve a Streaming Pipeline
Generate Custom Sample Data
Handle Late-Arriving Data
Handle Multiple Event Types
Log Debug Messages in UDFs
Mask Fields in a Table
Move a Statement to a Different Compute Pool
Read and Write Custom Changelog Formats
Read Records without a Schema ID Prefix
Profile a Query
Resolve Statement Issues
Scan and Summarize Tables
Run a Snapshot Query
Set a Baseline CFU for a Statement
Transform a Topic
Use Client-Side Field Level Encryption
View Schema Metadata in the Catalog Browser
View Time Series Data
Operate and Deploy
Overview
Carry-over Offsets
Deploy with dbt
dbt Adapter Reference
Deploy Table API Programs
Development Lifecycle
Enable Private Networking
Generate a Flink API Key
Grant Role-Based Access
Manage Compute Pools
Manage Connections
Manage with Terraform
Monitor and Manage Statements
Move SQL Statements to Production
Use the Query Profiler
REST API
Flink Reference
Overview
SQL Syntax
DDL Statements
Statements Overview
ALTER AGENT
ALTER CONNECTION
ALTER MODEL
ALTER MATERIALIZED TABLE
ALTER TABLE
ALTER TOOL
ALTER VIEW
CREATE AGENT
CREATE CONNECTION
CREATE FUNCTION
CREATE MATERIALIZED TABLE
CREATE MODEL
CREATE OR ALTER MATERIALIZED TABLE
CREATE TABLE
CREATE TOOL
CREATE VIEW
DESCRIBE
DROP AGENT
DROP CONNECTION
DROP FUNCTION
DROP MATERIALIZED TABLE
DROP MODEL
DROP TABLE
DROP TOOL
DROP VIEW
EXPLAIN
RESET
SET
SHOW
USE CATALOG
USE database_name
Queries
Queries Overview
Deduplication
Group Aggregation
HINTS
INSERT INTO FROM SELECT
INSERT VALUES
Joins
LIMIT
Pattern Recognition
ORDER BY
OVER Aggregation
SELECT
Set Logic
EXECUTE STATEMENT SET
Top-N
Window Aggregation
Window Deduplication
Window Join
Window Top-N
Window Table-Valued Function
WITH
Functions
AI Model Inference
Aggregate
Changelog Conversion
Collections
Comparison
Conditional
Datetime
Flink SQL Functions
Hashing
JSON
ML Preprocessing
Numeric
Search
String
Table API
Data Types
Data Type Mappings
Time Zone
Keywords
Information Schema
Example Streams
SQL Examples
Table API
CLI Reference
Get Help
FAQ
Manage Networking
Confluent Cloud Networking Overview
Networking on AWS
AWS Networking Overview
Public Networking on AWS
Confluent Cloud Network on AWS
PrivateLink on AWS
PrivateLink Overview
Inbound PrivateLink for Dedicated Clusters
Inbound PrivateLink for Serverless Products
Outbound PrivateLink for Dedicated Clusters
Outbound PrivateLink for Serverless Products
VPC Peering on AWS
Transit Gateway on AWS
Private Network Interface on AWS
DNS Forwarding on AWS
Networking on Azure
Azure Networking Overview
Public Networking on Azure
Confluent Cloud Network on Azure
Private Link on Azure
Private Link Overview
Inbound Private Link for Dedicated Clusters
Inbound Private Link for Serverless Products
Outbound Private Link for Dedicated Clusters
Outbound Private Link for Serverless Products
VNet Peering on Azure
Networking on Google Cloud
Google Cloud Networking Overview
Public Networking on Google Cloud
Confluent Cloud Network on Google Cloud
Private Service Connect on Google Cloud
Private Service Connect Overview
Inbound Private Service Connect for Dedicated Clusters
Inbound Private Service Connect for Serverless Products
Outbound Private Service Connect for Dedicated Clusters
VPC Peering on Google Cloud
Connectivity for Confluent Resources
Overview
Public Egress IP Address for Connectors and Cluster Linking
Cluster Linking using AWS PrivateLink
Follower Fetching using AWS VPC Peering
Use the Confluent Cloud Console with Private Networking
Test Connectivity
Networking FAQ
Log and Monitor
Overview
Metrics
Integrate Third-Party Monitoring Tools
Manage Notifications
Monitor Consumer Lag
Monitor Dedicated Clusters
Manage Performance and Expansion
Track Usage by Team
Export Logs to Third-Party Tools
Tutorials and Examples
Run Example Queries
Observability for Kafka Clients
FAQ
Manage Security
Overview
Manage Authentication
Overview
Manage User Identities
Overview
Manage User Accounts
Overview
Authentication Security Protections
Manage Local User Accounts
Multi-factor Authentication
Manage SSO User Accounts
Manage User Identity Providers
Overview
Use Single Sign-On (SSO)
Manage SAML Single Sign-On (SSO)
Manage Azure Marketplace SSO
Just-in-time User Provisioning
SCIM User Provisioning
Group Mapping
Overview
Enable Group Mapping
Manage Group Mappings
Troubleshooting
Best Practices
Manage Trusted Domains
Manage SSO provider
Troubleshoot SSO
Manage Workload Identities
Overview
Manage Workload Identities
Manage Service Accounts and API Keys
Overview
Create Service Accounts
Manage Service Accounts
Manage API Keys
Overview
Manage API keys
Best Practices
Troubleshoot
Manage OAuth/OIDC Identity Providers
Overview
Add an OIDC Identity Provider
Use OAuth Identity Pools and Filters
Manage Identity Provider Configurations
Manage the JWKS URI
Configure OAuth Clients
Overview
Go Clients
Java Clients
JavaScript Clients
.NET Clients
Python Clients
Configuration Reference
Configure UAMI
Configure AWS IAM Java Client Plugin
Configure AWS IAM Python Client Plugin
Configure AWS IAM .NET Client Plugin
Access Kafka REST APIs
Use Confluent STS Tokens with REST APIs
Best Practices
Troubleshoot OAuth Issues
Manage mTLS Identity Providers
Overview
Configure mTLS
Manage Certificate Authorities
Manage Certificate Identity Pools
Create CEL Filters for mTLS
Create JSON payloads for mTLS
Manage Certificate Revocation
Troubleshoot mTLS Issues
Identity FAQ
Control Access
Overview
Resource Hierarchy
Overview
Organizations
Overview
Manage Multiple Organizations
Environments
Confluent Resource Names (CRNs)
Manage Role-Based Access Control
Overview
Predefined RBAC Roles
Manage Role Bindings
Use ACLs with RBAC
Manage IP Filtering
Overview
Manage IP Groups
Manage IP Filters
Best Practices
Manage Access Control Lists
Overview
Operations
Examples
Troubleshoot
Reference
Use the Confluent CLI with multiple credentials on Confluent Cloud
Encrypt and Protect Data
Overview
Manage Data in Transit With TLS
Use Self-Managed Encryption Keys
Overview
Use Self-Managed Encryption Keys on AWS
Use Self-Managed Encryption Keys on Azure
Use Self-Managed Encryption Keys on Google Cloud
Use Self-Managed Encryption Keys with Tableflow
Use Confluent CLI for Self-Managed Encryption Keys
Use BYOK API for Self-Managed Encryption Keys
Revoke Access to Data at Rest
Best Practices
Troubleshoot Key Policy Issues
Use Client-Side Field Level Encryption
Overview
Manage CSFLE using Confluent Cloud Console
Use Client-side Field Level Encryption
Configuration Settings
Manage Encryption Keys
Manage Multiple Encryption Rules
Quick Start
Implement a Custom KMS Driver
Process Encrypted Data with Apache Flink
Code examples
Troubleshoot
FAQ
Use Client-Side Payload Encryption
Advanced Security Add-on
Monitor Activity
Concepts
Audit Log Event Categories
Audit Log Event Records
Audit Log Event Schema
Auditable Event Methods
Access Transparency
Connector
Custom Connector Plugin
Endpoints
Flink Management and Operations
Flink Authentication and Authorization
IP Filter Authorization
IP Filter and IP Group Management
Kafka Cluster Management and Operations
Kafka Cluster Authentication and Authorization
ksqlDB Cluster Authentication and Authorization
Networking
Notifications Service
OAuth-OIDC Identity Provider and Identity Pool
Organization
Role-Based Access Control
Real-Time Context Engine
Schema Registry Management and Operations
Schema Registry Authentication and Authorization
SCIM
Tableflow Control Plane
Tableflow Data Plane
Unified Stream Manager Control Plane
Access and Consume Audit Logs
Access Transparency
Retain Audit Logs
Best Practices
Troubleshoot
Access Management Tutorial
Security FAQ
Manage Billing
Overview
Billing Dimensions
Invoices and Costs
Cost Allocation
Amazon Web Services
Pay As You Go
Commitments
Google Cloud
Pay as you Go
Commitments
Professional Services
Microsoft Azure
Pay As You Go
Commitments
Jio Commitments
Professional Services
Marketplace Organization Suspension and Deactivation
Troubleshoot Billing
FAQ
Legacy Billing Reference
Manage Service Quotas
Overview
Service Quotas
View Service Quotas Using Confluent CLI
Service Quotas API
APIs
Overview
Confluent Cloud API Usage and Reference
Overview
Confluent Cloud API Reference
Metrics API Reference
Admin and Produce REST API Usage
Connect API Usage
Provider Integration API Usage
Stream Catalog REST API Usage
Service Quotas API Usage
Kafka Client API Reference
Overview
.NET Client API Reference
C++ Client API Reference
Go Client API Reference
Java Client API Reference
JavaScript Client API Reference
Python Client API Reference
Flink Client API Usage and Reference
GraphQL API Usage and Reference
Confluent CLI
Query Data with Lightning Tables
Overview
Get Started
Manage Lightning Tables
Query a Lightning Table
Overview
SQL Reference
Private Networking
Release Notes & FAQ
Release Notes
FAQ
Upgrade Policy
Compliance
Generate a HAR file for Troubleshooting
AI Assistant
Support
Glossary
