Release Notes for Confluent Cloud

Confluent Cloud is regularly updated with improvements and new features. This page highlights significant new and updated features in Confluent Cloud by release date.

2024 Releases

April 17, 2024

Enterprise Kafka clusters now support one E-CKU as a minimum instead of two. For more information, see E-CKU limits per Enterprise cluster.

April 11, 2024

Client-side field level encryption (CSFLE) is now available in Limited Availability as a fully supported feature recommended for production use. CSFLE provides an additional layer of security on Confluent Cloud for protection of sensitive data, safeguarding data in motion throughout its lifecycle across producers and consumers. For more information, see Protect Sensitive Data Using Client-Side Field Level Encryption.

To be considered for access before General Availability, contact Confluent Support.

Enterprise clusters are available in the following Microsoft Azure regions:

  • australiaeast
  • brazilsouth
  • canadacentral
  • centralus
  • eastasia
  • eastus
  • eastus2
  • germanywestcentral
  • northeurope
  • southeastasia
  • uksouth
  • westeurope

For details about Enterprise clusters, see Enterprise clusters.

April 10, 2024

Default user permissions now apply to all SSO user accounts in new SSO-enabled organizations. A new default group mapping binds all SSO user accounts to the DataDiscovery and FlinkDeveloper roles, providing permissions to access Confluent Cloud resources, including Flink and Data portal. Existing SSO-enabled organizations can opt-in. For more information, see Default user permissions.

The fully-managed OpenSearch Sink connector is now generally available for your Apache Kafka® clusters on AWS, Azure, and Google Cloud. The connector provides a simple and secure way to stream data from Confluent Cloud to OpenSearch and supports both AWS and OSS OpenSearch. For more details, see OpenSearch Sink Connector for Confluent Cloud.

April 5, 2024

Service quota default for User accounts (active and invited) per organization is now 1,000 (increased from 500).

OAuth 2.0 authentication using Confluent Security Token Service (STS) access tokens (confluent-sts-access-token) for authorization to access Confluent Cloud resources is now available for all control plane Confluent Cloud APIs. Support is added for notifications/v1, sd/v1, service-quota, srcm/v2, billing/v1, cdx/v1, partner/v2, byok/v1, metrics, flink, and kafka-quota/v1. For more information, see the API Reference for Confluent Cloud.

April 3, 2024

Service quotas for RBAC role bindings have been updated:

  • Organization scope includes a new quota, RBAC role bindings (total), and the updated quota, RBAC role bindings (with Kafka permissions), no longer limiting role bindings without Kafka permissions.
  • Schema Registry Cluster scope has been removed, and the RBAC role bindings are incorporated in the new quota for RBAC role bindings (total) at the Organization scope.
  • Kafka Cluster scope includes an updated quota, RBAC role bindings (with Kafka permissions), which no longer limits role bindings without Kafka permissions.
  • All RBAC role binding quotas now provide usage data.

March 29, 2024

Confluent Cloud now supports outbound AWS PrivateLink connections using Egress Access Points. Egress Access Points enable fully managed Confluent connectors to access services from AWS PrivateLink Service providers such as AWS, MongoDB, Snowflake, and others.

Egress Access Points are supported for Dedicated Clusters with AWS PrivateLink networking.

For details, see AWS Egress Access Points for Dedicated Clusters.

March 28, 2024

Managing SSO access to the Confluent Support Portal is now in Early Access. For more information, see Manage SSO Access to Confluent Support Portal.

March 25, 2024

The throughput cluster limits and capacity guidelines for Dedicated and Enterprise Kafka clusters have changed.

  • For Enterprise clusters, capacity guidance for ingress is 60 megabytes per second (MBps) per CKU with an upper limit of 300 megabytes and egress is 180 MBps per CKU with a 900 megabyte limit. Per partitions limits for Enterprise are now 6 MBps for ingress and 18 MBps for egress.
  • For Dedicated clusters, capacity guidance for ingress is 60 MBps per CKU with an upper limit of 9,120 megabytes and egress is 180 MBps per CKU with a 27,360 megabyte limit. Per partitions limits for Dedicated are now 12 MBps for ingress and 36 MBps for egress.

For more information, see E-CKU capacity guidance, Limits per CKU, and Dimensions with a recommended guideline.

March 19, 2024

Confluent Cloud for Apache Flink®️ is promoted to General Availability.

Auditable event methods for Apache Flink and Auditable event methods for Flink authentication and authorization are promoted to General Availability. These auditable event methods are triggered by operations on Flink authentication, authorization, regions, compute pools, workspaces, and statements.

March 5, 2024

Stream Lineage for Flink is now available providing complete end-to-end visibility for Flink SQL statements.

March 4, 2024

A new predefined RBAC role, BillingAdmin, is now generally available. This role allows users to view and manage billing information for an organization. For more information, see BillingAdmin.

IP Filtering is now generally available for production use. Use IP Filtering to enhance the security of your Confluent Cloud resources by restricting access to trusted network locations. This extra layer of access control protects against compromised credentials being used to manage Confluent Cloud from unauthorized IP addresses.

February 29, 2024

RBAC role bindings usage data is now available for the following scopes: Organization and Kafka cluster. For details about using the Quotas API to view your usage data, see Service Quotas API for Confluent Cloud resources.

February 22, 2024

Confluent Cloud for Apache Flink®️ is now available for preview in Google Cloud (asia-southeast1, australia-southeast1, europe-west1, europe-west3, us-central1, us-east1, us-east4, and us-west4).

February 21, 2024

Confluent Cloud now supports resolving private DNS names from a DNS resolver within your own VPC or VNet via DNS forwarding. This feature enables fully managed connectors to access endpoints using private DNS zones.

DNS forwarding is supported for AWS VPC peering, AWS Transit Gateway connection, or Azure VNet peering in Confluent Cloud.

For details, see DNS forwarding for AWS Peering, DNS forwarding for AWS Transit Gateway, and DNS for Azure Peering.

February 16, 2024

Early Access is now available for the confluent-kafka-javascript client, a librdkafka-based client with APIs that are compatible with the KafkaJS and node-rdkafka libraries. For early access, only basic produce and consume functionality is available, along with the ability to create and delete topics. For more information, see the Introduction to Confluent-Kafka-JavaScript. For migrating existing code, see the KafkaJS Migration Guide.

January 12, 2024

  • Terraform support for Flink SQL statements is now available. Refer to this tutorial for a complete end-to-end CI/CD example of deploying a Flink SQL statement on Confluent Cloud for Apache Flink®️.
  • Flink is now available in preview in Azure (eastus, eastus2, westeurope, southeastasia, westus2) and 4 additional AWS regions (us-west-2, ap-southeast-1, eu-west-2, ap-southeast-2).
  • Several Flink metrics are now available to query directly via the Metrics API, Confluent Cloud Console, and Datadog.

January 10, 2024

The connection count guideline for Dedicated Kafka clusters has been raised from 12,000 per CKU to 18,000 per CKU. For more information, see Limits per CKU and Dimensions with a recommended guideline.

2023 Releases

December 15, 2023

December 14, 2023

Self-managed encryption keys on Azure now include support for FIPS 140-2 Level 2 compliance on Confluent Cloud Dedicated clusters when using HSM-protected keys with Azure Key Vault.

December 13, 2023

Service quota on RBAC role bindings for a Schema Registry cluster updated:

  • Schema Registry cluster scope added, with the RBAC role bindings quota for each Schema Registry cluster now independent of the “organizations + environments” RBAC role bindings quota.
  • RBAC role bindings now enforced per Schema Registry cluster with default quota of 5000.

December 6, 2023

IP Filtering is available for production use in Limited Availability. Use IP Filtering to enhance the security of your Confluent Cloud resources by restricting access to trusted network locations. This extra layer of access control protects against compromised credentials being used to manage Confluent Cloud from unauthorized IP addresses. To get access before General Availability, contact Confluent Support.

December 4, 2023

Just-in-time (JIT) user provisioning and group mapping are promoted to General Availability. JIT user provisioning automatically creates Confluent Cloud user accounts, then uses group mapping to grant Confluent Cloud RBAC permissions based on group memberships in your SSO identity provider.

December 1, 2023

November 17, 2023

The fully-managed BigQuery Sink V2 connector is available for your Apache Kafka® clusters on Google Cloud. The connector supports the Google Cloud BigQuery Storage Write API for data ingestion. Using the BigQuery Storage Write API may provide a cost-benefit for your BigQuery project. For more information, see Google BigQuery Sink V2 Connector for Confluent Cloud.

October 12, 2023

Enterprise clusters are now available in the ap-south-1 (Mumbai) region in AWS.

October 6, 2023

  • The new resource metadata access option is generally available.

    The resource metadata access option enables you to connect to the Kafka clusters with private networking to view resources. Without the need to set up a proxy or reverse SSH channel, the following features are enabled when you turn on the option in your private network:

    • Topics metadata views, specifically names, and configuration
    • Stream Lineage
    • Metrics and consumer lag information for topics

    You can toggle the option at the cluster level or at the organization level as the OrganizationAdmin role.

    For details, see Enable or disable the Resource metadata access option.

September 26, 2023

A new Kafka cluster type, Enterprise, is generally available on AWS. Enterprise clusters are designed for production-ready functionality that requires private endpoint networking capabilities.

Enterprise clusters are available over AWS PrivateLink connections in the following regions in AWS, with rollouts to additional regions shortly following:

  • us-east-1 (N. Virginia)
  • us-east-2 (Ohio)
  • us-west-2 (Oregon)
  • eu-west-1 (Ireland)
  • eu-central-1 (Frankfurt)
  • ap-southeast-2 (Sydney)
  • ap-southeast-1 (Singapore)
  • af-south-1 (Cape Town)

For details about the Enterprise cluster, see Enterprise clusters.

Flink SQL is available for Open Preview. For more information, see Stream Processing with Confluent Cloud for Apache Flink.

September 11, 2023

September 8, 2023

August 1, 2023

  • Two new RBAC roles, AccountAdmin and ResourceKeyAdmin, are promoted to General Availability.
    • AccountAdmin - Manage user and service accounts across the organization.
    • ResourceKeyAdmin - Manage API keys for resources (Kafka, Schema Registry, and ksqlDB) across the organization. No Cloud API key management.
  • Just-in-time (JIT) user provisioning automatically creates Confluent Cloud user accounts, then uses group mapping to grant Confluent Cloud RBAC permissions based on group memberships in your SSO identity provider. Both features are now available for Early Access. To be considered for access before General Availability, contact Confluent Support.

July 27, 2023

  • Use OAuth to authenticate a cluster link with source Confluent Cloud, Confluent Platform, or Apache Kafka® clusters, as described under OAuth in the Cluster Linking documentation.

July 14, 2023

  • Use the Custom Connector Logs UI to view detailed log messages for custom connectors. To learn more, see View from logs tab.
  • Cluster links can now be created in bidirectional mode for Disaster Recovery. To learn more, see Bidirectional mode in the Confluent Cloud Cluster Linking configuration documentation.
  • Cluster Linking mirror topics can now begin replication from the latest message, thereby leaving behind historical events, or from a specific timestamp using the cluster link configuration mirror.start.offset.spec. To learn more, see mirror.start.offset.spec.

July 12, 2023

Use the Confluent Security Token Service (Confluent STS) to provide trusted users or services with temporary security credentials that can access Confluent Cloud resources without requiring them to have a Confluent Cloud account. Documentation is now available at Use Confluent Security Token Service (STS) tokens with Confluent Cloud APIs.

July 7, 2023

Two new RBAC roles, AccountAdmin and ResourceKeyAdmin, are now in Limited Availability to a subset of Confluent customers.

  • AccountAdmin - Manage user and service accounts across the organization.
  • ResourceKeyAdmin - Manage API keys for resources (Kafka, Schema Registry, and ksqlDB) across the organization. No Cloud API key management.

To be considered for access before General Availability, contact Confluent Support.

June 22, 2023

Cluster Linking is now available between Private Confluent Cloud Dedicated clusters in AWS PrivateLink.

To learn more, see Cluster Linking between AWS PrivateLink Confluent Cloud clusters.

June 22, 2023

ksqlDB 0.29.0 is now available in Confluent Cloud.

  • New functions: LOG, POWER, CBRT, TRUNC, CORRELATION
  • UDAFs with multiple/variadic args and support for four- and five-column arguments to UDAFs
  • Variadic TOPK that can select other columns
  • Improved syntax error messages
  • Support for JSON arrays

June 5, 2023

The managed Snowflake Sink connector with support for the Snowpipe Streaming API is available for public preview. For more information, see Snowflake Sink Connector for Confluent Cloud.

May 16, 2023

The managed AlloyDB Sink connector is available for your Kafka clusters on Google Cloud. The AlloyDB Sink connector is a fully-managed PostgreSQL-compatible database service. For more information, see AlloyDB Sink Connector for Confluent Cloud.

May 12, 2023

Custom Connector support is available in Confluent Cloud for certain AWS regions. Custom Connectors offer a fully-managed Connect infrastructure service in Confluent Cloud. Users can upload a Kafka Connect-based plugin to Confluent Cloud and create connectors based on that plugin. While customers manage the connectors, Confluent manages the underlying Connect infrastructure in Confluent Cloud.

May 10, 2023

Stream Sharing is now GA. Use Stream Sharing to exchange data between multiple organizations at the topic level. For more information, see Share Data with Confluent Stream Sharing.

April 28, 2023

Costs API is now GA. Use the Cost API to access your costs for a specific range of dates. For more information, see View or download invoices.

April 27, 2023

Cluster Linking is now available from any Private Confluent Cloud Dedicated cluster to a Public-Dedicated Confluent Cloud cluster. To learn more, see Private to public Cluster Linking.

April 24, 2023

Single Sign-on (SSO) adds support for SAML metadata files. You can now upload a SAML metadata file obtained from your identity provider to quickly enable SSO or update settings while eliminating the risks of manual entry. For more information, see Use the SAML metadata file for SSO configuration.

April 21, 2023

The Cluster Linking metric io.confluent.kafka.server/cluster_active_link_count, which indicates the number of active links on a cluster, is DEPRECATED and will be removed in a future release. To learn more, see Monitor Metrics for Cluster Linking on Confluent Cloud.

April 12, 2023

Audit log support for Notifications Service is now generally available. The auditable event methods track operations on notification types, integrations, and subscriptions. To learn more, see Notifications Service Auditable Event Methods.

April 3, 2023

Error reporting is available for the Google Cloud BigQuery Sink (Legacy) Connector for Confluent Cloud. For additional details, see KIP-610.

March 31, 2023

Support for /27 CIDR blocks in VPC Peering Confluent Cloud networks on AWS is a fully supported offering in Limited Availability to a subset of Confluent customers. To learn more, see the Select CIDR blocks and block size section in Confluent Cloud Network on AWS.

March 29, 2023

Support for Resource ID (resourceId) in access control lists (ACLs) is currently rolling out to Confluent Cloud organizations. The non-breaking changes enable resource IDs (resourceId) for Kafka ACLs in Confluent Cloud. For more information, see ACL operation details.

March 27, 2023

Authentication protections have been added to Confluent Cloud to prevent unauthorized access to local user accounts. For more information, see Confluent Cloud Security Protections for Authentication.

March 24, 2023

OAuth authentication support for Confluent Cloud APIs is promoted to General Availability (GA). This release includes the following enhancements:

  • Support for OAuth on APIs for managing Confluent Cloud (an authentication alternative to Cloud API keys)
  • Introduction of a new Secure Token Service (STS) that enables exchanging a third-party token for a Confluent STS token.

To learn more, see Authentication in the Confluent Cloud APIs documentation.

March 10, 2023

Audit log support for authentication and authorization of Schema Registry and Stream Catalog actions are now available. To learn more, see Authentication and Authorization Auditable Event Methods for Confluent Cloud Schema Registry.

March 9, 2023

Static egress IP addresses for Azure are generally available (GA). Static egress IP addresses are now supported on all three major cloud platforms. Static egress IP addresses are public IP addresses associated with Confluent Cloud that are used to communicate with external resources (such as data sources and sinks for managed connectors) over the public internet. To learn more, see Use Public Egress IP Addresses on Confluent Cloud for Connectors and Cluster Linking and Public Egress IP Addresses for Confluent Cloud Connectors.

February 28, 2023

Private DNS resolution is promoted to General Availability for:

Enable private DNS resolution to fully resolve Confluent endpoints within your private DNS zone without requiring external resolution to the Confluent Global DNS Resolver (GLB).

February 24, 2023

Keys (byok/v1) API is available in Open Preview for Confluent Cloud on AWS and Azure. Use the Keys API to include self-managed encryption keys (aka BYOK) as part of your cluster creation workflow (including the ability to build policy profiles).

Confluent Cloud Console now uses the Kafka REST API and the Metrics API instead of the legacy API. While most of Confluent Cloud remains unchanged, Consumer Lag in Cloud Console will no longer display offset information, instead focusing only on the lag to make it more actionable for developers and operators. This change rolls out across organizations over the next few weeks.

February 23, 2023

Self-managed Encryption Keys for Azure support is promoted to General Availability (GA). You can now use your own encryption keys in Azure Key Vault to encrypt data at rest on Confluent Cloud Dedicated Clusters in Azure.

February 15, 2023

Stream Catalog RBAC is now General Available (GA). As part of this, we have released two new roles DataSteward and DataDiscovery which allow management of access to metadata associated with entities such as topics and schemas. As RBAC will be enforced on the ability to attach tags, business metadata, and searching using stream catalog APIs, cluster and resource level roles such as CloudClusterAdmin, Operator (Resource level), ResourceOwner, DeveloperRead and DeveloperWrite roles will not be allowed to attach tags, business metadata and search using via UI or stream catalog APIs.

January 30, 2023

Private DNS resolution for AWS PrivateLink is promoted to General Availability. You can fully resolve Confluent endpoints within your private DNS zone without requiring external resolution to the Confluent Global DNS Resolver (GLB).

January 27, 2023

Stream Designer now enables users and organizations to easily manage the entire lifecycle of pipelines by using the Confluent CLI and the Pipelines REST API.

To learn more, see the following sections:

2022 Releases

December 16, 2022

OAuth for Kafka REST APIs is now promoted to General Availability (GA). You can now authenticate using an OAuth/OIDC identity provider to access Kafka REST APIs. To learn more, see Access Kafka REST APIs with an OAuth/OIDC identity provider.

Cluster Linking between two AWS Transit Gateway Confluent Cloud clusters in different regions is now promoted to General Availability (GA). You can peer AWS Transit Gateways to create connectivity and use Cluster Linking for fully-managed multi-region replication. To learn more, see Cluster Linking between AWS Transit Gateway attached Confluent Cloud clusters.

December 13, 2022

OAuth for Kafka is now promoted to General Availability (GA). Create OAuth/OIDC identity providers and use Confluent OAuth with Kafka clients.

December 9, 2022

December 8, 2022

Self-service AWS Transit Gateway is now promoted to General Availability (GA) for Confluent Cloud networks using the Confluent Cloud Console, REST API, or Confluent Terraform Provider.

December 7, 2022

Service quotas for RBAC role bindings have been added or updated to enable increases in quotas:

  • Organization scope: RBAC role bindings (organization plus environments)
  • Environment scope: RBAC role bindings (organization plus environments)
  • Kafka cluster scope: RBAC role bindings

Audit log support for role-based access control (RBAC) operations and action are now available. To learn more, see Audit log support for |rbac-long|.

December 6, 2022

As a feature of Stream Governance, the Confluent CLI AsyncAPI tool adds the ability to Use AsyncAPI to Describe Topics and Schemas on Confluent Cloud Clusters.

November 28, 2022

Support for Stream Governance business and topic metadata is available in the Confluent Cloud Console and REST API. To learn more, see these topics:

November 17, 2022

Support for the following auditable event methods have been added to Confluent Cloud audit logs:

November 4, 2022

To make the ksqlDB editor more accessible, you can press Alt+Tab in the editor window to create a tab on a Mac.

October 11, 2022

The Message Browser now supports Avro messages deserialization.

To learn more about schema formats, see Formats, Serializers, and Deserializers.

October 3, 2022

  • Promoted to General Availability (GA):
  • Cluster Linking for Transit Gateway clusters launched in Limited Availability.
  • Notifications for account, billing, and service events can now be managed using a REST API in addition to the Cloud Console. You can integrate Microsoft Teams, Slack, a generic webhook or email for notifications using the API, and create new notification subscriptions. For more information, see Notifications for Confluent Cloud.

September 29, 2022

REST APIs for Invitation are promoted to General Availability:

  • Provides programmatic management of user invitation operations, including creating, listing, describing, and deleting Invitations.

August 31, 2022

Google Cloud Private Service Connect for Dedicated clusters on Confluent Cloud is promoted to General Availability.

August 11, 2022

OAuth for Confluent Cloud is a fully supported offering in Limited Availability to a subset of Confluent Cloud customers.

August 2, 2022

ksqlDB 0.28.2 is now available in Confluent Cloud.
  • Enable the new EMIT FINAL implementation.
  • Support pausing and resuming persistent queries.
  • Add additional UDFs for trigonometry.

July 21, 2022

ksqlDB 0.27.1 is now available in Confluent Cloud.
  • Handle multi-schema Protobuf/Avro topics.
  • Add ASSERT SCHEMA and ASSERT TOPIC statements to assert the existence of resources.
  • Add PROTOBUF_NOSR format for Protobuf messages without Schema Registry.
  • Enable aggregation without a GROUP BY clause.
  • Improve null handling.

July 15, 2022

Google Cloud Private Service Connect for Dedicated clusters on Confluent Cloud is available in an Early Access Program to a limited set of early adopters.

June 30, 2022

Cluster Linking now supports adding a prefix to the names of mirror topics. To learn more, see, Prefixing Mirror Topics and Consumer Group Names.

Confluent Terraform Provider v1.0.0 is now generally available.

View the full changelog on Github.

June 28, 2022

Confluent Terraform Provider v0.13.0 is now available in public preview. It contains the following changes:

  • Added support for the kafka_api_key, kafka_api_secret, kafka_rest_endpoint attributes in a provider block to make the rest_endpoint attribute and credentials block optional for confluent_kafka_acl and confluent_kafka_topic resources (#37, #54).
  • Added disable_wait_for_ready attribute to disable readiness check for confluent_api_key resource #25, #51).
  • Added support for pausing / resuming a connector by adding status attribute for confluent_connector resource.

View the full changelog on Github.

June 27, 2022

Confluent Terraform Provider v0.12.0 is now available in public preview. It contains the following changes:

  • Reverted resource versioning changes introduced in 0.11.0. For example, the confluent_environment_v2 resource was renamed to confluent_environment. User feedback on versioned resources made it clear that the pain of manually updating the TF state file outweighs the potential benefits of deprecation flexibility that versioned resources could have provided. In order to avoid forcing users to edit their TF state files (either manually or by running commands like terraform state mv) in the future, TF state migrations will be handled within the Confluent Terraform Provider whenever possible.

Follow Confluent Provider 0.12.0: Upgrade Guide to update your TF state and TF configuration files accordingly. Direct updates from both 0.10.0 and 0.11.0 to 0.12.0 are supported.

June 23, 2022

Added the SignIn event to organization auditable log events. For details, see Sign-in attempt.

June 15, 2022

Confluent Terraform Provider v0.11.0 is now available in public preview. It contains the following changes:

  • Renamed all resources and data sources to contain a version postfix that matches their API group version (full list).
  • Renamed the http_endpoint attribute to rest_endpoint for the confluent_kafka_cluster, confluent_kafka_topic, confluent_kafka_acl resources and data sources to match the Cluster settings tab in Confluent Cloud Console, where the corresponding attribute is named the REST endpoint.
  • Renamed the api_key and api_secret attributes of the provider block to cloud_api_key and cloud_api_secret, respectively.

June 9, 2022

Updated the RBAC limitations about API keys for ksqlDB and Schema Registry clusters.

June 8, 2022

Confluent Terraform Provider v0.10.0 is now available in public preview. It contains the following changes:

View the full changelog on Github.

May 25, 2022

Confluent Terraform Provider v0.9.0 is now available in public preview. It contains the following changes:

  • Added new confluent_network data source (#39).
  • Added dns_domain and zonal_subdomains computed attributes for confluent_network resource (#40).
  • Decreased the creation time of confluent_role_binding resource by 4.5x (#24).

Bug fixes:

  • Fixed provisioning error for confluent_connector resource (#43).

View the full changelog on Github.

May 24, 2022

Notifications for account, billing, and service events can now be managed using the Cloud Console. Additionally, you can integrate Microsoft Teams, Slack, or a generic webhook for notifications using the console. For more information, see Notifications for Confluent Cloud.

May 13, 2022

Confluent Terraform Provider v0.8.0 is now available in public preview. It contains the following changes:

  • Added new confluent_connector resource (#6).
  • Added new confluent_organization data source (#20).
  • Implemented import for confluent_api_key resource (#17).

Bug fixes:

  • Updated input validation for confluent_private_link_access and confluent_kafka_cluster resources (#18).
  • Fixed minor documentation issues (#15).

View the full changelog on Github.

May 6, 2022

Network service quotas for the following resources have increased:

  • Kafka clusters: 10 (previously 5)
  • Kafka cluster CKUs: 72 (previously 24)

May 4, 2022

REST APIs for Cloud and Kafka API keys are promoted to General Availability:

  • Provides programmatic management of critical API key operations, including creating, listing, describing, updating, and deleting API keys.
  • Enables organizations to build end-to-end provisioning flow using the Confluent Terraform Provider or other automation tools.

The Operator RBAC role has been updated with the following restrictions:

  • No access to ksqlDB clusters and cannot see any information related to the ksqlDB clusters.
  • No access to the Schema Registry and cannot see any information related to the Schema Registry.

May 3, 2022

Confluent Terraform Provider v0.7.0 is now available in public preview. It contains the following changes:

  • Added new resources and corresponding docs:
    • confluent_api_key (#4, #17, #25, #41, #66)
    • confluent_network (#45)
    • confluent_peering
    • confluent_private_link_access (#45)
  • Added new data sources and corresponding docs:
    • confluent_user (#61)
  • Completely rewrote the Sample Project guide that references 9 TF sample configurations for end-to-end workflows.
  • Updated confluent_kafka_cluster and confluent_environment data sources to accept display_name as an input.
  • Improved logging to simplify debugging process:
    • Started using the tflog package: now you can enable detailed logs and use grep and a corresponding “logging key” to find all entries related to a particular resource, for example, grep "environment_id=env-9761j7" log.txt.
    • Revised and structured logging messages to output non-sensitive attributes instead of unreadable references.
  • Added support for self-managed encryption keys (also known as bring-your-own-key (BYOK) encryption). They are only available for Dedicated Kafka clusters on AWS and GCP.

Bug fixes:

  • Fixed pagination issue for data sources (#54, #68).
  • Fixed a bug where you could “successfully” import a non-existent resource (#58).
  • Fixed a null pointer exception (#53, #55, #67).
  • Added other minor fixes (#57).

Breaking changes:

  • All resources and data sources have been renamed in the new Confluent Terraform Provider. The prefix has been changed from confluentcloud to confluent. For example, the confluentcloud_environment resource was updated to confluent_environment. Follow the Confluent Provider 0.7.0: Upgrade Guide to update your TF state file.
  • Changed kafka_cluster attribute type from string to block for confluent_kafka_acl and confluent_kafka_topic resources and data sources.
  • Made host attribute required for confluent_kafka_acl resource.

View the full changelog on Github.

May 3, 2022

New user session timeouts when using the Confluent Cloud Console are now promoted to General Availability:

  • Users remain signed in to the Confluent Cloud Console until no activity is detected for 30 minutes.
  • Users remain signed in to the Confluent Cloud Console for a maximum of eight hours without refreshing user credentials. Users must sign in at least once every eight hours.

For details, see What user session timeouts does Cloud Console require?.

April 28, 2022

ksqlDB 0.26.0 is now available in Confluent Cloud.
  • Add support for Stream-to-Stream and Table-to-Table right joins.
  • MIN/MAX aggregates can now be used for Time/TS/Date types.

April 28, 2022

REST APIs for Dedicated clusters and private networking are now Generally Available, and include the following features:

  • Adds REST APIs for:
  • Adds Confluent Cloud networks
    • Confluent Cloud networks are now first-class citizens, with independent lifecycle management of private dedicated clusters and networks.
    • Supports self-service provisioning of multiple Dedicated clusters, reducing manual effort and improving network resource utilization. For example, you can reuse /16 CIDR blocks across multiple clusters for VPC peering.
    • Users can select zones for the Confluent Cloud network. A Confluent Cloud network is always multi-zone and all multi-zone clusters in it are added to the same zones.
  • Adds NetworkAdmin RBAC role targeting network lifecycle management, enabling the separation of concerns between infrastructure and application development teams in an organization.
  • Adds audit log support for network-related auditable events.

April 7, 2022

ksqlDB 0.25.1 is now available in Confluent Cloud.
  • Improvements to aggregate functions to support complex types, like structs, arrays, and maps.
  • Support for push query continuation tokens in the Java API.
  • Better error handling for nested functions.
  • In the Java API and migrations tool, support for custom request headers and connector IF NOT EXISTS clauses.

April 1, 2022

The Service Level Agreeement (SLA) for Confluent Cloud now specifies a 99.99% uptime SLA for Standard and Dedicated Kafka clusters with Multi-Zone configurations. For details, see Confluent Cloud SLA.

The uptime SLAs for Single-Zone clusters remain the same; 99.5% for Basic and 99.95% for Standard and Dedicated.

March 30, 2022

ksqlDB Connector Management is now available in Confluent Cloud. For more details, see Manage Connectors With ksqlDB on Confluent Cloud.

March 29, 2022

New organization audit log events for management operations are promoted to General Availability. For more details, see Organization Auditable Event Methods.

March 24, 2022

Consumer lag is now available as a metric in the Confluent Cloud Metrics API. For more details see Monitor Kafka Consumer Lag in Confluent Cloud.

March 22, 2022

Granular role-based access control (RBAC) for Kafka resources is promoted to General Availability. For details, see Role-based Access Control (RBAC) in Confluent Cloud.

Highlights:

  • Adds roles for DeveloperRead (Read access), DeveloperWrite (Write access), DeveloperManage (Create, Delete, Change configurations), ResourceOwner (full access, including granting permissions) for Kafka resources to enable using RBAC for managing access to topics, consumer groups, and transactionalIDs.
  • Adds the Operator role that enables Describe-only access at the Organization, Environment, and Cluster level. For details, see Operator.
  • Restrict user and service accounts using RBAC and ACLs.
  • User and service accounts can be granted multiple roles.
  • Adds the MetricsViewer role that grants access only to metrics for specified user and service accounts. This role cannot access data in Kafka clusters.
  • Granular RBAC for Kafka resources is only available in Standard and Dedicated clusters. This functionality is not available on Basic clusters.
    • Note that administrator roles are enforced on Basic clusters as usual.
  • Stream lineage views can be accessed by administrator and operator roles (OrganizationAdmin, EnvironmentAdmin, CloudClusterAdmin, MetricsViewer, and Operator). Developers cannot access.

Gaps:

  • User and service accounts with DeveloperRead, DeveloperWrite, DeveloperManage, and ResourceOwner roles on resources within a Kafka cluster can see all of the metrics within that cluster. We are actively working to block this access.
  • Any user with access to a resource in a cluster can see all of the consumers and producers of a cluster, regardless of which topic on the cluster the consumer consumes from. Engineering is actively working to block this access.
  • Some users might receive email notifications related to Connector create operations, even if they are not directly related to or involved in these operations. If a user receives a notification email message, they cannot access the connector unless they are assigned the required roles. Engineering is working to resolve this issue.

March 9, 2022

Cluster links can now be viewed on the Confluent Cloud Console in your web browser. Log on to Confluent Cloud, navigate to Environments, then click the Cluster links tab (next to Environments on the Home page). To learn more, see Go exploring in the Quick Start Tutorial.

Confluent Cloud Terraform Provider v0.5.0 is now available in public preview. It contains the following changes:

  • Added support for Kafka topic configuration updates (#11).
  • Added support for display_name input for confluentcloud_environment and confluentcloud_service_account data sources (#42, #46).
  • Fixed Provider produced inconsistent result after apply error when creating a lot of Kafka topics (#40).
  • Fixed delete operation for confluentcloud_kafka_topic resource to avoid 400 Bad Request: Topic ‘foobar’ is marked for deletion error when recreating a lot of Kafka topics (#50).
  • Added support for old environment IDs (#43).

View the full changelog on Github.

February 22, 2022

New metrics to track all bytes sent and received over the network by Confluent Cloud are now available in the Confluent Cloud Metrics API. These metrics have a principal_id label to attribute usage to a user or service account. For more details see Confluent Cloud Metrics.

February 11, 2022

ksqlDB 0.24.0 is now available in Confluent Cloud.
  • Expose Kafka message headers to ksqlDB
  • Add utility functions for working with JSON data
  • Add ability to use an existing Schema Registry schema when creating streams and tables

January 28, 2022

Confluent Cloud Terraform Provider v0.4.0 is now available in public preview. It contains the following changes:
  • Added data sources for: confluentcloud_environment, confluentcloud_kafka_cluster, confluentcloud_kafka_topic, and confluentcloud_service_account
  • Improved readability of error messages by adding details to them
  • Resolved potential HTTP 429 errors by adding automatic retries with exponential backoff for HTTP requests
  • Added graceful handling for resources created via Terraform but deleted via Confluent Cloud Console, Confluent CLI, or Confluent Cloud APIs.
  • Fixed minor bugs and docs issues.
Breaking Changes:
  • Removed friction around manual look-up of IntegerID for Service Accounts by removing the need to use a service_account_int_id TF variable. If you are using the confluentcloud_kafka_acl resource you might see an input validation error after running terraform plan, which can be resolved by following this guide. Updated “Sample project” guide to reflect this change.
  • Simplified confluentcloud_role_binding resource creation by adding a new rbac_crn attribute for confluentcloud_kafka_cluster resource. Updated the confluentcloud_role_binding resource examples to reflect this simplified approach.

View the full changelog on Github.

January 19, 2022

ksqlDB now supports 1 CSU and 2 CSU deployments. For more information, see Announcing the Confluent Q1 ‘22 Launch.

January 11, 2022

Confluent Cloud Terraform Provider is now available in public preview. You can manage the following Confluent Cloud resources:
  • Environments
  • Kafka Clusters
  • Kafka Topics
  • Kafka ACLs
  • RBAC Rolebindings
  • Service Accounts

2021 Releases

December 14, 2021

ksqlDB 0.23.1 is now available in Confluent Cloud.
  • Add support for TIMESTAMP type in the WITH/TIMESTAMP property
  • Enable ROWPARTITION and ROWOFFSET pseudo columns
  • Enable GRACE period with new stream-stream joins semantics

November 16, 2021

ksqlDB 0.22.0 is now available in Confluent Cloud.
  • Add SOURCE keyword for CREATE STREAM and CREATE TABLE statements
  • Improve pull query performance for primary key range scans
  • Improve push query performance

October 7, 2021

For Dedicated clusters:

September 16, 2021

ksqlDB 0.21.0 is now available in Confluent Cloud.
  • Support for expressions in foreign-key table-table joins
  • BYTES data type to represent byte arrays
  • ARRAY_CONCAT function added

September 14, 2021

Stream Governance is now available on Confluent Cloud including:

Schema Linking is introduced in preview.

Fully-managed Confluent Cloud Azure Cognitive Search Sink GA
This feature is launched for your Kafka clusters on Azure. For more information, see Azure Cognitive Search Sink Connector for Confluent Cloud.

September 9, 2021

Fully-managed Confluent Cloud Azure Synapse Analytics Search Sink GA
This feature is launched for your Kafka clusters on Azure. For more information, see Azure Synapse Analytics Sink Connector for Confluent Cloud.

September 8, 2021

Fully-managed Confluent Cloud Salesforce Platform Events Sink GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Salesforce Platform Event Sink Connector for Confluent Cloud.

September 7, 2021

Fully-managed Confluent Cloud Salesforce SObject Sink GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Salesforce SObject Sink Connector for Confluent Cloud.

August 17, 2021

Multi-tenant cluster provisioning APIs, Admin REST APIs for Apache Kafka®, and Cluster Linking APIs are Generally Available. For more information, see API Reference Documentation.

ksqlDB Pull Queries are now Generally Available.

Fully-managed Confluent Cloud Azure Service Bus Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Azure Service Bus Source Connector for Confluent Cloud.
Fully-managed Confluent Cloud ServiceNow Sink GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see ServiceNow Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud ServiceNow Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see ServiceNow Source Connector for Confluent Cloud.

Infinite Storage is now available on Google Cloud clusters. CKUs are no longer tied to storage on Google Cloud clusters.

Cluster Linking for Confluent Cloud is Generally Available on all dedicated, internet networked clusters across all cloud providers. Note: Cluster Linking REST APIs to create and update cluster links are available on all Dedicated Confluent Cloud clusters with Internet networking created after August 16, 2021. These APIs are being rolled out to all previously created clusters. To request a Dedicated cluster update sooner, send an email to clusterlinking@confluent.io. To learn more, see the Cluster Linking on Confluent Cloud Overview page.

max.message.bytes can now be configured up to 20 MB on dedicated clusters (previously the limit was 8 MB). See the Confluent Cloud Broker and Topic Configuration Settings for more details.

Additionally, check out the August Confluent Cloud blog post to learn about the latest Confluent Cloud features.

August 16, 2021

Fully-managed Confluent Cloud Salesforce Platform Events Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Salesforce Platform Event Source Connector for Confluent Cloud.

August 9, 2021

Fully-managed Confluent Cloud Azure Cosmos DB Sink GA
This feature is launched for your Kafka clusters on Azure. For more information, see Azure Cosmos DB Sink Connector for Confluent Cloud.

July 28, 2021

Cluster management APIs for Standard and Basic clusters are now available. For more information, see Clusters-(cmkv2).

July 26, 2021

ksqlDB 0.20.0 is now available in Confluent Cloud.
  • DATE and TIME SQL types added
  • LEAST and GREATEST UDFs added
  • DATEADD and DATESUB functions added
  • FROM_DAYS and update UNIX_DATE functions added
  • PARSE_DATE and FORMAT_DATE functions added
  • PARSE_TIME and FORMAT_TIME functions added
  • TIMEADD and TIMESUB functions added

July 19, 2021

ksqlDB 0.19.0 is now available in Confluent Cloud.
  • Foreign-key joins are now supported.
  • NULLIF function added.

July 12, 2021

For customers with at least one Standard or Dedicated Kafka cluster, Audit logs now include authorization event checks that occur in the control plane.

June 10, 2021

Fully-managed Confluent Cloud Datadog Metrics Sink GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Datadog Metrics Sink for Confluent Cloud.

June 2, 2021

Infinite Storage for Standard and Dedicated clusters on Google Cloud All new and existing Standard and Dedicated clusters on Google Cloud now support Infinite Storage. This means there is no maximum size limit for the amount of data that can be stored on the cluster. There is no price change for clusters with Infinite Storage.

For more information, see Kafka Cluster Types in Confluent Cloud.

May 26, 2021

ksqlDB 0.18.0 is now available in Confluent Cloud.

May 6, 2021

Audit logs are now GA
Authentication events and authorization check events that occur on Standard and Dedicated Kafka cluster types are logged and available for consumption.
Confluent Cloud Cluster Role Based Access Control (RBAC) is now GA
Customers can gate access to management operations at the Organization, Environment, and Cluster level. Existing users and service accounts with Confluent Cloud API keys are granted the OrganizationAdmin role in all existing organizations.

April 26, 2021

ksqlDB 0.17.0 is now available in Confluent Cloud

April 22, 2021

Fully-managed Confluent Cloud MongoDB Atlas Sink GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see MongoDB Atlas Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud MongoDB Atlas Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Get Started with the MongoDB Atlas Source Connector for Confluent Cloud.

April 6, 2021

Azure Private Link support for Confluent Cloud Dedicated clusters is now GA

Customers can provision new Confluent Cloud Dedicated clusters with Azure Private Link and establish secure connectivity to Confluent Cloud from their Azure VNet.

For more information, see Confluent Cloud Azure Private Link

Import Routes with VPC Peering to Confluent Cloud Dedicated clusters on Google Cloud (Preview)

Import route option is now supported with VPC Peering to Confluent Cloud Dedicated clusters on Google Cloud to enable connectivity from customer premise through customer VPC and support advanced network topologies to connect to Confluent Cloud.

For more information, see Confluent Cloud VPC Peering on GCP

March 18, 2021

Fully-managed Confluent Cloud Microsoft SQL Server Sink (JDBC) GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Microsoft SQL Server Sink (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud MySQL Sink (JDBC) GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see MySQL Sink (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud PostgreSQL Sink (JDBC) GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see PostgreSQL Sink (JDBC) Connector for Confluent Cloud.

February 24, 2021

Fully-managed Confluent Cloud Microsoft SQL Server CDC Source (Debezium) GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Microsoft SQL Server CDC Source (Debezium) [Legacy] Connector for Confluent Cloud.
Fully-managed Confluent Cloud MySQL CDC Source (Debezium) GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see MySQL CDC Source (Debezium) [Legacy] Connector for Confluent Cloud.
Fully-managed Confluent Cloud PostgreSQL CDC Source (Debezium) GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see PostgreSQL CDC Source Connector (Debezium) [Legacy] for Confluent Cloud.
Fully-managed Confluent Cloud Salesforce CDC Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Salesforce CDC Source Connector for Confluent Cloud.

February 2021

Dedicated clusters are now available for all Confluent Cloud users
Previously, Dedicated clusters were only available for customers who signed up through a cloud provider Marketplace integration, and customers with commits.
Fully-managed Confluent Cloud AWS Lambda Sink GA
This feature is launched for your Kafka clusters on AWS. For more information, see AWS Lambda Sink Connector for Confluent Cloud.
Metrics API Version 2 is now GA
Version 2 of the Metrics API adds metrics for Kafka Connect, ksqlDB, and Schema Registry. For more information, see Confluent Cloud Metrics.
ksqlDB 0.15.0 is now available in Confluent Cloud
  • Array and Struct types can now be used as row keys.
  • PARTITION BY now supports partitioning on multiple columns.
  • Row keys now support all data formats (e.g., JSON, DELIMITED, etc.)
  • This ksqlDB release includes breaking changes. Note that these breaking changes only apply to newly created persistent queries. Existing persistent queries are not affected:
    • Persistent queries that use multiple grouping columns now use a different row key format.
    • Stream-table key-to-key joins on mismatched key formats now result in repartition.

January 28, 2021

Microsoft Azure marketplace enhanced integration is in GA for customers
The change allows customers to use their Azure AD account to login (SSO) to Confluent Cloud, and there’s no need for a separate sign up.
Self-serve provisioning UI and CLI for ksqlDB applications

New self-serve provisioning UI and CLI for ksqlDB apps that enables providing your own API Key. You can specify the access for your ksqlDB application:

  • With Global access, you don’t need to configure ACLs at all, and you can begin writing queries immediately.
  • With Granular access, you can configure ACLS in the UI.
Fully-managed Confluent Cloud Azure Functions Sink GA
This feature is launched for your Kafka clusters on Azure. For more information, see Azure Functions Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Google Functions Sink GA
This feature is launched for your Kafka clusters on Google Cloud. For more information, see Google Cloud Functions Sink Connector for Confluent Cloud.
Manage lifecycle for your fully-managed connectors using an API
You can now manage the lifecycle for your fully-managed connectors by API. For more information, see the Confluent Cloud Connector API docs.
Fully-managed Confluent Cloud MongoDB Atlas Source Connector now supports BSON
The fully-managed Confluent Cloud MongoDB Atlas Source Connector now supports BSON as an input message format, along with Avro, JSON, JSON_SR (JSON schema), and Protobuf. The connector also now supports an option to fetch a document change only and an option to fetch a full document when a subset of records is updated. For more information, see Get Started with the MongoDB Atlas Source Connector for Confluent Cloud.
Fully-managed Confluent Cloud MongoDB Atlas Sink Connector now supports BSON
The fully-managed Confluent Cloud MongoDB Atlas Sink Connector now supports BSON as an input message format, along with Avro, JSON, JSON_SR (JSON schema), and Protobuf. For more information, see MongoDB Atlas Sink Connector for Confluent Cloud.

2020 Releases

December 16, 2020

ksqlDB version 0.14.0 now available in Confluent Cloud
ksqlDB version 0.14.0 provides more advanced pull query expressions (WHERE k IN (...)), incremental schema evolution (ALTER), variable substitution (${foo}), and more key formats.

December 1, 2020

Infinite Storage for Standard and Dedicated clusters on AWS

All new and existing Standard and Dedicated clusters on AWS now support Infinite Storage. This means there is no maximum size limit for the amount of data that can be stored on the cluster. There is no price change for clusters with Infinite Storage.

For more information, see Kafka Cluster Types in Confluent Cloud.

November 20, 2020

Fully-managed Confluent Cloud Elasticsearch Service Sink GA
This feature is launched for your Kafka clusters on AWS, Azure, or Google Cloud. For more information, see Elasticsearch Service Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Azure Data Lake Storage Gen2 Sink GA
This feature is launched for your Kafka clusters on Azure. For more information, see Azure Data Lake Storage Gen2 Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Google Cloud Functions Sink Preview
This feature is launched for your Kafka clusters on Google Cloud. For more information, see Google Cloud Functions Sink Connector for Confluent Cloud.

October 23, 2020

ksqlDB version 0.13.0 now available in Confluent Cloud
Pull queries are now available as a preview feature for all Confluent Cloud ksqlDB users.

September 28, 2020

ksqlDB version 0.12.0 now available in Confluent Cloud
For more information, see the 0.12.0 changelog.

September 25, 2020

Fully-managed Confluent Cloud Amazon Redshift Sink GA
This feature is launched for your Kafka clusters in AWS. For more information, see Amazon Redshift Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Microsoft SQL Server Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Microsoft SQL Server Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Oracle DB Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Oracle Database Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Snowflake Sink GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Oracle Database Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Azure Functions Sink Preview
This feature is launched for your Kafka clusters in AWS. For more information, see Azure Functions Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud MySQL Sink Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see MySQL Sink (JDBC) Connector for Confluent Cloud.

September 11, 2020

MySQL Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see MySQL Source (JDBC) Connector for Confluent Cloud.
PostgreSQL Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see PostgreSQL Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud AWS Lambda Sink Preview
This feature is launched for your Kafka clusters in AWS. For more information, see AWS Lambda Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Salesforce CDC Source Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Salesforce CDC Source Connector for Confluent Cloud.

September 3, 2020

Updated Schemas UI + Schema Registry settings
Customers can now see the list of schemas stored in Schema Registry, irrespective of the subject naming strategy applied, on the Schemas section in the Cloud Console. Additionally, Schemas Registry Allowed Usage, Schemas Registry API access, and Schemas Registry compatibility configuration are moved to the Settings section in the Environment the Schema Registry was created.
Fully-managed Confluent Cloud Microsoft SQL Server Sink Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Microsoft SQL Server Sink (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud PostgreSQL Sink Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see PostgreSQL Sink (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud MySQL CDC Source (Debezium) Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see MySQL CDC Source (Debezium) [Legacy] Connector for Confluent Cloud.
Fully-managed Confluent Cloud Microsoft SQL Server CDC Source (Debezium) Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Microsoft SQL Server CDC Source (Debezium) [Legacy] Connector for Confluent Cloud.
Fully-managed Confluent Cloud PostgreSQL CDC Source Connector (Debezium) Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see PostgreSQL CDC Source Connector (Debezium) [Legacy] for Confluent Cloud.

September 1, 2020

Improvements to Confluent Cloud ksqlDB handling of authorization by using bearer tokens.

August 13, 2020

Early access for Custom Dedicated Cluster settings
You can now modify the following Dedicated cluster settings in this limited Early Access: auto topic creation, allowed cipher suites, and default topic partitions and retention. For more information, see Change cluster settings for Dedicated clusters.

August 3, 2020

Azure VPC Peering self-serve provisioning via the Confluent Cloud Console
Customers with annual commitments on usage-based billing plans can now provision new dedicated clusters on Azure with VPC Peering. For more information, see Use VNet Peering Connections with Confluent Cloud on Azure.
ksqlDB version 0.11.0 now available in Confluent Cloud.
For more information, see the 0.11.0 changelog.

July 31, 2020

Fully-managed Confluent Cloud Datagen Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Datagen Source Connector for Confluent Cloud.
Feature enhancements for Fully-managed connectors

July 15, 2020

AWS Marketplace Commits and Pay-as-you-go

Amazon Web Services customers can now sign up for a self-serve Pay-as-you-go account or Confluent Cloud annual commitments through the AWS Marketplace. With Confluent Cloud annual commitments you can use your AWS commit towards usage-based consumption of Confluent Cloud. For more information, see:

July 14, 2020

Support for Bring Your Own Key (BYOK) on AWS dedicated clusters
  • New dedicated clusters only.
  • Supports AWS Key Management Service (KMS) only.
  • Support for automatic key rotation. No support for manual key rotation.

For more information, see Protect Data at Rest Using Self-managed Encryption Keys.

June 25, 2020

Fully-managed Confluent Cloud Azure Event Hubs Source GA
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Azure Event Hubs Source Connector for Confluent Cloud.
Fully-managed Confluent Cloud Snowflake Sink Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Snowflake Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Elasticsearch Sink Preview
This feature is launched for your Kafka clusters in AWS, Azure, or Google Cloud. For more information, see Elasticsearch Service Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Amazon S3 Sink Improvements
Additional properties to support building a time-based directory structure for data stored in S3. For more information, see Amazon S3 Sink Connector for Confluent Cloud.
Hard-delete schemas in Schema Registry
The Schema Registry API now supports permanent schema deletes with ?permanent=true on the HTTP DELETE call.
Support for schema references for Avro and JSON Schema in Schema Registry
Avro and JSON Schema can now make references to external schemas and evolve those independently (Protobuf already supports references). Schema references are a means of modularizing a schema and its dependencies.
Functionality from ksqlDB 0.9.0 and 0.10.0 is now available in Confluent Cloud

June 18, 2020

Annual Commitment Users on Google Cloud Can Provision Dedicated Clusters with VPC Peering
Customers with annual commitments on usage-based billing plans can now provision new dedicated clusters on Google Cloud with VPC Peering through the Cloud Console. For more information, see Use VPC Peering Connections with Confluent Cloud on Google Cloud.

June 10, 2020

Data flow
Data flow is now GA. This feature provides a visual representation of the data flow paths (edges) between producers, topics, and consumers within a cluster.
Google Cloud Marketplace Commits
Google Cloud customers can now sign up for Confluent Cloud annual commitments using the Google Cloud marketplace and utilize their Google Cloud commit towards usage-based consumption of Confluent Cloud. For more information, see Get Started with Confluent Cloud on the GCP Marketplace with Commitments.

June 5, 2020

Fully-managed Confluent Cloud Kinesis Source GA
This feature is launched for your Kafka clusters in AWS. For more information, see Amazon Kinesis Source Connector for Confluent Cloud.
Annual Commitment Users on AWS Can Provision Dedicated Clusters with VPC Peering
Customers with annual commitments on usage-based billing plans can now provision new dedicated clusters on Amazon Web Services with VPC Peering through the Cloud Console. For more information, see Use VPC Peering Connections with Confluent Cloud on AWS.

May 27, 2020

Fully-managed Confluent Cloud Google BigQuery Sink GA
This feature is launched for your Kafka clusters in Google Cloud. For more information, see Google Cloud BigQuery Sink (Legacy) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Google Cloud Pub/Sub Source GA
This feature is launched for your Kafka clusters in Amazon Web Services, Google Cloud, and Microsoft Azure. For more information, see Google Cloud Pub/Sub Source Connector for Confluent Cloud.
Fully-managed Confluent Cloud MongoDB Source Preview
This feature is launched for your Kafka clusters in Amazon Web Services, Google Cloud, and Microsoft Azure. For more information, see Get Started with the MongoDB Atlas Source Connector for Confluent Cloud.
Fully-managed Confluent Cloud MongoDB Sink Preview
This feature is launched for your Kafka clusters in Amazon Web Services, Google Cloud, and Microsoft Azure. For more information, see MongoDB Atlas Sink Connector for Confluent Cloud.
Confluent Cloud Metrics API
Confluent Cloud Metrics API now serves metrics for records sent and received for clusters, topics, and partitions along with cluster level partition count. For more information, see Confluent Cloud Metrics.

May 14, 2020

Cluster Level Metrics in the Cloud Console
View your time-series graphs of your Apache Kafka® cluster usage. This includes your ingress, egress, storage, and partition count to allow you to monitor your usage over time.
Annual Commitment Users Can Expand Dedicated Clusters
Customers with annual commitments on usage-based billing plans can now expand their dedicated clusters through the Cloud Console. For more information, see Expand a Dedicated Kafka Cluster.

April 23, 2020

Usage-based billing with commits
Usage-based billing with commits is now available for customers on the Azure Marketplace. You can now commit a spend, get a discount, and transact through the Azure Marketplace to get started with Confluent Cloud. For more information, see Get Started with Confluent Cloud on the Azure Marketplace with Commitments.
Support for Protocol Buffers and JSON Schema in Confluent Cloud
Support for Protocol Buffers and JSON Schema has been added in Schema Registry and throughout Confluent Cloud, including ksqlDB, Kafka Streams and Kafka Clients. For more information, see Avro, JSON, and Protobuf Supported Formats and Extensibility.
Confluent Cloud CLI General Availability

The Confluent Cloud CLI has been promoted to general availability with features that now enable use in a scripted environment:

  • Machine readable JSON or YAML output through the -o flag on commands with return values.
  • Long-lived authentication through ccloud login --save.

For more information, see Confluent Cloud command reference.

Fully-managed Confluent Cloud Google Cloud Spanner Sink Preview
This feature is launched for your Kafka clusters in Google Cloud. For more information, see Google Cloud Spanner Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Google Cloud Dataproc Sink Preview
This feature is launched for your Kafka clusters in Google Cloud. For more information, see Google Cloud Dataproc Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Azure Event Hubs Source Preview
This feature is launched for your Kafka clusters in Amazon Web Services, Google Cloud, and Microsoft Azure. For more information, see Azure Event Hubs Source Connector for Confluent Cloud.
Fully-managed Confluent Cloud Azure Data Lake Storage Gen2 Sink Preview
This feature is launched for your Kafka clusters in Microsoft Azure. For more information, see Azure Data Lake Storage Gen2 Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud Amazon Redshift Sink Preview
This feature is launched for your Kafka clusters in Amazon Web Services. For more information, see Amazon Redshift Sink Connector for Confluent Cloud.

April 6, 2020

Confluent Cloud Cluster Tiers: Basic, Standard, Dedicated

Confluent Cloud now offers three cluster tiers: Basic, Standard, and Dedicated.

  • Basic clusters are billed for ingress, egress, and storage.
  • Standard clusters are billed an hourly base price of $1.50 USD per hour, in addition to usage-based charges.
  • Dedicated clusters are available for customers with annual commitments, which you can purchase from Confluent. Existing standard clusters will remain unchanged through March 31, 2021, after which any existing single-zone clusters will be migrated to basic, and multi-zone clusters will be migrated to standard.

For more information, see Kafka Cluster Types in Confluent Cloud.

Annual Commitment Users Can Provision Dedicated Clusters
Customers with annual commitments on usage-based billing plans can now provision new dedicated clusters with internet endpoints through the Confluent Cloud Console. For more information, see Kafka Cluster Types in Confluent Cloud.
Confluent Cloud ksqlDB Production Availability
Confluent Cloud ksqlDB is now production available for all users on usage-based billing plans.

March 31, 2020

Confluent Cloud Metrics API GA
The Confluent Cloud Metrics API is now GA with new metrics for connection counts and request rates. It is enabled for all newly provisioned clusters and is rolling out to existing clusters in AWS, Google Cloud, and Azure at this time. For more information, see Confluent Cloud Metrics.
Confluent Cloud Azure Blob Storage Sink GA
Fully-managed Confluent Cloud Azure Blob Storage Sink is now GA. For more information, see Azure Blob Storage Sink Connector for Confluent Cloud.

February 18, 2020

Consumption-based Self-serve Confluent Cloud on the Azure Marketplace
With this release, you can now find consumption-based self-serve Confluent Cloud offering on the Azure Marketplace. You can sign up to use Confluent Cloud by utilizing your Azure spend. For more information, see Get Started with Confluent Cloud on the Azure Marketplace with Pay As You Go and the blog post.

January 24, 2020

Fully-managed Confluent Cloud Oracle Database Source Preview
This feature is launched for your Apache Kafka® clusters in Amazon Web Services, Google Cloud, and Microsoft Azure. For more information, see Oracle Database Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Microsoft SQL Server Source Preview
This feature is launched for your Kafka clusters in AWS, Google Cloud, and Azure. For more information, see Microsoft SQL Server Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Google Cloud Pub/Sub Source Preview
This feature is launched for your Kafka clusters in AWS, Google Cloud, and Azure. For more information, see Google Cloud Pub/Sub Source Connector for Confluent Cloud.

January 2, 2020

Fully-managed Confluent Cloud GCS Connector (Sink) GA
For more information, see Google Cloud Storage Sink Connector for Confluent Cloud.

2019 Releases

December 20, 2019

SAML/SSO Production Availability
  • This feature enables customers to utilize their Identity provider to centrally manage user login information.
  • This feature supports all the Identity Providers with SAML 2.0 including: Okta, Ping, OneLogin, Microsoft Active Directory
  • This feature is available on AWS, Google Cloud, and Azure.
  • For more information, see the documentation.
Confluent Cloud Metrics API Preview
This feature is available for Apache Kafka® clusters in AWS, Google Cloud, and Azure. For more information, see Confluent Cloud Metrics.

December 12, 2019

Fully-managed Confluent Cloud PostgreSQL Source Preview
This feature is launched for your Apache Kafka® clusters in AWS, Google Cloud, and Azure. For more information, see PostgreSQL Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud MySQL Source Preview
This feature is launched for your Kafka clusters in AWS, Google Cloud, and Azure. For more information, see MySQL Source (JDBC) Connector for Confluent Cloud.
Fully-managed Confluent Cloud Kinesis Source Preview
This feature is launched for your Kafka clusters in AWS. For more information, see Amazon Kinesis Source Connector for Confluent Cloud.
Other improvements
  • The Kafka cluster ID is now shown in the Cluster Settings page. This makes it easier for you to connect clients to your clusters.
  • The Clients tab in CLI & Client Configuration page now shows client configurations for 12 different clients, with links to example code for each type of client.

November 15, 2019

Fully-managed Confluent Cloud Google BigQuery Connector (Sink) Preview
For more information, see Google Cloud BigQuery Sink (Legacy) Connector for Confluent Cloud.
Connector improvements
Support plan update
  • Support plan downgrades now have certain restrictions in place. When you purchase a support plan, you will retain the support plan and be charged for it for the current and potentially next billing cycle. For more information, see Support
  • A Confluent Community self-serve offering is now available from the Google Cloud (Google Cloud) marketplace. Google Cloud customers can now use their Google Cloud committed expenditure for Confluent Cloud standard clusters. See the GCP marketplace offering for details.

October 31, 2019

Higher availability with multi-zone clusters

You can now choose between single or multiple availability zones when creating new Confluent Cloud clusters. If you select multiple availability zones, data in the cluster will be spread across multiple cloud availability zones. This provides higher availability in the case of a zonal outage. Prices may differ between single and multiple availability zone configurations. For more details about cloud provider availability zones:

Use all UI features with VPC-peered clusters
You can now use the Confluent Cloud Console for ksqlDB stream processing, topic management, and consumer lag monitoring on VPC peered clusters. You must configure your network to route and proxy the necessary requests between the UI and your cluster. For more details about setting this up, see Networking in Confluent Cloud.
Fully-managed Confluent Cloud Azure Blob Storage Connector (Sink) Preview
Fully-managed Confluent Cloud Azure Blob Storage Connector (Sink) available in Preview. For more information, see Azure Blob Storage Sink Connector for Confluent Cloud.
Use Confluent Cloud in more regions

Confluent Cloud is now available in:

  • Azure useast2 (Virginia)
  • Google Cloud asia-southeast1 (Singapore)

September 27, 2019

Confluent Cloud Schema Registry General Availability
Now available on Microsoft Azure and in multiple geographical regions (US, Europe, and APAC).

August 30, 2019

Microsoft Azure General Availability

Confluent Cloud is now generally available on Microsoft Azure in:

  • Azure southeastasia (Singapore)
  • Azure westus2 (Washington)
  • Azure westeurope (Netherlands)
Fully-managed Confluent Cloud S3 Connector (Sink) Production Availability.
For more information, see Amazon S3 Sink Connector for Confluent Cloud.
Fully-managed Confluent Cloud GCS Connector (Sink) Preview
For more information, see Google Cloud Storage Sink Connector for Confluent Cloud.
Use Confluent Cloud in more regions

Confluent Cloud is now available in:

  • AWS ap-northeast-1 (Tokyo)
  • AWS ap-south-1 (Mumbai)
  • AWS ap-southeast-1 (Singapore)
  • Google Cloud asia-northeast1 (Tokyo)
  • Google Cloud asia-southeast1 (Singapore)
  • Google Cloud europe-west4 (Netherlands)

August 16, 2019

Support
You can now purchase support for Confluent Cloud through the global menu in the web interface. For plan details and pricing, see Confluent Cloud Support.
Service Level Agreement (SLA)
With this release, the SLA for Confluent Cloud is updated. An uptime SLA is now available for new clusters created in some regions; the SLA is displayed in the cluster creation and cluster details UI if it is available. See Confluent Cloud SLA for details.
Schema Registry
Confluent Cloud Schema Registry is now generally available on Google Cloud (GCP) and in multiple geographical regions (US, Europe, and APAC). To get started, see Quick Start for Schema Management on Confluent Cloud.

August 1, 2019

VPC peering to multiple customer VPCs
You can now peer one Dedicated cluster with up to five VPCs within the same region and cloud provider. This lets you connect applications across multiple networks using Confluent Cloud.
AWS Transit Gateway
You can now link a Dedicated cluster running in AWS to an AWS Transit Gateway. Transit Gateway allows transitive routing and supports a variety of AWS networking services, which makes it possible to connect clients in many networks, both in the cloud and on-premises, to Confluent Cloud.

June 25, 2019

Apache Kafka® 2.3 released.
All Confluent Cloud clusters have been automatically upgraded. For more information, see https://www.apache.org/dist/kafka/2.3.0/RELEASE_NOTES.html.

May 29, 2019

CLI update
The Confluent Cloud CLI now supports ACLs and service accounts.

May 13, 2019

Capacity increase
All Confluent Cloud self-serve clusters can now support peak throughput up to 100 MBps write and 100 MBps read, and can store up to 5 TB of data.
ksqlDB Preview
Fully managed KSQL is available in Preview.

May 7, 2019

S3 Connector Preview
Fully managed AWS S3 Sink Connector is available in Preview.

May 1, 2019

Consumption-based pricing
Confluent Cloud now offers consumption-based pricing.
Name change
Confluent Cloud Professional is now simply called Confluent Cloud. For more information, see https://www.confluent.io/blog/introducing-cloud-native-experience-for-apache-kafka-in-confluent-cloud.

April 5, 2019

Schema edit UI
View and edit schemas in the Topic Management UI.

March 26, 2019

Apache Kafka® 2.2 released.
All Confluent Cloud clusters have been automatically upgraded. For more information, see https://www.apache.org/dist/kafka/2.2.0/RELEASE_NOTES.html.

March 13, 2019

Schema Registry Preview
Schema Registry is now available in Preview.

February 27, 2019

Topic management UI
You can now see the actual topics, configurations, and events on your cluster from the Cloud Console interface. For details, see Manage Topics in Confluent Cloud.
Consumer lag
You can now see how your consumer groups are managing with the traffic on your cluster from the Cloud Console interface. For details, see Monitor Kafka Consumer Lag in Confluent Cloud.

Important

These features are not yet available for customers using VPC peering.

January 22, 2019

UI navigation update
The UI has been updated to show you more information with fewer clicks, and to logically group common actions. Many administrative actions and support links are always available by clicking on your name in the upper-right corner. These options were previously available in the navigation bar and in the cluster management UI. The Quick Start for Confluent Cloud and related documentation is updated to reflect these changes.
Environment overview
Now you can see provisioned capacity and usage data for all your clusters on the new Environment Overview page. Usage data was previously available in a dedicated Activity page for each cluster.
Parameter changes
In the past, Confluent Cloud allowed users to configure a wide range of topic level configuration parameters. However, some of these parameters aren’t necessary when using a fully managed service. Confluent Cloud now ignores these parameters. Existing users should see no change, as it has been verified that these parameters were never used in practice. For consistency, some configuration parameters in the describe topics/configuration APIs are now read-only.