Confluent Platform Component Changelogs

This topic provides changelogs for the individual Confluent Platform components.

Version 7.2.9

Released December 2023

Community Features

Common

  • e99d8b1a - exclude logback-core and logback-classic in line with the changes in kafka-rest
  • eb200670 - update zookeeper component to match version in ce-kafka
  • 0c034e86 - re-add dependencymanagement sections for old bouncycastle to satisfy downstream validation
  • 33734c5f - add additional version definition to ease the update of the downstream repos
  • 8e71caf2 - update bouncycastle

Kafka

  • 7c7cb939 - CONFLUENT: Bump ZK version to 3.8.3 for 7.2.x
  • PR-14497 - HOTIFX: fix Kafka versions for system tests (#14497)

REST Proxy

  • PR-1230 - KREST-12372 Upgrade dependency to JDK 1.8 with version 1.77
  • PR-1221 - KREST-12630 Exclude logback from zookeeper dependency in tests
  • PR-1219 - KREST-12630 Add missing dependency due to zookeeper upgrade
  • PR-1212 - KREST-12277 semaphore migration to release branches
  • PR-440 - KREST-11812 upgrade jaxb-api dependency
  • ee8dd479 - KREST-12364: update bcpix
  • PR-427 - KRES-12288 migration semaphore release branches

Schema Registry

  • 98a1a4de - update swagger core
  • PR-2888 - Apply service bot changes to version branches
  • bafbad8c - DGS-9343 Allow removing enum in JSON Schema to be backward compatible
  • PR-2874 - DGS-9048: Semaphore Migration of Version Branches
  • 899b38a2 - migrate to semaphore
  • 7f7a7ab1 - add metrics-core to fix the build
  • d3b1912d - upgrade com.squareup.okio:okio to 3.4.0
  • c8ab3fd0 - Add log if encoding fails
  • d81d5a53 - Encode subject names for Maven download plugin
  • PR-2820 - Cache ProtobufSchema.toDynamicSchema calls (#2818)
  • PR-2816 - DGS-8960 Fix handling of diamond structure in Protobuf converter

Version 7.2.8

Released October 2023

Community Features

Common

  • 35a1415d - APPSEC-3039: Update jetty and netty
  • 81295738 - update snappy to 1.10.5
  • aea31af8 - APPSEC-2796: add guava to dependencyManagement

Kafka

  • PR-971 - KSECURITY-2013: Upgraded Jetty to 9.4.53.v20231009 and Netty to 4.1.100.Final
  • PR-959 - KAFKA-15498: bump snappy-java version to 1.1.10.5 (#14434)

Schema Registry

  • PR-2790 - DGS-8088 Get the mode in scope rather that just for the subject

Version 7.2.7

Released September 2023

Community Features

Common

  • 59440c88 - APPSEC-2855: add generation of SBOMs to maven based Java projects
  • 27a3c1ca - APPSEC-2796: update guava

Kafka

  • PR-940 - KSECURITY-1789: upgrading requests to v2.31.0 (3.2)
  • PR-933 - KSECURITY-1859: updating netty to 4.1.96 (3.2)
  • PR-14082 - KAFKA-15102: Add replication.policy.internal.topic.separator.enabled property to MirrorMaker 2 (KIP-949) (#14082)

ksqlDB

  • PR-10065 - fix: import not picked back in fix
  • d3f0e149 - fix: fix compile error introduced by merge conflict resolution

REST Proxy

Schema Registry

  • PR-2734 - DGS-8112 Allow properties to be omitted during serialization
  • 3f0e1198 - DGS-7927: update io.grpc_grpc-protobuf
  • PR-2695 - do not reinstantiate objectmapper as it’s expensive (#2686)

Version 7.2.6

Released June 2023

Community Features

Common

  • PR-530 - Backport log redactor to CP patches.
  • bd393b16 - AUDIT-1600: Updating logredactor version to 1.0.12
  • 22a9da57 - APPSEC-2551: Update Prometheus JMX Exporter
  • 5ad03d12 - APPSEC-2551: Update Jackson
  • PR-514 - Update snakeyaml
  • b4334b94 - pin jose4j version to match ce-kafka
  • 95ed5124 - include snappy and jetty in the dependency management to match versions with ce-kafka, cleanup jackson imports

Kafka

  • PR-13602 - KAFKA-14869: Bump coordinator value records to flexible versions (KIP-915, Part-2) (#13526) (#13602)
  • PR-13598 - KAFKA-14869: Ignore unknown record types for coordinators (KIP-915, Part-1) (#13598)
  • d6285927 - KAFKA-14887: FinalizedFeatureChangeListener should not shut down when ZK session expires
  • PR-13499 - KAFKA-14880; TransactionMetadata with producer epoch -1 should be expirable (#13499)
  • PR-13445 - KAFKA-14843: Include Connect framework properties when retrieving connector config definitions (#13445)
  • PR-13148 - KAFKA-14645: Use plugin classloader when retrieving connector plugin config definitions (#13148)
  • PR-13386 - KAFKA-14809 Fix logging conditional on WorkerSourceTask (#13386)
  • PR-13273 - KAFKA-14731: Upgrade ZooKeeper to 3.6.4 (#13273)
  • PR-913 - KSECURITY-1627 KSECURITY-1556 KSECURITY-1568: update snappy, jetty, jose

ksqlDB

  • PR-9810 - Bump minimist and mkdirp
  • 4ce2d5f3 - fix: Replace regex in CommandParser with a split by space
  • cc0501d8 - fix: Simplify regex in DdlDmlRequestValidators to avoid catastrophic backtracking
  • aefe6338 - Fix log4j-extensions
  • 08853cd3 - Fix log4j-extensions

REST Proxy

  • ab17aa29 - Fix the overzealous conflict resolution
  • 5be3406e - KREST-9942: Remove SnakeYaml from dependency management
  • a54dde7e - CNC-366: Update Jetty
  • PR-389 - Cherry pick KREST-1553 for duplicate log fix
  • PR-385 - Backport KREST-8335 to branch 7.2.x

Schema Registry

  • 0f13c16e - fix checkstyle
  • 20526ee5 - solve conflicts
  • e0626f64 - Update the test to make it clear to customer
  • dc6f2096 - update the doc
  • 33659feb - Update schema-serializer/src/main/java/io/confluent/kafka/serializers/AbstractKafkaSchemaSerDeConfig.java
  • 3ffd8fc7 - Update schema-serializer/src/main/java/io/confluent/kafka/serializers/AbstractKafkaSchemaSerDeConfig.java
  • 1ca2a39d - Update the codes with checking string for http connect timeout
  • ffba37fe - * changed the config names
  • 4c383ee4 - Apply suggestions from code review
  • 7155f0fb - * checkstyle error
  • 7e2dec9c - * removing unused import
  • 9ab1b0ec - * adding defaults
  • 01c6d7a7 - * Made SR client http connect and read timeout configurable.
  • 89aa28be - * Made SR client http connect and read timeout configurable.
  • PR-2654 - DGS-7432 Fix ClassCastException when getting params option
  • 18d69e07 - Fix merge issue
  • PR-2647 - DGS-7422 Optimization: omit compat check during IMPORT
  • PR-2642 - DGS-7367 Propagate error messages even if not JSON
  • PR-2616 - DGS-7005 Convert socket timeouts to RetriableException for converters
  • f45fe28e - DGS-6698: Remove SnakeYaml from the dependencyManagement
  • PR-2602 - DGS-6929 Ignore invalid Avro defaults for source connectors
  • PR-2590 - DGS-6701 Fix getSchemaById to match subject if passed
  • ed4ec914 - DGS-6698: Remove SnakeYaml from the dependencyManagement
  • PR-2589 - DGS-6613 Ignore invalid Avro defaults in Avro Converter
  • PR-2588 - DGS-6603 Fix default conversions in JsonSchemaConverter
  • PR-2693 - DGS-7746 Fix perf regression due to DGS-6331
  • PR-2684 - DGS-7675 Fix NPE when print.schema.ids=true
  • 1bf961b7 - Update json-schema

Commercial Features

Confluent Server

  • KSECURITY-1568: Upgrading jose4j
  • KGLOBAL-2035: Unblock local follower fetch requests when records are appended to mirror leader logs
  • KDATA-737: Fix incorrectly exposed ccloud only configs on documentation
  • KSECURITY-1556: updated jetty version
  • KAFKA-14887: FinalizedFeatureChangeListener should not shut down when
  • KDATA-853: Upgrading dependencies
  • KSECURITY-1460, KSECURITY-1466: Updated snakeyaml, json-smart and nim
  • KSECURITY-1459: updated golang.org/x/net mod.
  • KSECURITY-1455: updated golang.org/x/text mod.
  • KSECURITY-1453: Updated version of golang.org/x/sys
  • KSECURITY-1462: Disabled colocated KRaft mode test.
  • KSTORAGE-2447: Disable ULE on tier topic, if tier topic already exists
  • KGLOBAL-3350 Add more logging for persistent connection creation in Outbound connection manager
  • KSECURITY-1627: Updated snappy-java
  • KSECURITY-1618: update guava version to 32.0.1-jre.
  • KAFKA-14887: FinalizedFeatureChangeListener should not shut down when ZK session expires

Security

  • CIAM-2998 - Log redactor backport for confluent-security-plugins
  • KREST-10128 Create LicenseManager instance in iteration run instead o

Secret Registry

  • unpin netty, as rest-utils brings updated version

Control Center

  • [MMA-13078] revisit session caching in basic auth
  • [MMA-13013] Add property to specify alias cert per component for Schema Registry, KSQL & Connect
  • [MMA-13089] Handle large message JSON on topic inspection
  • [MMA-13042] Fixing log statement for websocket time out
  • [MMA-13216] update jose4j
  • [MMA-13201] Csrf Enabled Flag not working

MQTT Proxy

  • CC-19108 | Rename isChannelClosed to isAuthenticated.
  • CC-19108 | Use an atomic reference to avoid publishing message when the channel is closed or marked for closure.

Metadata Service

  • CIAM-2936: update jose4j
  • Update pom.xml
  • CIAM-2986 - Older MDS builds are not running all the tests they should be
  • another attempt with mina-core
  • pin mina core in cli, scope mina-core as test in main pom
  • pin mina-core in testingLdap only
  • SEC-xyz: Update mina-core

Replicator

  • disable builds of connect-replicator version 5.5.x
  • used spotbugs version variable instead
  • use spotbugs annotations instead of findbugs
  • resolving compile issue
  • KGLOBAL-3224 removed find bugs usage
  • remove aws-maven plugin to unblock the downstream validation for common: RCCA-10412, APPSEC-2551

Version 7.2.5

Released March 2023

Community Features

Common

  • PR-512 - add snakeyaml to dependency management
  • 7bcaab9e - Fix typo in with method calls
  • 3868e27b - Fix typo
  • 783c5721 - Return the original “version_range” if it isn’t an actual Maven version range
  • e71293e4 - Update logredactor depdendency to 1.0.11
  • PR-502 - fix: override maven version plugin’s default versionrange
  • 9350d231 - Update resolver-maven-plugin to 0.6.0
  • PR-497 - Upgrade Netty to 4.1.86.Final
  • PR-496 - Bump to 7.4.4

Kafka

  • PR-13245 - KAFKA-14704; Follower should truncate before incrementing high watermark (#13245)
  • PR-872 - KC-2332: Upgrade netty to 4.1.86
  • PR-857 - CONFLUENT: Fix filter for not publishing streams upgrade test artifacts
  • PR-853 - CONFLUENT: Skip publishing for kafka-streams-upgrade-system-tests
  • PR-13000 - KAFKA-14496: Wrong Base64 encoder used by OIDC OAuthBearerLoginCallbackHandler (#13000)
  • PR-12935 - KAFKA-14432: RocksDBStore relies on finalizers to not leak memory (#12935)
  • PR-12909 - KAFKA-14422; Consumer rebalance stuck after new static member joins a group with members not supporting static members (#12909)
  • PR-12869 - KAFKA-14382: wait for current rebalance to complete before triggering followup (#12869)
  • PR-12809 - [KAFKA-14324] Upgrade RocksDB to 7.1.2 (#12809)
  • PR-12794 - Revert “KAFKA-13891: reset generation when syncgroup failed with REBALANCE_IN_PROGRESS (#12140)” (#12794)
  • PR-12140 - KAFKA-13891: reset generation when syncgroup failed with REBALANCE_IN_PROGRESS (#12140)
  • 50029d3e - Bump version to 3.2.3

ksqlDB

  • PR-9821 - fix: migrations tool without basic auth works again
  • PR-9818 - fix: default to get authHeader if using basic
  • PR-9770 - Upgrade netty to 4.1.86 #2
  • PR-9717 - fix: change password-based configs to Type.PASSWORD

REST Proxy

  • 69ed0cd9 - Remove incorrect synchronization
  • PR-1108 - Set kafka-schema-registry version in dependency mamanagement
  • 7a7f5dcd - Remove unnecessary ${project.version} tag
  • PR-1102 - Fix transitive dependency of kafka-schema-registry
  • PR-1101 - Fix dependency org.yaml_snakeyaml, upgrade to fixed

Schema Registry

  • PR-2577 - DGS-6373 Ignore leading dot when merging Protobuf custom options
  • PR-2575 - DGS-6331 Handle javaType for oneOfs during JSON deserialization
  • PR-2568 - DGS-6306 Allow multiple oneofs in Protobuf converter
  • PR-2550 - DGS-6192 Include default ctx when using subjectPrefix w/wildcard ctx
  • PR-2540 - DGS-6075 : Add explicit definition of snakeyaml.
  • PR-2519 - DGS-6014 cherry pick Maven plugin enhancement to 5.5.x
  • PR-2514 - DGS-5950: Allow optional map key in Avro
  • PR-2474 - Fix handling of Protobuf repeated options
  • PR-2471 - Preserve metadata associated with primitive types during normalization
  • PR-2468 - DGS-5567 Handle Protobuf map options in toCanonicalString()

Commercial Features

Confluent Server

  • Backport “Minor: add logging to inLock / inWriteLock to catch leaked locks (#8594)” to 7.2.x
  • KMETA-478 Enable zk audit logs by default
  • fix version comparison in kafkatests (#8922)
  • KAFKA-14731: Upgrade ZooKeeper to 3.6.4 (#13273)
  • KSECURITY-1005: [7.2.x] Enforce kafka-client-plugins consumers to use the same snakeyaml version
  • cherrypick KAFKA-14417: Address incompatible error code returned by broker from`InitProducerId`
  • KSECURITY-897: Make expiration timeout for ZK ACL change notification path configurable
  • KENGINE-287: RPCProducerIdManager should not wait on new block
  • KC-2328: Update yaml.v2 to 2.2.4
  • KSECURITY-953: Update azure-identity to 1.7.3
  • KSECURITY-965: Update git version 1.13.0
  • KSECURITY-981: Add FeatureZNode zk node path to secure root paths
  • KC-2333: Update io.netty libraries to 4.1.86.Final
  • CPKAFKA-3875: Support reading I/O metrics from /proc/self/io
  • KSTORAGE-82: Tiered storage topic deletion support
  • MINOR: disable use of ConfluentLeaderAndIsrRequest in 5.4.x
  • [KENGINE-314]: Fix a NPE when FetchSession close.
  • KAFKA-9038: [WIP] Allow creating partitions for topics partitions not in reassignment
  • CONFLUENT: Use single audit log provider for MDS and its hosting broker
  • CPKAFKA-3830: Include observer information in MetadataResponse
  • Bump version to 3.2.3

Security

  • Removed From Supported Operations to follow RBAC Rules
  • Added fix for unit test
  • Fixed import
  • Changed the design of RBAC for Exporters
  • Removed extra line changes
  • Added RBAC for Schema linking Phase 1
  • Remove logging statement
  • SEC-5350: Update netty-codec-http to 4.1.86.Final

Secret Registry

  • Remove unused variables
  • Update RestService.java

Control Center

  • Update docker image tag for integration-test
  • Use docker image tag 7.1.6
  • Increase wait start time for control center in test
  • Make sure control center stop properly
  • Change PORT to avoid conflict with TelemetryReporterIntegrationTest
  • Change to make this compatible with 6.2.x
  • KC-2261 timeout websocket connection via jwt token
  • Update CODEOWNERS to match latest definition from master
  • MMA-13013: Override SSL Stores priority
  • Refactoring- made code more functional and improved readability.
  • Updated NotFoundException message in scenario where topicName provided returns 0 no consumergroupdata.
  • Updated code based on PR feedback.
  • Updated consumerGroupId API to also support topicName queryParam.
  • Improving test cases with scenarios of single consumergroup covering multiple topics. 2. updated consumerGroupId to not support topicName queryParam, it is not required.
  • Adding unit test for CachedConsumerOffsetsResource
  • Adding support for topicName in query param to return only consumer groups for that topic
  • Pin bc-fips version correctly
  • [MMA-12439] Update Websocket configuration for Control-Center if BasePath supplied
  • reading password using getPassword instead of getString, this fixes the casting exception
  • Adding a config to force armeria health check to use HTTP1
  • Fixing failing test case, due to merge issue
  • Fixing check style error, removing unused import
  • renaming Health_check to health check
  • MMA-12911: Propagate numPartitions and replication factor from CreateTopicsResult
  • MMA-12912: Disable offset commits, don’t supply group ID
  • adding config based functionality to force http1 for armeria health checks
  • MINOR: Update repo to use mvn-wrapper to speed up builds
  • [MMA-12804] Re-enable failing tests in SslUtilsTest
  • Fix codeowners to make c3 default ownens as well
  • Cherry pick 7746 codewoner

MQTT Proxy

  • Remove the pin of netty version to use the (current) version defined in common

Metadata Service

  • Clean testng
  • [Fix build] Drop down to testNG 7.5 - which is the last version to support jdk8
  • Adapt 7.1.x to testNg 7
  • Clean up surefire
  • CIAM-2615 - Bump TestNG to 7.7.0
  • Fix notnull in 7.1.x
  • Fix NotNull import
  • Squashed ‘mk-include/’ content from commit 7df56b0fff
  • Revert “Merge remote-tracking branch ‘origin/7.1.x’ into 7.2.x”
  • Squashed ‘mk-include/’ content from commit 7df56b0fff
  • CIAM-2579: update pgsql
  • CIAM-2570: Backport CIAM-2183 fix to 7.2.x
  • CIAM-2577: Turned off test RbacExtractorMetricsTest
  • Increase buffer size for Proxy Servlet

Replicator

  • Fixed deprecated method usage
  • Changed to 5 sec to honor TASK_SHUTDOWN_GRACEFUL_TIMEOUT_MS_CONFIG
  • Changed default to 120 sec to match topic config sync
  • KGLOBAL-3060 added consumer poll timeout ms property

Version 7.2.4

Released February 2023

Commercial Features

Security

  • Security Fixes
  • Removed bcfips from common
  • Pin bouncycastle fips dependency in confluent-security-plugins
  • Exclude bcpkix-jdk15on as compile dep and add as test dependency

Secret Registry

  • Exclude Non-FIPS dep and use bc-fips dependency

Version 7.2.3

Released December 2022

Community Features

Common

  • PR-492 - APIF-3112: Upgrade jmx_prometheus_javaagent to 0.17.2.
  • f5764727 - Merge conflict resolution.
  • PR-489 - APIF-3117: Upgrade scala to 2.13.10.
  • PR-485 - APIF-2957: Upgrade Jackson and Protobuf versions.

Kafka

  • PR-845 - CONFLUENT: Skip publishing for projects with no scala suffix when the scala version is not the default
  • PR-842 - DP-9030: Use the new withGradleFile closure
  • PR-831 - KSECURITY-792: Upgrade from Scala 2.13.8 to 2.13.10
  • PR-817 - KSECURITY-788: Upgrade jackson-databind version to 2.13.4.2
  • 110bc014 - Merged remote trancking branch into 3.2-sync-upstream-4-nov-2022
  • PR-801 - KAFKA-13778: Fetch from follower should never run the preferred read replica selection (3.2)

ksqlDB

  • PR-9713 - Bump netty tcnative version to 2.0.54.Final
  • PR-9708 - APIF-3117: Unpin scala version.
  • PR-9697 - APIF-3122: Unpin Protobuf version.

REST Proxy

  • PR-1072 - KREST-7107 Shouldn’t provide overly detailed info or stack traces in responses -

Schema Registry

  • PR-2460 - DGS-5544 Support nulls when using optional fields in proto2
  • PR-2459 - DGS-5400 Support subjectPrefix containing wildcard context and subject
  • PR-2450 - Pin Snakeyaml version
  • PR-2443 - DGS-5423 Check subject when looking up ID across contexts
  • PR-2440 - Update the Snakeyaml dependency
  • 8e5ce168 - Unpin Protobuf version.
  • PR-2414 - DGS-5253 Handle cycles when resolving references
  • PR-2405 - DGS-4754 Handle empty record default at field level
  • PR-2399 - DGS-5084 Ignore compat check in IMPORT mode
  • PR-2395 - DGS-4971 Handle map types with enhanced.protobuf.schema.support

Commercial Features

Confluent Server

  • CONFLUENT: Skip publishing for projects with no scala suffix when the scala version is not the default
  • DP-9030 - Switch to codeartifact repo
  • Increase vagrant aws timeout for system test
  • BouncyCastle Issue fix for Connect service [7.2.x]
  • KSECURITY-792: Upgrade from Scala 2.13.8 to 2.13.10
  • CPKAFKA-3723: Message changes to add observer tagged field
  • KSECURITY-788: Upgrade jackson-databind version to 2.13.4.2
  • Merged remote trancking branch into 3.2-sync-upstream-4-nov-2022
  • KSECURITY-789: Upgrade to snakeyaml version 1.32
  • CIAM-2424 - Name RestClient threads for stackdump identification (#7887)
  • KSECURITY-794: Upgrade to protobuf version 3.19.6
  • KSTORAGE-2249: update MergedLog.read to throw NotLeaderOrFollowerExce
  • KGLOBAL-1812: Fix thread leak in cluster linking test. (#7188)
  • MINOR. Remove call to java static interface method in scala
  • CIAM-2304: Add SecurityMetadata:Describe to SecurityAdmin
  • RCCA-8564: log a warning if LDAP login fails becuase of network issues
  • CIAM-2290: Upgrade bc fips drivers

Security

  • Exclude bcpkix-jdk15on as compile dep and add as test dependency
  • Pin bc-nonfips dep as a test dependency
  • Pin bouncycastle fips dependency in confluent-security-plugins
  • Removed bcfips from common
  • excluded bcfips jars
  • AUTHN-1087: Explicit define netty versions in kafka-rest plugin
  • AUTHN-1087: [7.0.x only] Enforce Netty versions in kafka-rest plugin
  • AUTHN-1087: Upgrade vertx to 3.9.14
  • AUTHN-1087: Upgrade vertx to 3.9.14
  • AUTHN-1087: Upgrade vertx to 3.9.14
  • AUTHN-1087: Upgrade vertx to 3.9.14
  • AUTHN-1087: Upgrade vertx to 3.9.14
  • AUTHN-1087: Upgrade vertx to 3.9.14
  • AUTHN-1325: Update bc-fips version to 1.0.2.3
  • fixed checkstyle error
  • Requesting permission only for Subject Read operation instead of any of the subject operation in case of GET /schemas

Secret Registry

  • Exclude Non-FIPS dep and use bc-fips dependency

Control Center

  • RCCA-7746: CCloud RBAC user unable to view messages from UI
  • MMA-9023: memory bounding for streams applications [5.4.x, master]
  • Revert “MMA-12206 upgrade io.netty:netty-codec-http”

MQTT Proxy

  • Fixing the tests and config validator, to incorporate new changes in validation of MqttDecoder brought in by netty upgrade
  • Upgrading netty

Metadata Service

  • APIF-3122: Unpin protobuf version.
  • MMA-12624 Fix testng dependencies
  • CIAM-2392 Bump PSQL Version
  • Remove spaces
  • Add back newline
  • Implement writeTransactionMarkers in DelegateConfluentAdmin
  • CIAM-2304: Add unit tests for SecurityAdmin

Replicator

  • KGLOBAL-2436: Don’t seek to beginning on pause for schema translator
  • REPL-2055-: Log WakeupException at debug level
  • RCCA-7678: Reverse proxy header check added

Version 7.2.2

Released August 2022

Community Features

Common

  • aeca780b - Update Jolokia version in pom.xml
  • PR-472 - Upgrade Netty to 4.1.79.Final
  • PR-468 - Fix dependency in disk-usage-agent [6.2 and 7.0]
  • PR-464 - :Migrate from confluent-log4j to reload4j [5.4.x – 7.0.x]
  • PR-465 - Confluent log4j to reload4j [7.1.x Only]
  • PR-467 - Upgrade JUNIT in 5.4.x only

Kafka

  • a9b49f40 - Remove unused import
  • PR-12626 - KAFKA-14208; Do not raise wakeup in consumer during asynchronous offset commits (#12626)
  • PR-12603 - KAFKA-14196; Do not continue fetching partitions awaiting auto-commit prior to revocation (#12603)
  • d695a90f - Bump version to 3.2.2
  • PR-12376 - Upgrade Netty and Jackson versions[KAFKA-14044] (#12376)
  • PR-12584 - KAFKA-14194: Fix NPE in Cluster.nodeIfOnline (#12584)
  • PR-12063 - KAFKA-13835: Fix two bugs related to dynamic broker configs in KRaft (#12063)
  • PR-12440 - KAFKA-14107: Upgrade Jetty version (#12440)
  • PR-12483 - KAFKA-14136 Generate ConfigRecord for brokers even if the value is unchanged (#12483)
  • PR-12455 - KAFKA-14111 Fix sensitive dynamic broker configs in KRaft (#12455)
  • b172a0a9 - Bump version to 3.2.1
  • PR-12417 - KAFKA-13917: Avoid calling lookupCoordinator() in tight loop (#12417)
  • PR-12349 - KAFKA-14024: Consumer keeps Commit offset in onJoinPrepare in Cooperative rebalance (#12349)
  • PR-12421 - Revert “KAFKA-12887 Skip some RuntimeExceptions from exception handler (#11228)” (#12421)
  • PR-12412 - KAFKA-14079 - Ack failed records in WorkerSourceTask when error tolerance is ALL (#12412)
  • PR-12405 - KAFKA-13572 Fix negative preferred replica imbalanced count metric (#12405)
  • PR-12398 - KAFKA-14062: OAuth client token refresh fails with SASL extensions (#12398)
  • PR-12388 - KAFKA-14013: Limit the length of the reason field sent on the wire (#12388)
  • PR-12390 - KAFKA-14055; Txn markers should not be removed by matching records in the offset map (#12390)
  • PR-12381 - KAFKA-13474: Allow reconfiguration of SSL certs for broker to controller connection (#12381)
  • PR-12371 - KAFKA-14035; Fix NPE in SnapshottableHashTable::mergeFrom() (#12371)
  • PR-12362 - KAFKA-14010: AlterPartition request won’t retry when receiving retriable error (#12362)
  • PR-12298 - KAFKA-13998: JoinGroupRequestData ‘reason’ can be too large (#12298)
  • PR-12136 - KAFKA-13773: catch kafkaStorageException to avoid broker shutdown directly (#12136)
  • PR-12106 - KAFKA-13861; Fix the validateOnly behavior for CreatePartitions requests in KRaft mode (#12106)
  • 38103ffa - Bump version to 3.2.0
  • PR-794 - Upgrade Jetty to 9.4.48.v20220622
  • PR-774 - migrating log4j12 to reload4j, slf4j-log4j12 to slf4j-reload4j.jar (3.2)
  • 3bf3480d - upgrading netty to v4.1.79.Final (3.2) #755

ksqlDB

  • PR-9337 - bugfix: remove log4j from the classpath (#9334)
  • PR-9334 - bugfix: remove log4j from the classpath

REST Proxy

  • PR-1049 - APIF-2714: Migrate from confluent-log4j to slf4j-reload4j.
  • PR-1047 - Migrate from confluent-log4j to slf4j-reload4j.
  • PR-1044 - APIF-2768: Workaround for “Failed to bind to 0.0.0.0/0.0.0.0:9998” error.
  • PR-350 - Cherry-pick https://github.com/confluentinc/rest-utils/pull/349 to 5.4.x
  • 3d1250af - APIF-2739: Upgrade Jetty to 9.4.48.v20220622.
  • d93674fb - Do not create a new sensor for error count
  • 88556559 - Set sensors to be expired in 1 hr
  • ff3595a0 - DGS-4220: fix request tag based metrics
  • PR-320 - APIF-2714: Switch from confluent-log4j to reload4j (5.4.x)
  • PR-329 - APIF-2705: Update jersey version to 2.36.

Schema Registry

  • PR-2381 - Adding timer in onJoinPrepare
  • PR-2376 - DGS-4768 Fix reserved ranges for Protobuf enums
  • 2fd5e6e9 - Remove deprecated methods in SchemaRegistryMetric
  • PR-2359 - DGS-4395 Fix message indexes of normalized Protobuf with map
  • PR-2351 - DGS-4358 Fix NPE in Protobuf converter for null map value
  • 0577dffb - Add comments
  • 042d3e3c - DGS-4303: Support different stat types in SchemaRegistryMetric
  • PR-2346 - Optimize sync call
  • PR-2345 - Add leader change listeners
  • PR-2342 - APIF-2714: Migrate from confluent-log4j to slf4j-reload4j.
  • PR-2339 - APIF-2714: Migrate from confluent-log4j to slf4j-reload4j.
  • PR-2336 - DGS-4249 Fix name resolution during Protobuf normalization

Commercial Features

Confluent Server

  • KAFKA-13861; Fix the validateOnly behavior for CreatePartitions requests in KRaft mode (#12106)
  • KAFKA-13778: Fetch from follower should never run the preferred read replica selection (7.2.x)
  • cherry-pick KGLOBAL-2127:72723ca0606d24a3894b58d4fad3eace9b0a07a0 to 7.2.x
  • Remove unused import
  • KENGINE-212: batch transaction requests.
  • KENGINE-211: Add a metric to record the avg latency for a transaction to transit from PreCommit to Commit.
  • Bump version to 3.2.2
  • Don’t include Server info as an HTTP response header in the Connect REST API (#7264)
  • KGLOBAL-1803 reset lastCaughtupTime when mirror leader appends to its log
  • Update log level in RestClient
  • MINOR: Follower delayed fetch request should not be recorded for consumer fetch lag
  • Add Telemetry MetricsReporter Http Exporter stats
  • upgrading netty to v4.1.79.Final (3.2) #755
  • Bump version to 3.2.1
  • MINOR. Remove keyword args and use positional argument
  • Bump version to 3.2.0
  • Add direct dependency on com.squareup.okhttp3.okhttp 4.9.3
  • KAFKA-14107: Upgrade Jetty version.
  • Migrating log4j12 to reload4j, slf4j-log4j12 to slf4j-reload4j.jar (7.2.x) #7066
  • Avoid sending partial updates during LDAP group manager startup
  • Fix exception handling in RBAC writer coordinator (#6576)
  • Upgrading google-cloud-storage to v2.6.1 (7.2.x)
  • Upgrading netty version to 4.1.79.Final (backport 7.2.x)
  • Upgrading aws-java-sdk-s3 to v1.12.268 (7.2.x)
  • Cherry pick KAFKA-13474 on master to 7.2.x
  • KGLOBAL-1724: Wrong source topic name in DescribeMirrorsResponse. (#6

Security

  • add auth token provider to ksql security extensions
  • revert pom
  • add auth token provider to ksql security extensions
  • AUTHN-1085: Fix NPE in debug log
  • APIF-2714: Migrate from confluent-log4j to slf4j-reload4j.

Secret Registry

  • Migrate from log4j to reload4j for connect-plugin
  • CC-17641,CC-17644 Bump jetty version
  • APIF-2714: Migrate from confluent-log4j to slf4j-reload4j.

Control Center

  • MMA-12388: Upgrade okhttp
  • MMA-12201 Fix the mistake in resolving merge conflict
  • MMA-12201 remove slf4j from transitive deps
  • MMA-12206 upgrade transitive dependency of netty
  • MMA-11617: allow for trailing slash in path
  • MMA-12206 upgrade io.netty:netty-codec-http
  • MMA-12201 Exclude slf4j in transitive dependency
  • MMA-8781: Respect SR Config and handle nulls in CachingSchemaRegistryClientSupplier
  • MMA-12201: Use reload4j version properties from common
  • MMA-12201 Add logredactor [7.1.x]
  • MMA-8781: Respect SR Config and handle nulls in CachingSchemaRegistryClientSupplier
  • MMA-12201 Replace log4j with reload-4j
  • MMA-12127: Change type from String to Password for CONTROL_CENTER_EMAIL_PASSWORD

MQTT Proxy

  • CC-17620: remove dependency on slf4j-log4j12 and confluent-log4j

Metadata Service

  • Remove unnecessary dep on noop logger
  • fix pass
  • CIAM-2097 DB Password config should be password type
  • CIAM-2164 - Migrate from confluent-log4j to reload4j for MDS

Replicator

  • KGLOBAL-2126 seek to begining only for non empty partitions list
  • Add log redactor.
  • Migrate confluent-log4j to reload4j.

Version 7.2.1

Released July 2022

Community Features

ksqlDB

  • PR-9260 - fix: Excludes Guava from Guava-retrying in order to manage Guava depe
  • 617df451 - merge conflicts
  • 4ef7a1df - merge conflicts

Schema Registry

  • PR-2331 - DGS-4172 Bound size of Avro datumReader/Writer caches
  • PR-2329 - DGS-4163 Pass topic to schema formatters
  • PR-2328 - DGS-4162 Handle refs at different levels in Protobuf converter
  • c4c0b7f7 - Fix merge issue
  • PR-2327 - DGS-1648 Allow Protobuf msg fullname to be passed for console producer

Commercial Features

Confluent Server

  • AUTHN-739: Oauth token refresh causes kafka client authentication to fail

Version 7.2.0

Released May 2022

Community Features

Common

  • Upgrading gson
  • PR-456 - DGS-3674 Upgrade gson to 2.8.6
  • PR-451 - Remove confluent-log4j
  • PR-450 - Add reload4j definition
  • PR-446 - Upgrade jackson related packages
  • 6170c767 - Upgrade maven-surefire-plugin version to 3.0.0-M6
  • 5a8b2e2c - Change back powermock 2.0.9 due to manual merge
  • PR-445 - Unify protocol buffer version.
  • PR-436 - deprecate common-metrics
  • PR-393 - chore: update mockito to last available 3.x version
  • PR-425 - chore: update spotbugs to 4.5.3
  • PR-429 - import junit-bom to align junit dependencies, update to 3.8.2
  • PR-400 - Bump confluent-log4j to 1.2.17-cp6
  • PR-396 - Bump confluent-log4j version 1.2.17-cp5
  • PR-394 - Add Support to Split Up Integration Tests for Junit5
  • PR-385 - Bump junit 4 version to latest version (4.13.2)

Kafka

  • PR-710 - KSECURITY-220: Update jackson packages to 2.13.2
  • PR-12096 - KAFKA-13794: Fix comparator of inflightBatchesBySequence in TransactionsManager (round 3) (#12096)
  • PR-12064 - KAFKA-12841: Remove an additional call of onAcknowledgement (#12064)
  • PR-12055 - [MINOR] Update upgrade documentation for 3.2 (#12055)
  • PR-12018 - KAFKA-13542: Add rebalance reason in Kafka Streams (#12018)
  • PR-12043 - KAFKA-13828; Ensure reasons sent by the consumer are small (#12043)
  • PR-11948 - KAFKA-10405: Set purge interval explicitly in PurgeRepartitionTopicIntegrationTest (#11948)
  • PR-11939 - KAFKA-13761: KafkaLog4jAppender deadlocks when idempotence is enabled (#11939)
  • PR-12006 - KAFKA-13794: Follow up to fix producer batch comparator (#12006)
  • PR-11995 - KAFKA-13782; Ensure correct partition added to txn after abort on full batch (#11995)
  • PR-11991 - KAFKA-13794; Fix comparator of inflightBatchesBySequence in TransactionManager (#11991)
  • baf8976f - Add muckrake mapping for 7.2 release
  • PR-11928 - fix: make sliding window works without grace period (#kafka-13739) (#11928)
  • PR-11953 - KAFKA-13772: Partitions are not correctly re-partitioned when the fetcher thread pool is resized (#11953)
  • PR-11971 - KAFKA-13783; Remove reason prefixing in JoinGroupRequest and LeaveGroupRequest (#11971)
  • f96b0211 - Revert “KAFKA-13598: enable idempotence producer by default and validate the configs (#11691)”
  • 63b76b81 - Revert “:KAFKA-13673: disable idempotence when config conflicts (#11788)”
  • PR-11908 - KAFKA-13748: Do not include file stream connectors in Connect’s CLASSPATH and plugin.path by default (#11908)
  • PR-11743 - KAFKA-13660: Switch log4j12 to reload4j (#11743)
  • PR-11962 - KAFKA-13775: Upgrade jackson-databind to 2.12.6.1 (#11962)
  • PR-11967 - Upgrade RocksDB from 6.27.3 to 6.29.4.1 (#11967)
  • PR-11869 - KAFKA-13719: Fix connector restart cause duplicate tasks (#11869)
  • PR-11966 - KAFKA-13418: Support key updates with TLS 1.3 (#11966)
  • PR-11923 - KAFKA-6718: Add documentation for KIP-708 (#11923)
  • PR-11942 - KAFKA-13767; Fetch from consumers should return immediately when preferred read replica is defined by the leader (#11942)
  • PR-11760 - KAFKA-13600: Kafka Streams - Fall back to most caught up client if no caught up clients exist (#11760)
  • PR-11946 - KAFKA-13770: Restore compatibility with KafkaBasedLog using older Kafka brokers (#11946)
  • PR-11920 - KAFKA-13672: Race condition in DynamicBrokerConfig (#11920)
  • PR-11926 - KAFKA-13714: Fix cache flush position (#11926)
  • PR-11933 - KAFKA-13759: Disable idempotence by default in producers instantiated by Connect (#11933)
  • PR-11932 - Revert “KAFKA-7077: Use default producer settings in Connect Worker (#11475)” (#11932)
  • PR-11912 - KAFKA-13752: Uuid compare using equals in java (#11912)
  • PR-686 - KAFKA-6502: Update consumed offsets on corrupted records. (#11683)
  • PR-11898 - KAFKA-7540: commit offset sync before close (#11898)
  • PR-11879 - KAFKA-13728: fix PushHttpMetricsReporter no longer pushes metrics when network failure is recovered. (#11879)
  • PR-11893 - KAFKA-13682; KRaft Controller auto preferred leader election (#11893)
  • PR-11733 - KAFKA-13587; Implement leader recovery for KIP-704 (#11733)
  • PR-11903 - KAFKA-13497: Add trace logging to RegexRouter (#11903)
  • PR-11909 - KAFKA-13750; Client Compatability KafkaTest uses invalid idempotency configs (#11909)
  • PR-11173 - KAFKA-13509; Support max timestamp in GetOffsetShell (KIP-815) (#11173)
  • PR-11705 - KAFKA-9847: add config to set default store type (KIP-591) (#11705)
  • PR-11837 - KAFKA-6718 / Add rack awareness configurations to StreamsConfig (#11837)
  • PR-11901 - Don’t generate Uuid with a leading “-” (#11901)
  • PR-11897 - Polish Javadoc for EpochState (#11897)
  • PR-11610 - KAFKA-13549: Add repartition.purge.interval.ms (#11610)
  • PR-11891 - KAFKA-13727; Preserve txn markers after partial segment cleaning (#11891)
  • PR-11875 - KAFKA-13721: asymetric join-winodws should not emit spurious left/outer join results (#11875)
  • PR-11475 - KAFKA-7077: Use default producer settings in Connect Worker (#11475)
  • PR-11877 - KAKFA-13699: new ProcessorContext is missing methods (#11877)
  • PR-11817 - KAFKA-13438: Replace EasyMock and PowerMock with Mockito in WorkerTest (#11817)
  • PR-11802 - KIP-825: Part 1, add new RocksDBTimeOrderedWindowStore (#11802)
  • PR-10802 - KAFKA-6718: Update SubscriptionInfoData with clientTags (#10802)
  • PR-11873 - Revert “KAFKA-13542: add rebalance reason in Kafka Streams (#11804)” (#11873)
  • PR-11863 - KAFKA-13689: Revert AbstractConfig code changes (#11863)
  • PR-11864 - KAFKA-13717: skip coordinator lookup in commitOffsetsAsync if offsets is empty (#11864)
  • PR-11867 - KAFKA-12648: fix #getMinThreadVersion and include IOException + topologyName in StreamsException when topology dir cleanup fails (#11867)
  • PR-11872 - KAFKA-12879: Remove extra sleep (#11872)
  • PR-11871 - KAFKA-12879: Addendum to reduce flakiness of tests (#11871)
  • PR-11797 - KAFKA-12879: Revert changes from KAFKA-12339 and instead add retry capability to KafkaBasedLog (#11797)
  • PR-11722 - KAFKA-13630: Reduce amount of time that producer network thread holds batch queue lock (#11722)
  • PR-674 - KAFKA-12648: fix bug where thread is re-added to TopologyMetadata whe
  • PR-11857 - KAFKA-12648: fix bug where thread is re-added to TopologyMetadata when shutting down (#11857)
  • PR-11853 - KAFKA-13710: bring the InvalidTimestampException back for record error (#11853)
  • PR-11847 - KAFKA-12648: fix NPE due to race condtion between resetting offsets and removing a topology (#11847)
  • PR-11833 - KAFKA-13671: Add ppc64le build stage (#11833)
  • PR-11493 - KAFKA-12959: Distribute standby and active tasks across threads to better balance load between threads (#11493)
  • PR-11800 - KAFKA-13689: printing unused and unknown logs separately (#11800)
  • PR-11830 - KAFKA-13694: Log more specific information when the verification record fails on brokers. (#11830)
  • PR-11813 - KAFKA-12648: fix #add/removeNamedTopology blocking behavior when app is in CREATED (#11813)
  • PR-11839 - KAFKA-13706: Remove closed connections from MockSelector.ready (#11839)
  • PR-11517 - KAFKA-13466: delete unused config batch.size in kafka-console-producer.sh (#11517)
  • PR-11788 - :KAFKA-13673: disable idempotence when config conflicts (#11788)
  • PR-11691 - KAFKA-13598: enable idempotence producer by default and validate the configs (#11691)
  • PR-11572 - KAFKA-13510: Connect APIs to list all connector plugins and retrieve their configs (#11572)
  • PR-11777 - KAFKA-10000: Add producer fencing API to admin client (KIP-618) (#11777)
  • PR-10851 - KAFKA-6718 / Rack aware standby task assignor (#10851)
  • PR-11812 - KAFKA-12738: address minor followup and consolidate integration tests of PR #11787 (#11812)
  • PR-7082 - KAFKA-8659: fix SetSchemaMetadata failing on null value and schema (#7082)
  • PR-11804 - KAFKA-13542: add rebalance reason in Kafka Streams (#11804)
  • PR-11807 - KAFKA-13698; KRaft authorizer should use host address instead of name (#11807)
  • PR-11810 - KAFKA-13281: allow #removeNamedTopology while in the CREATED state (#11810)
  • PR-11808 - KAFKA-13281: add API to expose current NamedTopology set (#11808)
  • 8b12f346 - add getBrokerListStrFromServers() as a deprecated method to fix downstream validation
  • PR-11806 - KAFKA-13697; KRaft authorizer should support AclOperation.ALL (#11806)
  • PR-11801 - KAFKA-12738: send LeaveGroup request when thread dies to optimize replacement time (#11801)
  • PR-11787 - KAFKA-12738: track processing errors and implement constant-time task backoff (#11787)
  • PR-11499 - KAFKA-10199: Add interface for state updater (#11499)
  • PR-11774 - KAFKA-10000: Utils methods for overriding user-supplied properties and dealing with Enum types (#11774)
  • PR-11772 - KAFKA-10000: Add new metrics for source task transactions (#11772)
  • PR-11791 - KAFKA-13676: Commit successfully processed tasks on error (#11791)
  • PR-11575 - KAFKA-13511: Add support for different unix precisions in TimestampConverter SMT (#11575)
  • PR-11752 - KAFKA-13666 Don’t Only ignore test exceptions for windows OS for certain tests. (#11752)
  • PR-11753 - Add license header in suppressions.xml (#11753)
  • PR-11770 - KAFKA-13669; Demote empty offset commit messages for source tasks to DEBUG level (#11770)
  • PR-11750 - KAFKA-12648: avoid modifying state until NamedTopology has passed validation (#11750)
  • PR-11688 - KAFKA-13435; Static membership protocol should let the leader skip assignment (KIP-814) (#11688)
  • PR-11534 - KAFKA-12939: After migrating processors, search the codebase for missed migrations (#11534)
  • PR-11745 - KAFKA-13661; Consistent permissions in KRaft for CreatePartitions API (#11745)
  • PR-11674 - KAFKA-13577: Replace easymock with mockito in kafka:core - part 3 (#11674)
  • PR-11333 - KAFKA-13306: Null connector config value passes validation, but fails creation (#11333)
  • PR-11558 - KAFKA-13323; Fixed variable name in KafkaConsumer (#11558)
  • PR-11655 - KAFKA-13316; Enable KRaft mode in CreateTopics tests (#11655)
  • PR-11742 - KAFKA-13636: Fix for the group coordinator issue where the offsets are deleted for unstable groups (#11742)
  • PR-11673 - KAFKA-13577: Replace easymock with mockito in kafka:core - part 2 (#11673)
  • PR-11649 - KAFKA-13646; Implement KIP-801: KRaft authorizer (#11649)
  • PR-11672 - KAFKA-13577: Replace easymock with mockito in kafka:core - part 1 (#11672)
  • 7c7282f0 - KC-1802: Workaround for init script issue affecting Gradle 7.1 and newer
  • PR-11340 - KAFKA-13310 : KafkaConsumer cannot jump out of the poll method, and the… (#11340)
  • PR-10525 - KAFKA-7572: Producer should not send requests with negative partition id (#10525)
  • PR-11631 - KAFKA-13563: clear FindCoordinatorFuture for non consumer group mode (#11631)
  • PR-11721 - KAFKA-13629: Use faster algorithm for ByteUtils sizeOfXxx algorithm (#11721)
  • PR-11726 - KAFKA-13637: Use default.api.timeout.ms as default timeout value for KafkaConsumer.endOffsets (#11726)
  • PR-11689 - KAFKA-12841: Fix producer callback handling when partition is missing (#11689)
  • PR-11656 - KAFKA-13579: Patch upgrade of netty/jetty/jackson (#11656)
  • PR-11725 - KAFKA-13221; Implement PartitionsWithLateTransactionsCount metric (#11725)
  • PR-11618 - KAFKA-13558: NioEchoServer fails to close resources (#11618)
  • PR-11717 - KAFKA-13619: Remove zookeeper.sync.time.ms (#11717)
  • PR-11690 - KAFKA-13599: Upgrade RocksDB to 6.27.3 (#11690)
  • 67cf1876 - Revert “KAFKA-13152: Replace “buffered.records.per.partition” with “input.buffer.max.bytes” (#11424)”
  • PR-11695 - KAFKA-13595: Allow producing records with null fields in ConsoleProducer (#11695)
  • PR-11599 - KAFKA-13527: Add top-level error code field to DescribeLogDirsResponse (#11599)
  • PR-11424 - KAFKA-13152: Replace “buffered.records.per.partition” with “input.buffer.max.bytes” (#11424)
  • PR-11455 - KAFKA-13423: GlobalThread should not log ERROR on clean shutdown (#11455)
  • PR-11345 - KAFKA-13603: Allow the empty active segment to have missing offset index during recovery (#11345)
  • PR-11382 - KAFKA-13348: Allow Source Tasks to Handle Producer Exceptions (KIP-779) (#11382)
  • PR-11676 - KAFKA-13605: checkpoint position in state stores (#11676)
  • PR-11714 - KAFKA-13614: Don’t apply leader replication quota to consumer fetches (#11714)
  • PR-11715 - KAFKA-13618: Fix typo in BatchAccumulator (#11715)
  • PR-652 - KC-1933; Upgrade confluent-log4j to 1.2.17-cp8
  • PR-651 - KC-1933; Upgrade confluent-log4j to 1.2.17-cp8
  • PR-11682 - KAFKA-13524: Add IQv2 query handling to the caching layer (#11682)
  • PR-11508 - KAFKA-9279: Fail producer transactions for asynchronously-reported, synchronously-encountered ApiExceptions (#11508)
  • PR-11686 - KAFKA-12648: invoke exception handler for MissingSourceTopicException with named topologies (#11686)
  • PR-11609 - KAFKA-12648: fixes for query APIs with named topologies (#11609)
  • PR-11704 - KAFKA-13590:rename InternalTopologyBuilder#topicGroups (#11704)
  • PR-11657 - KAFKA-13552: Fix BROKER and BROKER_LOGGER in KRaft (#11657)
  • PR-11671 - KAFKA-13388; Kafka Producer nodes stuck in CHECKING_API_VERSIONS (#11671)
  • PR-11683 - KAFKA-6502: Update consumed offsets on corrupted records. (#11683)
  • PR-11452 - KAFKA-13412; Ensure initTransactions() safe for retry after timeout (#11452)
  • PR-11456 - KAFKA-13351: Add possibility to write kafka headers in Kafka Console Producer (KIP-798) (#11456)
  • PR-11600 - KAFKA-12648: handle MissingSourceTopicException for named topologies (#11600)
  • PR-11571 - KAFKA-13496: Add reason to LeaveGroupRequest (KIP-800) (#11571)
  • PR-11566 - KAFKA-13495: Add reason to JoinGroupRequest (KIP-800) (#11566)
  • PR-11560 - KAFKA-7589: Allow configuring network threads per listener (#11560)
  • PR-11664 - KAFKA-13582: TestVerifiableProducer.test_multiple_kraft_security_protocols fails (#11664)
  • PR-11593 - KAFKA-13528: KRaft RegisterBroker should validate that the cluster ID matches (#11593)
  • PR-11535 - KAFKA-13476: Increase resilience timestamp decoding Kafka Streams (#11535)
  • PR-11650 - KAFKA-13553: Add PAPI Window and Session store tests for IQv2 (#11650)
  • PR-11624 - KAFKA-13553: add PAPI KV store tests for IQv2 (#11624)
  • PR-11460 - KAFKA-13425: Optimization of KafkaConsumer#pause semantics (#11460)
  • PR-11567 - KAFKA-13494: WindowKeyQuery and WindowRangeQuery (#11567)
  • PR-11607 - KAFKA-13544: fix FinalizedFeatureChangeListener deadlock (#11607)
  • PR-11617 - KAFKA-13557: Remove swapResult from the public API (#11617)
  • PR-11582 - KAFKA-13525: Implement KeyQuery in Streams IQv2 (#11582)
  • PR-11408 - KAFKA-13374: Update doc to mention read from leader/followers (#11408)
  • PR-11605 - replace lastOption with exists (#11605)
  • PR-11451 - KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error (#11451)
  • PR-11598 - KAFKA-13479: Implement range and scan queries (#11598)
  • PR-11552 - KAFKA-13488: Producer fails to recover if topic gets deleted midway (#11552)
  • PR-11597 - KAFKA-13539: Improve propagation and processing of SSL handshake failures (#11597)
  • PR-11581 - KAFKA-13522: add position tracking and bounding to IQv2 (#11581)
  • PR-11591 - KAFKA-12648: fix IllegalStateException in ClientState after removing topologies (#11591)
  • PR-11503 - KAFKA-13456; Tighten KRaft listener config checks/constraints (#11503)
  • PR-11577 - KAFKA-13515: Fix KRaft config validation issues (#11577)
  • f05a1797 - KAFKA-13512: Avoid duplicating maps in ZkMetadataCache topic accessors
  • PR-11573 - KAFKA-13507: GlobalProcessor ignores user specified names (#11573)
  • PR-11450 - KAFKA-13414: Replace Powermock/EasyMock by Mockito in connect.storage (#11450)
  • PR-11562 - KAFKA-12648: extend IQ APIs to work with named topologies (#11562)
  • PR-11046 - KAFKA-12980; Return empty record batch from Consumer::poll when position advances due to aborted transactions (#11046)
  • e1449994 - KAFKA-13512: Avoid duplicating maps in ZkMetadataCache topic accessors
  • PR-11513 - KAFKA-13506: Write and restore position to/from changelog (#11513)
  • PR-11496 - KAFKA-13454: Avoid duplicate config logging at startup (#11496)
  • f068a791 - KAFKA-13490: Fix createTopics and incrementalAlterConfigs for KRaft mode #11416
  • a957748d - KAFKA-13490: Fix createTopics and incrementalAlterConfigs for KRaft mode #11416
  • PR-11479 - KAFKA-12648: Make changing the named topologies have a blocking option (#11479)
  • PR-11557 - KAFKA-13491: IQv2 framework (#11557)
  • PR-11563 - KAFKA-13461: Don’t re-initialize ZK client session after auth failure if connection still alive (#11563)
  • PR-11541 - KAFKA-13498: track position in remaining state stores (#11541)
  • PR-11529 - KAFKA-12932: Interfaces for SnapshotReader and SnapshotWriter (#11529)
  • PR-11524 - KAFKA-13469: Block for in-flight record delivery before end-of-life source task offset commit (#11524)
  • PR-11526 - KAFKA-13472: Correct last-committed offsets tracking for sink tasks after partial revocation (#11526)
  • PR-11212 - KAFKA-13200: Fix MirrorMaker2 connector version (#11212)
  • PR-11538 - KAFKA-10712; Update release scripts to Python3 (#11538)
  • PR-11514 - KAFKA-13480: Track Position in KeyValue stores (#11514)
  • e8b53caa - KAFKA-13357; Store producer IDs in broker snapshots
  • PR-11431 - KAFKA-13397: MirrorMaker should not mirror topics ending with .internal (#11431)
  • PR-11504 - KAFKA-13457: SocketChannel in Acceptor#accept is not closed upon IOException (#11504)
  • PR-11481 - KAFKA-13117: migrate TupleForwarder and CacheFlushListener to new Record API (#11481)
  • PR-11500 - KAFKA-13455: Add steps to run Kafka Connect to quickstart (#11500)
  • PR-11422 - KAFKA-9648: Add configuration to adjust listen backlog size for Acceptor (KIP-764) (#11422)
  • PR-11459 - KAFKA-13394: Topic IDs should be removed from PartitionFetchState if they are no longer sent by the controller (#11459)
  • 237dede9 - test
  • 6d0e0828 - test
  • PR-11490 - KAFKA-13439: Deprecate eager rebalance protocol in kafka stream (#11490)
  • PR-11004 - KAFKA-12257; Consumer mishandles topics deleted and recreated with the same name (#11004)
  • PR-11484 - KAFKA-13443: Kafka broker exits when OAuth enabled and certain configuration not specified (#11484)
  • PR-11486 - KAFKA-13444: Fix OAuthCompatibilityTool help and add SSL options (#11486)
  • PR-11502 - KAFKA-13071; Deprecate support for changing acls through the authorizer (#11502)
  • PR-11498 - Add recordMetadata() to StateStoreContext (#11498)
  • 3c2dab10 - Revert “MINOR: Remove redundant argument from TaskMetricsGroup#recordCommit (#9642)”
  • 9ea9f0f8 - Revert “MINOR: Remove redundant argument from TaskMetricsGroup#recordCommit (#9642)”
  • PR-11505 - KAFKA-13449: Comment optimization for parameter log.cleaner.delete.retention.ms (#11505)
  • PR-11439 - KAFKA-13406: skip assignment validation for built-in cooperativeStickyAssignor (#11439)
  • PR-11487 - KAFKA-13445: Add ECDSA test for JWT validation (#11487)
  • PR-11448 - KAFKA-13417; Ensure dynamic reconfigurations set old config properly (#11448)
  • PR-11323 - KAFKA-12226: Commit source task offsets without blocking on batch delivery (#11323)
  • PR-11483 - KAFKA-13441: Fix typo in upgrade.html (#11483)
  • PR-11401 - KAFKA-13255: Use config.properties.exclude when mirroring topics (#11401)
  • PR-11489 - KAFKA-13446: Remove JWT access token from logs (#11489)
  • PR-11331 - KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs (#11331)
  • PR-11485 - KAFKA-13421; Reenable testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup (#11485)
  • PR-11415 - KAFKA-13429: ignore bin on new modules (#11415)
  • PR-11272 - KAFKA-12648: introduce TopologyConfig and TaskConfig for topology-level overrides (#11272)
  • PR-10563 - KAFKA-12487: Add support for cooperative consumer protocol with sink connectors (#10563)
  • PR-11412 - KAFKA-10543: Convert KTable joins to new PAPI (#11412)
  • PR-11429 - KAFKA-13396: Allow create topic without partition/replicaFactor (#11429)
  • PR-11463 - KAFKA-13430: Remove broker-wide quota properties from the documentation (#11463)
  • PR-11368 - KAFKA-13261: Add support for custom partitioners in foreign key joins (#11368)
  • PR-10678 - TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc (#10678)
  • PR-11441 - KAFKA-8941: Add RocksDB Metrics that Could not be Added due to RocksD… (#11441)

ksqlDB

  • PR-9065 - Switch from confluent-log4j to reload4j
  • PR-9047 - fix: INSERT/VALUES on a stream with SCHEMA_ID/SCHEMA_FULL_NAME fails
  • PR-9038 - fix: INSERT fails when serializing Proto/Avro nested Structs
  • PR-9041 - build: exclude reload4j
  • PR-8933 - fix: Create stream fails when multiple Protobuf schema definitions exist
  • PR-8984 - fix: INSERT VALUES fail when SR schema has a non-default name
  • PR-9028 - fix: remove double quotes from json_records function
  • PR-8918 - fix: Guard null struct dereferencing inside function calls
  • PR-8947 - revert: consistency APIs
  • PR-8967 - fix: preserve old schema behavior for protobuf wrapped primitives (7.1.x)
  • PR-8968 - fix: preserve old schema behavior for protobuf wrapped primitives (7.0.x)
  • PR-8934 - fix: preserve old schema behavior for protobuf wrapped primitives
  • PR-8924 - feat: Support MIN/MAX udafs for Time/TS/Date types
  • PR-8935 - feat: clean up extra runtimes so the assignment is more focused
  • PR-8785 - feat: add java client support for push query v2 ALOS through continue method
  • PR-8845 - feat: Add support for Stream-Stream and Table-Table right join
  • PR-8936 - fix: clean up state when restarting runtimes to avoid errors
  • PR-8932 - fix: only make shared runtime that is chosen
  • PR-8920 - feat: add physical plan stubs for new query planner
  • PR-8776 - fix: Apply the ExtensionSecurityManager to UDAFs
  • PR-8901 - Support JDKs 11 & 17
  • PR-8876 - fix: resolve schema registry issue for pull query
  • PR-8909 - fix: re-oder cache usage error
  • PR-8868 - feat: add support for simple column name projection to new query planner
  • PR-8728 - fix: Fix bugs in sample standard deviation UDAF
  • PR-8902 - fix: empty to add future list
  • PR-8898 - fix: make sure topologies are done added before removing
  • PR-8892 - fix: CLI should return non-zero error code on failure
  • PR-8877 - feat: Generalize the UDAFs collect_list and collect_set
  • PR-8889 - fix: decrease default number of shared runtimes
  • PR-8862 - feat: add stubs for new query planner
  • PR-8871 - feat: Extend Udaf interface to allow for polymorphic UDAFs.
  • PR-8869 - fix: do not include schema id in session config
  • PR-8866 - build: pull from docker internal for onprem image
  • PR-8819 - fix: use blocking call and throw exception on failure
  • PR-8849 - fix: Ensures response end handler is invoked just once
  • PR-8857 - fix: clean up mistaken topic names
  • PR-8855 - fix(ksql): allow migrations tool to run connector commands with IF [NOT] EXISTS clauses
  • PR-8851 - fix(ksql): add ifExists/ifNotExist parameters to java client connector functions
  • PR-8850 - fix: Adds error handling for nested functions
  • PR-8844 - feat: allow users to specify custom migrations dir location
  • PR-8813 - Enable consistency mode by default
  • PR-8809 - feat: add rate-limiting to ksql command topic
  • PR-8779 - feat: add cleanup service metrics
  • PR-8765 - coerce property values to correct type
  • PR-8815 - feat: add consistency levels to clients
  • PR-8811 - fix: add copious amounts of logging to improve visibility into Gen 2 query’s runtimes
  • PR-8803 - fix: restore process fails due to DROP constraints
  • PR-8802 - fix: update restore command topic tool to work with command topic configs
  • PR-8742 - feat: create command topic with command topic configs
  • PR-8673 - feat: Use bounds in pull query
  • PR-8787 - feat: support custom request headers from java client and migrations tool
  • PR-8789 - fix: check for the queryId in the Task ID for registering saturation metric
  • PR-8782 - build: add staging s3 url for dependency jars
  • PR-8777 - fix: spotbugs warnings with Java 11
  • PR-8775 - fix: pass DCN_NULLPOINTER_EXCEPTION spotbugs error
  • PR-8769 - fix: always close validation runtimes even on an exception
  • PR-8761 - fix: reinstate the old KsqlRestClient.create overload
  • PR-8694 - feat: cleanup transient query resources
  • PR-8764 - fix: change conflicting metrics name that leads to infinite loop
  • PR-8755 - fix: various fixes for tracking shared runtime queries in validation
  • PR-8566 - fix: make writes to the backup file atomic
  • PR-8740 - fix: prevent hanging stream pull queries on truncated topics
  • PR-8739 - build: remove release related files from ksql
  • PR-8726 - fix: Add null handling to functions
  • PR-8612 - fix: Gives a query completed message for stream pull queries
  • PR-8734 - DOC fix: replaced old schema registry config with bootstrap servers
  • PR-8720 - fix: bug preventing decimals in (-1, 1) from being inserted / queried
  • PR-8722 - fix: only check configs on validation
  • PR-8713 - fix: when a isolated query is restarted then it should stay isolated
  • PR-8718 - feat: include checking the the config during validation of SET
  • PR-8711 - feat: allow for only Gen 1 create or replace queries with server level configs via rest api, bars all gen 2 queries
  • PR-8716 - fix: reorder imports
  • PR-8717 - fix: skip docker build for packaging
  • PR-8715 - fix: logging improvement
  • PR-8685 - fix: fix create connector config handling for name config
  • PR-8684 - feat: new CLI params to provide credentials for cloud connector management
  • PR-8614 - fix: register schema within sandbox
  • PR-8617 - feat: Return position from streams to client as consistency vector
  • PR-8710 - build: add docker plugin for release stabilization
  • PR-8704 - fix: recreating old queries in the old runtime will still use the old runtimes
  • PR-8671 - feat: remove old runtimes
  • PR-8692 - build: use pinned cp-base-new image
  • PR-8675 - fix: use topology-specific IQ APIs
  • PR-8670 - fix: error message for named topologies is different
  • PR-8668 - fix: keep shared runtime dirs even if no query has state
  • PR-8636 - docs: add missing environment variable in event-driven-microservice tutorial
  • PR-8667 - fix: don’t throw on drop
  • PR-8640 - fix: clean up custom prefixed internal topics
  • PR-8632 - feat: Add json_records, to_json_string, and json_concat UDFs
  • PR-8660 - fix: remove usages of internal Streams API/variable that was removed upstream
  • PR-8625 - fix: make tutorial work
  • PR-8644 - build: Update Git Commit Id plugin
  • PR-8603 - feat: add json_keys UDF
  • PR-8602 - feat: Add json_array_length UDF
  • PR-8635 - feat: allow custom connect auth header configuration
  • PR-8600 - feat: Add is_json_string UDF
  • PR-8597 - fix: pull queries are supported on source streams now.
  • PR-8607 - feat: uses internal topics prefix for shared runtimes
  • 6c3320c6 - Revert “fix: back out post-3.1 changes to fix 7.1.x build (#8599)”
  • PR-8514 - fix: Streams overrides bugfix
  • PR-8590 - feat: Change API to return Position from Streams
  • PR-8593 - fix: Fixes an NPE which was causing terminate to fail
  • PR-8539 - fix: typo in TimestampExtractionPolicyFactory
  • PR-8565 - feat: [UIF-1113] Add weighting to search results based on domain
  • PR-8555 - Using IQv2 API for pull queries on window stores
  • PR-8570 - refactor: small IQv2 cleanup
  • PR-8553 - feat: add support for connect specific https configs
  • PR-8556 - feat: Use IQv2 when executing range and table scan pull queries
  • PR-8563 - feat: un-synchronize PullQueryQueue row queuing when limit absent
  • PR-8567 - fix: Make JaasPrincipal public
  • PR-8551 - fix: SandboxKafkaTopicClient should use default replication factor if applicable
  • PR-8559 - fix: Fix DROP STREAM IF EXISTS DELETE TOPIC
  • PR-8549 - feat: add max task usage and num stateful tasks metrics
  • PR-8547 - fix: variable substitution with CREATE CONNECTOR in migrations tool
  • PR-8544 - fix: make adding to pull query queue threadsafe
  • PR-8542 - fix: Allow disabling Scalable Push Query ALOS to be set via config

REST Proxy

  • PR-1021 - KREST-6139 Deflake produce rate limiter test
  • b22efb66 - Patch gson to be 2.9.0
  • PR-1016 - KREST-5096 Fix NPE in Topics Resource when no key, or no value specified
  • 938cbdd6 - Fix log4j
  • PR-942 - Fix(#341): Remove deadlock when rebalancing by multiple consumer instances
  • PR-997 - KREST-4979 reverse order of produce global rate limiters
  • PR-994 - KEXP-280 new manager method to submit multiple ACLs for creation
  • PR-974 - Move ProducerMetrics to resources/v3.
  • PR-993 - KREST-3323 add global rate limiter for produce
  • PR-981 - KREST-4608 unflake consumergroup tests
  • PR-979 - KREST-4605 Deflake all the tests that extend AbstractConsumerTest
  • PR-977 - KREST-4577 Fix Metadata API Test
  • PR-972 - KREST-4466 Run tests individually and repeatedly
  • PR-973 - KREST-4356 Optimize CompletionExceptions when rate-limiting
  • PR-941 - Make ProduceRequest.getOriginalSize() non-optional.
  • PR-961 - KREST-3322 Remove grace period and swap out custom rate limiter
  • PR-964 - KREST-3660 Move to Junit5
  • PR-960 - KREST-3537: Fix HTTP 500 errors in Produce V3.
  • PR-955 - KREST-3636 all repos need a codeowners file - kafka-rest-eng set
  • PR-311 - APIF-2427: Switch from confluent-log4j to reload4j
  • PR-308 - KREST-3446 ensure there is always a minimum value for the thread pool queue
  • PR-309 - KREST-4958 Update codeowners to also include kafka-rest
  • PR-299 - KREST-3636 all repos need a codeowners file
  • PR-306 - KREST-3660 Remove junit 4 dependencies that come in via jersey test
  • 05fbf52e - MMA-11468: Add option to enable nosniff protection
  • PR-303 - KREST-3660-Junit5-ify rest-utils
  • PR-300 - TRIVIAL: Change the Maven repository protocol: http → https
  • PR-293 - KREST-3148 enable ip based rate limiting

Schema Registry

  • PR-2307 - Change everit-json-schema coordinates to reflect artifact published o
  • PR-2306 - DGS-3783 Allow same schema w/diff ids during IMPORT
  • PR-2299 - DGS-3141 - adding new v1/metadata/version endpoint
  • PR-2294 - APPSEC-1156: Patch Gson to be 2.9.0
  • PR-2292 - DGS-3679 Allow unencrypted private keys when using PEM files
  • PR-2290 - DGS-3674 Upgrade to Protobuf 3.19.4
  • PR-2288 - DGS-3672 Allow CachedSchemaRegistryClient to register same schema
  • PR-2283 - DGS-3659 Handle null default in JSON Schema converter
  • PR-2282 - DGS-3654 Ensure isKey is passed in deserializers
  • PR-2275 - Migrate from confluent-log4j to reload4j
  • 96471721 - Upgrade kotlin to 1.6.0
  • PR-2259 - Fix upgrade to Jackson 2.13
  • PR-2257 - DGS-3548 Optimize cache for JSON Schema converter
  • PR-2253 - DGS-3535: Remove enforcement of building with JDK8
  • PR-2241 - DGS-3484 Allow NaN when parsing JSON
  • PR-2223 - DGS-3342 Add reserved fields for Protobuf enums
  • PR-2227 - DGS-3417 Fix default value conversions in JsonSchemaConverter
  • PR-2221 - DGS-3329 Expose ObjectMapper to allow customizations
  • PR-2206 - Introduce Pull Request Reviewers
  • PR-2194 - Incorporated endpoint verification disable for schema registry client
  • PR-2196 - DGS-3087: Accommodate upstream change in AbstractCoordinator
  • PR-2176 - Added goal set-compatibility
  • PR-2177 - Adding new goal test-local-compatibility for schema registry maven plugin
  • PR-2178 - Downloading specific version of schemas capability added
  • PR-2188 - DGS-3087: Accommodate upstream change in AbstractCoordinator
  • PR-2170 - DGS-2975 Make register API 422 error code verbose
  • PR-2172 - DGS-2989 Update function return type due to changes in parent class
  • PR-2166 - DGS-2951 Make Register Api’s incompatibility error message verbose
  • PR-2153 - DGS-2871 Add API to delete Global-level compatibility setting
  • PR-2163 - DGS-2929 Optimising getLatestVersion implementation [skip secret scan]
  • PR-2149 - DGS-2672 Add generalized sum type support
  • PR-2136 - DGS-2750 Add API to SchemaRegistryClient interface to get deleted subjects and schemas
  • PR-2138 - DGS-2770 Allow Protobuf enums to be be converted to int32
  • PR-2132 - Upgrade json-schema to 1.14.0
  • PR-2062 - Configure Schema Registry Client [m]TLS using PEM
  • 55dd7d94 - Added restriction for __GLOBAL subject
  • PR-2116 - Fix compile error from KAFKA-13456 fix: effectiveAdvertisedListeners
  • PR-2101 - feat: Update wire-schema version to 4.0.0
  • PR-2088 - Allow passing a specific class when creating a KafkaJsonSchemaSerde with a client (in tests)

Commercial Features

Confluent Server

  • Revert “CIAM-1419: Restructure DefaultAuthCache to lookup access rules for principal (#4758)”
  • Revert “CONFLUENT: Rename DataPlaneAuthCache class name to CloudAuthCache (#4885)”
  • KC-2144: Revert “AUTHN-280: Java client: implement async auth (#4659)”
  • KC-2202 Disable kraft cluster linking system tests 7 2
  • KGLOBAL-1394: Broker fails to start due to deleted cluster link (#6509)
  • KC-2202 Disable CL in KRaft mode for CP 7.2
  • KC-2223: Disallow enabling SBC with KRaft in CP 7.2 release
  • KC-2202; Disallow TS and KRaft in 7.2.x
  • build: kafka system tests should support larger EBS volumes for newer instances (#6371)
  • Upgrade Gson
  • CPKAFKA-7262: fully support 7.0 and 7.1 in upgrade, downgrade tests
  • Disable idempotent producer by default in Connect centralized licenses (#6193)
  • back port fix for scalabe restore test to 7.2.x
  • KAFKALESS-1047: Always acess SBC related Enums by name
  • KSECURITY-221: Update jackson packages to 2.13.2 version
  • Fix backward incompatibility issue in license store (#6152)
  • CONFLUENT: Record total usage for cluster link quota even if user quota not set
  • KGLOBAL-1297: Revert cluster link sync filter config validation changes
  • KSTORAGE-2163: regression in confluent.tier.local.hotset.ms dynamism (#6235)
  • AUDIT-1041: Add resource id to schema of audit log
  • KCFUN-411: Fix NaN error for Quota Calculation
  • KMETA-112; Retry ISR expansion after partition epoch updates
  • KSECURITY-195: Update org.jetbrains.kotlin packages to 1.6.0
  • KAFKA-13682; KRaft Controller auto preferred leader election (#11893)
  • CONFLUENT: Fix path to jolokia
  • [skip secret scan] KSTORAGE-2003: Lock contention causing producer latency during disk outage
  • Fix semaphore builds issue introduced by #5614
  • KPLATFORM-97: Update the jdk version to 17 [skip secret scan]
  • KAFKALESS-1021: Enable back BrokerFailureDetector#testPartialClusterFailure for KRaft
  • KAFKALESS-716: Add brokers in KRaft mode only if they’re empty (contain no replicas) [skip-secret-scan]
  • KSTORAGE-2039: disable durability audits for upgrade tests from versions < 7.1
  • KCFUN-379: remove principal quotas on empty message
  • KSTORAGE-2141: fix ExtendedOffsetMap.tombstoneCount
  • KGLOBAL-1389: Enable kraft mode in eligible tests in MultiTenantClusterLinkTest
  • KAFKALESS-1066: Log plans that are not improving cluster imbalance
  • KSTORAGE-2057: use default file deletion delay for compacted segments
  • KENGINE-164; Use estimated timestamp from broker in late transaction metric
  • KAFKALESS-811: Add implemention for triggerEvenClusterLoad Api in Kraft
  • MINOR: Enable rebalance_topic and remove_broker_command system tests
  • KAFKALESS-937: Update integration tests for KDBM methods onElection(), onResignation()
  • KGLOBAL-1393: Reduce the workload for CL soaked clusters
  • KSTORAGE-2055: improve logging in tier tasks
  • CIAM-1916 Operator should be Readonly
  • Add Trogdor Helm values for KCFUN soak
  • METRICS-4256 Factor out MetricCollectors naming conventions + improve collector memory usage
  • KGLOBAL-1211: Incorrect failed link count
  • KSTORAGE-2097: local vs. tier data validation in dual compaction mode
  • KSTORAGE-1821: Tiered transaction violation for exactly aborted batch where baseOffset and lastOffset = 0
  • KAFKA-13651; Add audit logging to StandardAuthorizer
  • [skip secret scan] KGLOBAL-1160: CreatePartitions API support for mirror topics in KRaft
  • KGLOBAL-1081: Fail mirroring if source leader epoch goes backwards
  • KGLOBAL-1364: Fix link coordinator integration test for KRaft
  • KGLOBAL-1291: Track public credential for reverse connections to handle API key delete
  • [skip secret scan] Expire quota consumptions if there is no report from a broker
  • KAFKALESS-1018: Don’t change RF when draining broker
  • Add low fluctuating bandwidth KCFUN workload
  • change brokerList to bootstrapServers() and refactor some create/delete code
  • KGLOBAL-1350: Enable ClusterLinkSyncIntegrationTest for KRaft and ZK mode
  • Fix a CL test that is failing on Scala 2.12
  • KAFKALESS-874: Port a set of broker removal integration tests to run in KRaft
  • KDATA-245 Improve exception handling for CLM object store calls
  • CONFLUENT: Make pid work with Java 17
  • Fix possible race in TopicBasedPhysicalClusterMetadataTest
  • KSECURITY-194: DataplaneAuthReader should complete startup after parsing ignored/errored Records
  • KAFKA-13743: Prevent topics with conflicting metrics names from being created in KRaft mode #11910
  • CIAM-1731: Added metric for missing organization Metadata in Auth Request [skip secret scan]
  • Add formatter for quotas topic
  • Add alternating KCFUN soak workload
  • KMETA-78; Return UNKNOWN_LEADER_EPOCH when follower is not recognized among the replica set
  • Update Docker Build Instructions [skip secret scan]
  • CONFLUENT: Add missing log argument in DataplaneAuthReader log
  • KCFUN-128: Adds a KafkaRequestHandlerBenchmark to benchmark KafkaRequestHandler.poll.
  • KCFUN-247: Create integration test for Dynamic quota pipeline
  • KSECURITY-36: Support ResourceIds in Describe ACL Requests
  • Add Linux CPU usage metric for the Kafka process [skip secret scan]
  • KCFUN-241: Read service account quotas from CDC internal topic
  • KCFUN-330: Update deactivated tenant status in the background
  • Mockito timeout() doesn’t work when mock is called from another thread
  • KGLOBAL-1365: Enable ClusterLinkIsrTest.testRestartPausedLink
  • KAFKALESS-1032: Use wall clock to prune task history
  • KCFUN-169: Fix incorrect metric
  • KGLOBAL-1369: Handle KafkaBroker shutdown and startup correctly in the cluster link tests.
  • KGLOBAL-1368: Use input param in verifyMarkReplicaThrottle when calling verify
  • [KSECURITY-71] Add support for AuditLog V2 schema. [skip secret scan]
  • KSECURITY-164: Support ResourceIds in Create ACL Requests
  • KSECURITY-138: Support for special principalType””UserV2:” in Kafka ACLs
  • Exclude iowait time from cpu busy time.
  • [skip secret scan] Enable KRaft mode for cluster link integration tests
  • KAFKALESS-969 Fix NPE in SystemTopicEvenDistributionGoal [skip secret scan]
  • KAFKALESS-928: KafkaServer should specify SBC bootstrap server under ZooKeeper [skip secret scan]
  • CPKAFKA-8405: fix leader fields parsing from describe_topic output in
  • Fix Scala 2.12 compatibility by using type parameter
  • KAFKALESS-1001: Propagate errors conditionally from BatchedConfigFetcher::getConfigs
  • KDATA-395 Make CLM minimum sleep time configurable
  • KAFKA-13577: Replace easymock with mockito in kafka:core - part 1 (#1
  • KSTORAGE-2107: add more transactions tests to TierCompactLogTest
  • KAFKA-13801: Kafka server does not respect MetricsReporter contract for dynamically configured reporters (#11998)
  • KSTORAGE-1946: Consume record timestamp in tier metadata
  • KDATA-242 KDATA-272 Address CLM scalability for large number of topics
  • KAFKA-13749: CreateTopics in KRaft must return configs (#11941).
  • KDATA-244 Handle exceptions for GCS list call response
  • KMETA-45; KRaft support for Confluent authorizer framework (including multi-tenant ACLs and RBAC) [skip secret scan]
  • Disabled testAutoMirroringNoOverlappingTopicFilters for kraft
  • KDATA-113: Add system test for scalable restore
  • KMETA-75; Do not reset replica state unless there is an epoch bump
  • KCFUN-355 Make enabling user quota dynamically configurable
  • KSTORAGE-1949: backfill stateChangeTimestamp when migrating state file
  • KCFUN-290: Publish Dynamic Quota to brokers [skip secret scan]
  • Use the non .sh script to start Kafka in Ducker and add missing CP versions
  • KSECURITY-7: Add request log filter for detailed audit log events
  • decouple KafkaMetricsCollector from MetricsReporter
  • KAFKALESS-1007: Wait for new topic metadata to be propagated to all brokes
  • KDATA-333: Add restore metrics tag
  • KSECURITY-141: Fix flakiness in metrics checks in ClusterLinkAclSyncIntegrationTest
  • KAFKALESS-832: Add preliminary check in CapacityGoal for ignored brokers over capacity
  • KC-1945: Allow SBC operations in the presence of exclusions [skip secret scan]
  • KSTORAGE-2030: remove segments that are tier compacted from local hotset
  • KGLOBAL-1208: Don’t do validation of configs when reading from persistent store
  • [skip secret scan] KCFUN-168: Add expiration thread for computed quotas
  • KGLOBAL-1022: Use link id in the request for source link creation in quorum controller.
  • Add muckrake mapping for 7.2 release
  • KGLOBAL-1235: Add records in the correct order while creating mirror topic
  • Grant ValidateConfig permission to ConnectorDeveloperRead role
  • KAFKALESS-872: Port replica replacement self healing test to support KRaft
  • KAFKALESS-998: Disable idempotence of all SBC used producers
  • KAFKALESS-872: Disable rebalance topic test for KRaft
  • KGLOBAL-887: Implementing KRaft integration test framework for some CL tests
  • KGLOBAL-1188 Ensure ReplicaManager see MirrorTopicChangeRecords
  • KAFKALESS-872: Port remove broker test to support KRaft
  • EVENTS-843: Disable idempotence in all KafkaExporters by default (#5987)
  • EVENTS-843: Disable idempotence in all KafkaExporters by default
  • KAFKA-13418: Support key updates with TLS 1.3 (#11966)
  • KAFKALESS-970 Fix computeBalanceUpperThresholdPercentage() to return values no greater than 1.0
  • KC-2136: Don’t include file-based login configs in broker’s dynamic config list
  • KGLOBAL-889: Support CL system tests with KRaft + ZK
  • Revert “AUTHN-280: Java client: implement async auth (#4659)”
  • KSTORAGE-2071: add dual compaction to log_compaction_test
  • Revert “KAFKA-13598: enable idempotence producer by default and validate the configs (#11691)”
  • Revert “:KAFKA-13673: disable idempotence when config conflicts (#11788)”
  • KENGINE-152: do not use idempotent producer for license log (#5971)
  • KSTORAGE-2056: Change suffix of tier compaction temporary files from .cleaned to .tiercleaned
  • KENGINE-152: do not use idempotent producer for license log
  • KGLOBAL-1191: Fix initialize code in ClusterLinkSyncAcls so we only set initialized to true if we successfully create and delete ACLs
  • KENGINE-14: enable consumer lag emitter for kraft
  • KSTORAGE-2068: Fix integration.kafka.tier.TierTopicManagerIntegrationTest.testTierTopicManager to run in KRaft mode
  • KAFKALESS-872: Port rebalance_topic_test to support KRaft
  • KAFKALESS-971 Fix computation of resources in ResourceDistributionGoal
  • KAFKALESS-915: Correct evaluation of expectedFinalClusterSize to fix testRemoveMultipleIncludingController
  • KGLOBAL-1187: Switch KafkaServerTestHarness (back) to non-concurrent start
  • KAFKALESS-865: Mechanism to clear SbcResourceManager resources.
  • KENGINE-57: Added auth latency and error metrics.
  • CONFLUENT: Fix AclCount metric for MultiTenantAuthorizer
  • KAFKALESS-982: Retry describeTopics in case of unknown partition exception due to race condition in metadata propagation in exclusion integration tests
  • KC-2102: Propagate exclusion information to SBC
  • KCFUN-291: Filter incoming LKC, ignore non-Kafka
  • CONFLUENT: Downgrade netty-tcnative to 2.0.46
  • KC-2059: Enable integration and system tests for broker replica exclusion in a KRaft Cluster
  • AUTHN-695: Add more debuggability for OAuth key resolver
  • KSTORAGE-1934: concurrent local and tier compaction
  • KGLOBAL-1197: Fixing IncrementalAlterConfigs to check for overlapping topic filters for cluster links
  • KGLOBAL-1204: Fix cluster linking metric names for consistency
  • KAFKALESS-814: Implement RemoveBroker/DescribeBrokerRemovals in KRaft
  • KAFKALESS-872: Port add_broker_test to support KRaft
  • KGLOBAL-1172: Add CL configs to ConfigSchema to be encrypted by MetadataControlManager
  • CC-16870: Set idempotence to false for Producers instantiated in Connect worker
  • CC-16870: Set idempotence to false for Producers instantiated in Connect worker
  • METRICS-4017 fix histogram/timer snapshot sum, add min
  • KAFKA-13761: KafkaLog4jAppender deadlocks when idempotence is enabled
  • KAFKA-13761: KafkaLog4jAppender deadlocks when idempotence is enabled
  • KGLOBAL-1198: Fix misleading message about recreating cluster link for dynamic configs
  • [KPLATFORM-89] creates ce-kafka-resources project
  • KAFKA-13750; Client Compatability KafkaTest uses invalid idempotency
  • KCFUN-331: Adding support for Client Quota to UpateDynamicQuotas.
  • Retry test failures for master branch
  • KGLOBAL-1182: Add metrics for each remote RPC call for cluster link periodic tasks
  • Broker Health State Changes
  • KSECURITY-35: Support ResourceIds in CreateACL/DeleteACL Request Handlers
  • KGLOBAL-973: Mirror topics API changes for KRaft
  • CCLOG-1485 Cleanup connect permissions, move ResourceOwner and DeveloperManage roles to connectv2 namespace
  • KGLOBAL-1187: Disable the testMirrorFailoverWhileSourceIsUnavailable
  • KAFKALESS-942: De-flake testOngoingBrokerAdditionRejectsTriggerEvenClusterLoadRequest
  • [skip secret scan] KCFUN-168: Recompute quotas when quota usages are reported
  • CPKAFKA-8201 Fix for regression in CLM system test due to addition of stateChangeTs to FTPS
  • KAFKA-13750; Client Compatability KafkaTest uses invalid idempotency
  • bugfix: return startZooKeeper ` as a deprecated proxy to `startQuorum
  • KGLOBAL-1184: Fix the ReverseConnectionRequestTest
  • KAFKALESS-921: Re-enable Thread Leak checking for all but SBC tests.
  • KC-2109: Introduce and use killBrokerById
  • KAFKALESS-764: Fallback to populating SBC internal listener from metadata log
  • KAFKALESS-852 – SbcEventQueue
  • KAFKALESS-920: Fix BalancerStatusTest in KRaft by matching returned Error instead of ApiError
  • KAFKALESS-900: Fix replication factor in BrokerFailureDetectorTest and use monotonic time
  • KC-1929: Convert SBC Integration tests to use KafkaServerTestHarness
  • bugfix: return startZookeeper as a deprecated proxy to startQuorum
  • KDATA-229: Add support for list and restore operations in Azure
  • KENGINE-139: do not synchronize when reporting fetch session cache metrics
  • KSTORAGE-2019: set enable.idempotence=false for TierTopic producer (#5833)
  • KMETA-27: Add KRaft support to the multitenant integration tests
  • CPKAFKA-8319: Update okio version to 3.0.0
  • KAFKA-13727; Preserve txn markers after partial segment cleaning (#11
  • CPKAFKA-8319: Update okio version to 3.0.0
  • KC-2088: Ensure MZ cluster availability when health check cannot reach brokers through load balancers due to a network issue.
  • MINOR: Revert “MINOR: temporary disable downstream validation”
  • KGLOBAL-1162: Disallow cluster link prefixing and acl syncing to be e
  • KAFKALESS-896 Enable ClusterModelPBTUtils to generate clusters with NEW brokers
  • [skip secret scan][Metrics-4078]add environment and cloud-cluster scoped MetricsViewer role
  • KAFKALESS-847 Exclusion-aware TopicReplicaDistributionGoal [skip secret scan]
  • KGLOBAL-1140: Filter out mirror topics from source cluster in ClusterLinkAutoMirroring when applicable
  • KENGINE-65: Add Metric for the total number of ACLs for a PKC
  • KDATA-346: Add flag to enable/disable deepOffsetScan
  • CIAM-1792 - Stream Lineage is available to new DataplaneRoles
  • [skip secret scan] KAFKALESS-846 Support exclusion in ResourceDistributionGoal
  • Handle KRaft cluster ID with leading minus sign
  • KAFKALESS-895 Part 1: ClusterModelPBTUtils able to create special states (IGNORED, DEAD) [skip secret scan]
  • KGLOBAL-997: Use AdminClient for mirror topic config sync
  • KAFKA-13435; Static membership protocol should let the leader skip assignment (KIP-814)
  • fix test that wasn’t testing anything
  • KAFKALESS-819: Log exact resource usage by hot partition #5847
  • KSTORAGE-1499: fix segment deletion before creation
  • KGLOBAL-974: Delete mirror topics support for cluster link in KRaft.
  • KDATA-340: Set Durability topic producer idempotence to false
  • KSTORAGE-1975 Remove unnecessary WrapIO
  • KDATA-273 CLM Maintain reference to latest instance of LifecycleManagerState
  • KSTORAGE-2019: set enable.idempotence=false for TierTopic producer
  • [skip secret scan] KSTORAGE-1422: TierArchiver Metric for Max Time Lag
  • KENGINE-73: Use more threads to load and unload groups
  • KAFKALESS-841: Add support for CapacityGoal with exclusions [skip secret scan]
  • Upgrading snakeyaml
  • KDATA-307: kafka reversion check when run restore
  • KDATA-308: restore fromTimestamp input format
  • KSECURITY-59: Add additional authoriser metrics
  • AUDIT-986: Update confluent-log4j version
  • AUDIT-986: Update confluent-log4j version
  • CPKAFKA-3449: Add simple Trogdor worker for calling Cruise Control rebalances
  • [skip secret scan] KGLOBAL-887 Cluster Linking requests tests in KRaft
  • KC-2094: Add KRaft quorum test cases to TS system tests
  • KGLOBAL-1139: Update cluster link tests to always check migrated ACLs
  • KGLOBAL-1070: Fix unnecessary metadata requests and logs.
  • KC-2058: Validate against replica exclusions in KRaft mode for the CreatePartitions,CreateTopic and AlterPartitionReassignments APIs
  • KGLOBAL-1129: Change consumer.group.prefix.enable default value to false
  • KGLOBAL-1134: Validate sasl.jaas.config for cluster links to avoid UnknownServerException
  • KMETA-53: Implement Metadata Encryption for sensitive records in kraft
  • KAFKALESS-928: Remove possible port collision when starting multiple brokers in Embe
  • KDATA-329 Added retries for consumer calls that can time outs
  • remove obsolete duplicateResourceLabelsOnTimeseries flag
  • CONFLUENT: Convert more modules to JUnit 5 and fix related build issues
  • KC-2095: Enable dynamic updates of secrets stored in sym linked directories
  • KGLOBAL-1125: Fix lag reported by MirrorCommand when source hwm not known
  • update telemetry-client + telemetry-api to 3.x
  • Address Akhilesh’s review comments
  • Bug fixes for CRUD operations and updating config operations to be KRaft compatible
  • KCFUN-312: Add wait for socket close in testDisconnectThrottledConnec
  • KGLOBAL-1128: Remove cluster link prefix from ACL resource transformation in LinkContext
  • KAFKALESS-853: Implement SbcEvents [skip secret scan]
  • KC-2045: Add KRaft quorum options to four system tests with TS
  • KDATA-299 Remove metrics reporter class property from CLM’s tier topic consumer configuration
  • CONFLUENT: Use non-parameterized tests for EndToEndAuthorizationTest since it is extended for Confluent authorizer tests
  • CONFLUENT: Use non-parameterized tests for EndToEndAuthorizationTest since it is extended for Confluent authorizer tests
  • KGLOBAL-863: Fix formatting to handle multiple filtered out topics (#
  • KGLOBAL-1096: Remove cluster link prefix from user principal
  • KGLOBAL-1043: Implement cluster link metadata topic in Zk mode.
  • KC-2057: Add BrokerReplicaExclusion{Image, Delta} and notify SBC on altered exclusions as part of the metadata image update
  • KGLOBAL-1093: Fix handling of CLUSTER_ID in LinkContext
  • KGLOBAL-1108: Fix OffsetsForLeaderEpoch version for cluster link source version < 2.8
  • Throw IOException for Confluent internal ip and port
  • CPKAFKA-8142: document merge requirements in pull request template
  • [skip secret scan] KSTORAGE-1976: Add DeletionTask exceptions per second metric
  • KGLOBAL-863: Fix formatting to handle multiple filtered out topics
  • Disallow loopback addresses for CL connections.
  • MINOR: temporary disable downstream validation
  • KDATA-311: Add support for Azure backend for recovery
  • KSTORAGE-1958: Avoid producer state snapshot sync flush during log roll
  • KGLOBAL-908: Change kafka-cluster-links cmd utility to ignore sync property and filter validations for source link creation
  • KSTORAGE-1959: Avoid checking for existence of stale index files during roll
  • CONFLUENT: Add missing arguments to log statements
  • KGLOBAL-1094: Change config name for enabling cluster link prefixing
  • fix merge and test failure
  • Fix DynamicBrokerReconfigurationTest.testThreadPoolResize
  • Fix test failure MultiTenantAuthorizerTest.testAclUpdateInZooKeeper.
  • KGLOBAL-1032: Add config option for whether to add cluster link prefix to consumer group metadata
  • Revert “CONFLUENT: Delete duplicate script files”
  • KAFKALESS-878: Add array field brokerId in describeBalancerStatus API
  • KAFKALESS-838: Add support for excluded broker utilization
  • CONFLUENT: Delete duplicate script files
  • KSTORAGE-1933: Make tier cleaner configs dynamically configurable
  • KAFKA-13603: Allow the empty active segment to have missing offset index during recovery [skip secret scan]
  • KGLOBAL-1049: Make sure cluster link config changes are processed on controller failover
  • Revert “KSTORAGE-1958: Avoid producer state snapshot sync flush during log roll (#5592)
  • add getBrokerListStrFromServers() as a deprecated method to fix downstream validation
  • AuthN-546, 547 Fix extractor compatibility issue
  • KAFKALESS-142: Send DataBalancer logs to dedicated file.
  • KSTORAGE-1958: Avoid producer state snapshot sync flush during log roll
  • KGLOBAL-983: Limit Number of Lagging Partitions
  • Add Kafka 3.0/1 and CP 7.0.1 to vagrant base.sh script so they’re pulled in
  • KSTORAGE-1947: add state change timestamp to TierPartitionStateEntry [FTPS cleanup]
  • KC-1927: BrokerReplicaExclusion API wiring & record persistence 1/2
  • KGLOBAL-927: Delete cluster links for deleted tenants.
  • [timestampConverter] add validator and recommender
  • KCFUN-279: Setup KCFUN Soak cluster workloads
  • CPKAFKA-8136: Remove named arg from method call when creating KafkaSe
  • KGLOBAL-319: Reduce log level of repetitive metadata refresh errors
  • KGLOBAL-1071: Don’t auto-mirror _confluent topics even if they match filters
  • [skip secret scan] KAFKA-13310: KafkaConsumer cannot jump out of the poll method, and t
  • KGLOBAL-1045: Add unit test for ClusterLinkSyncOffsets that tests handling two writers
  • AUDIT-971: Update confluent-log4j version for 7.1.x
  • DGS-2782: Added New Metadata resource in dataplane rbac roles for DG
  • Ignore failing quota_test (#5651)
  • AUDIT-971: Bump confluent-log4j version
  • KGLOBAL-938 leader epoch bump
  • KDATA-269 CLM to use customer supplied key for AWS BYOK clusters
  • KAFKALESS-850: Push callbacks to SBC [skip secret scan]
  • Revert “[CCLOG-1141] TimestampConverter : add validator and recommender”
  • KAFKA-13646; Implement KIP-801: KRaft authorizer (#11649)
  • KAFKALESS-848: Make LeaderBytesInDistributionGoal exclusion-aware. [skip secret scan]
  • KGLOBAL-1048: Check mirror topic state during ClusterLinkStopMirrorTopic
  • KAFKALESS-838: Add capacity for excluded brokers
  • KGLOBAL-988: Remove cache in cluster link offset sync task to stale offsets during controller failover, overwrites, expiry etc.
  • KDATA-246 CLM Making backup period configurable
  • KGLOBAL-112: Integration test for cluster link fetch with topic ids to detect topic recreate
  • [CCLOG-1141] TimestampConverter : add validator and recommender
  • KDATA-298 Add a tool to inspect (list / get) tiered objects
  • config restore parallelism from cli
  • KENGINE-124: Fit and finish for KC-1786
  • Ignore failing quota_test
  • Upgrade TCNative version
  • KENGINE-127; Add dynamic config for transaction logging verbosity
  • KPERF-247 single scan replicas for deleted topics in KafkaController updateMetrics
  • SEC-2906: Don’t generate audit events for un-routed method categories
  • KCFUN-272: Allow muting connections before TLS handshake completion
  • Allow to set list of aud in jwtConsumerBuilder
  • KDATA-280: Add metrics for Automated restore
  • KGLOBAL-1056: Support listing ACLs filtered by link ids for AclCommand
  • KMETA-12 Optimize CreateTopicsRequest
  • Fix javadoc in clients module to prepare ce-kafka for jdk17
  • Cherry-pick “Address comments from PR #5558 (#5612)” to master
  • Cherry-pick “Disbaled bubbling errors from JsonSerializer and Deserializers for connect that print the message in stack trace (#5558)” onto 7.1.x
  • Cherrypick to 7.1.x “KSTORAGE-1915: Check if usage of S3’s GetBucketLocation API can be eliminated”
  • KAFKALESS-838: Set Broker state at construction
  • KCFUN-268: Re-add missing call to deleteTenants()
  • CPKAFKA-8140: disable tier compaction system test in 7.1.x
  • KGLOBAL-881: Integrating CRUD operations for links with KRaft
  • KAFKALESS-845 Support exclusion in LeaderReplicaDistributionGoal [skip secret scan]
  • FIX: Remove record logging in connector tracing exception
  • CONFLUENT: Inline preAuthorize into authorize
  • FIX: Remove logging entire record in connector tracing exception.
  • [CLI-1430] Add GCM functionality to DecryptionEngine (#5563)
  • [CLI-1430] Add GCM functionality to DecryptionEngine
  • Revert “[KPLATFORM-89] Publishes ccDockerKafkaTarGz artifact (#5383)”
  • CONFLUENT: Call each authorization request sensor once per batched authorize call [skip secret scan]
  • KSTORAGE-1915: Check if usage of S3’s GetBucketLocation API can be eliminated
  • CONFLUENT: Check version to select ZK CLI class name
  • [KPLATFORM-89] Publishes ccDockerKafkaTarGz artifact
  • Revert “KPERF-205: Accumulate follower fetch purgatory checks in acti
  • KDATA-69 Add more metrics for Backup Object Lifecycle Manager
  • revert change to build.gradle
  • Incorporate LogCleanerDeleteRentenionMsDoc from AK to ce-kafka according to suggestion from Jason
  • KGLOBAL-972: AlterMirrors support in KRaft mode brokers.
  • Temporary commit(will be squashed into merge commit after review)
  • KGLOBAL-1046: Test ClusterLinkAutoMirroring handles multiple controllers/writers
  • KGLOBAL-1047: Add unit tests for dest cluster ACLs getting mutated out of band by ClusterLinkSyncAcls task
  • CONFLUENT: Initialise DynamicConfigs in BrokerServer, ControllerServer
  • move opencensus related code from telemetry-api to ce-metrics
  • KAFKALESS-867: Don’t create SampleStore during startup check
  • KSTORAGE-1953: Back off CompactionTask if Log.lockFirstNotDeletableOffset call fails
  • KSTORAGE-1901: Add TierArchiverExceptions per second metric
  • Cherry-pick “Disbaled bubbling errors from JsonSerializer and Deserializers for connect that print the message in stack trace #5558” onto master
  • KAFKALESS-843: Add excluded broker support to SystemTopicEvenDistributionGoal.
  • KAFKA-13636: Fix for the group coordinator issue where the offsets ar
  • CONFLUENT: Fix ReverseConnectionTest failure when executed with Java 17
  • KSTORAGE-1898: add internal retry for retriable exception in CompactionTask
  • KAFKALESS-844 Support exclusion in ReplicaDistributionGoal [skip secret scan]
  • KAFKALESS-842: Update ReplicaCapacity goal to support broker replica exclusions [skip secret scan]
  • KAFKALESS-851: Create an SbcResource class
  • KGLOBAL-770: StopMirrorsTask for ClusterLink in KRaft mode.
  • Build image build using developer credentials
  • CONFLUENT: Reinstate MultiTenantClusterLinkTest that was deleted by mistake
  • remove two empty lines in KafkaClusterTestKit to pass checkstyleTest (MethodLength)
  • AuthN-546, 547 Only Authenticate Oauth users to lkc bound to the same
  • CONFLUENT: Fix compiler warnings when building with Java 17
  • Revert “[KPLATFORM-7] Enables local Docker image build using developer creden… (#5456)”
  • KC-1802: Workaround for init script issue affecting Gradle 7.1 and newer
  • [KPLATFORM-7] Enables local Docker image build using developer creden
  • KC-1802: Workaround for init script issue affecting Gradle 7.1 and newer
  • CONFLUENT: Update netty-tcnative to 2.0.48.Final
  • Revert “Revert “KAFKALESS-820, KAFKALESS-685: Fix NPE in CDBE::shutdown (#5436)” (#5514)”
  • KSTORAGE-1932: add confluent.tier.cleaner.enable config
  • Revert “KAFKALESS-820, KAFKALESS-685: Fix NPE in CDBE::shutdown (#5436)”
  • KAFKA-13614: Don’t apply leader replication quota to consumer fetches
  • KAFKALESS-820, KAFKALESS-685: Fix NPE in CDBE::shutdown
  • KGLOBAL-1034: Support source initiated links with link coordinators based on controller or partition leader
  • SBC: Cleanup Mockito usage
  • KGLOBAL-1034: Support source initiated links with link coordinators based on controller or partition leader
  • KMETA-31: datagen connector with KRaft
  • KC-1973, KDATA-300: Add support for KRaft in DA integration tests
  • Add new resourceTypes and role mapping for notification-service RBAC
  • CCLOG-1356 Move connect permissions to cloud_rbac_roles.json
  • KDATA-286: Remove interrupt to AuditJob
  • [skip secret scan] Cell PBTs for replicaMoves in OnPremClusterModel
  • CONFLUENT; Avoid duplicate topic id in replica manager update
  • KC-2043: Add KRaft quorum options to tier_deletion_test
  • EVENTS-710: remove restriction on event extension length
  • Revert “CONFLUENT; Avoid duplicate topic id in replica manager update (#4995)”
  • CONFLUENT; Avoid duplicate topic id in replica manager update
  • [skip secret scan] KSTORAGE-1854: Implement min compaction lag ms
  • CDX-174 Add consumer shared resources for OrgAdmin role
  • KDATA-271: restore byok support for gcs
  • KPERF-290: Maintain principal scope as part of MultiTenantPrincipal
  • KC-1967: KRaft: No JVM Exit upon K8s Operator HTTP BeginShutdown
  • KMETA-17: update TierConfigurationTest.testDisableTieredStorageAtBrokerLevelAfterEnablingStatically to run against kraft
  • Pick KAFKA-13221 which adds PartitionsWithLateTransactionsCount metric
  • KMETA-25: Fix controller NPE due multitenant metrics
  • [skip secret scan] KAFKALESS-837: Introduce IGNORED (alive & excluded) broker state/strategy in ClusterModel and modify RackAwareGoal to work with exclusion [skip-secret-scan]
  • KGLOBAL-1038: Fix cluster link prefix issues
  • CIAM-1700: Add role definitions for ksqlDB data plane roles
  • KGLOBAL-1025: Auto mirror create should exclude all linked topics. (#
  • Revert “KAFKA-13152: Replace “buffered.records.per.partition” with “input.buffer.max.bytes” (#11424)”
  • KCFUN-240: Allow configuration of service account quotas
  • KCFUN-267: Only update LKC metadata store once on initial load
  • KDATA-43 System test for CLM
  • KC-1504: fix license topic consumer endOffsets TimeoutException
  • CPKAFKA-7648: retry fetching license topic metadata in LicenseStore
  • KGLOBAL-558: Pass kwargs correctly to KafkaService
  • KGLOBAL-1036: Add most recent Kafka versions to test_cluster_link_com
  • KGLOBAL-783: Add upgrade system test for cluster linking
  • KGLOBAL-1025: Auto mirror create should exclude all linked topics.
  • KSTORAGE-1462: Ensure tasks for deleted partitions are removed from partitionsInError
  • KSTORAGE-1930: allow setting log.retention.ms to -1 (infinite) at cluster level in ccloud
  • [KPERF-249] [skip secret scan] Use exponential backoff on fetch failure
  • KPERF-205: Accumulate follower fetch purgatory checks in action queue
  • [CNC-9] Configure log redactor for Connect (#5440)
  • KC-2004 - Disable populating map if the BrokerHealthManager thread isn’t running
  • KDATA-287: restore checksum enabled
  • KC-2039; Fix infinite recursion when AlterIsr inflight
  • KCFUN-237: Update quota auto-tuning logic to work with hierarchical quotas
  • [CNC-9] Configure log redactor for Connect
  • KGLOBAL-1028: Update ACL failed metric when ACL sync fails due to tenant ACL limit
  • KGLOBAL-785: Handle partition leadership updates for mirror partitions in replica manager in KRaft mode.
  • KGLOBAL-1021: Fix deadlock in ClusterLinkFetcherManager during excessive epoch updates
  • KC-1659: Add metrics for monitoring API keys that are currently in use
  • make cc-trogdor role binding sorta namespaced
  • [DO NOT MERGE] Cache+upgrade+update assignment metadata
  • KAFKALESS-812: Optimize proposal rejections in SystemTopicEvenDistrib
  • KENGINE-115: Leader replication quota should not be applied to consumers
  • KCFUN-274: ClientQuotaCallback.updateDynamicQuotas needs a default implementation (#5403)
  • KCFUN-274: ClientQuotaCallback.updateDynamicQuotas needs a default implementation
  • [skip secret scan] KSTORAGE-1920: Compaction: add metric and improve log message when offset map is filled
  • removed default cc-trogdor role binding since it broke a test. Will c
  • CCDB-4528: Prevent ClassCastException during preflight connector config validation
  • KGLOBAL-995: Change mirrorTopic in NewMirrorTopic to sourceTopic in t
  • KGLOBAL-881: Refactor away zk in cl components
  • KGLOBAL-1006: Use Kafka Uuid instead of Java UUID for cluster link APIs and metrics
  • KSE-848: remove ksql connector management RBAC roles
  • Update confluent-log4j version to cp8
  • [SEC-2896] Update confluent-log4j version to cp8
  • KGLOBAL-1009: Fix testDeleteAutoMirroredTopics intermittent failures
  • KGLOBAL-882 KRaft support for mirror topics
  • KGLOBAL-1009: Fix testDeleteAutoMirroredTopics intermittent failures
  • KGLOBAL-894: Return error message detailing all overlapping topic fil
  • KGLOBAL-995: Change mirrorTopic in NewMirrorTopic to sourceTopic in the admin API
  • CONFLUENT: fix PartitionTest.testIsrShrinkDeferralIfUnhealthy
  • KGLOBAL-1014: Disable cluster link prefix in 7.1.x.
  • KENGINE-47: metric for tracking controlled shutdown requests due to unhealthy brokers
  • CIAM-1618 Add internal flag for role that requires “Bind” authz
  • KAFKALESS-726: Basic implementation of SystemTopicEvenDistributionGoal [skip secret scan]
  • Updates to cc-trogdor and CloudNetworkFaultSpec
  • KGLOBAL-1013: Add metrics to track prefixed auto mirror topics
  • KGLOBAL-854: Fix function name style. (#5353)
  • KAFKALESS-798: Ensure ApiPersistenceStore does not leak an admin client instance by closing it appropriately
  • KENGINE-29: Shrunk ISR before leader crash makes the partition offline
  • KGLOBAL-854: Fix function name style.
  • KSTORAGE-1928: update TierTopicDeletionIntegrationTest to run in kraft mode
  • KGLOBAL-1012: Move clusterLinkPrefix to AbstractClusterLinkIntegrationTest
  • KGLOBAL-991: Allow link ids to be specified in ACL filters to prevent circular sync
  • KENGINE-108: clear KafkaYammerMetrics and ThreadCountersManager memory after all brokers are shutdown
  • KSTORAGE-1931: update TierTopicManagerIntegrationTest to run against both zk and kraft modes
  • KGLOBAL-1003: Add metrics to track information regarding cluster link prefix
  • KSTORAGE-1929: make TierCompactionCommitAndSwap idempotent
  • CIAM-1659 Give Cluster and Topic DescribeConfigs to all Operator roles
  • KAFKA-13582: TestVerifiableProducer.test_multiple_kraft_security_prot
  • KAFKA-13582: TestVerifiableProducer.test_multiple_kraft_security_protocols fails
  • CONFLUENT: Fix QuorumTestHarness.controllerListenerSecurityProtocol
  • KC-2002: Disallow TS with KRaft for CP 7.1
  • Backport: AuthN-256 Fix Oauth system test with new configuration
  • Temporarily disable integrations tests for backup object lifecycle manager
  • KGLOBAL-1000 Address any test gaps involving cluster link prefix
  • AuthN-256 - Fix Oauth system test with new configuration
  • KGLOBAL-989: Enhance system tests to include cluster link prefix
  • Fix merge for Connect source task logic
  • KCFUN-239: Add interface and implementation for hierarchical client quota callback
  • CONFLUENT: Fix IntegrationTestHarness and QuorumTestHarness
  • CONFLUENT: Ensure dynamic reconfigurations are setup correctly in KRaft mode
  • Fix NPE
  • Clm kraft compatibility
  • Revert “KDATA-248”
  • CCLOG-1189 Add connect roles to CCloud RBAC policies
  • KSTORAGE-1894: fix test testMetricsNotAcquireLogLock
  • KGLOBAL-854: Introduce DescribeClusterLinks (#5014)
  • KPERF-281 Lazily evaluate log parameters in EmbeddedAuthorizer
  • KGLOBAL-854: Introduce DescribeClusterLinks
  • KGLOBAL-904: Add support for ListClusterLinks with KRaft
  • Cluster Link periodic tasks and metrics support for KRaft.
  • KGLOBAL-880 Create and delete cluster links
  • KAFKA-13512: Avoid duplicating maps in ZkMetadataCache topic accessors
  • KAFKA-13512: Avoid duplicating maps in ZkMetadataCache topic accessors
  • KAFKA-13490: Fix createTopics and incrementalAlterConfigs for KRaft mode #11416
  • KAFKA-13490: Fix createTopics and incrementalAlterConfigs for KRaft mode #11416
  • KAFKA-13357; Store producer IDs in broker snapshots
  • Revert “MINOR: Remove redundant argument from TaskMetricsGroup#recordCommit (#9642)”

Security

  • SEC-3245: Migrate from confluent-log4j to reload4j
  • Fix confluent-log4j version.
  • Minor: Fix KafkaYammerMetrics import
  • Add spotbugs
  • Added exclusion since MDC class is failing because of reload4j
  • bugfix: repair failing build due to renamed method in ce-kafka
  • Introduce GitHub CODEOWNERS (Pull Request Reviewers)
  • KREST-3660 Move to Junit 5 where needed
  • Add authorizations for DELETE of Global Config
  • BUGFIX: KC-1948 changed TestSslUtils to return String not Password
  • KSQL-7811: support JwtPrincipal wrapped in DefaultKsqlPrincipal
  • FF-6454 MINOR Debug Logging for subjectPatternOperationFound

Secret Registry

  • Migrate log4j
  • bugfix: Make SecretRegistryCoordinator implement AbstractCoordinator
  • Update onJoinPrepare method to return boolean
  • remove usage of deprecated mockito-all
  • Rename advertisedListeners to effectiveAdvertisedListeners

Control Center

  • MMA-11829: add reload4j dependency
  • Bump maven-shade-plugin to 3.3.0
  • Revert “MMA-11712: Support different Schema Registry clusters with the same URL endpoints”
  • Override transitive dependency for analytics library of kotlin-stdlib-common
  • Add exclusion to override dependency kotlin-stdlib-jdk8
  • MMA-11829: Migrate from confluent-log4j to reload4j for blueway
  • MMA-11712: Support different Schema Registry clusters with the same URL endpoints
  • MMA-11827: Add findbugs-exclude.xml file to fix build failures
  • LOG_DIR to match rest of confluent components
  • (MINOR): Revert change that commented testArmeriaServiceHealthCheck
  • MMA-11694: Add retry logic for ControlCenterIntegrationTest
  • APIF-2311: Remove graphql module
  • TRAFFIC-1398 Add bootstrap templatization for ApiKeyAdminSupplier
  • MMA-11725: Remove usages of deprecated RocksDBStore:init(ProcessorContext, StateStore)
  • MMA-11404: fix powermockito incompatibility with Mockito 4.0+ and other build failures
  • MMA-11121: Fix compatibility issues for partition size metric
  • KEXP-213 add flags for ACL and Consumer group management from REST Proxy
  • fix build break
  • MMA-11491: Basic Authentication for KSQL
  • MMA-7291: Basic Authentication for Connect
  • [MMA-10400] fix: comment out config property to match project style
  • [MMA-10400] feat: custom analytics endpoint for segment

MQTT Proxy

  • CC-17228 | Migrate from confluent-log4j to reload4j.
  • Introduce GitHub CODEOWNERS (Pull Request Reviewers)

Metadata Service

  • Revert “MINOR: Use CloudAuthCache in DBAuthCache (#758)”
  • CIAM-2020 - Fix null string in MDSLoggingFilter
  • CIAM-2019 - Fix 6.x MDS builds from Jackson update
  • Upgrade events version
  • Fix dependencies
  • MDS-38 MDS-39 - Make MDSLoggingFilter case-insensitive
  • MDS-37 MDS-39 - Improve redaction rule for auth header
  • MINOR SEC-3087 SEC-3028 Avoid NPE in integration test
  • Use custom mds version format in mk-include targets
  • Removed OrgAdmin from user User:u-4x25kx User:u-12qko3
  • Update cc-mk-include to fix semaphore PR builds
  • [AUTHN-566] Fix policy parse exception error messages
  • [AUTHN-703] add migration to provider_org_mapping
  • Update one-off db readme to use gimme-aws-creds
  • PR Template to encourage writing motivation and testing strategies
  • Build Break Fix for KSQL - only resolve confluent-sec-plugins version once
  • CIAM-1814: Create new cc-rbac maven module
  • [AUTHN-565] Fix error message when deleting non-existent identity pools
  • [AUTHN-562] Fix internal errors on policy parsing
  • CIAM-1488: Extractor will toggle role bindings for health check.
  • Add consumes annotation to identity pool api
  • CIAM-1789 CIAM-1696: Only emit for new kafka cluster, also only look at BOUND_TO_PHYSICAL event
  • CIAM-1806: Update EmbeddedKafkaCluster method usages
  • CIAM-1752: Enable remote JMX for icc-rbac
  • CIAM-1792 - Stream Lineage is available to new DataplaneRoles
  • CIAM-1488: Update id to format rb-hc-xx for precreated 60 role bindings
  • CIAM-1524: Configure icc-rbac load-balancer and weighted DNS routing
  • Introduce GitHub CODEOWNERS (Pull Request Reviewers)
  • Authn-545: Publish organization id with IdentityPool
  • CIAM-1488: Insert 60 rbac role bindings for org 0 health checking.
  • CCLOG-1190 : Updated validation to allow Connector resource Type for clusterType NOT_SPECIFIED(“”)
  • [AUTHN-557] Add orgId check for trust service extractor
  • CIAM-1431: Update regex for semaphore auto deploy make target
  • CIAM-1754: Added toggle soft delete function.
  • CIAM-1431: Update icc-rbac & rbac-extractor to use newer semaphore mk targets
  • CIAM-1431: Integrate icc-rbac with helm, halyard, and semaphore
  • CIAM-1771 dbmigration to delete role bindings with newlines
  • Revert authn-545 and resolve conflict
  • CIAM-1760 - Do CDX stag and prod dbMigrates
  • SEC-2906: Update rbac-api-server for upstream AuditLog refactor
  • CIAM-1482: Use EventsMetadata instead of single entry sequence_id for sequence id.
  • Authn-287: Add Metrics for Trust Services RBAC Extractor
  • CIAM-1733: Rbac Extractor emit 0 (healthy) HTTP status while closing or closed
  • AUTHN-515: TrustService Performance metrics
  • MDS-25 Prevent Credentials from be logged when Jetty prints debug auth headers
  • Authn-545: Update Extractor to publish organization id with IdentityPool record
  • CIAM-1671: Upgrade icc-rbac to be configurable via env var
  • CIAM-1733: Don’t emit Rbac Extractor HTTP status while closing
  • CIAM-1521: Build fat shaded jar for icc-rbac
  • CIAM-1695: Added BOUND_TO_PHYSICAL event for lifecycle.
  • Authn-523: Simplify code in JwksKeyRefreshSchedulerService
  • CIAM-1721: Temporary fix bug that Extractor cannot be automatically deploied to devel
  • CIAM-1700: Add unit tests for new KSQL namespace and roles definitions
  • Authn-511: Add LD FF for KeyRefreshSchedulerService
  • AUTHN-509: Enable Extractor for Trust Service in Devel
  • Authn-509: Temp grant access to cc_rbac_extractor_api_0 in devel
  • AUTHN-510: Minor fix in JWKS refresh scheduler
  • CIAM-1429: Upgrade icc-rbac to be configurable via file
  • [MDS-27] Protobuf version bump
  • AUTHN-506: Add trust service schema for rbac-extractor
  • CIAM-1669: Logging new created LKC events in INFO level.
  • CIAM-1648: Resource Pattern validation for v2 API
  • [MINOR] Fix assertion check on error string
  • [AUTHN-490] Fix exception handling in RefreshTask
  • BUGFIX: Clear PGOPTIONS so search_path doesn’t break dbmate
  • KSE-848: remove scheduler service role binding in stag and prod
  • test: update test for removed RBAC roles (CCloudConnectorManager + CCloudClusterRoleBindingAdmin)
  • CIAM-1618 - Updated devel schema.sql PR
  • KSE-848: remove scheduler service role binding in devel
  • AUTHN-490: handle deserialization exception in IdentityProviderManagerImpl
  • CIAM-1618 add functionality for internal rbac roles
  • Improved meters for capturing both db query duration and producer to events Kafka duration
  • CIAM-1631: Implement and test wildcard and prefix resource role bindings for V2 API
  • Change Trust-Service update routes to patch
  • Authn-120: JWKS scheduler Implementation
  • CIAM-1493: Reverted changes for RBAC Extractor load testing.
  • CIAM-1493: Updated events topics for RBAC Extractor load testing in DEVEL.
  • Update development process for ccloud
  • [AUTHN-460] Add OpenAPI spec for Assume Principal endpoint
  • BUGFIX: resourcePattern should be null for non-resource roles
  • CIAM-1490: Update Public API path from /v2 to /iam/v2
  • CIAM-1616: Run cloud.coop tests with the rest of MDS tests
  • KGLOBAL-969 : Adapt MDS tests to lookup brokerId
  • AUTHN-263: Fix interface API compatibility
  • KSE-715 Migrate scheduler admin in stag, prod
  • CIAM-1570 Add notificationserviceadmin rolebinding
  • Give RBAC user temp access to cts schema
  • CIAM-1436 Add input validation on ResourceName in rolebinding APIs
  • CIAM-1610 - Remove explicit usage of log4j2 from extractor class
  • CIAM-1138: Minor renaming of function parameter from jwt to credential for authorizer client
  • Dbmigration: Add Trust Service user Schema
  • TrustService devel migration scripts
  • CIAM-1594 - Add index to prod for knownScopes call
  • CIAM-540 - Enable pg_stat_statements in prod
  • CIAM-1594: Stag Create and apply rb_scope_idx_with_cluster_type dbmigration
  • CIAM-540: Stag Create extension pg_stat_statements dbmigration
  • CIAM-1450: Update one-off db creation & connection readme
  • CIAM-1594: Devel Create and apply rb_scope_idx_with_cluster_type dbmigration
  • CIAM-540: Devel Create extension pg_stat_statements dbmigration
  • test: update tests for new RBAC roles (CCloudConnectorManager + CCloudClusterRoleBindingAdmin)
  • Add CCloudClusterRoleBindingAdmin role binding for scheduler service
  • Authn-373 Support manual refresh for Trust Service data given Orgs
  • CIAM-1428: Adapt ParitySuite to run against icc-rbac
  • CIAM-1424: Upgrading OTEL from 1.4.1-alpha to 1.9.0-alpha
  • Add Configurable Authn to TrustService
  • Trust Service API Crud
  • Authn-340 Add RolePolicy table
  • Fix Content-Type for public API create request
  • CIAM-1451 Fix tests for new CCRoleBindingViewer role
  • CIAM-1494-1548: Added metrics for lifecycle dead letter queue and Kafka produce time.
  • CIAM-2018 This release version includes a fix to prevent stack trace exposure from getting surfaced in HTTP responses for malformed requests.

Replicator

  • KSECURITY-325: Migrate confluent-log4j to reload4j
  • fix upstream build
  • MINOR: Add CLUSTER level acls to fix build failures