Confluent Platform Component Changelogs¶
This topic provides changelogs for the individual Confluent Platform components.
Version 7.5.0¶
Released August 2023
Community Features¶
Common¶
- b4334b94 - Pin jose4j version
- 95ed5124 - Include snappy and jetty in the dependency management, cleanup jackson imports
- 27a3c1ca - APPSEC-2796: update guava
- PR-530 - Backport log redactor to CP patches.
- 9cce6f1e - Add log redactor dependency
- bd393b16 - AUDIT-1600: Updating logredactor version to 1.0.12
Kafka¶
- PR-930 - KSECURIYT-1859: upgrading netty to 4.1.96.Final (3.5)
- PR-13759 - KAFKA-15019: Improve handling of broker heartbeat timeouts (#13759)
- PR-13735 - KAFKA-15003: Fix ZK sync logic for partition assignments (#13735)
- PR-13758 - KAFKA-15010: ZK migration failover support (#13758)
- PR-13757 - KAFKA-15017: Fix snapshot load in dual write mode for ClientQuotas and SCRAM (#13757)
- PR-13786 - Upgrade snappy to v1.1.10.0 (#13786)
- PR-13767 - KAFKA-15004: Fix configuration dual-write during migration (#13767)
- PR-13781 - KAFKA-8713: JsonConverter replace.null.with.default should prevent emitting default for Struct fields (#13781)
- PR-13742 - KAFKA-14996: Handle overly large user operations on the kcontroller (#13742)
- PR-13741 - KAFKA-15009: Handle new ACLs in KRaft snapshot during migration (#13741)
- PR-13732 - KAFKA-15007: Use the correct MetadataVersion in MetadataPropagator (#13732)
- PR-13729 - KAFKA-14970: Fix SCRAM during migration dual-write (#13729)
- PR-13745 - KAFKA-15015: Explicit load of reload4j (#13745)
- PR-13723 - KAFKA-14980: Fix MirrorSourceConnector source consumer configuration (#13723)
- PR-13717 - KAFKA-14994: Update jose4j (#13717)
- PR-13690 - KAFKA-14978: ExactlyOnceWorkerSourceTask should remove parent metrics (#13690)
- PR-13660 - KAFKA-14662: Update the ACL list in the doc (#13660)
- PR-13688 - KAFKA-14974: Restore backward compatibility in KafkaBasedLog (#13688)
- PR-13461 - KAFKA-14840: Support for snapshots during ZK migration (#13461)
- PR-13628 - KAFKA-14859: SCRAM ZK to KRaft migration with dual write (#13628)
- PR-13653 - KAFKA-14946: Fix NPE when merging the deltatable (#13653)
- PR-13657 - KAFKA-14876: Document the new ‘PUT /connectors/{name}/stop’ REST API for Connect (#13657)
- PR-13631 - KAFKA-14909: Check zkMigrationReady tag before migration (#13631)
- PR-13407 - KAFKA-14805: KRaft controller supports pre-migration mode (#13407)
- PR-13550 - KAFKA-14639: A single partition may be revoked and assign during a single round of rebalance (#13550)
- PR-13606 - KAFKA-14918: Only send controller RPCs to migrating ZK brokers (#13606)
- 33962e8b - KAFKA-14943: Fix ClientQuotaControlManager validation
- PR-13429 - KAFKA-14666: Add MM2 in-memory offset translation index for offsets behind replication (#13429)
- PR-13533 - KAFKA-12446: Update change encoding to use varint (#13533)
- PR-13615 - KAFKA-14834: [12/N] Minor code cleanups relating to versioned stores (#13615)
- PR-13592 - KAFKA-14862: Outer stream-stream join does not output all results with multiple input partitions (#13592)
- PR-13587 - KAFKA-14876: Document the new ‘GET /connectors/{name}/offsets’ REST API for Connect (#13587)
- PR-13575 - KAFKA-14905: Reduce flakiness in MM2 ForwardingAdmin test due to admin timeouts (#13575)
- PR-13604 - KAFKA-14869: Bump coordinator value records to flexible versions (KIP-915, Part-2) (#13604)
- 03b41b54 - KAFKA-14887: FinalizedFeatureChangeListener should not shut down when ZK session expires
- 3f1e78ee - KAFKA-14887: FinalizedFeatureChangeListener should not shut down when ZK session expires
- PR-13579 - KAFKA-14904: Pending state blocked verification of transactions (#13579)
- PR-13614 - KAFKA-14586: Adding redirection for StreamsResetter (#13614)
- PR-13609 - KAFKA-14834: [11/N] Update table joins to identify out-of-order records with isLatest (#13609)
- PR-13513 - KAFKA-14881: Rework UserScramCredentialRecord (#13513)
- PR-13526 - KAFKA-14869: Bump coordinator value records to flexible versions (KIP-915, Part-2) (#13526)
- PR-13511 - KAFKA-14869: Ignore unknown record types for coordinators (KIP-915, Part-1) (#13511)
- PR-13567 - Update zstd to 1.5.5 (#13567)
- PR-12830 - KAFKA-8115: Reduce flakiness in Trogdor JsonRestServer shutdown (#12830)
- PR-13534 - KAFKA-14054: Handle TimeoutException gracefully (#13534)
- PR-13565 - KAFKA-14834: [9/N] Disable versioned-stores for unsupported operations (#13565)
- PR-13477 - KAFKA-7499: Handle serialization error in ProductionExceptionHandler (#13477)
- PR-13566 - KAFKA-14834: [10/N] Reserve repartition topic formats to include isLatest (#13566)
- PR-13564 - KAFKA-14834: [8/N] Propagate isLatest as part of Change (#13564)
- PR-13554 - KAFKA-14834: [7/N] Update VersionedKeyValueStore#put() to return validTo (#13554)
- PR-13552 - KAFKA-14834: [6/N] Add tracking of versioned tables into graph nodes (#13552)
- PR-13491 - KAFKA-14722: Make BooleanSerde public (an addition of upgrade.html changes) (#13491)
- PR-13505 - KAFKA-14462: [5/N] Add EventAccumulator (#13505)
- PR-13525 - KAFKA-14883: Expose observer state in KRaft metrics (#13525)
- PR-13522 - KAFKA-14834: [5/N] Drop out-of-order records from FK join with versioned tables (#13522)
- PR-13510 - KAFKA-14834: [4/N] Drop out-of-order records from table-table join with versioned tables (#13510)
- PR-13391 - KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction (#13391)
- PR-13509 - KAFKA-14834: [3/N] Timestamped lookups for stream-table joins (#13509)
- PR-13541 - KAFKA-14894: MetadataLoader must call finishSnapshot after loading a snapshot (#13541)
- PR-13462 - KAFKA-14857: Fix some MetadataLoader bugs (#13462)
- PR-13520 - KAFKA-14462: [4/N] Add Group, Record and Result (#13520)
- PR-13539 - KAFKA-14891: Fix rack-aware range assignor to assign co-partitioned subsets (#13539)
- PR-13487 - KAFKA-9550: Copying log segments to tiered storage in RemoteLogManager (#13487)
- PR-13497 - KAFKA-14834: [2/N] Test coverage for out-of-order data in joins (#13497)
- PR-13496 - KAFKA-14834: [1/N] Add timestamped get to KTableValueGetter (#13496)
- PR-13424 - KAFKA-14783: (KIP-875): New STOPPED state for connectors (#13424)
- PR-10747 - KAFKA-12446: Call subtractor before adder if key is the same (#10747)
- PR-13373 - KAFKA-14420: Use incrementalAlterConfigs API for syncing topic configurations in MirrorMaker 2 (KIP-894) (#13373)
- PR-13449 - KAFKA-14491: [22/N] Add test for manual upgrade to versioned store (#13449)
- PR-13345 - KAFKA-13020: Implement reading Snapshot log append timestamp (#13345)
- PR-13489 - KAFKA-14617: Fill broker epochs to the AlterPartitionRequest (#13489)
- PR-13269 - KAFKA-12634: enforce checkpoint after restoration (#13269)
- PR-12992 - KAFKA-14376: Add ConfigProvider to make use of environment variables KIP-887 (#12992)
- PR-13499 - KAFKA-14880: TransactionMetadata with producer epoch -1 should be expirable (#13499)
- PR-13369 - KAFKA-14172: Should clear cache when active recycled from standby (#13369)
- PR-13300 - KAFKA-10199: Add task updater metrics, part 2 (#13300)
- PR-13442 - KAFKA-14491: [20/N] Add public-facing methods for versioned stores (#13442)
- PR-13456 - KAFKA-14850: introduce InMemoryLeaderEpochCheckpoint (#13456)
- PR-13318 - KAFKA-14533: Do not interrupt state-updater thread during shutdown (#13318)
- PR-13374 - KAFKA-14765: and KAFKA-14776: Support for SCRAM at bootstrap with integration tests (#13374)
- PR-13470 - KAFKA-14864: Close iterator in KStream windowed aggregation emit on window close (#13470)
- PR-13431 - KAFKA-14491: [19/N] Combine versioned store RocksDB instances into one (#13431)
- PR-13364 - KAFKA-14491: [16/N] Add recovery logic for store inconsistency due to failed write (#13364)
- PR-13480 - Fix typos in security.html (#13480)
- PR-13325 - KAFKA-14771: Include threads info in ConcurrentModificationException message (#13325)
- PR-13350 - KAFKA-14452: Make sticky assignors rack-aware if client rack is configured (KIP-881) (#13350)
- PR-13434 - KAFKA-14785: (KIP-875): Connect offset read REST API (#13434)
- PR-13486 - Suppress exception in testExceptionInUpdateCoordinator (#13486)
- PR-13458 - KAFKA-14838: Add flow/connector/task/role information to MM2 Kafka client.id configs (#13458)
- PR-13474 - KAFKA-14867: Trigger rebalance when replica racks change if client.rack is configured (KIP-881) (#13474)
- PR-13483 - Use readlock for reading epochs in LeaderEpochFIleCache (#13483)
- PR-13408 - KAFKA-14617: Update AlterPartitionRequest and enable Kraft controller to reject stale request. (#13408)
- PR-13482 - Switch to SplittableRandom in ProducerPerformance utility (#13482)
- PR-13380 - KAFKA-14468: Committed API (#13380)
- PR-13440 - KAFKA-14829: Consolidate reassignment logic into PartitionReassignmentReplicas (#13440)
- PR-13472 - KAFKA-14774: the removed listeners should not be reconfigurable (#13472)
- PR-13460 - KAFKA-14853: the serializer/deserialize which extends ClusterResourceListener is not added to Metadata (#13460)
- PR-13445 - KAFKA-14843: Include Connect framework properties when retrieving connector config definitions (#13445)
- PR-13148 - KAFKA-14645: Use plugin classloader when retrieving connector plugin config definitions (#13148)
- PR-13446 - KAFKA-14837/14842: Avoid the rebalance caused by the addition and deletion of irrelevant groups for MirrorCheckPointConnector (#13446)
- PR-13127 - KAFKA-14586: Moving StreamResetter to tools (#13127)
- PR-13423 - KAFKA-14827: Support for StandardAuthorizer benchmark (#13423)
- PR-13368 - KAFKA-14796: Migrate ACLs from AclAuthorizor to KRaft (#13368)
- PR-13452 - KAFKA-14848: KafkaConsumer incorrectly passes locally-scoped serializers to FetchConfig (#13452)
- PR-13326 - KAFKA-14774: the removed listeners should not be reconfigurable (#13326)
- PR-13441 - Fix log DateTime format unit test (#13441)
- PR-13393 - KAFKA-10244: An new java interface to replace ‘kafka.common.MessageReader’ (#13393)
- PR-13425 - KAFKA-14365: Extract common logic from Fetcher (#13425)
- PR-13438 - KAFKA-14835: Create ControllerMetadataMetricsPublisher (#13438)
- PR-13382 - KAFKA-14722: Make BooleanSerde public (#13382)
- PR-13385 - KAFKA-14800: Bump snappy-java version to 1.1.9.1 (#13385)
- PR-13426 - KAFKA-14814: Skip Connect target state updates when the configs store has same state (#13426)
- PR-13340 - KAFKA-14491: [15/N] Add integration tests for versioned stores (#13340)
- PR-13409 - KAFKA-14491: [18/N] Update versioned store to check latest value on timestamped get (#13409)
- PR-13292 - KAFKA-14491: [14/N] Set changelog topic configs for versioned stores (#13292)
- PR-13420 - KAFKA-14740: Add source tag to MirrorSourceMetrics - KIP-911 (#13420)
- PR-13419 - KAFKA-8713: Allow using null for field in JsonConverter (KIP-581) (#13419)
- PR-13367 - KAFKA-14797: Emit offset sync when offset translation lag would exceed max.offset.lag (#13367)
- PR-13404 - KAFKA-14812:ProducerPerformance still counting successful sending in console when sending failed (#13404)
- PR-13398 - KAFKA-6891: send.buffer.bytes should be allowed to set -1 in KafkaConnect (#13398)
- PR-13362 - KAFKA-14795: Provide message formatter for RemoteLogMetadata (#13362)
- 361095a1 - KAFKA-14491: [17/N] Refactor segments cleanup logic
- PR-13415 - KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs (#13415)
- PR-13323 - KAFKA-14617: Add ReplicaState to FetchRequest (KIP-903) (#13323)
- PR-13386 - KAFKA-14809: Fix logging conditional on WorkerSourceTask (#13386)
- PR-13384 - KAFKA-14801: Encoded configs are not decoded before ZK migration (#13384)
- PR-13396 - KAFKA-13884: Only voters flush on Fetch response (#13396)
- PR-13378 - KAFKA-14793: Propagate Topic Ids to the Group Coordinator during Offsets Commit (#13378)
- PR-13379 - KAFKA-14799: Ignore source task requests to abort empty transactions (#13379)
- PR-13388 - KAFKA-14804: Update swagger plugin/dependencies to 2.2.8 (#13388)
- PR-13349 - KAFKA-14452: Refactor AbstractStickyAssignor to prepare for rack-aware assignment (#13349)
- PR-13258 - KAFKA-14447: remove stale TODO comment (#13258)
- PR-13301 - KAFKA-14758: Extract inner classes from Fetcher for reuse in refactoring (#13301)
- PR-13371 - Updating video links to ASF YouTube (#13371)
- PR-12813 - KAFKA-14317: ProduceRequest timeouts are logged as network exceptions (#12813)
- PR-13363 - KAFKA-14794: Decode base64 JSON string (#13363)
- PR-13351 - KAFKA-14781: Downgrade MM2 log message severity when no ACL authorizer is configured on source broker (#13351)
- PR-13067 - KAFKA-14524: Rewrite KafkaMetricsGroup in Java (#13067)
- PR-13357 - KAFKA-14462: [3/N] Add onNewMetadataImage to GroupCoordinator interface (#13357)
- PR-13354 - KAFKA-14753: Improve kafka producer example (#13354)
- PR-13353 - KAFKA-14752: Improving the existing consumer examples (#13353)
- PR-13303 - KAFKA-14761: Adding integration test for the prototype consumer (#13303)
- PR-13359 - KAFKA-14792: Race condition in LazyIndex.get() (#13359)
- PR-13116 - KAFKA-14351: Controller Mutation Quota for KRaft (#13116)
- PR-13231 - KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests (#13231)
- PR-13346 - KAFKA-14770: Allow dynamic keystore update for brokers if string representation of DN matches even if canonical DNs don’t match (#13346)
- PR-13329 - KAFKA-14462: [2/N] Add ConsumerGroupHeartbeart to GroupCoordinator interface (#13329)
- PR-13274 - KAFKA-14491: [13/N] Add versioned store builder and materializer (#13274)
- PR-883 - Update tags to match standards
- PR-13215 - KAFKA-14578: Move ConsumerPerformance to tools (#13215)
- PR-13304 - KAFKA-14726: Move/rewrite of LogReadInfo, LogOffsetSnapshot, LogStartOffsetIncrementReason to storage module (#13304)
- PR-13114 - KAFKA-14084: SCRAM support in KRaft. (#13114)
- PR-13328 - KAFKA-14745: Cache the ReplicationPolicy instance in MirrorConnectorConfig (#13328)
- PR-13264 - KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores (#13264)
- PR-13182 - KAFKA-14649: Isolate failures during plugin path scanning to single plugin classes (#13182)
- PR-13322 - KAFKA-14462: [1/N] Add new server configurations (KIP-848) (#13322)
- PR-13095 - KAFKA-14580: Moving EndToEndLatency from core to tools module (#13095)
- PR-13172 - KAFKA-14590: Move DelegationTokenCommand to tools (#13172)
- PR-13270 - KAFKA-14729: The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread (#13270)
- PR-13078 - KAFKA-13999: Add ProducerCount metrics (KIP-847) (#13078)
- PR-12990 - KAFKA-14451: Rack-aware consumer partition assignment for RangeAssignor (KIP-881) (#12990)
- PR-13102 - KAFKA-14371: Remove unused clusterId field from quorum-state file (#13102)
- PR-13190 - KAFKA-12639: Exit upon expired timer to prevent tight looping (#13190)
- PR-13184 - KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation (#13184)
- PR-13276 - KAFKA-14732: Use an exponential backoff retry mechanism while reconfiguring connector tasks (#13276)
- PR-13193 - KAFKA-14659: source-record-write-[rate|total] metrics should exclude filtered records (#13193)
- PR-13291 - KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs (#13291)
- PR-13191 - KAFKA-14060: Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTest (#13191)
- PR-13279 - KAFKA-14295: FetchMessageConversionsPerSec meter not recorded (#13279)
- PR-13297 - KAFKA-14743: update request metrics after callback (#13297)
- PR-13021 - KAFKA-14468: Implement CommitRequestManager to manage the commit and autocommit requests (#13021)
- PR-13206 - KAFKA-14685: Refactor logic to handle OFFSET_MOVED_TO_TIERED_STORAGE error (#13206)
- PR-13252 - KAFKA-14491: [11/N] Add metered wrapper for versioned stores (#13252)
- PR-13228 - KAFKA-10199: Add task updater metrics, part 1 (#13228)
- PR-13205 - KAFKA-14680: Upgrade gradle version from 7.6 to 8.0.1 (#13205)
- PR-13295 - KAFKA-14744: NPE while converting OffsetFetch from version < 8 to version >= 8 (#13295)
- PR-13263 - KAFKA-14728: Don’t run ‘spotlessScalaCheck’ in CI (#13263)
- PR-13052 - KAFKA-14545: Make MirrorCheckpointTask.checkpoint handle null OffsetAndMetadata gracefully (#13052)
- PR-13181 - KAFKA-14610: Publish Mirror Maker 2 offset syncs in task commit() method (#13181)
- PR-11818 - KAFKA-12558: Do not prematurely mutate internal partition state in Mirror Maker 2 (#11818)
- PR-13161 - KAFKA-14128: Kafka Streams does not handle TimeoutException (#13161)
- PR-13255 - KAFKA 14714: Move/Rewrite RollParams, LogAppendInfo, and LeaderHwChange to storage module. (#13255)
- PR-13251 - KAFKA-14491: [10/N] Add changelogging wrapper for versioned stores (#13251)
- PR-13025 - KAFKA-14299: Fix pause and resume with state updater (#13025)
- PR-13192 - KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher 1/4 (#13192)
- PR-13282 - KAKFA-14733: Added a few missing checks for Kraft Authorizer and updated AclAuthorizerTest to run tests for both zk and kraft (#13282)
- PR-13273 - KAFKA-14731: Upgrade ZooKeeper to 3.6.4 (#13273)
- PR-11976 - KAFKA-13771: Support to explicitly delete delegationTokens that have expired but have not been automatically cleaned up (#11976)
- PR-13244 - [MINOR] assert the cache size for each operation in RemoteIndexCacheTest (#13244)
- PR-13196 - KAFKA-14673: Add high watermark listener to Partition/Log layers (#13196)
- PR-13250 - KAFKA-14491: [9/N] Add versioned bytes store and supplier (#13250)
- PR-13248 - KAFKA-14717: KafkaStreams can’ get running if the rebalance happens be… (#13248)
- PR-13234 - KAFKA-14706: Move/rewrite ShutdownableThread to server-common module. (#13234)
- PR-13253 - KAFKA-14253: More informative logging (#13253)
- PR-13262 - KAFKA-14727: Enable periodic offset commits for EOS source tasks (#13262)
- PR-13168 - Kafka 14565: On failure, close AutoCloseable objects instantiated and configured by AbstractConfig (#13168)
- PR-13238 - KAFKA-14708: Use Java thread instead of kafka library for example purpose (#13238)
- PR-13208 - KAFKA-5756: Wait for concurrent source task offset flush to complete before starting next flush (#13208)
- PR-13249 - KAFKA-14491: [8/N] Add serdes for ValueAndTimestamp with null value (#13249)
- PR-13243 - KAFKA-14491: [7/N] Enforce strict grace period for versioned stores (#13243)
- PR-13207 - KAFKA-14664: Fix inaccurate raft idle ratio metric (#13207)
- b9754747 - KAFKA-14653: Use raw properties instead of post-resolution properties for MirrorMaker connectors(#13163)
- PR-13227 - KAFKA-14693: Kafka node should halt instead of exit (#13227)
- PR-13230 - KAFKA-14704: Follower should truncate before incrementing high watermark (#13230)
- PR-13189 - KAFKA-14491: [6/N] Support restoring RocksDB versioned store from changelog (#13189)
- PR-13241 - KAFKA-14711: kafaka-metadata-quorum.sh does not honor –command-confi… (#13241)
- PR-13225 - KAFKA-6793: Unused configuration logging appears to be noisy and unnecessary (#13225)
- PR-12366 - KAFKA-14021: Implement new KIP-618 APIs in MirrorSourceConnector (#12366)
- PR-13211 - KAFKA-14676: Include all SASL configs in login cache key to ensure clients in a JVM can use different OAuth configs (#13211)
- PR-13040 - KAFKA-14480: Move/Rewrite ProducerStateManager to storage module. (#13040)
- PR-13188 - KAFKA-14491: [5/N] Basic operations for RocksDB versioned store (#13188)
- PR-13202 - KAFKA-14513: Add broker side PartitionAssignor interface (#13202)
- PR-13167 - KAFKA-14650: Synchronize access to tasks inside task manager (#13167)
- PR-13183 - KAFKA-14668: Avoid unnecessary UMR during ZK migration (#13183)
- PR-13137 - KAFKA-15086, KAFKA-9981: Intra-cluster communication for Mirror Maker 2 (#13137)
- PR-12590 - KAFKA-7109: Close fetch sessions on close of consumer (#12590)
- PR-12972 - KAFKA-14391: Add ConsumerGroupHeartbeat API (#12972)
- PR-13203 - KAFKA-14048: Add new __consumer_offsets records from KIP-848 (#13203)
- PR-12984 - KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic (#12984)
- PR-13175 - KAFAK-14660: Fix divide-by-zero vulnerability (#13175)
- PR-13213 - KAFKA-14688: Move package org.apache.kafka.server.log.internals to org.apache.kafka.storage.internals.log (#13213)
- PR-13179 - KAFKA-10575: Add onRestoreSuspsnded to StateRestoreListener (#13179)
- PR-13046 - KAFKA-14551: Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module. (#13046)
- PR-13200 - KAFKA-14678: Move __consumer_offsets records from core to group-coordinator (#13200)
- PR-13107 - KAFKA-13972: Ensure replica state deleted after reassignment cancellation (#13107)
- PR-13143 - KAFKA-14491: [3/N] Add logical key value segments (#13143)
- PR-13186 - KAFKA-14491: [4/N] Improvements to segment value format for RocksDB versioned store (#13186)
- PR-879 - Set Owner and role tags for Vagrant EC2 instances
- PR-12777 - Replace EasyMock and PowerMock with Mockito - TimeOrderedWindowStoreTest (#12777)
- PR-880 - KC-2332: Upgrade netty to 4.1.86
- PR-13136 - KAFKA-14582: Move JmxTool to tools (#13136)
- PR-13126 - KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store (#13126)
- PR-13169 - KAFKA-14658: Do not open broker ports until we are ready to accept traffic (#13169)
- PR-12879 - KAFKA-14409: Clean ProcessorParameters from casting (#12879)
- 2e1947d2 - Bump version to 3.4.0
- PR-13142 - KAFKA-14491: [2/N] Refactor RocksDB store open iterator management (#13142)
- PR-13159 - KAFKA-14656: Send UMR first during ZK migration (#13159)
- PR-13131 - KAFKA-14628: Move CommandLineUtils and CommandDefaultOptions to tools (#13131)
- PR-13166 - KAFKA-14623: OAuth’s HttpAccessTokenRetriever potentially leaks secrets in logging (#13119) (#13166)
- PR-13140 - KAFKA-14644: Process should crash after failure in Raft IO thread (#13140)
- PR-13151 - KRaft brokers and controllesr should fail on Authorizer failure (#13151)
- 8c637b71 - Update muckrake version mapping
- PR-13119 - KAFKA-14623: OAuth’s HttpAccessTokenRetriever potentially leaks secrets in logging (#13119)
- PR-13156 - KAFKA-14533: re-enable ‘false’ and disable the ‘true’ parameter of SmokeTestDriverIntegrationTest (#13156)
- PR-13144 - KAFKA-14463: Close ConnectorClientConfigOverridePolicy instances (#13144)
- PR-13147 - KAFKA-14533: temporarily disable the ‘false’ parameter of SmokeTestDriverIntegrationTest (#13147)
- PR-12802 - KAFKA-14311: Cleanly cleanly stop connectors/tasks on Connect worker shutdown (#12802)
- PR-13080 - KAFKA-14575: Move ClusterTool to tools module (#13080)
- PR-13139 - Update outdated documentation. (#13139)
- PR-857 - CONFLUENT: Fix filter for not publishing streams upgrade test artifacts
- PR-853 - CONFLUENT: Skip publishing for kafka-streams-upgrade-system-tests
- PR-13112 - KAFKA-14367: Add internal APIs to the new GroupCoordinator interface (#13112)
- PR-13129 - KAFKA-14638: Elaborate when transaction.timeout.ms resets (#13129)
- PR-12821 - KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests (#12821)
- PR-13130 - KAFKA-14637: Fix upgrade compatibility issue from older versions to 3.4 (#13130)
- PR-12818 - Replace EasyMock with Mockito in streams tests (#12818)
- PR-13117 - KAFKA-14621: Disallow authorizers during ZK migration (#13117)
- PR-12902 - KAFKA-14367: Add OffsetDelete to the new GroupCoordinator interface (#12902)
- PR-13115 - Update ProducerConfig.java (#13115)
- PR-13108 - KAFKA-14618: Fix off by one error in snapshot id (#13108)
- PR-13106 - KAFKA-13709: (follow-up): Avoid mention of ‘exactly-once delivery’ or ‘delivery guarantees’ in Connect (#13106)
- PR-12901 - KAFKA-14367: Add TxnOffsetCommit to the new GroupCoordinator interface (#12901)
- PR-13085 - KAFKA-14568: Move FetchDataInfo and related to storage module (#13085)
- PR-13104 - KAFKA-14612: Make sure to write a new topics ConfigRecords to metadata log iff the topic is created (#13104)
- 8478bbb5 - KAFKA-14601: Improve exception handling in KafkaEventQueue #13089
- PR-12886 - KAFKA-14367: Add OffsetCommit to the new GroupCoordinator interface (#12886)
- PR-13017 - KAFKA-14530: Check state updater more often (#13017)
- PR-13103 - KAFKA-14304: Use boolean for ZK migrating brokers in RPC/record (#13103)
- PR-12301 - KAFKA-14003: Kafka Streams JUnit4 to JUnit5 migration part 2 (#12301)
- PR-13092 - KAFKA-14607: Move Scheduler/KafkaScheduler to server-common (#13092)
- PR-857 - CONFLUENT: Fix filter for not publishing streams upgrade test artifacts
- PR-13058 - KAFKA-14557: Lock metadata log dir (#13058)
- PR-12870 - KAFKA-14367: Add OffsetFetch to the new GroupCoordinator interface (#12870)
- PR-13032 - KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer (#13032)
- PR-13087 - KAFKA-14600: Reduce flakiness in ProducerIdExpirationTest (#13087)
- PR-13077 - KAFKA-14279: Add 3.3.x streams system tests (#13077)
- PR-12998 - KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller. (#12998)
- PR-13072 - KAFKA-14570: Fix parenthesis in verifyFullFetchResponsePartitions output (#13072)
- PR-13043 - KAFKA-14558: Move/Rewrite LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module (#13043)
- PR-13075 - KAFKA-9087: Replace log high watermark by future log high watermark wh… (#13075)
- 347042cc - KAFKA-14458: Introduce RPC support during ZK migration #13028
- PR-13001 - KAFKA-14446: Code style improvements for broker-to-controller forwarding (#13001)
- PR-13020 - KAFKA-14529: Use the MetadataVersion from ClusterConfig in ZK tests (#13020)
- PR-13076 - KAFKA-14279: Add 3.3.x to core compatibility tests (#13076)
- PR-13065 - KAFKA-14482: Move LoadedLogOffsets to storage module (#13065)
- 0e51a202 - KAFKA-14458: Introduce RPC support during ZK migration #13028
- PR-13073 - KAFKA-14571: Include rack info in ZkMetadataCache.getClusterMetadata (#13073)
- PR-13049 - KAFKA-14478: Move LogConfig/CleanerConfig and related to storage module (#13049)
- PR-13070 - KAFKA-14564: Upgrade netty to 4.1.86
- PR-13053 - KAFKA-13881: Add Storage package info (#13053)
- PR-13039 - KAFKA-14550: Move SnapshotFile and CorruptSnapshotException to storage module (#13039)
- PR-13061 - [MINOR] Update upgrade documentation for 3.4 (#13061)
- PR-13016 - KAFKA-14498: reduce the startup nodes to avoid timeout error (#13016)
- PR-12008 - KAFKA-13439: move upgrade note to stream upgrade doc (#12008)
- PR-12937 - KAFKA-13881: Add Connect package infos (#12937)
- PR-12613 - MINOT: Fix punctuation marks (#12613)
- PR-12166 - KAFKA-13817: Always sync nextTimeToEmit with wall clock (#12166)
- PR-853 - CONFLUENT: Skip publishing for kafka-streams-upgrade-system-tests
- PR-13048 - KAFKA-14554: Move ClassLoaderAwareRemoteStorageManagerTest to storage module (#13048)
- PR-13038 - KAFKA-14543: Move LogOffsetMetadata to storage module (#13038)
- PR-12936 - KAFKA-13881: Add Streams package infos (#12936)
- PR-12979 - KAFKA-14544: The “is-future” should be removed from metrics tags after future log becomes current log (#12979)
- PR-13042 - KAFKA-14476: Move OffsetMap and related to storage module (#13042)
- PR-13041 - KAFKA-14549: Move LogDirFailureChannel to storage module (#13041)
- PR-13036 - KAFKA-14534: Reduce flakiness in TransactionsExpirationTest (#13036)
- PR-13012 - KAFKA-14477: Move LogValidator and related to storage module (#13012)
- PR-12947 - KAFKA-6586: Refactor ConnectDistributed and ConnectStandalone to re-use shared logic (#12947)
- PR-12735 - KAFKA-14132: Replace EasyMock and PowerMock with Mockito in connect/runtime/ErrorHandlingTaskTest (#12735)
- PR-13014 - KAFKA-14461: Move StoreQueryIntegrationTest to junit5 and fixing logic in a couple of tests for finding active streams (#13014)
- PR-13023 - KAFKA-14532: Correctly handle failed fetch when partitions unassigned (#13023)
- PR-13026 - KAFKA-14299: Avoid interrupted exceptions during clean shutdown (#13026)
- PR-13010 - KAFKA-14475: Move TimeIndex/LazyIndex to storage module (#13010)
- PR-13019 - KAFKA-14531: Fix controller snapshot interval (#13019)
- PR-13011 - KAFKA-14521: Replace BrokerCompressionCodec with BrokerCompressionType (#13011)
- PR-13009 - KAFKA-14474: Move OffsetIndex to storage module (#13009)
- PR-12994 - KAFKA-14457: Controller metrics should only expose committed data (#12994)
- PR-12801 - KAFKA-14343: Upgrade tests for state updater (#12801)
- PR-13007 - KAFKA-14473: Move AbstractIndex to storage module (#13007)
- PR-12996 - KAFKA-14472: Move TransactionIndex and related to storage module (#12996)
- PR-12862 - KAFKA-14264: New logic to discover group coordinator (#12862)
- PR-12968 - KAFKA-14417: Address incompatible error code returned by broker from InitProducerId (#12968)
- PR-13013 - KAFKA-14466: Move ClassloaderAwareRemoteStorageManager to storage module (#13013)
- PR-12993 - Move IndexEntry and related to storage module (#12993)
- PR-11390 - KAFKA-13369: Follower fetch protocol changes for tiered storage. (#11390)
- PR-12961 - KAFKA-14446: API forwarding support from zkBrokers to the Controller (#12961)
- PR-12965 - KAFKA-14448: Let ZK brokers register with KRaft controller (#12965)
- PR-12856 - KAFKA-14392: Fix overly long request timeouts in BrokerToControllerChannelManager (#12856)
- PR-12946 - KAFKA-14427: ZK client support for migrations (#12946)
- PR-13000 - KAFKA-14496: Wrong Base64 encoder used by OIDC OAuthBearerLoginCallbackHandler (#13000)
- PR-12977 - Removing Multicasting partitioner for IQ (#12977)
- PR-12985 - KAFKA-13602: Remove unwanted logging in RecordCollectorImpl.java (#12985)
- PR-12858 - KAFKA-14367: Add DeleteGroups to the new GroupCoordinator interface (#12858)
- PR-12944 - KAFKA-14395: Add config to configure client supplier (#12944)
- PR-12729 - KAFKA-14285: Delete quota node in zookeeper when configs are empty (#12729)
- PR-12855 - KAFKA-14367: Add DescribeGroups to the new GroupCoordinator interface (#12855)
- PR-12956 - KAFKA-14379: Consumer should refresh preferred read replica on update metadata (#12956)
- PR-12971 - KAFKA-14454: Making unique StreamsConfig for tests (#12971)
- PR-12962 - KAFKA-14318: KIP-878, Introduce partition autoscaling configs (#12962)
- PR-12932 - KAFKA-14425: The Kafka protocol should support nullable structs (#12932)
- c6590ee2 - KAFKA-14435: Fix allow.everyone.if.no.acl.found config behavior for StandardAuthorizer
- PR-12935 - KAFKA-14432: RocksDBStore relies on finalizers to not leak memory (#12935)
- PR-12955 - KAFKA-14443: Close topic creation Admin clients in MM2 connectors (#12955)
- PR-12954 - KAFKA-14352: Rack-aware consumer partition assignment protocol changes (KIP-881) (#12954)
- PR-12893 - KAFKA-14260: Add synchronized to prefixScan method (#12893)
ksqlDB¶
- d3f0e149 - fix: fix compile error introduced by merge conflict resolution
- PR-10000 - fix: implement default method for schema registry client
- PR-9853 - feat: expose compaction and compression configs for RocksDB
- PR-9916 - docs: use https for repository
- PR-9911 - docs: upgrade pymdown-extensions and Pygments version
- PR-9880 - feat: add MD5 hash UDF
- e4d0bd7e - Upgrade netty to 4.1.87.Final
- PR-9810 - Bump minimist and mkdirp
- 4ce2d5f3 - fix: Replace regex in CommandParser with a split by space
- da83d1c6 - fix: Replace regex in CommandParser with a split by space
- PR-9876 - fix: check for tombstone before forwarding to sink
- PR-9868 - KSE-911: allow proxy protocol listeners in KSQL
- PR-9865 - bugfix: NPE for BigDecimal in CSV serializer
- PR-9856 - feat: Add metrics for pull query thread pools
- a5e1c5b5 - fix: Simplify regex in DdlDmlRequestValidators to avoid catastrophic backtracking
- PR-9851 - fix: Avoid calling context.fail() twice
- PR-9823 - fix: Set timeout for pull query forwarded requsts to 20s
- PR-9818 - fix: default to get authHeader if using basic
- PR-9812 - fix: catch TopicAuthorizationExceptions when getting topic config
- PR-9770 - Upgrade netty to 4.1.86 #2
- PR-9711 - fix: use args map instead of method args in generated java code
- f1feb1ab - SSEO-3393 - Add metatag for Zendesk search crawler
- PR-9772 - fix: complete transition to 7.5.x series
REST Proxy¶
- 3274c17d - KREST-11122: - Add note about empty response from endpoint
- a18ee85d - KREST-11122: - Add note about empty response from endpoint
- PR-1171 - Remove the use of non-public API MockTime
- PR-1170 - KREST-10646: Build break as a result of MockTime moving in Apache Kafka
- PR-1169 - KREST-10639: Tidy up batch produce
- PR-1166 - KREST-10244: Fix produce-request-rate metric
- PR-1165 - Disable integration test temporarily
- PR-1162 - KREST-10313: Prototype of batch REST Produce
- PR-1163 - KREST-10286: Example python code for produce streaming V3 API
- PR-1161 - Remove verbose log line
- PR-1158 - KREST-8294: Permit charset for v3 produce
- PR-1157 - KREST-4467: First part of reworking produce tests
- PR-1156 - KREST-10318: Topic create without DESCRIBE_CONFIGS
- PR-1154 - KREST-9968: Aggregated OpenAPI improvements
- PR-1142 - KREST-9691: Add integration tests for the produce rate-limits for a single tenant.
- PR-1153 - KREST-9559: Update lifecycle for Produce v3
- PR-1146 - KREST-5471: Tidy up descriptions of API operations
- PR-1144 - KREST-8221: Dynamic broker config improvements
- PR-1140 - KREST-2594: Fix principal format in OpenAPI spec
- PR-1139 - KREST-9401: Support STRING type in v3 produce API
- PR-1138 - KREST-6569: - Cope with partitions disappearing
- PR-1137 - KREST-1701: - Blank message for missing topic
- PR-1136 - KREST-5711: - Non-negative partition id for produce
- PR-1134 - KREST-8332: - Better error messages for query parameters
- PR-1135 - KREST-2863: - Validate topic name in createTopic
- PR-1132 - OpenAPI specification validation fixes
- PR-1131 - Error response improvements
- PR-1130 - Tidy up multi-record produce examples
- 24efcbe1 - Integration test to send larger message size data in produce
- PR-1126 - Required query parms and errors for ACL operations
- PR-1129 - Update readme for v3 API
- PR-1125 - KREST-7599: - add authorized_operations
- PR-1124 - KREST-4757: Fix example for replicas_assignments
- PR-1052 - Update README.md
- PR-1119 - KREST-1797: - CreateTopic returns partitions and repl factor
- PR-1114 - KREST-8943: Add an integration test with multiple consumers in parallel.
- a54dde7e - CNC-366: Update Jetty
- PR-395 - Don’t use DosFilter.Listener.onRequestOverLimit default to avoid verbosity
- PR-393 - KREST 8913 Jetty 429 metrics
- PR-384 - AUTHN-1586 Add optional latency SLO/SLA metrics in annotation
- PR-380 - Insert RequestLogHandler to the ServletContextHandler instead of putting in Handler collection
- PR-379 - Remove stacktrace in response when server throws BadMessageException
- 1ec7602c - KREST 9773 Handle InvalidTopicException correctly
- 8b251aa1 - Defer loading Conscrypt library
- PR-376 - KREST-8331: - Remove class names from exceptions
- PR-374 - Make SNI host check explicit
- 54cde302 - Add BoringSSL TLS provider with Conscrypt
- 5ae7042a - Add max buffer header size configs
Schema Registry¶
- ca7a941c - Fix merge issue
- PR-2719 - DGS-7826 DGS-7828 DGS-7830: Add DEK registry for CSFLE
- 3f0e1198 - DGS-7927: fix for io.grpc_grpc-protobuf
- a2933052 - throw IOException in BearerAuthCredentialProvider
- c67de210 - Fix exception handling
- 8cf3c48f - Update client/src/main/java/io/confluent/kafka/schemaregistry/client/SchemaRegistryClient.java
- 38bbe23f - Close SerDes
- 843787b4 - DSG-7861: Make BearerAuthCredentialProvider Closeable
- 9ef14fcd - Fix exception handling
- 049ba7bc - Update schema-serializer/src/main/java/io/confluent/kafka/formatter/SchemaMessageSerializer.java
- a6672805 - Update schema-serializer/src/main/java/io/confluent/kafka/formatter/SchemaMessageDeserializer.java
- dc8e8914 - Update client/src/main/java/io/confluent/kafka/schemaregistry/client/security/bearerauth/BearerAuthCredentialProvider.java
- 0388c541 - Update client/src/main/java/io/confluent/kafka/schemaregistry/client/SchemaRegistryClient.java
- PR-2717 - DGS-7976: Add tagging support for composite json schema
- PR-2716 - Upgrade wire to 4.8.0
- 0cf27170 - DGS-7797: Fix checkstyle errors
- 47296719 - DGS-7797: Introduce a new optional host.port config for inter instance communication
- PR-2699 - Minor: Fix entity order after converting list to map
- PR-2696 - DGS-7772: Impl POST /subjects/{subject}/versions/{version}/tags
- PR-2695 - do not reinstantiate objectmapper as it’s expensive (#2686)
- PR-2693 - DGS-7746: Fix perf regression due to DGS-6331
- 48101a91 - Fix merge issue
- PR-2692 - DGS-7723: Fix for qualifySubjectWithParent method
- PR-2690 - DGS-7697: Ensure version 0 is not returned in register response
- PR-2685 - DGS-7565: Add rule name validation
- 1e57cba0 - Fix merge issue
- PR-2684 - DGS-7675: Fix NPE when print.schema.ids=true
- PR-2683 - DGS-7682: Ensure correct tenant is passed when resolving refs
- PR-2679 - DGS-7668: DGS-7669: Ensure invalid defaults are dropped; also handle slash in aliases
- PR-2674 - DGS-7564: When registering, return schema if changed on server
- PR-2673 - Exclude metadata population during import mode
- PR-2670 - DGS-7488: Add X-Forward=true if forwarding request to leader
- 4a833e6e - reorder
- 1bf961b7 - Update json-schema
- PR-2665 - DGS-7208: DGS-7474: Fix some regressions
- PR-2664 - DGS-7208: DGS-7474: Add alias/normalize configs
- PR-2658 - DGS-7457: Cache schemas in client when getting by subject/version
- PR-2663 - Ensure compat check returns mutable lists
- 963677cd - Fix conflicts and delete duplicate methods
- 0f13c16e - Fix checkstyle
- 20526ee5 - Solve conflicts
- 119fcae0 - Fix duplicate variable httpConnectTimeoutMs definition
- e0626f64 - Update the test to make it clear to customer
- dc6f2096 - Update the doc
- 33659feb - Update schema-serializer/src/main/java/io/confluent/kafka/serializers/AbstractKafkaSchemaSerDeConfig.java
- 3ffd8fc7 - Update schema-serializer/src/main/java/io/confluent/kafka/serializers/AbstractKafkaSchemaSerDeConfig.java
- 1ca2a39d - Update the codes with checking string for http connect timeout
- ffba37fe - Change the config names
- PR-2635 - DGS-7289: Adding CustomBearerAuthCredentialProvider
- 7155f0fb - * Fix checkstyle error
- 7e2dec9c - * Remove unused import
- 9ab1b0ec - * Add defaults
- 89aa28be - * Made SR client http connect and read timeout configurable.
- PR-2655 - Enable use of service loader for CSFLE
- PR-2653 - Make DEK algorithm configurable for CSFLE
- PR-2644 - Add JSONata integration test
- PR-2654 - DGS-7432: Fix ClassCastException when getting params option
- PR-2652 - DGS-7430: Add auto.flush config for DlqAction
- PR-2647 - DGS-7422: Optimization: omit compat check during IMPORT
- PR-2646 - DGS-7412: Fix for registering references in non-default context
- PR-2645 - DGS-7407: Fix issues for numeric types in CEL_FIELD exprs
- 6e014ed0 - Fix merge issue
- PR-2643 - DGS-7375: DGS-7376: DlqAction enhancements, support ServiceLoader
- PR-2642 - DGS-7367: Propagate error messages even if not JSON
- PR-2640 - DGS-7363: Handle JsonNode objects in CEL executors
- PR-2614 - DGS-7103: Optimize instantiation of lists of schemas
- PR-2629 - RCCA-12410: Fix exception due to addition to immutable list
- PR-2639 - DGS-7353: Allow message references in CEL_FIELD exprs
- 7572f96c - Made classes public
- PR-2632 - DGS-7243: Add initialized method to determine extension readiness
- PR-2630 - Add a local SR client for internal use to SR
- dec6d308 - Made MutableHttpServletRequest case-insensitive
- 01b5d127 - Use a handler instead of filter for adding request ID
- 3e4e14f3 - Updated unittest
- 535615db - Added X-Request-ID header to all request and response headers
- PR-2625 - Static token provider: adding optional lsrc-id and pool-id
- PR-2617 - Update RestClientException.java
- PR-2556 - DGS-6065: Use HOST_NAME config for host even if inter.instance.listener.name is set
- PR-2554 - Remove kafka-server-common dependency
- e4f254af - Update README.md
- PR-2545 - Fix due to KAFKA-14706