Confluent Platform Component Changelogs

This topic provides changelogs for the individual Confluent Platform components.

Version 8.1.0

Released October 2025

Community Features

Common

  • bc7c5964 - Update jetty in rc branch
  • 76c8abea - Update netty to 4.1.125
  • 8f780906 - Update netty to 4.1.225
  • PR-830 - Upgrade protobuf to 31.1 to match ce-kafka
  • 348fe558 - Update jetty
  • a86ab6d5 - Update jetty, add bc-fips to renovatebot ignore file
  • PR-819 - Update dependency org.bouncycastle:bc-fips to v2.1.1
  • PR-814 - Update dependency org.bouncycastle:bcpkix-fips to v2.0.8
  • 94288a36 - Use correct versions of fips providers
  • 22a14027 - Revert renovatebot upgrade, use validated versions
  • cac21f69 - Update netty and auxilary bc-fips library
  • PR-810 - Update dependency org.bouncycastle:bc-fips to v2.1.0
  • PR-808 - Add license for assembly-plugin-boilerplate and build-tools modules
  • 79dbce2c - Update jackson bom to match ce-kafka version
  • 06637ab6 - Pin commons beanutils and validator
  • PR-799 - Update jetty 12 version
  • PR-797 - Update semaphore instance
  • PR-794 - Update node config for semaphore
  • PR-793 - Updating jackson version as per ce-kafka version upgrade
  • PR-791 - Updating versions as per ce-kafka version upgrade in PR #21588
  • 6ce9ebd5 - Update Probuf version to match ce-kafka
  • f11da56e - Upgrade spotbugs version
  • 5f835d66 - Downgrade the version to reflect logredactor re-release
  • 398fd1b3 - Update logredactor to address issues with versions 1 vs 2
  • PR-787 - Trigger cp-jar-build to verify CP packaging in after_pipeline job

Kafka

  • PR-20633 - KAFKA-19748: Fix metrics leak in Kafka Streams (#20633)
  • PR-20618 - KAFKA-19690 Add epoch check before verification guard check to prevent unexpected fatal error (#20618)
  • PR-20583 - [MINOR] Cleaning ignored streams test (#20583)
  • PR-20604 - KAFKA-19719 –no-initial-controllers should not assume kraft.version=1 (#20604)
  • PR-19961 - KAFKA-19390: Call safeForceUnmap() in AbstractIndex.resize() on Linux to prevent stale mmap of index files (#19961)
  • PR-20591 - KAFKA-19732, KAFKA-19716: Clear out coordinator snapshots periodically while loading (#20591)
  • PR-20581 - KAFKA-19546: Rebalance should be triggered by subscription change during group protocol downgrade (#20581)
  • PR-20519 - KAFKA-19695: Fix bug in redundant offset calculation. (#20516) (#20519)
  • PR-20512 - KAFKA-19679: Fix NoSuchElementException in oldest open iterator metric (#20512)
  • PR-20470 - KAFKA-19668: processValue() must be declared as value-changing operation (#20470)
  • 13f70256 - Bump version to 4.1.0
  • 70dd1ca2 - Revert “Bump version to 4.1.0”
  • PR-20405 - KAFKA-19642 Replace dynamicPerBrokerConfigs with dynamicDefaultConfigs (#20405)
  • PR-1777 - KSECURITY-2558: Bump jetty to version 12.0.25 in 4.1
  • PR-20070 - KAFKA-19429: Deflake streams_smoke_test, again (#20070)
  • PR-20398 - Revert “KAFKA-13722: remove usage of old ProcessorContext (#18292)” (#20398)
  • PR-1765 - DPA-1801 Add run_tags to worker-ami and aws-packer
  • PR-1746 - Change ci_tools import path
  • 23b64404 - Bump version to 4.1.0
  • 6340f437 - Revert “Bump version to 4.1.0”
  • de16dd10 - KAFKA-19581: Temporary fix for Streams system tests
  • PR-20269 - KAFKA-19576 Fix typo in state-change log filename after rotate (#20269)
  • PR-20274 - KAFKA-19529: State updater sensor names should be unique (#20262) (#20274)
  • PR-1708 - DPA-1675: In case of infra failure in ccs-kafka tag that as infra failure in testbreak
  • PR-20165 - KAFKA-19501 Update OpenJDK base image from buster to bullseye (#20165)
  • e14d849c - Bump version to 4.1.0
  • PR-20200 - KAFKA-19522: avoid electing fenced lastKnownLeader (#20200)
  • PR-20196 - KAFKA-19520 Bump Commons-Lang for CVE-2025-48924 (#20196)
  • PR-20040 - KAFKA-19427 Allow the coordinator to grow its buffer dynamically (#20040)
  • PR-20166 - KAFKA-19504: Remove unused metrics reporter initialization in KafkaAdminClient (#20166)
  • PR-20151 - KAFKA-19495: Update config for native image (v4.1.0) (#20151)
  • 610f0765 - Bump version to 4.1.0
  • PR-1684 - DPA-1489 migrate from vagrant to terraform
  • PR-1693 - Revert “Temporarily disable artifact publishing for the 4.1 branch.”
  • 57e81f20 - Bump version to 4.1.0
  • PR-20071 - KAFKA-19184: Add documentation for upgrading the kraft version (#20071)
  • PR-20116 - KAFKA-19444: Add back JoinGroup v0 & v1 (#20116)
  • PR-19964 - KAFKA-19397: Ensure consistent metadata usage in produce request and response (#19964)
  • PR-19971 - KAFKA-19042 Move ProducerSendWhileDeletionTest to client-integration-tests module (#19971)
  • PR-20100 - KAFKA-19453: Ignore group not found in share group record replay (#20100)
  • PR-20025 - KAFKA-19152: Add top-level documentation for OAuth flows (#20025)
  • PR-20029 - KAFKA-19379: Basic upgrade guide for KIP-1071 EA (#20029)
  • PR-20062 - KAFKA-19445: Fix coordinator runtime metrics sharing sensors (#20062)
  • PR-19704 - KAFKA-19246; OffsetFetch API does not return group level errors correctly with version 1 (#19704)
  • PR-19985 - KAFKA-19414: Remove 2PC public APIs from 4.1 until release (KIP-939) (#19985)
  • PR-1672 - DPA-1593 exclude newly added files to fix build
  • PR-1663 - DPA-1593 add cloudwatch metrics to view cpu, memory and disk usage
  • PR-20022 - KAFKA-19398: (De)Register oldest-iterator-open-since-ms metric dynamically (#20022)
  • PR-20033 - KAFKA-19383: Handle the deleted topics when applying ClearElrRecord (#20033)
  • PR-19745 - KAFKA-19294: Fix BrokerLifecycleManager RPC timeouts (#19745)
  • PR-19974 - KAFKA-19411: Fix deleteAcls bug which allows more deletions than max records per user op (#19974)
  • PR-19972 - KAFKA-19407 Fix potential IllegalStateException when appending to timeIndex (#19972)
  • PR-1659 - Reapply “KAFKA-18296 Remove deprecated KafkaBasedLog constructor (#18
  • PR-20019 - KAFKA-19429: Deflake streams_smoke_test (#20019)
  • PR-19999 - KAFKA-19421: Deflake streams_broker_down_resilience_test (#19999)
  • PR-20004 - KAFKA-19422: Deflake streams_application_upgrade_test (#20004)
  • PR-20005 - KAFKA-19423: Deflake streams_broker_bounce_test (#20005)
  • PR-19983 - KAFKA-19356: Prevent new consumer fetch assigned partitions not in explicit subscription (#19983)
  • PR-19917 - KAFKA-19297: Refactor AsyncKafkaConsumer’s use of Java Streams APIs in critical sections (#19917)
  • PR-19981 - KAFKA-19413: Extended AuthorizerIntegrationTest to cover StreamsGroupDescribe (#19981)
  • PR-19978 - KAFKA-19412: Extended AuthorizerIntegrationTest to cover StreamsGroupHeartbeat (#19978)
  • PR-19976 - KAFKA-19367: Follow up bug fix (#19976)
  • PR-19800 - KAFKA-14145; Faster KRaft HWM replication (#19800)
  • PR-1655 - Add back deprecated constructors in KafkaBasedLog
  • PR-19938 - KAFKA-19153: Add OAuth integration tests (#19938)
  • PR-19910 - KAFKA-19367: Fix InitProducerId with TV2 double-increments epoch if ongoing transaction is aborted (#19910)
  • PR-19814 - KAFKA-18117; KAFKA-18729: Use assigned topic IDs to avoid full metadata requests on broker-side regex (#19814)
  • PR-19904 - KAFKA-18961: Time-based refresh for server-side RE2J regex (#19904)
  • PR-19939 - KAFKA-19359: force bump commons-beanutils for CVE-2025-48734 (#19939)
  • b311ac7d - Temporarily disable artifact publishing for the 4.1 branch.
  • PR-19607 - KAFKA-19221 Propagate IOException on LogSegment#close (#19607)
  • PR-19928 - KAFKA-19389: Fix memory consumption for completed share fetch requests (#19928)
  • PR-19895 - KAFKA-19244: Add support for kafka-streams-groups.sh options (delete offsets) [4/N] (#19895)
  • PR-19908 - KAFKA-19376: Throw an error message if any unsupported feature is used with KIP-1071 (#19908)
  • PR-19936 - KAFKA-19392 Fix metadata.log.segment.ms not being applied (#19936)
  • PR-19919 - KAFKA-19382:Upgrade junit from 5.10 to 5.13 (#19919)
  • PR-19929 - KAFKA-18486 Remove becomeLeaderOrFollower from readFromLogWithOffsetOutOfRange and other related methods. (#19929)
  • PR-19931 - KAFKA-19283: Update transaction exception handling documentation (#19931)
  • PR-19832 - KAFKA-19271: allow intercepting internal method call (#19832)
  • PR-19918 - KAFKA-19386: Correcting ExpirationReaper thread names from Purgatory (#19918)
  • PR-19817 - KAFKA-19334 MetadataShell execution unintentionally deletes lock file (#19817)
  • PR-19922 - KAFKA-18486 Remove ReplicaManager#becomeLeaderOrFollower from testReplicaAlterLogDirs (#19922)
  • PR-19827 - KAFKA-19042 Move PlaintextConsumerSubscriptionTest to client-integration-tests module (#19827)
  • PR-19883 - KAFKA-18486 Update testExceptionWhenUnverifiedTransactionHasMultipleProducerIds (#19883)
  • PR-19890 - KAFKA-18486 Update activeProducerState wih KRaft mechanism in ReplicaManagerTest (#19890)
  • PR-19879 - KAFKA-14895 [1/N] Move AddPartitionsToTxnManager files to java (#19879)
  • PR-19915 - KAFKA-19295: Remove AsyncKafkaConsumer event ID generation (#19915)
  • PR-19902 - KAFKA-18202: Add rejection for non-zero sequences in TV2 (KIP-890) (#19902)
  • PR-15913 - KAFKA-19309 : Add transaction client template code in kafka examples (#15913)
  • PR-19900 - KAFKA-19369: Add group.share.assignors config and integration test (#19900)
  • PR-19815 - KAFKA-19290: Exploit mapKey optimisation in protocol requests and responses (wip) (#19815)
  • PR-19889 - KAFKA-18913: Start state updater in task manager (#19889)
  • PR-19907 - KAFKA-19370: Create JMH benchmark for share group assignor (#19907)
  • PR-19773 - KAFKA-19042 Move PlaintextConsumerAssignTest to clients-integration-tests module (#19773)
  • PR-18739 - KAFKA-16505: Add source raw key and value (#18739)
  • PR-19903 - KAFKA-19373 Fix protocol name comparison (#19903)
  • PR-18325 - KAFKA-19248: Multiversioning in Kafka Connect - Plugin Loading Isolation Tests (#18325)
  • PR-19844 - KAFKA-18042: Reject the produce request with lower producer epoch early (KIP-890) (#19844)
  • PR-19901 - KAFKA-19372: StreamsGroup not subscribed to a topic when empty (#19901)
  • PR-19722 - KAFKA-19044: Handle tasks that are not present in the current topology (#19722)
  • PR-19856 - KAFKA-17747: [7/N] Add consumer group integration test for rack aware assignment (#19856)
  • PR-19898 - KAFKA-19347 Deduplicate ACLs when creating (#19898)
  • PR-19872 - KAFKA-19328: SharePartitionManagerTest testMultipleConcurrentShareFetches doAnswer chaining needs verification (#19872)
  • PR-19758 - KAFKA-19244: Add support for kafka-streams-groups.sh options (delete all groups) [2/N] (#19758)
  • PR-19754 - KAFKA-18573: Add support for OAuth jwt-bearer grant type (#19754)
  • PR-19656 - KAFKA-19250 : txnProducer.abortTransaction() API should not return abortable exception (#19656)
  • PR-19522 - KAFKA-19176: Update Transactional producer to translate retriable into abortable exceptions (#19522)
  • PR-19796 - KAFKA-17747: [6/N] Replace subscription metadata with metadata hash in share group (#19796)
  • PR-19802 - KAFKA-17747: [5/N] Replace subscription metadata with metadata hash in stream group (#19802)
  • PR-19861 - KAFKA-19338: Error on read/write of uninitialized share part. (#19861)
  • PR-19878 - KAFKA-19358: Updated share_consumer_test.py tests to use set_group_offset_reset_strategy (#19878)
  • PR-19849 - KAFKA-19349 Move CreateTopicsRequestWithPolicyTest to clients-integration-tests (#19849)
  • PR-19877 - KAFKA-18904: [4/N] Add ListClientMetricsResources metric if request is v0 ListConfigResources (#19877)
  • PR-19811 - KAFKA-19320: Added share_consume_bench_test.py system tests (#19811)
  • PR-19831 - KAFKA-16894: share.version becomes stable feature for preview (#19831)
  • PR-19836 - KAFKA-19321: Added share_consumer_performance.py and related system tests (#19836)
  • PR-19866 - KAFKA-19355 Remove interBrokerListenerName from ClusterControlManager (#19866)
  • PR-19327 - KAFKA-19053 Remove FetchResponse#of which is not used in production … (#19327)
  • PR-19728 - KAFKA-19284 Add documentation to clarify the behavior of null values for all partitionsToOffsetAndMetadata methods. (#19728)
  • PR-19864 - KAFKA-19311 Document commitAsync behavioral differences between Classic and Async Consumer (#19864)
  • PR-19685 - KAFKA-19042 Move GroupAuthorizerIntegrationTest to clients-integration-tests module (#19685)
  • PR-19651 - KAFKA-19042 Move BaseConsumerTest, SaslPlainPlaintextConsumerTest to client-integration-tests module (#19651)
  • PR-19846 - KAFKA-19346: Move LogReadResult to server module (#19846)
  • PR-19855 - KAFKA-19351: AsyncConsumer#commitAsync should copy the input offsets (#19855)
  • PR-19810 - KAFKA-19042 move ConsumerWithLegacyMessageFormatIntegrationTest to clients-integration-tests module (#19810)
  • PR-19808 - KAFKA-18904: kafka-configs.sh return resource doesn’t exist message [3/N] (#19808)
  • PR-19714 - KAFKA-19082:[4/4] Complete Txn Client Side Changes (KIP-939) (#19714)
  • PR-19404 - KAFKA-6629: parameterise SegmentedCacheFunctionTest for session key schemas (#19404)
  • PR-19843 - KAFKA-19337: Write state writes snapshot for higher state epoch. (#19843)
  • PR-19741 - KAFKA-19056 Rewrite EndToEndClusterIdTest in Java and move it to the server module (#19741)
  • PR-19774 - KAFKA-19316: added share_group_command_test.py system tests (#19774)
  • PR-19838 - KAFKA-19344: Replace desc.assignablePartitions with spec.isPartitionAssignable. (#19838)
  • PR-19840 - KAFKA-19347 Don’t update timeline data structures in createAcls (#19840)
  • PR-19826 - KAFKA-19342: Authorization tests for alter share-group offsets (#19826)
  • PR-19818 - KAFKA-19335: Membership managers send negative epoch in JOINING (#19818)
  • PR-19778 - KAFKA-19285: Added more tests in SharePartitionManagerTest (#19778)
  • PR-19823 - KAFKA-19310: (MINOR) Missing mocks for DelayedShareFetchTest tests related to Memory Records slicing (#19823)
  • PR-19761 - KAFKA-17747: [4/N] Replace subscription metadata with metadata hash in consumer group (#19761)
  • PR-19835 - KAFKA-19336 Upgrade Jackson to 2.19.0 (#19835)
  • PR-19744 - KAFKA-19154; Offset Fetch API should return INVALID_OFFSET if requested topic id does not match persisted one (#19744)
  • PR-19812 - KAFKA-19330 Change MockSerializer/Deserializer to use String serializer instead of byte[] (#19812)
  • PR-19790 - KAFKA-18687: Setting the subscriptionMetadata during conversion to consumer group (#19790)
  • PR-19786 - KAFKA-19268 Missing mocks for SharePartitionManagerTest tests (#19786)
  • PR-19798 - KAFKA-19322 Remove the DelayedOperation constructor that accepts an external lock (#19798)
  • PR-19779 - KAFKA-19300 AsyncConsumer#unsubscribe always timeout due to GroupAuthorizationException (#19779)
  • PR-19093 - KAFKA-18424: Consider splitting PlaintextAdminIntegrationTest#testConsumerGroups (#19093)
  • PR-19371 - KAFKA-19080 The constraint on segment.ms is not enforced at topic level (#19371)
  • PR-19681 - KAFKA-19034 [1/N] Rewrite RemoteTopicCrudTest by ClusterTest and move it to storage module (#19681)
  • PR-19759 - KAFKA-19312 Avoiding concurrent execution of onComplete and tryComplete (#19759)
  • PR-19767 - KAFKA-19313 Replace LogOffsetMetadata#UNIFIED_LOG_UNKNOWN_OFFSET by UnifiedLog.UNKNOWN_OFFSET (#19767)
  • PR-19747 - KAFKA-18345; Wait the entire election timeout on election loss (#19747)
  • PR-19687 - KAFKA-19260 Move LoggingController to server module (#19687)
  • PR-18929 - KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets (#18929)
  • PR-19729 - KAFKA-19069 DumpLogSegments does not dump the LEADER_CHANGE record (#19729)
  • PR-19781 - KAFKA-19204: Add timestamp to share state metadata init maps [1/N] (#19781)
  • PR-19582 - KAFKA-19042 Move PlaintextConsumerPollTest to client-integration-tests module (#19582)
  • PR-19763 - KAFKA-19314 Remove unnecessary code of closing snapshotWriter (#19763)
  • PR-19743 - KAFKA-18904: Add Admin#listConfigResources [2/N] (#19743)
  • PR-19757 - KAFKA-19291: Increase the timeout of remote storage share fetch requests in purgatory (#19757)
  • PR-18951 - KAFKA-4650: Add unit tests for GraphNode class (#18951)
  • PR-19749 - KAFKA-19287 document all group coordinator metrics (#19749)
  • PR-19731 - KAFKA-18783 : Extend InvalidConfigurationException related exceptions (#19731)
  • PR-19658 - KAFKA-18345; Prevent livelocked elections (#19658)
  • PR-1627 - Trigger cp-jar-build to verify CP packaging in after_pipeline job
  • PR-19755 - KAFKA-19302 Move ReplicaState and Replica to server module (#19755)
  • PR-19389 - KAFKA-19042 Move PlaintextConsumerCommitTest to client-integration-tests module (#19389)
  • PR-19611 - KAFKA-17747: [3/N] Get rid of TopicMetadata in SubscribedTopicDescriberImpl (#19611)
  • PR-19700 - KAFKA-19202: Enable KIP-1071 in streams_eos_test (#19700)
  • PR-19717 - KAFKA-19280: Fix NoSuchElementException in UnifiedLog (#19717)
  • PR-19691 - KAFKA-19256: Only send IQ metadata on assignment changes (#19691)
  • PR-19708 - KAFKA-19226: Added test_console_share_consumer.py (#19708)
  • PR-19683 - KAFKA-19141; Persist topic id in OffsetCommit record (#19683)
  • PR-19697 - KAFKA-19271: Add internal ConsumerWrapper (#19697)
  • PR-1625 - Increase timeout for Connect tests
  • PR-19734 - KAFKA-19217: Fix ShareConsumerTest.testComplexConsumer flakiness. (#19734)
  • PR-19507 - KAFKA-19171: Kafka Streams crashes with UnsupportedOperationException (#19507)
  • PR-19709 - KAFKA-19267 the min version used by ListOffsetsRequest should be 1 rather than 0 (#19709)
  • PR-19580 - KAFKA-19208: KStream-GlobalKTable join should not drop left-null-key record (#19580)
  • PR-19493 - KAFKA-18904: [1/N] Change ListClientMetricsResources API to ListConfigResources (#19493)
  • PR-19713 - KAFKA-19274; Group Coordinator Shards are not unloaded when __consumer_offsets topic is deleted (#19713)
  • PR-19701 - KAFKA-19231-1: Handle fetch request when share session cache is full (#19701)
  • PR-19721 - KAFKA-19281: Add share enable flag to periodic jobs. (#19721)
  • PR-19523 - KAFKA-17747: [2/N] Add compute topic and group hash (#19523)
  • PR-19698 - KAFKA-19269 Unexpected error .. should not happen when the delete.topic.enable is false (#19698)
  • PR-19718 - KAFKA-19270: Remove Optional from ClusterInstance#controllerListenerName() return type (#19718)
  • PR-19539 - KAFKA-19082:[3/4] Add prepare txn method (KIP-939) (#19539)
  • PR-19586 - KAFKA-18666: Controller-side monitoring for broker shutdown and startup (#19586)
  • PR-19635 - KAFKA-19234: broker should return UNAUTHORIZATION error for non-existing topic in produce request (#19635)
  • PR-19702 - KAFKA-19273 Ensure the delete policy is configured when the tiered storage is enabled (#19702)
  • PR-19553 - KAFKA-19091 Fix race condition in DelayedFutureTest (#19553)
  • PR-19666 - KAFKA-19116, KAFKA-19258: Handling share group member change events (#19666)
  • PR-19569 - KAFKA-19206 ConsumerNetworkThread.cleanup() throws NullPointerException if initializeResources() previously failed (#19569)
  • PR-19712 - KAFKA-19275 client-state and thread-state metrics are always “Unavailable” (#19712)
  • PR-19630 - KAFKA-19145 Move LeaderEndPoint to Server module (#19630)
  • PR-19622 - KAFKA-18847: Refactor OAuth layer to improve reusability 1/N (#19622)
  • PR-19677 - KAFKA-18688: Fix uniform homogeneous assignor stability (#19677)
  • PR-19659 - KAFKA-19253: Improve metadata handling for share version using feature listeners (1/N) (#19659)
  • PR-19559 - KAFKA-19201: Handle deletion of user topics part of share partitions. (#19559)
  • PR-19515 - KAFKA-14691; Add TopicId to OffsetFetch API (#19515)
  • PR-19705 - KAFKA-19245: Updated default locks config for share group (#19705)
  • PR-19496 - KAFKA-19163: Avoid deleting groups with pending transactional offsets (#19496)
  • PR-1554 - Chore: update repo by service bot
  • PR-19644 - KAFKA-18905; Disable idempotent producer to remove test flakiness (#19644)
  • PR-19631 - KAFKA-19242: Fix commit bugs caused by race condition during rebalancing. (#19631)
  • PR-19497 - KAFKA-19160;KAFKA-19164; Improve performance of fetching stable offsets (#19497)
  • PR-19633 - KAFKA-18695 Remove quorum=kraft and kip932 from all integration tests (#19633)
  • PR-19673 - KAFKA-19264 Remove fallback for thread pool sizes in RemoteLogManagerConfig (#19673)
  • PR-19346 - KAFKA-19068 Eliminate the duplicate type check in creating ControlRecord (#19346)
  • PR-19543 - KAFKA-19109 Don’t print null in kafka-metadata-quorum describe status (#19543)
  • PR-19650 - KAFKA-19220 Add tests to ensure the internal configs don’t return by public APIs by default (#19650)
  • PR-1623 - KBROKER-295: Ignore failing quota_test
  • PR-1622 - KBROKER-295: Ignore failing quota_test
  • PR-19508 - KAFKA-17897: Deprecate Admin.listConsumerGroups [2/N] (#19508)
  • PR-19657 - KAFKA-19209: Clarify index.interval.bytes impact on offset and time index (#19657)
  • PR-18391 - KAFKA-18115; Fix for loading big files while performing load tests (#18391)
  • PR-19608 - KAFKA-19182 Move SchedulerTest to server module (#19608)
  • PR-19568 - KAFKA-19087 Move TransactionState to transaction-coordinator module (#19568)
  • PR-19581 - KAFKA-18855 Slice API for MemoryRecords (#19581)
  • PR-19590 - KAFKA-19212: Correct the unclean leader election metric calculation (#19590)
  • PR-19609 - KAFKA-19214: Clean up use of Optionals in RequestManagers.entries() (#19609)
  • PR-19640 - KAFKA-19241: Updated tests in ShareFetchAcknowledgeRequestTest to reuse the socket for subsequent requests (#19640)
  • PR-19598 - KAFKA-19215: Handle share partition fetch lock cleanly using tokens (#19598)
  • PR-19625 - KAFKA-19202: Enable KIP-1071 in streams_standby_replica_test.py (#19625)
  • PR-19602 - KAFKA-19218: Add missing leader epoch to share group state summary response (#19602)
  • PR-19574 - KAFKA-19207 Move ForwardingManagerMetrics and ForwardingManagerMetricsTest to server module (#19574)
  • PR-19528 - KAFKA-19170 Move MetricsDuringTopicCreationDeletionTest to client-integration-tests module (#19528)
  • PR-19612 - KAFKA-19227: Piggybacked share fetch acknowledgements performance issue (#19612)
  • PR-19639 - KAFKA-19216: Eliminate flakiness in kafka.server.share.SharePartitionTest (#19639)
  • PR-19592 - KAFKA-19133: Support fetching for multiple remote fetch topic partitions in a single share fetch request (#19592)
  • PR-19641 - KAFKA-19240 Move MetadataVersionIntegrationTest to clients-integration-tests module (#19641)
  • PR-19619 - KAFKA-19232: Handle Share session limit reached exception in clients. (#19619)
  • PR-19629 - KAFKA-19131: Adjust remote storage reader thread maximum pool size to avoid illegal argument (#19629)
  • PR-19393 - KAFKA-19060 Documented null edge cases in the Clients API JavaDoc (#19393)
  • PR-19578 - KAFKA-19205: inconsistent result of beginningOffsets/endoffset between classic and async consumer with 0 timeout (#19578)
  • PR-19571 - KAFKA-18267 Add unit tests for CloseOptions (#19571)
  • PR-19603 - KAFKA-19204: Allow persister retry of initializing topics. (#19603)
  • PR-1621 - Dexcom fix master
  • PR-1620 - Dexcom fix 4.0
  • PR-19475 - KAFKA-19146 Merge OffsetAndEpoch from raft to server-common (#19475)
  • PR-19606 - KAFKA-16894 Correct definition of ShareVersion (#19606)
  • PR-19355 - KAFKA-19073 add transactional ID pattern filter to ListTransactions (#19355)
  • PR-19430 - KAFKA-17541:[1/2] Improve handling of delivery count (#19430)
  • PR-19329 - KAFKA-19015: Remove share session from cache on share consumer connection drop (#19329)
  • PR-19540 - KAFKA-19169: Enhance AuthorizerIntegrationTest for share group APIs (#19540)
  • PR-19604 - KAFKA-19202: Enable KIP-1071 in streams_relational_smoke_test (#19604)
  • PR-19587 - KAFKA-16718-4/n: ShareGroupCommand changes for DeleteShareGroupOffsets admin call (#19587)
  • PR-19601 - KAFKA-19210: resolved the flakiness in testShareGroupHeartbeatInitializeOnPartitionUpdate (#19601)
  • PR-19542 - KAFKA-16894: Exploit share feature [3/N] (#19542)
  • PR-19594 - KAFKA-19202: Enable KIP-1071 in streams_broker_down_resilience_test (#19594)
  • PR-19509 - KAFKA-19173: Add Feature for “streams” group (#19509)
  • PR-19191 - KAFKA-18760: Deprecate Optional<String> and return String from public Endpoint#listener (#19191)
  • PR-19519 - KAFKA-19139 Plugin#wrapInstance should use LinkedHashMap instead of Map (#19519)
  • PR-19588 - KAFKA-19135 Migrate initial IQ support for KIP-1071 from feature branch to trunk (#19588)
  • PR-15968 - KAFKA-10551: Add topic id support to produce request and response (#15968)
  • PR-19470 - KAFKA-19082: [2/4] Add preparedTxnState class to Kafka Producer (KIP-939) (#19470)
  • PR-19584 - KAFKA-19202: Enable KIP-1071 in streams_broker_bounce_test.py (#19584)
  • PR-19593 - KAFKA-19181-2: Increased offsets.commit.timeout.ms value as a temporary solution for the system test test_broker_failure failure (#19593)
  • PR-19560 - KAFKA-19202: Enable KIP-1071 in streams_smoke_test.py (#19560)
  • PR-19555 - KAFKA-19195: Only send the right group ID subset to each GC shard (#19555)
  • PR-19535 - KAFKA-19183 Replace Pool with ConcurrentHashMap (#19535)
  • PR-19529 - KAFKA-19178 Replace Vector by ArrayList for PluginClassLoader#getResources (#19529)
  • PR-19478 - KAFKA-16718-3/n: Added the ShareGroupStatePartitionMetadata record during deletion of share group offsets (#19478)
  • PR-19520 - KAFKA-19042 Move PlaintextConsumerFetchTest to client-integration-tests module (#19520)
  • PR-19532 - KAFKA-19131: Adjust remote storage reader thread maximum pool size to avoid illegal argument (#19532)
  • PR-19504 - KAFKA-17747: [1/N] Add MetadataHash field to Consumer/Share/StreamGroupMetadataValue (#19504)
  • PR-19544 - KAFKA-19190: Handle shutdown application correctly (#19544)
  • PR-19552 - KAFKA-19198: Resolve NPE when topic assigned in share group is deleted (#19552)
  • PR-19548 - KAFKA-19195: Only send the right group ID subset to each GC shard (#19548)
  • PR-19450 - KAFKA-19128: Kafka Streams should not get offsets when close dirty (#19450)
  • PR-19545 - KAFKA-19192; Old bootstrap checkpoint files cause problems updated servers (#19545)
  • PR-17988 - KAFKA-18988: Connect Multiversion Support (Updates to status and metrics) (#17988)
  • PR-19429 - KAFKA-19082: [1/4] Add client config for enable2PC and overloaded initProducerId (KIP-939) (#19429)
  • PR-19536 - KAFKA-18889: Make records in ShareFetchResponse non-nullable (#19536)
  • PR-19457 - KAFKA-19110: Add missing unit test for Streams-consumer integration (#19457)
  • PR-19440 - KAFKA-15767 Refactor TransactionManager to avoid use of ThreadLocal (#19440)
  • PR-19453 - KAFKA-19124: Follow up on code improvements (#19453)
  • PR-19443 - KAFKA-18170: Add scheduled job to snapshot cold share partitions. (#19443)
  • PR-19505 - KAFKA-19156: Streamlined share group configs, with usage in ShareSessionCache (#19505)
  • PR-19541 - KAFKA-19181: removed assertions in test_share_multiple_partitions as a result of change in assignor algorithm (#19541)
  • PR-19461 - KAFKA-14690; Add TopicId to OffsetCommit API (#19461)
  • PR-19416 - KAFKA-16538; Enable upgrading kraft version for existing clusters (#19416)
  • PR-18673 - KAFKA-18572: Update Kafka Streams metric documenation (#18673)
  • PR-19500 - KAFKA-19159: Removed time based evictions for share sessions (#19500)
  • PR-19378 - KAFKA-19057: Stabilize KIP-932 RPCs for AK 4.1 (#19378)
  • PR-19518 - KAFKA-19166: Fix RC tag in release script (#19518)
  • PR-19525 - KAFKA-19179: remove the dot from thread_dump_url (#19525)
  • PR-19437 - KAFKA-19019: Add support for remote storage fetch for share groups (#19437)
  • PR-17099 - KAFKA-8830 make Record Headers available in onAcknowledgement (#17099)
  • PR-19526 - KAFKA-19180 Fix the hanging testPendingTaskSize (#19526)
  • PR-19302 - KAFKA-14487: Move LogManager static methods/fields to storage module (#19302)
  • PR-19487 - KAFKA-18854 remove DynamicConfig inner class (#19487)
  • PR-19286 - KAFKA-18891: Add KIP-877 support to RemoteLogMetadataManager and RemoteStorageManager (#19286)
  • PR-19462 - KAFKA-17184: Fix the error thrown while accessing the RemoteIndexCache (#19462)
  • PR-19477 - KAFKA-17897 Deprecate Admin.listConsumerGroups (#19477)
  • PR-18926 - KAFKA-18332 fix ClassDataAbstractionCoupling problem in KafkaRaftClientTest(1/2) (#18926)
  • PR-19465 - KAFKA-19136 Move metadata-related configs from KRaftConfigs to MetadataLogConfig (#19465)
  • PR-19503 - KAFKA-19157: added group.share.max.share.sessions config (#19503)
  • PR-1614 - CONFLUENT: Fix tools-log4j files in the scripts
  • PR-1613 - CONFLUENT: Fix tools-log4j files names in the scripts
  • PR-19474 - KAFKA-14523: Move kafka.log.remote classes to storage (#19474)
  • PR-19491 - KAFKA-19162: Topology metadata contains non-deterministically ordered topic configs (#19491)
  • PR-19394 - KAFKA-19054: StreamThread exception handling with SHUTDOWN_APPLICATION may trigger a tight loop with MANY logs (#19394)
  • PR-19454 - KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup (#19454)
  • PR-19460 - KAFKA-19002 Rewrite ListOffsetsIntegrationTest and move it to clients-integration-test (#19460)
  • PR-19492 - KAFKA-19158: Add SHARE_SESSION_LIMIT_REACHED error code (#19492)
  • PR-19488 - KAFKA-19147: Start authorizer before group coordinator to ensure coordinator authorizes regex topics (#19488)
  • PR-19298 - KAFKA-19042 Move PlaintextConsumerCallbackTest to client-integration-tests module (#19298)
  • PR-19472 - KAFKA-13610: Deprecate log.cleaner.enable configuration (#19472)
  • PR-19050 - KAFKA-18888: Add KIP-877 support to Authorizer (#19050)
  • PR-19420 - KAFKA-18983 Ensure all README.md(s) are mentioned by the root README.md (#19420)
  • PR-19433 - KAFKA-18288: Add support kafka-streams-groups.sh –describe (#19433)
  • PR-19464 - KAFKA-19137 Use StandardCharsets.UTF_8 instead of StandardCharsets.UTF_8.name() (#19464)
  • PR-19364 - KAFKA-15370: ACL changes to support 2PC (KIP-939) (#19364)
  • PR-19417 - KAFKA-18900: Implement share.acknowledgement.mode to choose acknowledgement mode (#19417)
  • PR-19463 - KAFKA-18629: Account for existing deleting topics in share group delete. (#19463)
  • PR-19319 - KAFKA-19042 Move ProducerCompressionTest, ProducerFailureHandlingTest, and ProducerIdExpirationTest to client-integration-tests module (#19319)
  • PR-19391 - KAFKA-14523: Decouple RemoteLogManager and Partition (#19391)
  • PR-19469 - KAFKA-18172 Move RemoteIndexCacheTest to the storage module (#19469)
  • PR-19426 - KAFKA-19119 Move ApiVersionManager/SimpleApiVersionManager to server (#19426)
  • PR-19439 - KAFKA-19121 Move AddPartitionsToTxnConfig and TransactionStateManagerConfig out of KafkaConfig (#19439)
  • PR-19424 - KAFKA-19113: Migrate DelegationTokenManager to server module (#19424)
  • PR-19347 - KAFKA-19027 Replace ConsumerGroupCommandTestUtils#generator by ClusterTestDefaults (#19347)
  • PR-19431 - KAFKA-19115: Utilize initialized topics info to verify delete share group offsets (#19431)
  • PR-19419 - KAFKA-15371 MetadataShell is stuck when bootstrapping (#19419)
  • PR-19345 - KAFKA-19071: Fix doc for remote.storage.enable (#19345)
  • PR-19374 - KAFKA-19030 Remove metricNamePrefix from RequestChannel (#19374)
  • PR-19387 - KAFKA-14485: Move LogCleaner to storage module (#19387)
  • PR-19293 - KAFKA-16894: Define feature to enable share groups (#19293)
  • PR-19436 - KAFKA-19127: Integration test for altering and describing streams group configs (#19436)
  • PR-19441 - KAFKA-19103 Remove OffsetConfig (#19441)
  • PR-19438 - KAFKA-19118: Enable KIP-1071 in StandbyTaskCreationIntegrationTest (#19438)
  • PR-19423 - KAFKA-18286: Implement support for streams groups in kafka-groups.sh (#19423)
  • PR-19289 - KAFKA-19042 Move TransactionsWithMaxInFlightOneTest to client-integration-tests module (#19289)
  • PR-19410 - KAFKA-19101 Remove ControllerMutationQuotaManager#throttleTimeMs unused parameter (#19410)
  • PR-19354 - KAFKA-18782: Extend ApplicationRecoverableException related exceptions (#19354)
  • PR-19363 - KAFKA-18629: Utilize share group partition metadata for delete group. (#19363)
  • PR-19421 - KAFKA-19124: Use consumer background event queue for Streams events (#19421)
  • PR-19425 - KAFKA-19118: Enable KIP-1071 in InternalTopicIntegrationTest (#19425)
  • PR-19432 - KAFKA-18170: Add create and write timestamp fields in share snapshot [1/N] (#19432)
  • PR-19167 - KAFKA-18935: Ensure brokers do not return null records in FetchResponse (#19167)
  • PR-19261 - KAFKA-16729: Support isolation level for share consumer (#19261)
  • PR-19188 - KAFKA-18962: Fix onBatchRestored call in GlobalStateManagerImpl (#19188)
  • 83f6a1d7 - KAFKA-18991; Missing change for cherry-pick
  • PR-19223 - KAFKA-18991: FetcherThread should match leader epochs between fetch request and fetch state (#19223)
  • PR-19422 - KAFKA-18287: Add support for kafka-streams-groups.sh –list (#19422)
  • PR-18852 - KAFKA-18723; Better handle invalid records during replication (#18852)
  • PR-19377 - KAFKA-19037: Integrate consumer-side code with Streams (#19377)
  • PR-1611 - Fix build failure (#1582)
  • PR-19390 - KAFKA-19090: Move DelayedFuture and DelayedFuturePurgatory to server module (#19390)
  • PR-19213 - KAFKA-18984: Reset interval.ms By Using kafka-client-metrics.sh (#19213)
  • PR-18976 - KAFKA-16718-2/n: KafkaAdminClient and GroupCoordinator implementation for DeleteShareGroupOffsets RPC (#18976)
  • PR-19384 - KAFKA-19093 Change the “Handler on Broker” to “Handler on Controller” for controller server (#19384)
  • PR-19296 - KAFKA-19047: Allow quickly re-registering brokers that are in controlled shutdown (#19296)
  • PR-19413 - KAFKA-19099 Remove GroupSyncKey, GroupJoinKey, and MemberKey (#19413)
  • PR-19068 - KAFKA-18892: Add KIP-877 support for ClientQuotaCallback (#19068)
  • PR-19406 - KAFKA-19100: Use ProcessRole instead of String in AclApis (#19406)
  • PR-19398 - KAFKA-19098 Remove lastOffset from PartitionResponse (#19398)
  • PR-19359 - KAFKA-19077: Propagate shutdownRequested field (#19359)
  • PR-19219 - KAFKA-19001: Use streams group-level configurations in heartbeat (#19219)
  • PR-19369 - KAFKA-19084: Port KAFKA-16224, KAFKA-16764 for ShareConsumers (#19369)
  • PR-19392 - KAFKA-19076 replace String by Supplier<String> for UnifiedLog#maybeHandleIOException (#19392)
  • PR-17614 - KAFKA-16758: Extend Consumer#close with an option to leave the group or not (#17614)
  • PR-19303 - KAFKA-16407: Fix foreign key INNER join on change of FK from/to a null value (#19303)
  • PR-19242 - KAFKA-19013 Reformat PR body to 72 characters (#19242)
  • PR-19288 - KAFKA-19042 Move TransactionsExpirationTest to client-integration-tests module (#19288)
  • PR-19357 - KAFKA-19074 Remove the cached responseData from ShareFetchResponse (#19357)
  • PR-19285 - KAFKA-14523: Move DelayedRemoteListOffsets to the storage module (#19285)
  • PR-19323 - KAFKA-13747: refactor TopologyTest to test different store type parametrized (#19323)
  • PR-19370 - KAFKA-19085: SharePartitionManagerTest testMultipleConcurrentShareFetches throws silent exception and works incorrectly (#19370)
  • PR-19218 - KAFKA-7952: use in memory stores for KTable test (#19218)
  • PR-19328 - KAFKA-18761: [2/N] List share group offsets with state and auth (#19328)
  • PR-19005 - KAFKA-18713: Fix FK Left-Join result race condition (#19005)
  • PR-19269 - KAFKA-18067: Add a flag to disable producer reset during active task creator shutting down (#19269)
  • PR-19320 - KAFKA-19055 Cleanup the 0.10.x information from clients module (#19320)
  • PR-19348 - KAFKA-19075: Included other share group dynamic configs in extractShareGroupConfigMap method in ShareGroupConfig (#19348)
  • PR-19333 - KAFKA-19064: Handle exceptions from deferred events in coordinator (#19333)
  • PR-19339 - KAFKA-18827: Incorporate initializing topics in share group heartbeat [4/N] (#19339)
  • PR-19111 - KAFKA-18923: resource leak in RSM fetchIndex inputStream (#19111)
  • PR-19317 - KAFKA-18949 add consumer protocol to testDeleteRecordsAfterCorruptRecords (#19317)
  • PR-19324 - KAFKA-19058 Running the streams/streams-scala module tests produces a streams-scala.log (#19324)
  • PR-19276 - KAFKA-19003: Add forceTerminateTransaction command to CLI tools (#19276)
  • PR-19226 - KAFKA-19004 Move DelayedDeleteRecords to server-common module (#19226)
  • PR-18953 - KAFKA-18826: Add global thread metrics (#18953)
  • PR-19343 - KAFKA-19016: Updated the retention behaviour of share groups to retain them forever (#19343)
  • PR-19344 - KAFKA-19072: Add system test for ELR (#19344)
  • PR-19331 - KAFKA-15931: Cancel RemoteLogReader gracefully (#19331)
  • PR-19338 - KAFKA-18796-2: Corrected the check for acquisition lock timeout in Sh… (#19338)
  • PR-19335 - KAFKA-19062: Port changes from KAFKA-18645 to share-consumers (#19335)
  • PR-19334 - KAFKA-19018,KAFKA-19063: Implement maxRecords and acquisition lock timeout in share fetch request and response resp. (#19334)
  • PR-18383 - KAFKA-18613: Unit tests for usage of incorrect RPCs (#18383)
  • PR-19189 - KAFKA-18613: Improve test coverage for missing topics (#19189)
  • PR-18510 - KAFKA-18409: ShareGroupStateMessageFormatter should use CoordinatorRecordMessageFormatter (#18510)
  • PR-19274 - KAFKA-18959 increase the num_workers from 9 to 14 (#19274)
  • PR-19283 - KAFKA-19042 Move ConsumerTopicCreationTest to client-integration-tests module (#19283)
  • PR-18297 - KAFKA-16260: Deprecate window.size.ms and window.inner.class.serde in StreamsConfig (#18297)
  • PR-19114 - KAFKA-18613: Add StreamsGroupHeartbeat handler in the group coordinator (#19114)
  • PR-19270 - KAFKA-19032 Remove TestInfoUtils.TestWithParameterizedQuorumAndGroupProtocolNames (#19270)
  • PR-19268 - KAFKA-19005 improve the documentation of DescribeTopicsOptions#partitionSizeLimitPerResponse (#19268)
  • PR-19282 - KAFKA-19036 Rewrite LogAppendTimeTest and move it to storage module (#19282)
  • PR-19299 - KAFKA-19049 Remove the @ExtendWith(ClusterTestExtensions.class) from code base (#19299)
  • PR-19076 - KAFKA-17830 Cover unit tests for TBRLMM init failure scenarios (#19076)
  • PR-19216 - KAFKA-14486 Move LogCleanerManager to storage module (#19216)
  • PR-19026 - KAFKA-18827: Initialize share group state group coordinator impl. [3/N] (#19026)
  • PR-18695 - KAFKA-18616; Refactor Tools’s ApiMessageFormatter (#18695)
  • PR-19192 - KAFKA-18899: Improve handling of timeouts for commitAsync() in ShareConsumer. (#19192)
  • PR-19154 - KAFKA-18914 Migrate ConsumerRebootstrapTest to use new test infra (#19154)
  • PR-19233 - KAFKA-18736: Add pollOnClose() and maximumTimeToWait() (#19233)
  • PR-19230 - KAFKA-18736: Handle errors in the Streams group heartbeat request manager (#19230)
  • PR-18711 - KAFKA-18576 Convert ConfigType to Enum (#18711)
  • PR-19247 - KAFKA-18796: Added more information to error message when assertion fails for acquisition lock timeout (#19247)
  • PR-19046 - KAFKA-18276 Migrate ProducerRebootstrapTest to new test infra (#19046)
  • PR-19207 - KAFKA-18980 OffsetMetadataManager#cleanupExpiredOffsets should record the number of records rather than topic partitions (#19207)
  • PR-19227 - KAFKA-18999 Remove BrokerMetadata (#19227)
  • PR-19256 - KAFKA-17806 remove this-escape suppress warnings in AclCommand (#19256)
  • PR-19255 - KAFKA-18329; [3/3] Delete old group coordinator (KIP-848) (#19255)
  • PR-19064 - KAFKA-18893: Add KIP-877 support to ReplicaSelector (#19064)
  • PR-19251 - KAFKA-18329; [2/3] Delete old group coordinator (KIP-848) (#19251)
  • PR-19254 - KAFKA-19017: Changed consumer.config to command-config in verifiable_share_consumer.py (#19254)
  • PR-19246 - KAFKA-15599 Move MetadataLogConfig to raft module (#19246)
  • PR-19180 - KAFKA-18954: Add ELR election rate metric (#19180)
  • PR-19197 - KAFKA-15931: Cancel RemoteLogReader gracefully (#19197)
  • PR-19243 - KAFKA-18329; [1/3] Delete old group coordinator (KIP-848) (#19243)
  • PR-19174 - KAFKA-18946 Move BrokerReconfigurable and DynamicProducerStateManagerConfig to server module (#19174)
  • PR-18842 - KAFKA-806 Index may not always observe log.index.interval.bytes (#18842)
  • PR-19214 - KAFKA-18989 Optimize FileRecord#searchForOffsetWithSize (#19214)
  • PR-19183 - KAFKA-18819 StreamsGroupHeartbeat API and StreamsGroupDescribe API check topic describe (#19183)
  • PR-19217 - KAFKA-18975 Move clients-integration-test out of core module (#19217)
  • PR-19193 - KAFKA-18953: [1/N] Add broker side handling for 2 PC (KIP-939) (#19193)
  • PR-18949 - KAFKA-17431: Support invalid static configs for KRaft so long as dynamic configs are valid (#18949)
  • PR-19202 - KAFKA-18969 Rewrite ShareConsumerTest#setup and move to clients-integration-tests module (#19202)
  • PR-19165 - KAFKA-18955: Fix infinite loop and standardize options in MetadataSchemaCheckerTool (#19165)
  • PR-18966 - KAFKA-18808 add test to ensure the name=<default> is not equal to default quota (#18966)
  • PR-18463 - KAFKA-17171 Add test cases for STATIC_BROKER_CONFIG in kraft mode (#18463)
  • PR-18801 - KAFKA-17565 Move MetadataCache interface to metadata module (#18801)
  • PR-19181 - KAFKA-18736: Do not send fields if not needed (#19181)
  • PR-19215 - KAFKA-18990 Avoid redundant MetricName creation in BaseQuotaTest#produceUntilThrottled (#19215)
  • PR-19027 - KAFKA-18859 honor the error message of UnregisterBrokerResponse (#19027)
  • PR-19212 - KAFKA-18993 Remove confusing notable change section from upgrade.html (#19212)
  • PR-19129 - KAFKA-18703 Remove unused class PayloadKeyType (#19129)
  • PR-19187 - KAFKA-18915 Rewrite AdminClientRebootstrapTest to cover the current scenario (#19187)
  • PR-19147 - KAFKA-18924 Running the storage module tests produces a storage/storage.log file (#19147)
  • PR-19136 - KAFKA-18781: Extend RefreshRetriableException related exceptions (#19136)
  • PR-18994 - KAFKA-18843: MirrorMaker2 unique workerId (#18994)
  • PR-17264 - KAFKA-17516 Synonyms for client metrics configs (#17264)
  • PR-19134 - KAFKA-18927 Remove LATEST_0_11, LATEST_1_0, LATEST_1_1, LATEST_2_0 (#19134)
  • PR-19164 - KAFKA-18943: Kafka Streams incorrectly commits TX during task revokation (#19164)
  • PR-19205 - KAFKA-18979; Report correct kraft.version in ApiVersions (#19205)
  • PR-19176 - KAFKA-18651: Add Streams-specific broker configurations (#19176)
  • PR-19040 - KAFKA-18858 Refactor FeatureControlManager to avoid using uninitialized MV (#19040)
  • PR-19030 - KAFKA-14484: Move UnifiedLog to storage module (#19030)
  • PR-18662 - KAFKA-18617 Allow use of ClusterInstance inside BeforeEach (#18662)
  • PR-18018 - KAFKA-18142 Switch to com.gradleup.shadow (#18018)
  • PR-19169 - KAFKA-18947 Remove unused raftManager in metadataShell (#19169)
  • PR-18998 - KAFKA-18837: Ensure controller quorum timeouts and backoffs are at least 0 (#18998)
  • PR-19119 - KAFKA-18422 Adjust Kafka client upgrade path section (#19119)
  • PR-19168 - KAFKA-18942: Add reviewers to PR body with committer-tools (#19168)
  • PR-19148 - KAFKA-18932: Removed usage of partition max bytes from share fetch requests (#19148)
  • PR-19145 - KAFKA-18936: Fix share fetch when records are larger than max bytes (#19145)
  • PR-18091 - KAFKA-18074: Add kafka client compatibility matrix (#18091)
  • PR-18258 - KAFKA-18195: Fix Kafka Streams broker compatibility matrix (#18258)
  • PR-19171 - KAFKA-17808: Fix id typo for connector-dlq-adminclient (#19171)
  • PR-19144 - KAFKA-18933 Add client integration tests module (#19144)
  • PR-19155 - KAFKA-18925: Add streams groups support to Admin.listGroups (#19155)
  • PR-19142 - KAFKA-18901: [1/N] Improved homogeneous SimpleAssignor (#19142)
  • PR-19162 - KAFKA-18941: Do not test 3.3 in upgrade_tests.py (#19162)
  • PR-19121 - KAFKA-18736: Decide when a heartbeat should be sent (#19121)
  • PR-19173 - KAFKA-18931: added a share group session timeout task when group coordinator is loaded (#19173)
  • PR-19099 - KAFKA-18637: Fix max connections per ip and override reconfigurations (#19099)
  • PR-17767 - KAFKA-17856 Move ConfigCommandTest and ConfigCommandIntegrationTest to tool module (#17767)
  • PR-18802 - KAFKA-18706 Move AclPublisher to metadata module (#18802)
  • PR-19166 - KAFKA-18944 Remove unused setters from ClusterConfig (#19166)
  • PR-19081 - KAFKA-18909 Move DynamicThreadPool to server module (#19081)
  • PR-19062 - KAFKA-18700 Migrate SnapshotPath, Entry, OffsetAndEpoch, LogFetchInfo, and LogAppendInfo to record classes (#19062)
  • PR-19156 - KAFKA-18940: fix electionWasClean (#19156)
  • PR-19127 - KAFKA-18920: The kcontrollers must set kraft.version in ApiVersionsResponse (#19127)
  • PR-19116 - KAFKA-18285: Add describeStreamsGroup to Admin API (#19116)
  • PR-18684 - KAFKA-18461 Add Objects.requireNotNull to Snapshot (#18684)
  • PR-18299 - KAFKA-17607: Add CI step to verify LICENSE-binary (#18299)
  • PR-19137 - KAFKA-18929: Log a warning when time based segment delete is blocked by a future timestamp (#19137)
  • PR-15241 - KAFKA-15931: Reopen TransactionIndex if channel is closed (#15241)
  • PR-19138 - KAFKA-18046; High CPU usage when using Log4j2 (#19138)
  • PR-19094 - KAFKA-18915: Migrate AdminClientRebootstrapTest to use new test infra (#19094)
  • PR-19113 - KAFKA-18900: Experimental share consumer acknowledge mode config (#19113)
  • PR-19131 - KAFKA-18648: Make records in FetchResponse nullable again (#19131)
  • PR-19120 - KAFKA-18887: Implement Streams Admin APIs (#19120)
  • PR-19130 - KAFKA-18811: Added command configs to admin client as well in VerifiableShareConsumer (#19130)
  • PR-19112 - KAFKA-18910 Remove kafka.utils.json (#19112)
  • 4a500418 - Revert “KAFKA-18246 Fix ConnectRestApiTest.test_rest_api by adding multiversioning configs (#18191)”
  • d86cb597 - Revert “KAFKA-18887: Implement Streams Admin APIs (#19049)”
  • PR-19049 - KAFKA-18887: Implement Streams Admin APIs (#19049)
  • PR-19104 - KAFKA-18919 Clarify that KafkaPrincipalBuilder classes must also implement KafkaPrincipalSerde (#19104)
  • PR-19054 - KAFKA-18882 Remove BaseKey, TxnKey, and UnknownKey (#19054)
  • PR-19083 - KAFKA-18817: ShareGroupHeartbeat and ShareGroupDescribe API must check topic describe (#19083)
  • PR-18983 - KAFKA-14121: AlterPartitionReassignments API should allow callers to specify the option of preserving the replication factor (#18983)
  • PR-18918 - KAFKA-18804 Remove slf4j warning when using tool script (#18918)
  • PR-9766 - KAFKA-10864 Convert end txn marker schema to use auto-generated protocol (#9766)
  • PR-19087 - KAFKA-18886 add behavior change of CreateTopicPolicy and AlterConfigPolicy to zk2kraft (#19087)
  • PR-19097 - KAFKA-18422 add link of KIP-1124 to “rolling upgrade” section (#19097)
  • PR-19089 - KAFKA-18917: TransformValues throws NPE (#19089)
  • PR-19065 - KAFKA-18876 4.0 documentation improvement (#19065)
  • PR-19086 - Fix typos in multiple files (#19086)
  • PR-19091 - KAFKA-18918: Correcting releasing of locks on exception (#19091)
  • PR-19088 - KAFKA-18916; Resolved regular expressions must update the group by topics data structure (#19088)
  • PR-19075 - KAFKA-18867 add tests to describe topic configs with empty name (#19075)
  • PR-18449 - KAFKA-18500 Build PRs at HEAD commit (#18449)
  • PR-19059 - KAFKA-18878: Added share session cache and delayed share fetch metrics (KIP-1103) (#19059)
  • PR-18997 - KAFKA-18844: Stale features information in QuorumController#registerBroker (#18997)
  • PR-19036 - KAFKA-18864:remove the Evolving tag from stable public interfaces (#19036)
  • PR-19055 - KAFKA-18817:[1/N] ShareGroupHeartbeat and ShareGroupDescribe API must check topic describe (#19055)
  • PR-18981 - KAFKA-18613: Auto-creation of internal topics in streams group heartbeat (#18981)
  • PR-19056 - KAFKA-18881 Document the ConsumerRecord as non-thread safe (#19056)
  • PR-18752 - KAFKA-18168: Adding checkpointing for GlobalKTable during restoration and closing (#18752)
  • PR-19070 - KAFKA-18907 Add suitable error message when the appended value is too larger (#19070)
  • PR-19067 - KAFKA-18908 Document that the size of appended value can’t be larger than Short.MAX_VALUE (#19067)
  • PR-19047 - KAFKA-18880 Remove kafka.cluster.Broker and BrokerEndPointNotAvailableException (#19047)
  • PR-19063 - KAFKA-17039 KIP-919 supports for unregisterBroker (#19063)
  • PR-17771 - KAFKA-17981 add Integration test for ConfigCommand to add config key=[val1,val2] (#17771)
  • PR-19045 - KAFKA-18734: Implemented share partition metrics (KIP-1103) (#19045)
  • PR-19048 - KAFKA-18860 Remove Missing Features section (#19048)
  • PR-18349 - KAFKA-18371 TopicBasedRemoteLogMetadataManagerConfig exposes sensitive configuration data in logs (#18349)
  • PR-19020 - KAFKA-18780: Extend RetriableException related exceptions (#19020)
  • PR-19037 - KAFKA-18869 add remote storage threads to “Updating Thread Configs” section (#19037)
  • PR-17743 - KAFKA-18863: Connect Multiversion Support (Versioned Connector Creation and related changes) (#17743)
  • PR-19042 - KAFKA-18813: ConsumerGroupHeartbeat API and ConsumerGroupDescribe API… (#19042)
  • PR-18989 - KAFKA-18813: ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe (#18989)
  • PR-18979 - KAFKA-18614, KAFKA-18613: Add streams group request plumbing (#18979)
  • PR-18864 - KAFKA-18757: Create full-function SimpleAssignor to match KIP-932 description (#18864)
  • PR-18988 - KAFKA-18839: Drop EAGER rebalancing support in Kafka Streams (#18988)
  • PR-18985 - KAFKA-18792 Add workflow to check PR format (#18985)
  • PR-19010 - KAFKA-17351: Improved handling of compacted topics in share partition (2/N) (#19010)
  • PR-19021 - KAFKA-17836 Move RackAwareTest to server module (#19021)
  • PR-18803 - KAFKA-18712 Move Endpoint to server module (#18803)
  • PR-18387 - KAFKA-18281: Kafka is improperly validating non-advertised listeners for routable controller addresses (#18387)
  • PR-18900 - KAFKA-17937 Cleanup AbstractFetcherThreadTest (#18900)
  • PR-18898 - KIP-966 part 1 release doc (#18898)
  • PR-18770 - KAFKA-18748 Run new tests separately in PRs (#18770)
  • PR-18804 - KAFKA-18522: Slice records for share fetch (#18804)
  • PR-18233 - KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics (#18233)
  • PR-18939 - KAFKA-18779: Validate responses from broker in client for ShareFetch and ShareAcknowledge RPCs. (#18939)
  • PR-18992 - KAFKA-18827: Initialize share group state persister impl [2/N]. (#18992)
  • PR-18880 - KAFKA-15583 doc update for the “strict min ISR” rule (#18880)
  • PR-18928 - KAFKA-18629: ShareGroupDeleteState admin client impl. (#18928)
  • PR-18978 - KAFKA-17351: Update tests and acquire API to allow discard batches from compacted topics (1/N) (#18978)
  • PR-18968 - KAFKA-18827: Initialize share state, share coordinator impl. [1/N] (#18968)
  • PR-19000 - Revert “KAFKA-16803: Change fork, update ShadowJavaPlugin to 8.1.7 (#16295)” (#19000)
  • PR-18897 - KAFKA-18795 Remove Records#downConvert (#18897)
  • PR-18996 - KAFKA-18813: [3/N] Client support for TopicAuthException in DescribeConsumerGroup path (#18996)
  • PR-18959 - KAFKA-18733: Implemented fetch ratio and partition acquire time metrics (3/N) (#18959)
  • PR-18986 - KAFKA-18813: [2/N] Client support for TopicAuthException in HB path (#18986)
  • PR-18844 - KAFKA-18737 KafkaDockerWrapper setup functions fails due to storage format command (#18844)
  • PR-18848 - KAFKA-18629: Delete share group state RPC group coordinator impl. [3/N] (#18848)
  • PR-18982 - KAFKA-18829: Added check before converting to IMPLICIT mode (#18964) (Cherry-pick) (#18982)
  • PR-18969 - KAFKA-18831 Migrating to log4j2 introduce behavior changes of adjusting level dynamically (#18969)
  • PR-18737 - KAFKA-18641: AsyncKafkaConsumer could lose records with auto offset commit (#18737)
  • PR-18962 - KAFKA-18828: Update share group metrics per new init and call mechanism. (#18962)
  • PR-18891 - KAFKA-16918 TestUtils#assertFutureThrows should use future.get with timeout (#18891)
  • PR-18965 - MIINOR: Remove redundant quorum parameter from *AdminIntegrationTest classes (#18965)
  • PR-18967 - KAFKA-18791 Set default commit to PR title and description [2/n] (#18967)
  • PR-18964 - KAFKA-18829: Added check before converting to IMPLICIT mode (#18964)
  • PR-18955 - KAFKA-18791 Enable new asf.yaml parser [1/n] (#18955)
  • PR-18845 - KAFKA-18601: Assume a baseline of 3.3 for server protocol versions (#18845)
  • PR-18944 - KAFKA-18198: Added check to prevent acknowledgements on initial ShareFetchRequest. (#18944)
  • PR-18946 - KAFKA-18799 Remove AdminUtils (#18946)
  • PR-18757 - KAFKA-18667 Add replication system test case for combined broker + controller failure (#18757)
  • PR-18872 - KAFKA-18773 Migrate the log4j1 config to log4j 2 for native image and README (#18872)
  • PR-18004 - KAFKA-18089: Upgrade Caffeine lib to 3.1.8 (#18004)
  • PR-18850 - KAFKA-18767: Add client side config check for shareConsumer (#18850)
  • PR-18460 - KAFKA-14484: Decouple UnifiedLog and RemoteLogManager (#18460)
  • PR-18927 - KAFKA-16718 [1/n]: Added DeleteShareGroupOffsets request and response schema (#18927)
  • PR-18870 - KAFKA-18736: Add Streams group heartbeat request manager (1/N) (#18870)
  • PR-18914 - KAFKA-18798 The replica placement policy used by ReassignPartitionsCommand is not aligned with kraft controller (#18914)
  • PR-18888 - KAFKA-18787: RemoteIndexCache fails to delete invalid files on init (#18888)
  • PR-18934 - KAFKA-18807; Fix thread idle ratio metric (#18934)
  • PR-18871 - KAFKA-18684: Add base exception classes (#18871)
  • PR-18924 - KAFKA-18733: Updating share group record acks metric (2/N) (#18924)
  • PR-18907 - KAFKA-18801 Remove ClusterGenerator and revise ClusterTemplate javadoc (#18907)
  • PR-18809 - KAFKA-18730: Add replaying streams group state from offset topic (#18809)
  • PR-18889 - KAFKA-18784 Fix ConsumerWithLegacyMessageFormatIntegrationTest (#18889)
  • PR-18920 - KAFKA-18805: add synchronized block for Consumer Heartbeat close (#18920)
  • PR-18908 - KAFKA-18755 Align timeout in kafka-share-groups.sh (#18908)
  • PR-18922 - KAFKA-18809 Set min in sync replicas for __share_group_state. (#18922)
  • PR-18916 - KAFKA-18803 The acls would appear at the wrong level of the metadata shell “tree” (#18916)
  • PR-18906 - KAFKA-18790 Fix testCustomQuotaCallback (#18906)
  • PR-18894 - KAFKA-18761: Complete listing of share group offsets [1/N] (#18894)
  • PR-18819 - KAFKA-16717 [1/2]: Add AdminClient.alterShareGroupOffsets (#18819)
  • PR-18899 - KAFKA-18772 Define share group config defaults for Docker (#18899)
  • PR-18826 - KAFKA-18733: Updating share group metrics (1/N) (#18826)
  • PR-18680 - KAFKA-18634: Fix ELR metadata version issues (#18680)
  • PR-18795 - KAFKA-17182: Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer (#18795)
  • PR-18834 - KAFKA-16720: Support multiple groups in DescribeShareGroupOffsets RPC (#18834)
  • PR-18810 - KAFKA-18654[2/2]: Transction V2 retry add partitions on the server side when handling produce request. (#18810)
  • PR-18756 - KAFKA-17298: Update upgrade notes for 4.0 KIP-848 (#18756)
  • PR-18807 - KAFKA-18728 Move ListOffsetsPartitionStatus to server module (#18807)
  • PR-18851 - KAFKA-18769: Improve leadership changes handling in ShareConsumeRequestManager. (#18851)
  • PR-18869 - KAFKA-18777 add PartitionsWithLateTransactionsCount to BrokerMetricNamesTest (#18869)
  • PR-18729 - KAFKA-18323: Add StreamsGroup class (#18729)
  • PR-18275 - KAFKA-15443: Upgrade RocksDB to 9.7.3 (#18275)
  • PR-18451 - KAFKA-18035: TransactionsTest testBumpTransactionalEpochWithTV2Disabled failed on trunk (#18451)
  • PR-17804 - KAFKA-15995: Adding KIP-877 support to Connect (#17804)
  • PR-18829 - KAFKA-18756: Enabled share group configs for queues related system tests (#18829)
  • PR-18858 - Fix bug in json naming (#18858)
  • PR-18833 - KAFKA-18758: NullPointerException in shutdown following InvalidConfigurationException (#18833)
  • PR-18855 - KAFKA-18764: Throttle on share state RPCs auth failure. (#18855)
  • PR-18039 - KAFKA-14484: Move UnifiedLog static methods to storage (#18039)
  • PR-18394 - KAFKA-18396: Migrate log4j1 configuration to log4j2 in KafkaDockerWrapper (#18394)
  • PR-18853 - KAFKA-18770 close the RM created by testDelayedShareFetchPurgatoryOperationExpiration (#18853)
  • PR-18820 - KAFKA-18366 Remove KafkaConfig.interBrokerProtocolVersion (#18820)
  • PR-18812 - KAFKA-18658 add import control for examples module (#18812)
  • PR-18821 - KAFKA-18743 Remove leader.imbalance.per.broker.percentage as it is not supported by Kraft (#18821)
  • PR-1578 - CCS CP release test regex updates
  • PR-18196 - KAFKA-18225 ClientQuotaCallback#updateClusterMetadata is unsupported by kraft (#18196)
  • PR-1582 - Fix build failure
  • PR-18846 - KAFKA-18763: changed the assertion statement for acknowledgements to include only successful acks (#18846)
  • PR-18824 - KAFKA-18745: Handle network related errors in persister. (#18824)
  • PR-18252 - KAFKA-17833: Convert DescribeAuthorizedOperationsTest to use KRaft (#18252)
  • PR-1577 - CCS CP release test regex updates
  • PR-18381 - KAFKA-18275 Restarting broker in testing should use the same port (#18381)
  • PR-18818 - KAFKA-18741 document the removal of inter.broker.protocol.version (#18818)
  • PR-18496 - KAFKA-18483 Disable Log4jController and Loggers if Log4j Core absent (#18496)
  • PR-18672 - KAFKA-18618: Improve leader change handling of acknowledgements [1/N] (#18672)
  • PR-18566 - KAFKA-18360 Remove zookeeper configurations (#18566)
  • PR-18641 - KAFKA-18530 Remove ZooKeeperInternals (#18641)
  • PR-18583 - KAFKA-18499 Clean up zookeeper from LogConfig (#18583)
  • PR-18771 - KAFKA-18689: Improve metric calculation to avoid NoSuchElementException (#18771)
  • PR-18189 - KAFKA-18206: EmbeddedKafkaCluster must set features (#18189)
  • PR-18765 - KAFKA-17379: Fix inexpected state transition from ERROR to PENDING_SHUTDOWN (#18765)
  • PR-18696 - KAFKA-18494-3: solution for the bug relating to gaps in the share partition cachedStates post initialization (#18696)
  • PR-18748 - KAFKA-18629: Add persister impl and tests for DeleteShareGroupState RPC. [2/N] (#18748)
  • PR-18671 - [KAFKA-16720] AdminClient Support for ListShareGroupOffsets (2/2) (#18671)
  • PR-18702 - KAFKA-18645: New consumer should align close timeout handling with classic consumer (#18702)
  • PR-18791 - KAFKA-18722: Remove the unreferenced methods in TBRLMM and ConsumerManager (#18791)
  • PR-18782 - KAFKA-18694: Migrate suitable classes to records in coordinator-common module (#18782)
  • PR-18784 - KAFKA-18705: Move ConfigRepository to metadata module (#18784)
  • PR-18783 - KAFKA-18698: Migrate suitable classes to records in server and server-common modules (#18783)
  • PR-18781 - KAFKA-18675 Add tests for valid and invalid broker addresses (#18781)
  • PR-18304 - KAFKA-16524; Metrics for KIP-853 (#18304)
  • PR-18277 - KAFKA-18635: reenable the unclean shutdown detection (#18277)
  • PR-18708 - KAFKA-18649: complete ClearElrRecord handling (#18708)
  • PR-18148 - KAFKA-16540: Clear ELRs when min.insync.replicas is changed. (#18148)
  • PR-17952 - KAFKA-16540: enforce min.insync.replicas config invariants for ELR (#17952)
  • PR-15622 - KAFKA-16446: Improve controller event duration logging (#15622)
  • PR-18028 - KAFKA-18131: Improve logs for voters (#18028)
  • PR-18222 - KAFKA-18305: validate controller.listener.names is not in inter.broker.listener.name for kcontrollers (#18222)
  • PR-18777 - KAFKA-18690: Keep leader metadata for RE2J-assigned partitions (#18777)
  • PR-18551 - KAFKA-18538: Add Streams membership manager (#18551)
  • PR-18165 - KAFKA-18230: Handle not controller or not leader error in admin client (#18165)
  • PR-18700 - KAFKA-18644: improve generic type names for internal FK-join classes (#18700)
  • PR-18790 - KAFKA-18693 Remove PasswordEncoder (#18790)
  • PR-18720 - KAFKA-18654 [1/2]: Transaction Version 2 performance regression due to early return (#18720)
  • PR-18592 - KAFKA-18545: Remove Zookeeper logic from LogManager (#18592)
  • PR-18676 - KAFKA-18325: Add TargetAssignmentBuilder (#18676)
  • PR-18786 - KAFKA-18672; CoordinatorRecordSerde must validate value version (4.0) (#18786)
  • PR-18717 - KAFKA-18655: Implement the consumer group size counter with scheduled task (#18717)
  • PR-18764 - KAFKA-18685: Cleanup DynamicLogConfig constructor (#18764)
  • PR-18785 - KAFKA-18676; Update Benchmark system tests (#18785)
  • PR-18330 - KAFKA-17631 Convert SaslApiVersionsRequestTest to kraft (#18330)
  • PR-18749 - KAFKA-18672; CoordinatorRecordSerde must validate value version (#18749)
  • PR-18768 - KAFKA-18678 Update TestVerifiableProducer system test (#18768)
  • PR-18652 - KAFKA-17125: Streams Sticky Task Assignor (#18652)
  • PR-18751 - KAFKA-18674 Document the incompatible changes in parsing –bootstrap-server (#18751)
  • PR-18727 - KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 (#18727)
  • PR-18759 - KAFKA-18683: Handle slicing of file records for updated start position (#18759)
  • fc3dca4e - Revert “KAFKA-17182: Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer (#17700)”
  • 7920fadb - Revert “KAFKA-17182: Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer (#17700)”
  • PR-18758 - KAFKA-18660: Transactions Version 2 doesn’t handle epoch overflow correctly (#18730) (#18758)
  • PR-18750 - KAFKA-18320; Ensure that assignors are at the right place (#18750)
  • PR-1541 - Merge trunk
  • PR-17700 - KAFKA-17182: Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer (#17700)
  • PR-18766 - KAFKA-18146; tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft (#18766)
  • PR-18763 - KAFKA-18677; Update ConsoleConsumerTest system test (#18763)
  • PR-17511 - KAFKA-15995: Initial API + make Producer/Consumer plugins Monitorable (#17511)
  • PR-18722 - KAFKA-18644: improve generic type names for KStreamImpl and KTableImpl (#18722)
  • PR-18754 - KAFKA-18034: CommitRequestManager should fail pending requests on fatal coordinator errors (#18754)
  • PR-18730 - KAFKA-18660: Transactions Version 2 doesn’t handle epoch overflow correctly (#18730)
  • PR-1556 - MINOR: Disable publish artifacts for 4.0
  • PR-18548 - KAFKA-18034: CommitRequestManager should fail pending requests on fatal coordinator errors (#18548)
  • PR-18731 - KAFKA-18570: Update documentation to add remainingLogsToRecover, remainingSegmentsToRecover and LogDirectoryOffline metrics (#18731)
  • PR-18669 - KAFKA-18621: Add StreamsCoordinatorRecordHelpers (#18669)
  • PR-18681 - KAFKA-18636 Fix how we handle Gradle exits in CI (#18681)
  • PR-18590 - KAFKA-18569: New consumer close may wait on unneeded FindCoordinator (#18590)
  • PR-18698 - KAFKA-13722: remove internal usage of old ProcessorContext (#18698)
  • PR-18314 - KAFKA-16339: Add Kafka Streams migrating guide from transform to process (#18314)
  • PR-18732 - KAFKA-18498: Update lock ownership from main thread (#18732)
  • PR-18478 - KAFKA-18383 Remove reserved.broker.max.id and broker.id.generation.enable (#18478)
  • PR-18733 - KAFKA-18662: Return CONCURRENT_TRANSACTIONS on produce request in TV2 (#18733)
  • PR-18718 - KAFKA-18632: Multibroker test improvements. (#18718)
  • PR-18725 - KAFKA-18653: Fix mocks and potential thread leak issues causing silent RejectedExecutionException in share group broker tests (#18725)
  • PR-18726 - KAFKA-18646: Null records in fetch response breaks librdkafka (#18726)
  • PR-18668 - KAFKA-18619: New consumer topic metadata events should set requireMetadata flag (#18668)
  • PR-18728 - KAFKA-18488: Improve KafkaShareConsumerTest (#18728)
  • PR-18716 - KAFKA-18648: Add back support for metadata version 0-3 (#18716)
  • PR-18555 - KAFKA-18528: MultipleListenersWithSameSecurityProtocolBaseTest and GssapiAuthenticationTest should run for async consumer (#18555)
  • PR-18651 - KAFKA-17951: Share parition rotate strategy (#18651)
  • PR-18712 - KAFKA-18629: Delete share group state impl [1/N] (#18712)
  • PR-18570 - KAFKA-17162: join() started thread in DefaultTaskManagerTest (#18570)
  • PR-18602 - KAFKA-17587 Refactor test infrastructure (#18602)
  • PR-18693 - KAFKA-18631 Remove ZkConfigs (#18693)
  • PR-18699 - KAFKA-18642: Increased the timeouts in share_consumer_test.py system tests (#18699)
  • PR-18632 - KAFKA-18555 Avoid casting MetadataCache to KRaftMetadataCache (#18632)
  • PR-18547 - KAFKA-18533 Remove KafkaConfig zookeeper related logic (#18547)
  • PR-18554 - KAFKA-18529: ConsumerRebootstrapTest should run for async consumer (#18554)
  • PR-18292 - KAFKA-13722: remove usage of old ProcessorContext (#18292)
  • PR-18444 - KAFKA-17894: Implemented broker topic metrics for Share Group 1/N (KIP-1103) (#18444)
  • PR-18687 - KAFKA-18630: Clean ReplicaManagerBuilder (#18687)
  • PR-18477 - KAFKA-18474: Remove zkBroker listener (#18477)
  • PR-18688 - KAFKA-18616; Refactor DumpLogSegments’s MessageParsers (#18688)
  • PR-15574 - KAFKA-16372 Fix producer doc discrepancy with the exception behavior (#15574)
  • PR-18618 - KAFKA-18590 Cleanup DelegationTokenManager (#18618)
  • PR-18593 - KAFKA-18559 Cleanup FinalizedFeatures (#18593)
  • PR-18627 - KAFKA-18597 Fix max-buffer-utilization-percent is always 0 (#18627)
  • PR-18686 - KAFKA-18620: Remove UnifiedLog#legacyFetchOffsetsBefore (#18686)
  • PR-18621 - KAFKA-18592 Cleanup ReplicaManager (#18621)
  • PR-18476 - KAFKA-18324: Add CurrentAssignmentBuilder (#18476)
  • PR-12042 - KAFKA-13810: Document behavior of KafkaProducer.flush() w.r.t callbacks (#12042)
  • PR-18667 - KAFKA-18484 [2/2]; Handle exceptions during coordinator unload (#18667)
  • PR-18601 - KAFKA-18488: Additional protocol tests for share consumption (#18601)
  • PR-18666 - KAFKA-18486; [1/2] Update LocalLeaderEndPointTest (#18666)
  • d2024436 - KAFKA-18575: Transaction Version 2 doesn’t correctly handle race condition with completing and new transaction(#18604)
  • PR-18532 - KAFKA-18517: Enable ConsumerBounceTest to run for new async consumer (#18532)
  • PR-18614 - KAFKA-18519: Remove Json.scala, cleanup AclEntry.scala (#18614)
  • PR-18630 - KAFKA-18599: Remove Optional wrapping for forwardingManager in ApiVersionManager (#18630)
  • PR-18389 - KAFKA-18229: Move configs out of “kraft” directory (#18389)
  • PR-18661 - KAFKA-18484 [1/N]; Handle exceptions from deferred events in coordinator (#18661)
  • PR-18649 - KAFKA-18392: Ensure client sets member ID for share group (#18649)
  • PR-18527 - KAFKA-18518: Add processor to handle rebalance events (#18527)
  • PR-18607 - KAFKA-17402: DefaultStateUpdated should transite task atomically (#18607)
  • PR-18539 - KAFKA-18454 Publish build scans to develocity.apache.org (#18539)
  • PR-18512 - KAFKA-18302; Update CoordinatorRecord (#18512)
  • PR-18316 - KAFKA-15370: Support Participation in 2PC (KIP-939) (2/N) (#18316)
  • PR-18587 - KAFKA-8862: Improve Producer error message for failed metadata update (#18587)
  • PR-18581 - KAFKA-17561: add processId tag to thread-state metric (#18581)
  • PR-18629 - KAFKA-18598: Remove ControllerMetadataMetrics ZK-related Metrics (#18629)
  • PR-18611 - KAFKA-18585 Fix fail test ValuesTest#shouldConvertDateValues (#18611)
  • PR-18647 - KAFKA-18487; Remove ReplicaManager#stopReplicas (#18647)
  • PR-18635 - KAFKA-18583; Fix getPartitionReplicaEndpoints for KRaft (#18635)
  • PR-18442 - KAFKA-18311: Internal Topic Manager (5/5) (#18442)
  • PR-18636 - KAFKA-18604; Update transaction coordinator (#18636)
  • PR-18497 - KAFKA-14552: Assume a baseline of 3.0 for server protocol versions (#18497)
  • PR-18346 - KAFKA-18363: Remove ZooKeeper mentiosn in broker configs (#18346)
  • PR-18631 - KAFKA-18595: Remove AuthorizerUtils#sessionToRequestContext (#18631)
  • PR-18626 - KAFKA-18594: Cleanup BrokerLifecycleManager (#18626)
  • PR-18174 - KAFKA-18232: Add share group state topic prune metrics. (#18174)
  • PR-18567 - KAFKA-18553: Update javadoc and comments of ConfigType (#18567)
  • PR-18571 - [KAFKA-16720] AdminClient Support for ListShareGroupOffsets (1/n) (#18571)
  • PR-18624 - KAFKA-18588 Remove TopicKey.scala (#18624)
  • PR-18628 - KAFKA-18578: Remove UpdateMetadataRequest from MetadataCacheTest (#18628)
  • PR-18625 - KAFKA-18593 Remove ZkCachedControllerId In MetadataCache (#18625)
  • PR-17390 - KAFKA-17668: Clean-up LogCleaner#maxOverCleanerThreads and LogCleanerManager#maintainUncleanablePartitions (#17390)
  • PR-18616 - KAFKA-18429 Remove ZkFinalizedFeatureCache and StateChangeFailedException (#18616)
  • PR-18619 - KAFKA-18589 Remove unused interBrokerProtocolVersion from GroupMetadataManager (#18619)
  • PR-18598 - KAFKA-18516 Remove RackAwareMode (#18598)
  • PR-18608 - KAFKA-18492 Cleanup RequestHandlerHelper (#18608)
  • PR-18613 - KAFKA-18427: Remove ZooKeeperClient (#18613)
  • PR-18591 - KAFKA-18540: Remove UpdataMetadataRequest from KafkaApisTest (#18591)
  • PR-18594 - KAFKA-18532: Clean Partition.scala zookeeper logic (#18594)
  • PR-18605 - KAFKA-18423: Remove ZkData and related unused references (#18605)
  • PR-18586 - KAFKA-18565 Cleanup SaslSetup (#18586)
  • PR-18606 - KAFKA-18430 Remove ZkNodeChangeNotificationListener (#18606)
  • PR-18492 - KAFKA-18480 Fix fail e2e test_offset_truncate (#18492)
  • PR-18012 - KAFKA-806: Index may not always observe log.index.interval.bytes (#18012)
  • PR-18595 - KAFKA-18515 Remove DelegationTokenManagerZk (#18595)
  • PR-18579 - Remove casts to KRaftMetadataCache (#18579)
  • PR-18577 - Convert BrokerEndPoint to record (#18577)
  • PR-18240 - KAFKA-17642: PreVote response handling and ProspectiveState (#18240)
  • PR-18585 - KAFKA-18413: Remove AdminZkClient (#18585)
  • PR-18406 - KAFKA-18318: Add logs for online/offline migration indication (#18406)
  • PR-18224 - KAFKA-18150; Downgrade group on classic leave of last consumer member (#18224)
  • PR-18209 - Infrastructure for system tests for the new share consumer client (#18209)
  • PR-18553 - KAFKA-18373: Remove ZkMetadataCache (#18553)
  • PR-18582 - KAFKA-18557 streamline codebase with testConfig() (#18582)
  • PR-18573 - KAFKA-18431: Remove KafkaController (#18573)
  • PR-18574 - KAFKA-18407: Remove ZkAdminManager, DelayedCreatePartitions, CreatePartitionsMetadata, ZkConfigRepository, DelayedDeleteTopics (#18574)
  • PR-18568 - KAFKA-18556: Remove JaasModule#zkDigestModule, JaasTestUtils#zkSections (#18568)
  • PR-18534 - KAFKA-14485: Move LogCleaner exceptions to storage module (#18534)
  • PR-18565 - KAFKA-18546: Use mocks instead of a real DNS lookup to the outside (#18565)
  • PR-18140 - KAFKA-16368: Add a new constraint for segment.bytes to min 1MB for KIP-1030 (#18140)
  • PR-18106 - KAFKA-16368: Update defaults for LOG_MESSAGE_TIMESTAMP_AFTER_MAX_MS_DEFAULT and NUM_RECOVERY_THREADS_PER_DATA_DIR_CONFIG (#18106)
  • PR-18374 - KAFKA-7776: Tests for ISO8601 in Connect value parsing (#18374)
  • PR-18562 - KAFKA-18558: Added check before adding previously subscribed partitions (#18562)
  • PR-18535 - KAFKA-18521 Cleanup NodeApiVersions zkMigrationEnabled field (#18535)
  • PR-18552 - KAFKA-18542 Cleanup AlterPartitionManager (#18552)
  • PR-18561 - KAFKA-18406 Remove ZkBrokerEpochManager.scala (#18561)
  • PR-18508 - KAFKA-18405 Remove ZooKeeper logic from DynamicBrokerConfig (#18508)
  • PR-18080 - KAFKA-16368: Update default linger.ms to 5ms for KIP-1030 (#18080)
  • PR-18524 - KAFKA-18514: Refactor share module code to server and server-common (#18524)
  • PR-18414 - KAFKA-18331: Make process.roles and node.id required configs (#18414)
  • PR-18559 - KAFKA-18552: Remove unnecessary version check in testHandleOffsetFetch* (#18559)
  • PR-18483 - KAFKA-18472: Remove MetadataSupport (#18483)
  • PR-18342 - KAFKA-18026: KIP-1112, clean up graph node grace period resolution (#18342)
  • PR-18491 - KAFKA-18479: Remove keepPartitionMetadataFile in UnifiedLog and LogMan… (#18491)
  • PR-18365 - KAFKA-18364 add document to show the changes of metrics and configs after removing zookeeper (#18365)
  • PR-18550 - KAFKA-18539 Remove optional managers in KafkaApis (#18550)
  • PR-18563 - Use version.py get_version to get version (#18563)
  • PR-18459 - KAFKA-18452: Implemented batch size in acquired records (#18459)
  • PR-18448 - KAFKA-18401: Transaction version 2 does not support commit transaction without records (#18448)
  • PR-18490 - KAFKA-18479: RocksDBTimeOrderedKeyValueBuffer not initialized correctly (#18490)
  • PR-18536 - KAFKA-18514 Remove server dependency on share coordinator (#18536)
  • PR-18521 - KAFKA-18513: Validate share state topic records produced in tests. (#18521)
  • PR-18542 - KAFKA-18399 Remove ZooKeeper from KafkaApis (12/N): clean up ZKMetadataCache, KafkaController and raftSupport (#18542)
  • PR-18386 - KAFKA-18346 Fix e2e TestKRaftUpgrade for v3.3.2 (#18386)
  • PR-18530 - KAFKA-18520: Remove ZooKeeper logic from JaasUtils (#18530)
  • PR-18540 - KAFKA-18399 Remove ZooKeeper from KafkaApis (11/N): CREATE_ACLS and DELETE_ACLS (#18540)
  • PR-18432 - KAFKA-18399 Remove ZooKeeper from KafkaApis (10/N): ALTER_CONFIG and INCREMENETAL_ALTER_CONFIG (#18432)
  • PR-18544 - Revert “KAFKA-18034: CommitRequestManager should fail pending requests on fatal coordinator errors (#18050)” (#18544)
  • PR-18487 - KAFKA-18476: KafkaStreams should swallow TransactionAbortedException (#18487)
  • PR-18195 - KAFKA-18026: KIP-1112, clean up StatefulProcessorNode (#18195)
  • PR-18518 - KAFKA-18502 Remove kafka.controller.Election (#18518)
  • PR-18281 - KAFKA-18330: Update documentation to remove controller deployment limitations (#18281)
  • PR-18465 - KAFKA-18399 Remove ZooKeeper from KafkaApis (9/N): ALTER_CLIENT_QUOTAS and ALLOCATE_PRODUCER_IDS (#18465)
  • PR-18511 - KAFKA-18493: Fix configure :streams:integration-tests project error (#18511)
  • PR-18453 - KAFKA-18399 Remove ZooKeeper from KafkaApis (8/N): ELECT_LEADERS , ALTER_PARTITION, UPDATE_FEATURES (#18453)
  • PR-18525 - Rename the variable to reflect its purpose (#18525)
  • PR-18403 - KAFKA-18211: Override class loaders for class graph scanning in connect. (#18403)
  • PR-18500 - Add DescribeShareGroupOffsets API [KIP-932] (#18500)
  • PR-17669 - KAFKA-17915: Convert Kafka Client system tests to use KRaft (#17669)
  • PR-17901 - KAFKA-18064: SASL mechanisms should throw exception on wrap/unwrap (#17901)
  • PR-18507 - KAFKA-18491 Remove zkClient & maybeUpdateMetadataCache from ReplicaManager (#18507)
  • PR-18337 - KAFKA-18274 Failed to restart controller in testing due to closed socket channel [2/2] (#18337)
  • PR-18475 - KAFKA-18469;KAFKA-18036: AsyncConsumer should request metadata update if ListOffsetRequest encounters a retriable error (#18475)
  • PR-17728 - KAFKA-17973: Relax Restriction for Voters Set Change (#17728)
  • PR-18050 - KAFKA-18034: CommitRequestManager should fail pending requests on fatal coordinator errors (#18050)
  • PR-17870 - KAFKA-18404: Remove partitionMaxBytes usage from DelayedShareFetch (#17870)
  • PR-18504 - KAFKA-18485; Update log4j2.yaml (#18504)
  • PR-18433 - KAFKA-18399 Remove ZooKeeper from KafkaApis (7/N): CREATE_TOPICS, DELETE_TOPICS, CREATE_PARTITIONS (#18433)
  • PR-18320 - KAFKA-18341: Remove KafkaConfig GroupType config check and warn log (#18320)
  • PR-18480 - KAFKA-18457; Update DumpLogSegments to use coordinator record json converters (#18480)
  • PR-18447 - KAFKA-18399 Remove ZooKeeper from KafkaApis (6/N): handleCreateTokenRequest, handleRenewTokenRequestZk, handleExpireTokenRequestZk (#18447)
  • PR-18464 - KAFKA-18399 Remove ZooKeeper from KafkaApis (5/N): ALTER_PARTITION_REASSIGNMENTS, LIST_PARTITION_REASSIGNMENTS (#18464)
  • PR-18461 - KAFKA-18399 Remove ZooKeeper from KafkaApis (4/N): OFFSET_COMMIT and OFFSET_FETCH (#18461)
  • PR-18456 - KAFKA-18399 Remove ZooKeeper from KafkaApis (3/N): USER_SCRAM_CREDENTIALS (#18456)
  • PR-18472 - KAFKA-18466 Remove log4j-1.2-api from runtime scope while keeping it in distribution package (#18472)
  • PR-18404 - KAFKA-18400: Don’t use YYYY when formatting/parsing dates in Java client (#18404)
  • PR-18437 - KAFKA-18446 Remove MetadataCacheControllerNodeProvider (#18437)
  • PR-18468 - KAFKA-18465: Remove MetadataVersions older than 3.0-IV1 (#18468)
  • PR-18467 - KAFKA-18464: Empty Abort Transaction can fence producer incorrectly with Transactions V2 (#18467)
  • PR-18471 - KAFKA-8116: Update Kafka Streams archetype for Java 11 (#18471)
  • PR-17510 - KAFKA-17792: Efficiently parse decimals with large exponents in Connect Values (#17510)
  • PR-18679 - KAFKA-18632: Added few share consumer multibroker tests. (#18679)
  • 82ccf75a - KAFKA-18575: Transaction Version 2 doesn’t correctly handle race condition with completing and new transaction(#18604)
  • 94a1bfb1 - KAFKA-18575: Transaction Version 2 doesn’t correctly handle race condition with completing and new transaction(#18604)
  • PR-18340 - KAFKA-18339: Fix parseRequestHeader error handling (#18340)
  • PR-18643 - Revert “KAFKA-18404: Remove partitionMaxBytes usage from DelayedShareFetch (#17870)” (#18643)
  • 21c4539d - Revert “KAFKA-18034: CommitRequestManager should fail pending requests on fatal coordinator errors (#18050)”
  • PR-18150 - KAFKA-18026: KIP-1112 migrate KTableSuppressProcessorSupplier (#18150)
  • 0186534a - Revert “KAFKA-17411: Create local state Standbys on start (#16922)” and “KAFKA-17978: Fix invalid topology on Task assignment (#17778)”
  • PR-18378 - KAFKA-18340: Change Dockerfile to use log4j2 yaml instead log4j properties (#18378)
  • PR-18397 - KAFKA-18311: Enforcing copartitioned topics (4/N) (#18397)
  • PR-17454 - KAFKA-17671: Create better documentation for transactions (#17454)
  • PR-18455 - KAFKA-18308; Update CoordinatorSerde (#18455)
  • PR-18435 - KAFKA-18440: Convert AuthorizationException to fatal error in AdminClient (#18435)
  • PR-18458 - KAFKA-18304; Introduce json converter generator (#18458)
  • PR-18422 - KAFKA-18399 Remove ZooKeeper from KafkaApis (2/N): CONTROLLED_SHUTDOWN and ENVELOPE (#18422)
  • PR-18146 - KAFKA-18073: Prevent dropped records from failed retriable exceptions (#18146)
  • PR-18321 - KAFKA-13093: Log compaction should write new segments with record version v2 (KIP-724) (#18321)
  • PR-18100 - KAFKA-18180: Move OffsetResultHolder to storage module (#18100)
  • PR-17527 - KAFKA-17455: fix stuck producer when throttling or retrying (#17527)
  • PR-18367 - KAFKA-17915: Convert remaining Kafka Client system tests to use KRaft (#18367)
  • PR-18247 - KAFKA-18277 Convert network_degrade_test to Kraft mode (#18247)
  • PR-18175 - KAFKA-17986 Fix ConsumerRebootstrapTest and ProducerRebootstrapTest (#18175)
  • PR-18445 - KAFKA-18445 Remove LazyDownConversionRecords and LazyDownConversionRecordsSend (#18445)
  • PR-18417 - KAFKA-18399 Remove ZooKeeper from KafkaApis (1/N): LEADER_AND_ISR, STOP_REPLICA, UPDATE_METADATA (#18417)
  • PR-18382 - KAFKA-17730 ReplicaFetcherThreadBenchmark is broken (#18382)
  • PR-18423 - KAFKA-18437: Correct version of ShareUpdateRecord value (#18423)
  • PR-18457 - KAFKA-18397: Added null check before sending background event from ShareConsumeRequestManager. (#18419) (#18457)
  • PR-18462 - KAFKA-18449: Add share group state configs to reconfig-server.properties (#18440) (#18462)
  • PR-18395 - KAFKA-18311: Configuring repartition topics (3/N) (#18395)
  • PR-18446 - KAFKA-18453: Add StreamsTopology class to group coordinator (#18446)
  • PR-18450 - KAFKA-18435 Remove zookeeper dependencies in build.gradle (#18450)
  • PR-18452 - KAFKA-18111: Add Kafka Logo to README (#18452)
  • PR-18438 - KAFKA-18432 Remove unused code from AutoTopicCreationManager (#18438)
  • PR-18436 - KAFKA-18434: enrich the authorization error message of connecting to controller (#18436)
  • PR-18441 - KAFKA-18426 Remove FinalizedFeatureChangeListener (#18441)
  • PR-18276 - KAFKA-18321: Add StreamsGroupMember, MemberState and Assignment classes (#18276)
  • PR-18443 - KAFKA-18425 Remove OffsetTrackingListener (#18443)
  • PR-18439 - KAFKA-18433: Add BatchSize to ShareFetch request (1/N) (#18439)
  • PR-18428 - Backport some GHA changes from trunk (#18428)
  • PR-18415 - KAFKA-18428: Measure share consumers performance (#18415)
  • PR-18419 - KAFKA-18397: Added null check before sending background event from ShareConsumeRequestManager. (#18419)
  • PR-18440 - KAFKA-18449: Add share group state configs to reconfig-server.properties (#18440)
  • PR-18296 - KAFKA-18173 Remove duplicate assertFutureError (#18296)
  • PR-18094 - KAFKA-15599: Move SegmentPosition/TimingWheelExpirationService to raft module (#18094)
  • PR-18329 - KAFKA-18353 Remove zk config control.plane.listener.name (#18329)
  • PR-18429 - KAFKA-18443 Remove ZkFourLetterWords (#18429)
  • PR-18431 - KAFKA-18417 Remove controlled.shutdown.max.retries and controlled.shutdown.retry.backoff.ms (#18431)
  • PR-18287 - KAFKA-18326: fix merge iterator with cache tombstones (#18287)
  • PR-18413 - KAFKA-18411 Remove ZkProducerIdManager (#18413)
  • PR-18421 - KAFKA-18408 tweak the ‘tag’ field for BrokerHeartbeatRequest.json, BrokerRegistrationChangeRecord.json and RegisterBrokerRecord.json (#18421)
  • PR-18401 - KAFKA-18414 Remove KRaftRegistrationResult (#18401)
  • PR-17671 - KAFKA-17921 Support SASL_PLAINTEXT protocol with java.security.auth.login.config (#17671)
  • PR-18411 - KAFKA-18436: Revert Multiversioning Changes from 4.0 release. (#18411)
  • PR-18364 - KAFKA-18384 Remove ZkAlterPartitionManager (#18364)
  • PR-17946 - KAFKA-10790: Add deadlock detection to producer#flush (#17946)
  • PR-18399 - KAFKA-18412: Remove EmbeddedZookeeper (#18399)
  • PR-18352 - KAFKA-18368 Remove TestUtils#MockZkConnect and remove zkConnect from TestUtils#createBrokerConfig (#18352)
  • PR-18396 - KAFKA-18303; Update ShareCoordinator to use new record format (#18396)
  • PR-18370 - KAFKA-18388 test-kraft-server-start.sh should use log4j2.yaml (#18370)
  • PR-17742 - KAFKA-18419: KIP-891 Connect Multiversion Support (Transformation and Predicate Changes) (#17742)
  • PR-18355 - KAFKA-18374 Remove EncryptingPasswordEncoder, CipherParamsEncoder, GcmParamsEncoder, IvParamsEncoder, and the unused static variables in PasswordEncoder (#18355)
  • PR-18379 - KAFKA-18311: Configuring changelog topics (2/N) (#18379)
  • PR-18318 - KAFKA-18307: Don’t report on disabled/removed tests (#18318)
  • PR-17801 - KAFKA-17278; Add KRaft RPC compatibility tests (#17801)
  • PR-18377 - KAFKA-17539: Application metrics extension for share consumer (#18377)
  • PR-18384 - KAFKA-17616: Remove KafkaServer (#18384)
  • PR-18268 - KAFKA-18311: Add internal datastructure for configuring topologies (1/N) (#18268)
  • PR-18343 - KAFKA-18358: Replace Deprecated $buildDir variable in build.gradle (#18343)
  • PR-18353 - KAFKA-18365 Remove zookeeper.connect in Test (#18353)
  • PR-18373 - Use instanceof pattern to avoid explicit cast (#18373)
  • PR-18270 - KAFKA-18319: Add task assignor interfaces (#18270)
  • PR-18259 - KAFKA-18273: KIP-1099 verbose display share group options (#18259)
  • PR-18363 - KAFKA-18367 Remove ZkConfigManager (#18363)
  • PR-18351 - KAFKA-18347 Add tools-log4j2.yaml to config and remove unsed tools-log4j.properties from config (#18351)
  • PR-18359 - KAFKA-18375 Update the LICENSE-binary (#18359)
  • PR-18345 - KAFKA-18026: KIP-1112, configure all StoreBuilder & StoreFactory layers (#18345)
  • PR-18232 - KAFKA-12469: Deprecated and corrected topic metrics for consumer (KIP-1109) (#18232)
  • PR-18254 - KAFKA-17421 Add integration tests for ConsumerRecord#leaderEpoch (#18254)
  • PR-18347 - KAFKA-18361 Remove PasswordEncoderConfigs (#18347)
  • PR-18271 - KAFKA-17615 Remove KafkaServer from tests (#18271)
  • PR-18308 - KAFKA-18280 fix e2e TestSecurityRollingUpgrade.test_rolling_upgrade_sasl_mechanism_phase_one (#18308)
  • PR-18327 - KAFKA-18313 Fix to Kraft or remove tests associate with Zk Broker config in SocketServerTest and ReplicaFetcherThreadTest (#18327)
  • PR-18279 - KAFKA-18316 Fix to Kraft or remove tests associate with Zk Broker config in ConnectionQuotasTest (#18279)
  • PR-18185 - KAFKA-18243 Fix compatibility of Loggers class between log4j and log4j2 (#18185)
  • PR-18269 - KAFKA-18315 Fix to Kraft or remove tests associate with Zk Broker config in DynamicBrokerConfigTest, ReplicaManagerTest, DescribeTopicPartitionsRequestHandlerTest, KafkaConfigTest (#18269)
  • PR-18338 - KAFKA-18354 Use log4j2 APIs to refactor LogCaptureAppender (#18338)
  • PR-18309 - KAFKA-18314 Fix to Kraft or remove tests associate with Zk Broker config in KafkaApisTest (#18309)
  • PR-18344 - KAFKA-18359 Set zkConnect to null in LocalLeaderEndPointTest, HighwatermarkPersistenceTest, IsrExpirationTest, ReplicaManagerQuotasTest, OffsetsForLeaderEpochTest (#18344)
  • PR-18101 - KAFKA-18135: ShareConsumer HB UnsupportedVersion msg mixed with Consumer HB (#18101)
  • PR-18283 - KAFKA-18317 Remove zookeeper.connect from RemoteLogManagerTest (#18283)
  • PR-18295 - KAFKA-18339: Remove raw unversioned direct SASL protocol (KIP-896) (#18295)
  • PR-18313 - KAFKA-18272: Deprecated protocol api usage should be logged at info level (#18313)
  • PR-18282 - KAFKA-18295 Remove deprecated function Partitioner#onNewBatch (#18282)
  • PR-18317 - KAFKA-18348 Remove the deprecated MockConsumer#setException (#18317)
  • PR-18324 - KAFKA-18352: Add back DeleteGroups v0, it incorrectly tagged as deprecated (#18324)
  • PR-18310 - KAFKA-18274 Failed to restart controller in testing due to closed socket channel [1/2] (#18310)
  • PR-18250 - KAFKA-18093 Remove deprecated DeleteTopicsResult#values (#18250)
  • PR-18312 - KAFKA-18343: Use java_pids to implement pids (#18312)
  • PR-18294 - KAFKA-18338 add log4j.yaml to test-common-api and remove unsed log4j.properties from test-common (#18294)
  • PR-18306 - KAFKA-18342 Use File.exist instead of File.exists to ensure the Vagrantfile works with Ruby 3.2+ (#18306)
  • PR-18246 - KAFKA-18290 Remove deprecated methods of FeatureUpdate (#18246)
  • PR-18255 - KAFKA-18289 Remove deprecated methods of DescribeTopicsResult (#18255)
  • PR-18265 - KAFKA-18291 Remove deprecated methods of ListConsumerGroupOffsetsOptions (#18265)
  • PR-18223 - KAFKA-18278: Correct name and description for run-gradle step (#18223)
  • PR-18267 - KAFKA-17393: Remove log.message.format.version/message.format.version (KIP-724) (#18267)
  • PR-18132 - KAFKA-17705: Add Transactions V2 system tests and mark as production ready (#18132)
  • PR-18291 - KAFKA-18269: Remove deprecated protocol APIs support (KIP-896, KIP-724) (#18291)
  • PR-18218 - KAFKA-18269: Remove deprecated protocol APIs support (KIP-896, KIP-724) (#18218)
  • PR-18288 - KAFKA-18334: Produce v4-v6 should be undeprecated (#18288)
  • PR-18262 - KAFKA-18270: FindCoordinator v0 incorrectly tagged as deprecated (#18262)
  • PR-18221 - KAFKA-18270: SaslHandshake v0 incorrectly tagged as deprecated (#18221)
  • PR-18249 - KAFKA-13722: code cleanup after deprecated StateStore.init() was removed (#18249)
  • PR-17687 - KAFKA-15370: Support Participation in 2PC (KIP-939) (1/N) (#17687)
  • PR-18285 - KAFKA-18312: Added entityType: topicName to SubscribedTopicNames in ShareGroupHeartbeatRequest.json (#18285)
  • PR-18261 - KAFKA-18301; Make coordinator records first class citizen (#18261)
  • PR-18204 - KAFKA-18262 Remove DefaultPartitioner and UniformStickyPartitioner (#18204)
  • PR-18257 - KAFKA-18296 Remove deprecated KafkaBasedLog constructor (#18257)
  • PR-18238 - KAFKA-12829: Remove old Processor and ProcessorSupplier interfaces (#18238)
  • PR-18245 - KAFKA-18292 Remove deprecated methods of UpdateFeaturesOptions (#18245)
  • PR-18154 - KAFKA-12829: Remove deprecated Topology#addProcessor of old Processor API (#18154)
  • PR-18136 - KAFKA-18207: Serde for handling transaction records (#18136)
  • PR-18243 - KAFKA-13722: Refactor Kafka Streams store interfaces (#18243)
  • PR-18241 - KAFKA-17131: Refactor TimeDefinitions (#18241)
  • PR-18228 - KAFKA-18284: Add group coordinator records for Streams rebalance protocol (#18228)
  • PR-18242 - KAFKA-13722: Refactor SerdeGetter (#18242)
  • PR-18176 - KAFKA-18227: Ensure v2 partitions are not added to last transaction during upgrade (#18176)
  • PR-18251 - Add IT for share consumer with duration base offet auto reset (#18251)
  • PR-18230 - KAFKA-18283: Add StreamsGroupDescribe RPC definitions (#18230)
  • PR-18260 - KAFKA-18294 Remove deprecated SourceTask#commitRecord (#18260)
  • PR-18211 - KAFKA-18264 Remove NotLeaderForPartitionException (#18211)
  • PR-18248 - KAFKA-18094 Remove deprecated TopicListing(String, Boolean) (#18248)
  • PR-18227 - KAFKA-18282: Add StreamsGroupHeartbeat RPC definitions (#18227)
  • PR-18205 - KAFKA-18026: transition KTable#filter impl to use processor wrapper (#18205)
  • PR-18244 - KAFKA-18293 Remove org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler and org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerValidatorCallbackHandler (#18244)
  • PR-18234 - KAFKA-17960; PlaintextAdminIntegrationTest.testConsumerGroups fails with CONSUMER group protocol (#18234)
  • PR-18144 - KAFKA-18200; Handle empty batches in coordinator runtime (#18144)
  • PR-18180 - KAFKA-18237: Upgrade system tests from using 3.7.1 to 3.7.2 (#18180)
  • PR-18210 - KAFKA-18259: Documentation for consumer auto.offset.reset contains invalid HTML (#18210)
  • PR-18207 - KAFKA-18263; Group lock must be acquired when reverting static membership rejoin (#18207)
  • PR-18190 - KAFKA-18244: Fix empty SHA on “Pull Request Labeled” workflow (#18190)
  • PR-18166 - KAFKA-18226: Disable CustomQuotaCallbackTest and remove isKRaftTest (#18166)

ksqlDB

  • PR-10831 - Fix ProcessValue and update historical plans
  • 318f76ab - Bump up tcnative dependency.
  • 28b84e56 - Update netty to 4.1.125 in 8.1.0
  • 53ee8cae - Update netty version
  • PR-10820 - Add log4j-slf4j-impl dependency for external security plugins
  • 5a2abfb2 - Merge conflict fix
  • 35cd807a - Merge conflict fix
  • b54b98a7 - Added check for a compliant resource extension class name
  • PR-10808 - Added check for a compliant resource extension class name
  • PR-10806 - Changes to add License Validation plugin from CSP (#10789)
  • PR-10802 - Pin httpclient 5 to correct one
  • e9c70665 - Update json-smart version override comment for CVE-2024-57699
  • e1506346 - Override vulnerable json-smart version to fix CVE-2024-57699
  • PR-10789 - KSQL-13744 Changes to add License Validation plugin from CSP
  • ff42df17 - Update dependency io.netty:netty-codec-http2 to v4.1.124.Final [SECURITY]
  • PR-10792 - Merge Conflict Resolution (from 7.9.x to 8.0.x)
  • PR-10791 - Add option to use local mode in proxy protocol headers.
  • PR-10788 - PR merge 7 9 x to 8 0 x
  • PR-10782 - Filter out security.protocol and sasl.mechanism as configs to be passed to ksql query overrides.
  • PR-10786 - Fix checkstyle errors.
  • PR-10785 - Apply proxy protocol configs to admin client.
  • PR-10781 - Pass the proxy protocol headers to admin, producer and consumer clients if the user principal is available.
  • PR-10779 - CVE fix for commons-lang3. Bump the version to 3.18.0
  • PR-10774 - Upgrade http components
  • afa3e130 - Master fix
  • 1323f2de - Master fix
  • 2dc484a5 - Master fix
  • PR-10770 - MINOR: Fix ConsistencyOffsetVector deserialization after Jackson 2.19.0 version upgrade
  • PR-10768 - MINOR: Update maven-shade-plugin version
  • PR-10765 - Adds apache kafka logger to rolling log4j2 yaml file
  • 4baa81fa - Preliminary change set to merge when Apache Kafka upstream merges are introduced
  • PR-10761 - Fix machine type
  • fbbfc142 - Suppress SIC_INNER_SHOULD_BE_STATIC04
  • d0ed3895 - Resolve checkstyle errors.
  • f48de3d3 - Resolve checkstyle errors.
  • 89da3e56 - Resolve checkstyle errors.
  • 79daf33d - Due to a recent commit in ce-kafka https://github.com/confluentinc/ce-kafka/pull/21030 (cherry pick from AK), few OAuth layer classes have been renamed: AccessTokenRetriever -> JwtRetriever AccessTokenValidator -> JwtValidator HttpAccessTokenRetriever -> HttpJwtRetriever LoginAccessTokenValidator -> ClientJwtValidator
  • 193aa810 - Suppress spotbugs.
  • a13a47da - Add suppression for PA_PUBLIC_PRIMITIVE_ATTRIBUTE, FS_BAD_DATE_FORMAT_FLAG_COMBO in findbugs-exclude.xml
  • f2beb974 - Suppress spot bug errors.
  • 812b566e - Suppress spot bug errors.
  • e6450af9 - Suppress spotbug errors..
  • PR-10744 - Return a server error for host unavailability errors in pull queries.

REST Proxy

  • PR-1409 - Prompt for community/open-source editions (#1407)
  • PR-1407 - Prompt for community/open-source editions
  • f05cee42 - Remove bc dependency that is being merged in bc-prov
  • PR-1403 - Hardcoding the CP rpm and deb installation dependency version
  • 3d866adb - Update Ubuntu version from 20 to 24 in Semaphore configuration
  • PR-1377 - Remove zk support for kafka-rest integration tests
  • PR-1373 - Chore: update repo by service bot
  • d3249c51 - Import Disabled
  • PR-605 - Merge Conflict Resolution (from 8.0.x to 8.1.x)
  • fe264d8b - Adding a UT for the temporary exception Mapper logic
  • 76bb723c - Fix build issues
  • b59226a4 - Name the config correctly
  • 9691e060 - Added behind a RestConfig
  • b2279888 - Temp: for inc-3209, we return a 429 instead of 500
  • PR-587 - Fix javax to jakarta in SpireTest
  • PR-586 - Fix jakarta usage in SpireTest.java
  • PR-584 - Adding ProxyCustomizer for accessing tlvs
  • 3d67bbc7 - Refactor comments
  • 33f20c6e - Add comment to explain acceptAnySpiffeId
  • f390b052 - Add comment
  • 8dbdc48c - Clean code
  • 03d316fc - Fix http2 fips tests
  • 2accbb1b - Fix SSL_IS_SPIRE_ENABLED_DOC and SSL_IS_SPIRE_ENABLED_DEFAULT
  • e57ff8da - Rename SSL_IS_SPIRE_ENABLED to SSL_SPIRE_ENABLED
  • 8b340b25 - Add grpc-netty-linux to pom
  • 2837a665 - Dependency modification
  • 4f573a6f - White space nit
  • 913fe83a - Add more constructor
  • e93773ec - Add new consturctor to application server
  • 590a07e6 - Style fix
  • 94b1e7bb - Add more comments for the sample HelloWorldSpireApplication
  • a7f06a76 - Make all the test to use SSL_CLIENT_AUTHENTICATION_CONFIG instead
  • d1992f62 - Revert extra variable for MTLS
  • 2b569a12 - Fix HelloWorldSpireApplication style issue
  • 99dfa601 - Remove socket path
  • d102c902 - Remove socketPath variable from config
  • e8fa0abe - Remove init X509 Source logic; changed to throw error instead
  • b154af2a - Spire Test Refactor 2
  • 447f8a9a - Spire Test Refactor 1
  • affb8342 - Create HelloWorldApplication with s2s based on spire
  • 9e463ffb - Revert all changes made to HelloWorldApplication
  • 6fcdf0f2 - Add more tests cases for spire Test
  • 5392cec4 - Add option to be MTLS v.s TLS
  • 27f06eb5 - Fix TestCustomizeThreadPool unit testing failure due to incorrect constructor building
  • 67f8d26c - Nit changes
  • 62abe019 - Implement mock class in spire Test
  • 54c2459e - Style check for sslfactory
  • 85737b0a - Style fixing
  • b5ec6760 - Add null check
  • bb80e4e8 - Add 2 ways of application starting
  • 8c6a02bb - Move X509source object to be in application server to prevent it getting closed
  • 0a69aadd - Put x509 passing into the server
  • a470260f - Add spire setting for helloWorldApplication
  • e6ddc845 - Refactor x509source initilization to sslFactory
  • 7b309f76 - Add config for spire related setting
  • f5b3cb4f - Modify spireTest to use spiffeFactoryContext
  • a14733fd - Modify HelloWorld Application to pass X509Source when init application
  • 62f664bd - Modify application to take or initialize X509
  • 35162aea - Mdofiy applicationserver to to take X509 source outside
  • ed3d2fca - SslFactory utilize SpiffeSslContextFactory instead of custom implementation
  • e73cc147 - Remove SpiffeTrustManager
  • 6356cf0e - Add spire client test to do MTLS
  • 1a5b4c6c - Make HelloWorldApplication using SSL
  • c4eb6a20 - Dependency pom xml
  • 30763b96 - Modify server to make it connecting to spire agent
  • f748ee7d - Use max metric value
  • 9fcd1fa5 - Enable metric latency test
  • 3685f929 - Enable request log test
  • PR-579 - Update Ubuntu version from 20 to 24
  • 3af4625f - Semaphore s1-prod-ubuntu24-04-amd64-0 after_pipeline
  • 8202fbd9 - Fix test
  • a81a7845 - Update Semaphore agent to s1-prod-ubuntu24-04-amd64-1
  • 53e0fd45 - Add PREFIX_SNI_PREFIX_CONFIG
  • da8cf6fe - Restrict sni prefix validation to certain prefix
  • PR-573 - Scoped to listener config for network connector

Schema Registry

  • PR-3906 - Follow up PR to handle old CP versions (#3902)
  • PR-3895 - Remove protobuf.version in order to rely on the one from common (#3891)
  • PR-3892 - Ensure tags are used during schema evolution (#3890)
  • PR-3880 - Fix IndexOutOfBoundsException when evolving Avro schema w/rules
  • PR-3876 - Fix merge issue; add JavaDoc for invalidate methods
  • PR-3875 - Refine cache invalidation
  • PR-3868 - DGS-21934: only retry + throw NetworkException on IOException related to network connections
  • PR-3871 - Some fixes to tests/lints
  • PR-3870 - Add sr-version to sr client API
  • PR-3866 - Merge Conflict Resolution (from 7.4.x to 7.5.x)
  • 1cdf19fe - Re-organize imports
  • PR-3865 - Merge Conflict Resolution (from 7.4.x to 7.5.x)
  • PR-3864 - Organizing imports
  • PR-3863 - Fix assert equals usage for 8.0.x and greater
  • PR-3862 - Add deployment metadata endpoint
  • PR-3860 - Add sr type endpoint
  • PR-3837 - Hardcoding the CP rpm and deb installation dependency version
  • PR-3855 - Minor refactoring; add test
  • PR-3850 - Prevent re-registration of schema with dangling reference
  • PR-3851 - For shared KEKs avoid calling KMS when deleting DEKs
  • PR-3842 - Modify Schema Registry Client Config to convert all configs to string
  • PR-3840 - Fix build due to Jackson upgrade to 2.16
  • PR-3841 - Modify POST /subjects lookup to fail only if both normalize=true fails
  • PR-3838 - Upgrade json-sKema to 0.24.0
  • PR-3834 - Add descriptive logging for use of apache http client
  • PR-3832 - Close Schema registry after closing resource extensions
  • PR-3822 - DGS-21595 Allow alternate KMS key IDs on a KEK
  • PR-3826 - Merge Conflict Resolution (from 7.3.x to 7.4.x)
  • PR-3821 - Upgrade commons lang version
  • PR-3825 - Add Apache and CCL licenses to the dek-* modules
  • PR-3824 - Fix license headers
  • PR-3823 - Fix license headers
  • PR-3815 - Add getGuid method to SchemaRegistryClient
  • 752b07bc - DGS-21546 Minor refactor to add subject to create DEK API
  • 38791869 - Removed comment
  • PR-3810 - Fix : Subject config and mode should be deleted on hard delete
  • PR-3817 - Prevent default context being allowed in forward mode
  • PR-3816 - DGS-21504 Ensure DEKs are decrypted if version=-1 for shared KEKs
  • PR-3814 - Replace MDC with ThreadContext for LOG4J2 compatibility
  • PR-3812 - DGS-21443 Configure customer handlers after security handler (#3805) 8.1.x prot
  • PR-3809 - Enfroce forward mode to global context
  • PR-3808 - Add support for JSON Schema 2020-12 in JsonSchemaUtils
  • PR-3777 - DGS-21268 Add support for full payload encryption
  • PR-3787 - Changed resource logging to log subject name assotiation rather than hash contents
  • PR-3802 - Fix field traversals when POJO property is missing
  • PR-3794 - Handle decimals based on fixed type in Avro converter
  • PR-3800 - Fix license headers
  • PR-3799 - Fix license headers
  • PR-3797 - Fix license headers
  • PR-3795 - Fix license headers
  • PR-3792 - Fix license headers
  • PR-3789 - Support for license headers
  • PR-3783 - Support for license headers
  • PR-3763 - Add additional config for Apache Http Client
  • PR-3784 - Fix parsing of recursive definitions for JSON Schema 2020-12
  • PR-3773 - Send NetworkException instead of ConnectionException for IO exceptions in Connect converters
  • PR-3775 - Set cleanup.policy to compact in integration tests
  • da3ea478 - Fix test
  • 9661d1af - Migrate test to Junit 5 after merge
  • PR-3766 - Support a true global config/mode
  • PR-3767 - Upgrade jackson-datatype-protobuf to 0.9.16
  • PR-3764 - Add REST API to delete context
  • PR-3760 - 7.8 below java doc fix
  • PR-3761 - Javadoc fix in ParsedSchema
  • PR-3759 - Add javadoc as part of the maven build (#3758)
  • PR-3758 - Add javadoc as part of the maven build
  • PR-3749 - Update PR template to include related changes
  • PR-3755 - Fix for javadoc failure
  • PR-3751 - Fix master SR oauth to handle AK changes
  • PR-3750 - Bump max DEK registry key default
  • PR-3746 - Generate correct field type for Decimal in JSON converter
  • PR-3744 - Add referenceFormat param to qualify references
  • PR-3738 - Send ConnectException for IO exceptions in connect converters
  • dee00fa2 - Checkstlye fix
  • e70d6ffe - Formatting fixes
  • PR-3741 - DGS-20896 Ensure correct GUID when requesting a formatted schema
  • 47c90d80 - Fixed failing test
  • d439f6d7 - Formatting fix
  • 42349149 - Exposed context name for mode/config errors
  • PR-3739 - Fix ubuntu24 image in schema registry repo
  • PR-3736 - Suppressions and few volatile var changes to resolve spotbugs errors
  • PR-3735 - Add log4j-1.2-api dependency to SR (#3734)
  • PR-3734 - Add log4j-1.2-api dependency to SR
  • PR-3733 - Fix build by renaming oauth kafka classes
  • 39474f1d - Upgrade json-skema to 0.22
  • PR-3724 - Upgrade everit json-schema to 1.14.6
  • PR-3718 - Adjust the format of the PR template to remove checkbox
  • PR-3714 - DGS-20647 Ensure SR client cache for CP 8.0 is backward compat with 7.x.x
  • PR-3701 - Adjust the PR template to use freeform text instead of checkbox
  • PR-3705 - Correct forward statement
  • PR-3703 - Remove unused method to resolve kafka build failure
  • PR-3697 - Add Forward mode