Confluent Platform Component Changelogs

This topic provides changelogs for the individual Confluent Platform components.

Version 5.5.4

This topic provides changelogs for the individual Confluent Platform components.

Community Features

Common

  • PR-314 - MMA-9930: Sync Google Guava version.
  • PR-309 - SEC-1789: Upgrade bouncycastle to 1.68

Kafka

  • PR-547 - Upgrade Jetty to 9.4.39.v20210325
  • PR-538 - SEC-1883: Upgrade Netty version to 4.1.62.Final
  • PR-10396 - KAFKA-12474: Handle failure to write new session keys gracefully (#10396)
  • PR-537 - kc-1457: Upgrade HttpClient for CVE-2020-13956
  • PR-10118 - KAFKA-10192: Increase max time to wait for worker to start in some integration tests (#10118)
  • 24349972 - KAFKA-12324: Upgrade jetty to fix CVE-2020-27218
  • PR-10152 - KAFKA-12339: Add retry to admin client’s listOffsets (#10152)
  • PR-10158 - KAFKA-12343: Handle exceptions better in TopicAdmin, including UnsupportedVersionException (#10158)
  • PR-10153 - KAFKA-12340: Fix potential resource leak in Kafka*BackingStore (#10153)
  • PR-10122 - KAFKA-12326: Corrected regresion in MirrorMaker 2 executable introduced with KAFKA-10021 (#10122)
  • PR-10064 - KAFKA-12193: Re-resolve IPs after a client disconnects (#9902) (#10064)
  • PR-9780 - KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics (#9780)
  • PR-9977 - KAFKA-12310: Update zookeeper to 3.5.9 (#9977)
  • PR-9987 - KAFKA-10895: Gracefully handle invalid JAAS configs (follow up fix) (#9987)
  • PR-9319 - KAFKA-10413: Allow for even distribution of lost/new tasks when multiple Connect workers join at the same time (#9319)
  • PR-9765 - KAFKA-10763: Fix incomplete cooperative rebalances preventing connector/task revocations (#9765)
  • PR-9880 - KAFKA-10792: Prevent source task shutdown from blocking herder thread (#9669) (#9880)
  • PR-9806 - KAFKA-10895: Attempt to prevent JAAS config from being overwritten for basic auth filter in Connect (#9806)
  • PR-8357 - KAFKA-9767: Add logging to basic auth rest extension (#8357)

ksqlDB

  • PR-7333 - fix: upgrade io.netty:netty-codec-http2 to 4.1.62.Final.
  • PR-7305 - fix: only list known connect worker properties when listing server props (5.5.x)
  • PR-6935 - fix: FF-4240 upgrade org.apache.httpcomponents.httpclient version
  • PR-6934 - fix: upgrade ANTLR to 4.7.1

REST Proxy

  • PR-831 - KREST-865 Remove usage of the deprecated SimpleAclAuthorizer.
  • PR-799 - KREST-558 Backport the fix for KREST-524 (fixing a concurrent test failure) to 5.5.x and 6.0.x.
  • PR-242 - Upgrade Jetty to 9.4.39.v20210325
  • PR-237 - Define Netty version to be shared to downstreams.
  • PR-229 - KC-1456: Update Jetty to 9.4.36.v20210114
  • PR-231 - UIF-298: Upgrade Jetty to 9.4.35.v20201120
  • PR-228 - MMA-9930: Use compatible version of Guava
  • PR-222 - UIF-300: Upgrade org.apache.httpcomponents.httpclient
  • PR-223 - UIF-302: Upgrade guava for 5.4.x and older.
  • PR-224 - upgrade hibernate-validator to 6.1.7.Final
  • PR-216 - MMA-7520: add CsrfTokenProtectionFilter

Schema Registry

  • PR-1833 - DGS-1534 Use raw Avro schema to check doc equality
  • PR-1821 - DGS-1469 Add server-side schema cache
  • PR-1816 - DGS-1391: fix Avro Convertor for GenericData of Enum Union with names
  • PR-1812 - Add more JSON Schema tests
  • PR-1808 - DGS-1403 Allow register different schema types if compatibility level
  • PR-1807 - UIF-302: Add Guava declaration in dependency.
  • PR-1806 - DGS-1402 Flag to set non-required fields to optional in JSON Schema
  • PR-1805 - DGS-1400 Escape Special Character in Protobuf Option
  • PR-1804 - DGS-1392 Allow removing false from closed content model in JSON Schema
  • PR-1802 - DGS-1398 Allow adding empty schema to open content model for JSON Schema
  • PR-1801 - DGS-1396 Fix optionality of ref schemas in JSON Schema converter
  • PR-1799 - DGS-1391: fix Avro Convertor for GenericData of union with null, string, enum
  • PR-1795 - DGS-1221 Ensure AvroSchema.hashCode is consistent with equals
  • PR-1791 - DGS-1364 Fix compatibility for JSON empty schema
  • PR-1737 - Backport #1733 to 5.4.x
  • PR-1784 - DGS-1221 Fix AvroSchema.equals
  • PR-1779 - DGS-772 Add API annotations for /mode
  • PR-1777 - Upgrade to everit 1.12.2
  • PR-1639 - Upgrade to wire 3.6.0
  • PR-1775 - DGS-104 Fix Avro compat check
  • PR-1774 - DGS-1333 Add config to remove Java props from Avro schemas
  • PR-1770 - DGS-1315: upgrade HibernateValidator
  • PR-1769 - DGS-1314: update JetBeanKotlin to 1.4.21
  • PR-1760 - DGS-1244 Resolve dependencies before caching
  • PR-1757 - DG-1239 Fix Avro Converter for union with null, string, enum
  • PR-1739 - DG-980 Support ISO 8601 for JSON date/time
  • PR-1754 - DG-1237 Handle missing fields in JsonSchemaConverter
  • PR-1753 - DG-1236 Improve oneOf handling in JsonSchemaConverter
  • PR-1748 - DG-424: prevent import different schema with same id
  • PR-1747 - DG-1189 Add latest.compatibility.strict flag
  • PR-1746 - DG-931: throw ConfigException in Avro/Json/Protobuf Converter
  • PR-1724 - DG-1124 NPE in ProtobufMessageFormatter
  • PR-1722 - DG-1122 Treat reordering Protobuf msgs as incompatible

Commercial Features

Confluent Server

  • Correct Downstream validation parameters
  • Upgrade Telemetry client to 1.155.1
  • SEC-2022: Upgrade netty-tcnative-boringssl-static to 2.0.38.Final
  • Added classpath for mds jars.
  • CONFLUENT MINOR: Remove Math.min check, Archiver debug logging
  • KAFKA-12293: remove JCenter and Bintray repositories mentions out of build gradle scripts (sunset is announced for those repositories)
  • MMA-9397: Filter out confluent.ssl configs when describing topic configs
  • KAFKA-12324: Upgrade jetty to fix CVE-2020-27218
  • SEC-1805: Reduce failed MDS request send log threshold from ERROR to Debug
  • KC-1457 : Update Httpclient to 4.5.13 and add explicit HttpClient dependency
  • CONFLUENT: Update Zookeeper node start timeout in system tests
  • KSQL-5843: prevent log spam from MDS RestClient on client close
  • SEC-1789 Bump Bouncy Castle dep to resolve CVE-2020-28052

Security

  • DGS-1463: Modify config types for sensitive SR validator plugin configs

MQTT Proxy

  • SEC-2022: Upgrade Netty to 4.1.62.Final

Connectors

Elasticsearch Connector

  • PR-506 - CCMSG-835, CCMSG-834: Update outdated commons-codec to fix CVE
  • PR-495 - CC-13829: Upgrade httpclient to 4.5.13

HDFS Connector

  • PR-550 - CCMSG-852: Swallow exceptions and continue recovery when attempting to apply a corrupt WAL
  • PR-548 - CCMSG-857: Match lease acquisition log level

JDBC Connector

  • PR-1038 - Upgrade org.postgresql:postgresql to version 42.2.19
  • PR-1004 - CCDB-3681: pick binding method wisely according to column def
  • PR-959 - CC-12626: validate topic.prefix to disallow spaces in between

JMS Connector

  • CCMSG-846: Do not use SSL when SSL configs are not entered
  • Upgrade Active MQ client to 5.15.14 and fix CVE

Replicator Connector

  • REPL-1410: Changed logging for WakeupException to DEBUG
  • REPL-1386: Adding clear logging statements for src and dest operations
  • REPL-1409: Added WARN logging if destination SR deemed not ready
  • REPL-1396: Fix CVE for HttpClient
  • SEC:1820: Upgrade codec version
  • REPL-1396: Fix CVE for aws-java-sdk-ecr
  • REPL-1310 fix for monitor thread failures in start stop start cycle

S3 Connector

  • PR-399 - SEC-1996: Replace commons-httpclient with apache httpclient
  • PR-391 - CC-13830: Upgrade S3 connector to use HttpClient defined in kafka-connect-storage-common

Storage Common

  • PR-176 - CC-13830: upgrade org.apache.httpcomponents:httpclient version to 4.5.13 to address CVE

Version 5.5.3

This topic provides changelogs for the individual Confluent Platform components.

Community Features

Common

  • PR-306 - Bump Junit version to 4.13.1
  • PR-305 - SEC-1474: Upgraded bcpkix-jdk15on to 1.66

Kafka

  • PR-9026 - KAFKA-10274; Consistent timeouts in transactions_test
  • PR-9702 - CVE-2020-25649: bumping jackson to patched version 2.10.5.1
  • PR-9698 - KAFKA-10811: Correct the MirrorConnectorsIntegrationTest to correctly mask the exit procedures
  • PR-9633 - KAFKA-10706; Ensure leader epoch cache is cleaned after truncation to end offset
  • PR-9270 - KAFKA-10284: Group membership update due to static member rejoin should be persisted
  • PR-9431 - KAFKA-10426: Deadlock on session key update.
  • PR-9343 - KAFKA-10332: Update MM2 refreshTopicPartitions() logic
  • PR-9425 - KAFKA-10600: Connect should not add error to connector validation values for properties not in connector’s ConfigDef
  • PR-9375 - KAFKA-10574: Fix infinite loop in Values::parseString
  • PR-8910 - KAFKA-10188: Prevent SinkTask::preCommit from being called after SinkTask::stop
  • PR-9320 - KAFKA-10439: Connect’s Values to parse BigInteger as Decimal with zero scale.
  • PR-8353 - KAFKA-9764: Remove stream simple benchmark suite
  • PR-9347 - KAFKA-10531: Check for negative values to Thread.sleep call
  • PR-9306 - KAFKA-10477: Enabling the same behavior of NULL JsonNodeType to MISSI…
  • PR-8973 - KAFKA-10218: Stop reading config topic in every subsequent tick if catchup fails once
  • PR-8181 - KAFKA-9584 Headers ConcurrentModificationException
  • PR-9202 - KAFKA-10401: Fix the currentStateTimeStamp doesn’t get set correctly

ksqlDB

  • PR-6732 - fix: (minor) don’t use deprecated jersey calls
  • PR-6702 - fix: use Java’s Base64 instead of jersey’s
  • PR-6608 - fix: Check for index before removing value in undo of COLLECT_LIST

REST Proxy

  • PR-773 - KREST-287: Syncronize resource pools/managers lazy instantiation.
  • PR-209 - SEC-592: Customize Jetty request queue and threadpool size (#172)
  • PR-215 - ff-3928: bump version of Guava in parent of schema-registry.
  • PR-210 - ST-4542: Upgrade jetty to address CVE-2020-27216

Schema Registry

  • PR-1700 - DG-293: Improve exception messages in JsonSchemaConverter and ProtobufConverter
  • PR-1699 - DG-1040 Register ids for soft deletes
  • PR-1688 - DG-1007 Preserve refs when converting schema to envelope
  • PR-1686 - MMA-8608 Handle duplicate configs after stripping prefix
  • PR-1684 - MMA-8608: parse configs before calling restService.configure()
  • PR-1678 - DG-990 Allow SpecificAvroSerde to work with array/map
  • PR-1676 - DG-972 Fix name collisions with field and message
  • PR-1675 - DG-962 Handle const schemas in JSON Schema converter
  • PR-1658 - DG-951 Handle duplicate message names during deserialization
  • PR-1648 - DG-935 Treat removing Protobuf message types as incompatible
  • PR-1647 - DG-933 Resend old value when handling invalid key-value
  • PR-1634 - DG-921 Fix Avro specific reader for unions
  • PR-1625 - DG-410 Fix doc/defaults in Avro converter

Commercial Features

Confluent Server

  • KC-1275: Update KafkaReader to handle entries from multiple partitions
  • KSTORAGE-1290: Bump google storage client dependency to 1.113.4
  • CPKAFKA-6126: Update commons codec
  • KC-1195: Ensure connections are closed if principal cannot be built
  • KC-1120: Ensure that RBAC metadata write failures are reset after writer elections
  • KC-705: Retry metadata topic consumer.position() until authorizer startup times out

Security

  • Implement asychronous schema fetching in LruSchemaRegistryClient

Metadata Service

  • SEC-1565: Incorrect implementation of equals in ManagedRoleBindings
  • SEC-1566: Switch to https for packages.confluent.io
  • CIAM-338 - Test MyRoleBindings endpoints

Connectors

Elasticsearch Connector

  • PR-466 - adding a null check when validating list of urls
  • PR-463 - CC-10923: add reasonable validators for number configs (#456)
  • PR-462 - CC-10923: add reasonable validators for number configs
  • PR-454 - CC-12447: add comprehensive ITs to ES
  • PR-457 - CC-12452: add config combination validators
  • PR-455 - CC-12530: do not throw exception on flush after task close
  • PR-452 - Support retry_on_conflict parameter Fixes #374
  • PR-449 - CC-12129: catch resource_already_exists_exception when creating indices

HDFS Connector

  • PR-522 - Fix #326 by using config’s avroDataConfig method

JDBC Connector

  • PR-947 - CC-12468: Periodically return control flow to WorkerSourceTask
  • PR-942 - Maven: Removed build property ${confluent.maven.repo}.
  • PR-938 - Remove Connect-utils and Licensing-Extensions Deps
  • PR-918 - CC-8794: MS SQL Server datetime give repeated messages due to rounding error
  • PR-925 - CC-11940: fix a bug that happens when merging long text to oracle table

JMS Connector

  • CC-12824: Handle WebLogic Server clients, which include on messages a destination that is both a Queue and Topic
  • Revert “MINOR: Rename and fix test with permissive schemas (#136)”
  • CC-11937: Correct the maximum retry interval in the JMS source task
  • Address CVEs by upgrading activemq client to 1.15.13
  • SEC-1034: log4j migration to confluent repackaged version

Replicator Connector

  • REP-1300: Null out licenseManager on connector stop to avoid hang on restart
  • REPL-1303: Setting deadline correctly when trying to resume partitions
  • FF-3928: Exclude test dependency javassisst from curator-test to be assembled
  • FF-3928: Bump the version of Guava
  • REPL-1263: Supporting source url configs for active active SR
  • REPL-1204: Enable retries on cluster id fetch for Replicator task start

S3 Connector

  • PR-379 - CC-12772: bump test containers version to addres commons-compress CVE
  • PR-377 - CC-12825: Fix proprietary dependencies
  • PR-378 - CC-12695: stop throwing retriable exceptions on non-retriable S3 errors
  • PR-373 - HCD329: S3 Sink Connector Network ITs
  • PR-351 - CC-11250: Add basic integration tests

Storage Common

  • PR-168 - CC-13001: Remove avro-converter dependency and add avro-data dependency
  • PR-165 - Fix time-zone aware calculation for scheduled rotation between daylight savings and standard time
  • PR-151 - Correct SR schemas cache size property name for AvroDataConfig
  • PR-156 - Update commons codec to 1.15 to resolve CVE and exclude zookeeper test jar

Version 5.5.2

This topic provides changelogs for the individual Confluent Platform components.

Community Features

Common

  • PR-294 - SEC-1307: Backport “log4j replacement with confluent repackaged version”
  • PR-274 - ST-3988: Update jackson version to 2.10.5
  • PR-275 - SEC-1305: update jackson-bom version
  • PR-269 - Upgrade Jackson to 2.10.2 and Avro to 1.9.2

Kafka

  • PR-9286 - KAFKA-10292: Set min.insync.replicas to 1 of consumer_offsets
  • PR-9183 - KAFKA-10404; Use higher poll timeout to avoid rebalance in testCoordinatorFailover
  • PR-9184 - KAFKA-8033; Wait for NoOffsetForPartitionException in testFetchInvalidOffset
  • PR-9181 - KAFKA-9516; Increase timeout in testNonBlockingProducer to make it more reliable
  • PR-8854 - KAFKA-10146, KAFKA-9066: Retain metrics for failed tasks (backport to 2.5)
  • PR-8993 - KAFKA-10173: Use SmokeTest for upgrade system tests (#8938)
  • PR-9089 - KAFKA-10224: Update jersey license from CDDL to EPLv2
  • PR-9086 - FIX: Remove staticmethod tag to be able to use logger of instance
  • PR-9043 - KAFKA-10295: Wait for connector recovery in test_bounce
  • PR-9040 - KAFKA-10286: Connect system tests should wait for workers to join group
  • PR-9035 - set dev version to 2.5.1
  • PR-8934 - KAFKA-10134: Use long poll if we do not have fetchable partitions
  • PR-8987 - KAFKA-10221: Backport fix for KAFKA-9603 to 2.5
  • PR-8989 - KAFKA-10239: Make GroupInstanceId ignorable in DescribeGroups
  • PR-8905 - KAFKA-10173: Fix suppress changelog binary schema compatibility
  • PR-8904 - KAFKA-10185: Restoration info logging (#8896)
  • PR-8886 - KAFKA-9891: fix corrupted StandbyTask state

ksqlDB

  • PR-5786 - fix: better error on DECIMAL type with PROTOBUF format
  • PR-5656 - fix: allow empty structs in schema inference

REST Proxy

  • PR-191 - SEC-1034: log4j migration to confluent repackaged version
  • PR-199 - Rest CORS option skip will now default to true
  • PR-195 - Add a config flag to skip OPTION when CORS is enabled
  • PR-193 - Removed OPTION omission for CORS

Schema Registry

  • PR-1624 - DG-857 Fix Avro converter for top-level bytes object
  • PR-1616 - DG-845 Have typeName override Object.class type; fixes #1615
  • PR-1611 - Correct License in Client library
  • PR-1598 - CP-644: Include CP jars required for Security and monitoring
  • PR-1594 - DG-813 If use.latest.version is true, use on Protobuf dependencies
  • PR-1588 - DG-811 Allow JSON schema spec version to be specified
  • PR-1589 - DG-812 Derive file extension during download
  • PR-1587 - Upgrade to Kotlin 1.4.0
  • PR-1586 - DG-800 Cache ProtobufSchema using name in Converter
  • PR-1528 - SEC-1034: log4j migration to confluent repackaged version
  • PR-1580 - DG-789 Fix for CVE-2020-15824
  • PR-1579 - DG-788 Allow anyOf to be backward compat with oneOf/allOf
  • PR-1578 - DG-767 Calculate proper defaults for client ssl configs
  • PR-1577 - DG-774 restore ssl client configs
  • PR-1575 - DG-780 Add support for number with format for JSON Schema
  • PR-1574 - DG-774 Avoid regenerating default names for Protobuf data
  • PR-1567 - DG-740 Convert connect defaults for JSON Schema
  • PR-1561 - DG-723 Enable defaults for JSON Schema
  • PR-1550 - DG-695 Normalize JSON ref schemas before comparing
  • PR-1548 - ST-3988: update swagger-core to 1.6.2
  • PR-1538 - DG-670 Treat anyOf same as oneOf in JSON Schema converter
  • PR-1537 - DG-652 Fix missing negation in conditional
  • PR-1535 - DG-652 Handle imports during protobuf compat checks
  • PR-1531 - DG-628 Allow changes to id during json schema compat checks
  • PR-1530 - DG-607 Add lenient processing for numbers in oneof
  • PR-1523 - DG-607 Ensure fields for union are optional
  • PR-1520 - Handle null error stream in RestService
  • PR-1522 - DG-606 Add option to not generate oneof for nullable fields
  • PR-1517 - Upgrade maven-plugin dependencies to 3.6 in 5.4.x

Commercial Features

Confluent Server

  • KC-845: Ensure LogConfig includes broker defaults to pass schema config validation
  • CPKAFKA-5849: Don’t log password configs in request log filter
  • Increase root FS to 20GB
  • KC-646: Cherry pick Netty CVE fixes from 5.4.x
  • (Backport) include UnderMinIsrPartitionCount in the default broker metrics list
  • CPKAFKA-2852: CCloud metadata listener thread should not die on unexpected exception
  • SEC-384: Use the correct log level for debug output

Security

  • Validate KSQL/RBAC cannot initialize on non-SASL protocols
  • SEC-1034: log4j migration to confluent repackaged version
  • DG-706: fix bug in schema registry client tests, as well as some refactor
  • DG-708: Skip Schema Validation query range check for first lookup

Metadata Service

  • SEC-1034: log4j migration to confluent repackaged version

Connectors

Elasticsearch Connector

  • PR-435 - CC-9455: address SslFactor backwards/forwards compatibility
  • PR-433 - SEC-1307: Backport “log4j replacement with confluent repackaged version”
  • PR-428 - CC-4774: Check for unexpected datatypes in response from server

HDFS Connector

  • PR-510 - Resolving netty CVEs
  • PR-507 - Bump hadoop version to 2.7.7 and address beanutils CVE
  • PR-501 - CC-7360: Recover gracefully if closing a temporary file fails
  • PR-506 - CC-9755: Validate timezone configuration with rotate.schedule.interva…
  • PR-503 - CC-9710: Retry effectively on exceptions from time-based commits

JDBC Connector

  • PR-910 - CC-11507: Always parse Date in UTC
  • PR-906 - SEC-1307: Backport “log4j replacement with confluent repackaged version”
  • PR-692 - Enable CURRENT_TIMESTAMP for SAP HANA JDBC

JMS Connector

  • SEC-1307: Backport “log4j replacement with confluent repackaged version”

Replicator Connector

  • REP-1176 Log error when connector submission fails for Replicator Executable
  • REP-1131 Add support for Replicator with regex router
  • REP-1055 Enable converter configs for Replicator connector

S3 Connector

  • PR-356 - CC-11480: Add configuration property to choose between path style and virtual hosted bucket access to S3
  • PR-352 - SEC-1307: Backport “log4j replacement with confluent repackaged version”
  • PR-340 - CC-9753: Validate timezone configuration with rotate.schedule.interval.ms

Storage Common

  • PR-149 - Upgrade Parquet to 1.11.1
  • PR-145 - SEC-1307: Backport “log4j replacement with confluent repackaged version”
  • PR-139 - CC-8704: Exclude jetty from hcatalog and address CVE
  • PR-136 - CC-9779: PartitionerConfig should perform basic timezone validation

Version 5.5.1

This topic provides changelogs for the individual Confluent Platform components.

Community Features

Common

  • PR-261 - Update ZooKeeper to 3.5.8
  • PR-259 - add property for jackson-jsonschema version

ksqlDB

  • PR-5617 - fix: don’t fail if broker does not support AuthorizedOperations
  • PR-5273 - feat: implement earliest_by_offset() UDAF
  • PR-4975 - fix: fix NPE in latest_by_offset if first element being processed has null…
  • PR-4782 - feat: Implement latest_by_offset() UDAF
  • PR-5124 - Backport array len
  • PR-5213 - fix: use sr’s jackson-jsonschema version
  • PR-5139 - fix: include lower-case identifiers among those that need quotes (#3723)

Schema Registry

  • PR-1497 - DG-554 Pass refs when forwarding register requests
  • PR-1496 - DG-535 Handle recursive Protobuf schemas
  • PR-1495 - DG-402 Missed some places where dotted names can occur
  • PR-1487 - DG-527 Omit defaults for proto 3 schemas (fixed in wire)
  • PR-1482 - DG-499 Fix JSON Schema compat checks for partial models
  • PR-1484 - DG-524 Catch NPE during Avro compat check
  • PR-1476 - Add unit test for mvn validate action
  • PR-1474 - Add validate action for SR maven plugin
  • PR-1473 - Add ability to use latest version during serialization
  • PR-1471 - DG-436 Pass existing Avro schema instead of regenerating
  • PR-1470 - Allow unknown properties while deserializing SchemaRegistryProtocol.Assignment
  • PR-1469 - Fix message name on schema when version is included; fixes #1467
  • PR-1466 - DG-450 Perform proper matching of subschemas
  • PR-1450 - DG-400 Support enums using allOf in JSONSchema converter
  • PR-1449 - DG-402 Add support for packages in ProtobufConverter
  • PR-1451 - Upgrade swagger deps
  • PR-1440 - Fix null schema type
  • PR-1433 - use property for jackson-jsonschema
  • PR-1437 - Fix cyclic schema references
  • PR-1431 - Cherry-pick for permanent delete
  • PR-1426 - DG-377 Allow generated classes to use refs during serialization
  • PR-1427 - DG-399 Use envelope in JsonSchemaUtils.toObject
  • PR-1417 - Allow id to be passed to console prod/cons; fixes #160
  • PR-1422 - Fix cycles in Avro schemaEquals

Kafka

  • PR-8841 - KAFKA-10123 Fix incorrect value for AWAIT_RESET#hasPosition
  • PR-8764 - KAFKA-10049: Fixed FKJ bug where wrapped serdes are set incorrectly when using default StreamsConfig serdes
  • PR-8455 - KAFKA-9845: Warn users about using config providers with plugin.path property
  • PR-8453 - KAFKA-9841: Revoke duplicate connectors and tasks when zombie workers return with an outdated assignment
  • PR-8663 - KAFKA-9985: Sink connector may exhaust broker when writing in DLQ
  • PR-8630 - KAFKA-9969: Exclude ConnectorClientConfigRequest from class loading isolation
  • PR-7384 - KAFKA-8938: Improve allocations during Struct validation in ConnectSchema
  • PR-8827 - KAFKA-9849: Fix issue with worker.unsync.backoff.ms creating zombie workers when incremental cooperative rebalancing is used
  • PR-8805 - KAFKA-9848: Avoid triggering scheduled rebalance delay when task assignment fails but Connect workers remain in the group
  • PR-8270 - KAFKA-9216: Enforce internal config topic settings for Connect workers during startup
  • PR-8804 - KAFKA-9851: Revoking Connect tasks due to connectivity issues should also clear the running assignment
  • PR-8135 - KAFKA-9570: Define SSL configs in all worker config classes, not just distributed
  • PR-8759 - KAFKA-10066: TestOutputTopic should pass record headers into deserializers
  • PR-8706 - KAFKA-10030: Allow fetching a key from a single partition
  • PR-8668 - KAFKA-9987: optimize sticky assignment algorithm for same-subscription case
  • PR-8739 - KAFKA-10056: Ensure consumer metadata contains new topics on subscription change
  • PR-8705 - KAFKA-10029: Don’t update completedReceives when channels are closed to avoid ConcurrentModificationException
  • PR-8736 - KAFKA-9802: Increase transaction timeout in system tests to reduce flakiness
  • PR-8504 - KAFKA-9298: reuse mapped stream error in joins
  • PR-8376 - KAFKA-9724: Newer clients not always sending fetch request to older brokers
  • PR-8395 - Added doc for KIP-535 and updated it for KIP-562
  • PR-8118 - KAFKA-9472: Remove deleted Connect tasks from status store
  • PR-8511 - KAFKA-9888: Copy connector configs before passing to REST extensions
  • PR-8675 - KAFKA-10004: ConfigCommand fails to find default broker configs without ZK
  • PR-8608 - KAFKA-9950: Construct new ConfigDef for MirrorTaskConfig before defining new properties
  • PR-8444 - KAFKA-8869: Remove task configs for deleted connectors from config snapshot
  • PR-8673 - KAFKA-9992: EmbeddedKafkaCluster.deleteTopicAndWait not working with kafka_2.13
  • PR-8618 - KAFKA-9955: Prevent SinkTask::close from shadowing other exceptions
  • PR-8090 - KAFKA-9537: Cleanup error messages for abstract transformations
  • PR-8674 - KAFKA-9996: Upgrade zookeeper to 3.5.8
  • PR-8647 - KAFKA-9669: Loosen validation of inner offsets for older message formats
  • PR-8626 - KAFKA-9921: explicit handling of null values with retainDuplicates
  • PR-8230 - KAFKA-9667: Connect JSON serde strip trailing zeros
  • PR-8360 - KAFKA-9768: Fix handling of rest.advertised.listener config
  • PR-7950 - KAFKA-9419: Integer Overflow Possible with CircularIterator
  • PR-8260 - KAFKA-9625: Fixing IncrementalAlterConfigs with respect to Broker Configs
  • PR-8294 - KAFKA-9718: Don’t log passwords for AlterConfigs in request logs
  • PR-8204 - KAFKA-9633: Ensure ConfigProviders are closed
  • PR-8554 - KAFKA-9919: Add logging to KafkaBasedLog::readToLogEnd
  • PR-8559 - KAFKA-9922: Update examples README
  • PR-8442 - KAFKA-9830: Implement AutoCloseable in ErrorReporter and subclasses
  • PR-8542 - KAFKA-9826: Handle an unaligned first dirty offset during log cleani…
  • PR-8574 - KAFKA-9925: decorate pseudo-topics with app id
  • PR-8540 - KAFKA-9127: don’t create StreamThreads for global-only topology
  • PR-8564 - KAFKA-9921: disable caching on stores configured to retain duplicates
  • PR-8509 - KAFKA-9839: Broker should accept control requests with newer broker epoch
  • PR-8536 - KAFKA-9883: Add better error message when REST API forwards a request and leader is not known

Commercial Features

Security

  • Add authorizations for mode endpoints

Confluent Server

  • KSTORAGE-559: add maximum eligible segments deleted on every cleanup
  • KSTORAGE-743: prevent tier.feature use with IBP < 2.4 (#1787)
  • KC-533: Allow headers to be injected into RBAC records
  • CPKAFKA-4923: Disable audit logging in RbacTest::test_ldap_to_rbac_authorizer_upgrade
  • KAFKA-9731: Disable immediate fetch response for hw propagation if replica selector is not defined
  • CONFLUENT: Ensure license validator is closed in test to avoid impacting subsequent test
  • KCORE-330: Allow brokers to complete start up with configured license
  • KSTORAGE-502: Improve documentation for tiered storage configurations for 5.5.x
  • KCORE-341: Fix permission type in authorizer debug log entry
  • KCORE-316: Don’t load configs from ZK when the log has already been loaded

Connectors

Elasticsearch Connector

  • PR-413 - CC-9373: Skip only exceptions during conversion when drop.invalid.message is true
  • PR-412 - CC-9347: Inspect interrupted state before next attempt
  • PR-411 - CC-9261: call get() on futures so that we properly handle exceptions …
  • PR-410 - CC-9314: Allow disabling hostname verification

HDFS Connector

  • PR-496 - CC-8809: Replace assignment with topicPartitionWriters.keySet

JDBC Connector

  • PR-866 - CC-8750: Changed the dialects to sanitize all URL properties that case-insensitively contain “password”
  • PR-844 - CC-8898: Add better error messages when consumed records don’t match connector config
  • PR-839 - CC-8823: Add support for the JDBC sink to write to views in addition to tables

JMS Connector

  • CC-3439: Update MQ Source Connector to better handle errors and auto reconnect when MQ manager is restarted

Replicator Connector

  • REP-787: Synchronize endOffsetsConsumer in FetchEndOffsetsService
  • REP-813 removed unnecessary server id config that was breaking tests
  • REP-805: add atLeastOnce to downstream expectations to fix flakiness
  • REP-795 moved translated records log to DEBUG and only print if recor…
  • REP-755: retrieve port from –connect-url if specified
  • REP-743: Fix issue where we don’t properly log the topic that got an UnknownTopicPartitionException
  • REP-754 fix for offset commit failure resulting in loss of offsets

S3 Connector

  • PR-328 - CC-9198: Move null value handling earlier in SinkTask put

Storage Common

  • PR-132 - CC-8816: Document more accurate timezone restrictions

Version 5.5.0

This topic provides changelogs for the individual Confluent Platform components.

Community Features

Common

  • PR-252 - ST-3255: Parameterize the option in docker plugin to always pull latest base image
  • PR-251 - ST-3227: Pull down the latest base image version when building docker images with the maven plugin
  • PR-250 - Upgrade to junit 4.13
  • PR-249 - Update ZooKeeper to 3.5.7
  • PR-247 - Upgrade Avro to 1.9.2, Jackson to 2.10.2
  • PR-246 - Update to jackson databind 2.9.10.3
  • PR-244 - Disable net assembly & oss index report
  • PR-241 - CC-7633: ConfigDef needs to check current thread’s classloader when parsing a type CLASS config
  • PR-243 - Add flag to allow disabling dependency-check
  • PR-237 - update cve to json feed
  • PR-234 - Update maven-surefire-plugin from 2.21.0 to 2.22.0
  • PR-230 - Add SuppressWarningsFilter to checkstyle config
  • PR-229 - todoComment check
  • PR-224 - exclude exception classes from ClassDataAbstractionCoupling count

ksqlDB

  • PR-4949 - fix: Don’t wait for streams thread to be in running state (#4908)
  • PR-4936 - fix: remove immutable properties from headless mode
  • PR-4935 - fix: handle leap days correctly during timestamp extraction (#4878)
  • PR-4917 - fix: logic when closing ksqlEngine fixed
  • PR-4857 - fix: don’t cleanup topics on engine close (#4658)
  • PR-4819 - fix: backport fixes from query close
  • PR-4834 - fix: add deserializer for SqlType
  • PR-4633 - Use the new topics endpoint in Connect REST API to describe the topics of a connector
  • PR-4716 - fix: decimals in structs should display as numeric (#4165)
  • PR-4723 - fix: don’t display decimals in scientific notation in CLI
  • PR-4742 - test: include rows in row count mismatch error message in RQTT
  • PR-4658 - fix: don’t cleanup topics on engine close
  • PR-4643 - fix: idempotent terminate that can handle hung streams
  • PR-4596 - feat: introduce JSON_SR format
  • PR-4625 - fix: support partial schemas
  • PR-4616 - feat: support custom column widths in cli
  • PR-4606 - fix: StoreQueryParameters name change
  • PR-4585 - test: fix timezone issue in RecordFormatterTest
  • PR-4551 - feat: enhance PRINT TOPIC’s format detection
  • PR-4563 - feat: support JSON schema inference in ksqlDB
  • PR-4586 - fix: add functional-test dependencies to Docker module
  • PR-4495 - feat: New API - integrate push queries into backend
  • PR-4469 - feat: support Protobuf in ksqlDB
  • PR-5181 - docs: fix mkdocs-material theme tabs (DOCS-4171)
  • PR-5180 - docs: cherry-pick update to ksqlDB docs for Protobuf support (DOCS-4167)
  • PR-5178 - docs: remove TODO from Serialization topic (DOCS-4162)
  • PR-5173 - docs: remove extraneous EMIT CHANGES clauses (DOCS-4159)
  • PR-5154 - docs: cherry-pick fix for version picker for previous versions
  • PR-5135 - docs: update requirements.txt on old ksqlDB branch (DOCS-4112)
  • PR-5133 - docs: cherry-pick version picker to 0.7.1-ksqldb branch (DOCS-4111)
  • PR-4658 - fix: don’t cleanup topics on engine close
  • PR-4643 - fix: idempotent terminate that can handle hung streams
  • PR-4616 - feat: support custom column widths in cli
  • PR-4625 - fix: support partial schemas
  • PR-4586 - fix: add functional-test dependencies to Docker module
  • PR-4514 - docs: update docs for klip-12 configs
  • PR-4495 - feat: New API - integrate push queries into backend
  • PR-4510 - fix: ConcurrentModificationException in ClusterStatusResource
  • PR-4505 - fix: print root cause in error message
  • PR-4500 - fix: support conversion of STRING to BIGINT for window bounds
  • PR-4494 - fix: Fixes the single host lag reporting case
  • PR-4503 - test: update tests and docs around testing tool and primitive keys
  • PR-4470 - docs: clarify that DROP STREAM/TABLE deletes source topic (DOCS-2386)
  • PR-4492 - fix: Remove unnecessary timeout in PullQueryRoutingFunctionalTest
  • PR-4468 - feat: Adds a new RoutingFilter, MaximumLagFilter that looks at offset lags
  • PR-4490 - fix: Remove duplicate maven dependencies that cause warnings during build
  • PR-4486 - feat: better error message when transaction to command topic fails to initialize by timeout
  • PR-4478 - Docs for primitive key support
  • PR-4440 - test: add test to prove #596 is fixed
  • PR-4459 - feat: remove WindowStart() and WindowEnd() UDAFs
  • PR-4467 - fix: rename stale to standby in KsqlConfig
  • PR-4465 - fix: fix compilation error due to Format refactoring
  • PR-4398 - feat: Implement pull query routing to standbys if active is down
  • PR-4451 - refactor: generalize SerdeSupplier to streamline adding QTT formats
  • PR-4437 - refactor: introduce Format interface
  • PR-4446 - docs: fix typo on ksqlDB installation index page (DOCS-3332)
  • PR-4443 - docs: fix tutorial stack file versions in master (DOCS-3330)
  • PR-4430 - feat: add new and rename show queries columns for sink Kafka Topic and Stream/Table
  • PR-4435 - fix: support WindowStart() and WindowEnd() in pull queries
  • PR-4438 - docs: update tutorial stack file for v0.6.0/5.4.0 (DOCS-3330)
  • PR-4414 - refactor: fix GenericRow encapsulation
  • PR-4427 - refactor: Changes lag APIs to return Optional, per comments
  • PR-4432 - refactor: move Format into ksql-serde module
  • PR-4412 - Reorder value schema
  • PR-4431 - docs: add note about KSQL headless mode and Avro schemas (DOCS-1487)
  • PR-4429 - fix: Remove unncecessary @AfterClass cleanup in LagReportingAgentFunctionalTest which is causing flakiness
  • PR-4361 - docs: add note about ksqlDB headless mode and Avro schemas (DOCS-1487)
  • PR-4418 - fix: Make host status map entries in Heartbeat Handler immutable
  • PR-4415 - refactor: generalize FormatInfo in prepration for more formats
  • PR-4272 - fix: add ksql-test-runner deps to ksql package lib
  • PR-4425 - fix: add ksql-test-runner deps to ksql package lib (#4272)
  • PR-4322 - feat: hide internal/system topics from SHOW TOPICS
  • PR-4417 - fix: Fixes ImmutabilityTest to run on new types. Also simplifies lag object structure
  • PR-4392 - feat: Adds lag reporting and API for use in lag aware routing as described in KLIP 12
  • PR-4406 - feat: support implicit casting in UDFs
  • PR-4407 - Fix RestQueryTranslationTest test to use UTC time zone.
  • PR-4401 - fix: partial push & persistent query support for window bounds columns
  • PR-4274 - fix: Include functional tests jar in docker images
  • PR-4390 - Correctly validate joins between windowed and non-windowed sources
  • PR-4388 - fix: reserve WINDOWSTART and WINDOWEND as system column names
  • PR-4386 - refactor: remove duplicate code from SqlPredicate
  • PR-4314 - 5.4 pending shutdown fix
  • PR-4271 - fix: pull queries should work across nodes (#4169)
  • PR-4364 - test: add tests covering pull queries of windowed primitive keys
  • PR-4379 - feat: Use POJOs to represent JSON objects read/written from wire
  • PR-4378 - refactor: make decimal literals actual decimals
  • PR-4357 - feat: Use AbstractConfig for API server config
  • PR-4376 - feat: Support JSON format for responses and other refactorings
  • PR-4358 - feat: Use POJOs to represent JSON objects read/written from wire
  • PR-4372 - fix: floating point comparison was inexact
  • PR-4331 - refactor: drop qualifiers from logical schema
  • PR-4371 - fix: delimiters reset across non-delimited types (reverts #4366)
  • PR-4377 - docs: add missing KSQL/CCloud Docker parameter (DOCS-2550)
  • PR-4373 - fix: remove deprecated Acl API
  • PR-4354 - feat: Integrate reactive streams TCK and improvements to our reactive streams implementations
  • PR-4366 - fix: do not throw error if VALUE_DELIMITER is set on non-DELIMITED topic
  • PR-4335 - feat: improve the semantics around decimal/floating point literals
  • PR-4355 - test: missed requested change (trivial)
  • PR-4182 - docs: Updates to the KLIP-template
  • PR-4350 - docs: add workaround to docs for ksql-test-runner jars (DOCS-3266)
  • PR-4351 - fix: Make null key serialization/deserialization symmetrical
  • PR-4348 - refactor: move custom schema registry not configured error messages to rest endpoints
  • PR-4346 - fix: remove duplicate comment about Schema Registry URL from sample server properties
  • PR-4345 - docs: clarify Docker image build availability
  • PR-4232 - feat: native map/array constructors
  • PR-4320 - feat: Bare bones API server
  • PR-4339 - refactor: supress warnings for metadataForKey
  • PR-4343 - docs: add CP release version token to markdown docs (DOCS-3259)
  • PR-4342 - docs: update release branch token in ksqlDB markdown docs (DOCS-3258)
  • PR-4341 - docs: remove inline struct content from 5.4.x branch (DOCS-3256)
  • PR-4340 - docs: remove inline struct content from 5.4.0-post branch (DOCS-3256)
  • PR-4338 - docs: add readthedocs.yml to 5.4.0-post branch (DOCS-3255)
  • PR-4337 - docs: add docs-md directory to the new 5.4.0-post branch (DOCS-3254)
  • PR-4325 - feat: add a DefaultSchemaRegistryClient and remove default for SR url in KsqlConfig
  • PR-4326 - docs: migrate new struct content to md docs (DOCS-3240)
  • PR-4173 - feat: Implementation of heartbeat mechanism as part of KLIP-12
  • PR-4313 - fix: report window type and query status better from API
  • PR-4324 - fix: pin the jetty client version
  • PR-4327 - docs: fix broken link on dev guide index page (DOCS-3243)
  • PR-4318 - docs: add note re. logs folder for server output
  • PR-4311 - test: ensure test cases for group by and partition by primitive key
  • PR-4310 - test: push queries work with non-windowed primitive keys
  • PR-4278 - feat: expression support in JOINs
  • PR-4297 - fix: deadlock when closing transient push query
  • PR-4235 - docs: refactor installation docs around Docker (DOCS-3009)
  • PR-4312 - fix: fix NPE in CLI if not username supplied
  • PR-4302 - perf: Avoids logging INFO for rest-util requests, since it hurts pull query performance
  • PR-4293 - fix: log4j properties files
  • PR-4022 - docs: KLIP 12 - Implement High-Availability for Pull queries
  • PR-4212 - docs: add embedded Connect tutorial
  • PR-4299 - build: Do not run twist lock scan and other docker image operations since we no longer build images in this repo
  • PR-4295 - fix: report clearer error message when AVG used with DELIMITED
  • PR-4153 - feat: ask for password if -p is not provided
  • PR-4270 - fix: add logging during restore
  • PR-4069 - docs: klip-15 New client and API
  • PR-4260 - feat: allow environment variables to configure embedded connect
  • PR-4249 - fix: include path of field that causes JSON deserialization error
  • PR-4248 - fix: better error message on self-join
  • PR-4187 - feat: enable Kafla ACL authorization checks for Pull Queries
  • PR-4216 - perf: Improves pull query performance by making the default schema service a singleton
  • PR-4245 - fix: don’t load current qtt test case from legacy loader
  • PR-4230 - build: Disable building docker images
  • PR-4243 - test: Fix Schema Registry tests after new SR API changes
  • PR-4247 - test: fix build issue caused by new register method on SR client
  • PR-4186 - feat: add a KSQL cache for Kafka authorization validator
  • PR-4204 - feat: add test topology rewriter
  • PR-4184 - refactor: inject a KsqlSecurityContext to REST requests
  • PR-4189 - test: add equals testers for plan classes
  • PR-4225 - refactor: Use FunctionName not String in FunctionRegistry API
  • PR-4209 - docs: remove basic auth section from server-config (DOCS-3140)
  • PR-4210 - docs: add section for ksql.streams.state.dir (DOCS-3153)
  • PR-4214 - docs: add section for ksql.streams.state.dir to md docs (DOCS-3153)
  • PR-4213 - docs: add note to ksqlDB processing log settings (DOCS-3076)
  • PR-4211 - docs: add security note linking to processing log settings (DOCS-3076)
  • PR-4208 - docs: unpin mkdocs-macros-plugin version (DOCS-3100)
  • PR-4201 - test: enhance test framework to support primitive keys
  • PR-4185 - fix: reintroduce FetchFieldFromStruct as a public UDF
  • PR-4176 - test: qtt generate/validate execution plans
  • PR-4175 - docs: add basic docker-compose file and instructions
  • PR-4169 - fix: pull queries should work across nodes
  • PR-4149 - fix: change query id generation to work with planned commands
  • PR-4120 - feat: add support for inline struct creation
  • PR-4166 - test: disambiguate some Schema Registry methods
  • PR-4165 - fix: decimals in structs should display as numeric
  • PR-4128 - test: do not mock config store in StandaloneExecutor integration test
  • PR-4159 - fix: show topics doesn’t display topics with different casing
  • PR-4161 - docs: update codeowners file for docs-md directory (DOCS-3120)
  • PR-4121 - feat: add config to make error messages configurable
  • PR-4132 - Adds support for using primitive types in joins.
  • PR-4150 - feat: add COUNT_DISTINCT and allow generics in UDAFs
  • PR-4134 - feat: add source statement to SourceDescription
  • PR-4122 - fix: untracked file after cloning on Windows
  • PR-4135 - docs: add functions index to markdown docs (DOCS-3049)
  • PR-4133 - docs: fix a typo in queries overview topic (DOCS-3105)
  • PR-4117 - docs: update push and pull query topics with feedback (DOCS-3092)
  • PR-4099 - feat: implemention of KLIP-13
  • PR-4106 - feat: support writing plans to command topic
  • PR-4119 - fix: headless server no longer throws NPE on null configs
  • PR-4112 - docs: fix markdown docs build (DOCS-3091)
  • PR-4063 - refactor: nicer spec for aggregation steps
  • PR-4090 - fix: properly set key when partition by ROWKEY and join on non-ROWKEY
  • PR-4080 - test: serialize/deserialize plans from qtt
  • PR-4104 - docs: note CREATE CONNECTOR works only in interactive mode (DOCS-3036)
  • PR-4103 - docs: note CREATE CONNECTOR works only in interactive mode (DOCS-3036)
  • PR-4102 - docs: fix munged code blocks in Clickstream tutorial (DOCS-3084)
  • PR-4085 - fix: Explicitly disallow table functions with table sources, fixes #4033
  • PR-4076 - docs: fix docker image names + remove monitoring interceptor docs
  • PR-4089 - docs: update example output from SHOW TOPICS (KSQL-2981)
  • PR-4056 - docs: intent for klip-16: Introduce K$ Dynamic Views
  • PR-4087 - fix: UncaughtExceptionHandler not being set for Persistent Queries
  • PR-4031 - docs: klip-13: Introduce KSQL command to print connect worker properties to the console
  • PR-4068 - test: enhance QTT to support non-string keys
  • PR-4066 - fix: remove mapValues that excluded ROWTIME and ROWKEY columns
  • PR-3962 - feat: never skip command in CommandRunner thread
  • PR-4077 - feat: add connector status to LIST CONNECTORS
  • PR-4064 - refactor: clean up offset reset from plan steps
  • PR-4032 - feat: expression support for PARTITION BY
  • PR-4007 - refactor: use query context to build node names
  • PR-4057 - fix: array access is now 1-indexed instead of 0-indexed
  • PR-4019 - feat: add JMX metric for commandRunner status
  • PR-4047 - refactor: remove step schemas from execution plan
  • PR-4026 - docs: propose KLIP-14
  • PR-4052 - refactor: enforce reserved column names
  • PR-4049 - docs: intent for klip-15: new KSQLDB client and API
  • PR-4002 - Clean up query plan schema
  • PR-4044 - docs: update copyright years in CLI splash screen (DOCS-3057)
  • PR-4041 - docs: update KSQL changelog file formatting (DOCS-3055)
  • PR-4038 - docs: add section on Flow page to C3 tutorial (DOCS-2715)
  • PR-4037 - docs: update screenshots in C3 tutorial (DOCS-2714)
  • PR-4028 - refactor: get ROWKEY from key of Kafka record in topology steps
  • PR-4024 - BREAKING CHANGE: fix: dont update rowkey when executing StreamSelectKey
  • PR-3996 - refactor: switch KS topologies to transformValues call
  • PR-4006 - refactor: drop the execution step properties interface
  • PR-4010 - feature: support ROWTIME in pull queries
  • PR-3995 - refactor: remove KeySerde as its not longer needed
  • PR-4017 - refactor: expose namespace and index on Column
  • PR-4016 - build: use [https] instead of [http]
  • PR-3982 - fix: unify behavior for PARTITION BY and GROUP BY
  • PR-4013 - docs: intent for klip-13: Introduce KSQL command to print connect worker properties to the console
  • PR-3978 - test: test that our immutable objects are immutable
  • PR-3987 - feat: remove unnecessary changelog for topics
  • PR-3970 - refactor: clean up format pojos in serialized model
  • PR-3935 - feat: Add Cube UDTF
  • PR-3990 - docs: migrate syntax reference change from .rst to .md docs (DOCS-3028)
  • PR-3980 - feat : Porting #3879, #3696 fixes for pull queries against secure clusters
  • PR-3936 - refactor: clean up timestamp extraction policy from physical plan
  • PR-3983 - docs: add ksqlDB arch diagram to landing page (DOCS-3019)
  • PR-3979 - docs: update docs site url to match canonical root.
  • PR-3944 - feat: add support to terminate all running queries
  • PR-3952 - fix: fix issues with multi-statement requests failing to validate
  • PR-3955 - test: when deleting sources we should quote identifiers
  • PR-3965 - docs: wrap lines at 80 chars in ksqlDB docs (DOCS-2767)
  • PR-3964 - docs: scrub remaining markdown extension tags (DOCS-3002)
  • PR-3963 - docs: scrub remaining escaped quote chars in ksqlDB docs (DOCS-3001)
  • PR-3960 - docs: update graphics in ksqlDB docs (DOCS-2954)
  • PR-3959 - docs: intent for klip-12: Implement high availability for pull queries
  • PR-3958 - docs: new ACLs for transactional produces to Command topic (DOCS-2959)
  • PR-3957 - docs: bump ksqlDB docs version to 0.6.0 (DOCS-2996)
  • PR-3956 - docs: remove redundant topic titles in ksqlDB docs (DOCS-2905)
  • PR-3899 - refactor: change processing log stream create to use KsqlResource
  • PR-3948 - fix: the Abs, Ceil and Floor methods now return proper types
  • PR-3930 - test: switch InteractiveStatmentExecutorTest to use mockito
  • PR-3911 - refactor: clean up ksql sink
  • PR-3931 - fix: some terminals dont work with JLine 3.11
  • PR-3910 - refactor: bake known code for pull queries when building agg table
  • PR-3934 - docs: add section on quoted identifiers to syntax reference (DOCS-2884)
  • PR-3808 - docs: add section on quoted identifiers to syntax reference (DOCS-2884)
  • PR-3929 - docs: update PostgresDB to PostgreSQL in ksqlDB docs (KSQL-3686)
  • PR-3928 - docs: fix broken quickstart link
  • PR-3482 - feat: expose execution plans from the ksql engine API
  • PR-3926 - Add EMIT CHANGES breaking change to CHANGELOG
  • PR-3924 - docs: update site logo with size-constrained png (DOCS-2977)
  • PR-3921 - docs: link to changelog.md in KSQL repo root (DOCS-2987)
  • PR-3918 - docs: add changelog and README for v0.6.0
  • PR-3913 - docs: add overview of key incompatibilities between KSQL and ksqlDB
  • PR-3916 - docs: add stream processing examples
  • PR-3907 - refactor: ensure pull schema has no meta columns
  • PR-3905 - test: ensure Admin client is closed in tests
  • PR-3889 - refactor: transient queries should only have value columns in schema
  • PR-3912 - refactor: clean up sql text from ddl commands
  • PR-3520 - feat: plan serialization jackson annotations
  • PR-3917 - docs: remove extraneous sections in ksqlDB Concepts index (DOCS-2979)
  • PR-3915 - docs: update ksqlDB docs logo with size-constrained svg (DOCS-2977)

REST Proxy

  • PR-175 - CPKAFKA-4948: Make ssl.client.auth for REST consistent with Kafka
  • PR-171 - Upgrade Jetty and Jersey to latest versions (fixes #170)
  • PR-648 - CLIENTS-1532: Change configuration to config.
  • PR-644 - CLIENTS-1521: Remove GET Topic from LIST/GET/UPDATE/REST Topic Configuration.
  • PR-643 - CLIENTS-1514: Defaults to JSON:API Content-Type when no Accept header in request.
  • PR-642 - CLIENTS-1513: Change Type and ID to Confluent Resource Names and Iden…
  • PR-641 - Add LIST/GET/UPDATE/RESET Topic Configurations.
  • PR-639 - CLIENTS-1506: Add DELETE Topics V3 endpoints.
  • PR-638 - CLIENTS-1503: Add CREATE Topics V3 endpoints.
  • PR-637 - Update ports of minimal test environment documentation.
  • PR-636 - CLIENTS-1500: Add LIST/GET Replicas V3 endpoints.
  • PR-635 - CLIENTS-1499: Add LIST/GET Partitions V3 endpoints.
  • PR-634 - CLIENTS-1492: Add LIST/GET Topics V3 endpoints.
  • PR-631 - CLIENTS-1475: Add LIST/GET Brokers V3 endpoints.
  • PR-632 - CPKAFKA-4617: Change Admin binding to be request-scoped.
  • PR-624 - Add first V3 cluster APIs (+ V3 plumbing).
  • PR-617 - Fix compile error due to KIP-515 (ZK TLS)
  • PR-622 - Refactoring: Split V1 and V2 resources and entities.
  • PR-619 - Fixes for map handling in Protobuf plugin
  • PR-600 - Add support for Protobuf and JSON Schema
  • PR-607 - Fix kafka-rest build to use new schema-registry packages.

Schema Registry

  • PR-1403 - CC-8525: add equals implementation for CyclicSchemaWrapper
  • PR-1405 - DG-308 Check the cache of refs before retrieval
  • PR-1402 - DG-358 Ensure schema provider is set in SR clients
  • PR-1401 - DG-352 Remove unnecessary slf4j dependency
  • PR-1400 - DG-351 Handle Null JSON Schema with properties
  • PR-1398 - DG-349 Ensure schema key version matches schema value
  • PR-1394 - DG-321 Fix NPE in equals method
  • PR-1393 - DG-323: Fix SchemaMessageReader NPE if parse.key is enabled
  • PR-1392 - DG-321 Omit schemaType field when storing Avro schemas
  • PR-1391 - DG-308 Perf optimizations; add benchmarks
  • PR-1387 - DG-305 Fix ClassCastException for proxy.port
  • PR-1385 - DG-295 Fix trailing zeroes being stripped
  • PR-1383 - DG-24: Add more detailed logs during POST and DELETE ops
  • PR-1382 - DG-299 Fix processing of refs in SR maven plugin
  • PR-1378 - fix: connect.default on long avro field
  • PR-1373 - fix: enum always resolves to default value
  • PR-1372 - Add schema file input capability to the message reader
  • PR-1366 - DG-266: Fix NPE for null input for JsonSchemaData
  • PR-1365 - DG-265 - Validate refs before persisting Protobuf schema
  • PR-1359 - Use AK for master election if possible
  • PR-1357 - DG-263: Fix Avro defaults of type record
  • PR-1356 - Fix Protobuf formatter by enabling default fields
  • PR-1355 - Convert Protobuf enum values to String
  • PR-1350 - Add REST API to get versions for id
  • PR-1268 - Add null checks
  • PR-1347 - Add support for both binary and numeric decimals for JSON
  • PR-1345 - Clean up some tests
  • PR-1337 - Fix compile error due to KIP-515 (ZK TLS)
  • PR-1343 - Refactor readers and formatters
  • PR-1333 - Prevent dangling references during deletion
  • PR-1330 - Refactor JsonSchemaData out of JsonSchemaConverter
  • PR-1331 - Fix NPE cases in AbstractSchemaProvider.resolveReferences
  • PR-1339 - API update for Jetty 9.4.26.v20200117 (#1323)
  • PR-1323 - API update for Jetty 9.4.26.v20200117
  • PR-1327 - Add API to retrieve supported schema types
  • PR-1320 - Fixes for map handling in Protobuf plugin
  • PR-1324 - Update Metadata::bootstrap signature
  • PR-1322 - Handle null schemaValues during schemaTombstoned
  • PR-1309 - Optimize internal cache indexes
  • PR-1307 - Fix default handling in Protobuf converter
  • PR-1297 - Fixes #1134: Add non-AVRO Int and Long key support
  • PR-1304 - Fix handling of null messages in Protobuf converter
  • PR-1289 - First cut at JSON Schema support
  • PR-1285 - First cut at Protobuf support
  • PR-1300 - CC-7692 / ISSUE-1197: Fix configuration of basic auth credentials provider
  • PR-1296 - Adds always-true hostname verifier if ssl.endpoint.identification.algorithm is set to null or empty string
  • PR-1295 - Refactor common serializer classes to separate module
  • PR-1281 - Reflection serde
  • PR-1288 - DG-160: Omit schemaType if specified as AVRO
  • PR-1280 - Add support for schema pluggability and schema references
  • PR-1248 - Make AbstractKafkaAvroDeserializer.getDatumReader() protected
  • PR-1246 - Add key.serializer property to kafka-avro-console-producer (#935)
  • PR-1249 - CC-7169: Publish AvroData and related classes in separate artifact from AvroConverter plugin
  • PR-1264 - Improve Avro SerializationException message
  • PR-821 - Pass up subject & schema/version id errors from where they occur.
  • PR-1257 - CP-650–Fixed wrong Timeout unit. Should be MS.
  • PR-1243 - DG-134: Fix NPE when schema.registry.ssl.protocol not specified
  • PR-1234 - DG-114: Fix tombstone behavior

Kafka

  • PR-8476 - KAFKA-9838; Add log concurrency test and fix minor race condition
  • PR-8403 - KAFKA-9797; Fix TestSecurityRollingUpgrade.test_enable_separate_interbroker_listener (#8403)
  • PR-8457 - KAFKA-9842; Add test case for OffsetsForLeaderEpoch grouping in Fetcher (#8457)
  • PR-8077 - KAFKA-9583; Use topic-partitions grouped by node to send OffsetsForLeaderEpoch requests (#8077)
  • PR-8451 - KAFKA-9835; Protect FileRecords.slice from concurrent write (#8451)
  • PR-8405 - KAFKA-9801: Still trigger rebalance when static member joins in CompletingRebalance phase (#8405)
  • PR-8420 - KAFKA-9815; Ensure consumer always re-joins if JoinGroup fails (#8420)
  • PR-8418 - KAFKA-9807; Protect LSO reads from concurrent high-watermark updates (#8418)
  • PR-8408 - KAFKA-9810: Document Connect Root REST API on / (#8408)
  • PR-8412 - KAFKA-9750; Fix race condition with log dir reassign completion (#8412)
  • PR-7755 - KAFKA-9233: Fix IllegalStateException in Fetcher retrieval of beginning or end offsets for duplicate TopicPartition values (#7755)
  • PR-8269 - KAFKA-9659: Add more log4j when updating static member mappings (#8269)
  • PR-8279 - KAFKA-9706: Handle null in keys or values when Flatten transformation is used (#8279)
  • PR-8350 - KAFKA-9760: Add KIP-447 protocol change to upgrade notes (#8350)
  • PR-8369 - KAFKA-9771: Port patch for inter-worker Connect SSL from Jetty 9.4.25 (#8369)
  • PR-8280 - KAFKA-9707: Fix InsertField.Key should apply to keys of tombstone records (#8280)
  • PR-8343 - KAFKA-9758: Doc changes for KIP-523 and KIP-527 (#8343)
  • PR-8290 - KAFKA-9677: Fix consumer fetch with small consume bandwidth quotas (#8290)
  • PR-8339 - KAFKA-9752; New member timeout can leave group rebalance stuck (#8339)
  • PR-8285 - KAFKA-9700: Fix negative estimatedCompressionRatio (#8285)
  • PR-8336 - KAFKA-9749; Transaction coordinator should treat KAFKA_STORAGE_ERROR as retriable (#8336)
  • PR-8124 - KAFKA-9563: Fix Kafka Connect documentation around consumer and producer overrides (#8124)
  • PR-8205 - KAFKA-9634: Add note about thread safety in the ConfigProvider interface (#8205)
  • PR-8325 - KAFKA-9741: Update ConsumerGroupMetadata before calling onPartitionsRevoked() (#8325)
  • PR-8324 - KAFKA-9701 (fix): Only check protocol name when generation is valid (#8324)
  • PR-8223 - KAFKA-9654; Update epoch in ReplicaAlterLogDirsThread after new LeaderAndIsr (#8223)
  • PR-8278 - KAFKA-8803: Remove timestamp check in completeTransitionTo (#8278)
  • PR-8289 - KAFKA-9712: Catch and handle exception thrown by reflections scanner (#8289)
  • PR-8267 - KAFKA-6647: Do note delete the lock file while holding the lock (#8267)
  • PR-8232 - KAFKA-9658; Fix user quota removal (#8232)
  • PR-8233 - KAFKA-9668: Iterating over KafkaStreams.getAllMetadata() results in ConcurrentModificationException (#8233)
  • PR-8227 - KAFKA-9662: Wait for consumer offset reset in throttle test to avoid losing early messages (#8227)
  • PR-8229 - KAFKA-9661: Propagate includeSynonyms option to AdminClient in ConfigCommand (#8229)
  • PR-8208 - KAFKA-8995: delete all topics before recreating (#8208)
  • PR-8197 - KAFKA-9573: Fix VerifiableProducer and VerifiableConsumer to work with older Kafka versions (#8197)
  • PR-273 - Upgrade to Avro 1.9.2
  • PR-8188 - throttle consumer timeout increase (#8188)
  • PR-8165 - KAFKA-9601: Stop logging raw connector config values (#8165)
  • PR-8159 - KAFKA-9599 create unique sensor to record group rebalance (#8159)
  • PR-8142 - KAFKA-9577; SaslClientAuthenticator incorrectly negotiates SASL_HANDSHAKE version (#8142)
  • PR-263 - Changes to migrate to Artifactory
  • PR-8143 - KAFKA-9582: Do not abort transaction in unclean close (#8143)
  • PR-8116 - KAFKA-9562: part 1: ignore exceptions while flushing stores in close(dirty) (#8116)
  • PR-8108 - KAFKA-9533: ValueTransform forwards null values (#8108)
  • PR-8119 - KAFKA-9558; Fix retry logic in KafkaAdminClient listOffsets (#8119)
  • PR-8125 - KAFKA-9515: Upgrade ZooKeeper to 3.5.7 (#8125)
  • PR-8106 - KAFKA-9319: Fix generation of CA certificate for system tests. (#8106)
  • PR-8088 - KAFKA-9535; Update metadata before retrying partitions when fetching offsets (#8088)
  • PR-7389 - KAFKA-8805; Bump producer epoch on recoverable errors (#7389)
  • PR-7781 - KAFKA-8904: Improve producer’s topic metadata fetching. (#7781)
  • PR-8085 - KAFKA-9556; Fix two issues with KIP-558 and expand testing coverage (#8085)
  • PR-8023 - KAFKA-8507; Unify connection name flag for command line tool [KIP-499] (#8023)
  • PR-7731 - allow ReplaceField SMT to handle tombstone records (#7731)
  • PR-7733 - KAFKA-9192: fix NPE when for converting optional json schema in structs (#7733)
  • PR-8000 - KAFKA-9417: New Integration Test for KIP-447 (#8000)
  • PR-8031 - KAFKA-9447: Add new customized EOS model example (#8031)
  • PR-8053 - KAFKA-9499; Improve deletion process by batching more aggressively (#8053)
  • PR-7955 - KAFKA-9423: Refine layout of configuration options on website and make individual settings directly linkable (#7955)
  • PR-8015 - KAFKA-9500: Fix FK Join Topology (#8015)
  • PR-8065 - KAKFA-9503: Fix TopologyTestDriver output order (#8065)
  • PR-7996 - KAFKA-9355: Fix bug that removed RocksDB metrics after failure in EOS (#7996)
  • PR-8054 - KAFKA-9390: Make serde pseudo-topics unique (#8054)
  • PR-8024 - KAFKA-9483: Add Scala KStream#toTable to the Streams DSL (#8024)
  • PR-8040 - KAFKA-6607: Commit correct offsets for transactional input data (#8040)
  • PR-8059 - KAFKA-7052 Avoiding NPE in ExtractField SMT in case of non-existent fields (#8059)
  • PR-8061 - KAFKA-9517: Fix default serdes with FK join (#8061)
  • PR-8033 - KAFKA-9487: Follow-up PR of Kafka-9445 (#8033)
  • PR-8081 - KAFKA-9523: Migrate BranchedMultiLevelRepartitionConnectedTopologyTest into a unit test (#8081)
  • PR-8018 - KAFKA-9480: Fix bug that prevented to measure task-level process-rate (#8018)
  • PR-8039 - KAFKA-9505: Only loop over topics-to-validate in retries (#8039)
  • PR-8027 - KAFKA-7658: Follow up to original PR (#8027)
  • PR-8057 - KAFKA-9507; AdminClient should check for missing committed offsets (#8057)
  • PR-8056 - KAFKA-9519: Deprecate the –zookeeper flag in ConfigCommand (#8056)
  • PR-8048 - KAFKA-9509; Fixing flakiness of MirrorConnectorsIntegrationTest.testReplication (#8048)
  • PR-255 - CONFLUENT: Update muckrake version map to include 2.4 and 2.5
  • PR-7770 - KAFKA-9261; Client should handle unavailable leader metadata (#7770)
  • PR-8037 - KAFKA-9491; Increment high watermark after full log truncation (#8037)
  • PR-7568 - KAFKA-9074: Correct Connect’s Values.parseString to properly parse a time and timestamp literal (#7568)
  • PR-8030 - KAFKA-9492; Ignore record errors in ProduceResponse for older versions (#8030)
  • PR-7725 - KAFKA-9027, KAFKA-9028: Convert create/delete acls requests/response to use generated protocol (#7725)
  • PR-7994 - KAFKA-9437; Make the Kafka Protocol Friendlier with L7 Proxies [KIP-559] (#7994)
  • PR-7994 - KAFKA-9437; Make the Kafka Protocol Friendlier with L7 Proxies [KIP-559] (#7994)
  • PR-7901 - KAFKA-9375: Add names to all Connect threads (#7901)
  • PR-8011 - KAFKA-8503; Add default api timeout to AdminClient (KIP-533) (#8011)
  • PR-8021 - Add retries to release.py script (#8021)
  • PR-6524 - KAFKA-8162: IBM JDK Class not found error when handling SASL (#6524)
  • PR-7940 - KAFKA-9408: Use StandardCharsets.UTF-8 instead of “UTF-8” (#7940)
  • PR-8012 - KAFKA-9474: Adds ‘float64’ to the RPC protocol types (#8012)
  • PR-7887 - KAFKA-9360: Allow disabling MM2 heartbeat and checkpoint emissions (#7887)
  • PR-7985 - KAFKA-7658: Add KStream#toTable to the Streams DSL (#7985)
  • PR-7984 - KAFKA-9445: Allow adding changes to allow serving from a specific partition (#7984)
  • PR-8017 - KAFKA-9422: Track the set of topics a connector is using (KIP-558) (#8017)
  • PR-7607 - KAFKA-9040; Add –all option to config command (#7607)
  • PR-4154 - KAFKA-4203: Align broker default for max.message.bytes with Java producer default (#4154)
  • PR-7959 - KAFKA-9426: Use switch instead of chained if/else in OffsetsForLeaderEpochClient (#7959)
  • PR-7937 - KAFKA-9405: Use Map.computeIfAbsent where applicable (#7937)
  • PR-7560 - KAFKA-9026: Use automatic RPC generation in DescribeAcls (#7560)
  • PR-7998 - KAFKA-9460: Enable only TLSv1.2 by default and disable other TLS protocol versions (KIP-553) (#7998)
  • PR-7870 - KAFKA-9254; Overridden topic configs are reset after dynamic default change (#7870)
  • PR-7870 - KAFKA-9254; Overridden topic configs are reset after dynamic default change (#7870)
  • PR-7928 - KAFKA-9152; Improve Sensor Retrieval (#7928)
  • PR-7995 - Correct exception message in DistributedHerder (#7995)
  • PR-7969 - KAFKA-7317: Use collections subscription for main consumer to reduce metadata (#7969)
  • PR-7941 - KAFKA-9181; Maintain clean separation between local and group subscriptions in consumer’s SubscriptionState (#7941)
  • PR-7920 - KAFKA-7737; Use single path in producer for initializing the producerId (#7920)
  • PR-7952 - KAFKA-9418; Add new sendOffsetsToTransaction API to KafkaProducer (#7952)
  • PR-7952 - KAFKA-9418; Add new sendOffsetsToTransaction API to KafkaProducer (#7952)
  • PR-7489 - KAFKA-7273 Clarification on mutability of headers passed to Converter#fromConnectData() (#7489)
  • PR-7648 - KAFKA-9143: Log task reconfiguration error only when it happened (#7648)
  • PR-7819 - KAFKA-9024: Better error message when field specified does not exist (#7819)
  • PR-7505 - KAFKA-7204: Avoid clearing records for paused partitions on poll of MockConsumer (#7505)
  • PR-7593 - KAFKA-9083: Various fixes/improvements for Connect’s Values class (#7593)
  • PR-7970 - KAFKA-9338; Fetch session should cache request leader epoch (#7970)
  • PR-7865 - KAFKA-9329; KafkaController::replicasAreValid should return error message (#7865)
  • PR-7967 - KAFKA-9449; Adds support for closing the producer’s BufferPool. (#7967)
  • PR-7745 - KAFKA-9218: MirrorMaker 2 can fail to create topics (#7745)
  • PR-7966 - KAFKA-8847; Deprecate and remove usage of supporting classes in kafka.security.auth (#7966)
  • PR-7961 - KAFKA-9431: Expose API in KafkaStreams to fetch all local offset lags (#7961)
  • PR-7963 - KAFKA-9235; Ensure transaction coordinator is stopped after replica deletion (#7963)
  • PR-7943 - KAFKA-9410; Make groupId Optional in KafkaConsumer (#7943)
  • PR-7962 - KAFKA-6144: IQ option to query standbys (#7962)
  • PR-7960 - KAFKA-6144: Add KeyQueryMetadata APIs to KafkaStreams (#7960)
  • PR-7897 - KAFKA-9365: Add server side change to include consumer group information within transaction commit (#7897)
  • PR-7932 - KAFKA-8764: LogCleanerManager endless loop while compacting/cleaning (#7932)
  • PR-7927 - KAFKA-9294: Add tests for Named parameter (#7927)
  • PR-7931 - KAFKA-9420; Add flexible version support for converted protocols (#7931)
  • PR-5866 - KAFKA-7538: Reduce lock contention for Partition ISR lock (#5866)
  • PR-7878 - KAFKA-9346: Consumer back-off logic when fetching pending offsets (#7878)
  • PR-7665 - KAFKA-9159: The caller of sendListOffsetRequest need to handle retriable InvalidMetadata (#7665)
  • PR-7880 - KAFKA-9352: Use ‘roundrobin’ to assign topic-partitions to mirroring tasks (#7880)
  • PR-5920 - KAFKA-7639: Read one request at a time from socket to avoid OOM (#5920)
  • PR-7893 - KAFKA-9363; Display success message after topic creation with AdminClient (#7893)
  • PR-7922 - KAFKA-9396; Use JDK emptyIterator in ConnectHeaders Class (#7922)
  • PR-7029 - KAFKA-8617: Use automated protocol for EndTxn API (#7029)
  • PR-7312 - KAFKA-8421: Still return data during rebalance (#7312)
  • PR-7874 - KAFKA-9294: Add tests for Named parameter (#7874)
  • PR-7687 - KAFKA-9144; Track timestamp from txn markers to prevent early producer expiration (#7687)
  • PR-7799 - KAFKA-9287; Fix unneeded delay before failing pending transaction commit (#7799)
  • PR-7906 - KAFKA-9383: Expose consumer group metadata (#7906)
  • PR-7911 - KAFKA-9386; Apply delete ACL filters to resources from filter even if not in cache (#7911)
  • PR-7908 - KAFKA-9068: Fix javadoc of Stores.{persistent,inMemory}SessionStore (#7908)
  • PR-7907 - KAFKA-9384: Loop improvements (#7907)
  • PR-7493 - KAFKA-8988; Replace CreatePartitions Request/Response with automated protocol (#7493)
  • PR-7847 - KAFKA-6049: extend Kafka Streams Scala API for cogroup (KIP-150) (#7847)

Commercial Features

Security

  • DG-403 Add missing method to retrieve schema refs
  • fix method access on RbacBasicCredentialsManipulator
  • CC-8484: Add credential injection support for new converters, stop stripping credentials from non-Schema Registry-based converters
  • update ksql-rest-app artifact to ksqldb-rest-app
  • CC-7979: Include the new Connect endpoints for topic tracking (KIP-558) to RBAC
  • DG-274: Basic auth support for schema validation
  • DG-133: Add SSL configs to schema validation’s SR client
  • DG-304 Allow access to /schemas/types
  • SEC-251 - Don’t treat Basic authentication as JWT Bearer Token
  • DG-262 Pass authorizer-prefixed props to Authorizer
  • Update JaasUtils.isZkSecurityEnabled to JaasUtils.isZkSaslEnabled
  • Fix test compilation error due to kafka-rest moving classes around.
  • Fix compilation error due to kafka-rest moving ConsumersResource.
  • DG-153: Support multiple subject name strategies in broker side schema validation
  • CNKAF-200: Add ApiKeyPrincipal class
  • Changes for new SR APIs
  • DG-21 Ability to audit all ACL requests made to the Schema Registry ACL plugin
  • DG-13: Audit log for Schema Registry Authorizer
  • Remove the use of 2nd Schema Registry in integration tests for schema validation
  • SEC-693—Added ServerMetadataResource to initializeSchemaRegistryResourceActio…
  • SEC-649–Added BC non-FIPS into package of package-schema-registry-security-pl…
  • Fix KSQL access denied logging format issue

Confluent Server

  • KAFKA-9797; Fix TestSecurityRollingUpgrade.test_enable_separate_interbroker_listener (#8403)
  • CPKAFKA-4647: Disable audit logging in RbacTest::test_broker_failure test
  • add AppInfo version+commitId to metrics messages
  • KSTORAGE-626: Remove metrics reporter configuration when configuring internal tier topic clients
  • KAFKA-9835; Protect FileRecords.slice from concurrent write (#8451)
  • KAFKA-9801: Still trigger rebalance when static member joins in CompletingRebalance phase (#8405)
  • KCORE-297: Fix wildcard principals for centralized ACLs and no.acl.found for ConfluentServerAuthorizer
  • KAFKA-9815; Ensure consumer always re-joins if JoinGroup fails (#8420)
  • KAFKA-9820: validateMessagesAndAssignOffsetsCompressed allocates unused iterator (#8422) (#1477)
  • CPKAFKA-4649: Ensure LDAP group manager is recreated on writer failover
  • KAFKA-9807; Protect LSO reads from concurrent high-watermark updates (#8418)
  • KAFKA-9810: Document Connect Root REST API on / (#8408)
  • KAFKA-9750; Fix race condition with log dir reassign completion (#8412)
  • modify kafka_path to only set project for confluentplatform
  • KAFKA-9233: Fix IllegalStateException in Fetcher retrieval of beginning or end offsets for duplicate TopicPartition values (#7755)
  • KAFKA-9659: Add more log4j when updating static member mappings (#8269)
  • KAFKA-9706: Handle null in keys or values when Flatten transformation is used (#8279)
  • KAFKA-9760: Add KIP-447 protocol change to upgrade notes (#8350)
  • KAFKA-9771: Port patch for inter-worker Connect SSL from Jetty 9.4.25 (#8369)
  • KAFKA-9707: Fix InsertField.Key should apply to keys of tombstone records (#8280)
  • KAFKA-9758: Doc changes for KIP-523 and KIP-527 (#8343)
  • KAFKA-9677: Fix consumer fetch with small consume bandwidth quotas (#8290)
  • KAFKA-9752; New member timeout can leave group rebalance stuck (#8339)
  • KAFKA-9700: Fix negative estimatedCompressionRatio (#8285)
  • KAFKA-9749; Transaction coordinator should treat KAFKA_STORAGE_ERROR as retriable (#8336)
  • KAFKA-9563: Fix Kafka Connect documentation around consumer and producer overrides (#8124)
  • KAFKA-9634: Add note about thread safety in the ConfigProvider interface (#8205)
  • KAFKA-9741: Update ConsumerGroupMetadata before calling onPartitionsRevoked() (#8325)
  • KAFKA-9701 (fix): Only check protocol name when generation is valid (#8324)
  • KCORE-114: Allow placement-constraints to be configured for internal topics (offsets + transactions) (#1319)
  • KAFKA-9654; Update epoch in ReplicaAlterLogDirsThread after new LeaderAndIsr (#8223)
  • KAFKA-8803: Remove timestamp check in completeTransitionTo (#8278)
  • KCORE-234: Upgrade netty to 4.1.48.Final and netty-tcnative to 2.0.29.Final
  • CC-7979: Add new topic tracking operations of KIP-558 to default RBAC roles
  • KAFKA-9712: Catch and handle exception thrown by reflections scanner (#8289)
  • [CPKAFKA-4658] Restore removed SchemaRegistryUrl Config.
  • KAFKA-6647: Do note delete the lock file while holding the lock (#8267)
  • KCORE-225: Schedule periodic license validation task at fixed rate
  • DG-274, DG-133: Add configs for Basic Auth and SSL for embedded Schema Registry client (#1374)
  • v5.5.x KSTORAGE-524: Fix potential NPE in DelayedFetch
  • KCORE-199: Set default values for schema configs on topics to avoid NPE
  • KAFKA-9658; Fix user quota removal (#8232)
  • KCORE-111: Default replica placement constraints for external topics
  • KSTORAGE-354: avoid roundtrip and connection in GCS fetch path
  • KCORE-175: Extend TopicPlacement to include assignment validation logic
  • SEC-159: RestRequest pluggable HTTP auth
  • KAFKA-9668: Iterating over KafkaStreams.getAllMetadata() results in ConcurrentModificationException (#8233)
  • KAFKA-9662: Wait for consumer offset reset in throttle test to avoid losing early messages (#8227)
  • KCORE-190: Add max LSO lag metric
  • KAFKA-9661: Propagate includeSynonyms option to AdminClient in ConfigCommand (#8229)
  • Log TierPartitionStatus to differentiate online vs catchup consumer
  • KSTORAGE-450: default confluent.tier.fetcher.num.threads = 4
  • KSTORAGE-457 ListOffsetRequest v0 does not account for tiered section…
  • KSTORAGE-330, KSTORAGE-328, KSTORAGE-325 TierStorageMaterialization recovery and validation tool.
  • KSTORAGE-452: Improve README for system tests w/ Tiered Storage
  • KSTORAGE-400: Handle duplicate PartitionDeleteInitiate messages
  • KSTORAGE-420: missing toString on MergedLog
  • KSTORAGE-460: Disable preferred tier reads for replica fetch
  • CPKAFKA-4369. Cherry pick of #1228 into 5.5.x
  • CPKAFKA-4126: Add prefix to system test config to match MDS changes
  • CONFLUENT: Fix bug in result handling from readFromLocalLog
  • KAFKA-8995: delete all topics before recreating (#8208)
  • KCORE-151: Allow some reassignment of offline brokers
  • KAFKA-9573: Fix VerifiableProducer and VerifiableConsumer to work with older Kafka versions (#8197)
  • KSTORAGE-424: Allow use of SSL for internal tier topic clients
  • KCORE-110: Introducing new flag to display partitions violating topic replica constraints
  • throttle consumer timeout increase (#8188)
  • CONFLUENT: Update protobuf to 3.11.4 (#1237)
  • KAFKA-9601: Stop logging raw connector config values (#8165)
  • KAFKA-9599 create unique sensor to record group rebalance (#8159)
  • KAFKA-9577; SaslClientAuthenticator incorrectly negotiates SASL_HANDSHAKE version (#8142)
  • CPKAFKA-2705: Added retention to soak topics
  • KAFKA-9582: Do not abort transaction in unclean close (#8143)
  • KAFKA-9562: part 1: ignore exceptions while flushing stores in close(dirty) (#8116)
  • KAFKA-9533: ValueTransform forwards null values (#8108)
  • KAFKA-9558; Fix retry logic in KafkaAdminClient listOffsets (#8119)
  • KAFKA-9515: Upgrade ZooKeeper to 3.5.7 (#8125)
  • KAFKA-9319: Fix generation of CA certificate for system tests. (#8106)
  • KAFKA-9535; Update metadata before retrying partitions when fetching offsets (#8088)
  • KAFKA-8805; Bump producer epoch on recoverable errors (#7389)
  • KAFKA-8904: Improve producer’s topic metadata fetching. (#7781)
  • KAFKA-9556; Fix two issues with KIP-558 and expand testing coverage (#8085)
  • KCORE-81, part 1: remove ZkTrialPeriod
  • KSTORAGE-324: Add GCS support to Tiered Storage System Tests
  • Bump version to 6.0.0-ce-SNAPSHOT
  • KSTORAGE-429: Add mode for preferential tiered reads
  • KSTORAGE-308: Add integration test for ArchiveTask uploading deleted partition
  • KAFKA-8507; Unify connection name flag for command line tool [KIP-499] (#8023)
  • allow ReplaceField SMT to handle tombstone records (#7731)
  • KAFKA-9192: fix NPE when for converting optional json schema in structs (#7733)
  • KAFKA-9417: New Integration Test for KIP-447 (#8000)
  • KAFKA-9447: Add new customized EOS model example (#8031)
  • KAFKA-9499; Improve deletion process by batching more aggressively (#8053)
  • KAFKA-9423: Refine layout of configuration options on website and make individual settings directly linkable (#7955)
  • KAFKA-9500: Fix FK Join Topology (#8015)
  • KAKFA-9503: Fix TopologyTestDriver output order (#8065)
  • KAFKA-9355: Fix bug that removed RocksDB metrics after failure in EOS (#7996)
  • KAFKA-9390: Make serde pseudo-topics unique (#8054)
  • KAFKA-9483: Add Scala KStream#toTable to the Streams DSL (#8024)
  • KAFKA-6607: Commit correct offsets for transactional input data (#8040)
  • KAFKA-7052 Avoiding NPE in ExtractField SMT in case of non-existent fields (#8059)
  • CONFLUENT: Update cc-trogdor-service version to 0.705.x
  • KSTORAGE-436 Decreased restart delay
  • KAFKA-9517: Fix default serdes with FK join (#8061)
  • KAFKA-9487: Follow-up PR of Kafka-9445 (#8033)
  • KAFKA-9523: Migrate BranchedMultiLevelRepartitionConnectedTopologyTest into a unit test (#8081)
  • KAFKA-9480: Fix bug that prevented to measure task-level process-rate (#8018)
  • KAFKA-9505: Only loop over topics-to-validate in retries (#8039)
  • KCORE-46 Fix ConcurrentModificationException in ClusterTestCommon
  • KCORE-70: support CP 5.4 in upgrade system test
  • KAFKA-7658: Follow up to original PR (#8027)
  • KAFKA-9507; AdminClient should check for missing committed offsets (#8057)
  • KAFKA-9519: Deprecate the –zookeeper flag in ConfigCommand (#8056)
  • KAFKA-9509; Fixing flakiness of MirrorConnectorsIntegrationTest.testReplication (#8048)
  • performance_tests: Add necessary brackets to list variable ‘test_definitions’ in performance clients README
  • TierArchiver: sleep outside of synchronized block in main loop
  • Prevent telemetry from accumulating long-lived garbage
  • KAFKA-9261; Client should handle unavailable leader metadata (#7770)
  • KAFKA-9491; Increment high watermark after full log truncation (#8037)
  • CONFLUENT: Remove support-metrics-fullcollector
  • KAFKA-9491; Increment high watermark after full log truncation (#8037)
  • CONFLUENT: Fix semaphore build by removing explicit gradle download
  • KCORE-38: Remove tenant prefix from produce response error messages
  • KAFKA-9074: Correct Connect’s Values.parseString to properly parse a time and timestamp literal (#7568)
  • KAFKA-9492; Ignore record errors in ProduceResponse for older versions (#8030)
  • ccs-master -> master merge
  • KAFKA-9027, KAFKA-9028: Convert create/delete acls requests/response to use generated protocol (#7725)
  • KCORE-37: Add send I/O time to request log entry
  • KAFKA-9437; Make the Kafka Protocol Friendlier with L7 Proxies [KIP-559] (#7994)
  • KAFKA-9437; Make the Kafka Protocol Friendlier with L7 Proxies [KIP-559] (#7994)
  • KAFKA-9375: Add names to all Connect threads (#7901)

MQTT Proxy

  • Upgrade netty version to 4.1.48
  • CC-8256: Don’t pull in incorrect netty version
  • Update upstream to ce-kafka

Metadata Service

  • SEC-251 - Don’t treat Basic authentication as JWT Bearer Token
  • SEC-251 - Don’t treat Basic authentication as JWT Bearer Token
  • CPKAFKA-4549: Don’t process unprefixed broker configs as MDS REST config
  • SEC-717 - MDS Test Infra : Run tests in Parallel
  • SEC-690 - MDS : Check for cluster scoped roles being granted resources.
  • SEC-618: MDS + Kafka Perf / Scale Testing
  • Use ApplicationServer to start up HTTP server to run MDS security service.
  • SEC-652: Optimize visibility lookup endpoint implementation in metada…

Connectors

Elasticsearch Connector

  • PR-398 - CC-8284: Log errors during index exist check at info level
  • PR-377 - Add retries for create index
  • PR-361 - CC-7147: set the max connection per route config for client
  • PR-220 - CC-7146 : Introduce an option to control HTTP-level compression

HDFS Connector

  • PR-491 - CC-8229: HDFS2 format options are not showing all available options
  • PR-477 - CC-7247: allow topics.dir config to be more configurable

JDBC Connector

  • PR-794 - CC-6411: Upgrade jdbc driver for postgres to 42.2.10
  • PR-793 - CC-7637: change from DEBUG level to TRACE level
  • PR-792 - CC-8090: Validate connection.attempts property in config class
  • PR-791 - CC-8087: Remove plaintext logging of task configs
  • PR-429 - Add function to query with initial timestamp.
  • PR-715 - [jdbc-source-connector] Fixed issue in CachedConnectionProvider, to enable retries when a connection is failed
  • PR-787 - Make metadata allFields ordered consistently with the valueSchema.
  • PR-770 - CC-7628 Set conservative timeout for JDBC to stop trying to reach drive
  • PR-785 - CC-5047: connect jdbc url field should have example text
  • PR-775 - Move setFetchSize to GenericDatabaseDialect
  • PR-776 - CC-7637: added logging of query to be executed at DEBUG level
  • PR-748 - * Handling deletes with schema !null
  • PR-730 - suffix param
  • PR-758 - Fix Postgres OOM by limiting fetch size

JMS Connector

  • CC-6503: Capping batch size at 10000 for IBM MQ connector
  • fix dependency to not use hardcoded scala
  • CC-8051: corrected pom version and confluent-licensing-new version
  • CC-7957: corrected pom version and confluent-licensing-new version
  • CC-8052: corrected pom version and confluent-licensing-new version
  • CC-7984: corrected pom version
  • CC-3937: repackaging base classes
  • CC-7926: Corrected logic to prevent infinite loops during poll()
  • CC-7866: Added more and improved existing logging in the base JMS source task and connector
  • CC-7866: Added more and improved existing logging in the base JMS source task and connector
  • Update upstream to ce-kafka

Replicator Connector

  • REP-700: Fixed AdminClient behavior to ignore UnknownTopicOrPartitionException
  • REP-685: Fixing NPE for null timestamp when recording metrics
  • REP-677: Adding default connect.protocol for Replicator Executable
  • REP-552: Enable replicating to clusters with the number of brokers smaller than source topic replication factor
  • REP-669: Renaming script and modifying pom to package verifier jar for verifier tool
  • REP-641: Replicator verifier checks for the consumer-timestamps topic
  • REP-607: Added consumer group check and ported integration tests to TestContainers for verifier tool
  • REP-641: Basic non-destructive ACL checks for verifier tool
  • Integration testing for license checks for verifier tool
  • REP-662: Script wrapping around verifier tool
  • REP-663: Fixing logging message to reflect code path taken for verifier tool
  • REP-607: Added LicenseManager checks for verifier tool
  • REP-625: Created shaded jar for the Verifier tool
  • REP-620, REP-622, REP-623, REP-639, REP-640: Add checks for source/destination connectivity, whitelisted topics, blacklisted topics, regex patterns for verifier tool
  • REP-618: Get attribute map for verifier tool from (1) connector json and (2) running connector
  • REP-638: Ensuring translatorMonitor is not null before closing it out
  • REP-637: Ensuring timestampsCommitter is not null before closing it out
  • REP-619: Initial scaffold for verifier tool
  • REP-184: License check whilst connector running
  • REP-592: Specify clear warnings/errors when Replicator doesn’t have the correct ACLs
  • REP-175: Defaulting to byte array converter for header, key, and value
  • REP-558: separate connector and worker configs in Replicator Executable
  • REP-381: Replicator should not automatically create source topics because it will use the default number of partitions and replication factor.
  • REP-434: Adding more logging to Replicator
  • REP-210: Replicator handles exception when topic-metadata is out-of-sync
  • REP-557: Added check for blacklisted config in executable
  • REP-66: Replicator mentions only destination topic when it fails to read source topic configs
  • REP-566: Caught errors when Replicator cannot describe whitelisted topic
  • REP-456: Fixing dest.kafka.replication.factor bug
  • REP-448: and REP-449: Refactoring and batching offset requests.
  • REP-284: Added warnings for default topics configs
  • REP-533: Added a byte based throughput metric for Replicator
  • REP-513: Expose JMX metrics with additional tag

S3 Connector

  • PR-319 - CC-8430: pilot for connect CVE scanning
  • PR-318 - CC-8170: Exclude jackson-mapper-asl and commons-beanutils from hadoop-common import
  • PR-302 - CC-2539: Added a validator to check the format of S3 bucket name
  • PR-311 - Add AWS IAM Assume Role credentials provider
  • PR-305 - CC-7892: Introduce configuration properties for key and secret to easily define credentials per connector instance
  • PR-308 - CC-8085: Allow setting compression level for gzip in Json and ByteArray formats
  • PR-291 - S3 Object Level Tagging for Offsets & Record Counts

Storage Common

  • PR-128 - Bump parquet version to remove jackson-mapper-asl dependency

Confluent Platform Documentation

  • DOCS-4165: CP Quickstart : update verbiage
  • DOCS-4182: Update auto-generate ccloud params page
  • HCD-283 : Adding support of Schema name and table suffix for Vertica rejected records Table.
  • DOCS-4108 - added worker vs. connector config content
  • Consistent references to config files
  • CC-8651: Sync new source connector configs to docs
  • Reworded for a slightly better emphasis on the download link
  • DOCS-4173 Change 5.5 variable to hardcoded version
  • DOCS-4163 Update Operator doc title with imperative to conform to the…
  • Final 5.5 nit fixes
  • DOCS-4164 Ansible doc titles refactoring
  • Operator download link change
  • docs: link to changelog.md (DOCS-4172)
  • DOCS-4168 Add new flags to config reference for ADB in 5.5.0
  • DOCS-4166: Update ‘ksqlDB community’ to ‘ksqlDB Standalone’ in CP docs
  • Update index.rst for SQL DW Sink
  • DOCS-3789: Update outbound links to docs.ksqlDB.io with versioned URLs
  • DOCS-4148 - Add blog and video to release notes
  • DOCS-4153 - Add replicator verification tool release notes entry
  • DOCS-3170 - added note about environment variable use
  • DOCS-4138: Fix broken link in CP 5.5 release notes
  • Update cc-gcp-dataproc-sink.rst
  • OPER-294 Updated the download link for 5.5
  • Removed a duplicate step
  • Update ksqldb package name for 5.5.0
  • DOCS-3507: Add all redirects for refactored ksqlDB content
  • DOCS-4144 - added additional HDSF 2 sink limitation text; added commit note to google pub/sub
  • DOCS-4145 Removed confluent.security.event.logger.enabled from the An…
  • Fixed a typo
  • OPER-252 OPER-253 Created co-download page and simplified the Helm in…
  • WIP Vertica Sink: Added config ‘pk.mode’, ‘pk.fields’ and ‘delete.enabled’ in Vertica.
  • HCD-354 : Jira Source Connector configuration changes
  • HCD-353 : Github Source Connector configuration changes
  • Update azure-blob-sink-connector-limits.rst
  • Update gcs-sink-connector-limits.rst
  • Update s3-sink-connector-limits.rst
  • added CCE; added to Kinesis
  • OPER-101 Upgrading Operator 5.4 to 5.5
  • ANSI-117 RBAC in Ansible
  • Changed the 5.4 text in examples to 5.5
  • OPER-201 ClusterRoleBinding, Config Overrides, and Kafka License configuration
  • OPER-291 OPER-292 Added the notes about ksqlDB changes in the OPER re…
  • DOCS-3507: Add redirects to new ksqlDB content
  • Fix ksqldb external links
  • KCORE-178: cancel, topics, replica-placement-only and incremental
  • DOCS-3762 SR support for Protobuf, JSON Schema, Avro, improvements on C3 schemas workflow
  • DEVX-1731: Add link from ZK TLS docs to cp-demo
  • DOCS-4114 - Add JAAS secrets limitation
  • DOCS-4086: Refactor ksqlDB upgrade topic to focus on console consumer
  • DOCS-565 - Add missing C3 broker metric
  • DOCS-4107 - Remove cluster-level connection limit
  • Clarify schema version limits for SR
  • Updated the fully-managed Dataproc Sink doc
  • DOCS-4089 - added Protobuf and JSON Schema RBAC examples
  • Operator RBAC update for ksqlDB
  • DOCS-3860 - Update release date
  • DOCS-4080 - added cloud resource manager API link to prereqs
  • DOCS-3797 - 5.5.0 Release Notes
  • fixed code comment to codewithvars, not picked up with earlier merge
  • DOCS-4081 - typo corrected
  • DOCS-2421 - fixed REST curl examples
  • DOCS-2555 - fixed community gap; period in tip
  • Update the quickstart doc for Github Source Connector.
  • Clients v1.4.0 / CP 5.5
  • DOCS-3542 SR C3 and tutorial updates, follow-up reviews
  • DOCS-4077: Replace cksql-full token with ksqldb token
  • moved banner; fixed redshift duplication
  • DOCS-3546: Global rename of KSQL to ksqlDB in CP docs
  • CLIENTS-1536: Update REST Proxy documetation with V3 API for 5.5.x.
  • DOCS-2636 - made link clearer
  • DOCS-2547, DOCS-3596, DOCS-3892 - AWS credentials environment variables
  • DOCS-3689, DOCS-3927 - added blog links
  • DOCS-3741: Copy migration topic to ksqlDB Enterprise dir in CP docs repo
  • OPER-66 RBAC mTLS for Operator
  • OPER-112 ANSI-145 CP features supported in OPER and ANSI
  • DOCS-3560: Add serdes for Protobuf and JSON schema support in Streams
  • Update valid cluster sizes
  • DOCS-3951 - added container creation link and avro config property
  • DOCS-3831 Replicator C3 UI rebrand CP 5.5, Tutorial updates
  • Fixed a few old and new KSQL names
  • Remove AWS us-west-1 from region list
  • OPER-287 A simpler ACL config
  • DOCS-2208 - added additional subject name strategy information
  • DOCS-2330 - on duplicate key UPDATE instead of REPLACE
  • DOCS-3945 - Update interoperability table for 5.5
  • Remove misplaced cp-demo link
  • DOCS-3543: Update C3 ksqlDB User Guide page
  • DOCS-3836: New client auth with LDAP section
  • CLIENTS-1490 - Update client matrix to include EOS true for librdkafk…
  • DOCS-3874 - Protobuf and JSON Schema Support in CLIs and Clients
  • DOCS-3556 - Protobuf and JSON Schema Support in REST Proxy
  • DOCS-3471 - New C3 screenshots
  • DOCS-3616: Config options for object tagging, gzip compression and credentials in S3 connector
  • DOCS-1400 - added link to Robin’s article
  • Clarify retained_bytes behavior
  • Update confluent-cloud-commit-note.rst
  • DOCS-3486: Split KSQL content into ksqlDB Community docs and CP docs [WIP]
  • DOCS-3860 - Cloud release notes for 4 14 2020
  • DOCS-3378 Cloud updates UI, JSON, Protobuf
  • DOCS-3397 - Add Azure marketplace UBB doc
  • DOCS-3781 - added UBB Confluent Cloud Commit note; asterisk bullet
  • DOCS-3515 - Azure Event Hubs Source connector docs for Confluent Cloud
  • DOCS-3516 - Amazon Redshift Sink connector docs for Confluent Cloud
  • DOCS-3517 - Google Cloud Spanner Sink connector docs for Confluent Cloud
  • DOCS-3518 - Google Cloud Dataproc Sink connector docs for Confluent Cloud
  • DOCS-3519 - Azure Data Lake Gen2 Storage Sink connector docs for Confluent Cloud
  • DOCS-3365: New ZK TLS content - adding and migrating
  • OPER-95 OPER-193 K8S tasks that require the cluster-level access - Storage and CRD
  • Explicit example for Cloud API Keys generation
  • DOCS-3926: Add link to cp-demo from main RBAC page
  • DOCS-3836: New client auth with LDAP section
  • DOCS-3828 - added root REST request for cluster ID
  • DEVX-1705: Add see also link from SR tutorial to cp-demo
  • ANSI-237 Noted that KSQL cannot be upgraded to 5.5
  • DOCS-3895 - remove tasks from restart connector endpoint description
  • DOCS-3763: Add version compat matrix for CP ksqlDB and standalone ksqlDB
  • DOCS-3403: Limitation wrt prefixes in secrets configs
  • DOCS-3805: Replaced link to FIPS web site
  • DOCS-3503 - Deprecate zookeeper.connect configuration
  • DOCS-3819 - Remove deprecated parameter
  • DOCS-3696 - KIP-352: Distinguish URPs caused by reassignment
  • DOCS-3835 - Fix incorrect parm c3
  • DOCS-3830 - Add broker connections count JMX
  • DOCS-926 - Add link to connect C3 to cloud with Docker
  • Add confluent.license parm
  • DOCS-3921 - file format lines
  • DOCS-3669 - Generate AK 2.4 configs from ce-kafka
  • DOCS-3425 - Add the AK 2.5 configs
  • DOCS-3678 - Add pre-execution SQL logging to JBDC source connector
  • DOCS-3912 Update CKU limits
  • DOCS-3841 - Fix Azure marketplace billing example
  • Update Canada Central support
  • Update docs for new cogroup operator (KIP-150)
  • DOCS-3913: Copy updated timestamp extractor name from AK to CP docs repo
  • DOCS-3906 - change delivery guarantee description
  • All ccloud CLI traffic is https
  • Remove extra TGW requirements
  • Explain Transit Gateway routing
  • SR per env and over port 443
  • Update CKU limits
  • OPER-150 Pod annotations support in Operator
  • SNMP COPS feedback : HCD-326
  • Ccloud debug with kafkacat improvements
  • DOCS-3540 - C3 Connect UI rebranding
  • METRICS-1322: update docs to use api key
  • DOCS-3542 CP 5.5 Rebrand UI, Schema Registry tutorial, C3 topics
  • Licenses, RBAC - removed Preview label
  • Salesforce CDC source connector : Adding subscription to change notification
  • DOCS-3558 - 5.5 release - adding Protobuf and JSON Schema converter content
  • Add text string replace for kafka rest proxy
  • KSTREAMS-3963: Update CP 5.5 docs for KIP-535
  • Update cluster-types.rst
  • Add limits to cluster table
  • Get stream 2.5 change docs
  • DOCS-3812: Doc KStreams serving interactive queries from in-sync standbys
  • DOCS-3863 - clean-up; added separate source connector service account steps
  • DOCS-3680 - 5.5 release - Added deprecation bullet for bundled connectors in 5.5 release notes
  • CC-8404: Move Salesforce bulk api to supported status
  • OPER-65 OPER-99 OPER-201 Namespaced deployment configs
  • OPER-69 JMX TLS support in Operator
  • DOCS-3731 - Add link to Developer site
  • DOCS-3803 - Update Connecting Rest Proxy to Ccloud config
  • Environments are free
  • DOCS-3829: Update docs cp-all-in-one to point to new GitHub repo
  • DOCS-3544 - 5.5 release - Add “Topics” to rest API doc
  • DOCS-3587 - New cluster types and billing
  • DOCS-3866: Remove preview from CCloud KSQL pricing section
  • fix step 8 wrongness
  • CC-6258: Zendesk connector documentation
  • fix ccloud api-key create command documentation
  • Add note about where to find specific CSU cost
  • DOCS-3838: Revert ksqldb string token to KSQL for CCloud PA
  • DOCS-3679: Add a new config for IBM MQ Source Connector for a reconnection logic
  • Adapt metrics docs to reflect changes from KIP-444
  • Remove PCI level from compliance table
  • DOCS-3681: better document how to list metrics
  • Update Azure regions
  • Add AWS Sao Paulo
  • Corrected the avro download link for HDFS v2 Sink
  • OPER-100 Supported env in Operator 5.5
  • DOCS-3821 - fixed timing issue
  • DOCS-3539: Removed and updated rebranded C3 screens for security
  • DOCS-3537: cloud UI updates for ksqlDB docs [WIP]
  • DOCS-1818- added multiple cluster section
  • DOCS-2794 - numeric mapping content updated
  • cleared up partitioner options
  • DOCS-2843 - added note about offsets
  • DOCS-1134 - added note about CLASSPATH
  • DOCS-3736 - Rename confusing cloud directory
  • DOCS-3638 Docker Images Support Matrix for CP 5.5
  • OPER-192 User-provided storage class for Operator
  • DOCS-3534 - Cloud UI screen updates (part 3)
  • DOCS-3670 - Add cloud release notes for 4/1
  • Fix MBean expression for Streams metrics
  • DOCS-3793 - Remove note about delete env limitation
  • DOCS-3766 - Move cloud includes into main cloud dir
  • DOCS-3567 - moved CC Azure Blob Sink connector for to GA for 03/27 release
  • Improve Cloud overview
  • REP-616 added note regarding topic.whitelist behaviour change in 5.5.…
  • ST-3326: Add role for linking to ksqlDB docs
  • DOCS-3569 - fixed examples
  • HCD-305 : Retry instead of fail fast on errors
  • CC-8434: add changelog for bigquery connector
  • OPER-211 Restructure the Operator docs: Take 1
  • Adding missing GCS Sink Connector release notes.
  • Update networking page
  • DOCS-3621: Sync KStreams 5.5 content between docs repo and AK repo
  • Change ordering of features page
  • DOCS-3505 - Fix broken link
  • DOCS-3488 no SR security plugin trial licenses for TLS ZK quorums
  • DOCS-3743 - Define CCLOUD units
  • DOCS-3532: Recaptured screens post rebranding
  • DOCS-3740: Update cp-ksql-* Docker image names to cp-ksqldb-*
  • DOCS-3742: Update Azure Blob Storage changelog
  • DOCS-3752 - Fix Incorrect config for REST Proxy connecting to CC
  • Attempt to fix codeowners
  • DOCS-3662 added podcast link; connect docs cleanup initiative
  • Move marketplace docs to their own node
  • DOCS-3728: Link to CCloud KSQL preview/PA migration topic
  • fix capitalization
  • DOCS-3733 - change to Microsoft SQL
  • Appdynamics initial documentation
  • Initial documentation for prometheus-metrics-sink-connector
  • DOCS-3730: Cherry-pick blog post link to 5.4.1-post branch (No need to review)
  • added code owner for cloud/connectors
  • Update oracle-db-source-connector-limits.rst
  • Update mysql-source-connector-limits.rst
  • Update postgresql-source-connector-limits.rst
  • Update microsoft-sql-server-source-connector-limits.rst
  • build version 1 for datadog metrics sink
  • DOCS-3534 - Cloud UI updates (part 1)
  • CC-8183: Document changes to address parquet support to azure-blob-st…
  • DEVX-1602: Add ToC for “new” clickstream demo
  • DOCS-3711 Cloud updates from C3 review comments topic message browser
  • DOCS-3603 C3 UI rebrand updates for 5.5 Topics docs, DOCS-694 prereqs topic browser, DOCS-3499 change Close to Cancel in Delete topic modal, DOCS-3460 human-readable timestamp
  • DOCS-3673 Robert Cowart’s comment re: weird wording
  • Update azure-blob-sink-connector-limits.rst
  • CC-8110: Provide note about timezone restrictions in prerequisites section
  • DOCS-3691: Add blog link to Streams topic
  • DOCS-3673 Update C3 screen snaps on Rolling Restart to match current UI
  • DOCS-3512 Docker Images Support Matrix
  • DOCS-3665 remove active controller from alerts
  • DOCS-3511, DOCS-3578, DOCS-3651, DOCS-3523 Cloud Topic Message Browser updates
  • SalesforceBulkAPI: COPS feedback (HCD-327)
  • added vpc peering info
  • DOCS-2256 Document CCLoud librdkafka SSL setup
  • adding confluent server to the list of components requiring a license
  • Update gcs-sink-connector-limits.rst
  • DOCS-3500 C3 Active Controller updates
  • DOCS-3650 - Add link to podcast
  • DOCS-3599: Add 5.3.3 Release Notes
  • DOCS-3565 Revise Ansible and Operator interoperability docs on CP fe…
  • DOCS-3600 C3 UI rebrand updates for 5.5 Brokers docs
  • DOCS-3357 - Add deprecation notice for rest proxy v1
  • DOCS-3611 - Add link to developer site
  • DOCS-3607 - Fix instances of kakfa
  • DOCS-3626 - Update consumer lag image
  • Updated the download link for Operator 5.4.1
  • Updated the Salesforce Bulk API Source doc
  • DOCS-3579 C3 UI rebrand updates for 5.5 Alerts docs
  • DOCS-3580 C3 UI updates for 5.5 License Management docs
  • DOCS-3610 rebrand C3 userguide landing page
  • DOCS-3331: Add allow.auto.create.topics param to KStreams config topic
  • DOCS-3601 C3 UI rebrand updates for 5.5 Cluster Overview docs
  • DOCS-3602 C3 UI rebrand updates for 5.5 Cluster Settings docs
  • DOCS-3604 C3 UI rebrand updates for 5.5 Consumers docs
  • DOCS-3586 Schema Registry JMX options env var
  • DOCS-3373: Secrets protection feature
  • DOCS-3597 - Add missing C3 fixes (5.4.1-post only)
  • DOCS-3597 - Add missing C3 fixes (5.4.x only)
  • added to top page links; moved to end of doc
  • DOCS-3081 Document how to override the default JMX_OPTS
  • added different region statement
  • DOCS-1353 Clarify Scala versions and Java dependency
  • CC-8188: BigQuery Connector lacks new config documentation
  • DOCS-3498 Add to librdkafka documentation that its default partitione…
  • DOCS-3589 - Add 5.4.1 release notes
  • DOCS-3553: Replaced ZK option
  • DOCS-3027 Topic Message Browser Pause/Play feature for C3 5.4.1 (port to cloud post-approval)
  • REP-644 docs for replicator verifier
  • DOCS-3520 Moved c3 images for multi-cluster SR to top-level images folder
  • DOCS-3141 delete internal topic content
  • DOCS-2699 Multi Cluster Schema Registry
  • REP-668: Notice about zk deprecation and no support for tls enabled zk
  • DOCS-3447: Deprecation warning for TLS 1.0 and 1.1
  • new config setting node health checks
  • Fix gradle config
  • DOCS-2556 Remove Cloud specific note from include (reprise)
  • DOCS-3346 - Microsoft SQL Server Source CCloud CLI Quick Start and clean up
  • removed duplicate demo tip
  • DOCS-3352 Add cp-kafka-connect-base image to the list of Docker images
  • DOCS-3096 Removed the claim generic clients apps cannot be on lower v…
  • adding note; updating MySQL version
  • DOCS-3246 Updated the description for disk utilization
  • REP-616 added note regarding topic.whitelist behaviour change in 5.5.…
  • REP-614 added notes on ccloud tuning and Replicator cluster locations
  • DOCS-3211 Remove warnings re: License tab availability for expired trial license 5.4.1 release
  • DOCS-2990 - 5.4.0 release notes
  • REP-599: documenting new dest rf config
  • CC-7629 : regenerate configs to reflect new configs
  • REP-559 enforce client property locations
  • REP-2: Explaining src.consumer.allow.auto.topics.create and deleting topics on Replicator
  • Fixes and Updates from doing a fresh setup
  • Fix link to Table API, switched table and columns images
  • REP-550: Documenting new byte based throughput replicator metrics
  • Cassandra : Offset Tracking in Kafka + TTL Support
  • REP-362 fixed bad name for rest extension in proposed docs
  • Fix “type error” in Testing section for Kafka Streams
  • CC-7145: add new compression config to elastic search connector
  • Update gcp-bigquery-sink-connector-limits.rst
  • Update gcs-sink-connector-limits.rst
  • Updated GTM code