Changelog for SFTP Sink and Source Connector for Confluent Platform

Version 3.2.18

  • INC-6168: Deprecated the non-functional csv.null.field.indicator config and introduced a replacement config csv.null.field.mode.

Version 3.2.17

  • CC-35471: Updated hadoop-common to 3.4.2, commons-compress to 1.28.0, commons-lang3 to 3.18.0 and netty-handler to 4.2.5.Final.

Version 3.2.16

  • CC-31824: Removed usage of non-public Apache Kafka APIs

Version 3.2.15

  • CC-34198: Updated commons-beanutils to 1.11.0.

Version 3.2.14

  • CC-33760: Updated parquet-avro to 1.15.2.

Version 3.2.13

  • CC-32375, CC-33024 | Upgraded netty-common to 4.1.118.FINAL & parquet-avro to 1.15.1

Version 3.2.12

  • CC-32072: Bumped netty-handler to 4.1.119.Final.

Version 3.2.11

  • CC-30796, CC-30795, CC-30794, CC-30792: Fixed CVE-2024-7254, CVE-2024-47554, CVE-2024-25638 and CVE-2024-23454.

  • CC-29991: Updated the documentation for key.schema and value.schema.

  • CC-30145: Upgraded avro from v1.11.3 to v1.11.4 to fix CVE-2024-47561.

Version 3.2.10

  • CC-26210: Fixed version file to display the correct version in logs.

Version 3.2.9

  • Removed kafka-connect-avro-connector dependency.

Version 3.2.8

  • CC-19615: Fixed reconnection logic for all source connectors.

Version 3.2.7

  • [RCCA-21240] Resolve timestamp value in FILE_TIME mode in SFTP Source

Version 3.2.6

  • RCCA-20439: Handled npe for csv reader on reconnection.

Version 3.2.5

  • Bumped jackson-databind to 2.16.2.

  • Bumped commons-configuration to 2.10.1.

Version 3.2.4

  • CC-26302: Bumped jose4j to 0.9.6.

  • RCCA-18080: Reduced session timeout to 10s for validation of connector’s config.

Version 3.2.3

  • Bumped Hadoop common to 3.3.6.

Version 3.2.2

  • CC-25325: Bumped commons.compress to 1.26.0.

Version 3.2.1

  • CC-24218: Bumped jsch to 0.2.15.

Version 3.2.0

  • Added new config sftp.max.record.size to limit record size in memory and move the file to the error directory if a record in a file exceeds the configured value.

  • Bumped snappy-java to 1.1.10.4

  • Removed zookeeper dependency

  • ESC-581: Updated hadoop-common to 3.3.6, freemarker to 2.3.32, ch.qos.reload4j to 1.2.25.

  • Closed parquet writer before closing sftp channel.

  • ESC-581: Bumped snappy-java to 1.1.10.3, jackson-core to 2.15.2, jetty-server to 9.4.51.v20230217 and jose4j to 0.9.3.

  • RCCA-12250: Fixed bug causing flush records immediately for Json format without reaching any condition for rotation through flush.size, rotate.interval.ms or rotate.schedule.interval.ms.

  • Added Support to work with SFTP server with GCS integration.

  • RCCA-11646: Handled SFTP server connection termination gracefully and attempted reconnection with retries

  • CCMSG-2436: Bumped json-smart to 2.4.10.

  • CCDB-5326: Bumped commons-net to 3.9.0.

  • CCDB-5326: Removed jettison dependency.

  • CCMSG-2217: Bumped jackson-databind to 2.14.0.

  • RCCA-11300: Updated kafka-connect-avro-converter to 7.3.0.

  • RCCA-10748: Fixed SFTP CSV Source connector to avoid incomplete processing of files in case of sftp connection error.

  • CCMSG-1450: Improved error message for sftp channel opening error.

  • RCCA-9970: Fixed NPE error while handling failed to process files.

  • CCMSG-2130: Bumped hadoop-common to 3.2.4.

  • CCMSG-2269: Bumped woodstox-core to 6.4.0.

  • RCCA-9026: Fixed an issue with the SFTP source connector that allowed files to be moved to the processed folder without being fully written to Kafka.

  • CCMSG-2289: Handled OOM issue occuring due to storing of offsets for MOVE and DELETE clean-up policy.

  • RCCA-8631: Created distinct temporary directory based on timestamp during validation

  • CC-17471: Add support to create structured CSV files from structured record data

  • CCMSG-2114: Added cross validate schema in validations and schema validator

  • Bump hadoop-common from 3.2.2 to 3.2.3

  • CVE: Remove slf4j-log4j12 dependency

  • CCMSG-2057: Add graceful handling for config cross validation

  • CCMSG-1935: Updated Gson version to 2.9.0