Changelog for SFTP Sink and Source Connector for Confluent Platform

Version 3.2.10

  • CC-26210: Fixed version file to display the correct version in logs.

Version 3.2.9

  • Removed kafka-connect-avro-connector dependency.

Version 3.2.8

  • CC-19615: Fixed reconnection logic for all source connectors.

Version 3.2.7

  • [RCCA-21240] Resolve timestamp value in FILE_TIME mode in SFTP Source

Version 3.2.6

  • RCCA-20439: Handled npe for csv reader on reconnection.

Version 3.2.5

  • Bumped jackson-databind to 2.16.2.
  • Bumped commons-configuration to 2.10.1.

Version 3.2.4

  • CC-26302: Bumped jose4j to 0.9.6.
  • RCCA-18080: Reduced session timeout to 10s for validation of connector’s config.

Version 3.2.3

  • Bumped Hadoop common to 3.3.6.

Version 3.2.2

  • CC-25325: Bumped commons.compress to 1.26.0.

Version 3.2.1

  • CC-24218: Bumped jsch to 0.2.15.

Version 3.2.0

  • Added new config sftp.max.record.size to limit record size in memory and move the file to the error directory if a record in a file exceeds the configured value.
  • Bumped snappy-java to 1.1.10.4
  • Removed zookeeper dependency
  • ESC-581: Updated hadoop-common to 3.3.6, freemarker to 2.3.32, ch.qos.reload4j to 1.2.25.
  • Closed parquet writer before closing sftp channel.
  • ESC-581: Bumped snappy-java to 1.1.10.3, jackson-core to 2.15.2, jetty-server to 9.4.51.v20230217 and jose4j to 0.9.3.
  • RCCA-12250: Fixed bug causing flush records immediately for Json format without reaching any condition for rotation through flush.size, rotate.interval.ms or rotate.schedule.interval.ms.
  • Added Support to work with SFTP server with GCS integration.
  • RCCA-11646: Handled SFTP server connection termination gracefully and attempted reconnection with retries
  • CCMSG-2436: Bumped json-smart to 2.4.10.
  • CCDB-5326: Bumped commons-net to 3.9.0.
  • CCDB-5326: Removed jettison dependency.
  • CCMSG-2217: Bumped jackson-databind to 2.14.0.
  • RCCA-11300: Updated kafka-connect-avro-converter to 7.3.0.
  • RCCA-10748: Fixed SFTP CSV Source connector to avoid incomplete processing of files in case of sftp connection error.
  • CCMSG-1450: Improved error message for sftp channel opening error.
  • RCCA-9970: Fixed NPE error while handling failed to process files.
  • CCMSG-2130: Bumped hadoop-common to 3.2.4.
  • CCMSG-2269: Bumped woodstox-core to 6.4.0.
  • RCCA-9026: Fixed an issue with the SFTP source connector that allowed files to be moved to the processed folder without being fully written to Kafka.
  • CCMSG-2289: Handled OOM issue occuring due to storing of offsets for MOVE and DELETE clean-up policy.
  • RCCA-8631: Created distinct temporary directory based on timestamp during validation
  • CC-17471: Add support to create structured CSV files from structured record data
  • CCMSG-2114: Added cross validate schema in validations and schema validator
  • Bump hadoop-common from 3.2.2 to 3.2.3
  • CVE: Remove slf4j-log4j12 dependency
  • CCMSG-2057: Add graceful handling for config cross validation
  • CCMSG-1935: Updated Gson version to 2.9.0