Changelog

Version 3.1.18

  • ESC-581: Updated hadoop-common to 3.3.6, freemarker to 2.3.32, ch.qos.reload4j to 1.2.25 .

Version 3.1.17

  • Closed parquet writer before closing sftp channel.

Version 3.1.16

  • ESC-581: Bumped snappy-java to 1.1.10.3, jackson-core to 2.15.2, jetty-server to 9.4.51.v20230217 and jose4j to 0.9.3.

Version 3.1.15

  • RCCA-12250: Fixed bug causing flush records immediately for Json format without reaching any condition for rotation through flush.size, rotate.interval.ms or rotate.schedule.interval.ms.

Version 3.1.14

  • Added Support to work with SFTP server with GCS integration.

Version 3.1.13

  • RCCA-11646: Handled SFTP server connection termination gracefully and attempted reconnection with retries

Version 3.1.12

  • CCMSG-2436: Bumped json-smart to 2.4.10.
  • CCDB-5326: Bumped commons-net to 3.9.0.
  • CCDB-5326: Removed jettison dependency.

Version 3.1.11

  • CCMSG-2217: Bumped jackson-databind to 2.14.0.
  • RCCA-11300: Updated kafka-connect-avro-converter to 7.3.0.

Version 3.1.10

  • No changes

Version 3.1.9

  • RCCA-10748: Fixed SFTP CSV Source connector to avoid incomplete processing of files in case of sftp connection error.
  • CCMSG-1450: Improved error message for sftp channel opening error.

Version 3.1.8

  • RCCA-9970: Fixed NPE error while handling failed to process files.
  • CCMSG-2081: Bumped gson to 2.8.9.
  • CCMSG-2130: Bumped hadoop-common to 3.2.4.
  • CCMSG-2269: Bumped woodstox-core to 6.4.0.

Version 3.1.7

  • RCCA-9026: Fixed an issue with the SFTP source connector that allowed files to be moved to the processed folder without being fully written to Kafka.
  • CCMSG-2289: Handled OOM issue occuring due to storing of offsets for MOVE and DELETE clean-up policy.

Version 3.1.6

  • RCCA-8631: Created distinct temporary directory based on timestamp during validation

Version 3.1.5

  • CC-17471: Add support to create structured CSV files from structured record data

Version 3.1.4

  • CCMSG-2114: Added cross validate schema in validations and schema validator

Version 3.1.3

  • Bump hadoop-common from 3.2.2 to 3.2.3

Version 3.1.2

  • CVE: Remove slf4j-log4j12 dependency
  • CCMSG-2057: Add graceful handling for config cross validation

Version 3.1.1

  • CCMSG-1935: Updated Gson version to 2.9.0

Version 3.1.0

  • CCMSG-1766: Added a new configuration property, csv.pre.validate.file.enabled for validating the integrity of records in a CSV file, which is applicable to the Consolidated SFTP Source connector and CSV Source connector