Changelog for SFTP Sink and Source Connector for Confluent Platform
Version 3.2.17
CC-35471: Updated
hadoop-common
to3.4.2
,commons-compress
to1.28.0
,commons-lang3
to3.18.0
andnetty-handler
to4.2.5.Final
.
Version 3.2.16
CC-31824: Removed usage of non-public Apache Kafka APIs
Version 3.2.15
CC-34198: Updated commons-beanutils to
1.11.0
.
Version 3.2.14
CC-33760: Updated
parquet-avro
to1.15.2
.
Version 3.2.13
CC-32375, CC-33024 | Upgraded netty-common to 4.1.118.FINAL & parquet-avro to 1.15.1
Version 3.2.12
CC-32072: Bumped netty-handler to 4.1.119.Final.
Version 3.2.11
CC-30796, CC-30795, CC-30794, CC-30792: Fixed CVE-2024-7254, CVE-2024-47554, CVE-2024-25638 and CVE-2024-23454.
CC-29991: Updated the documentation for key.schema and value.schema.
CC-30145: Upgraded avro from v1.11.3 to v1.11.4 to fix CVE-2024-47561.
Version 3.2.10
CC-26210: Fixed version file to display the correct version in logs.
Version 3.2.9
Removed kafka-connect-avro-connector dependency.
Version 3.2.8
CC-19615: Fixed reconnection logic for all source connectors.
Version 3.2.7
[RCCA-21240] Resolve timestamp value in FILE_TIME mode in SFTP Source
Version 3.2.6
RCCA-20439: Handled npe for csv reader on reconnection.
Version 3.2.5
Bumped jackson-databind to 2.16.2.
Bumped commons-configuration to 2.10.1.
Version 3.2.4
CC-26302: Bumped
jose4j
to 0.9.6.RCCA-18080: Reduced session timeout to 10s for validation of connector’s config.
Version 3.2.3
Bumped Hadoop common to 3.3.6.
Version 3.2.2
CC-25325: Bumped
commons.compress
to 1.26.0.
Version 3.2.1
CC-24218: Bumped
jsch
to 0.2.15.
Version 3.2.0
Added new config
sftp.max.record.size
to limit record size in memory and move the file to the error directory if a record in a file exceeds the configured value.Bumped snappy-java to 1.1.10.4
Removed zookeeper dependency
ESC-581: Updated hadoop-common to 3.3.6, freemarker to 2.3.32, ch.qos.reload4j to 1.2.25.
Closed parquet writer before closing sftp channel.
ESC-581: Bumped snappy-java to 1.1.10.3, jackson-core to 2.15.2, jetty-server to 9.4.51.v20230217 and jose4j to 0.9.3.
RCCA-12250: Fixed bug causing flush records immediately for Json format without reaching any condition for rotation through flush.size, rotate.interval.ms or rotate.schedule.interval.ms.
Added Support to work with SFTP server with GCS integration.
RCCA-11646: Handled SFTP server connection termination gracefully and attempted reconnection with retries
CCMSG-2436: Bumped json-smart to 2.4.10.
CCDB-5326: Bumped commons-net to 3.9.0.
CCDB-5326: Removed jettison dependency.
CCMSG-2217: Bumped jackson-databind to 2.14.0.
RCCA-11300: Updated kafka-connect-avro-converter to 7.3.0.
RCCA-10748: Fixed SFTP CSV Source connector to avoid incomplete processing of files in case of sftp connection error.
CCMSG-1450: Improved error message for sftp channel opening error.
RCCA-9970: Fixed NPE error while handling failed to process files.
CCMSG-2130: Bumped hadoop-common to 3.2.4.
CCMSG-2269: Bumped woodstox-core to 6.4.0.
RCCA-9026: Fixed an issue with the SFTP source connector that allowed files to be moved to the processed folder without being fully written to Kafka.
CCMSG-2289: Handled OOM issue occuring due to storing of offsets for MOVE and DELETE clean-up policy.
RCCA-8631: Created distinct temporary directory based on timestamp during validation
CC-17471: Add support to create structured CSV files from structured record data
CCMSG-2114: Added cross validate schema in validations and schema validator
Bump hadoop-common from 3.2.2 to 3.2.3
CVE: Remove slf4j-log4j12 dependency
CCMSG-2057: Add graceful handling for config cross validation
CCMSG-1935: Updated Gson version to 2.9.0