Changelog¶
Version 3.1.18¶
- ESC-581: Updated
hadoop-common
to 3.3.6,freemarker
to 2.3.32,ch.qos.reload4j
to 1.2.25 .
Version 3.1.17¶
- Closed parquet writer before closing sftp channel.
Version 3.1.16¶
- ESC-581: Bumped
snappy-java
to 1.1.10.3,jackson-core
to 2.15.2,jetty-server
to 9.4.51.v20230217 andjose4j
to 0.9.3.
Version 3.1.15¶
- RCCA-12250: Fixed bug causing flush records immediately for Json format without reaching any condition for rotation through
flush.size
,rotate.interval.ms
orrotate.schedule.interval.ms
.
Version 3.1.14¶
- Added Support to work with SFTP server with GCS integration.
Version 3.1.13¶
- RCCA-11646: Handled SFTP server connection termination gracefully and attempted reconnection with retries
Version 3.1.12¶
- CCMSG-2436: Bumped
json-smart
to 2.4.10. - CCDB-5326: Bumped
commons-net
to 3.9.0. - CCDB-5326: Removed
jettison
dependency.
Version 3.1.11¶
- CCMSG-2217: Bumped
jackson-databind
to 2.14.0. - RCCA-11300: Updated
kafka-connect-avro-converter
to 7.3.0.
Version 3.1.10¶
- No changes
Version 3.1.9¶
- RCCA-10748: Fixed SFTP CSV Source connector to avoid incomplete processing of files in case of sftp connection error.
- CCMSG-1450: Improved error message for sftp channel opening error.
Version 3.1.8¶
- RCCA-9970: Fixed NPE error while handling failed to process files.
- CCMSG-2081: Bumped
gson
to 2.8.9. - CCMSG-2130: Bumped
hadoop-common
to 3.2.4. - CCMSG-2269: Bumped
woodstox-core
to 6.4.0.
Version 3.1.7¶
- RCCA-9026: Fixed an issue with the SFTP source connector that allowed files to be moved to the processed folder without being fully written to Kafka.
- CCMSG-2289: Handled OOM issue occuring due to storing of offsets for MOVE and DELETE clean-up policy.
Version 3.1.6¶
- RCCA-8631: Created distinct temporary directory based on timestamp during validation
Version 3.1.5¶
- CC-17471: Add support to create structured CSV files from structured record data
Version 3.1.4¶
- CCMSG-2114: Added cross validate schema in validations and schema validator
Version 3.1.3¶
- Bump hadoop-common from 3.2.2 to 3.2.3
Version 3.1.2¶
- CVE: Remove slf4j-log4j12 dependency
- CCMSG-2057: Add graceful handling for config cross validation
Version 3.1.1¶
- CCMSG-1935: Updated Gson version to 2.9.0
Version 3.1.0¶
- CCMSG-1766: Added a new configuration property,
csv.pre.validate.file.enabled
for validating the integrity of records in a CSV file, which is applicable to the Consolidated SFTP Source connector and CSV Source connector