Changelog

Version 3.1.0

  • CCMSG-1766: Added a new configuration property, csv.pre.validate.file.enabled for validating the integrity of records in a CSV file, which is applicable to the Consolidated SFTP Source connector and CSV Source connector

Version 3.0.2

  • Minor: Upgrade connect-commons-plugins from 0.8.12 to 0.8.13 to use backward compatible licensing jar
  • Minor: Upgrade connect-commons-plugins from 0.8.11 to 0.8.12 to remove nano version
  • CCMSG-1745: Upgraded storage commmons to latest to resolve jackson databind 2.13.2 CVE
  • CVE: Upgrade connect-commons-plugins from 0.8.10 to 0.8.11
  • CCMSG-1721: Updated to latest commons to fix jackson databind CVE
  • CCMSG-1637: Updated to latest commons to resolve protobuf CVE

Version 3.0.1

  • Minor: Close file stream

Version 3.0.0

  • CCLOG-1073: Add config validations for source connector to check configured SFTP directories’ permissions
  • CCMSG-1357: Converting jetty-servlet test
  • CCLOG-1162: Generic SFTP Source connector
  • CCLOG-1197: Reduce log level to debug for sensitive logs which can log customer data (topic names)
  • CCLOG-1035: Add config validations for common connection related configs and Sink connector permissions
  • CCLOG-1128: Replace java.util.regex with com.google.re2j
  • Exclude unused netty dependencies to resolve netty-codec CVE for version 4.1.48
  • CCMSG-1331: Upgrade commons-io to 2.9.0 and resolve CVE
  • CCMSG-1356: Exclude unused netty-buffer library and resolve CVE
  • CCMSG-1357: Upgrade jetty-server to 9.4.43 and resolve CVE
  • CCMSG-1326: Enforce required columns from config schema
  • Upgrade commons-compress to 1.21 through parent and resolve CVE
  • CCMSG-1217: Update jersey-common to 2.34 through parent to resolve CVEs
  • CCMSG-1056: Upgrade json-smart to 2.4.7 through parent and resolve CVE
  • CCMSG-993: Bump parent dependency to 0.5.10
  • CC-14996: Upgrade hadoop common to 3.2.2 and exclude unused dependency jackson-xc to address CVE
  • Update the support term for SFTP
  • CCMSG-1031: Fix sink errors when buffered records are less than flush size
  • MINOR: Increase timeout on SFTP file check
  • CCMSG-1018: SFTP Source connector should close files properly on failure
  • CCMSG-972: Support NULL or empty value for optional field

Version 2.3.10

  • Fix licensing issue (remove java csv usage in CSV writer) (#78)

Version 2.3.9

  • [CCMSG-1357] Upgrade jetty-servlet to 9.4.43 and resolve CVE

Version 2.3.8

  • CCLOG-1197: Reduce log level of sensitive data to debug

Version 2.3.7

  • Exclude unused netty dependencies to resolve CVEs

Version 2.3.6

  • CCMSG-1331: Upgrade commons-io to 2.9.0 and resolve CVE
  • CCMSG-1357: Upgrade jetty-server to 9.4.43 and resolve CVE

Version 2.3.5

SFTP Source Connector

  • CCMSG-1326: Enforce required columns from config schema

Version 2.3.4

  • Upgrade parent to 0.5.14 and resolve CVE in commons compress dependency
  • CCMSG-1217: Update connect plugins common to 0.5.13 to resolve CVEs

Version 2.3.3

SFTP Sink Connector

  • CCMSG-1056: Upgrade json-smart to 2.4.7
  • CCMSG-993: Upgrade jersey-common to 2.34
  • CC-14996: Upgrade hadoop common to 3.2.2 and exclude unused dependency jackson-xc

SFTP Source Connector

  • CCMSG-1056: Upgrade json-smart to 2.4.7
  • CCMSG-993: Upgrade jersey-common to 2.34
  • CC-14996: Upgrade hadoop common to 3.2.2 and exclude unused dependency jackson-xc

Version 2.3.2

SFTP Sink Connector

  • CCMSG-1031: Fix errors when buffered records are less than flush size

SFTP Source Connector

  • CCMSG-1018: Improvement for closing files properly on failure

Version 2.3.1

SFTP Source Connector

  • CCMSG-972: Support for optional fields in CSV files

Version 2.3.0

SFTP Source Connector

  • CCMSG-954: Add support for binary files
  • CC-14511: Include details about source files in Kafka headers

Version 2.2.5

SFTP Source Connector

  • CCMSG-1018: Close files properly on failures
  • CCMSG-972: Support NULL or empty values for optional fields for CSV format

SFTP Sink Connector

  • CCMSG-1031: Fix errors when buffered records are less than flush size

Version 2.2.4

SFTP Sink Connector

  • CCMSG-17: Resolve connection leak in sink connector

Version 2.2.3

SFTP Source Connector

  • CCMSG-832: Resolve connection leak in source connector
  • CCMSG-450: Enable ITs on Jenkins

Version 2.2.2

  • Exclude jetty-http and jetty-security 9.3.24 and resolve CVE

Version 2.2.1

  • CCMSG-827: Resolve Google protobuf-java 2.5.0 CVE

Version 2.2.0

  • CCMSG-517: Upgrade storage-common to 10.0.4 and jackson databind to 2.10.5.1

Version 2.1.6

  • Update connect plugins common to 0.5.6

Version 2.1.5

SFTP Source Connector

  • CC-11703: Added support for Kerberos authentication to the SFTP server

Version 2.1.4

SFTP Source Connector

  • CC-12595: Added improvements for the SFTP connection to recover if the SFTP server is temporarily unavailable

Version 2.1.3

  • Addressed several CVE’s, internal dependency upgrades

Version 2.1.2

  • Addressed several CVE’s for Jackson, Jetty, Guava, Netty, and Beanutils

Version 2.1.1

SFTP Source Connector

  • CC-11402: Major improvements in performance as file count increases in input.path

Version 2.1.0

SFTP Source Connector

  • Added support for pemfile configuration tls.pemfile

SFTP Sink Connector

  • Added support for pemfile configuration tls.pemfile

Version 2.0.4

  • CCMSG-517: Upgrade parent dependency and Jackson Databind to 2.10.5.1

Version 2.0.3

  • Update connect plugins common to 0.5.5

Version 2.0.2

  • Update parent to 0.5.4 corresponding to CP 5.5.2 and fix CVEs
  • Address CVE’s for Jackson, Jetty, Guava, Netty, and Beanutils

Version 2.0.1

SFTP Source Connector

  • CC-11244: Major improvements for in-memory filepath storage
  • CC-9754: Added timezone configuration validation
  • CC-9012: Fixed incorrect schema message logging

Version 2.0.0

SFTP Source Connector

  • CC-8949: Fixed CsvSourceConnector to fill record.key on configured key.schema
  • CC-8931: Fixed SFTP Connector schema.generation.enabled flag config to be respected

Note

The schema.generation.enabled=true configuration has previously been disregarded for the CSV source connector. This fix will ensure that the schemas specified in key.schema and value.schema are properly used to build the record keys and values. In some deployments this fix might introduce a breaking change in record schemas and this should be taken into account before upgrading to this major version.

Version 1.1.0

SFTP Sink Connector

  • Added support for mutual TLS/SSL to SFTP Source and Sink connectors
  • CC-8809: Replaced assignment with topicPartitionWriters.keySet

SFTP Source Connector

  • Added support for mutual TLS/SSL to SFTP Source and Sink connectors
  • CC-8367: Fixed SFTP Source connector not ignoring error.path and finished.path sub-folders
  • CC-8123: Fixed race condition when deleting/re-creating a connector (using cleanup.policy MOVE or DELETE)

Version 1.0.4

SFTP Source Connector

  • CC-8121 and CC-8122: Fixed closing the SFTP connection
  • CC-8096: Fixed closing the output stream after file writes

Version 1.0.3

  • MINOR: Fixed Javadocs in order to run Connect release job

SFTP Source Connector

  • CC-8065: Fixed NPE for performing and closing cleanup policies

Version 1.0.2

  • CC-7395: Release SFTP Sink and Source connectors in PA

Version 1.0.1-preview

SFTP Source Connector

  • Bug fixes related to the SFTP connection channel and schema updates

Version 1.0.0-preview

SFTP Sink Connector

  • SFTP Sink connector implementation

SFTP Source Connector

  • SFTP Source connector implementation
  • Added support summary to prepare for release
  • SFTP source: Added Schema evaluation and behavior.on.error config