.. _hdfs_connector_changelog: Changelog ========= Version 5.4.0 ------------- * `PR-460 `_ - CC-6423: Disable FileSystem Object Caching * `PR-456 `_ - CC-6196: fix NPE for store.url config * `PR-451 `_ - CC-6089: Improve fault tolerance of HDFS sink connector * `PR-450 `_ - CC-5969: Pass extra connector configs to the partitioner * `PR-442 `_ - Adding debug logs for WAL recovery * `PR-440 `_ - Remove jackson databind version override * `PR-114 `_ - CC-147: logical types support for HiveSchemaConverter * `PR-116 `_ - CC-6565: Add parquet.codec property to enable compression in storage sink connectors * `PR-110 `_ - CC-5963: Improved ability to handle schema evolution with different names Version 5.2.0 ------------- * `PR-422 `__ - CC-4124: Clear partition assignment on close * `PR-417 `__ - CC-3950: Change the HDFS sink task to return to Connect offsets for records committed to HDFS Version 5.1.0 ------------- * `PR-357 `__ - Fix checkstyle to pass on 8.5 after upgrade from 6.19 Version 5.0.0 ------------- * `PR-63 `__ - DataUtils::getField returns field Version 4.1.2 ------------- * `PR-335 `__ - MINOR: Fix the secure HDFS test Version 4.1.1 ------------- * `PR-307 `__ - CC-918 Add |kconnect-long| Maven plugin to build Version 4.1.0 ------------- * `PR-299 `__ - CC-1669: Set no offset when no offset was found for topic partition * `PR-293 `__ - Explicitly specify Jackson version instead of relying on transitive dependency version. * `PR-283 `__ - Adding StringFormat to available formatters * `PR-286 `__ - Support for multiple fields in field partitioner * `PR-269 `__ - Fix or suppress findbugs errors * `PR-255 `__ - CC-1299: Add configuration setting for Avro compression codec * `PR-48 `__ - RecordField nested timestamp extraction * `PR-57 `__ - Issue-53. Multiple field support for partitioning. * `PR-55 `__ - CC-1489: NPE on records with null timestamp. * `PR-45 `__ - HOTFIX: Consider all the properties in AvroDataConfig. * `PR-52 `__ - CC-1333: Remove dependency on hive-exec and instead use hive-exec:core * `PR-51 `__ - CC-1333: Remove dependency on hive-exec and instead use hive-exec:core * `PR-50 `__ - CC-1333: Remove dependency on hive-exec and instead use hive-exec:core * `PR-46 `__ - CC-1299: Create AVRO_CODEC ConfigKey Version 4.0.1 ------------- * `PR-305 `__ - CC-1669: Disable commit of consumer offsets * `PR-299 `__ - CC-1669: Set no offset when no offset was found for topic partition * `PR-293 `__ - Explicitly specify Jackson version instead of relying on transitive dependency version. * `PR-55 `__ - CC-1489: NPE on records with null timestamp. * `PR-45 `__ - HOTFIX: Consider all the properties in AvroDataConfig. Version 4.0.0 ------------- * `PR-251 `__ - CC-1270: Reinstantiate HiveConfig properties in getConfig. * `PR-247 `__ - MINOR: Exclude storage common dependencies. * `PR-246 `__ - CC-1213: Enable record based timebased partitioners in HDFS connector * `PR-245 `__ - CC-1212: Accept partitioners implementing the new partitioner interface * `PR-243 `__ - CC-1168: Recommenders for HDFS connector's class type properties * `PR-237 `__ - Remove unused imports * `PR-196 `__ - CC-492: Add JsonFormat to HDFS Connector * `PR-142 `__ - not trying to hold leases on WAL files if we are holding them already. * `PR-220 `__ - HOTFIX: Enable default for format and storage classes in hdfs connector * `PR-219 `__ - Move to common pom * `PR-188 `__ - CC-397: Refactoring on top of storage-common * `PR-214 `__ - fix TimeBasedPartitionerTest by defining the expected locale * `PR-212 `__ - Remove invalid offset check. * `PR-44 `__ - HOTFIX: Remove unused parameter in newConfigDef for PartitionerConfig. * `PR-41 `__ - HOTFIX: Update dependencies * `PR-40 `__ - HOTFIX: Make specific dependencies explicit. * `PR-37 `__ - Remove unused imports * `PR-35 `__ - Add missing modules to the dependencyManagement pom section so downstream projects will inherit the right version automatically. * `PR-31 `__ - Remove schema.generator.class config and have Formats specify their own SchemaGenerator internally Version 3.3.1 ------------- * `PR-235 `__ - CC-1172: Fix memory leak in TopicPartitionerWriter * `PR-227 `__ - Specify a nodeLabel for Jenkins that doesn't die during the HDFS connector tests. * `PR-226 `__ - Add upstream project so builds will be triggered automatically * `PR-217 `__ - Update quickstart to use Confluent CLI Version 3.3.0 ------------- * `PR-187 `__ - CC-491: Consolidate and simplify unit tests of HDFS connector. * `PR-205 `__ - Upgrade avro to 1.8.2. Version 3.2.2 ------------- * `PR-194 `__ - Fix HdfsSinkConnector to extend from SinkConnector instead of Connector. * `PR-200 `__ - Fix incorrect licensing and webpage info. Version 3.2.1 ------------- No changes Version 3.2.0 ------------- * `PR-135 `__ - Fix typos * `PR-164 `__ - Issue 136 - Support topic with dots in hive. * `PR-170 `__ - MINOR: Upgrade Hadoop version to 2.7.3 and joda-time to 2.9.7 Version 3.1.1 ------------- No changes Version 3.1.0 ------------- * `PR-134 `__ - Flush the last partial file when incoming stream is paused. * `PR-133 `__ - CC-331: Update config options docs * `PR-126 `__ - Fix TimeBasedPartitioner config validation * `PR-112 `__ - Lint change to avoid compiler error in Oracle JDK 1.7 using jenv. * `PR-94 `__ - Fix lint annoyances * `PR-108 `__ - Revert "support multi partition fields." * `PR-105 `__ - support multi partition fields. * `PR-101 `__ - Added link to Confluent documentation for the connector. * `PR-92 `__ - Start a new WAL file after `truncate` instead of appending to log.1 * `PR-87 `__ - Scheduled rotation implementation * `PR-90 `__ - Use configured Hadoop configuration object for Parquet writer * `PR-91 `__ - Upgrade to Hadoop 2.6.1 * `PR-70 `__ - Fix handling of topics with periods * `PR-68 `__ - prints details of HDFS exceptions * `PR-67 `__ - clean up hive metastore artifacts from testing * `PR-64 `__ - cleaned up .gitignore. Now ignores Eclipse files Version 3.0.1 ------------- HDFS Connector ~~~~~~~~~~~~~~ * `PR-82 `__ - add version.txt to share/doc Version 3.0.0 ------------- HDFS Connector ~~~~~~~~~~~~~~ * `PR-62 `__ - Update doc for Confluent Platform 3.0. * `PR-60 `__ - Remove HDFS connectivity check. * `PR-55 `__ - Removing retry logic from HiveMetaStore to fix the metastore connection bloat. * `PR-50 `__ - Remove close of topic partition writers in DataWriter close. * `PR-42 `__ - Using new config validation. * `PR-41 `__ - Bump version to 3.0.0-SNAPSHOT and |ak-tm| dependency to 0.10.0.0-SNAPSHOT. * `PR-35 `__ - Minor doc typo fix TimeBasedPartitioner. * `PR-33 `__ - Minor doc fix.