Important
You are viewing documentation for an older version of Confluent Platform. For the latest, click here.
Changelog¶
Version 4.1.1¶
Version 4.1.0¶
S3 Connector¶
- PR-150 - Make confluent CLI command output shared
- PR-148 - Rely on jackson.version from common pom instead of defining it ourselves
- PR-149 - Bump Jackson version
- PR-140 - Fix for BufferOverflowException in S3OutputStream
- PR-106 - Add s3.sse.kms.key.id to specify a particular key in AWS KMS
- PR-98 - Add gzip compression support for json and byte array formats
- PR-143 - Support for multiple fields in field partitioner
- PR-138 - CC-1490: NPE when rotate.interval.ms is set but partitioner is not instance of TimeBasedPartitioner
- PR-132 - CC-1214: Import all the AvroData configs to storage sink connectors
- PR-123 - CC-1299: Refactor this code to use the AVRO_CODEC config key from storage-common
- PR-114 - Update to PowerMock 2.0.x and Mockito 2
- PR-48 - RecordField nested timestamp extraction
- PR-57 - Issue-53. Multiple field support for partitioning.
- PR-55 - CC-1489: NPE on records with null timestamp.
- PR-45 - HOTFIX: Consider all the properties in AvroDataConfig.
- PR-52 - CC-1333: Remove dependency on hive-exec and instead use hive-exec:core
- PR-51 - CC-1333: Remove dependency on hive-exec and instead use hive-exec:core
- PR-50 - CC-1333: Remove dependency on hive-exec and instead use hive-exec:core
- PR-46 - CC-1299: Create AVRO_CODEC ConfigKey
Version 4.0.1¶
S3 Connector¶
- PR-148 - Rely on jackson.version from common pom instead of defining it ourselves
- PR-149 - Bump Jackson version
- PR-140 - Fix for BufferOverflowException in S3OutputStream
- PR-138 - CC-1490: NPE when rotate.interval.ms is set but partitioner is not instance of TimeBasedPartitioner
- PR-132 - CC-1214: Import all the AvroData configs to storage sink connectors
- PR-55 - CC-1489: NPE on records with null timestamp.
- PR-45 - HOTFIX: Consider all the properties in AvroDataConfig.
Version 4.0.0¶
S3 Connector¶
- PR-102 - Allow to write records at the root of the bucket
- PR-105 - Add instructions about upstream builds
- PR-97 - MINOR: S3 Proxy Settings revisited
- PR-103 - Remove unused imports
- PR-101 - Remove unused imports
- PR-85 - Add ByteArrayFormat
- PR-87 - Add s3.canned.acl config
- PR-84 - Create CONTRIBUTING.md
- PR-92 - CC-1114: Switch to common pom and fix checkstyle issues.
- PR-78 - Retry s3 part upload
- PR-80 - HOTFIX: Remove refs to schema-generator config.
- PR-60 - Add logging when creating a new RecordWriter
- PR-44 - HOTFIX: Remove unused parameter in newConfigDef for PartitionerConfig.
- PR-41 - HOTFIX: Update dependencies
- PR-40 - HOTFIX: Make specific dependencies explicit.
- PR-37 - Remove unused imports
- PR-35 - Add missing modules to the dependencyManagement pom section so downstream projects will inherit the right version automatically.
- PR-31 - Remove schema.generator.class config and have Formats specify their own SchemaGenerator internally
Version 3.3.1¶
S3 Connector¶
- PR-116 - HOTFIX: Add recommender for schema generator classes only on 3.3.x.
- PR-112 - CC-1244: 3.3.1 release notes
- PR-108 - HOTFIX: Handle primitive types in AvroFormat
- PR-104 - Fix new client creation to cater for URLs and region together
- PR-100 - CC-1167: Add recommenders for class type properties
- PR-90 - Add upstream project so build are triggered automatically
- PR-82 - CC-872: Update default part.size number in S3 docs and more.
- PR-77 - Update quickstart to use Confluent CLI.
- PR-43 - HOTFIX: Add recommender for schema generator classes only on 3.3.x.
- PR-39 - HOTFIX: Check simple class names in recommender.
- PR-38 - CC-1153: Isolate config instances and recommenders.
- PR-36 - CC-1153: Storage connectors can add recommendations for Class types
- PR-33 - Add upstream project so build are triggered automatically
Version 3.3.0¶
S3 Connector¶
- PR-28 - HOTFIX: Explicitly deactivate licensing profiles by default.
- PR-34 - CC-524: Reduce the default s3.part.size to 25MB to avoid OOM with current default jvm heap size.
- PR-33 - CC-513: Newline is not appended between records when using JsonFormat.
- PR-37 - Enable compression of output Avro files.
- PR-38 - CC-530: Exclude storage-common jars when packaging S3 connector.
- PR-19 - Move to using io.confluent:common for deps.
- PR-22 - HOTFIX: Import recent changes from the hdfs connector.
- PR-24 - Convert - to _ in Hive table names.
- PR-25 - Include causes with ConfigExceptions caused by catching other exceptions.
- PR-26 - Add constructors to SchemaGenerators to support no parameters and a Map config.
- PR-29 - Timestamp information should be copied to projected SinkRecord.
Version 3.2.2¶
S3 Connector¶
- PR-19 - CC-500: Provide exactly-once time-based partitioning in S3
- PR-45 - HOTFIX: S3SinkConnector should extend SinkConnector
- PR-51 - Allow custom partitioners to have their own configs
- PR-27 - HOTFIX: Include a trailing delimiter when verifying data format for Hive
- PR-23 - HOTFIX: Add test schema and record builder for records with timestamp field
- PR-18 - CC-497: Add timestamp based partitioners.
Version 3.2.1¶
S3 Connector¶
- PR-33 - Separate JSON records using line separator instead of single white space.
- PR-34 - Reduce the default s3.part.size to 25MB to avoid OOM exceptions with the current default java heap size settings for Connect.
- PR-32 - Add s3.region property to quickstart config and docs.
- PR-25 - flush.size doc fixes.