Changelog

Version 2.1.0

  • GH-80 (PR-84): Add support for configuring time partitioning type on created tables. See the timePartitioningTypeconfiguration properties.
  • PR-61: Expand support for time-partitioned tables to allow connector to write to HOUR-, MONTH-, and YEAR-partitioned tables.

Version 2.0.0

  • CCDB-3674: Make IdentitySchemaRetriever the default schema retriever for BigQuery 2.0.0
  • CC-8803 - Add support for upsert/delete through periodic merge flushes. See the following configuration properties:
    • upsertEnabled
    • deleteEnabled
    • intermediateTableSuffix
    • mergeIntervalMs
    • mergeRecordsThreshold
  • PR-291 - Generalize schema retriever (see Upgrading to 2.0.0)
  • PR-28 - Add allowSchemaUnionization config property

Version 1.6.1

  • PR-246 - CC-7246: add ability to partition based on timestamp of a record value field
  • PR-244 - Added configuration to add/remove partition decorator for BigQuery inserts
  • PR-237 - Add support for handling empty schemas and records
  • PR-231 - change log level for BigQuery exception to WARN

Version 1.5.2

  • PR-220 - CC-7399: Handle null value if schema-less record has a map with a null value
  • PR-215 - Use batch delete operation when cleaning up blob ids

Version 1.3.0

  • PR-198 - Log errors encountered when writing batches
  • PR-192 - Log topic and table name when a row fails to be inserted into BQ
  • PR-191 - Added keyFileType field to connector configs
  • PR-188 - Add Support for Schemaless Record
  • PR-187 - Add field name Sanitization
  • PR-172 - Handle xargs and basename on linux
  • PR-170 - Fix gcs load retry logic
  • PR-168 - Support Java 11

Version 1.2.0

  • PR-167 - Upgrade google-cloud version
  • PR-164 - Add prefix/folder related configuration
  • PR-159 - Await termination on correct executor

Version 1.1.2

  • PR-161 - Prevent context update after/while rebalancing

Version 1.1.0

Initial version