You are viewing documentation for an older version of Confluent Platform. For the latest, click here.
Kafka Connect Transformations¶
Transformations included with Kafka Connect are shown below:
|Cast||Cast fields or the entire key or value to a specific type, e.g. to force an integer field to a smaller width.|
|ExtractField||Extract the specified field from a Struct when schema present, or a Map in the case of schemaless data. Any null values are passed through unmodified.|
|Flatten||Flatten a nested data structure. This generates names for each field by concatenating the field names at each level with a configurable delimiter character.|
|HoistField||Wrap data using the specified field name in a Struct when schema present, or a Map in the case of schemaless data.|
|InsertField||Insert field using attributes from the record metadata or a configured static value.|
|MaskField||Mask specified fields with a valid null value for the field type.|
|RegexRouter||Update the record topic using the configured regular expression and replacement string.|
|ReplaceField||Filter or rename fields.|
|SetSchemaMetadata||Set the schema name, version, or both on the record’s key or value schema.|
|TimestampConverter||Convert timestamps between different formats such as Unix epoch, strings, and Connect Date and Timestamp types.|
|TimestampRouter||Update the record’s topic field as a function of the original topic value and the record timestamp.|
|ValueToKey||Replace the record key with a new key formed from a subset of fields in the record value.|
You can configure Java streams applications to deserialize and ingest data in multiple ways, including Kafka console producers, JDBC source connectors, and Java client producers. For full code examples, see connect-streams-pipeline.