public class UsePartitionTimeOnInvalidTimestamp extends Object
Embedded metadata timestamp was introduced in "KIP-32: Add timestamps to Kafka message" for the new 0.10+ Kafka message format.
Here, "embedded metadata" refers to the fact that compatible Kafka producer clients automatically and transparently embed such timestamps into message metadata they send to Kafka, which can then be retrieved via this timestamp extractor.
If the embedded metadata timestamp represents CreateTime (cf. Kafka broker setting
message.timestamp.type and Kafka topic setting
this extractor effectively provides event-time semantics.
If LogAppendTime is used as broker/topic setting to define the embedded metadata timestamps,
using this extractor effectively provides ingestion-time semantics.
If you need processing-time semantics, use
|Constructor and Description|
|Modifier and Type||Method and Description|
Extracts the embedded metadata timestamp from the given
Returns the current stream-time as new timestamp for the record.
public long onInvalidTimestamp(org.apache.kafka.clients.consumer.ConsumerRecord<Object,Object> record, long recordTimestamp, long partitionTime) throws StreamsException
record- a data record
recordTimestamp- the timestamp extractor from the record
partitionTime- the highest extracted valid timestamp of the current record's partition˙ (could be -1 if unknown)
StreamsException- if highest extracted valid timestamp is unknown
public long extract(org.apache.kafka.clients.consumer.ConsumerRecord<Object,Object> record, long partitionTime)