Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extracted timestamp value is negative, which is not allowed. #128

Open
machty opened this issue Feb 14, 2017 · 6 comments
Open

Extracted timestamp value is negative, which is not allowed. #128

machty opened this issue Feb 14, 2017 · 6 comments

Comments

@machty
Copy link

machty commented Feb 14, 2017

I'm trying to use Kafka-Streams to parse the data I've loaded into Kafka using Postgres and I'm getting

Exception in thread "StreamThread-1" org.apache.kafka.streams.errors.StreamsException: Extracted timestamp value is negative, which is not allowed.
        at org.apache.kafka.streams.processor.internals.RecordQueue.addRawRecords(RecordQueue.java:111)
        at org.apache.kafka.streams.processor.internals.PartitionGroup.addRawRecords(PartitionGroup.java:117)
        at org.apache.kafka.streams.processor.internals.StreamTask.addRecords(StreamTask.java:143)
        at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:415)
        at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242)

I found the following link http://docs.confluent.io/3.1.0/streams/faq.html#invalid-timestamp-exception

Am I possibly seeing this error because bottlewater was built for 0.9 and doesn't have proper timestamps for 0.10?

@machty
Copy link
Author

machty commented Feb 15, 2017

FYI I "fixed" this by specifying a TIMESTAMP_EXTRACTOR_CLASS_CONFIG of 'org.apache.kafka.streams.processor.WallclockTimestampExtractor' in the consumer.

That said I'd still like to figure out what could/should change about BW to include timestamp information, otherwise we're limited to at-processing timestamps only (which is what the setting above accomplishes).

@mmaia
Copy link

mmaia commented Jul 31, 2017

Thanks @machty - this solution worked for me also.

@Asiddiki
Copy link

Asiddiki commented Aug 5, 2017

Thanks @machty - Above solution also worked for me.

@postelrich
Copy link

Which config file do you add this to and what's the exact line?

@machty
Copy link
Author

machty commented Apr 25, 2018

Honestly I have no idea, never really stuck with this learning Kafka. I'd recommend you check out debezium rather than bottledwater though.

@parth22594
Copy link

Thanks @machty. Above solution worked for me as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants