Skip to content
This repository has been archived by the owner on Dec 31, 2020. It is now read-only.

Implement event-time ordering #13

Open
EronWright opened this issue Apr 2, 2016 · 2 comments
Open

Implement event-time ordering #13

EronWright opened this issue Apr 2, 2016 · 2 comments

Comments

@EronWright
Copy link
Collaborator

It is possible for events to arrive out-of-order into the HTM operator. We should reorder the events using an internal queue, using the watermark to make progress.

See the flink-cep library for an example of this: CEPPatternOperator.

@cogmission
Copy link
Member

HTM. Java sensors index every element. This was preparation for parallel decoding which hasn't been turned on; but is present. Maybe you should consider going through the sensor layer because it does a lot for you?

Though I was thinking, if the data is out of order before it reaches htm.java - then Sensor indexing won't help?

@EronWright
Copy link
Collaborator Author

@cogmission reordering must be done at the Flink layer, using the event time information and watermarks.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants