Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix out of range exception issue of partitioned Kafka spout #15

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Conversation

binhnv
Copy link

@binhnv binhnv commented Sep 28, 2012

I modified KafkaUtils::emitPartitionBatchNew method to fix the out of range exception when fetch messages from Kafka's topic.
This issue happens when there is no previous status in Zookeeper and the beginning offset of Kafka's brokers is non-zero.

-Binh

…rtitioned Kafka topic. This issue happens when there isn't latest consumed offset in Zookeeper and the beginning offset of Kafka is non-zero
@rsurendra
Copy link

Any updates on this issue... Was this merged ?

@kaustubhpriye
Copy link

I dont think this would fix anything.
kafka.api.OffsetRequest.EarliestTime() = -2.
If we set startOffsetTime = kafka.api.OffsetRequest.EarliestTime(); // which is the default behaviour.
And set forceFromStart = true; // which is to be done in this case as well.

We could achieve same behaviour. Am I missing anything ?

@ersushantsood
Copy link

Does this issue still exist in Storm 1.0.1 , as i am running with Storm 1.0.1 and got the same issue when i accidently deleted the kafka partitions . I had to create a new topic to avoid this issue and redeploy the topology with new topic as I was just doing POC.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants