Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consuming from multiple Kinesis Streams #33

Open
sap2105 opened this issue Nov 8, 2018 · 1 comment
Open

Consuming from multiple Kinesis Streams #33

sap2105 opened this issue Nov 8, 2018 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@sap2105
Copy link

sap2105 commented Nov 8, 2018

Hi,
I have a consumer application which needs to connect/consume from multiple Kinesis Streams.
However, using this library, I see that we can consume from only a single stream.
While trying to read from multiple Kinesis stream I got the following error:
Caused by: org.apache.spark.sql.kinesis.shaded.amazonaws.services.kinesis.model.AmazonKinesisException: 1 validation error detected: Value 'Stream_1,Stream_2' at 'streamName' failed to satisfy constraint: Member must satisfy regular expression pattern: [a-zA-Z0-9_.-]+ (Service: AmazonKinesis; Status Code: 400; Error Code: ValidationException; Request ID: f5bf9ad6-471f-17d7-a1e2-f6de108bdde7)

Could you shed some light on how we can mention multiple streams or if that is even possible from the same consumer?

Thanks in advance.

@itsvikramagr itsvikramagr added enhancement New feature or request good first issue Good for newcomers labels Nov 9, 2018
@itsvikramagr
Copy link
Contributor

@sap2105 - The library currently supports single stream. We need to make changes to handle multiple streams. Would you be interested in working on it and raising a PR?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants