Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GitHub action to push image to Quay.io #10

Merged
merged 2 commits into from
Aug 20, 2024

Conversation

katheris
Copy link
Collaborator

  • Add GitHub action to push image to Quay.io.
  • Update instructions to make image build optional.

@katheris
Copy link
Collaborator Author

@MikeEdgar could you create the data-generator repository in quay?

* Add GitHub action to push image to Quay.io.
* Update instructions to make image build optional.

Signed-off-by: Katherine Stanley <[email protected]>
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
@MikeEdgar
Copy link
Member

@MikeEdgar could you create the data-generator repository in quay?

@katheris , can we call it flink-data-generator ? There is also a console-datagen in StreamsHub.

.github/workflows/integration.yaml Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
recommendation-app/data-generator.yaml Outdated Show resolved Hide resolved
@SamBarker
Copy link
Collaborator

@MikeEdgar could you create the data-generator repository in quay?

@katheris , can we call it flink-data-generator ? There is also a console-datagen in StreamsHub.

I don't have a problem with flink-data-generator but do we really need two different data generators?

@MikeEdgar
Copy link
Member

I don't have a problem with flink-data-generator but do we really need two different data generators?

Ultimately, probably not. I see that this one is using Avro to generate data and the one we developed for the console is meant to generate variable producer/consumer traffic to put interesting data in the console's metrics graphs.

@SamBarker
Copy link
Collaborator

Build is timing out waiting for someone to agree to install the packages 😬 need to add a -y to the microdnf commands to say yes we do mean it.

README.md Outdated Show resolved Hide resolved
* Update cert-manager and flink operator versions.
* Update data-generator image name to flink-examples-data-generator.
* Add missing -y to microdnf update command.

Signed-off-by: Katherine Stanley <[email protected]>
@katheris
Copy link
Collaborator Author

I don't have a problem with flink-data-generator but do we really need two different data generators?

Ultimately, probably not. I see that this one is using Avro to generate data and the one we developed for the console is meant to generate variable producer/consumer traffic to put interesting data in the console's metrics graphs.

The data generator in this repo is designed specifically to generate data for the examples in this repo, I avoided creating a generic data generator, as there are already other examples of generic data generators for Kafka. I've gone with the name flink-examples-data-generator so it's very clear what it is for.
@MikeEdgar @SamBarker does that work for you?

Copy link
Member

@MikeEdgar MikeEdgar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, quay.io/streamshub/flink-examples-data-generator is created.

@SamBarker
Copy link
Collaborator

I'm not going to hold up anything over it but I do think it's odd to have two unrelated data generators in the same organisation. And yes I get that they have different goals today but I would expect they could be unified into a single tool which could service the needs of both.

@katheris katheris merged commit 2282851 into streamshub:main Aug 20, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants