Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automatic Handling of Data Stream Changes in Python Client #3042

Open
tenthe opened this issue Jul 17, 2024 · 0 comments · May be fixed by #3168
Open

Automatic Handling of Data Stream Changes in Python Client #3042

tenthe opened this issue Jul 17, 2024 · 0 comments · May be fixed by #3168
Assignees
@IsaakKrut
Labels
bug Something isn't working python Pull requests that update Python code

Comments

@tenthe
Copy link
Contributor

tenthe commented Jul 17, 2024

Body

Description

Currently, new data streams can be created in Python and registered in the backend. However, problems arise if the data streams change after a function restart, such as changes to the data stream name or properties in the event schema.

Expected Behavior

  • The Python client should automatically handle changes to data streams if possible.
  • If automatic handling is not possible, a warning should be displayed to the user.

Proposed Solution

  • Implement functionality similar to migration when changing adapters.
  • Add necessary functions to the REST API, such as updating data streams (PUT).

StreamPipes Committer

I acknowledge that I am a maintainer/committer of the Apache StreamPipes project.
@tenthe tenthe added bug Something isn't working python Pull requests that update Python code labels Jul 17, 2024
@IsaakKrut IsaakKrut self-assigned this Aug 20, 2024
IsaakKrut added a commit to IsaakKrut/streampipes that referenced this issue Aug 20, 2024
@IsaakKrut
apache#3042 added put method to Python client Endpoint
84d6082
IsaakKrut added a commit to IsaakKrut/streampipes that referenced this issue Aug 20, 2024
@IsaakKrut
apache#3042 added Put endpoint to Data Streams back-end
a594748
@IsaakKrut IsaakKrut linked a pull request Aug 20, 2024 that will close this issue
Open
IsaakKrut added a commit to IsaakKrut/streampipes that referenced this issue Aug 23, 2024
@IsaakKrut
apache#3042 added pipeline update
cfceff7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@IsaakKrut IsaakKrut

Labels
bug Something isn't working python Pull requests that update Python code
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

#3042 python client updating data stream IsaakKrut/streampipes
2 participants
@tenthe @IsaakKrut