Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make it possible for processor to return multiple records #636

Closed
hariso opened this issue Sep 15, 2022 · 3 comments
Closed

Make it possible for processor to return multiple records #636

hariso opened this issue Sep 15, 2022 · 3 comments
Labels
feature New feature or request
Milestone

Comments

@hariso
Copy link
Contributor

hariso commented Sep 15, 2022

Feature description

Currently, a processor accepts a single record as an input, and returns a single record as an output.

It would be good if the processor would return multiple records for the following reasons:

  • According to @ahmeroxa it's fairly when going to relational databases (e.g. from a denormalized to a normalized data model)
  • Some other tools use that too (e.g. Benthos), so doing a switch to Conduit would be easier.
@hariso hariso added feature New feature or request triage Needs to be triaged labels Sep 15, 2022
@meroxa-machine meroxa-machine moved this to Triage in Conduit Main Sep 15, 2022
@lovromazgon lovromazgon removed the status in Conduit Main Oct 24, 2022
@neovintage neovintage added this to the 0.7.0 milestone Apr 11, 2023
@simonl2002 simonl2002 moved this to Todo in Conduit Main Apr 24, 2023
@simonl2002 simonl2002 mentioned this issue Jun 12, 2023
11 tasks
@simonl2002 simonl2002 modified the milestones: 0.7.0, next Jul 18, 2023
@simonl2002 simonl2002 modified the milestones: 0.8.0, Future Jul 31, 2023
@simonl2002
Copy link
Member

@ahmeroxa is there a actual need for this currently? Otherwise going to delay this until after 0.8.0 when we will tackle splitting and combining records more wholistically.

@ahmeroxa
Copy link

@simonl2002 it's not currently blocking any active projects, so it can wait.

@simonl2002 simonl2002 modified the milestones: Future, Next Jul 31, 2023
@simonl2002 simonl2002 removed the status in Conduit Main Jul 31, 2023
@simonl2002 simonl2002 modified the milestones: Next, Future Aug 8, 2024
@lovromazgon
Copy link
Member

Done as part of #997.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
Status: Done
Development

No branches or pull requests

5 participants