Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate changing the way folds/scans work for concurrency #2828

Open
harendra-kumar opened this issue Aug 22, 2024 · 0 comments
Open

Investigate changing the way folds/scans work for concurrency #2828

harendra-kumar opened this issue Aug 22, 2024 · 0 comments
Labels
api:breaking Incompatible with existing releases aspect:api Related to api change aspect:folds
Milestone

Comments

@harendra-kumar
Copy link
Member

To make serial and concurrent folds work the same way, "step" function should just change the state and not return the Done/Partial status. The status should be returned independently by the "extract" function. That way for concurrent folds/scans we can just send the inputs in "step" and then gather the results in "extract" asynchronously. With this change we should be able to implement concurrent scan combinators in a modular way, in terms of parEval.

But this may have an impact on fusion characteristics of serial folds.

@harendra-kumar harendra-kumar added api:breaking Incompatible with existing releases aspect:folds aspect:api Related to api change labels Aug 22, 2024
@harendra-kumar harendra-kumar added this to the 0.12.0 milestone Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api:breaking Incompatible with existing releases aspect:api Related to api change aspect:folds
Projects
None yet
Development

No branches or pull requests

1 participant