Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce v2 for sub-plans #428

Merged
merged 1 commit into from
Aug 24, 2023
Merged

Commits on Jul 21, 2023

  1. Introduce v2 for sub-plans

    The previous implementation of sub plans API comprised of several
    modules which could be layered on top of each other. This made the code
    somewhat hard to follow, not all of the modules worked in all scenarios
    as some relied on an executor being a single process.
    
    The v2 flattens all the modules into a single one and drastically
    reduces the amount of possible combinations. Sub plans are spawned in
    batches and then the parent polls until the sub plans finish.
    
    It also includes support for limitting the number of sub-plans that may
    be running at a given time, without relying on the throttle limitter and
    thus should be safe in multi-process environments. Under the hood it
    dynamically alters the batch size to honor the concurrency limit.
    adamruzicka committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    3d4d8e6 View commit details
    Browse the repository at this point in the history