Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is scaling strategy 4a unnecessary? #3566

Open
benclifford opened this issue Aug 5, 2024 · 0 comments
Open

is scaling strategy 4a unnecessary? #3566

benclifford opened this issue Aug 5, 2024 · 0 comments
Labels

Comments

@benclifford
Copy link
Collaborator

Scaling strategy case 4a scales up by 1 block in certain circumstances.

it triggers after case 2b which is a different scale-up-by-many-blocks, which overlaps in many situations: so in many situations, case 2b will fire in prefererence to 4a.

What are the situations when case 2b will fire?

I think only when parallelism is 0, there are no blocks running, and there are active tasks. But in the parallelism = 0 case, it is arguable that parsl shouldn't be doing any scaling: it should be running only min_blocks blocks, always.

Adding 1 block is probably not the right thing to be doing here - the scaling code should be (but I don't think actually does) maintain min_blocks at all times (whether there are tasks or not), whatever the load - see #3071 for some more discussion relevant to this.

@benclifford benclifford added the bug label Aug 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant