Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More quality-of-life improvements: Exp/Eval/Gen limits, and soft limits #240

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

guicho271828
Copy link

@guicho271828 guicho271828 commented Jan 14, 2025

This commit adds separate limits for expansion / evaluaiton / generations, and soft limits.

Soft limit addresses the limitation of hard limits (e.g. max_time) that one limit interferes another. For example, when max_eval = 100k and max_time = 5 sec, majority of runs are cut off before reaching 100k evaluations, and the result is not an appropriate representation of running 100k evaluations. To measure the evaluations and time separately, therefore one would run two separate experiments, which is a waste of compute for instances solved by both. Instead of running them separately, this option allows one to run the union of the two configurations which can be later filtered to produce distinct tables/figures.

(Tbh I was surprized that FD does not have this feature yet.)

@guicho271828 guicho271828 changed the title Flexible limitsMore quality-of-life improvements: Exp/Eval/Gen limits, and soft limits More quality-of-life improvements: Exp/Eval/Gen limits, and soft limits Jan 14, 2025
@guicho271828
Copy link
Author

If you are eager to add a class for representing the limits, I can do that too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant