Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi MACE team,
I have added an argument
init_latest
. It is similar torestart_latest
but it only loads the model state_dict from the checkpoint. Thus, the training can start with a previous model but use a fresh new optimizer and lr_scheduler. In practice, it will also be useful in active learning as the later iterations can use previous models.Moreover, it will be much better to make
restart_latest
accept a checkpoint path instead of using the checkpoint in the training directory. However, this implementation will make a big change thus it may be implemented in the future if possible.All the best,
Jiayan