You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Could you explain what do 'lr_rampup_kimg', 'total_kimg', 'tick_kimg_default' and 'cur_nimg' mean in train.py respectively?
And what do 'resume_nimg' and 'cur_tick' mean in trainer.py?
And what is the function 'run' in trainer.py for?
The text was updated successfully, but these errors were encountered:
Hi,
to get the best grip, refer to the original implementation in theano. Basically, the original implementation instead of counting "iterations" or "epochs", only counts "nimg" or "kimg", which stand for number of images or thousands of images. So 1kimg = 1000nimg = 1000 images shown to the network during training.
That being said:
lr_rampup_kimg: how many kimg should learning rate "ramp up"
total_kimg for how many kimg in total should the network be trained
tick_kimg_default, so, this is only for logging purposes/doing stuff periodically. You can think of a "tick" as a sort of "iteration": a log line will be printed every tick. tick_kimg_default says "how many kimgs to show the network before the next tick". It is useful, because showing 100kimg to a small network is much faster than showing 100kimg to a full network (after full progressive growing). So you may want to print loss every 40kimg in the beginning, but move down to every 2kimg later on.
cur_nimg - well, current nimg.
resume_nimg - what is the initial value for nimg (this is used only when you resume training)
cur_tick - current tick
run method of trainer: this is the entrypoint. I think now that i may be kind of misleading, but I think I was following the convention of what used to be PyTorch Trainer class (now removed from PyTorch). Basically, .train() trains on one batch, while .run(3000) will run the whole training for 3000kimg.
Could you explain what do 'lr_rampup_kimg', 'total_kimg', 'tick_kimg_default' and 'cur_nimg' mean in train.py respectively?
And what do 'resume_nimg' and 'cur_tick' mean in trainer.py?
And what is the function 'run' in trainer.py for?
The text was updated successfully, but these errors were encountered: