Low accuracy for HMDB51

[hongbo-miao]

I am getting accuracy less than 1% for dataset HMDB51. I only ran 3 epochs. However this is still too low.
The default learning rate 1e-3 has this issue #8, tried 1e-4 and 1e-5, it works but getting very low accuracy.
Our experiment parameters and results are at W&B: https://wandb.ai/stanford-action-recognition/ar

Similar issues and some helpful info inside:
jfzhang95/pytorch-video-recognition#32
jfzhang95/pytorch-video-recognition#50
jfzhang95/pytorch-video-recognition#23

[hongbo-miao]

Only happens for C3D model.

[z369437558]

我也是同样问题