Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

training stops in colab #34

Open
ghost opened this issue Apr 24, 2019 · 4 comments
Open

training stops in colab #34

ghost opened this issue Apr 24, 2019 · 4 comments

Comments

@ghost
Copy link

ghost commented Apr 24, 2019

I am using these parameters python train.py --batch_size 4 --exp TEST --frame_sizes 16 4 --n_rnn 2 --dataset piano
and training stops in colab with ^C automatically

@michaelybecker
Copy link

I'm able to train a bespoke model on colab just fine. Training continues until stopped or until the Colab hits the 12 hour limit (when it expires). Samples get generated every once in a while (end of epoch, I think). Can you elaborate on your problem?

@ghost
Copy link
Author

ghost commented Nov 18, 2019

@MichaelHazani can you share your colab notebook?

@michaelybecker
Copy link

michaelybecker commented Nov 19, 2019

@ak9250 Sure, here's a reference Colab notebook I just made:
https://colab.research.google.com/drive/1tc2fzngIsnRt-ut21W7ADlU3yUzUqtw0
(only ran the RNN for a few seconds to make sure it's working)

@phatmann
Copy link

@MichaelHazani do you have an updated version of the notebook?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants