New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练时间 #59

Open

Nastu-Ho opened this issue Aug 8, 2023 · 0 comments

Nastu-Ho commented Aug 8, 2023

作者您好，在1-shot的setting下，您是：
1.训练完一个split后，接着训练另外一个split，直到4个split训练完；
还是：
2. 4个split一起训练，每个split各占一张GPU；

我觉得按照第一种方式，训完4个split需要的很长时间，
但我尝试第二种方法，4个split一起训练，每个split占用一张GPU，4个程序都启动后训练速度都会下降

请问您有没有更加高效的训练策略

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment