Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

多机训练问题 #26

Open
cdj0311 opened this issue Oct 14, 2019 · 0 comments
Open

多机训练问题 #26

cdj0311 opened this issue Oct 14, 2019 · 0 comments

Comments

@cdj0311
Copy link

cdj0311 commented Oct 14, 2019

您好，感谢分享， 请教一个多机训练问题。
使用keras和tf.distribute.experimental.MultiWorkerMirroredStrategy()进行多机训练时，batch_size=batch_size * worker_num，那么输入的数据(tfrecord格式)需要切分成worker_num份吗？如果不切分，每个worker都读取所有的数据，这种分布式策略会不会自动对数据进行分发呢？
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@cdj0311