How to handle logs when each gpus logs are being printed instead of just one?

[vishalghor]

I am doing a multi-gpu training with deepspeed with basic use of deepsped only for distributed training as of now. I get the logs printed for each gpus after an epoch which makes it difficult to track the experiment using tensorboard or anyother logging tools