posts/2013/04/08/quickly-transfer-files-between-servers/

[giscus[bot]]

posts/2013/04/08/quickly-transfer-files-between-servers/

When transferring files between systems usually rsync or scp are all that is needed. Sometimes, there are difficult edge cases. For example using rsync to transfer many files spread across 1000s of directories quickly. Recently, I needed to move several TB worth of files in varying size spread across 1000s of directories. I found that rsync spent most of the time traversing directories and not copying the data. I turned to the webs to find a better solution.

https://www.devopsderek.com/posts/2013/04/08/quickly-transfer-files-between-servers/

[derektamsen]

It should be 'du -sb' not 'du -sh' because pv wants the size units in bytes.

Dan

[derektamsen]

Thanks for catching that. I have fixed it in the article