Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrating data between Unifyfs servers #728

Open
hariharan-devarajan opened this issue Aug 4, 2022 · 0 comments
Open

Migrating data between Unifyfs servers #728

hariharan-devarajan opened this issue Aug 4, 2022 · 0 comments

Comments

@hariharan-devarajan
Copy link
Member

Describe the problem you're observing

In the case of producer-consumer workloads where a subset of producers produce and then another subset of processes on a different set of nodes consume, currently the reading of consumers is bottlenecked by the unifyfs server which holds the data (generally the set of nodes where data was produced).

We can add a migration step between the unifyfs servers to migrate this data closer to the consumers so that they can access data node-locally instead of remote access.

@hariharan-devarajan hariharan-devarajan changed the title MIgrating data between unifyfs servers Migrating data between Unifyfs servers Aug 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants