Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

performance: use unix domain sockets between htex submit side and interchange #3595

Open
benclifford opened this issue Aug 19, 2024 · 0 comments

Comments

@benclifford
Copy link
Collaborator

Is your feature request related to a problem? Please describe.

ZMQ supports unix domain sockets, when both ends of the connection are on the same host. That is the case for the workflow submit process and interchange.

Raw performance for this sockets can be much higher than TCP-over-loopback, which is how these two processes communicate now. For example, see https://stackoverflow.com/questions/14973942/tcp-loopback-connection-vs-unix-domain-socket-performance

It should be straightforward to try out, and less straightforward to benchmark, if this has any noticeable effect on interchange performance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant