Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proper multi-threading #70

Open
aimalz opened this issue Mar 6, 2018 · 1 comment
Open

Proper multi-threading #70

aimalz opened this issue Mar 6, 2018 · 1 comment
Assignees

Comments

@aimalz
Copy link
Owner

aimalz commented Mar 6, 2018

My tests currently run in parallel via external scripts, not using an inherent chippr mode. The reason is that the function that evaluates the posterior over n(z) is not pickleable, so emcee multi-threading doesn't work. This issue is for either choosing a sampler that somehow doesn't care about this shortcoming (I suspect there may not be such a thing) or making the function pickleable. It's a low priority for the scopes of paper 0 (the model and proof of concept) and paper 1 (demonstration on toy test cases) but essential for paper 2 (more realistic and/or real data at scale).

@aimalz
Copy link
Owner Author

aimalz commented Oct 16, 2018

Note: I will check if I can use dill/pathos/pyina to resolve this issue.

@aimalz aimalz added this to the Final analysis milestone Aug 16, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant