The Schwimmbad

schwimmbad provides a uniform interface to parallel processing pools and enables switching easily between local development (e.g., serial processing or with multiprocessing) and deployment on a cluster or supercomputer (via, e.g., MPI or JobLib).

Installation

The easiest way to install is via pip:

pip install schwimmbad

See the installation instructions in the documentation for more information.

Documentation

The documentation for schwimmbad is hosted on Read the docs.

DNA Storage Changes

• schwimmbad/mpi.py changed to support communicators to allow for MPI communicator groups on a given task. For DNA storage, provides power for pipeline pieces to utilize MPI parallelization. Immediately useful for strand-grain parallelization, could be useful for clustering algorithms.
• schwimmbad/__init__.py changed to allow pool interface to return mpi pool object that is configured for task based parallelism.

Attribution

If you use this software in a scientific publication, please cite the JOSS article:

@article{schwimmbad,
  doi = {10.21105/joss.00357},
  url = {https://doi.org/10.21105/joss.00357},
  year  = {2017},
  month = {sep},
  publisher = {The Open Journal},
  volume = {2},
  number = {17},
  author = {Adrian M. Price-Whelan and Daniel Foreman-Mackey},
  title = {schwimmbad: A uniform interface to parallel processing pools in Python},
  journal = {The Journal of Open Source Software}
}

License

Copyright 2016-2021 the contributors.

schwimmbad is free software made available under the MIT License. For details see the LICENSE file.