Releases: flatironinstitute/disBatch
Releases · flatironinstitute/disBatch
3.0
Version 3 improves the installation of disBatch and adds a few new features and fixes. It should only be a breaking upgrade for users directly importing disBatch from Python (use import disbatch
instead of import disbatchc
), or for users calling the disBatch
script that used to be in the repo root (install the package then use the disBatch
executable on the PATH
).
This is our first release on PyPI.
Breaking changes
- The Python package has been renamed
disbatch
fromdisbatchc
- Removed the
disBatch
script from the repo root. Instead, adisBatch
command will be placed on thePATH
upon installation, or see the installation instructions for other options.
Fixes
- disBatch now installs all the necessary helper files so out-of-place installs work
- Bugs (e.g. misspelled variables) in less common code paths fixed
Enhancements
- PEP518 compliant build system
- More robust discovery of disBatch installation by worker processes
- Initial release on PyPI
- uvx and pipx support
- Set up linting and formatting
- The executable can be invoked as
disbatch
ordisBatch
- Refreshed the readme
- Added
disbatch --version
anddisbatch.__version__
- Added MacOS test
- Added
--fail-fast
option [#38] - Gracefully handle empty task list [#37]
Changes
kvsstcp
submodule is now vendored
2.6
- Task commands are now represented verbatim in the status file---no quoting. To parse the status file, simply split into a fixed number of fields using the tab character. The contents of the last field will be the command
- Added environment variables with zero-padding as a convenience for when they are used to create file names
- Changed to "disbatchc" directory name to support case-insensitive platforms like Mac OS X
- Added option to specify the network address to be used internally by disBatch---some platforms self identify with something funky, when "localhost:0" would be more appropriate
- Added wait_for_one() method to disBatcher class
- Bug fixes
- Optimized internal monitoring to scale better
- Added throttle to reduce load on SLURM when retiring nodes
- When using SLURM, start internal management processes via srun for better integration
- When using SLURM, SLURM_CPU_BIND=cores and SLURM_MPI_TYPE=none are now defaults
2.5
Major changes since 2.0:
- Simplify installation and running directly from a git check out.
- Better handling of inconsistencies in options when used with SLURM.
- "--fill" option to make use of allocated resources that exceed request resources.
- Added mechanism for customizing options for internal srun invocations when using SLURM.
- The python object encapsulation, disBatcher, can now start its own disBatch server.
Full Changelog: 2.0...2.5
2.0-rc3
Switched from using the fix path mechanism to using an environment variable for determining where disBatch components live.
2.0-rc2
disBatch with dynamic engine management.
This release candidate includes a more robust monitor utility.