Skip to content

Releases: flatironinstitute/disBatch

3.0

05 Dec 16:33
Compare
Choose a tag to compare

Version 3 improves the installation of disBatch and adds a few new features and fixes. It should only be a breaking upgrade for users directly importing disBatch from Python (use import disbatch instead of import disbatchc), or for users calling the disBatch script that used to be in the repo root (install the package then use the disBatch executable on the PATH).

This is our first release on PyPI.

Breaking changes

  • The Python package has been renamed disbatch from disbatchc
  • Removed the disBatch script from the repo root. Instead, a disBatch command will be placed on the PATH upon installation, or see the installation instructions for other options.

Fixes

  • disBatch now installs all the necessary helper files so out-of-place installs work
  • Bugs (e.g. misspelled variables) in less common code paths fixed

Enhancements

  • PEP518 compliant build system
  • More robust discovery of disBatch installation by worker processes
  • Initial release on PyPI
  • uvx and pipx support
  • Set up linting and formatting
  • The executable can be invoked as disbatch or disBatch
  • Refreshed the readme
  • Added disbatch --version and disbatch.__version__
  • Added MacOS test
  • Added --fail-fast option [#38]
  • Gracefully handle empty task list [#37]

Changes

  • kvsstcp submodule is now vendored

2.6

15 Apr 18:51
Compare
Choose a tag to compare
2.6
  • Task commands are now represented verbatim in the status file---no quoting. To parse the status file, simply split into a fixed number of fields using the tab character. The contents of the last field will be the command
  • Added environment variables with zero-padding as a convenience for when they are used to create file names
  • Changed to "disbatchc" directory name to support case-insensitive platforms like Mac OS X
  • Added option to specify the network address to be used internally by disBatch---some platforms self identify with something funky, when "localhost:0" would be more appropriate
  • Added wait_for_one() method to disBatcher class
  • Bug fixes
  • Optimized internal monitoring to scale better
  • Added throttle to reduce load on SLURM when retiring nodes
  • When using SLURM, start internal management processes via srun for better integration
  • When using SLURM, SLURM_CPU_BIND=cores and SLURM_MPI_TYPE=none are now defaults

2.5

12 Dec 23:06
abee403
Compare
Choose a tag to compare
2.5

Major changes since 2.0:

  • Simplify installation and running directly from a git check out.
  • Better handling of inconsistencies in options when used with SLURM.
  • "--fill" option to make use of allocated resources that exceed request resources.
  • Added mechanism for customizing options for internal srun invocations when using SLURM.
  • The python object encapsulation, disBatcher, can now start its own disBatch server.

Full Changelog: 2.0...2.5

2.0-rc3

16 Sep 18:28
Compare
Choose a tag to compare

Switched from using the fix path mechanism to using an environment variable for determining where disBatch components live.

2.0-rc2

13 Jul 20:25
Compare
Choose a tag to compare
2.0-rc2 Pre-release
Pre-release

disBatch with dynamic engine management.

This release candidate includes a more robust monitor utility.