Skip to content

unidist 0.3.0

Compare
Choose a tag to compare
@YarShev YarShev released this 22 Mar 16:27
· 75 commits to master since this release
b133787

This release contains a few performance enhancements for MPI backend,
the renaming of backends "multiprocessing" to "pymp" and "python" to "pyseq",
includes a couple of important updates for documentation and multiple bugfixes.

Key Features and Updates

  • Stability and Bugfixes
    • FIX-#170: Fix serialization/deserialization for Ray actors (#171)
    • FIX-#172: Fix serialization/deserialization for Dask actors (#173)
    • FIX-#174: Fix serialization/deserialization for MPI actors (#177)
    • FIX-#179: Handle None return values correctly on MPI backend (#180)
    • FIX-#175; FIX-#178: Fix nested remote calls of remote tasks and actor methods (#176)
    • FIX-#187: Make Data_ID unique for different workers on MPI backend (#188)
    • FIX-#183: Fix serialization of dict_keys for MPI backend (#184)
    • FIX-#189: Fix Actor scheduling (#190)
    • FIX-#191: Fix pendinq response after blocking GET request (#192)
    • FIX-#193: Fix actor async execution (#194)
    • FIX-#197: Initialize a backend when doing unidist.put (#198)
    • FIX-#201: Fix warnings to be aligned with latest flake8 (#202)
    • FIX-#211: Fix dask[complete] syntax in conda environment file (#212)
    • FIX-#213: Fix NamedTuple serialization (#215)
    • FIX-#209: Fix set up of conda in CI to make it work properly (#210)
    • FIX-#216: Fix development environment for ray==2.1.0 (#217)
    • FIX-#218: Install Ray from PyPI to make CI work (#220)
    • FIX-#224: Fix recursion in processing remote task arguments and serialization of dictionary that has a tuple key (#225)
    • FIX-#228: Add missing configs to workers initialization (#229)
    • FIX-#233: Fix passing MpiHosts config to workers initialization (#234)
    • FIX-#232: Fix sending out-of-band data over 1 GB (#231)
    • FIX-#235: Adding handler only if logger does not have any handlers (#236)
    • FIX-#246: Slight changes to file formatting to match new version of black (#247)
    • FIX-#253: Append worker rank to logger name (#254)
    • FIX-#256: Fix sending a cleanup command from a worker to itself (#257)
    • FIX-#263: Update the year in the licence header (#264)
    • FIX-#259: Fix cleanup data in the workers (#260)
    • FIX-#269: Update min supported Ray version (#270)
  • Performance enhancements
    • PERF-#226: Do not use pickle5 for small object serialization (#227)
    • PERF-#243: Using non-blocking send (#244)
    • PERF-#195: Fix serialization for numpy objects (#200)
    • PERF-#195: Fix serialization for pandas and numpy objects (#196)
  • New Features
    • FEAT-#185: Add communication logging (#186)
    • FEAT-#204: Allow PERF prefix in the commit messages (#205)
    • FIX-#248: Rename backends "multiprocessing" to "pymp" and "python" to "pyseq" (#265)
  • Refactor Codebase
    • REFACTOR-#237: Replace len_buffers with buffer_count (#238)
  • Documentation improvements
    • DOCS-#207: Add a doc section regarding installation of Intel MPI (#208)
    • DOCS-#266: Fix documentation build (#267)
    • DOCS-#221: Add mentioning about Modin and unidist integration in to docs (#222)
  • Update testing suite
    • TEST-#181: Added async actor tests (#182)
    • TEST-#89: Set up testing for unidist on push (#206)
    • FIX-#250: Require format for PR descriptions instead of commit descriptions (#251)
    • FIX-#250: Replace lint-commit to check-pr-title in ci.yml (#252)

Contributors

@YarShev
@Retribution98
@arunjose696