Skip to content

WMCore 1.5.0 central services production release

Compare
Choose a tag to compare
@amaltaro amaltaro released this 01 Jul 22:12
· 1424 commits to master since this release

This is the first Python3 release deployed to CMSWEB Production.
This release also brings the initial skeleton for a new MicroService to perform the cleanup of unneeded unmerged files, called MSUnmerged.
It has also a few important feature changes, required to make the behavior consistent between Python2 and Python3. Last but not least,
many other Python3-related fixes and improvements are part of this release.

Release date: 2 July 2021.
Changes since release: 1.4.9.

Central services

Software stack

Features and/or feature changes

  • MSUnmerged basic skeleton. (Todor Ivanov) #10598
  • MSUnmerged construction around functional pipelines and configurable RSE lists. (Todor Ivanov) #10621
  • Replace built-in hash function by hashlib.sha1 (Alan Malta Rodrigues) #10605
  • Make output module ordering consistent between Py2/Py3 (Alan Malta Rodrigues) #10610
  • Force pickle protocol=0 for the spec creation to be compatible with Py2/Py3 (Alan Malta Rodrigues) #10628
  • Encode CMSSW picklearguments to bytes before loading it (Alan Malta Rodrigues) #10648

Bug Fixes

  • Deal with EventStreams=None in StepChain step level (Alan Malta Rodrigues) #10594

Enhancements

  • Fix string type for DBS mock calls in python2 (Alan Malta Rodrigues) #10588
  • Update code creating DBS mocked data; ditched unicode signatures (Alan Malta Rodrigues) #10585
  • Create function to elements being acquired in WorkQueue (Alan Malta Rodrigues) #10605
  • Print request name in the InvalidStateTransition exception (Alan Malta Rodrigues) #10649

WMAgent

Features and/or feature changes

  • Remove repack slots flag (germanfgv) #10629
  • DBFormatter formatDict/formatList to native string instead of bytes (Alan Malta Rodrigues) #10639

Bug Fixes

  • Fix problem with T0 processes (Kenyi Hurtado) #10527
  • Fix WMAgent component Daemon read/write operations (Alan Malta Rodrigues) #10632 #10645

Enhancements

  • Create workload sandbox efficiently (Alan Malta Rodrigues) #10612

Python3 related changes

  • Fixes for slice 13: file open mode; pickle operations; stdout/stderr (Alan Malta Rodrigues) #10585
  • [py2py3] fix unittests from #10289 - src (Dario Mapelli) #10580
  • [py2py3] fix unittest from #10262 - src (Dario Mapelli) #10590
  • Ensure input for md5 algorithm is a bytes-object in Python3 (Alan Malta Rodrigues) #10595
  • [py2py3] WMCore/Services/Service - suggestion (Dario Mapelli) #10584
  • Format REST response to bytes in Python3 (Alan Malta Rodrigues) #10601
  • [py2py3] Fixing unittests from #10329 - src (Dario Mapelli) #10606
  • [py2py3] fix some unittests from #10307 - src (Dario Mapelli) #10603
  • [py2py3] Fix AgentStatusWatcher subprocess.Popen calls (Alan Malta Rodrigues) #10635
  • [py2py3] Open file in binary mode for pickle load/dump (Alan Malta Rodrigues) #10637