WMCore 1.5.0 central services production release
This is the first Python3 release deployed to CMSWEB Production.
This release also brings the initial skeleton for a new MicroService to perform the cleanup of unneeded unmerged files, called MSUnmerged.
It has also a few important feature changes, required to make the behavior consistent between Python2 and Python3. Last but not least,
many other Python3-related fixes and improvements are part of this release.
Release date: 2 July 2021.
Changes since release: 1.4.9.
Central services
Software stack
Features and/or feature changes
- MSUnmerged basic skeleton. (Todor Ivanov) #10598
- MSUnmerged construction around functional pipelines and configurable RSE lists. (Todor Ivanov) #10621
- Replace built-in hash function by hashlib.sha1 (Alan Malta Rodrigues) #10605
- Make output module ordering consistent between Py2/Py3 (Alan Malta Rodrigues) #10610
- Force pickle protocol=0 for the spec creation to be compatible with Py2/Py3 (Alan Malta Rodrigues) #10628
- Encode CMSSW picklearguments to bytes before loading it (Alan Malta Rodrigues) #10648
Bug Fixes
- Deal with EventStreams=None in StepChain step level (Alan Malta Rodrigues) #10594
Enhancements
- Fix string type for DBS mock calls in python2 (Alan Malta Rodrigues) #10588
- Update code creating DBS mocked data; ditched unicode signatures (Alan Malta Rodrigues) #10585
- Create function to elements being acquired in WorkQueue (Alan Malta Rodrigues) #10605
- Print request name in the InvalidStateTransition exception (Alan Malta Rodrigues) #10649
WMAgent
Features and/or feature changes
- Remove repack slots flag (germanfgv) #10629
- DBFormatter formatDict/formatList to native string instead of bytes (Alan Malta Rodrigues) #10639
Bug Fixes
- Fix problem with T0 processes (Kenyi Hurtado) #10527
- Fix WMAgent component Daemon read/write operations (Alan Malta Rodrigues) #10632 #10645
Enhancements
- Create workload sandbox efficiently (Alan Malta Rodrigues) #10612
Python3 related changes
- Fixes for slice 13: file open mode; pickle operations; stdout/stderr (Alan Malta Rodrigues) #10585
- [py2py3] fix unittests from #10289 - src (Dario Mapelli) #10580
- [py2py3] fix unittest from #10262 - src (Dario Mapelli) #10590
- Ensure input for md5 algorithm is a bytes-object in Python3 (Alan Malta Rodrigues) #10595
- [py2py3] WMCore/Services/Service - suggestion (Dario Mapelli) #10584
- Format REST response to bytes in Python3 (Alan Malta Rodrigues) #10601
- [py2py3] Fixing unittests from #10329 - src (Dario Mapelli) #10606
- [py2py3] fix some unittests from #10307 - src (Dario Mapelli) #10603
- [py2py3] Fix AgentStatusWatcher subprocess.Popen calls (Alan Malta Rodrigues) #10635
- [py2py3] Open file in binary mode for pickle load/dump (Alan Malta Rodrigues) #10637