SONIC workflows

This repository serves to deploy and run SONIC workflows for performance tests.

Setup

wget https://raw.githubusercontent.com/fastmachinelearning/sonic-workflows/master/setup.sh
chmod +x setup.sh
./setup.sh
cd CMSSW_12_0_0_pre5/src/sonic-workflows
cmsenv

Running

cmsRun run.py

To run the Run-3 workflow, change it to

cmsRun run.py config=step4_PAT_Run3

Driver commands

2018 ultra-legacy re-miniAOD:

runTheMatrix.py -l 1325.518 --dryRun --command="--no_exec"

Modified commands:

dasgoclient --limit 0 --query 'file dataset=/RelValProdTTbar_13_pmx25ns/CMSSW_10_6_4-PUpmx25ns_106X_upgrade2018_realistic_v9-v1/AODSIM' | sort -u > step1_dasquery.log
cmsDriver.py step2  -s PAT --era Run2_2018 -n 100 --process PAT --conditions auto:phase1_2018_realistic --mc  --scenario pp --eventcontent MINIAODSIM --datatier MINIAODSIM --procModifiers run2_miniAOD_UL_preSummer20 --no_exec --filein filelist:step1_dasquery.log --fileout file:step2.root

UL re-miniAOD workflows for other years: 1325.516, 1325.5161, 1325.517

2021 Run-3 MiniAOD

runTheMatrix.py -w upgrade -n -l 11834.21 --dryRun --command="--no_exec"

Modified commands:

dasgoclient --limit 0 --query 'file dataset=/RelValTTbar_14TeV/CMSSW_12_0_0_pre4-PU_120X_mcRun3_2021_realistic_v2-v1/GEN-SIM-RECO' | sort -u > step3_dasquery.log
cmsDriver.py step4  -s PAT --conditions auto:phase1_2021_realistic --datatier MINIAODSIM -n 10 --eventcontent MINIAODSIM --geometry DB:Extended --era Run3 --no_exec --filein filelist:step3_dasquery.log  --fileout file:step4.root

Run3/Phase2 SONIC-enabled workflows are available from runTheMatrix.py -w upgrade -n with suffix .9001