The TestCheckDefaultKubeletConfig end-to-end test fails on OpenShift 4.12

[rhmdnd]

We've noticed failures in CI after upgrading to 4.12 clusters for testing, see openshift/release#33214:

TestE2E/Parallel_tests/TestCheckDefaultKubeletConfig
helpers.go:298: expecting COMPLIANT got NOT-APPLICABLE 

Test output:

    --- FAIL: TestE2E/Parallel_tests (0.00s)
        --- PASS: TestE2E/Parallel_tests/TestGenericRemediationFailsWithUnkownType (5.12s)
        --- PASS: TestE2E/Parallel_tests/TestSuiteWithInvalidScheduleShowsError (10.23s)
        --- PASS: TestE2E/Parallel_tests/TestApplyGenericRemediation (15.20s)
        --- PASS: TestE2E/Parallel_tests/TestPatchGenericRemediation (15.34s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithEmptyTailoringCMNameFails (30.16s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithInvalidScanTypeFails (30.19s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithInvalidContentFails (55.20s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithNodeSelectorNoMatches (25.16s)
        --- PASS: TestE2E/Parallel_tests/TestMalformedTailoredScanFails (75.36s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithInvalidProfileFails (80.31s)
        --- PASS: TestE2E/Parallel_tests/TestScanStorageOutOfLimitRangeFails (10.50s)
        --- PASS: TestE2E/Parallel_tests/TestScanSettingBindingWatchesTailoredProfile (15.39s)
        --- PASS: TestE2E/Parallel_tests/TestManualRulesTailoredProfile (120.63s)
        --- PASS: TestE2E/Parallel_tests/TestSingleTailoredPlatformScanSucceeds (75.22s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuiteInvalidPriorityClass (135.28s)
        --- PASS: TestE2E/Parallel_tests/TestRulesAreClassifiedAppropriately (0.24s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithUnexistentResourceFails (55.27s)
        --- FAIL: TestE2E/Parallel_tests/TestCheckDefaultKubeletConfig (125.40s)
        --- PASS: TestE2E/Parallel_tests/TestProfileModification (137.91s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuitePriorityClass (145.34s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithMissingTailoringCMFailsAndRecovers (145.48s)
        --- PASS: TestE2E/Parallel_tests/TestInvalidBundleWithNoTag (5.12s)
        --- PASS: TestE2E/Parallel_tests/TestSingleScanWithStorageSucceeds (135.27s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuiteUpdate (150.58s)
        --- PASS: TestE2E/Parallel_tests/TestInvalidBundleWithUnexistentRef (15.11s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithNodeSelectorFiltersCorrectly (110.56s)
        --- PASS: TestE2E/Parallel_tests/TestMissingPodInRunningState (165.41s)
        --- PASS: TestE2E/Parallel_tests/TestSingleTailoredScanSucceeds (110.24s)
        --- PASS: TestE2E/Parallel_tests/TestSuiteWithContentThatDoesNotMatch (175.25s)
        --- PASS: TestE2E/Parallel_tests/TestScanSettingBinding (105.71s)
        --- PASS: TestE2E/Parallel_tests/TestParsingErrorRestartsParserInitContainer (95.46s)
        --- PASS: TestE2E/Parallel_tests/TestScanProducesRemediations (90.44s)
        --- PASS: TestE2E/Parallel_tests/TestSingleScanSucceeds (100.48s)
        --- PASS: TestE2E/Parallel_tests/TestProfileISTagUpdate (141.24s)
        --- PASS: TestE2E/Parallel_tests/TestProfileISTagOtherNs (146.09s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuite (435.66s)
    --- PASS: TestE2E/Serial_tests (2438.69s)
        --- PASS: TestE2E/Serial_tests/TestScanStorageOutOfQuotaRangeFails (5.27s)
        --- PASS: TestE2E/Serial_tests/TestSuiteScan (126.45s)
        --- PASS: TestE2E/Serial_tests/TestTolerations (80.58s)
        --- PASS: TestE2E/Serial_tests/TestAutoRemediate (441.90s)
        --- PASS: TestE2E/Serial_tests/TestUnapplyRemediation (422.08s)
        --- PASS: TestE2E/Serial_tests/TestInconsistentResult (75.81s)
        --- PASS: TestE2E/Serial_tests/TestPlatformAndNodeSuiteScan (196.29s)
        --- PASS: TestE2E/Serial_tests/TestUpdateRemediation (437.41s)
        --- PASS: TestE2E/Serial_tests/TestProfileBundleDefaultIsKept (165.53s)
        --- PASS: TestE2E/Serial_tests/TestVariableTemplate (140.93s)
        --- PASS: TestE2E/Serial_tests/TestKubeletConfigRemediation (346.45s)
FAIL
FAIL    github.com/ComplianceAsCode/compliance-operator/tests/e2e       3194.980s
FAIL
make: *** [Makefile:563: e2e] Error 1

We can also recreate this locally by building the operator, deploying it into a 4.12 cluster, and running the e2e tests. At the moment, our CI is broken until we fix this issue.

I reproduced using:

$ export IMAGE_REPO=quay.io/lbragsta/
$ export TAG=`uuidgen`
$ make image && make push
$ make e2e