Broken ARA Bundle 1228c3b8041f11edb5b232208fe3aaeb.zip

[blinkdog]

There was a problem while processing an ARA data return request: ARA-2021-unbiased-SPS-ARA-1028.json

The checksum for the bundle is good, but the bundle itself appears to have internal checksum issues:

jadelta@c9-3 /data/user/jadelta/ltatemp/semaphore $ unzip -t ../welcome_home/1228c3b8041f11edb5b232208fe3aaeb.zip 
Archive:  ../welcome_home/1228c3b8041f11edb5b232208fe3aaeb.zip
    testing: 1228c3b8041f11edb5b232208fe3aaeb.metadata.ndjson   OK
    testing: SPS-ARA-RAW.ARA03.run_022526.flat.tar   OK
    testing: SPS-ARA-RAW.ARA03.run_022529.flat.tar   OK
    testing: SPS-ARA-RAW.ARA03.run_022524.flat.tar   OK
    testing: SPS-ARA-RAW.ARA03.run_022525.flat.tar   bad CRC dcf37403  (should be 12a2184f)
    testing: SPS-ARA-RAW.ARA03.run_022521.flat.tar   bad CRC 22183d6b  (should be 6120b110)
    testing: SPS-ARA-RAW.ARA03.run_022522.flat.tar   bad CRC 5d0dc417  (should be c6d9685c)
    testing: SPS-ARA-RAW.ARA03.run_022523.flat.tar   OK
    testing: SPS-ARA-RAW.ARA03.run_022528.flat.tar   bad CRC d51832ed  (should be dbdfa60f)
    testing: SPS-ARA-RAW.ARA01.run_022691.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022690.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022684.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022687.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022686.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022683.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022685.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022689.flat.tar   OK
    testing: SPS-ARA-RAW.ARA03.run_022527.flat.tar   OK
    testing: SPS-ARA-RAW.ARA01.run_022688.flat.tar   OK
At least one error was detected in ../welcome_home/1228c3b8041f11edb5b232208fe3aaeb.zip.

This issue is to investigate this.

[blinkdog]

Four files inside the bundle are corrupt.
This bundle will need to be regenerated and sent to NERSC, and the old bundle should be deleted.

broken-ara-bundle-2.txt

1. Implement Checksum -> Bundle -> Unzip -> Checksum #211 first
2. Regenerate this bundle, send it to NERSC, and fix the File Catalog entry.
3. Do Data Verification #239 to see if there are any other bundles that need to be fixed

[blinkdog]

I recovered the files contained in this bundle from an ARA disk mounted in jade03.
I copied the files to the appropriate place in the Data Warehouse.
The tasks in this ticket remain the same.