Cleanup local precheck/generate data from the worker

[vishnoianil]

Once the precheck/generate data is uploaded, we should clean up the the local data to save disk space. Otherwise if the diskspace gets full, we might not be able to access the worker itself.

We can think of some policy to delete the data -

• Immediate (the moment data is uploaded to s3 bucket)
• Lazy (do cleanup every couple of days)
• Event based (watch the disk pressure and execute LIFO delete)

[Gregory-Pereira]

/assign