can one iterate over files in a zip file?

[chananshgong]

If I have one big file with 10,000 files. Can rufus iterate (build the pipeline) assuming atomic operations are over the files withing the zip file (or alternatively do I need to unzip first and only then iterate).

[jbarlow83]

I did something similar. Use split task that scans the container file and creates an empty placeholder for every compressed file to extract, followed by atransform task that takes the name of a placeholders and actually does the unzipping. That will parallelize decompression.

But if that's all you want ruffus is overkill. concurrent.futures would be easier.