2013 07 23 misc zipbenchmarks

TL;DR: there is considerable variation in decompressing the same zip-file depending on the hardware, OS and method used. Range of variation is at least from +55 minutes (Windows7 native unzipping) to ~44 seconds (using Python's zipfile module).

---

Computer: cbig-arnold
Zip-file: IUCN_AmphibiansCBIGClassification_r16.zip
Command: time 7z x -mmt IUCN_AmphibiansCBIGClassification_r16.zip

1. To /media/DATAPART1/GlobalAnalyses/Species/Amphibians
   Type: SAS 10 000 RPM
   RAID: Yes
   OS: Ubuntu Server 12.04 LTS 64bit
   FS: NTFS

Folders:    1
Files:      19751
Size:       18094694571
Compressed: 388266543

real	13m31.498s
user	2m52.635s
sys	1m44.371s

2. To ~/Data
   Type: SAS 10 000 RPM
   RAID: Yes
   OS: Ubuntu Server 12.04 LTS 64bit
   FS: EXT4

Folders: 	1
Files: 		19751
Size:       18094694571
Compressed: 388266543

real	2m29.257s
user	0m56.516s
sys	1m25.349s

Notes

• Using unzip is considerably slower: 3m5.205s (measured)
• Using Python's zipfile module considerably faster (using example script): 0m44.399s

---

Computer: MRGTESLA
Zip-file: IUCN_AmphibiansCBIGClassification_r16.zip
Command: Using 7zip manually on Windows Explorer.

1. To C:/Temp
   Type: SAS 10 000 RPM
   RAID: Yes
   OS: Win7 Enterprise 64bit
   FS: NTFS

Elapsed:     2m3s (timed manually)

2. To Z:/Scratch
   Type: SATA 7200 RPM
   RAID: No
   OS: Win7 Enterprise 64bit
   FS: NTFS

Elapsed:     6m1s (timed manually)

---

Computer: DH1-BIOTI25
Zip-file: IUCN_AmphibiansCBIGClassification_r16.zip
Command: time 7z x -mmt IUCN_AmphibiansCBIGClassification_r16.zip

1. To ~/temp
   Type: SSD
   RAID: No
   OS: OpenSUSE 12.3 64bit
   FS: EXT4

Folders:    1  
Files:      19751  
Size:       18094694571  
Compressed: 388266543  

real	    2m47.81s  
user	    1m19.18s  
sys	    0m52.92s  

Notes

• On KDE, Ark (using libzip) seems to be even faster: 2m2s (timed manually)
• Using unzip is considerably faster: 1m57.85s (measured)

2. To C:/temp
   Type: SSD
   RAID: No
   OS: Win7 Enterprise 64bit
   FS: NTFS

Elapsed:     4m46s (timed manually)