Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make DOWNLOAD_ASSEMBLIES store data more effeciently #78

Open
zachary-foster opened this issue Jun 13, 2024 · 0 comments
Open

Make DOWNLOAD_ASSEMBLIES store data more effeciently #78

zachary-foster opened this issue Jun 13, 2024 · 0 comments

Comments

@zachary-foster
Copy link
Contributor

Currently, the DOWNLOAD_ASSEMBLIES function downloads a zipped archive, unzips it, and renames some files in the unzipped archive that are used for the process' output. Both the zipped and unzipped versions are retained, so this uses more than twice the storage it could use. We only need to store some of the files in the archive and those can be compressed again once they have been removed from the unzipped archive. All the other files can be deleted by the process.

Things to do:

  • Instead of renaming files in place, move them to the root of the process work directory while renaming them
  • Compress all the required files that were moved from the zipped archive
  • Delete the original zipped archive and the unzipped version
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant