Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update fastq data archive bucket settings #502

Merged
merged 2 commits into from
Nov 20, 2024

Conversation

reisingerf
Copy link
Member

This is to finalise the bucket configuration / setup of our archive buckets before we start the data migration / archival.

Note:

  • archive tiers are split in two, for large and smaller files
  • versioning is enabled. This may have significant cost implications as all object versions will be charged for a minimal period. It's the only way to guard against accidental deletion though (I think).
  • version expiry is based on the minimal charged duration (GLACIER_IA), not on the duration of the bulk of the data (DEEP_ARCHIVE)
  • the FileManager role is only given read access, the prod account only has list access and there is no dedicated write access yet

@reisingerf reisingerf self-assigned this Nov 18, 2024
@victorskl
Copy link
Member

Related umccr/orcabus#700

@reisingerf
Copy link
Member Author

@alexiswl after our chat the other day, I'm going ahead and apply those changes.

@reisingerf reisingerf merged commit 69910c7 into master Nov 20, 2024
1 check passed
@reisingerf reisingerf deleted the data/finalise-bucket-settings branch November 20, 2024 03:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants