Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop Solr (GOlr) indices from Zenodo archive bundle #353

Closed
kltm opened this issue Jan 17, 2024 · 8 comments
Closed

Drop Solr (GOlr) indices from Zenodo archive bundle #353

kltm opened this issue Jan 17, 2024 · 8 comments
Assignees

Comments

@kltm
Copy link
Member

kltm commented Jan 17, 2024

Drop Solr indices from the Zenodo archive bundle, to:

An alternate I want to consider is silently "splitting", maybe asynchronously or after-the-fact, giving us an archive w/o slowing things down.

@kltm kltm self-assigned this Jan 17, 2024
@kltm
Copy link
Member Author

kltm commented Jan 19, 2024

As I collect progress report items, I def think we want this archived--I do not want to be caught needing to regenerate.

@kltm
Copy link
Member Author

kltm commented Jan 20, 2024

Noting that this is a bit of a "non-starter" given that Zenodo doesn't really work anyway with #345

@kltm
Copy link
Member Author

kltm commented Apr 5, 2024

Glarf--the issue may be forced on this release, as recent additions have likely pushed us over the 50GB limit.

51532257933 Apr  5 14:06 go-release-archive.tgz

hm

48G Apr  5 14:06 go-release-archive.tgz

Well, showdown between GB and GiB...

@kltm
Copy link
Member Author

kltm commented Apr 5, 2024

I can confirm we can no longer proceed with current package:

Warning!
Could not upload files.
Uploading the selected files would result in 51.53 GBbut the limit is50.00 GB.

@kltm
Copy link
Member Author

kltm commented Apr 5, 2024

Okay, rebuilding package without these files.
I want to look at saving these separately in Zenodo.

@kltm
Copy link
Member Author

kltm commented Apr 9, 2024

Okay, I now have an experimental deposition here: https://zenodo.org/records/10946933, that contains the solr index and the two blazegraph builds.
However, it has a "twin" in the dashboard that is marked for "Review". I don't know what that means. I'll check back on it tomorrow.
If it looks good:

  • add them to the release notes
  • add this process to the release SOP (sadly manual at this point)
  • (add to end-use docs?)

@kltm
Copy link
Member Author

kltm commented Apr 9, 2024

Zenodo itself seems to be broken at this point--any attempt to make new versions or edit the metadata of the new deposit is met with a vague server error.

@kltm
Copy link
Member Author

kltm commented Apr 12, 2024

Checking again, I seem to have the ability to update the "binaries" package. I think this can be closed out by updating my SOP for the current "semi-manual" releases.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

No branches or pull requests

1 participant