Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experimental database dumps changelog #3617

Open
pietroalbini opened this issue May 14, 2021 · 12 comments
Open

Experimental database dumps changelog #3617

pietroalbini opened this issue May 14, 2021 · 12 comments

Comments

@pietroalbini
Copy link
Member

This is a low-traffic issue tracking all the changes happening to the experimental database dumps. We recommend subscribing to this issue to get notified whenever we make some changes to the contents of the dumps.

@rust-lang rust-lang locked and limited conversation to collaborators May 14, 2021
@pietroalbini pietroalbini pinned this issue May 14, 2021
@pietroalbini
Copy link
Member Author

The next crates.io deploy (happening in the next few days) will include the following changes to the database dumps:

We also plan to make the following changes in the future:

@Turbo87
Copy link
Member

Turbo87 commented Aug 16, 2022

Two relevant changes were just deployed:

@Turbo87
Copy link
Member

Turbo87 commented Feb 19, 2024

@Turbo87
Copy link
Member

Turbo87 commented Mar 6, 2024

  • Extract crate_downloads table #8232 added a new crate_downloads table, which is supposed to replace the crates.downloads column soon. this was done for performance reasons to reduce the amount of bloat in the crates table from the regular downloads column updates. at the moment the data should be in sync, but if everything works out we will stop writing to the crates.downloads column in the near future and eventually remove it.

@Turbo87
Copy link
Member

Turbo87 commented Mar 13, 2024

@Turbo87
Copy link
Member

Turbo87 commented Apr 12, 2024

@Turbo87
Copy link
Member

Turbo87 commented Apr 25, 2024

  • Add default_versions database table #8484 will introduce a new experimental default_versions table with a mapping from crates to their "default" version, that will be shown by the frontend and used in e.g. reverse dependency queries.

@Turbo87
Copy link
Member

Turbo87 commented Jun 10, 2024

  • Create db-dump.zip file too #8748 added an experimental ZIP file artifact at https://static.crates.io/db-dump.zip. this file has the advantage of not having to decompress the entire file if you only need access to a certain database table CSV file. compared to the tarball the ZIP file does not have a top-level datetime path prefix, otherwise the files should contain the exact same data.

@Turbo87
Copy link
Member

Turbo87 commented Oct 29, 2024

in other words: no changes (except for the few days in between the PRs) and sorry for forgetting to mention the change here 🙈

@Turbo87
Copy link
Member

Turbo87 commented Nov 19, 2024

@Turbo87
Copy link
Member

Turbo87 commented Nov 26, 2024

@Turbo87
Copy link
Member

Turbo87 commented Nov 29, 2024

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants