-
Notifications
You must be signed in to change notification settings - Fork 269
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Apply BSA diffs to the database #2229
Closed
Closed
Commits on Dec 10, 2023
-
Add the BsaDomainRefresh entity
Add the BsaDomainRefresh class which tracks the refresh actions. The refresh actions checks for changes in the set of registered and reserved domains, which are called unblockables to BSA.
Configuration menu - View commit details
-
Copy full SHA for 83f6eb4 - Browse repository at this point
Copy the full SHA 83f6eb4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0ecc2b7 - Browse repository at this point
Copy the full SHA 0ecc2b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for c7ae72a - Browse repository at this point
Copy the full SHA c7ae72aView commit details -
Configuration menu - View commit details
-
Copy full SHA for cf067fb - Browse repository at this point
Copy the full SHA cf067fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1d77d97 - Browse repository at this point
Copy the full SHA 1d77d97View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1660eae - Browse repository at this point
Copy the full SHA 1660eaeView commit details -
Create diffs between BSA downloads
Compare the latest BSA download and the previous one to discover: * New and deleted orders * New and deleted labels as well as konwn labels referenced by new orders The diff is stored on GCS as two files, one for orders and one for diffs.
Configuration menu - View commit details
-
Copy full SHA for 88dc0f1 - Browse repository at this point
Copy the full SHA 88dc0f1View commit details -
Apply BSA diffs to the database
Add a step in BsaDownloadAction to apply the diffs from the most recent download. This includes: - Add new labels and remove deleted labels to the `BsaLabel` table. - Add new entries to the `BsaDomainInUse` table if applicable. These are registered/reserved domains that match the new labels. - Generate list of domains that are not blocked and save them in a GCS file. These include all domains from the previous step as well as domains derived from invalid labels. More tests are needed but this PR successfully processed a real download.
Configuration menu - View commit details
-
Copy full SHA for e2eb621 - Browse repository at this point
Copy the full SHA e2eb621View commit details
Commits on Dec 11, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f140dcd - Browse repository at this point
Copy the full SHA f140dcdView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.