Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DG-1442 Modification of the PreProcessor for Custom Sort - Bulk Update Edge Cases #3265

Merged
merged 20 commits into from
Oct 15, 2024
Merged

DG-1442 Modification of the PreProcessor for Custom Sort - Bulk Update Edge Cases #3265

merged 20 commits into from
Oct 15, 2024

Conversation

hr2904
Copy link
Collaborator

@hr2904 hr2904 commented Jun 19, 2024

Change description

Glossary Entities can be created/modified from non-FE methods as well, so we needed to add logic to add appropriate lexicographicalSortOrder Attribute to the entity in case it is not sent from user.
Also added validation regarding valid and appropriate lexoranks in context to the entity being sent.

Type of change

  • New feature (adds functionality)

Related Docs

Ticket
TestCases

Checklists

Development

  • Lint rules pass locally
  • Application changes have been tested thoroughly
  • Automated tests covering modified code pass

Security

  • Security impact of change has been considered
  • Code follows company security practices and guidelines

Code review

  • Pull request has a descriptive title and context useful to a reviewer. Screenshots or screencasts are attached as necessary
  • "Ready for review" label attached and reviewers assigned
  • Changes have been reviewed by at least one other contributor
  • Pull request linked to task tracker where applicable

nikhilbonte21
nikhilbonte21 requested changes Jun 20, 2024
View reviewed changes
...src/main/java/org/apache/atlas/repository/store/graph/v2/preprocessor/PreProcessorUtils.java Outdated Show resolved Hide resolved
...src/main/java/org/apache/atlas/repository/store/graph/v2/preprocessor/PreProcessorUtils.java Outdated Show resolved Hide resolved
...src/main/java/org/apache/atlas/repository/store/graph/v2/preprocessor/PreProcessorUtils.java Outdated Show resolved Hide resolved
...src/main/java/org/apache/atlas/repository/store/graph/v2/preprocessor/PreProcessorUtils.java Outdated Show resolved Hide resolved
...src/main/java/org/apache/atlas/repository/store/graph/v2/preprocessor/PreProcessorUtils.java Outdated Show resolved Hide resolved
...a/org/apache/atlas/repository/store/graph/v2/preprocessor/glossary/CategoryPreProcessor.java Outdated Show resolved Hide resolved
...a/org/apache/atlas/repository/store/graph/v2/preprocessor/glossary/GlossaryPreProcessor.java Outdated Show resolved Hide resolved
...a/org/apache/atlas/repository/store/graph/v2/preprocessor/glossary/GlossaryPreProcessor.java Outdated Show resolved Hide resolved
.../java/org/apache/atlas/repository/store/graph/v2/preprocessor/glossary/TermPreProcessor.java Outdated Show resolved Hide resolved
nikhilbonte21
nikhilbonte21 previously approved these changes Jun 26, 2024
View reviewed changes
mehtaanshul
mehtaanshul previously approved these changes Jun 28, 2024
View reviewed changes
@hr2904 hr2904 dismissed stale reviews from mehtaanshul and nikhilbonte21 via c4e1cbb June 28, 2024 09:17
mehtaanshul
mehtaanshul previously approved these changes Jun 28, 2024
View reviewed changes
nikhilbonte21
nikhilbonte21 previously approved these changes Jun 28, 2024
View reviewed changes
@hr2904 hr2904 dismissed stale reviews from nikhilbonte21 and mehtaanshul via 5ee4f53 July 5, 2024 12:44
@nikhilbonte21
Copy link

Changes look good to me, I will do a quick testing tomorrow on datamesh.atlan.com before approving

hr2904 added 17 commits September 30, 2024 10:43
@hr2904
Init commmit, added lexorank generation util lib and logic for append…
49a6e6d 
…ing the lexo attribute to category.
@hr2904
Added method to append lexicographicSortOrder attribute to any Glossa…
7f36434 
…ry based Entity that does not have it while creation.
@hr2904
Added LexoRank Validation method, with tentative rebalancing trigger …
1bcff4e 
…logic
@hr2904
Corrected a method rename
f4a38dc
@hr2904
Added a check in validateLexoRank which checks if another entity with…
8c1c21a 
… duplicate lexorank doesnt exist in scenario where lexorank is being sent from user.
@hr2904
Added a check , such that if bulk request is from migration, it will …
30b4d47 
…override the check for for duplicate lexorank.
@hr2904
Modified ES query.
5d06cba
@hr2904
Modified an edge statement such that, when a new lexorank for cat is …
378859f 
…generated, it is not a duplicate of a term in same linear data set
@hr2904
Reverted the check, instead added padded new offset for terms.
ffd3e73
@hr2904
fixed the caching logic, by adding the bifurcation for terms and cate…
de5965c 
…gories
@hr2904
Fixed PR comments
7137d99
@hr2904
Added caching for same ranks in same request, for prevention of dupli…
1587489 
…cacy.
@hr2904
Fixed a minor bug where an empty lexo attribute in update call was re…
e28d7ac 
…moving the attribute from the vertex.
@hr2904
Fixed PR comments
f9838df
@hr2904
Reverted the AbstractGlossaryPreProcessor file , previously edited.
586304b
@hr2904
Fixed PR comments.
7ab9223
@hr2904
fixed attribute name in dsl query
cb56a94
@hr2904 hr2904 merged commit f0ad625 into master Oct 15, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nikhilbonte21 nikhilbonte21 nikhilbonte21 approved these changes

@mehtaanshul mehtaanshul mehtaanshul approved these changes

Assignees
No one assigned
Labels
DO NOT MERGE
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@hr2904 @nikhilbonte21 @mehtaanshul