Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preemptively filter the Rekognition tags #4644

Closed
AetherUnbound opened this issue Jul 22, 2024 · 0 comments · Fixed by #4667
Closed

Preemptively filter the Rekognition tags #4644

AetherUnbound opened this issue Jul 22, 2024 · 0 comments · Fixed by #4667
Assignees
Labels
💻 aspect: code Concerns the software code in the repository 🌟 goal: addition Addition of new feature 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: catalog Related to the catalog and Airflow DAGs 🧱 stack: ingestion server Related to the ingestion/data refresh server

Comments

@AetherUnbound
Copy link
Collaborator

Description

Before inserting the Rekognition tags, we want to make sure they are appropriately filtered during the data refresh. This filtering can either be the more complete set of exclusions described above for both the labels themselves and their accuracy. This, however, depends on the completion of #4541 and the ingestion server removal project in general (#3925).

In order to work on this effort in parallel with #3925, we can add a check to the existing tag filtering step which will exclude all tags with the provider rekognition. That way we can add all of the tags to the catalog with impunity, and allow those tags to be exposed when #3925 is finished and turned on.

Additional context

See this section of the IP.

@AetherUnbound AetherUnbound added 🌟 goal: addition Addition of new feature 💻 aspect: code Concerns the software code in the repository 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: catalog Related to the catalog and Airflow DAGs 🧱 stack: ingestion server Related to the ingestion/data refresh server labels Jul 22, 2024
@AetherUnbound AetherUnbound self-assigned this Jul 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💻 aspect: code Concerns the software code in the repository 🌟 goal: addition Addition of new feature 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: catalog Related to the catalog and Airflow DAGs 🧱 stack: ingestion server Related to the ingestion/data refresh server
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

1 participant