Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework the ddo_transform python wheel with updated schema #1023

Open
ydaponte opened this issue Jan 15, 2025 · 0 comments
Open

Rework the ddo_transform python wheel with updated schema #1023

ydaponte opened this issue Jan 15, 2025 · 0 comments
Assignees
Labels

Comments

@ydaponte
Copy link
Collaborator

ydaponte commented Jan 15, 2025

The schema of the ddo_transform currently references the object model of the original solution build on a public dataset. This means that all data that is currenly being "standardized" and "transformed" is bucketed into the "bad_data" category and does not show up in the portal reporting.

This task is to rewrite the "standardize" and "transform" processes to match the updated schema that is currently being produced by the new REST API.

DoD:

  • Standardize correctly buckets data from the sensors and locations API endpoints
  • Transform correctly transforms the data to the correct dimensional tables with the current API endpoints.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants