Add asset checks and project cleanup #41

izzye84 · 2023-09-25T22:51:10Z

Organized assets, jobs, schedules, and sensors into their respective directories.

Also added a few asset checks as a new feature.

github-actions · 2023-09-25T22:51:41Z

Your pull request is automatically being deployed to Dagster Cloud.

Location	Status	Link	Updated
data-eng-pipeline		View in Cloud	Sep 26, 2023 at 08:34 PM (UTC)
basics		View in Cloud	Sep 26, 2023 at 08:34 PM (UTC)

slopp

This looks mostly good to me, two things:

I think we need to update the file relative paths for dbt stuff? Maybe?
We mayneed to update the hooli_data_eng_tests to use the new location of things as well?

hooli_data_eng/resources/__init__.py

…e directories

izzye84 added 3 commits September 18, 2023 10:42

ignore local duckdb and dbt logs

d0f21da

moved sensor related files to the sensors directory

2b0e25a

moved analytics_job and predict_job out of definitions.py

3def107

izzye84 requested a review from slopp September 25, 2023 22:51

slopp approved these changes Sep 26, 2023

View reviewed changes

hooli_data_eng/resources/__init__.py Outdated Show resolved Hide resolved

izzye84 added 6 commits September 26, 2023 14:25

moved analytics_schedule to this directory for better organization

1b0949a

added check_avg_orders

5fb8631

added check_users asset check

8714daa

added check_country_stats asset check

d9ffbda

moved jobs, resources, schedules, and sensor logic to their respectiv…

7441e50

…e directories

moved resources from definitions.py to resources directory

ea2d017

izzye84 force-pushed the izzy/sensor_and_job_cleanup branch from b329d70 to ea2d017 Compare September 26, 2023 20:25

slopp merged commit e4b252f into master Sep 27, 2023
1 check passed

Provide feedback