Skip to content

Commit

Permalink
Re-enable image data refresh scheduling, readjust matview timeouts (#…
Browse files Browse the repository at this point in the history
  • Loading branch information
AetherUnbound authored Jul 11, 2023
1 parent c256094 commit a11969e
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 6 deletions.
2 changes: 1 addition & 1 deletion catalog/DAGs.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ The following are DAGs grouped by their primary tag:
| [`audio_data_refresh`](#audio_data_refresh) | `@weekly` |
| [`create_filtered_audio_index`](#create_filtered_audio_index) | `None` |
| [`create_filtered_image_index`](#create_filtered_image_index) | `None` |
| [`image_data_refresh`](#image_data_refresh) | `None` |
| [`image_data_refresh`](#image_data_refresh) | `@weekly` |

## Database

Expand Down
7 changes: 2 additions & 5 deletions catalog/dags/data_refresh/data_refresh_types.py
Original file line number Diff line number Diff line change
Expand Up @@ -63,14 +63,11 @@ def __post_init__(self):
DATA_REFRESH_CONFIGS = [
DataRefresh(
media_type="image",
# Temporarily turn off scheduled runs for the image data refresh.
# This allows us to keep the DAG enabled for manual runs.
schedule=None,
data_refresh_timeout=timedelta(days=4),
refresh_metrics_timeout=timedelta(hours=24),
refresh_matview_timeout=timedelta(days=21),
refresh_matview_timeout=timedelta(hours=72),
create_pop_constants_view_timeout=timedelta(hours=24),
create_materialized_view_timeout=timedelta(days=21),
create_materialized_view_timeout=timedelta(hours=72),
),
DataRefresh(media_type="audio"),
]

0 comments on commit a11969e

Please sign in to comment.