NTD: bringing safety and security tables into the warehouse as staging and mart

[charlie-costanzo]

Description

Following up on #3579, this brings the external tables for safety and security created in that PR into the Warehouse as MVP staging and mart tables.

New staging tables:

• stg_ntd_safety_and_security__fra_regulated_mode_major_security_events
• stg_ntd_safety_and_security__major_safety_events
• stg_ntd_safety_and_security__monthly_modal_time_series_safety_and_service
• stg_ntd_safety_and_security__nonmajor_safety_and_security_events

New mart tables:

• fct_safety_and_security__fra_regulated_mode_major_security_events
• fct_safety_and_security__major_safety_events
• fct_safety_and_security__monthly_modal_time_series_safety_and_service
• fct_safety_and_security__nonmajor_safety_and_security_events

Type of change

• New feature

How has this been tested?

Post-merge follow-ups

• Actions required (specified below)
  Observe for expected behavior, follow up with documentation, tests, typecasting

[github-actions]

Warehouse report 📦

Checks/potential follow-ups

Checks indicate the following action items may be necessary.

• For new models, do they all have a surrogate primary key that is tested to be not-null and unique?

New models 🌱

calitp_warehouse.mart.safety_and_security.fct_safety_and_security__fra_regulated_mode_major_security_events

calitp_warehouse.mart.safety_and_security.fct_safety_and_security__major_safety_events

calitp_warehouse.mart.safety_and_security.fct_safety_and_security__monthly_modal_time_series_safety_and_service

calitp_warehouse.mart.safety_and_security.fct_safety_and_security__nonmajor_safety_and_security_events

calitp_warehouse.staging.ntd_safety_and_security.stg_ntd_safety_and_security__fra_regulated_mode_major_security_events

calitp_warehouse.staging.ntd_safety_and_security.stg_ntd_safety_and_security__major_safety_events

calitp_warehouse.staging.ntd_safety_and_security.stg_ntd_safety_and_security__monthly_modal_time_series_safety_and_service

calitp_warehouse.staging.ntd_safety_and_security.stg_ntd_safety_and_security__nonmajor_safety_and_security_events

DAG

Legend (in order of precedence)

Resource type	Indicator	Resolution
Large table-materialized model	Orange	Make the model incremental
Large model without partitioning or clustering	Orange	Add partitioning and/or clustering
View with more than one child	Yellow	Materialize as a table or incremental
Incremental	Light green
Table	Green
View	White

[vevetron]

fct_major_safety_events has an ntdid, not an ntd_id.
fct_nonmajor_safety_and_security_events has a _5_digit_ntd_id
fct_monthly_modal_time_series_safety_and_service has a _5_digit_ntd_id
fct_fra_regulated_mode_major_security_events has an ntd_id

Hmm.

Those are the ids we had in source data that gets propogated to the mart.

An extension of #3579