Skip to content
This repository has been archived by the owner on Jun 1, 2023. It is now read-only.

Ngwos experiment - data update #37

Merged
merged 11 commits into from
May 7, 2020
Merged

Conversation

limnoliver
Copy link
Member

This PR updates the NGWOS for a rerun of the NGWOS experiment. Highlights include:

A narrative of what sites get included in our experiment, documented here. Of the 86 potential stream temp observations sites, 56 are included in the experiment setup. This bumps the percentage of training data that is NGWOS from 5% to 8%.

c5f41a4 -- adds and munges NGWOS spreadsheet from Brian Pellerin to get all NGWOS sites.

adf0809 -- modified the NGWOS site filter, messages user when sites are dropped due to having too much pre-NGWOS data (in a period from 2013-2017) or had no data in the NGWOS period.

e915c22 -- I noticed that some sites were not making it through the pipeline because they were in the middle of the reach, and hence violated our "fish distance" criteria (was set at 5km). Some segments are much longer, and sites along the reach were being dropped. I changed the distance to 20km. Not sure what the consequences are (in terms of observations representing the reach -- it definitely increased total observations and observed sites).

c5c96f8 -- documents the change in temperature observations after the update in NGWOS data and the change in fish distance. We gained ~9k daily observations from the NGWOS experiments.

…n original site list. Run through crosswalk step.
…e getting dropped, even though they matched to the reach well.

Added one site manually because it is in lower DRB where river is wide, and missed our bird distance cutoff.
…mp data so we can see changes between data updates. This summary was manually written on the pervious data so we can see the change in NGWOS and fish distance.
…sening fish distance criteria from 5km to 20km. In post-1980 data (our model timeframe) we gained 23 sites, 11 of which had 30+ observed years!
@limnoliver limnoliver requested a review from jsadler2 May 7, 2020 13:35
Copy link
Collaborator

@jsadler2 jsadler2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good to me, Sam.


ngwos_dat <- readRDS(sc_retrieve(ngwos_ind)) %>%
mutate(site_id = paste0('USGS-', site_id)) %>%
rename(temp_degC = temp_c)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I started using all temp_degC. Are you using all temp_c? I'm fine either way, but it'd be good for me to know, that way I can be consistent.

@jsadler2 jsadler2 merged commit 5d719b8 into USGS-R:master May 7, 2020
@limnoliver limnoliver deleted the ngwos_experiment branch October 9, 2020 18:35
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants