From 91154ba67bd686dcb8e53bd8431bde8fcbd59bff Mon Sep 17 00:00:00 2001 From: odiengineering <112506720+odiengineering@users.noreply.github.com> Date: Tue, 17 Dec 2024 11:10:34 -0800 Subject: [PATCH] Wordpress Posts Update --- ...n-forecasting-community-water-systems.html | 129 ++++++++++++++++++ ...n-forecasting-community-water-systems.json | 127 +++++++++++++++++ .../the-everyday-magic-of-plain-language.json | 2 +- .../why-we-use-content-design.json | 2 +- 4 files changed, 258 insertions(+), 2 deletions(-) create mode 100644 pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.html create mode 100644 pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.json diff --git a/pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.html b/pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.html new file mode 100644 index 00000000..86b4c02a --- /dev/null +++ b/pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.html @@ -0,0 +1,129 @@ +

The Office of Data and Innovation (ODI) collaborates with state departments to improve services for Californians. We help teams across the state make customer-focused, data-driven decisions. ODI partnered with the California State Water Resources Control Board’s (Water Boards) Division of Drinking Water to forecast the impact of drought on our community water systems.

+ +

In this blog post, we’ll briefly revisit the problem and our initial solution. Then we’ll describe some challenges we faced and addressed along the way, and close with our vision for the future.

+ +

Problem

+ +

Californians get their drinking water from 2,866 community water systems throughout the state. These water systems serve 39 million people. In 2022, dry weather caused some outages at these systems. At some point that year, roughly 60,000 Californians relied on bottled or hauled water supplied by the Water Boards. ODI wanted to help the Water Boards predict when these outages might happen.

+ +
This map shows community water systems in California. The blue dots show where water systems outages occurred in 2022. The rest of the systems, shown in orange, operated normally.
+ +

What we did

+ +

To forecast the impact of drought on community water systems, we need to know:

+ + + +

Fortunately, groups like the U.S. Geological Survey collect data that describes the flow of water throughout the state. One example is the 3D Hydrography Program. Some datasets are so large that they can’t fit on a standard laptop. Another program is the California Water Boards Safe and Affordable Funding for Equity and Resilience project. It collects lots of data about the health of California’s community water systems.

+ +

After we collected all these data, we looked for patterns. An example of a simple pattern is rainfall. It usually rains a lot in the winter and spring and much less in the summer and fall. Historical data helps us build confidence in these patterns. If we see this pattern over the last 100 years, we’ll be pretty confident we’ll see it this year too.

+ +

But some patterns are subtle and complex. To unearth these patterns, we built a computer algorithm called a machine learning model. Machine learning models help us look for patterns in historical data. We can also use them to predict future behavior. If we see a pattern in historical data that led to a problem with a community water system, we can watch for the same pattern today. It could lead to the same problem.

+ +

Systematically studying data makes for better decision-making and helps us identify problems before they start. Before our project, the Water Boards relied on persistence, intuition, and expertise from water resource engineers. Our model performs better than this previous method.

+ +

Challenges

+ +

We faced 3 main challenges doing this work.

+ +

Deciding to use machine learning

+ +

People wondered whether we should use machine learning to make decisions. It’s a valid concern. We addressed it in a few ways.

+ +

At the Water Boards, systems that affect Californians go through a public comment period. This gives the public the chance to share any concerns about using a machine learning model. This process gives the Water Boards structure to respond to concerns.

+ +

We also chose a machine learning model that is easy to interpret. That means we understand how the model works.

+ +

Collecting data

+ +

We also faced challenges around data collection.

+ + + +

To address these challenges, we’re building a cloud-based system that co-locates data with computational resources. This reduces the time researchers spend to gather and prepare data for analysis. It allows them to quickly query data and rapidly build models. It also allows researchers to build more sophisticated models that may require a lot of computational power. They no longer have to restrict themselves to models that rely on the computational power of a single desktop computer.

+ +

Breaking down silos

+ +

Our final challenge was about us, the scientists. Scientists often bucket themselves into one of 2 categories:

+ + + +

We argue for blending these traditionally siloed areas to increase discovery potential. Funding mechanisms are also heading in this direction (for example, NASA Earth Science to Action).

+ +

A vision for the future of environmental data modeling

+ +

The environmental datasets needed to study safe drinking water are

+ + + +

To get around this, we propose finding large, relevant datasets. A good example is the one from the U.S. Geological Survey we mentioned earlier. Datasets like that can help us figure out if historical patterns in these datasets map to water system failure.

+ +

We also propose using datasets that most people don’t usually look at together. This could include:

+ + + +

After all, all major global issues – like natural resources (which includes drinking water), transportation, housing, energy – are interconnected. They should be studied that way.

+ +
+

“Bringing data together across domains in a sustainable, repeatable, and transparent way is really where we can advance both operations and research. I’m so proud of what the team did on this project to demonstrate the art of the possible and to solve problems in a multi-disciplinary way. This is the way forward in putting data to work for Californians.”

+ +

Jason Lally, State Chief Data Officer

+
+ +

To learn more on the research we conducted, visit the ODI Innovation Hub for a detailed technical paper on this work.

+ +

About the authors

+ +

Monica Bobra is the Principal Data Scientist at the Office of Data and Innovation. She was appointed by Governor Newsom. She’s particularly interested in bringing together disparate communities in:

+ + + +

She previously studied the Sun and space weather at the Harvard-Smithsonian Center for Astrophysics and Stanford University.

+ +

Dan Wang, PhD, is a researcher at the Division of Drinking Water at the California State Water Resources Control Board. She’s interested in using modern data analysis techniques to improve the quality and quantity of water in the state. She conducted interdisciplinary research on:

+ + diff --git a/pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.json b/pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.json new file mode 100644 index 00000000..748cb395 --- /dev/null +++ b/pages/blog/posts/wordpress-posts/odi-in-action-forecasting-community-water-systems.json @@ -0,0 +1,127 @@ +{ + "meta": { + "created_date": "2024-12-17T19:05:46", + "updated_date": "2024-12-17T19:05:46", + "field_reference": "https://developer.wordpress.org/rest-api/reference/posts/", + "api_version": "v2", + "api_url": "https://live-digital-ca-gov.pantheonsite.io/wp-json/wp/v2/", + "object_url": "https://live-digital-ca-gov.pantheonsite.io/wp-json/wp/v2/posts/2348", + "process": { + "source_code": "https://github.com/cagov/wordpress-to-github", + "source_data": "https://live-digital-ca-gov.pantheonsite.io", + "deployment_target": "https://github.com/cagov/digital.ca.gov/tree/main" + }, + "refresh_frequency": "as needed" + }, + "data": { + "id": 2348, + "date": "2024-12-17T11:05:46", + "date_gmt": "2024-12-17T19:05:46", + "guid": "https://live-digital-ca-gov.pantheonsite.io/?p=2348", + "modified": "2024-12-17T11:05:46", + "modified_gmt": "2024-12-17T19:05:46", + "slug": "odi-in-action-forecasting-community-water-systems", + "status": "publish", + "type": "post", + "link": "https://live-digital-ca-gov.pantheonsite.io/2024/12/17/odi-in-action-forecasting-community-water-systems/", + "title": "ODI in action: Forecasting community water systems", + "excerpt": "

The Office of Data and Innovation (ODI) collaborates with state departments to improve services for Californians. We help teams across the state make customer-focused, data-driven decisions. ODI partnered with the California State Water Resources Control Board’s (Water Boards) Division of Drinking Water to forecast the impact of drought on our community water systems. In this … Read more

\n", + "author": "Monica Bobra and Dan Wang", + "featured_media": 0, + "comment_status": "closed", + "ping_status": "closed", + "sticky": false, + "template": "", + "format": "standard", + "meta": { + "footnotes": "" + }, + "categories": [ + "Uncategorized" + ], + "tags": [], + "class_list": [ + "post-2348", + "post", + "type-post", + "status-publish", + "format-standard", + "hentry", + "category-uncategorized" + ], + "design_system_fields": { + "template": "post" + }, + "event": null, + "custom_post_date": "", + "meta_": { + "0": "", + "custom_post_link": "", + "custom_post_date": "", + "custom_post_location": "" + }, + "og_meta": { + "editor": { + "platform": "WordPress", + "plugin": "autodescription", + "plugin_name": "The SEO Framework", + "plugin_version": "4.1.5.1", + "editor_url": "https://live-digital-ca-gov.pantheonsite.io" + }, + "site_name": "innovation.ca.gov", + "site_description": "Office of Data and Innovation", + "site_url": "https://live-digital-ca-gov.pantheonsite.io", + "canonical_url": "https://live-digital-ca-gov.pantheonsite.io/2024/12/17/odi-in-action-forecasting-community-water-systems/", + "page_title": "ODI in action: Forecasting community water systems", + "page_description": "Office of Data and Innovation", + "page_social_image_url": "", + "page_social_image_width": 1200, + "page_social_image_height": 630, + "page_social_image_alt": "", + "meta_title": "ODI in action: Forecasting community water systems", + "meta_description": "Office of Data and Innovation", + "meta_canonical_url": "https://live-digital-ca-gov.pantheonsite.io/2024/12/17/odi-in-action-forecasting-community-water-systems/", + "open_graph_title": "ODI in action: Forecasting community water systems", + "open_graph_description": "Office of Data and Innovation", + "twitter_title": "ODI in action: Forecasting community water systems", + "twitter_description": "Office of Data and Innovation" + }, + "headless_categories": [ + { + "term_id": 1, + "name": "Uncategorized", + "slug": "uncategorized", + "term_group": 0, + "term_taxonomy_id": 1, + "taxonomy": "category", + "description": "", + "parent": 0, + "filter": "raw", + "cat_ID": 1, + "category_description": "", + "cat_name": "Uncategorized", + "category_nicename": "uncategorized", + "category_parent": 0 + } + ], + "headless_tags": [], + "headless_publishing": [], + "headless_preview": [], + "wordpress_url": "https://live-digital-ca-gov.pantheonsite.io/2024/12/17/odi-in-action-forecasting-community-water-systems/", + "media": [ + { + "id": 2358, + "type": "full", + "path": "2024/12/ddw-map-blog.gif", + "wordpress_url": "https://live-digital-ca-gov.pantheonsite.io/wp-content/uploads/2024/12/ddw-map-blog.gif", + "file": "ddw-map-blog.gif", + "width": 1024, + "height": 746, + "mime_type": "image/gif", + "source_url": "https://live-digital-ca-gov.pantheonsite.io/wp-content/uploads/2024/12/ddw-map-blog.gif", + "source_url_match": true, + "featured": false + } + ] + } +} \ No newline at end of file diff --git a/pages/blog/posts/wordpress-posts/the-everyday-magic-of-plain-language.json b/pages/blog/posts/wordpress-posts/the-everyday-magic-of-plain-language.json index b6d8a388..ee0e74df 100644 --- a/pages/blog/posts/wordpress-posts/the-everyday-magic-of-plain-language.json +++ b/pages/blog/posts/wordpress-posts/the-everyday-magic-of-plain-language.json @@ -26,7 +26,7 @@ "link": "https://live-digital-ca-gov.pantheonsite.io/2022/06/09/the-everyday-magic-of-plain-language/", "title": "The everyday magic of plain language", "excerpt": "

ODI uses plain language in its projects to make sure all Californians get the information they need.

\n", - "author": "Peggy Gartin & Michael Sullivan", + "author": "Peggy Gartin and Michael Sullivan", "featured_media": 596, "comment_status": "closed", "ping_status": "closed", diff --git a/pages/blog/posts/wordpress-posts/why-we-use-content-design.json b/pages/blog/posts/wordpress-posts/why-we-use-content-design.json index cb2de0ab..e9fc9b63 100644 --- a/pages/blog/posts/wordpress-posts/why-we-use-content-design.json +++ b/pages/blog/posts/wordpress-posts/why-we-use-content-design.json @@ -26,7 +26,7 @@ "link": "https://live-digital-ca-gov.pantheonsite.io/2022/06/22/why-we-use-content-design/", "title": "Why we use content design", "excerpt": "

We talk about content design a lot. Here’s what it is and why we use it.

\n", - "author": "Peggy Gartin & Michael Sullivan", + "author": "Peggy Gartin and Michael Sullivan", "featured_media": 0, "comment_status": "closed", "ping_status": "closed",