after review

gena · May 4, 2016 · 8e92059 · 8e92059
1 parent e7c5400
commit 8e92059
Show file tree

Hide file tree

Showing 32 changed files with 2,327 additions and 3 deletions.
diff --git a/README b/README
@@ -0,0 +1,81 @@
+This repository provides material used for the paper: <add a link here>
+
+Overview
+========
+
+The repository contains scripts and Python Notebooks which can be used to perform a comparison of 
+
+  1) Raster water masks derived from Landsat satellite imagery
+  2) Vector datasets representing hydrography (OpenStreetMap or Surface Hydrology for Australia)
+  3) Drainage networks derived from 30m SRTM
+
+Some of the scripts make use of Google Earth Engine (GEE).
+
+Some of the scripts require https://github.com/gena/ee-runner to run GEE JavaScript API in a command-line.
+
+Dirctories
+==========
+
+  bin/ .......................... programs used during conversion
+    gdalcopyprj.cmd ............. copies gographic projection from one raster file to another
+    gdalcopyprj.py
+    osmconvert.exe .............. converts OpenStreetMap pbf binary files to o5m and osm format
+    osmfilter.exe ............... filter OpenStreetMap files
+
+  config/ ....................... config files use by some of the scripts
+    osmconf.ini ................. used by osmconvert and osmfilter
+    water.osmfilter.params ...... combines tags used to extract hydrography from OpenStreetMap files (polylines and polygons)
+
+  data/ ......................... input files
+    OpenStreetMap/
+    SurfaceHydrology/ ........... major rivers extracted from http://www.ga.gov.au
+    grid.kml .................... regular grid used to aggregate results and to parallelize the analysis
+    HydroSHEDS_Catchment_MD.* ... HydroSHEDS cachment boundaries for Murray-Darling River Basin
+    HydroSHEDS_rivers_MD.* ...... HydroSHEDS drainage network
+
+  graphics/ ..................... images comparing generated water mask and OSM with WOfS and Surface Hydrology
+    <images>
+
+  notebooks/ .................... Python Notebooks used to perform different steps of the analysis
+    ConvertWaterHistogramsAndThresholds.ipynb
+    ExplodeShpPolylines.ipynb
+    ExplodeShpPolylinesSH.ipynb
+    HAND.ipynb
+    HydroBASINS (fix).ipynb
+    NDWI_thresholds.ipynb
+    OSM water validation using LANDSAT (Murray & Darling).ipynb
+    SHP2KML with fix.ipynb
+    TileCatchmentsToGrid.ipynb
+    UploadToFusionTable.ipynb    
+
+  results/ ...................... some of the results generated during analysis
+    water_and_results_examples/
+    water.zip
+
+  src/
+    javascript/
+       download_SRTM.js ........... GEE script used to download SRTM data clipped by catchment boundaries
+       download_water.js .......... GEE
+       training.js ................ training dataset, generated within GEE
+
+    javascript-ee-playground/ ......... GEE Playground scripts
+       OSM_automatic_NDWI.js ..........
+       OSM_compute_buffers.js ......... computes distances between rivers using Goodchilds's method
+       OSM_compute_buffers_export.js .. 
+       OSM_stat_per_catchment.js ...... generates aggregated statistics
+
+    python/
+
+    scripts/
+
+  web/ .......................... source code of the Google App Engine website (http://osm-water.appspot.com)
+    httplib2
+    media
+    oauth2client
+    static
+    app.yaml
+    config_web.py
+    index.html
+    README.md
+    server.py
+    six.py
diff --git a/graphics/Comparison_SH/SurfaceHydrology_vs_Landsat8.png b/graphics/Comparison_SH/SurfaceHydrology_vs_Landsat8.png
diff --git a/graphics/Comparison_SH/point1.jpg b/graphics/Comparison_SH/point1.jpg
diff --git a/graphics/Comparison_SH/point2_OSM_L8.jpg b/graphics/Comparison_SH/point2_OSM_L8.jpg
diff --git a/graphics/Comparison_SH/point2_SH_WOFS.jpg b/graphics/Comparison_SH/point2_SH_WOFS.jpg
diff --git a/graphics/DEM_AU_5m_EE.jpg b/graphics/DEM_AU_5m_EE.jpg
diff --git a/graphics/SH_OSM.jpg b/graphics/SH_OSM.jpg
diff --git a/graphics/Validation_WOfS/desktop.ini b/graphics/Validation_WOfS/desktop.ini
@@ -0,0 +1,5 @@
+[.ShellClassInfo]
+InfoTip=This folder is shared online.
+IconFile=C:\Program Files (x86)\Google\Drive\googledrivesync.exe
+IconIndex=16
+
diff --git a/graphics/Validation_WOfS/point1.txt b/graphics/Validation_WOfS/point1.txt
@@ -0,0 +1,4 @@
+16530301.104
+-4183298.170
+16542012.164
+-4175150.102
diff --git a/graphics/Validation_WOfS/point1_l8.jpg b/graphics/Validation_WOfS/point1_l8.jpg
diff --git a/graphics/Validation_WOfS/point1_wofs.jpg b/graphics/Validation_WOfS/point1_wofs.jpg
diff --git a/graphics/Validation_WOfS/point2.txt b/graphics/Validation_WOfS/point2.txt
@@ -0,0 +1,4 @@
+16247191.582
+-4110720.751
+16258630.366
+-4102762.121
diff --git a/graphics/Validation_WOfS/point2_l8.jpg b/graphics/Validation_WOfS/point2_l8.jpg
diff --git a/graphics/Validation_WOfS/point2_wofs.jpg b/graphics/Validation_WOfS/point2_wofs.jpg
diff --git a/graphics/Validation_WOfS/point3.txt b/graphics/Validation_WOfS/point3.txt
@@ -0,0 +1,8 @@
+Lake Mokoan
+
+http://aqua-monitor.appspot.com/?view=-36.44600497112087,146.05606657978524,12z&percentile=15
+
+16243389.309
+-4377847.280
+16286266.141
+-4348015.364
diff --git a/graphics/Validation_WOfS/point3_l8.jpg b/graphics/Validation_WOfS/point3_l8.jpg
diff --git a/graphics/Validation_WOfS/point3_wofs.jpg b/graphics/Validation_WOfS/point3_wofs.jpg
diff --git a/graphics/Validation_WOfS/point4.txt b/graphics/Validation_WOfS/point4.txt
@@ -0,0 +1,4 @@
+16816119.756
+-3224903.887
+16880118.324
+-3180376.346
diff --git a/graphics/Validation_WOfS/point4_l8.jpg b/graphics/Validation_WOfS/point4_l8.jpg
diff --git a/graphics/Validation_WOfS/point4_wofs.jpg b/graphics/Validation_WOfS/point4_wofs.jpg
diff --git a/graphics/Validation_WOfS/point5.txt b/graphics/Validation_WOfS/point5.txt
@@ -0,0 +1,4 @@
+16394664.045
+-4181408.871
+16408032.981
+-4172107.321
diff --git a/graphics/Validation_WOfS/point5_l8.jpg b/graphics/Validation_WOfS/point5_l8.jpg
diff --git a/graphics/Validation_WOfS/point5_sh_osm.jpg b/graphics/Validation_WOfS/point5_sh_osm.jpg
diff --git a/graphics/Validation_WOfS/point5_wofs.jpg b/graphics/Validation_WOfS/point5_wofs.jpg
diff --git a/graphics/Validation_WOfS/point6.jpg b/graphics/Validation_WOfS/point6.jpg
diff --git a/notebooks/ExplodeShpPolylines.ipynb b/notebooks/ExplodeShpPolylines.ipynb
diff --git a/notebooks/ExplodeShpPolylinesSH.ipynb b/notebooks/ExplodeShpPolylinesSH.ipynb