Skip to content

ODC SC Meeting 2020 04 09

gamedaygeorge edited this page Apr 8, 2020 · 15 revisions

Attendees

  • Luigi di Fraia (SA Catapult)
  • Federica Moscato (SA Catapult)
  • Robert Woodcock (CSIRO)
  • Syed Rizvi (AMA)
  • Paul Haesler (CSIRO)
  • Kirill Kouzoubov (GA)
  • Tom Butler (GA)
  • Andrew Hicks (FrontierSI)
  • Randall Sunne (USGS)
  • Andrew Cherry (AMA)
  • Chris Morgan (FrontierSI)
  • Caitlin Adams (FrontierSI)
  • Peter Wang (Data61)
  • George Dyke (Symbios)

Apologies

  • Alex Leith (GA)
  • Tony Butzer (USGS)

Minutes

See Google Drive document.

Agenda

  • Welcome
  • Previous Actions
  • State of the Cube
    • CSIRO
      • data-pipeline automated order, cogify and index system moved into the CSIRO EASI Hub k8s deployment. Whilst the original project has now ended a new set of projects are now building on this foundation. It's not ready for general open source release yet but it is being considered by CSIRO.
      • EASI Hub is now running on the official v1.8 release of the datacube-k8s-eks terraform module. Thanks Team CSIRO and GA for the shiny new module.
      • EASI Hub has ported to the new geobuilder build system on Azure DevOps and has the current develop branch of datacube-core and ancillary libraries running in automated Build Pipelines ready for v1.8 release.
      • EASI Hub has seen a modest but steady increase in interest from internal CSIRO users and on the international EASI Hub California deployments.
      • Plans are underway to significantly improve training materials and we'll look forward a way to combine these with some of the others being used (e.g. DEA Sandbox) to create a generic ODC training set/update where applicable. Two issues exist in this regard - use of location, product and band names unique to a deployment environment; Use of Dask in training notebooks.
      • The CSIRO hyperspectral imaging ODC driver development has begun.
        • 2D Zarr driver (Started)
          • No changes to core
          • Supports s3 and disk
          • Flat or nested array structures
        • 2.0 Alpha 3D implementation (planned)
        • 2.0 3D/nD support (planned)
    • Catapult
    • GA
      • .geobox changes are complete. Adopting NetCDF/CF convention for tracking CRS metadata on loaded data. CRS metadata survives many more xarray operations now, unlike previous approach. Better interop with other libraries (xarray.open_dataset).
      • No longer use GDAL python bindings, instead using pyproj+shapely. GDAL python binding are a pain to install and is the most common stumbling point for building a python environment for datacube.
      • Will release 1.8.0rc1 soon.
    • USGS
    • AMA
    • FrontierSI
  • Enhancement Proposals
    • New Proposals
    • Committed Proposals
  • ODC V1.8 and V2.0
    • ODC datacube-k8s-eks v1.8 tagged and released.
  • Other Business
  • Next Meeting and Close
    • TBA

Actions

See the action tracking project.

Outstanding Actions

New Actions

  • Example
Clone this wiki locally