CI/CD pipeline cleanup #1
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* updated MosaicAnalyser section of quickstart notebook * A few other tweaks * Typo
….1 (#544) Bumps [org.apache.maven.plugins:maven-assembly-plugin](https://github.com/apache/maven-assembly-plugin) from 3.7.0 to 3.7.1. - [Release notes](https://github.com/apache/maven-assembly-plugin/releases) - [Commits](apache/maven-assembly-plugin@maven-assembly-plugin-3.7.0...maven-assembly-plugin-3.7.1) --- updated-dependencies: - dependency-name: org.apache.maven.plugins:maven-assembly-plugin dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Merged with the expansion of the grid
* fixing deletion / typing issues for checkpointing * fix diff * does it build on GH? * changed some of the python tests to allow the package to build with checkpointing by default * updated R tests to allow checkpointing by default * prep to pass around tmp prefix * added RST_Type function to get type for each raster band * added rst_updatetype * added python bindings and docs * added R tests * fix to SQL reg for RST_Transform * Feature/tin mesh (#569) * added methods for triangulation and interpolation, data for testing * updated interpolation function to use an STRTree * fails due to row size exceeding heap * working generator for unconstrained triangulation * conforming triangulation appears to be working * added st_interpolateelevation expression and updated wkb / wkt writers to respect coordinate dimension * removed buffer for input masspoints * first pass at rasterization, added toWKT and toWKB that can explicitly specify coordinate dimensions * added a GDALRasterize operator to write outputs * added RST_DTMFromGeoms initial implementation and tests * fixed issues with interpolation and triangulation split points missing Z values * updated tests to use 1km subset of masspoints * fixed failing tests * ran black on python module * added python bindings for new functions * added triangulation and interpolation python tests * added python test for raster function * added python test for raster function * added SparkR tests for vector functions * added SparkR tests for raster function * added sparklyr tests for vector functions * added raster function tests to sparklyr bindings / fixed typo in sql registration for rst_dtmfromgeoms * description of st_triangulate * mistake in BNG grid * grid points are silently dropped if not in triangulated area (will be set equal to NoData value when raster written) * updated logic of rasterize method to handle empty geometry collections * hardcoded algorithm tolerance to zero * check / fix failing test * small docs updates * minor docs fix, split out tolerance into two params * updated docs / added examples for st_triangulate * added docs for interpolateelevation and dtmfromgeoms * ran isort, reverted h3 version bump, removed unused import
…rst_pixelcount. (#576) Co-authored-by: Michael Johns <[email protected]>
* formatter, added rst_setsrid to docs * standardize on rst_tooverlappingtiles, mark rst_to_overlapping_tiles as deprecated * fixed error in RST_WorldToRasterCoordY (was returning x) * marked rst_to_overlapping_tiles deprecated in MosaicContext * updated RST_PixelCount to take extra params * fixed failing python test * added rst_write expression for writing rasters * fixed R test * added cutline option to RST_Clip * minor docs tweak * `MosaicRasterGDAL` does not need `memsize` at instantiation. Will be estimated from band data types and sizes if not known * formatter run on the python bindings
…pointing disabled, added checkpointing explanation and instructions to documentation
…n / checkpoint off tests)
* fixes to triangulation; exposed split point finding algorithm choice * updated R bindings and tests * fixed python bindings and tests * fixed failing test (sidecar files not cleaned up between checkpoint on / checkpoint off tests) * updated docs to reflect new sigs of triangulation funcs
* changes to the RasterAsGridReader and ReTileOnRead processes * removed some cruft * switch runners * fixed failing zarr tests * disabled the test for netcdf with checkpointing disabled
… with small clipping outputs
* changes to the RasterAsGridReader and ReTileOnRead processes * removed some cruft * switch runners * fixed failing zarr tests * disabled the test for netcdf with checkpointing disabled * added function `RST_AsFormat()` to change raster format / driver in-situ * fixed zarr test * added python bindings and tests
* updated the logic of some of the statistical raster functions to work with small clipping outputs
Pre 0.4.3 release
Final tweaks before release
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fix/quickstart-MosaicAnalyzer (https://github.com/databrickslabs/mosaic/pull/565[)](https://github.com/a0x8o/mosaic/commit/f62407ba9d2233cceaac37c77a53b5fed3cb4726)
Bump org.apache.maven.plugins:maven-assembly-plugin from 3.7.0 to 3.7…
fix: typo in lettermap SZ->HZ (https://github.com/databrickslabs/mosaic/pull/433[)](https://github.com/a0x8o/mosaic/commit/bef8c1b2b3617e8334d8c030bb2981e38cf50808)
RST_Type RST_UpdateType (https://github.com/databrickslabs/mosaic/pull/564[)](https://github.com/a0x8o/mosaic/commit/ea37ddab0a07597d4b3d3f01c5f783af5681ce79)
fixes 571, added test (https://github.com/databrickslabs/mosaic/pull/574[)](https://github.com/a0x8o/mosaic/commit/53b22cf83e50531deddf209f53a25aa6a53ccc20)
added python bindings for rst_avg, rst_max, rst_median, rst_min, and …
added missing driver param documented for RST_FromContent (databrickslabs#577
fixed missing bindings for rst_type and rst_updatetype
pinned numpy version
added gdal UDF example to docs (https://github.com/databrickslabs/mosaic/pull/579[)](https://github.com/a0x8o/mosaic/commit/0a9d8bd8a16ab3d34fab201d8fdac5d673be261d)
Raster api tweaks (https://github.com/databrickslabs/mosaic/pull/578[)](https://github.com/a0x8o/mosaic/commit/a019c23be3a217ccd3002f28474dc19b4a25eb11)
fixed issue 434: some two digit BNG grid references interpreted as qu…
updated CHANGELOG
catch for writing subdataset-based rasters over FUSE
additional test for subdivide on subdatasets
disabled checkpointing by default, fixed RST_Write failure when check…
fix failing python test (1)
fix failing python test (2)
swap chown for chmod
fix failing R tests
fixes to triangulation; exposed split point finding algorithm choice
updated R bindings and tests
fixed python bindings and tests
fixed failing test (sidecar files not cleaned up between checkpoint o…
updated docs to reflect new sigs of triangulation funcs
Resolving triangulation issues (https://github.com/databrickslabs/mosaic/pull/592[)](https://github.com/a0x8o/mosaic/commit/a9b17e4a4dc9c7647905b248ea894b6659b95a1c)
changes to the RasterAsGridReader and ReTileOnRead processes
removed some cruft
switch runners
fixed failing zarr tests
disabled the test for netcdf with checkpointing disabled
added function RST_AsFormat() to change raster format / driver in-situ
fixed zarr test
Fixes to the raster as grid reader (https://github.com/databrickslabs/mosaic/pull/593[)](https://github.com/a0x8o/mosaic/commit/27fd3eccbe2d9957860eefcdfa7aa3198ddcc45d)
added python bindings and tests
updated the logic of some of the statistical raster functions to work…
Update file format in-situ (https://github.com/databrickslabs/mosaic/pull/596[)](https://github.com/a0x8o/mosaic/commit/a8ef2d3712b06ac4c772a6588796309a367d4f34)
Small area stats (https://github.com/databrickslabs/mosaic/pull/597[)](https://github.com/a0x8o/mosaic/commit/851e69dda44850c5dc74bf016b5e63680d402850)
Merge pull request databrickslabs#575 from databrickslabs/pre-0.4.3-r…
updated changelog
updated version ref in documentation
updated docs for raster_to_grid
Merge branch 'main' into fix/changelog-0.4.3
Merge pull request databrickslabs#598 from databrickslabs/fix/changel…