-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add ability to upload STAC collections and STAC items to a STAC API #16
Comments
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 19, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 19, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 20, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 20, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 20, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 20, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 20, 2024
…nd save intermediate vpp metadata to geoparquet
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 21, 2024
…w collections: saving 10k to 100k STAC items without linking to collection
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 22, 2024
We retrieve products from VPP in a piecemeal way, because there is a limit on the amount of products you can get in one query. The client doesn't have full support for pagination, so we adapt our query to limit the number of products per query. This divides the total termporal extent of the collection into small enough time slots. But some products have a long enoug period (start/end datetime) that they span several of the time slots we request. That lead to the producst being received multiple times. Solution: We now check if we already have the product and skip it when it is a duplicate.
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 23, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 23, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 23, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 26, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
…nd save intermediate vpp metadata to geoparquet
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
…w collections: saving 10k to 100k STAC items without linking to collection
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
We retrieve products from VPP in a piecemeal way, because there is a limit on the amount of products you can get in one query. The client doesn't have full support for pagination, so we adapt our query to limit the number of products per query. This divides the total termporal extent of the collection into small enough time slots. But some products have a long enoug period (start/end datetime) that they span several of the time slots we request. That lead to the producst being received multiple times. Solution: We now check if we already have the product and skip it when it is a duplicate.
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 27, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 28, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Feb 29, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 1, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 1, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 1, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 4, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 5, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 5, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 5, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 5, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 5, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 5, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
JohanKJSchreurs
added a commit
that referenced
this issue
Mar 6, 2024
Implemented by the following two PRs: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add ability to upload the created STAC collections and STAC items to a STAC API
We will use this for the HRL VPP data in this ticket
Open-EO/openeo-geopyspark-driver#460
Breakdown of requirements
Input side
Some Technical Points
Because stac-catalog-builder is intended to be reasonably generic, its structure must allow to work with two types of inputs:
And similarly, on the output side it should support creating both:
Output side, Uploading to the STAC API, for HR VPP:
The text was updated successfully, but these errors were encountered: