Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEATURE: read only valid portion of imagery #538

Open
remtav opened this issue Jul 19, 2023 · 1 comment
Open

FEATURE: read only valid portion of imagery #538

remtav opened this issue Jul 19, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@remtav
Copy link
Collaborator

remtav commented Jul 19, 2023

Is your feature request related to a problem? Please describe.
Problem: some mosaics we use consists mostly of nodata regions. For example, NB_Edmunstron_2016-B:
image

This 15 cm image covers approx. 24 x 19.5 km -> 468 km2 including nodata (5200 km2 in 50 cm equivalent). The file for each indivial band itself is over 28Gb. However, the valid portion of this image covers appox. 10-15 % of the entire image.

How can we optimize this?

@mpelchat04 had brought up this issue already... The only solution we could come up with was creating smaller mosaics.

Describe the solution you'd like
How can nodata be supported along the way, in the dataloader for example? Anywhere else? Any other ideas?

@remtav remtav added the enhancement New feature or request label Jul 19, 2023
@remtav
Copy link
Collaborator Author

remtav commented Oct 16, 2023

Update: this remains a major optimization issue for our extraction pipeline :)

Other examples where valid data is less than 75%:
image
image
image
image
image
image
image
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant