Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

+= datacube 🧊 #3

Merged
merged 60 commits into from
Jul 22, 2024
Merged
Changes from 1 commit
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
08bdc1e
fascinating feature 🪄 - kamangir/bolt#746
kamangir Jul 19, 2024
62137f0
❗️ untested - towards datacube browse and ingest 🚀 - kamangir/bolt#746
kamangir Jul 19, 2024
2eeeedb
rebuild - kamangir/bolt#746
kamangir Jul 19, 2024
8e4fb11
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 19, 2024
e72190b
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 19, 2024
58e4ba3
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 19, 2024
4c3a663
QGIS -= select - kamangir/bolt#746
kamangir Jul 20, 2024
5bc50e4
QGIS refactor - kamangir/bolt#746
kamangir Jul 20, 2024
7f77cfb
firms ingest - kamangir/bolt#746
kamangir Jul 20, 2024
944b10c
datacube refactors - kamangir/bolt#746
kamangir Jul 20, 2024
02ac376
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 20, 2024
0f4fc74
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 20, 2024
65ce42e
datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
8b70c5d
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 20, 2024
1b023ef
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 20, 2024
58926da
pipeline fix, hopefully - kamangir/bolt#746
kamangir Jul 20, 2024
b3f5ba8
firms refactor - kamangir/bolt#746
kamangir Jul 20, 2024
24daba5
firms refactor - kamangir/bolt#746
kamangir Jul 20, 2024
de6d861
generic datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
0dd0c1c
datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
7808d76
rebuild - kamangir/bolt#746
kamangir Jul 20, 2024
04c4033
+= catalog - kamangir/bolt#746
kamangir Jul 20, 2024
52c54cd
datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
a04a813
untested code ❗️ - kamangir/bolt#746
kamangir Jul 20, 2024
4906a49
untested code ❗️ - kamangir/bolt#746
kamangir Jul 20, 2024
b4025df
failures expected ❗️ - kamangir/bolt#746
kamangir Jul 20, 2024
5280aef
datacube browse refactor - kamangir/bolt#746
kamangir Jul 20, 2024
8cccb74
README refactors - kamangir/bolt#746
kamangir Jul 20, 2024
bf81882
datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
c3c19c7
untested code ❗️ - kamangir/bolt#746
kamangir Jul 20, 2024
b4c19fb
datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
0683b5c
@datacube query refactor - kamangir/bolt#746
kamangir Jul 20, 2024
038d97e
untested code ❗️ - kamangir/bolt#746
kamangir Jul 20, 2024
08f35e0
datacube ingest refactor - kamangir/bolt#746
kamangir Jul 20, 2024
ad4ecc6
datacube refactor - kamangir/bolt#746
kamangir Jul 20, 2024
7644780
datacube refactor - kamangir/bolt#746
kamangir Jul 21, 2024
9395605
datacube refactor - kamangir/bolt#746
kamangir Jul 21, 2024
23db7a8
datacube query refactor - kamangir/bolt#746
kamangir Jul 21, 2024
4245e17
datacube query refactor - kamangir/bolt#746
kamangir Jul 21, 2024
167b8b9
datacube query refactor - kamangir/bolt#746
kamangir Jul 21, 2024
746a168
datacube query refactor - kamangir/bolt#746
kamangir Jul 21, 2024
6a8e725
datacube query refactor - kamangir/bolt#746
kamangir Jul 21, 2024
f1fba1f
Datacube refactor - kamangir/bolt#746
kamangir Jul 21, 2024
987c7c8
datacube ingest refactor - kamangir/bolt#746
kamangir Jul 21, 2024
6e65c24
firms_area refactor - kamangir/bolt#746
kamangir Jul 21, 2024
36e7872
firms_area refactor - kamangir/bolt#746
kamangir Jul 21, 2024
e2d3252
firms_area query fix - kamangir/bolt#746
kamangir Jul 21, 2024
f6024e7
pylint fix, hopefuly - kamangir/bolt#746
kamangir Jul 21, 2024
18b833f
doc refactor - kamangir/bolt#746
kamangir Jul 21, 2024
914411f
test refactors - kamangir/bolt#746
kamangir Jul 22, 2024
e9122fe
test refactors - kamangir/bolt#746
kamangir Jul 22, 2024
28d4f90
test refactors - kamangir/bolt#746
kamangir Jul 22, 2024
bb79157
test refactors - kamangir/bolt#746
kamangir Jul 22, 2024
ba52fd6
pytest fix, hopefully - kamangir/bolt#746
kamangir Jul 22, 2024
bed24c8
pylint fix, hopefully - kamangir/bolt#746
kamangir Jul 22, 2024
dad5792
pytest fix, hopefully - kamangir/bolt#746
kamangir Jul 22, 2024
c17597d
pytest fix, hopefully - kamangir/bolt#746
kamangir Jul 22, 2024
b6abcb1
rebuild - kamangir/bolt#746
kamangir Jul 22, 2024
7c3ba15
bas test refactors - kamangir/bolt#746
kamangir Jul 22, 2024
5dc1661
bashtest fix, hopefuly - kamangir/bolt#746
kamangir Jul 22, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
failures expected ❗️ - kamangir/bolt#746
kamangir committed Jul 20, 2024
commit b4025df7d2b38bba61ee29755e23f6f532913b41
10 changes: 9 additions & 1 deletion blue_geo/.abcli/datacube/browse.sh
Original file line number Diff line number Diff line change
@@ -6,8 +6,16 @@ function blue_geo_datacube_browse() {
if [ $(abcli_option_int "$options" help 0) == 1 ]; then
options="catalog=<catalog>"
abcli_show_usage "@datacube browse$ABCUL[$options]$ABCUL<args>" \
"list catalogs."
"browse <catalog>."
return
fi

local catalog=$(abcli_option "$options" catalog unknown)

if [[ ",$blue_geo_datacube_list_of_catalogs," != *",catalog,"* ]]; then
abcli_log_error "-@datacube: browse: $catalog: catalog not found."
return 1
fi

blue_geo_datacube_${catalog}_browse "${@:2}"
}
Empty file.
File renamed without changes.
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
#! /usr/bin/env bash

function firms_browse() {
function blue_geo_datacube_firms_area_browse() {
local options=$1

if [ $(abcli_option_int "$options" help 0) == 1 ]; then
options="home$EOP|map_key|area-api$EOPE"
abcli_show_usage "firms browse$ABCUL$options" \
"browse firms."
abcli_show_usage "@datacube browse firms_area$ABCUL$options" \
"browse firms_area datacubes."
return
fi

Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#! /usr/bin/env bash

function blue_geo_ingest_firms() {
function blue_geo_datacube_ingest_firms_area() {
local options=$1

if [ $(abcli_option_int "$options" help 0) == 1 ]; then
16 changes: 13 additions & 3 deletions blue_geo/.abcli/datacube/ingest.sh
Original file line number Diff line number Diff line change
@@ -1,11 +1,21 @@
#! /usr/bin/env bash

function blue_geo_datacube_ingest() {
local options=$1
local task=$(abcli_unpack_keyword $1 help)

if [ $(abcli_option_int "$options" help 0) == 1 ]; then
:
if [ "$task" == "help" ]; then
blue_geo_ingest_firms "$@"
return
fi

# refactor

local function_name=blue_geo_ingest_$task
if [[ $(type -t $function_name) == "function" ]]; then
$function_name "${@:2}"
return
fi

abcli_log_error "-@datacube: ingest: $task: command not found."
return 1
}
21 changes: 17 additions & 4 deletions blue_geo/.abcli/datacube/list.sh
Original file line number Diff line number Diff line change
@@ -10,6 +10,7 @@ function blue_geo_datacube_list() {
"list catalogs."
return
fi

python3 -m blue_geo.datacube \
list_of_catalogs \
"${@:2}"
@@ -19,7 +20,19 @@ function blue_geo_datacube_ls() {
blue_geo_datacube_list "$@"
}

abcli_log_list "$(blue_geo_datacube_list catalogs --log 0)" \
--delim , \
--before "🧊" \
--after "catalog(s)"
function blue_geo_datacube_load_catalogs() {
abcli_log_list $blue_geo_datacube_list_of_catalogs \
--delim , \
--before "🌐 loading" \
--after "datacube catalog(s)"

local catalog
for catalog in $(echo $blue_geo_datacube_list_of_catalogs | tr , " "); do
abcli_log "🧊 $catalog"
abcli_source_path - caller,suffix=/$catalog
done
}

export blue_geo_datacube_list_of_catalogs=$(blue_geo_datacube_list catalogs --log 0)

blue_geo_datacube_load_catalogs
21 changes: 0 additions & 21 deletions blue_geo/.abcli/ingest.sh

This file was deleted.

9 changes: 0 additions & 9 deletions blue_geo/.abcli/install.sh

This file was deleted.

2 changes: 1 addition & 1 deletion blue_geo/__init__.py
Original file line number Diff line number Diff line change
@@ -4,7 +4,7 @@

DESCRIPTION = f"{ICON} AI for precise geospatial data analysis and visualization."

VERSION = "4.82.1"
VERSION = "4.83.1"

REPO_NAME = "blue-geo"

2 changes: 1 addition & 1 deletion blue_geo/datacube/firms/area/classes.py
Original file line number Diff line number Diff line change
@@ -13,7 +13,7 @@


class FirmsAreaDatacube(GenericDatacube):
catalog = "firms-area"
catalog = "firms_area"

def __init__(
self,
247 changes: 104 additions & 143 deletions notebooks/firms-area-api.ipynb

Large diffs are not rendered by default.