Skip to content

Commit

Permalink
update docstring typos
Browse files Browse the repository at this point in the history
  • Loading branch information
nkshaw23 committed Oct 25, 2024
1 parent d1307a8 commit 73edda2
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions src/driutils/benchmarking/create_test_cosmos_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
1) Original format (no partitioning): /YYYY-MM/YYYY-MM-DD.parquet
2) Current format (partitioned by date): /date=YYYY-MM-DD/data.parquet
3) Proposed format (partitioned by date and site): /sire=site/date=YYYY-MM-DD/data.parquet
3) Proposed format (partitioned by date and site): /site=site/date=YYYY-MM-DD/data.parquet
As discussed, use case for loading from multiple dataset types
(precip, soilmet) unlikely due to different resolutions.
Expand Down Expand Up @@ -106,8 +106,8 @@ def export_test_data(bucket: str, data: pl.DataFrame, structure: str = "partitio
Data can be exported to various s3 structures:
'date': cosmos/dataset_type/YYYY-MM/YYYY-MM-DD.parquet (original format)
'date_partitioned': cosmos/dataset_type/date=YYYY-MM-DD/data.parquet (current format)
'date_site_partitioned': cosmos/dataset_type/site=site/date=YYYY-MM-DD/data.parquet (proposed format)
'partitioned_date': cosmos/dataset_type/date=YYYY-MM-DD/data.parquet (current format)
'partitioned_date_site': cosmos/dataset_type/site=site/date=YYYY-MM-DD/data.parquet (proposed format)
Args:
bucket: Name of the s3 bucket
Expand Down

0 comments on commit 73edda2

Please sign in to comment.