Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release v9.3.0 #2569

Merged
merged 58 commits into from
Jan 27, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
19814ba
add velocity option for OPERA_DISP_TMS jobs
asjohnston-asf Jan 13, 2025
038db24
ruff fixes
AndrewPlayer3 Jan 13, 2025
cd47ae6
Update tests/test_api/test_list_jobs.py
AndrewPlayer3 Jan 13, 2025
f48150a
Merge pull request #2554 from ASFHyP3/ruff-fixes
jtherrmann Jan 13, 2025
aa0f27f
Merge branch 'develop' into velocity2
asjohnston-asf Jan 13, 2025
bafe2de
Bump ASFHyP3/actions from 0.13.2 to 0.14.0
dependabot[bot] Jan 13, 2025
330e905
Merge pull request #2553 from ASFHyP3/velocity2
asjohnston-asf Jan 13, 2025
46026ed
restore automated deployment to hyp3-opera-disp-sandbox deployment
asjohnston-asf Jan 14, 2025
8c0ad40
fix python version
asjohnston-asf Jan 14, 2025
407064e
Merge pull request #2560 from ASFHyP3/disp-sandbox
asjohnston-asf Jan 14, 2025
3ae416c
Merge pull request #2559 from ASFHyP3/dependabot/github_actions/ASFHy…
jtherrmann Jan 15, 2025
56d49f0
upgrade to mypy action v0.15.0
jtherrmann Jan 18, 2025
5256ea3
Bump cfn-lint from 1.22.3 to 1.22.5
dependabot[bot] Jan 20, 2025
5749400
Bump boto3 from 1.35.93 to 1.36.2
dependabot[bot] Jan 20, 2025
42712ff
Bump ASFHyP3/actions from 0.14.0 to 0.15.0
dependabot[bot] Jan 20, 2025
3940fa2
Merge branch 'update-mypy-options' into dependabot/github_actions/ASF…
jtherrmann Jan 20, 2025
e1632e5
Merge pull request #2565 from ASFHyP3/dependabot/github_actions/ASFHy…
jtherrmann Jan 20, 2025
17dedf9
update code of conduct per guidance from NASA
jtherrmann Jan 22, 2025
185c3bf
Merge pull request #2567 from ASFHyP3/update-code-of-conduct
jtherrmann Jan 22, 2025
1a85c4c
Merge pull request #2564 from ASFHyP3/dependabot/pip/boto3-1.36.2
jtherrmann Jan 23, 2025
5aded4a
Bump moto[dynamodb] from 5.0.26 to 5.0.27
dependabot[bot] Jan 23, 2025
753ebba
Merge pull request #2563 from ASFHyP3/dependabot/pip/moto-dynamodb--5…
jtherrmann Jan 23, 2025
4401ccf
Merge pull request #2562 from ASFHyP3/dependabot/pip/cfn-lint-1.22.5
jtherrmann Jan 23, 2025
8bebfd4
Bump responses from 0.25.3 to 0.25.6
dependabot[bot] Jan 23, 2025
9ecc135
Merge pull request #2561 from ASFHyP3/dependabot/pip/responses-0.25.6
jtherrmann Jan 23, 2025
713442c
Bump setuptools from 75.7.0 to 75.8.0
dependabot[bot] Jan 23, 2025
70f0a77
Add validator for SRG jobs to check bounds size + remove default bounds
williamh890 Jan 23, 2025
d76cc58
update changelog
williamh890 Jan 23, 2025
6be8b28
for srg jobs bounds check add provided box size to error message
williamh890 Jan 23, 2025
2e4d4f8
SRG bounds check rounds to 2 decimal places in error message
williamh890 Jan 23, 2025
7f2b59e
Merge pull request #2568 from ASFHyP3/check-bounds-size
williamh890 Jan 23, 2025
4db2717
update example SRG job bounds
williamh890 Jan 23, 2025
d045bca
Merge pull request #2570 from ASFHyP3/update-srg-example-jobs
williamh890 Jan 23, 2025
b9fd98e
Merge pull request #2558 from ASFHyP3/dependabot/pip/setuptools-75.8.0
jtherrmann Jan 23, 2025
06a595b
fix arguments for bounds area check
forrestfwilliams Jan 24, 2025
da54dc5
fix import order
forrestfwilliams Jan 24, 2025
d678046
fix tests
forrestfwilliams Jan 24, 2025
c49db5f
ruff formatting
forrestfwilliams Jan 24, 2025
be5b4e1
fix ruff 2
forrestfwilliams Jan 24, 2025
703ebfa
ruff fix 3
forrestfwilliams Jan 24, 2025
f2952b5
fix ruff 4
forrestfwilliams Jan 24, 2025
3587143
fix ruff 5
forrestfwilliams Jan 24, 2025
68a8ea2
fix ruff 6
forrestfwilliams Jan 24, 2025
b51ea0f
Merge pull request #2571 from ASFHyP3/fix_bounds_validator
forrestfwilliams Jan 24, 2025
9213ccd
Add unit test to check validator function signiture
williamh890 Jan 24, 2025
611eea9
Allow for _ in validator function signatures
williamh890 Jan 24, 2025
f08b50f
rename file variable
jtherrmann Jan 24, 2025
e2d7c36
prefix private validation.py functions with underscore
jtherrmann Jan 24, 2025
34a92d1
updates to validator function signature test
williamh890 Jan 24, 2025
4b0ca16
Add assertion to validators unit test
williamh890 Jan 24, 2025
a90181b
Merge pull request #2572 from ASFHyP3/validator-function-signature-test
williamh890 Jan 24, 2025
e23fdcd
fix changelog
jtherrmann Jan 24, 2025
7e6ce44
Merge pull request #2573 from ASFHyP3/fix-changelog
jtherrmann Jan 25, 2025
555ca60
remove ability to pass [0,0,0,0] as valid bounds
williamh890 Jan 27, 2025
9314490
update code formatting
williamh890 Jan 27, 2025
86bd840
updates for ruff
williamh890 Jan 27, 2025
a96a075
update variable name in validator test
williamh890 Jan 27, 2025
c50a03b
Merge pull request #2575 from ASFHyP3/remove-default-bounds
williamh890 Jan 27, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/changelog.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@

jobs:
call-changelog-check-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-changelog-check.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-changelog-check.yml@v0.15.0

Check warning

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions Job or Workflow does not set permissions
2 changes: 1 addition & 1 deletion .github/workflows/create-jira-issue.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,10 @@

jobs:
call-create-jira-issue-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-create-jira-issue.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-create-jira-issue.yml@v0.15.0
secrets:
JIRA_BASE_URL: ${{ secrets.JIRA_BASE_URL }}
JIRA_USER_EMAIL: ${{ secrets.JIRA_USER_EMAIL }}
JIRA_API_TOKEN: ${{ secrets.JIRA_API_TOKEN }}
JIRA_PROJECT: ${{ secrets.JIRA_PROJECT }}
JIRA_FIELDS: ${{ secrets.JIRA_FIELDS }}

Check warning

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions Job or Workflow does not set permissions
2 changes: 1 addition & 1 deletion .github/workflows/deploy-daac.yml
Original file line number Diff line number Diff line change
Expand Up @@ -112,6 +112,6 @@ jobs:
call-bump-version-workflow:
if: github.ref == 'refs/heads/main'
needs: deploy
uses: ASFHyP3/actions/.github/workflows/reusable-bump-version.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-bump-version.yml@v0.15.0
secrets:
USER_TOKEN: ${{ secrets.TOOLS_BOT_PAK }}
80 changes: 80 additions & 0 deletions .github/workflows/deploy-opera-disp-sandbox.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
name: Deploy OPERA-DISP Sandbox Stack to AWS

on:
push:
branches:
- develop

concurrency: ${{ github.workflow }}-${{ github.ref }}

jobs:
deploy:
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
include:
- environment: hyp3-opera-disp-sandbox
domain: hyp3-opera-disp-sandbox.asf.alaska.edu
template_bucket: cf-templates-1hz9ldhhl4ahu-us-west-2
image_tag: test
product_lifetime_in_days: 14
default_credits_per_user: 0
default_application_status: APPROVED
cost_profile: DEFAULT
deploy_ref: refs/heads/develop
job_files: >-
job_spec/OPERA_DISP_TMS.yml
instance_types: r6id.xlarge,r6id.2xlarge,r6id.4xlarge,r6id.8xlarge,r6idn.xlarge,r6idn.2xlarge,r6idn.4xlarge,r6idn.8xlarge
default_max_vcpus: 640
expanded_max_vcpus: 640
required_surplus: 0
security_environment: ASF
ami_id: /aws/service/ecs/optimized-ami/amazon-linux-2023/recommended/image_id
distribution_url: ''

environment:
name: ${{ matrix.environment }}
url: https://${{ matrix.domain }}

steps:
- uses: actions/[email protected]

- uses: aws-actions/configure-aws-credentials@v4

Check warning

Code scanning / CodeQL

Unpinned tag for a non-immutable Action in workflow Medium

Unpinned 3rd party Action 'Deploy OPERA-DISP Sandbox Stack to AWS' step
Uses Step
uses 'aws-actions/configure-aws-credentials' with ref 'v4', not a pinned commit hash
with:
aws-access-key-id: ${{ secrets.V2_AWS_ACCESS_KEY_ID }}
aws-secret-access-key: ${{ secrets.V2_AWS_SECRET_ACCESS_KEY }}
aws-session-token: ${{ secrets.V2_AWS_SESSION_TOKEN }}
aws-region: ${{ secrets.AWS_REGION }}

- uses: actions/setup-python@v5
with:
python-version: 3.13

- uses: ./.github/actions/deploy-hyp3
with:
TEMPLATE_BUCKET: ${{ matrix.template_bucket }}
STACK_NAME: ${{ matrix.environment }}
DOMAIN_NAME: ${{ matrix.domain }}
API_NAME: ${{ matrix.environment }}
CERTIFICATE_ARN: ${{ secrets.CERTIFICATE_ARN }}
IMAGE_TAG: ${{ matrix.image_tag }}
PRODUCT_LIFETIME: ${{ matrix.product_lifetime_in_days }}
VPC_ID: ${{ secrets.VPC_ID }}
SUBNET_IDS: ${{ secrets.SUBNET_IDS }}
SECRET_ARN: ${{ secrets.SECRET_ARN }}
CLOUDFORMATION_ROLE_ARN: ${{ secrets.CLOUDFORMATION_ROLE_ARN }}
DEFAULT_CREDITS_PER_USER: ${{ matrix.default_credits_per_user }}
DEFAULT_APPLICATION_STATUS: ${{ matrix.default_application_status }}
COST_PROFILE: ${{ matrix.cost_profile }}
JOB_FILES: ${{ matrix.job_files }}
DEFAULT_MAX_VCPUS: ${{ matrix.default_max_vcpus }}
EXPANDED_MAX_VCPUS: ${{ matrix.expanded_max_vcpus }}
MONTHLY_BUDGET: ${{ secrets.MONTHLY_BUDGET }}
REQUIRED_SURPLUS: ${{ matrix.required_surplus }}
ORIGIN_ACCESS_IDENTITY_ID: ${{ secrets.ORIGIN_ACCESS_IDENTITY_ID }}
SECURITY_ENVIRONMENT: ${{ matrix.security_environment }}
AMI_ID: ${{ matrix.ami_id }}
INSTANCE_TYPES: ${{ matrix.instance_types }}
DISTRIBUTION_URL: ${{ matrix.distribution_url }}
AUTH_PUBLIC_KEY: ${{ secrets.AUTH_PUBLIC_KEY }}
Comment on lines +12 to +80

Check warning

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions Job or Workflow does not set permissions
2 changes: 1 addition & 1 deletion .github/workflows/labeled-pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,4 @@

jobs:
call-labeled-pr-check-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-labeled-pr-check.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-labeled-pr-check.yml@v0.15.0

Check warning

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions Job or Workflow does not set permissions
2 changes: 1 addition & 1 deletion .github/workflows/release-template-comment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ on:

jobs:
call-release-checklist-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-release-checklist-comment.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-release-checklist-comment.yml@v0.15.0
permissions:
pull-requests: write
with:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@

jobs:
call-release-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-release.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-release.yml@v0.15.0
with:
release_prefix: HyP3
secrets:
USER_TOKEN: ${{ secrets.TOOLS_BOT_PAK }}

Check warning

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions Job or Workflow does not set permissions
6 changes: 3 additions & 3 deletions .github/workflows/static-analysis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,10 +8,10 @@ on: push
jobs:
call-ruff-workflow:
# Docs: https://github.com/ASFHyP3/actions
uses: ASFHyP3/actions/.github/workflows/reusable-ruff.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-ruff.yml@v0.15.0

call-mypy-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-mypy.yml@v0.14.0
uses: ASFHyP3/actions/.github/workflows/reusable-mypy.yml@v0.15.0

cfn-lint:
runs-on: ubuntu-latest
Expand Down Expand Up @@ -84,4 +84,4 @@ jobs:
snyk iac test --severity-threshold=high

call-secrets-analysis-workflow:
uses: ASFHyP3/actions/.github/workflows/reusable-secrets-analysis.yml@v0.13.2
uses: ASFHyP3/actions/.github/workflows/reusable-secrets-analysis.yml@v0.15.0
34 changes: 22 additions & 12 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,16 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [9.3.0]

### Added
- Added `velocity` option for the `tile_type` parameter of `OPERA_DISP_TMS` jobs
- Restored previously deleted `hyp3-opera-disp-sandbox` deployment
- Added validator to check that bounds provided do not exceed maximum size for SRG jobs

### Removed
- Removed default bounds option for SRG jobs

## [9.2.0]

### Added
Expand Down Expand Up @@ -345,7 +355,7 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H
### Changed
- Update `INSAR_ISCE` and `INSAR_ISCE_TEST` job spec for GUNW version 3+ standard and custom products
- `frame_id` is now a required parameter and has no default
- `compute_solid_earth_tide` and `estimate_ionosphere_delay` now default to `true`
- `compute_solid_earth_tide` and `estimate_ionosphere_delay` now default to `true`
- `INSAR_ISCE_TEST` exposes custom `goldstein_filter_power`, `output_resolution`, `dense_offsets`, and `unfiltered_coherence` parameters

## [4.4.1]
Expand Down Expand Up @@ -427,7 +437,7 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H
## [3.10.8]
### Changed
- HyP3 deployments at JPL now use On Demand instances instead of Spot instances to prevent `INSAR_ISCE` jobs from being interrupted.
This *should* be a temporary change.
This *should* be a temporary change.

## [3.10.7]
### Changed
Expand Down Expand Up @@ -571,7 +581,7 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H
## [3.2.0]
### Added
- [`job_spec`s](job_spec/) can now specify a required set of secrets and an AWS Secrets Manage Secret ARN to pull the
secret values from. Notably, secrets are now externally managed and not part of the HyP3 stack.
secret values from. Notably, secrets are now externally managed and not part of the HyP3 stack.

## [3.1.2]
### Added
Expand All @@ -596,13 +606,13 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H
- The `flood_depth_estimator` parameter for `WATER_MAP` jobs is now restricted to a set of possible values.
- Changed the default value for the `flood_depth_estimator` parameter for `WATER_MAP` jobs from `iterative` to `None`.
A value of `None` indicates that a flood map will not be included.
- Reduced `ITS_LIVE` product lifetime cycle from 180 days to 45 days.
- Reduced `ITS_LIVE` product lifetime cycle from 180 days to 45 days.
### Removed
- Removed the `include_flood_depth` parameter for `WATER_MAP` jobs.

## [2.25.0]
### Added
- `INSAR_ISCE` and `INSAR_ISCE_TEST` jobs now accept a `weather_model` parameter to specify which weather model to use
- `INSAR_ISCE` and `INSAR_ISCE_TEST` jobs now accept a `weather_model` parameter to specify which weather model to use
when estimating trophospheric delay data.
- Increases the memory available to `AUTORIFT` jobs for Landsat pairs

Expand Down Expand Up @@ -642,7 +652,7 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H

## [2.21.8]
### Changed
- AUTORIFT jobs for Sentinel-2 scenes can now only be submitted using ESA naming convention.
- AUTORIFT jobs for Sentinel-2 scenes can now only be submitted using ESA naming convention.

## [2.21.7]
### Changed
Expand Down Expand Up @@ -701,7 +711,7 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H

## [2.19.4]
### Changed
- `scale-cluster` now adjusts the compute environment size based on total month-to-date spending, rather than only EC2
- `scale-cluster` now adjusts the compute environment size based on total month-to-date spending, rather than only EC2
spending.

## [2.19.3]
Expand Down Expand Up @@ -865,7 +875,7 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H
- `ASF` (default) -- AWS accounts managed by the Alaska Satellite Facility
- `EDC` -- AWS accounts managed by the NASA Earthdata CLoud
- `JPL` -- AWS accounts managed by the NASA Jet Propulsion Laboratory
- A `security_environment` Make variable used by the `render` target (and any target that depends on `render`).
- A `security_environment` Make variable used by the `render` target (and any target that depends on `render`).
Use like `make security_environment=ASF build`

### Changed
Expand Down Expand Up @@ -936,10 +946,10 @@ HyP3's monthly quota system has been replaced by a credits system. Previously, H

## [2.6.2](https://github.com/ASFHyP3/hyp3/compare/v2.6.1...v2.6.2)
### Added
- New `AmiId` stack parameter to specify a specific AMI for the AWS Batch compute environment
- New `AmiId` stack parameter to specify a specific AMI for the AWS Batch compute environment

### Changed
- `job_spec/*.yml` files are now explicitly selected allowing per-deployment job customization
- `job_spec/*.yml` files are now explicitly selected allowing per-deployment job customization

### Removed
- `AutoriftImage`, `AutoriftNamingScheme`, and `AutoriftParameterFile` CloudFormation stack parameters
Expand Down Expand Up @@ -994,7 +1004,7 @@ to the database but still validate it.
- `name` gets only subscriptions with the given name
- `job_type` gets only subscriptions with the given job type
- `enabled` gets only subscriptions where `enabled` matches
- subscriptions now include `creation_date` which indicates date and time of subscription creation, responses from
- subscriptions now include `creation_date` which indicates date and time of subscription creation, responses from
`GET /subscriptions` are sorted by `creation_date` decending


Expand Down Expand Up @@ -1033,7 +1043,7 @@ to the database but still validate it.
- `lib/dynamo` library to allow sharing common code among different apps.

## Changed
- `POST /jobs` responses no longer include the `job_id`, `request_time`, `status_code`, or `user_id` fields when `validate_only=true`
- `POST /jobs` responses no longer include the `job_id`, `request_time`, `status_code`, or `user_id` fields when `validate_only=true`
- moved dynamodb functionality from `hyp3_api/dynamo` to `lib/dynamo`
- moved job creation buisness logic from `hyp3_api/handlers` to `lib/dynamo`

Expand Down
8 changes: 2 additions & 6 deletions CODE_OF_CONDUCT.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,14 +3,10 @@
## Our Pledge

We as members, contributors, and leaders pledge to make participation in our
community a harassment-free experience for everyone, regardless of age, body
size, visible or invisible disability, ethnicity, sex characteristics, gender
identity and expression, level of experience, education, socio-economic status,
nationality, personal appearance, race, religion, or sexual identity
and orientation.
community a harassment-free experience for everyone.

We pledge to act and interact in ways that contribute to an open, welcoming,
diverse, inclusive, and healthy community.
and healthy community.

## Our Standards

Expand Down
Loading
Loading