27 Feb 16:43

awsbuild

e612817

Release 2.4.1 Latest

Latest

Oasis Release v2.4.1

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.4.1

#1149, #1150 - Fixed missing stack trace logging for V1 workers
#1129 - Platform schema generation - minor changes between versions.
#1170 - Azure Service Principal for Postgres SQL authentication - (#1169)
#1171 - Update expected validation errors for ods-tools 4.0.1

OasisLMF Changelog - 2.4.1

#1629 - Add computaion schema to CI and update documentaion
#1604 - exposure run crashes if CondPeril is missing
#1634 - Update release section in readme
#1603 - Feature/aalpy
#1573 - Update or Remove preparation/oed.py
#1638 - CI Fix, Skip incompatible client checks
#1579 - Eltpy, python replacement for eltcalc
#1590 - Pltpy, python replacement for pltcalc
#1628 - Update pages workflow
#1630 - fix issue with loc id
#1631 - specify parquet folder to improve footprint read time

ODS_Tools Changelog - 4.0.1

#173 - Feature/v4 integration
#176 - Drop testing for py3.8
#178 - Adjust model settings schema, replace AllOf with schema refs
#175 - Min package pin needed for jsonschema
#181 - drop py3.8 testing but don't force the version

Release Notes

OasisPlatform Notes

Fixed missing stack trace logging for V1 workers - (PR #1164)

Needed to write the trace to oasis logger, not root celery task logger

Pin drf-yasg package - (PR #1168)

Fixes #1129

Update expected validation errors for ods-tools 4.0.1 - (PR #1171)

CI fix

OasisLMF Notes

Added computation schema build to CI - (PR #1632)

Drop py3.8 from unit testing (python support ended)
Added computation schema build to CI

fix missing cond column when no term present - (PR #1633)

fix for OasisLMF/OasisLMF#1604

aalpy, python replacement for aalcalc and aalmeanonlycalc - (PR #1603)

This PR introduces creating AAL and ALCT files with the python replacement of the original aalcalc and aalmeanonlycalc found in ktools.

Solves AAL in OasisLMF/OasisLMF#1528

Refactor preparation/oed.py - (PR #1635)

The file preparation/oed.py contains a lot of unused code. This PR removes any unneeded code from the file and moves the constants to utils.

CI Fix, Skip incompatible client checks - (PR #1638)

This issue OasisLMF/OasisLMF#1618 (fixed in CI) can still cause problems locally if responses>=0.25.3
Check responses version installed the and disable these tests if not supported.

Eltpy, python replacement for eltcalc - (PR #1579)

This PR introduces the possibility of creating some summary files (SELT, MELT, QELT) with the python replacement of the original eltcalc and summarycalctocsv found in ktools.

Pltpy, python replacement for pltcalc - (PR #1590)

This PR introduces the possibility of creating some summary files (SPLT, MPLT, QPLT) with the python replacement of the original pltcalc found in ktools.

Solves PLT in OasisLMF/OasisLMF#1528

Update pages workflow - (PR #1628)

CI fix

Fix for pre analysis hook loc_id - (PR #1630)

Adapt the pre analysis hook to the new exposure preparation function, use prepare_oed_exposure instead of prepare_location_df.
"prepare_oed_exposure" doesn't create the loc_id column anymore, this was cerating an issue and the hook was not regeneration the column anymore

Improve parquet footprint performance - (PR #1631)

specify the event folder when reading footprint parquet file.
The parquet S3 interface is quite slow to filter by event even if it is partition by event.
This change improve greatly the performance by targeting the relevant folder when retrieving a footprint event

This help to partially solve OasisLMF/OasisLMF#1600

ODS_Tools Notes

Integrate new coverages and perils in OdsTools - (PR #173)

Drop testing for py3.8 - (PR #176)

Adjust model settings schema, replace AllOf with schema refs - (PR #178)

Fix for OasisLMF/ODS_Tools#177 - schema is functionally the name

set min pin for jsonschema - (PR #179)

Fixes OasisLMF/ODS_Tools#175

drop py3.8 testing but don't force the version - (PR #181)

Fix for CI

Assets 5

27 Feb 16:43

awsbuild

2.3.13

ee674be

Release 2.3.13

Oasis Release v2.3.13

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.3.13

#1149, #1150 - Fixed missing stack trace logging for V1 workers
#1158 - Worker controller detects pending V1 task and tries to scale V2 workers

OasisLMF Changelog - 2.3.13

#1604 - exposure run crashes if CondPeril is missing
#1638 - CI Fix, Skip incompatible client checks

Release Notes

OasisPlatform Notes

Fixed missing stack trace logging for V1 workers - (PR #1164)

Needed to write the trace to oasis logger, not root celery task logger

Worker controller detects pending V1 task and tries to scale V2 workers - (PR #1158)

Fixed issue where a analysis run requests is on a V1 queue will be viewed as a waiting V2 analyses.
This causes the auto-scaling to spin workers up and down.

OasisLMF Notes

fix missing cond column when no term present - (PR #1633)

fix for OasisLMF/OasisLMF#1604

CI Fix, Skip incompatible client checks - (PR #1638)

This issue OasisLMF/OasisLMF#1618 (fixed in CI) can still cause problems locally if responses>=0.25.3
Check responses version installed the and disable these tests if not supported.

Should output the correct error message as shown in the example

Error: PolInceptionDate missing for {'PortNumber': '1', 'AccNumber': 'A11111'}, cannot use AttachmentBasis [RA]. Please check the account file

Assets 5

27 Feb 16:43

awsbuild

1.28.11

b434dfb

Release 1.28.11

Oasis Release v1.28.11

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 1.28.11

#1169 - Azure Service Principal for Postgres SQL authentication -
#1147 - Release notes script - skip merge commits
#1149, #1150 - Fixed missing stack trace logging for V1 workers

OasisLMF Changelog - 1.28.11

#1604 - exposure run crashes if CondPeril is missing
#1638 - CI Fix, Skip incompatible client checks
#1611 - fix loss_out len in account level back allocation
#1618 - Fix testing failures (API Client)
#1599 - Fixes for CI testing stable 1.28.x

Release Notes

OasisPlatform Notes

Release notes script - skip merge commits - (PR #1147)

Update repo scraper to skip any merged commits from release notes

Fixed missing stack trace logging for V1 workers - (PR #1164)

Needed to write the trace to oasis logger, not root celery task logger

OasisLMF Notes

fix missing cond column when no term present - (PR #1633)

fix for OasisLMF/OasisLMF#1604

CI Fix, Skip incompatible client checks - (PR #1638)

This issue OasisLMF/OasisLMF#1618 (fixed in CI) can still cause problems locally if responses>=0.25.3
Check responses version installed the and disable these tests if not supported.

Fix fmpy back allocation for account level term - (PR #1611)

Trim loss_out to the correct length before account level term back allocation

Fix testing failures (API Client) - (PR #1618)

Objected returned from a mocked API post has changed between versions of the responses
Pinning to responses<=0.25.3 for now, but test should be updated later

Fixes for CI testing stable 1.28.x - (PR #1599)

Remove numpy max version pin and fix plat2 testing

Assets 3

04 Feb 09:11

awsbuild

2.4.0

9b270c3

Release 2.4.0

Oasis Release v2.4.0

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.4.0

#1097 - Extend sub-tasks to track and log any retries attempts
#1158 - Worker controller detects pending V1 task and tries to scale V2 workers
#1160 - Fix/testing oed4 update
#1123 - Generate oasis files is not using the pre-analysis adjusted location file for V2 runs
#1162 - Fix/v2 location loading
#1163 - Workaround for ods tools issue #174
#1035 - Remove debug mounts and refs in default compose file
#1047 - Tidy up docker compose examples
#1052 - Lot3 - worker monitor compatibility fix needed
#1070 - Use version 2 of the API on api ls commands
#904 - Lot3 - Load model data from object storage
#1089 - Fixed CVEs from fiona package
#1094 - Updated Package Requirements: twisted==24.7.0rc1
#1101 - Only run attach project issues workflow from Our repo - not forks
#1128 - Update python 3.12
#1142 - Project PR action - incorrectly running on external PRs
#689 - Add mechanism to list, and return individual files from tar

OasisLMF Changelog - 2.4.0

#1394 - Net RI losses do not use -z in summarycalc
#1607 - Fix/lookup sort keys
#1591 - Dynamic footprint has incorrect type 1 losses
#1611 - fix loss_out len in account level back allocation
#1615 - Non-useful error message for missing PolInceptionDate with RA Basis reinsurance
#1552 - Make analysis and model setting able to modify any computation step parameters (MDK parameters)
#1618 - Fix testing failures (API Client)
#1619 - Fix/ci pre analysis testing
#1624 - Feature/oed v4
#1625 - feat: security enhancements

ODS_Tools Changelog - 4.0.0

#146 - OED Settings merger
#167 - Fix default for do_disaggregation in schema
#170 - Update OED schema to release v4
#172 - CI Fix - branches renamed in OED repo
#173 - Feature/v4 integration

Release Notes

OasisPlatform Notes

Update subtasks when a retry is attempted - (PR #1155)

Added two new fields to analyses sub-task object

retry_count number of failed retry attempts
retry_log error trace for each failed retry attempt (appended to on each retry)

Worker controller detects pending V1 task and tries to scale V2 workers - (PR #1158)

Fixed issue where a analysis run requests is on a V1 queue will be viewed as a waiting V2 analyses.
This causes the auto-scaling to spin workers up and down.

Fixed platform Unit tests for OED4 update - (PR #1160)

Fix pre analysis hook loading - (PR #1161)

The main branch uses the Oasis-Data-Manager to fetch and store files. There a bug in ffspec that dosn't create local dirs when mkdir is called. Added a work around to make sure the local storage dir exists.

Update the location file loading in platform V2 runs - (PR #1162)

Needed to support the changes in OasisLMF/OasisLMF#1624 ~ Note cyber models will probably not with V2 runs, but should be fine with V1

Workaround for ods tools validation issue #174 - (PR #1163)

See: OasisLMF/ODS_Tools#174

Docker compose, removed debugging options from default - (PR #1036)

The default file docker-compose.yml has all debugging settings removed, instead these are now in compose/debug.docker-compose.yml

Tidy up docker compose examples - (PR #1047)

Removed all outdated examples from compose/

Lot3 work - (PR #958)

Added SQL endpoints for exposure data queries (Currently disabled)
Replaced Remote file storage manager with OasisDataManager package
Added the option to read model_data from a remote object store (S3, Azure BlobStorage)

There are two sets of 'remote storage' configuration options.

General Storage, for files like results and exposure in an ObjectStore - Env var prefix = OASIS_{option}
Model Data Storage, for reading 'model_data' during an analysis execution - Env var prefix = OASIS_WORKER_MODEL_DATA_{option}

For Valid options see src/common/filestore/filestore.py

https://github.com/OasisLMF/OasisPlatform/blob/cc6907ada4b9d67a6f02372572fb81f067f04f21/src/common/filestore/filestore.py#L21-L59

https://github.com/OasisLMF/OasisPlatform/blob/cc6907ada4b9d67a6f02372572fb81f067f04f21/src/common/filestore/filestore.py#L63-L83

Example

OASIS_WORKER_MODEL_DATA_STORAGE_TYPE: S3
OASIS_WORKER_MODEL_DATA_AWS_BUCKET_NAME: oasislmf-model-library-oasis-piwind
OASIS_WORKER_MODEL_DATA_AWS_ACCESS_KEY_ID:  {_ID_}
OASIS_WORKER_MODEL_DATA_AWS_SECRET_ACCESS_KEY:  {_KEY_}
OASIS_WORKER_MODEL_DATA_ROOT_DIR: model_data/

When set on a worker container, these are used to create a model_storage.json file which is then passed into the execution command so model data is pulled directly from OASIS_WORKER_MODEL_DATA_AWS_BUCKET_NAME

Fixed CVEs from fiona package - (PR #1089)

Updated Package Requirements: fiona==1.10b1 for CVE-2023-45853 & CVE-2020-14152

Updated Package Requirements: twisted==24.7.0rc1 - (PR #1094)

Only run attach project issues workflow from Our repo - not forks - (PR #1101)

CI fix for external PRs

Update main platform branch to latest Oasislmf package - (PR #1102)

Update docker base images and python packages - (PR #1128)

Update docker base images to ubuntu LTS 24.04
regenerate python package requirements files
Load CVE scanning DB from Github actions cache (Trivy)

Project PR action - incorrectly running on external PRs - (PR #1142)

External PR fail on the actions Job 'Project PR' - disable this action if the PR is from a Fork

Add endpoints to list and return individual files from tar - (PR #1151)

The following endpoints were added:

/analyses/{id}/{tar_file}_tar_list/: List the contents of {tar_file}
/analyses/{id}/{tar_file}_tar_extract/?filename={filename}: Extract {filename} from {tar_file}

These endpoints can be used on the following tar_files: input_files, output_files.
Issue: #689

OasisLMF Notes

Calculate summarycalc reinsurance without all zeros flag - [(PR #1601)](https://github.com/OasisLMF/...

Assets 5

17 Jan 10:51

awsbuild

2.3.12

39b1de9

Release 2.3.12

Oasis Release v2.3.12

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

#1063 - Expose components versions in API

OasisLMF Changelog - 2.3.12

#1394 - Net RI losses do not use -z in summarycalc
#1618 - Fix testing failures (API Client)
#1611 - fix loss_out len in account level back allocation
#1615 - Non-useful error message for missing PolInceptionDate with RA Basis reinsurance

ODS_Tools Changelog - 3.2.10

#167 - Fix default for do_disaggregation in schema
#172 - CI Fix - branches renamed in OED repo

Release Notes

OasisPlatform Notes

Expose components versions in API - (PR #1152)

Add ods-tools version and oed spec version to the following endpoints:

/server_info : Version of these components on the server.
/models/{id}/versions: Versions of these components on model workers.

Issue: #1063

OasisLMF Notes

Calculate summarycalc reinsurance without all zeros flag - (PR #1601)

Running summarycalc with the -z flag for Net RI was running into significant performance issues.

To resolve this, this PR:

removes the output all zeros flag when running summarycalc or summarypy
adds an additional check on the the mean_idx to catch non-zeros that were previously being filtered out

Issue: #1394

Fix testing failures (API Client) - (PR #1618)

Objected returned from a mocked API post has changed between versions of the responses
Pinning to responses<=0.25.3 for now, but test should be updated later

Fix fmpy back allocation for account level term - (PR #1611)

Trim loss_out to the correct length before account level term back allocation

fixes error message for missing PolInceptionDate - (PR #1614)

For RA based reinsurance introduced in 2.3.11 OasisLMF/OasisLMF#1576
Solution is to look for both non '_x' and '_x' variants of these column numbers in the row if they exist and output them.

acc_info = {
    field: row[f'{field}_x'] if f'{field}_x' in row else row[f'{field}']
    for field in RISK_LEVEL_FIELD_MAP[oed.REINS_RISK_LEVEL_ACCOUNT]
    if f'{field}_x' in row or f'{field}' in row
}

Should output the correct error message as shown in the example

Error: PolInceptionDate missing for {'PortNumber': '1', 'AccNumber': 'A11111'}, cannot use AttachmentBasis [RA]. Please check the account file

ODS_Tools Notes

Fix default for do_disaggregation to true - (PR #169)

Match schema default to the oasislmf package

CI Fix - branches renamed in OED repo - (PR #172)

Assets 5

28 Nov 18:07

awsbuild

2.3.11

01b1861

Release 2.3.11

Oasis Release v2.3.11

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.3.11

#1125 - Support Cyber models on OasisPlatform
#1134 - Fixed pip install on model worker images
#1139 - Fix/1135 model settings conf
#1129 - Platform schema generation - minor changes between versions.
#1140 - Add DB indexing to fields like Analyses status.
#1147 - Release notes script - skip merge commits

OasisLMF Changelog - 2.3.11

#1394 - Net RI losses do not use -z in summarycalc
#1250 - Support Risk Attaching 'RA' basis in reinsurance
#1581 - oasislmf code uses legacy correlation settings location in model settings
#1589 - Update platform API client for Cyber models
#1594 - improve the memory performance of il layer number continuity step
#1595 - Allow process perils with different resolution grids

ODS_Tools Changelog - 3.2.9

#148 - PLA options to be added into MS/AS schemas explicitly
#151 - Package does not include the validation files

Release Notes

OasisPlatform Notes

Add cybermodels support in the OasisAPI - V1 Only - (PR #1133)

Only for run_mode = V1 allow input generation to work without posting a location.csv file.
Update the check in portfolios to allow execution if Either a location or an account file is attached.

Fixed pip install on model worker images - (PR #1134)

Moving to ubuntu 24.04 uses a version of python with a stricter package manager. Added an env variable to base image as a workaround.

Removed the conf.ini variable MODEL_SETTINGS_FILE from run params - (PR #1139)

In run_mode = v1 the conf.ini MODEL_SETTINGS_FILE variable can override the oasislmf.json
model_settings path. This value has been removed from the run_params. its not ONLY used for a workers auto-registration and the only source of the model_settings path is given by the oasislmf config.

Fix API schema change, missing description fields - (PR #1143)

Issue seems to come from the update to package drf-yasg==1.21.8 from drf-yasg==1.21.5.
Note: this problem dosn't show on main only stable/2.3.x

Fix/1140 status db indexing (stable 2.3.x) - (PR #1145)

Added DB indexing to analyses/sub-task status fields #1140
Added CI testing for DB migration upgrades
Fixed DB migration clashes from main branch
Fixed CVE-2023-43804

Release notes script - skip merge commits - (PR #1147)

Update repo scraper to skip any merged commits from release notes

OasisLMF Notes

Calculate summarycalc reinsurance without all zeros flag - (PR #1601)

Running summarycalc with the -z flag for Net RI was running into significant performance issues.

To resolve this, this PR:

removes the output all zeros flag when running summarycalc or summarypy
adds an additional check on the the mean_idx to catch non-zeros that were previously being filtered out

Issue: #1394

Support Risk Attaching 'RA' basis in reinsurance - (PR #1576)

Implemented #1250 as shown below. Policies which meet the RA requirement are not set to the PASSTHROUGH_PROFILE_ID, and left as NO_LOSS_PROFILE_ID.
UseReinsDates is currently not considered for checking RA, only AttachmentBasis (LO/RA).

Added fix for correlation settings - (PR #1587)

Fixed #1581, where oasislmf code was looking for correlation in the legacy location, it now checks both.
Added testing to catch problems loading correlation from model settings.

Update Platform API client for Cyber models - (PR #1589)

Cyber models can run with only an account file, so no OED location input, updated API client to allow for this.

OOM issue for accounts with lots of layers for several levels - (PR #1594)

Improve the memory performance of level matching between levels of accounts that have lots of layers.

Feature - Unique grid resolution for each `areal_peril` - (PR #1596)

This PR does the following:

Introduces a new builtin lookup function fixed_size_geo_grid_multi_peril which allows for a unique resolution grid per peril.
Fixes an issue where fixed_size_geo_grid created area_peril_id starting at index 0. It now starts at index 1 as expected.

Related Issue: #1595

ODS_Tools Notes

Added lossfactor set options to settings files - (PR #162)

The oasislmf package accepts the pla_loss_factor_set from OasisLMF/OasisLMF#1558 Added these as options in the settings schema files (analysis_settings / model_settings) following the same format as other indexed files in the static dir lossfactors_{idx}.bin

Fix package build to include all ODTF data files - (PR #165)

Fixed setup.py so the package build adds all files under odtf/data/*

Assets 5

27 Nov 11:37

awsbuild

1.28.10

c795f40

Release 1.28.10

Oasis Release v1.28.10

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 1.28.10

#1141 - Add setttings from platform v2 for running the v1.28.x server on azure cloud
#1146 - Fix CVE issues in release 1.28.10

OasisLMF Changelog - 1.28.10

#1506 - acc_idx read as category type from input/accounts.csv
#1556 - Fix CI build system failures
#1566 - Fiona package vulnerability issue
#1599 - Fixes for CI testing stable 1.28.x

Release Notes

OasisPlatform Notes

Add setttings from platform v2 for running the v1.28.x server on azure cloud - (PR #1141)

Added a fix to Django settings to avoid permission denied errors when upload files to azure files
Fixed 'Network error' when access swagger via an ingress using https

Fix CVE issues in release 1.28.10 - (PR #1146)

Added DB migration CI check
Updated Oasislmf to 1.28.10
Update python packages for CVE fixes

OasisLMF Notes

Fix CI build system failures - (PR #1556)

Updated GH actions to use artifact v4
Pinned Fiona package (the newer package has incompatibility with some older versions of Geopandas)
update to geopandas 0.14.4 or pin fiona to version 1.9.6

Remove pin of fiona package - (PR #1565)

A package pin of fiona causes CVE issues for published docker images

Fixes for CI testing stable 1.28.x - (PR #1599)

Remove numpy max version pin and fix plat2 testing

Assets 3

31 Oct 17:57

awsbuild

2.3.10

4576ad5

Release 2.3.10

Oasis Release v2.3.10

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.3.10

#1122 - Update python packages for 2.3.9
#1124 - Update docker base images and python packages
#1123 - Generate oasis files is not using the pre-analysis adjusted location file for V2 runs
#1125 - Support Cyber models on OasisPlatform

OasisLMF Changelog - 2.3.10

#1563 - Intensity Adjustments in gulmc for dynamic footprints
#1585, #1575 - Fix missing complex keys return without amplification
#1578 - fix: point to the correct source in error message for vulnerabiity_id…
#1580 - Hazard correlation defaults to 100% if missing
#1581 - oasislmf code uses legacy correlation settings location in model settings

ODS_Tools Changelog - 3.2.8

#139 - Look for validation files in custom paths
#147 - fix fill_empty method for field that end in XX or YYY
#157 - Both correlation_settings fields are marked as "Legacy" in desc

Release Notes

OasisPlatform Notes

Update python packages for 2.3.9 - (PR #1122)

Update docker base images and python packages - (PR #1124)

Update docker base images to ubuntu LTS 24.04
regenerate python package requirements files
Load CVE scanning DB from Github actions cache (Trivy)

Fixed pre-analysis exposure files not working in V2 worker runs - (PR #1130)

Add cybermodels support in the OasisAPI - V1 Only - (PR #1133)

Only for run_mode = V1 allow input generation to work without posting a location.csv file.
Update the check in portfolios to allow execution if Either a location or an account file is attached.

OasisLMF Notes

Fix missing complex keys return without amplification - (PR #1574)

Fix from complex keys return when running without PLA
Added testing for complex keys return + logging output

Fix vulnerability_id missing error message - (PR #1578)

Fix the error message so it points to the correct source when some vulnerability_id are missing from the vulnerability file.

Fix: undo 100% correlation if no correlation setting provided in model settings - (PR #1584)

The hazard_group_id where not generated if the correlation settings were not provided, causing a 100% correlation across all location.
This fix assure the hazard_group_id are generated and used correctly in gulmc.

Added fix for correlation settings - (PR #1587)

Fixed #1581, where oasislmf code was looking for correlation in the legacy location, it now checks both.
Added testing to catch problems loading correlation from model settings.

ODS_Tools Notes

Validation files in custom paths - (PR #138)

When a custom path is passed in the configuration file, validation files in that folder will be found and used.

fix default values for field ending in XX or YYY - (PR #147)

Some OED field end with XX or YYY to allow users to specify several type of the same field (for example for GeogSchemeXX)
Because of the mismatch between the column name and the field name (GeogScheme1 vs GeogSchemeXX), default value were not applied.

Fixed 'correlation_settings' description in model settings - (PR #157)

There are two locations of correlation_settings one is Legacy which at the root of the file. The new version is within the model_settings attribute (fixed the description field to avoid confusion

Assets 5

08 Oct 18:32

awsbuild

2.3.9

f0f1653

Release 2.3.9

Oasis Release v2.3.9

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.3.9

#1105 - Release 2.3.8
#1122 - Update python packages for 2.3.9

OasisLMF Changelog - 2.3.9

#1567 - Occurrence file not found when requesting output from ktools component alt_meanonly
#1563 - Intensity Adjustments in gulmc for dynamic footprints
#1379 - Performance issue in get_exposure_summary
#1557 - Release 2.3.8
#1558 - support for having several pla sets
#1560 - add check for vulnerability id and intensity bin boundary
#1566 - Fiona package vulnerability issue
#139 - Look for validation files in custom paths

Release Notes

OasisPlatform Notes

Update python packages for 2.3.9 - (PR #1122)

OasisLMF Notes

Fix performance issues with get exposure summary - (PR #1550)

No Return keys were included in keys errors file, but this was ballooning to a huge size when AA1 peril code was used, since we would see no returns for all peril codes. This was causing the performance of the generate exposure summary report to degrade massively.

The fix removes the no-returns from the returned errors, but counts them in the exposure summary.

support for having several pla sets - (PR #1558)

Allow user to specify a different pla set from the default one by adding loss_factors_set in the model_settings part of analysis_settings.json
if "loss_factors_set": "2" is added
the loss factor that will be taken into account will be lossfactors_2.bin in the static folder

Fix out of bound issue when vulnerability file contains more intensity bin than the footprint - (PR #1560)

In the model part, we want to only load intensity that will be relevant in the footprint, however there was an issue in the code where the out of bound intensity was overwriting the other part of the vulnerability table that was created.
Also add a check to verify that all vulnerability_id that are needed are present in the vulnerability static file

Remove pin of fiona package - (PR #1565)

A package pin of fiona causes CVE issues for published docker images

ODS_Tools Notes

Validation files in custom paths - (PR #138)

When a custom path is passed in the configuration file, validation files in that folder will be found and used.

Assets 5

20 Sep 10:51

awsbuild

2.3.8

9fbcfe4

Release 2.3.8

Oasis Release v2.3.8

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.3.8

#1075 - Logging - V2 input generation and losses tar should include log files for all sub-tasks
#1104 - Fix params for V1 workers - so custom hooks are called
#1107 - Fix/gen log storage
#1109 - set artifact to v4
#1111 - Keycloak OIDC group permistions is broken.
#1110 - Add Endpoint for models - 'storage_links'

OasisLMF Changelog - 2.3.8

#1544 - dynamic footprint - slow performance for large hazard case
#1546 - Combus changes: 20240807
#1554 - drop duplicate il term lines before merging
#1547 - Running full_correlation + gulmc causes an execution to hang.
#1556 - Fix CI build system failures
#1559 - Read do_disaggregation from settings files
#1560 - add check for vulnerability id and intensity bin boundary
#1561 - Set Ktools 3.12.4
#1531 - fix effective deductible applied in minded calculation for calcrule 19

ODS_Tools Changelog - 3.2.7

#135 - Only run attach project issues workflow from Our repo - not forks
#136 - Triple quoting when saving fields containing multiple entries
#139 - Look for validation files in custom paths
#140 - Failed ODTF transformation with lark > 1.1.9
#142 - Update GH actions artifacts to v4
#143 - pin lark version
#145 - Add disaggregation-flag

ktools Changelog - v3.12.4

#387 - Bump actions/download-artifact from 3 to 4.1.7 in /.github/workflows
#390 - Average Loss Convergence Table (ALCT) fix
#391 - Fix GH actions artifact

Release Notes

OasisPlatform Notes

Fix docker compose UI - (PR #1099)

Fix log storage in result tar files. - (PR #1103)

Fixed log storage for input generation (run_mode=v1). workers now store a copy of run logs in the input.tar.gz file.
Fixed log storage for input generation (run_mode=v2). Workers copy in each sub-task log file to a log/ within a the input.tar.gz file
Fixed mismatch between v1 and v2 ktools log stored under /run_log_file/, v2 no longer nests the archive in a logs sub-dir.

Fix run params for V1 workers - (PR #1104)

Needed so that custom hooks are correctly called for workers in run_mode=V1, similar to #1087

Fix/gen log storage - (PR #1107)

Worker storage manager between main and stable/2.3.x is different, fix needed to work with both

Fixed group mapper class in Keyclock realm config - (PR #1112)

Issue #1111 - the users group information wasn't included in the JSON Web Token (JWT). This causes OasisAPI objects to be created without any groups attached.

Added model storage_links endpoint - (PR #1113)

Added the following endpoints to models, /v1/models/{id}/storage_links/ and /v2/models/{id}/storage_links/.
works in the same way as the other storage_links endpoints on (models and portfolios), returns the real filename or Object Store key of the model settings file.

example return

{
  "settings_file": "82cd9b3e16c44954a1ec98be6554440b.json"
}

OasisLMF Notes

Reduce memory usage in il generation step - (PR #1554)

Drop duplicated lines containing each specific level terms before merging with the input level do reduce memory consumption

Disable full_correlation when running gulmc - (PR #1555)

Gulmc provide a more fine grained correlation feature and make full_correlation flag not useful and created an issue where the run would hang
This change disable full_correlation in that case fixing the hanging issue.

Fix CI build system failures - (PR #1556)

Updated GH actions to use artifact v4
Pinned Fiona package (the newer package has incompatibility with some older versions of Geopandas)
update to geopandas 0.14.4 or pin fiona to version 1.9.6

Read do_disaggregation from settings json files - (PR #1559)

Workaround to address ticket #1497 to give more time for creating a better option for overriding settings OasisLMF/OasisLMF#1552

Fix out of bound issue when vulnerability file contains more intensity bin than the footprint - (PR #1560)

Fix issue in calcrule 19 when min deductible is triggered - (PR #1531)

When % of loss deductible is smaller than the minimum deductible, neither the minimum deductible nor the % of loss deductible gets applied. This overstates gross losses.
the deductible passed to the min deductible calculation was incorrect for calcrule 19, as we passed the percentage instead of the actual deductible, this fix the issue by passing the effective deductible for this calcrule.

ODS_Tools Notes

Only run attach project issues workflow from Our repo - not forks - (PR #135)

CI fix for external PRs

Fixes triple quoting when strings contain special characters - (PR #137)

... Strings containing special symbols (for example ;, ,, \t, \n) are now correctly quoted (only once with double quotes).

Validation files in custom paths - (PR #138)

When a custom path is passed in the configuration file, validation files in that folder will be found and used.

Fix failed transformations with lark > 1.1.9 - (PR #141)

Compatibility with all lark versions

Update GH actions artifacts to v4 - (PR #142)

Pin lark version to <=1.9 - (PR #143)

While testing the solution, lark is pinned to a working version to avoid failing tests.

Add do_disaggregation to setting schemas - (PR #145)

ktools Notes

Average Loss Convergence Table (ALCT) fix - (PR #390)

Changed the calculation of StandardError which is used for the confidence intervals for the AAL estimate to be equal to StandardErrorVuln from the ANOVA metrics
Reintroduced the ANOVA fields from the first version of the report
Set the lower and upper confidence threshold to zero where StandardError=0 (for SampleSize 1)

Assets 5

Releases: OasisLMF/OasisPlatform

Release 2.4.1

Oasis Release v2.4.1

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.4.1

OasisLMF Changelog - 2.4.1

ODS_Tools Changelog - 4.0.1

Release Notes

OasisPlatform Notes

Fixed missing stack trace logging for V1 workers - (PR #1164)

Pin drf-yasg package - (PR #1168)

Update expected validation errors for ods-tools 4.0.1 - (PR #1171)

OasisLMF Notes

Added computation schema build to CI - (PR #1632)

fix missing cond column when no term present - (PR #1633)

aalpy, python replacement for aalcalc and aalmeanonlycalc - (PR #1603)

Refactor preparation/oed.py - (PR #1635)

CI Fix, Skip incompatible client checks - (PR #1638)

Eltpy, python replacement for eltcalc - (PR #1579)

Pltpy, python replacement for pltcalc - (PR #1590)

Update pages workflow - (PR #1628)

Fix for pre analysis hook loc_id - (PR #1630)

Improve parquet footprint performance - (PR #1631)

ODS_Tools Notes

Integrate new coverages and perils in OdsTools - (PR #173)

Drop testing for py3.8 - (PR #176)

Adjust model settings schema, replace AllOf with schema refs - (PR #178)

set min pin for jsonschema - (PR #179)

drop py3.8 testing but don't force the version - (PR #181)

Release 2.3.13

Oasis Release v2.3.13

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.3.13

OasisLMF Changelog - 2.3.13

Release Notes

OasisPlatform Notes

Fixed missing stack trace logging for V1 workers - (PR #1164)

Worker controller detects pending V1 task and tries to scale V2 workers - (PR #1158)

OasisLMF Notes

fix missing cond column when no term present - (PR #1633)

CI Fix, Skip incompatible client checks - (PR #1638)

Release 1.28.11

Oasis Release v1.28.11

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 1.28.11

OasisLMF Changelog - 1.28.11

Release Notes

OasisPlatform Notes

Release notes script - skip merge commits - (PR #1147)

Fixed missing stack trace logging for V1 workers - (PR #1164)

OasisLMF Notes

fix missing cond column when no term present - (PR #1633)

CI Fix, Skip incompatible client checks - (PR #1638)

Fix fmpy back allocation for account level term - (PR #1611)

Fix testing failures (API Client) - (PR #1618)

Fixes for CI testing stable 1.28.x - (PR #1599)

Release 2.4.0

Oasis Release v2.4.0

Docker Images (Platform)

Docker Images (User Interface)

Components

Changelogs

OasisPlatform Changelog - 2.4.0

OasisLMF Changelog - 2.4.0

ODS_Tools Changelog - 4.0.0

Release Notes

OasisPlatform Notes

Update subtasks when a retry is attempted - (PR #1155)

Worker controller detects pending V1 task and tries to scale V2 workers - (PR #1158)

Fixed platform Unit tests for OED4 update - (PR #1160)

Fix pre analysis hook loading - (PR #1161)

Feature - Unique grid resolution for each `areal_peril` - (PR #1596)