Skip to content

Latest commit

Β 

History

History
492 lines (284 loc) Β· 33.3 KB

CHANGELOG.md

File metadata and controls

492 lines (284 loc) Β· 33.3 KB

Changelog

1.11.0 (2024-09-11)

Features

  • cli/configs.py: added new command (9af0d44)
  • cli/pipelines.py: added format to history timestamp (43753b6)
  • cli/pipelines.py: improving pipelines output (1edb6e3)

1.10.0 (2024-09-11)

Features

  • buckets.py: added limit option to remove command (#121) (01a5fc8)

1.9.11 (2024-09-06)

Bug Fixes

1.9.10 (2024-08-26)

Bug Fixes

  • attempt.py: removing duplicated call to update() function (#112) (3466f90)
  • configure.py: remove assigning of "None" to parameters not given in Work, causing TypeError (2fc7a28)
  • configure.py: Remove is_flag check (65041e1)
  • test_lifecycle.py: fixing tests (#114) (7863735)

1.9.9 (2024-08-06)

Bug Fixes

  • ci/cd: update ci.yml (3c6b70b)
  • transfer.py: fixed transfer daemon key error (#106) (b4e6f54)

1.9.8 (2024-07-31)

Bug Fixes

  • workspace-chimefrb: pipelines configs and schedules missing /v2 (ece1ad7)

1.9.7 (2024-07-29)

Bug Fixes

  • work: increase max timeout from 1 day to 3 days (#102) (2e1453e)
  • workspace: update chimefrb http urls (bc13da7)

1.9.6 (2024-07-23)

Bug Fixes

1.9.5 (2024-07-18)

Bug Fixes

  • chimefrb-workspace: add http baseurl for schedule and configs (f774846)
  • workspace: workspace.read now converts a str to pathlib.Path if the source exisits (3f71f57)

1.9.4 (2024-07-17)

Bug Fixes

  • deps: docker fixed to >=6.1 (d454651)

1.9.3 (2024-07-17)

Bug Fixes

  • example: added an example autocomplete function (df7fa2c)

1.9.2 (2024-07-17)

Bug Fixes

  • daemon: fixed transfer daemon duplication check error (a4ed3f6)

1.9.1 (2024-07-16)

Bug Fixes

  • entrypoint: added it to Dockerfile (8faf57c)

1.9.0 (2024-07-16)

Features

  • docker: added entrypoint to optionally run workspace set (1d89e82)

1.8.1 (2024-07-16)

Bug Fixes

  • daemon: improved transfer daemon to handle config.archive updates (0d4b4d6)

1.8.0 (2024-07-16)

Features

  • validation-strategy: added strict and relaxed validation modes (3302b4c)

Bug Fixes

  • execute.py: fixing command execution (#84) (f226528)

1.7.0 (2024-07-16)

Features

  • daemon: added reworked transfer daemon (8528f45)

Bug Fixes

  • tx: fixed startup errors (07e3d67)

1.6.0 (2024-07-04)

Features

  • argsource: added a new runtime cli parameter to perform function based work, by passing the work obj itself to the func (11adc37)

1.5.0 (2024-07-04)

Features

  • audit: added an audit daemon to the workflow cli (b73287a)
  • audit: added tests (e2f0be0)
  • execute: added functionality to execute work with the work object as arguments (b9927f5)
  • pypi: added functionality to push to pypi as workflow.core (fc811d5)

1.4.0 (2024-06-29)

Features

  • gha: added ghcr container push (f78275e)

1.3.2 (2024-06-29)

Bug Fixes

  • execute: properly handle cli options which are flags, i.e. --verbose (ae3da80)

1.3.1 (2024-06-26)

Bug Fixes

  • execute: executing a command no longer tries to evaluate the stdout to python types (61e4ca3)

1.3.0 (2024-06-26)

Features

  • helpers: added a new category of workflow functions called helpers to provide common utililites in the pipelines framework (bb3659b)

1.2.2 (2024-06-26)

Bug Fixes

  • deps: removed mergedeep usage when collating results (3104c80)

1.2.1 (2024-06-25)

Bug Fixes

  • cli: default options which are none, are no longer passed to cli (bcb0cbb)
  • cli: run command now properly parses click cli argument names. (26aceaf)
  • execution: fixed edge case in work execution due to json serializable error (cb9ce26)
  • execution: fixed issue when translating single and multiple letter click cli options to to code (f67b1f7)

1.2.0 (2024-06-25)

Features

  • cli/configs.py: adding validation for deployments (#67) (1154568)
  • cli: improved the cli run command significantly (894fd08)

Bug Fixes

  • cleanup: tutorial (53e7008)
  • cli: fixing ls and ps functions not receiving the right datatype for query and projection (#64) (87767cb)
  • imports: fixed typings imports error (98edf99)
  • lifecycle: fixed issue when running click cli wrapped functions were not reporting results,prods & plots properly (769cb73)

1.1.0 (2024-06-18)

Miscellaneous Chores

1.0.1 (2024-06-18)

Bug Fixes

  • cli: workspace set fix when passing path (2d9ab04)
  • json-schema: added default mode as serialization (5587cf7)

Documentation

  • readme: added readme, moved docs to workflow-docs repo, consolidated test configs to pyproject (20ba2b2)
  • readme: formatting (3681bd1)
  • readme: update (06f9a45)

1.0.0 (2024-06-18)

⚠ BREAKING CHANGES

  • http: work object by default only instantiates a buckets connection in the http context
  • workspace: this change marks a departure from multiple config files and assumed that default workspace is always set

Features

  • http: httpcontext now supports requesting individual backends (569d502)
  • workspace: consolidated all workflow settings under single workspace file (3f616ab)

Bug Fixes

  • http: removed the clients dependency read workspace (afd2273)
  • utils: reading workspace from a url now properly works (ac6f890)
  • workspace: fixed spelling error (a52c9ca)
  • workspace: fixed urls for dev workspace (e789499)
  • work: work now attemps to reuse http context (7df33e4)

0.10.0 (2024-06-13)

Features

  • client: the http client now accepts either a str | List[str] as argument for baseurls (460a731)

Bug Fixes

  • github-actions: fix for tests (80f8b26)

0.9.1 (2024-06-12)

Bug Fixes

  • run.py: fixing error when runspace is provided (#54) (2a0f262)

0.9.0 (2024-06-12)

Features

  • github-actions: added deployment action to publish docker containers (1c5d71c)
  • results: added workflow results API & CLI (0d20eaf)
  • workflow: updates to tests, and general api cleanup (644a744)

Bug Fixes

  • dockerfile: fixes (cdf4004)
  • github-actions: added debug ssh session (bce85d6)

0.8.2 (2024-06-07)

Bug Fixes

  • release-please: fixes for release please config linting (b285de4)

0.8.1 (2024-06-07)

Bug Fixes

  • release: fixed the release-please action config (eb0411c)

0.8.0 (2024-06-07)

Features

  • python: working build for py38,py39,py310 (6c0b3ef)

0.7.0 (2024-06-06)

Features

  • cli: multiple buckets + runspace (#47) (817e125)

0.6.0 (2024-06-04)

Features

0.5.0 (2024-06-04)

Features

  • dockerfile: improvements to the workflow docker container (af472b9)

Bug Fixes

  • archive: check that basepath, mount in config, exists before continuing (#39) (87fe370)
  • cli: improved cli structure (08ce5e3)

0.4.0 (2024-05-28)

Features

  • add schedule cli (#25) (56dcd6e)
  • cli/main.py: adding logging on top level function (#37) (7820c62)
  • docker-compose-tutorial.yml: adding docker compose for tutorial (#35) (7b17e2a)

0.3.0 (2024-03-06)

Features

  • examples: added a dedicated examples folder (908de1a)

Bug Fixes

  • context.py: fixing class validator (#17) (7bc52bb)
  • validate: updated the function/command validation logic to support Windows (3458f0b)
  • work.py: changes in validation (#21) (af96307)
  • workspace: improved the workspace set/unset logic (d8f6802)

0.2.0 (2024-01-28)

Features

  • workflow: major refactor of core work to support multiple projects (1fdd115)

Bug Fixes

  • ci: fixed ci to run on pre (bd67d17)

0.1.0 (2023-07-19)

⚠ BREAKING CHANGES

  • workflow: In addition to work.pipeline, work.site and work.user are now required parameters. Dropped support for site name allenby and deprecated attributes.
  • workflow: breaking changes to workflow work object with the following move, precursors -> config.parent, groups -> config.orgs|config.teams, path is deprecated and archive is now moved to config.archive.

Features

  • audit daemon: add time buffer to deleting failed work (46eb8f5)
  • audit daemon: remove deletion from audit daemon scope (bba327d)
  • cd: added cd pipeline (38b8b91)
  • ci: added pre-commit & tests (80871a1)
  • cli: added workflow pipelines cli (8bf7515)
  • copy-util: created copy util (271123c)
  • results: implement transfer daemon (09456ca)
  • tasks: Updated tasks and tests to work with v2 buckets (9662fd2)
  • transfer daemon: handle failed and stale work deletion (a69e19a)
  • transfer daemon: return dict results instead of bool (b5fc513)
  • transfer_daemon: handle 400 Bad Request (613d62b)
  • transfer_daemon: update transfer rules (b3e055b)
  • workflow_daemons: allow test_mode; fix tests (37380e2)
  • workflow-daemons: add cli options; continuously run daemons (f2f0930)
  • workflow-pipelines: added cli support (84583e0)
  • workflow-piplines: added deploy and rm commands (3ec10c4)
  • workflow/buckets: added functionality to return ids when depositing work (f831b15)
  • workflow: add functionality for work.config.archive (4d595f7)
  • workflow: added capability to filter workflow run by work.tags and work.config.parent fields (3ec1043)
  • workflow: Added HTTP interface to the work object (645103a)
  • workflow: added pre-commit, gitignore configs. Reorganized project structure. Starting work on developing resources structure for results/buckets API (05a00c2)
  • workflow: added support for work.functiona and work.command (400e29e)
  • workflow: added support for work.notify.slack functionality (0a0f569)
  • workflow: added utility to check if the script is running from k8s or docker runtime (193ee01)
  • workflow: added view to cli (56810e8)
  • workflow: cli (0a4396f)
  • workflow: First crack at audit daemon (40d04ab)
  • workflow: First crack at transfer daemon rough code. (f84316b)
  • workflow: Made audit daemon runnable (68e19c3)
  • workflow: major qol improvement for work object (1fa93d2)
  • workflow: refactored entire workflow core (f77df8f)
  • workflow: run: upload logs to loki (42b2709)
  • workflow: site names (eb8985d)
  • workflow: updated to workflow cli to handler merging of defaults and output of function more gracefullu (857fe38)
  • workflow: updated work object (c89822c)
  • workflow: work.withdraw now supports selecting work on event, site, priority and user in addition to pipeline (cda6ade)

Bug Fixes

  • add aro as valid site (d60ada7)
  • archive-run: check for files before creating directory (e24886d)
  • buckets: added cli to delete works (c72c61d)
  • configs: added base structure (3382816)
  • logging: fixed issue when log level was not propogated to root handlers (8f5e529)
  • modules: fixed results default urls (97a388d)
  • notify: append to instead of overwriting (6d70fcb)
  • notify: append to instead of overwriting (6ca4a74)
  • pipeline: fixed errors handling null work.parameters and tests (b549aa7)
  • pipelines: import fix (85b28cc)
  • pre-commit: significant pre-commit fixes (e5e5836)
  • readme: added basic readme (e10b06f)
  • results: update return values to int (d2081df)
  • slack-notifications: format products and plots into slack hyperlinks (1c4f40a)
  • transfer daemon: fix deposit result status (314f36c)
  • transfer daemon: fix typo (951ad88)
  • transfer daemon: Updated transfer daemon to work with results (d7ee97e)
  • transfer_daemon: fix Bad Request bug in 104 (5a217e4)
  • transfer_daemon: fix bug when no results should be deposited (c843470)
  • transfer_daemon: max limit_per_run adjusted to OId length (64db691)
  • transfer-daemon: update archive keys (1f3cbdf)
  • various: fixes for lint, dockerfile and flake8 (d375a0e)
  • work.py: fixed condition statement for pipeline reformatting (067db77)
  • work: added pipeline name reformatting (b3f791b)
  • work: added syntax warning for bad pipeline name (1233e59)
  • workflow pipeline: buckets run on 8004 onsite, not 8001 (922a84a)
  • workflow_daemons: fix args that were passed incorrectly (9ca093f)
  • workflow_daemons: fix tests (86e2573)
  • workflow-cli: better output for work lifecycle (33f435e)
  • workflow-cli: removed empty status field (d4d42b8)
  • workflow: added @retry to work.delete (c7b14f8)
  • workflow: added loki logging format (11fb580)
  • workflow: added loki logging handler for chime jobs (36666a4)
  • workflow: added retry for updates in cli (811b820)
  • workflow: better cli display (eb174cf)
  • workflow: changed default attempts from 1->0, the buckets system auto-increments attempt when work is withdrawn (c75f50f)
  • workflow: changed workflow buckets prune -> workflow buckets rm (5ea31f4)
  • workflow: changed workflow run to not use process call (465d2b3)
  • workflow: fixed duplicate logging issue (a0b5a99)
  • workflow: fixed stderr/stdout in workflow runner (54f2510)
  • workflow: improved exception catching (72c6f64)
  • workflow: improved test coverage (cf7cb3c)
  • workflow: improved workflow run cli functionality (95ba604)
  • workflow: reduced complexity (e263121)
  • workflow: reorganized work (17785c2)
  • workflow: significated changes to the work object (4ed2a38)
  • workflow: transfer daemon, fixed issue with stale work (db0e3bd)
  • workflow: undeprecated config parameter to be used with pipelines (cdd723c)
  • workflow: updated cli (92e5be3)
  • workflow: updated workflow function execution to merge work.results recursively (4b2207d)
  • workflow: updated workflow run cli (cdcb970)
  • workflow: work object updates (1591198)
  • workflow: work object value attempt is defaulted to 1 if not provided (fb8423b)
  • workflow: work token: changed token to be a top level attr, work.config.token -> work.token (6d6322a)
  • workflow: work.notify.slack.reply field added (9234dc0)
  • workflow: workflow run spinner now has a 1000x slowdown when detected to be running from a container to reducing log printing (02ddd94)

Documentation

  • work: fix typo (68e534e)
  • workflow: improved docstrings for workflow run command (f96de64)
  • workflow: updated some docs (f6d6899)