v9.0.0

9.0.0 (2024-09-03)

⚠ BREAKING CHANGES

• xmlupload: change representation of and in XML due to XSD schema validation problems (DEV-3964) (#1101)

Enhancements

• xmlupload: add resource type to error message when checking for encoding mistakes (RDU-25) (#1145) (7279b69)

Bug Fixes

• excel2json-lists: remove erroneous warning if comments column exist (RDU-23) (#1141) (4ed0a7e)
• excel2json: don't crash if json_header.xlsx is present when using the default command (RDU-24) (#1144) (4c4738e)
• xmlupload: change representation of <video-segment> and in XML due to XSD schema validation problems (DEV-3964) (#1101) (1476eca)
• xmlupload: don't rely on requests.Response.json() in case of unsuccessful request (DEV-4035) (#1132) (ff0b1de)

Maintenance

• bump stack to 2024.08.02 (#1147) (86e764b)
• don't ignore ARG001 in pre-commit hooks (#1136) (7ea83f7)
• remove codecov-integration (DEV-4043) (#1142) (042cf06)
• start-stack: change message for docker prune (DEV-4027) (#1126) (73c7823)
• surround angular brackets in docstrings by backticks (DEV-4014) (#1135) (7e746e2)
• turn XMLResource and XMLProperty into dataclasses (#1137) (6c4fe5d)

Documentation

• excel2xml: fix params of make_hasSegmentBounds_prop() (#1138) (95b7a84)
• mention fixed order of video/audio segments (#1139) (7ed7b93)

v8.5.0

8.5.0 (2024-08-21)

Enhancements

• exce2xml-lib: make xsd compatible string without uuid (DEV-4026) (#1127) (50ef476)
• excel2json-lists: enable to add comments to list nodes (RDU-18) (#1111) (54ba206)

Bug Fixes

• cli: resume-xmlupload --skip-first-resource now works (DEV-3744) (#1084) (7f99287)
• xmlupload: allow non-prefixed custom groups, and custom groups with dash (DEV-3979) (#1098) (e5a19eb)

Maintenance

• bump dependencies and fix new linter errors (#1122) (212e6e5)
• bump stack to 2024.08.01 (#1128) (400ddbe)
• excel2json-lists: access columns differently (#1109) (154f88f)
• excel2json-lists: add excel name to lists problem classes (#1089) (6112506)
• excel2json-lists: add filename to sheet class (#1090) (2f9e30e)
• excel2json-lists: change error message format (#1118) (f479aa4)
• excel2json-lists: change find missing translations (#1112) (ab54d96)
• excel2json-lists: change location of column info extraction (#1115) (bd163cf)
• excel2json-lists: change paramter to ExcelSheet in functions (#1091) (a4086c2)
• excel2json-lists: change sorting of columns (#1110) (4670085)
• excel2json-lists: remove dead check (#1120) (463c992)
• excel2json-lists: remove file hierarchy from code (#1094) (3b554a3)
• excel2json-lists: remove file hierarchy from Problem classes (#1093) (56bd84d)
• excel2json-lists: remove unnecessary checks (#1107) (71339f7)
• excel2json-lists: wrap file structure in classes (#1086) (e60002a)
• excel2json-new-lists: change order of functions (#1100) (0b9a429)
• excel2json-new-lists: extract fixtures for compliance tests (#1104) (f2b05ac)
• excel2json: lists delete duplicate tests (#1082) (90280c1)
• github-action: allow referencing RDU tickets in PR titles (RDU-13) (#1095) (c0f360c)
• new-lists: reorganise files (#1096) (866f6bd)
• preparation for new <video-segment> (#1125) (57dd646)
• send X-Asset-Ingested header only when needed (#1117) (a5279f1)
• small adaptions to docs + docstrings (#1121) (705c2f7)
• tidy up readme (#1106) (6663276)

Documentation

• CLI: add flag for IIIF validation in xmlupload in documentation (#1103) (d00f1cf)
• excel2json: mention old and new at the top (#1123) (cc58c68)

v8.4.0

8.4.0 (2024-08-07)

Enhancements

• excel2json: add option to create header with Excel file (DEV-3898) (#1065) (353d8e9)
• New workflow for big xmluploads: add commands upload-files and ingest-files (DEV-3905) (#1067) (b4c2912)

Bug Fixes

• don't use copyrighted testdata any more (DEV-3906) (#1068) (1558408)
• ingest-xmlupload: allow uppercased file extensions (DEV-3963) (#1075) (51a4703)
• Urlencode filenames when uploading files to ingesta (DEV-3865) (#1045) (4edfbd3)

Maintenance

• add logging of requests made in DspIngestClientLive (DEV-3761) (#1064) (84c6101)
• bump start-stack to 2024.07.02 (#1078) (2a74978)
• deps: bump the all-dependencies group with 16 updates (#1071) (a893aca)
• excel2json: change serialisation json header (DEV-3877) (#1046) (f4c6088)
• excel2json: find duplicate excel sheet names (#1054) (83bb96a)
• excel2json: generalise InvalidContentInSheetProblem (#1051) (c55603c)
• excel2json: improve checks for classes sheet in resources.xlsx (#1061) (1839d98)
• excel2json: move list problems to separate file (#1049) (353c002)
• excel2json: properties collect problems before raising error (#1063) (5ba6fc1)
• excel2json: reorder the functions in resources.py (#1060) (6295b02)
• excel2json: replace ListExcelProblem with ExcelFileProblem (#1052) (b84a185)
• excel2json: restructure and rename find missing values function (DEV-3909) (#1070) (d42595e)
• excel2json: serialise property with dataclass (#1059) (0e33238)
• excel2json: serialise resources with dataclass (#1062) (df11148)
• excel2json: validate classes sheet in resources.xlsx (#1057) (96b38f7)
• ignore ARG001 (unused function argument) in .pre-commit-config.yaml (#1066) (06b41d9)
• performance: add initial k6 excel2json performance test (DEV-3885) (#1056) (3625c62)
• test: renaming (#1048) (a7f0bca)
• test: take apart assertions for test_project.py (#1055) (da31d19)
• upload-files: adapt timeout, so that big files don't fail (#1077) (1f7b43b)
• xmlupload: video-segment and audio-segment: clarify docs / allow custom creation date (#1076) (1196afc)

Documentation

• add missing commands to docs/index.md (#1079) (231a6b7)
• tidy up dev docs (#1080) (eeaccc6)

v8.3.0

8.3.0 (2024-07-11)

Enhancements

• excel2json: creating classes without any cardinalities (DEV-3755) (#1029) (9e19aa1)

Bug Fixes

• excel2json-lists: assignment of wrong parent ID if the node names are identical (DEV-3844) (#1040) (51af556)
• harmonize supported file extensions in docs, test data, and prod code (DEV-3788) (#1028) (728b782)
• new-excel2json: don't crash when Excel files are upper-cased (DEV-3808) (#1032) (2a5cc31)
• xmlupload: allow angular brackets in SimpleText (DEV-3814) (#1033) (cf8e410)
• xmlupload: don't omit any stashed links (DEV-3827) (#1037) (20e7eac)

Maintenance

• Add db configuration to ingest container (#1039) (48e39ea)
• bump ruff (#1035) (720d7e9)
• bump start-stack to 2024.07.01 (#1043) (af6ad29)
• create: inform user that project membership has to be assinged manually (DEV-3800) (#1030) (5494267)
• deps: bump certifi from 2024.6.2 to 2024.7.4 (#1041) (550b1cf)
• deps: bump the all-dependencies group with 12 updates (#1036) (797f351)
• don't crash when offline (#1034) (c39d610)
• downgrade pytest, until Assertion Rewriting is fixed (DEV-3786) (#1026) (d2c8ede)
• downgrade pytest, until Assertion Rewriting is fixed (DEV-3786) (#1038) (d8d8d72)
• Enable erasing projects locally (#1042) (807db71)
• improve error messages according to consulting with RDU (#1031) (e9c9507)

v8.2.0

8.2.0 (2024-06-19)

Enhancements

• add flag to suppress warning when using old dsp-tools version (DEV-3707) (#1001) (e28ba2e)
• display progress in xmlupload as progress bar (DEV-3708) (#1022) (4ccf628)

Bug Fixes

• ci: bump release-please action (DEV-3526) (#992) (891a889)
• ci: fix flaky CI tests in rosetta repo (DEV-3733) (#990) (544923f)
• ci: fix release-please (DEV-3730) (#999) (4798d77)
• ci: move changelog (DEV-3730) (#1000) (0fae3e7)
• ci: use GITHUB_TOKEN instead of GH_TOKEN, move CHANGELOG.md back (DEV-3730) (#1002) (1f149de)
• excel2xml: support backslash in make_text_prop() (DEV-3377) (#991) (6e301d0)
• excel2xml: support named character references in make_text_prop() (DEV-3738) (#1007) (324c00a)
• remove GH_TOKEN from release workflows (DEV-3737) (#1006) (1c4f6f1)
• start-stack: fix display issue in DSP-APP on localhost (DEV-3745) (#1008) (b2d51ca)
• xmlupload: OntologyConstraintException should not interrupt an xmlupload (DEV-3724) (#995) (50ab6bf)

Maintenance

• add yamlfmt to pre-commit (#1009) (569c161)
• bump start-stack to 2024.06.01 (#1024) (991c6bc)
• ci: after every PR merge, upload test coverage report for main (DEV-3731) (#1010) (c76b787)
• ci: only post codecov comment if coverage changes (#1015) (8bee0ec)
• deps-dev: bump the all-dependencies group with 6 updates (#998) (99ef810)
• deps: bump the all-dependencies group with 4 updates (#1013) (5a1ac6e)
• deps: bump urllib3 from 2.2.1 to 2.2.2 (#1023) (bac6c69)
• fix some low-hanging linter warnings (#1019) (70beea3)
• fix typo (#1018) (df59932)
• replace deprecated PR title checker (DEV-3750) (#1016) (e4cd784)
• start-stack: don't print that stack is ready before it is ready (#997) (9317df2)
• test: add typing for test_ingest.py (#1020) (c959d31)
• use yamllint (#1011) (ddb47fd)
• xmlupload: serialise boolean value (DEV-3713) (#988) (92d3c64)

Documentation

• fix hierarchy of headings in cli-commands (#1012) (210965d)

v8.1.0

8.1.0 (2024-06-04)

Enhancements

• add IIIF image support (DEV-3507) (#946) (aa3eabb)
• xmlupload: interrupt if a resource cannot be created due to server failure (DEV-3444) (#954) (debc0b3)

Bug Fixes

• xmlupload: improve ingest performance by reusing session (DEV-3714) (#986) (d818f5d)

Maintenance

• chore: bump start-stack to 2024.05.03 by @gNahcab in #989
• deps: bump the all-dependencies group with 9 updates (#984) (1611d65)
• fix poetry exec clean (#983) (1721b1c)
• start-stack: print useful error if Docker is not running (#980) (25c036c)
• start-stack: remove network from docker-compose.yml (#981) (ea6fa08)
• start-stack: remove unnecessary config from docker-compose.yml (#982) (549d053)
• update dependencies (#977) (9473a7e)

Documentation

• create: fix: descriptions are required in JSON (#985) (00c8072)

v8.0.0

8.0.0 (2024-05-22)

⚠ BREAKING CHANGES

• add support for video and audio segments, remove isSequenceOf and standalone interval value (DEV-3439) (#933)

Enhancements

• add support for video and audio segments, remove isSequenceOf and standalone interval value (DEV-3439) (#933) (391da7f)

Bug Fixes

• excel2json: erroneous groupby in new-excel2json lists (DEV-3660) (#963) (46fbe95)
• excel2json: resources don't crash if optional columns are missing (DEV-3516) (#974) (db2df0a)
• mypy: prevent possibly unbound variables (DEV-3657) (#962) (1be2259)
• xmlupload: permission for uri value serialise (DEV-3630) (#958) (79a11bb)

Maintenance

• bump start-stack to 2024.05.02 (#975) (6c02a6a)
• deps: bump requests from 2.31.0 to 2.32.0 (#972) (092d4f7)
• do not use ingest client in bulk upload scenario (DEV-3665) (#966) (8614bbe)
• fix unbound variable error (#961) (7c41507)
• reduce number of arguments in some functions (#967) (f38f6b4)
• ruff: Update ruff to 0.4.4 (#951) (316a736)
• streamline shared logic between upload workflows (#969) (17750e0)
• Use dsp-ingest instead of sipi for upload of assets (DEV-3620) (#959) (c797010)
• xmlupload: add serialise value for URI (DEV-3624) (#955) (0289294)
• xmlupload: disallow +/- in interval property (#952) (871f312)
• xmlupload: handle error wider above in the call stack (#960) (c7ba637)
• xmlupload: refactor resource creation (#917) (cdad095)
• xmlupload: reorganise models file (#953) (6d90b8f)
• xmlupload: serialise int value with rdflib (DEV-3626) (#957) (0150fd6)
• xmlupload: value models (#949) (c69c963)

v7.2.0

7.2.0 (2024-05-08)

Enhancements

• excel2xml: if value is not valid, print warning instead of raising an error (only where it is possible) (DEV-3571) (#938) (3ae536d)
• new-excel2json: new lists section and excel (DEV-3462) (#916) (92cf58d)
• start-stack: make pre-loaded projects on localhost optional (DEV-3560) (#932) (d8ab847)

Bug Fixes

• warning_config recursive calls (DEV-3542) (#929) (20b8517)

Maintenance

• add DspToolsUserWarning class (#936) (fd0871d)
• add ruff ignore to pre-commit hook (#940) (9b14121)
• bump start-stack to 2024.05.01 (DEV-3612) (#944) (b1e5a46)
• deps-dev: bump jinja2 from 3.1.3 to 3.1.4 (#942) (5499e3b)
• deps: bump the all-dependencies group with 15 updates (#934) (548b6b4)
• fix typo (#927) (e52a8ce)
• prepend warning message with category (#937) (e5bbb83)

v7.1.3

7.1.3 (2024-04-24)

Bug Fixes

• allow slashes and semicola in query part of URL (DEV-3480) (#910) (af02895)

Maintenance

• add "Deprecated" section in release notes (#918) (8b24372)
• bump start-stack to 2024.04.02 (#923) (daacd16)
• bump versions of pre-commit hooks (#914) (7102e94)
• ci: fix ruff format checking (#915) (270dc6f)
• deps: bump idna from 3.6 to 3.7 (#912) (4c7bc29)
• fix excel2xml testdata (#921) (1771f5f)
• small fixes in pyproject.toml (#913) (ffa6cf3)

Deprecated

• deprecate isSequenceOf (DEV-3525) (#920) (b742ef8)

v7.1.2

7.1.2 (2024-04-10)

Bug Fixes

• excel2json: if gui_order is empty no warning is longer displayed (DEV-3469) (#908) (a278e3e)
• excel2properties no longer crashes if optional columns are missing (DEV-3468) (#907) (523d55b)

Maintenance

• add type annotations for pandas and networkx (#896) (bb0b3c6)
• bump start-stack to 2024.04.01 (#905) (04faeec)
• deps: bump the all-dependencies group with 10 updates (#894) (0e66199)
• remove .gitmodules file (#897) (64e4fe3)
• set api log level in docker-compose.yml (#899) (2a8d574)

Documentation

• precise resume-xmlupload (#900) (9611115)
• reformulate incremental xmlupload (#902) (e7063d0)