v2024.5.0

What's Changed

New Features

• feat: read golden json using fsspec by @ikrommyd in #1088

Fixes

• fix: output of do_preprocess saved in the wrong order of files by @ikrommyd in #1086

Misc

• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1084
• ci: drop python 3.8 (images not consistently available) by @lgray in #1085
• build: Disallow uproots with known form manipulation issue by @matthewfeickert in #1091
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1087
• ci: Use uv for all pip installs by @matthewfeickert in #1090

Full Changelog: v2024.4.1...v2024.5.0

v2024.4.1

What's Changed

New Features

• feat: Request all arrays from uproot at once inside dask task by @nsmith- in #1076
• feat: use tree reduction to aggregate files in preprocessing by @alexander-held in #1079

Fixes

• fix: update Applying corrections notebook by @Saransh-cpp in #1070

Misc

• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1071
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1081

Full Changelog: v2024.4.0...v2024.4.1

v2024.4.0

What's Changed

New Features

Fixes

• fix: Do not add trailing slash in xrootd urls by @valsdav in #1054

Misc

• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1060
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1062
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1067
• build: bump awkward for numpy 2 compatibility by @lgray in #1068
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1069

Full Changelog: v2024.3.0...v2024.4.0

v2024.3.0

What's Changed

New Features

Fixes

• fix: properly retain user metadata in preprocess by @lgray in #1051
• fix(build): unpin distributed as well! by @lgray in #1057

Misc.

• ci: bump pypa/gh-action-pypi-publish from 1.8.11 to 1.8.12 by @dependabot in #1049
• build: unpin dask and skooch dask-awkward pin by @lgray in #1055
• build: pin dask-histogram to >=2024.3.0 by @lgray in #1056
• ci: bump pypa/gh-action-pypi-publish from 1.8.12 to 1.8.14 by @dependabot in #1058
• build: for recent python use dask 2024.3.0 by @lgray in #1059

Full Changelog: v2024.2.2...v2024.3.0

v2024.2.2

What's Changed

This release is to pin to uproot 5.3.0 and adapt to the interface changes therein.

New Features

• feat: modifier argument for partial_weights method by @rkansal47 in #1042

Fixes

• fix: use ak.merge_union_of_records to generate input data format by @lgray in #1017
• fix: make apply_to_fileset be able to handle tuple outputs of data_manipulation. by @iasonkrom in #1038
• fix: adjust to breaking changes in form mapping interface by @lgray in #1047

Other

• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1035
• chore: test in python 3.12 by @lgray in #1040
• perf: use an lru_cache for weight, partial_weight, require by @lgray in #1043
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1044

Full Changelog: v2024.2.1...v2024.2.2

v2024.2.1

What's Changed

New Features

• feat: allowing unmatched files in rucio utils by @valsdav in #1021

Fixes

• fix: updateDataDiscoveryCLI usage of dataset_tools.preprocess by @iasonkrom in #1024
• fix: remove branches that aren't interpretable as nanoevents in preprocess by @lgray in #1031
• fix(build): pin dask < 2024.2.0 until a fix in awkward is in place by @lgray in #1033

Other

• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1026
• ci: bump ts-graphviz/setup-graphviz from 1 to 2 by @dependabot in #1028
• ci: bump pre-commit/action from 3.0.0 to 3.0.1 by @dependabot in #1029

Full Changelog: v2024.2.0...v2024.2.1

v2024.2.0

What's Changed

New Features:

• feat: round target step multiplicity so we end up with more even steps on average by @lgray in #1011
• feat: deprecate coffea.nanoevents.methods.vector by @lgray in #997

Fixes:

• fix!: improve user interface for preprocess by @lgray in #1008
• fix: use public uproot interfaces when extracting form by @lgray in #1013
• fix: force application of to_packed in awkward binnings by @lgray in #1016
• fix: convert sys.exit(1) to ValueError in DataDiscoveryCLI by @iasonkrom in #1020

Documentation:

• fix(docs): update Running inference tools notebook by @Saransh-cpp in #1004
• fix(docs): Update dataset_discovery.ipynb by @nsmith- in #1006
• fix(docs): rewrite Coffea Processors notebook by @Saransh-cpp in #1005

Other:

• build(binder): update binder install to include distributed by @lgray in #1009
• build: pin to uproot 5.2.2 by @lgray in #1012
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #1015
• chore: get ruff to show fixes when it applies them by @lgray in #1018
• ci: bump codecov/codecov-action from 3 to 4 by @dependabot in #1022
• build: bump dask-awkward and dask-histogram by @lgray in #1023

Full Changelog: v2024.1.2...v2024.2.0

v2024.1.2

What's Changed

• refactor: significantly simplify dask version of LumiList by @lgray in #993
• fix: better typing in manipulations by @lgray in #994
• fix: better empty files filter by @lgray in #995
• fix(docs): use correct source links in docs by @lgray in #996
• chore: cleanup VCS versioning by @Saransh-cpp in #999
• fix: update Reading data with coffea NanoEvents notebook by @Saransh-cpp in #1000
• fix: test delta-r + metric return with and without optimization by @lgray in #1001
• feat: warn user about abnormally large step sizes when align_clusters==True by @lgray in #1003
• fix: make dask layer name shorthands easier to read by @lgray in #1002

New Contributors

• @Saransh-cpp made their first contribution in #999

Full Changelog: v2024.1.1...v2024.1.2

v2024.1.1

What's Changed

• feat!: dask-based LumiList and LumiData by @lgray in #990

Full Changelog: v2024.1.0...v2024.1.1

v2024.1.0

What's Changed

• test: add skip for missing dependency, fixture for local tests directory by @lobis in #933
• docs: add packedselection notebook to coffea by example by @lgray in #970
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #971
• ci: triton changed their extras by @lgray in #974
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #976
• chore: remove now-defunct servicex tests by @lgray in #977
• build: bump dask-awkward requirement by @lgray in #979
• feat: max_files by @lgray in #981
• fix: remove hack to try to make correction serialization faster, it is too flaky by @lgray in #982
• ci(pre-commit): pre-commit autoupdate by @pre-commit-ci in #983
• feat: preprocess a dataset's base form and hint it to uproot by @lgray in #978
• fix: form_hash_md5 is not needed in FilesetSpec by @lgray in #984
• fix: remove conversion to dask arrays by @lgray in #985
• fix: adapt to read-only dask_awkward attrs by @lgray in #986
• build(deps): bump awkward version to 2.5.2 by @lgray in #987
• feat: preprocess returns [[0, 0]] for empty ttrees, add filter_files tool by @lgray in #989
• fix: use dask.delayed to reference objects like ml models or corrections by @lgray in #988

New Contributors

• @lobis made their first contribution in #933

Full Changelog: v2023.12.0...v2024.1.0