Releases: segment-any-text/wtpsplit
Releases · segment-any-text/wtpsplit
Release 1.2.2
- add
strip_whitespace
flag. - fix bug with some zero-length sentences being returned if there is lots of trailing whitespace.
Release 1.2.1
Release 1.2.0
- Speed up pre- & postprocessing via better vectorization (#94).
- Proper onnxruntime support for the
wtp-bert-*
models, although onnx models are currently not much faster (or even slower) than PyTorch models for some reason. Will continue to look into that. - Adds missing
pandas
requirement (fixing #92). - Lower bounds on
transformers
and other requirements to make sure all the functionality we need is there. - Removes
torch
from requirements since users will want to install it themselves depending on their hardware setup, and it's not required anymore when using only the onnx models.
Release 1.1.0
- Added missing
get_threshold
function wtp.split
adapted to some style now also allows changing the threshold viawtp.split(..., threshold=threshold)
. Was previously overwritten by the default.
Release 1.0.1
A major revamp of this library, now called wtpsplit
!
See the Readme for details.
Release 0.5.9
Release 0.5.8
- Updates tract to version 0.15.2
Release 0.5.7
- Adds Python 3.9 support (#25)
- CI failed spuriously for Release 0.5.6.
Release 0.5.6
- Adds Python 3.9 support (#25)
Release 0.5.5
- Fixes missing
nnsplit_javascript_bg.js
(#27)