-
Notifications
You must be signed in to change notification settings - Fork 206
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Set openvino_tokenizers on latest master
- Loading branch information
1 parent
4e3405a
commit 6853446
Showing
1 changed file
with
1 addition
and
1 deletion.
There are no files selected for viewing
Submodule openvino_tokenizers
updated
15 files
| +0 −2 | .github/dependency_review.yml | |
| +1 −1 | .github/workflows/sdl.yml | |
| +98 −45 | README.md | |
| +23 −1 | python/openvino_tokenizers/cli.py | |
| +1 −1 | python/openvino_tokenizers/convert_tokenizer.py | |
| +2 −9 | python/openvino_tokenizers/tokenizer_pipeline.py | |
| +33 −26 | src/CMakeLists.txt | |
| +1 −1 | src/combine_segments.cpp | |
| +37 −6 | src/regex_normalization.cpp | |
| +11 −3 | src/regex_split.cpp | |
| +4 −1 | src/utils.cpp | |
| +4 −5 | tests/conftest.py | |
| +56 −3 | tests/layer_tests.py | |
| +1 −1 | tests/pass_rates.json | |
| +4,317 −4,317 | tests/stats.json |