Skip to content

Actions: aya-multitokenizer/multi-tokenizer

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
25 workflow runs
25 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

PyPI Release
PyPI Release #9: Manually run by chandralegend
August 11, 2024 03:25 35s main
August 11, 2024 03:25 35s
Update CHANGELOG.md
Linting and Pre-commit checks #18: Commit b6cac78 pushed by chandralegend
August 11, 2024 03:23 39s main
August 11, 2024 03:23 39s
PyPI Release
PyPI Release #8: Manually run by chandralegend
August 11, 2024 03:17 31s main
August 11, 2024 03:17 31s
chore: Bump multi-tokenizer version to 0.1.4
Linting and Pre-commit checks #17: Commit cd05775 pushed by chandralegend
August 11, 2024 03:16 44s main
August 11, 2024 03:16 44s
PyPI Release
PyPI Release #7: Manually run by chandralegend
August 11, 2024 03:15 40s main
August 11, 2024 03:15 40s
added support to python 3.8 and up
Linting and Pre-commit checks #16: Commit 6533d05 pushed by chandralegend
August 11, 2024 03:14 43s main
August 11, 2024 03:14 43s
PyPI Release
PyPI Release #6: Manually run by chandralegend
July 23, 2024 19:29 37s main
July 23, 2024 19:29 37s
refactor: Update build process in release workflow and improve releas…
Linting and Pre-commit checks #15: Commit 11a9677 pushed by chandralegend
July 23, 2024 19:21 42s main
July 23, 2024 19:21 42s
Update pyproject.toml
Linting and Pre-commit checks #14: Commit 85a8ec9 pushed by chandralegend
July 23, 2024 18:41 45s main
July 23, 2024 18:41 45s
updated the tokenizer try notebook
Linting and Pre-commit checks #13: Commit a756da5 pushed by chandralegend
July 22, 2024 20:53 41s main
July 22, 2024 20:53 41s
refactor: Update tokenizer function names for clarity and consistency
Linting and Pre-commit checks #12: Commit f55c337 pushed by chandralegend
July 22, 2024 16:18 40s main
July 22, 2024 16:18 40s
PyPI Release
PyPI Release #3: Manually run by chandralegend
July 22, 2024 08:15 35s main
July 22, 2024 08:15 35s
Update README.md
Linting and Pre-commit checks #11: Commit bc7d398 pushed by chandralegend
July 22, 2024 08:15 44s main
July 22, 2024 08:15 44s
feat: Update multi-tokenizer to version 0.1.2-dev and improve Chinese…
Linting and Pre-commit checks #10: Commit 36cb6e3 pushed by chandralegend
July 22, 2024 08:14 37s main
July 22, 2024 08:14 37s
added fallback mechanism for un detected languages
Linting and Pre-commit checks #9: Commit d6e83b4 pushed by chandralegend
July 22, 2024 07:39 41s main
July 22, 2024 07:39 41s
updated the tokenizers decode and encode functions
Linting and Pre-commit checks #8: Commit a4ef7b0 pushed by chandralegend
July 21, 2024 21:41 36s main
July 21, 2024 21:41 36s
PyPI Release
PyPI Release #2: Manually run by chandralegend
July 21, 2024 18:56 35s main
July 21, 2024 18:56 35s
feat: Update multi-tokenizer to version 0.1.1 and improve Chinese out…
Linting and Pre-commit checks #7: Commit 242d1c9 pushed by chandralegend
July 21, 2024 18:55 37s main
July 21, 2024 18:55 37s
added correct tokenizers
Linting and Pre-commit checks #6: Commit ed7330c pushed by chandralegend
July 21, 2024 18:15 41s main
July 21, 2024 18:15 41s
added script to create tokenizers out of hf datasets
Linting and Pre-commit checks #5: Commit d088808 pushed by chandralegend
July 21, 2024 11:01 37s main
July 21, 2024 11:01 37s
pretokenization added
Linting and Pre-commit checks #4: Commit 02e2de7 pushed by chandralegend
July 21, 2024 09:16 41s main
July 21, 2024 09:16 41s
added language detection
Linting and Pre-commit checks #3: Commit e658ed5 pushed by chandralegend
July 21, 2024 08:38 42s main
July 21, 2024 08:38 42s
feat: Add tokenizers dependency and update Python version to 3.12
Linting and Pre-commit checks #2: Commit 89f810c pushed by chandralegend
July 20, 2024 18:26 36s main
July 20, 2024 18:26 36s
PyPI Release
PyPI Release #1: Manually run by chandralegend
July 19, 2024 19:29 35s main
July 19, 2024 19:29 35s
init python package structure
Linting and Pre-commit checks #1: Commit c6e6ff5 pushed by chandralegend
July 19, 2024 19:18 37s main
July 19, 2024 19:18 37s