Skip to content

Safer tokens with single tokenizers 🤕

Pre-release
Pre-release
Compare
Choose a tag to compare
@mathewsanders mathewsanders released this 04 Jan 03:03
· 21 commits to master since this release
0.3.0
6aff827 
Add default tokenizer type protocol (#3)

* Add DefaultTokenizerType.

* Update tests.

* Update documentation.
Assets 2
Loading