Skip to content

lowercase tokens

Compare
Choose a tag to compare
@hardikp hardikp released this 01 May 18:30
· 2 commits to master since this release

Text data is same as the previous release, but only the lowercase tokens are considered here.
Number of tokens: 2.2M
Vocab size: 13522