Skip to content

v0.1.0
Compare
Choose a tag to compare
@guuzaa guuzaa released this 11 Sep 15:01
· 8 commits to main since this release
v0.1.0
ad064b1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Release Notes for Rust Token Count (tc) 🦀

Version 0.1.0

We're excited to announce the initial release of Rust Token Count (tc), a simple and efficient token count program written in Rust! 🚀

🎉 Features

  • Multi-purpose Counting: Count lines, words, characters, and tokens in text files or from standard input.
  • Unicode Support: Fully supports Unicode, including multi-byte characters.
  • Multiple File Processing: Ability to process multiple files in a single command.
  • Standard Input Handling: Can read from standard input for flexible usage.
  • Tokenizer Models: Support for various tokenizer models including GPT-3, GPT-4, and more.
  • Customizable Output: Users can choose which counts to display (lines, words, characters, tokens).
Assets 13
Loading