Releases: guuzaa/tc
Releases · guuzaa/tc
v0.1.2
v0.1.1.alpha1
v0.1.1
v0.1.0
Release Notes for Rust Token Count (tc) 🦀
Version 0.1.0
We're excited to announce the initial release of Rust Token Count (tc), a simple and efficient token count program written in Rust! 🚀
🎉 Features
- Multi-purpose Counting: Count lines, words, characters, and tokens in text files or from standard input.
- Unicode Support: Fully supports Unicode, including multi-byte characters.
- Multiple File Processing: Ability to process multiple files in a single command.
- Standard Input Handling: Can read from standard input for flexible usage.
- Tokenizer Models: Support for various tokenizer models including GPT-3, GPT-4, and more.
- Customizable Output: Users can choose which counts to display (lines, words, characters, tokens).