fl_tokenizer: another way to tokenize Vietnamese

Testing
Package
Meta	License - MIT

What is it?

fl_tokenizer is a Python package that provides another method to tokenize Vietnamese.

Table of Contents

• Main Features
• Where to get it
• Dependencies
• Installation from sources
• License
• Documentation

Main Features

Where to get it

The source code is currently hosted on GitHub at: https://github.com/justinnguyendsa/fl_tokenizer

# Git clone (Jupyter Notebook)
!git clone https://github.com/justinnguyendsa/fl_tokenizer

Dependencies

Installation from sources

License

MIT

Documentaion

Go to Top