Skip to content

Version 4.9.2
Compare
Choose a tag to compare
@huseinzol05 huseinzol05 released this 17 Sep 13:30
· 213 commits to master since this release
v.4.9.2
0f5a17c
  1. Released Masked language model text scoring, https://malaya.readthedocs.io/en/latest/load-mlm.html
  2. Released GPT2 language model text scoring, https://malaya.readthedocs.io/en/latest/load-gpt2-lm.html
  3. Compare spelling correction results using KenLM, Masked LM and GPT2 LM, https://malaya.readthedocs.io/en/latest/load-gpt2-lm.html
  4. Added deep learning based for syllable tokenizer, with WER accuracy is 4.3% while rules based WER accuracy is 9.01%, https://malaya.readthedocs.io/en/latest/load-tokenizer-syllable.html
  5. Starting 4.9.2, pytorch and transformers are necessary libraries for Malaya.
Assets 2
Loading