Skip to content

Version 4.9
Compare
Choose a tag to compare
@huseinzol05 huseinzol05 released this 02 Aug 08:46
· 246 commits to master since this release
v4.9
ef9e94f
  1. Released EN-MS translation alignment using Eflomal, https://malaya.readthedocs.io/en/latest/alignment-en-ms-eflomal.html
  2. Released EN-MS translation alignment using HuggingFace, https://malaya.readthedocs.io/en/latest/alignment-en-ms-huggingface.html
  3. Released MS-EN translation alignment using Eflomal, https://malaya.readthedocs.io/en/latest/alignment-ms-en-eflomal.html
  4. Released MS-EN translation alignment using HuggingFace, https://malaya.readthedocs.io/en/latest/alignment-ms-en-huggingface.html
  5. Now preprocessing able to use NMT, https://malaya.readthedocs.io/en/latest/load-preprocessing.html#Load-translation
  6. Released Demoji module, https://malaya.readthedocs.io/en/latest/load-demoji.html
  7. Added transformer for Rumi-Jawi converter, https://malaya.readthedocs.io/en/latest/load-rumi-jawi.html, BASE size model WER 0.043%
  8. Added transformer for Jawi-Rumi converter, https://malaya.readthedocs.io/en/latest/load-rumi-jawi.html, BASE size model WER 0.3%
  9. Added substring language detection combined rules based and deep learning model, https://malaya.readthedocs.io/en/latest/language-detection-words.html
  10. Added EN-MS translation trained on noisy dataset to have better translation on local context, https://malaya.readthedocs.io/en/latest/load-translation-noisy-en-ms.html
  11. Added EN-MS translation using HuggingFace trained on noisy dataset to have better translation on local context, https://malaya.readthedocs.io/en/latest/load-translation-noisy-en-ms-huggingface.html
  12. Added MS-EN translation trained on noisy dataset to have better translation on local context, https://malaya.readthedocs.io/en/latest/load-translation-noisy-ms-en.html
  13. Added EN-MS translation using HuggingFace trained on noisy dataset to have better translation on local context, https://malaya.readthedocs.io/en/latest/load-translation-noisy-ms-en-huggingface.html
  14. Now normalizer able to translate, https://malaya.readthedocs.io/en/latest/load-normalizer.html#Use-translator
  15. Now normalizer able to group similar subword languages and translate to get better local context translation, https://malaya.readthedocs.io/en/latest/load-normalizer.html#Problem-with-single-word-translation
  16. Now normalizer able to segment words, https://malaya.readthedocs.io/en/latest/load-normalizer.html#Use-segmenter
  17. Now normalizer able to normalize emoji, https://malaya.readthedocs.io/en/latest/load-normalizer.html#Normalize-emoji
Assets 2
Loading