Skip to content
This repository has been archived by the owner on Jul 14, 2021. It is now read-only.

mozilla-applied-ml/bergamot-models

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 

Repository files navigation

bergamot-models

This repo was moved to https://github.com/mozilla/firefox-translations-models

Repo to host Bergamot models

prod - models that are uploaded to GCS and available to use in https://github.com/mozilla-extensions/firefox-translations dev - models under development (can be with low quality or speed)

Command to generate bin models:

marian-conv -f model.esen.npz -t model.esen.bin -g float32

Command to generate binary shortlists:

marian-conv --shortlist lex.esen.s2t.gz 50 50 0 --dump lex.50.50.esen.s2t.bin --vocabs vocab.esen.spm vocab.esen.spm

Uploading to GCS

cd prod
gzip -dr *
# bump version
gsutil -m cp -rZn * gs://bergamot-models-sandbox/0.2.0/

Currently supported Languages

Prod

  • Spanish <-> English
  • Estonian <-> English
  • English -> German
  • Czech <-> English

Dev

  • Russian -> English

Upcoming

  • German -> English
  • French <-> English
  • Polish <-> English
  • Russian <- English
  • Portuguese <-> English