NMT models for Bergamot

Teacher and student NMT models are described in subdirectories. We have prepared models for the following language pairs:

• Estonian-English
• English-Estonian
• Spanish-English
• English-Spanish
• English-German

Instructions

1. Download and compile the latest marian-dev in the upper directory:

    bash install.sh
   

   The compilation requires MKL and gperftools, see the Marian documentation to find which packages are needed on Ubuntu.

2. Go to a subdirectory, download data and model files, e.g.:

    cd eten
    bash download-data.sh
    bash download-models.sh
   

   See README file for more details.

3. Go to a model directory and run the evaluation script, e.g.:

    cd eten.student.tiny11
    bash eval.sh -d 0       # -d 0 means use first GPU
   

   or benchmarking scripts:

    bash speed.gpu.sh -d 0
    bash speed.cpu.sh
    bash speed.cpu.packed8.sh   # requires CPU with avx2
   

   See individual scripts for details.