Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch aligning student corpus to fast_align #717

Draft
wants to merge 1 commit into
base: aln_chunks
Choose a base branch
from

Switch aligning student corpus to fast_align

02f7390
Select commit
Loading
Failed to load commit list.
Draft

Switch aligning student corpus to fast_align #717

Switch aligning student corpus to fast_align
02f7390
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / translate-mono-trg-ru-en-2/2 succeeded Jul 1, 2024 in 19m 55s

FirefoxCI (pull_request)

translate mono for en

Details

View task in Taskcluster
View logs in Taskcluster


Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DtQ5zn1HS4-Q7G_cWlRc0Q/artifacts/public/build/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_171987702109066/fetches/cuda-toolkit.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/M_cQiiBGTtuVqDIY4ndTgA/artifacts/public/build/file.2.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DtQ5zn1HS4-Q7G_cWlRc0Q/artifacts/public/build/cuda-toolkit.tar.zst
attempt 1/5
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NkUx2oU5QQGkNUOP9tzOfg/artifacts/public/build/vocab.spm to /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NkUx2oU5QQGkNUOP9tzOfg/artifacts/public/build/final.model.npz.best-chrf.npz to /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NkUx2oU5QQGkNUOP9tzOfg/artifacts/public/build/vocab.spmDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NkUx2oU5QQGkNUOP9tzOfg/artifacts/public/build/final.model.npz.best-chrf.npz

/home/ubuntu/tasks/task_171987702109066/./fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NkUx2oU5QQGkNUOP9tzOfg/artifacts/public/build/vocab.spm resolved to 252592 bytes with sha256 cfe92f74764c406148110c47da747b23f4b84227eb0f9baed40647160bd81427 in 0.256s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/M_cQiiBGTtuVqDIY4ndTgA/artifacts/public/build/file.2.zst resolved to 257868 bytes with sha256 7868f81e2cbe9f7224956a0fa17537d762b714b89d4589b70c1e2faa606e0844 in 0.350s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NkUx2oU5QQGkNUOP9tzOfg/artifacts/public/build/final.model.npz.best-chrf.npz resolved to 137530873 bytes with sha256 97181e780967d3f709e1285a3e24d9629a568fecc2969342f1788890fefb16d2 in 6.143s
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cCr_z2sITDGiow53WiHs8g/artifacts/public/build/marian.tar.zst resolved to 684170918 bytes with sha256 674b3ad4462d1b7ef22e1f2a5a1e340385136821b0e5f4b48af357281a41d819 in 7.802s
Extracting /home/ubuntu/tasks/task_171987702109066/fetches/marian.tar.zst to /home/ubuntu/tasks/task_171987702109066/fetches
/home/ubuntu/tasks/task_171987702109066/fetches/marian.tar.zst extracted in 6.690s
Removing /home/ubuntu/tasks/task_171987702109066/fetches/marian.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DtQ5zn1HS4-Q7G_cWlRc0Q/artifacts/public/build/cuda-toolkit.tar.zst resolved to 3295138224 bytes with sha256 e3bdbf0078b8eb8c7804039d6cf6a10b673212bedf1d016a7b4a7eed3ead5f04 in 60.099s
Extracting /home/ubuntu/tasks/task_171987702109066/fetches/cuda-toolkit.tar.zst to /home/ubuntu/tasks/task_171987702109066/fetches
/home/ubuntu/tasks/task_171987702109066/fetches/cuda-toolkit.tar.zst extracted in 17.826s
Removing /home/ubuntu/tasks/task_171987702109066/fetches/cuda-toolkit.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 78.80821955199997, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-07-01T23:41:51.326Z] finished fetching artifacts
[task 2024-07-01T23:41:51.326Z] executing ['bash', '-xc', 'export MARIAN=$MOZ_FETCHES_DIR && $VCS_PATH/taskcluster/scripts/pipeline/translate-taskcluster.sh $MOZ_FETCHES_DIR/file.2.zst artifacts plain $MOZ_FETCHES_DIR/vocab.spm $MOZ_FETCHES_DIR/*.npz  --mini-batch-words 2000']
[task 2024-07-01T23:41:51.329Z] + export MARIAN=/home/ubuntu/tasks/task_171987702109066/fetches
[task 2024-07-01T23:41:51.329Z] + MARIAN=/home/ubuntu/tasks/task_171987702109066/fetches
[task 2024-07-01T23:41:51.329Z] + ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh /home/ubuntu/tasks/task_171987702109066/fetches/file.2.zst artifacts plain /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2024-07-01T23:41:51.331Z] + set -euo pipefail
[task 2024-07-01T23:41:51.331Z] + input=/home/ubuntu/tasks/task_171987702109066/fetches/file.2.zst
[task 2024-07-01T23:41:51.331Z] + output_dir=artifacts
[task 2024-07-01T23:41:51.331Z] + type=plain
[task 2024-07-01T23:41:51.331Z] + other_args=("${@:4}")
[task 2024-07-01T23:41:51.331Z] ++ dirname ./checkouts/vcs/taskcluster/scripts/pipeline/translate-taskcluster.sh
[task 2024-07-01T23:41:51.332Z] + pushd ./checkouts/vcs/taskcluster/scripts/pipeline/../../..
[task 2024-07-01T23:41:51.333Z] ++ pwd
[task 2024-07-01T23:41:51.333Z] + VCS_ROOT=/home/ubuntu/tasks/task_171987702109066/checkouts/vcs
[task 2024-07-01T23:41:51.333Z] + popd
[task 2024-07-01T23:41:51.333Z] + mkdir -p artifacts
[task 2024-07-01T23:41:51.335Z] + zstd -d --rm /home/ubuntu/tasks/task_171987702109066/fetches/file.2.zst
[task 2024-07-01T23:41:51.616Z] 
[task 2024-07-01T23:41:51.619Z] 6/fetches/file.2.zst : 0 MB...     
[task 2024-07-01T23:41:51.619Z]                                                                                
[task 2024-07-01T23:41:51.619Z] /home/ubuntu/tasks/task_171987702109066/fetches/file.2.zst: 616144 bytes 
[task 2024-07-01T23:41:51.619Z] + input=/home/ubuntu/tasks/task_171987702109066/fetches/file.2
[task 2024-07-01T23:41:51.619Z] + outfile=/home/ubuntu/tasks/task_171987702109066/fetches/file.2.out
[task 2024-07-01T23:41:51.619Z] + '[' plain = nbest ']'
[task 2024-07-01T23:41:51.619Z] + '[' -s /home/ubuntu/tasks/task_171987702109066/fetches/file.2 ']'
[task 2024-07-01T23:41:51.619Z] + '[' plain = plain ']'
[task 2024-07-01T23:41:51.619Z] + /home/ubuntu/tasks/task_171987702109066/checkouts/vcs/pipeline/translate/translate.sh /home/ubuntu/tasks/task_171987702109066/fetches/file.2 /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000
[task 2024-07-01T23:41:51.621Z] + set -euo pipefail
[task 2024-07-01T23:41:51.621Z] + test -v GPUS
[task 2024-07-01T23:41:51.621Z] + test -v MARIAN
[task 2024-07-01T23:41:51.621Z] + test -v WORKSPACE
[task 2024-07-01T23:41:51.621Z] + input=/home/ubuntu/tasks/task_171987702109066/fetches/file.2
[task 2024-07-01T23:41:51.621Z] + vocab=/home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm
[task 2024-07-01T23:41:51.621Z] + models=("${@:3}")
[task 2024-07-01T23:41:51.622Z] ++ dirname /home/ubuntu/tasks/task_171987702109066/checkouts/vcs/pipeline/translate/translate.sh
[task 2024-07-01T23:41:51.623Z] + cd /home/ubuntu/tasks/task_171987702109066/checkouts/vcs/pipeline/translate
[task 2024-07-01T23:41:51.623Z] + /home/ubuntu/tasks/task_171987702109066/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm -i /home/ubuntu/tasks/task_171987702109066/fetches/file.2 -o /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out --log /home/ubuntu/tasks/task_171987702109066/fetches/file.2.log -d 0 1 2 3 -w 12000
[task 2024-07-01T23:42:08.081Z] [2024-07-01 23:42:08] [marian] Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-07-01T23:42:08.081Z] [2024-07-01 23:42:08] [marian] Running on translations-1-b-linux-v100-gpu-4-cg-1xgfat0mq3f61rfh3jw as process 2686 with command line:
[task 2024-07-01T23:42:08.081Z] [2024-07-01 23:42:08] [marian] /home/ubuntu/tasks/task_171987702109066/fetches/marian-decoder -c decoder.yml -m /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz --mini-batch-words 2000 -v /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm -i /home/ubuntu/tasks/task_171987702109066/fetches/file.2 -o /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out --log /home/ubuntu/tasks/task_171987702109066/fetches/file.2.log -d 0 1 2 3 -w 12000
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] alignment: ""
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] allow-special: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] allow-unk: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] authors: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] beam-size: 8
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] bert-class-symbol: "[CLS]"
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] bert-mask-symbol: "[MASK]"
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] bert-masking-fraction: 0.15
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] bert-sep-symbol: "[SEP]"
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] bert-train-type-embeddings: true
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] bert-type-vocab-size: 2
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] best-deep: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] build-info: ""
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] check-nan: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] cite: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-augment-bad: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-dropout: 0.1
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-final-sigmoid: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-mix: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-mix-norm: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-mixup: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-mixup-reg: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-pooler-ffn:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 2048
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 1024
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-prepend-zero: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] comet-stop-grad: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] cpu-threads: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] data-threads: 8
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dec-cell: gru
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dec-cell-base-depth: 2
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dec-cell-high-depth: 1
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dec-depth: 1
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] devices:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 1
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 2
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 3
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dim-emb: 512
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dim-rnn: 1024
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dim-vocabs:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 1000
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - 1000
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] dump-config: ""
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] enc-cell: gru
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] enc-cell-depth: 1
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] enc-depth: 1
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] enc-type: bidirectional
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] factors-combine: sum
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] factors-dim-emb: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] force-decode: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] gemm-type: float32
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] ignore-model-config: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] input:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - /home/ubuntu/tasks/task_171987702109066/fetches/file.2
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] input-types:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   []
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] interpolate-env-vars: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] layer-normalization: True
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] lemma-dependency: ""
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] lemma-dim-emb: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] log: /home/ubuntu/tasks/task_171987702109066/fetches/file.2.log
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] log-level: info
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] log-time-zone: ""
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] max-length: 200
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] max-length-crop: true
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] max-length-factor: 3
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] maxi-batch: 1000
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] maxi-batch-sort: src
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] mini-batch: 16
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] mini-batch-words: 2000
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] model-mmap: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] models:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] n-best: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] no-spm-decode: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] no-spm-encode: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] normalize: 1.0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] optimize: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] output: /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] output-approx-knn:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   []
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] output-omit-bias: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] output-sampling:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   []
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] precision:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   - float32
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] quantize-range: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] quiet: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] quiet-translation: True
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] relative-paths: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] right-left: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] seed: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] shortlist:
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config]   []
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] skip: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] skip-cost: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] stat-freq: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] tied-embeddings: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] tied-embeddings-all: True
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] tied-embeddings-src: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-aan-activation: swish
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-aan-depth: 2
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-aan-nogate: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-decoder-autoreg: self-attention
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-decoder-dim-ffn: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-decoder-ffn-depth: 0
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-depth-scaling: false
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-dim-aan: 2048
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-dim-ffn: 2048
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-ffn-activation: swish
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-ffn-depth: 2
[task 2024-07-01T23:42:08.084Z] [2024-07-01 23:42:08] [config] transformer-guided-alignment-layer: last
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-heads: 8
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-no-affine: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-no-bias: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-no-projection: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-pool: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-postprocess: dan
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-postprocess-emb: d
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-postprocess-top: ""
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-preprocess: ""
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-rnn-projection: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-tied-layers:
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config]   []
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] transformer-train-position-embeddings: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] tsv: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] tsv-fields: 0
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] type: s2s
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] ulr: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] ulr-dim-emb: 0
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] ulr-trainable-transformation: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] version: v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] vocabs:
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config]   - /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config]   - /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] weights:
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config]   []
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] word-penalty: 0
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] word-scores: false
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] workspace: 12000
[task 2024-07-01T23:42:08.085Z] [2024-07-01 23:42:08] [config] Loaded model has been created with Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-07-01T23:42:08.086Z] [2024-07-01 23:42:08] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm
[task 2024-07-01T23:42:08.091Z] [2024-07-01 23:42:08] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_171987702109066/fetches/vocab.spm
[task 2024-07-01T23:42:08.094Z] [2024-07-01 23:42:08] Loading model from /home/ubuntu/tasks/task_171987702109066/fetches/final.model.npz.best-chrf.npz
[task 2024-07-01T23:42:10.815Z] [2024-07-01 23:42:10] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-07-01T23:42:10.815Z] [2024-07-01 23:42:10] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-07-01T23:42:10.815Z] [2024-07-01 23:42:10] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-07-01T23:42:10.815Z] [2024-07-01 23:42:10] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-07-01T23:42:11.054Z] [2024-07-01 23:42:11] Loaded model config
[task 2024-07-01T23:42:11.056Z] [2024-07-01 23:42:11] Loaded model config
[task 2024-07-01T23:42:11.071Z] [2024-07-01 23:42:11] Loaded model config
[task 2024-07-01T23:42:11.077Z] [2024-07-01 23:42:11] Loaded model config
[task 2024-07-01T23:42:11.178Z] [2024-07-01 23:42:11] Loading scorer of type s2s as feature F0
[task 2024-07-01T23:42:11.181Z] [2024-07-01 23:42:11] Loading scorer of type s2s as feature F0
[task 2024-07-01T23:42:11.197Z] [2024-07-01 23:42:11] Loading scorer of type s2s as feature F0
[task 2024-07-01T23:42:11.210Z] [2024-07-01 23:42:11] Loading scorer of type s2s as feature F0
[task 2024-07-01T23:42:11.347Z] [2024-07-01 23:42:11] [memory] Reserving 131 MB, device gpu2
[task 2024-07-01T23:42:11.352Z] [2024-07-01 23:42:11] [memory] Reserving 131 MB, device gpu1
[task 2024-07-01T23:42:11.367Z] [2024-07-01 23:42:11] [memory] Reserving 131 MB, device gpu0
[task 2024-07-01T23:42:11.391Z] [2024-07-01 23:42:11] [memory] Reserving 131 MB, device gpu3
[task 2024-07-01T23:42:13.363Z] [2024-07-01 23:42:13] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-07-01T23:42:33.473Z] [2024-07-01 23:42:33] Total time: 21.96216s wall
[task 2024-07-01T23:42:38.710Z] ++ wc -l
[task 2024-07-01T23:42:39.037Z] ++ wc -l
[task 2024-07-01T23:42:39.039Z] + test 4963 == 4963
[task 2024-07-01T23:42:39.040Z] + zstd --rm /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out
[task 2024-07-01T23:42:39.041Z] 
[task 2024-07-01T23:42:39.041Z]                                                                                
[task 2024-07-01T23:42:39.044Z] Read :  0 /  1 MB ==>  0%
[task 2024-07-01T23:42:39.044Z]                                                                                
[task 2024-07-01T23:42:39.044Z] /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out :  2.46%   (1218425 =>  30021 bytes, /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out.zst) 
[task 2024-07-01T23:42:39.045Z] + cp /home/ubuntu/tasks/task_171987702109066/fetches/file.2.out.zst artifacts
[fetches 2024-07-01T23:42:39.047Z] removing /home/ubuntu/tasks/task_171987702109066/fetches
[fetches 2024-07-01T23:42:43.237Z] finished
[taskcluster 2024-07-01T23:42:43.248Z]    Exit Code: 0
[taskcluster 2024-07-01T23:42:43.248Z]    User Time: 1m47.854016s
[taskcluster 2024-07-01T23:42:43.248Z]  Kernel Time: 31.986706s
[taskcluster 2024-07-01T23:42:43.248Z]    Wall Time: 2m27.188374617s
[taskcluster 2024-07-01T23:42:43.248Z]       Result: SUCCEEDED
[taskcluster 2024-07-01T23:42:43.249Z] === Task Finished ===
[taskcluster 2024-07-01T23:42:43.249Z] Task Duration: 2m27.190185697s
[taskcluster 2024-07-01T23:42:43.294Z] Uploading artifact public/build/file.2.out.zst from file /home/ubuntu/tasks/task_171987702109066/artifacts/file.2.out.zst with content encoding "identity", mime type "application/zstd" and expiry 2025-06-26T23:22:49.036Z
[taskcluster 2024-07-01T23:42:43.453Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_171987702109066/checkouts" to "/home/ubuntu/caches/BRYrR-FkQzylCa8L3lFkjQ"
[taskcluster 2024-07-01T23:42:43.627Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-06-26T23:22:49.036Z