Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to ICU tokenizer #939

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Use ICU system package

d585a63
Select commit
Loading
Failed to load commit list.
Open

Switch to ICU tokenizer #939

Use ICU system package
d585a63
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / translate-corpus-ru-en-1/2 succeeded Nov 23, 2024 in 1h 9m 47s

FirefoxCI (pull_request)

translate corpus for ru-en

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-11-22T23:57:25.100Z
Resolved: 2024-11-23T00:00:19.383Z
Task Execution Time: 2 minutes, 54 seconds, 283 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/build/file.1.nbest.zst
- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2024-11-22T23:57:25.312Z] Worker Type (translations-1/b-linux-v100-gpu-4-1tb) settings:
[taskcluster 2024-11-22T23:57:25.312Z]   {
[taskcluster 2024-11-22T23:57:25.312Z]     "config": {
[taskcluster 2024-11-22T23:57:25.312Z]       "deploymentId": ""
[taskcluster 2024-11-22T23:57:25.312Z]     },
[taskcluster 2024-11-22T23:57:25.312Z]     "generic-worker": {
[taskcluster 2024-11-22T23:57:25.312Z]       "engine": "insecure",
[taskcluster 2024-11-22T23:57:25.312Z]       "go-arch": "amd64",
[taskcluster 2024-11-22T23:57:25.312Z]       "go-os": "linux",
[taskcluster 2024-11-22T23:57:25.312Z]       "go-version": "go1.22.2",
[taskcluster 2024-11-22T23:57:25.312Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v64.2.6",
[taskcluster 2024-11-22T23:57:25.312Z]       "revision": "edab196d7d030a5d625b77335109cd9060ab7e1f",
[taskcluster 2024-11-22T23:57:25.312Z]       "source": "https://github.com/taskcluster/taskcluster/commits/edab196d7d030a5d625b77335109cd9060ab7e1f",
[taskcluster 2024-11-22T23:57:25.312Z]       "version": "64.2.6"
[taskcluster 2024-11-22T23:57:25.312Z]     },
[taskcluster 2024-11-22T23:57:25.312Z]     "image": "projects/taskcluster-imaging/global/images/gw-translations-gcp-googlecompute-2024-04-22t18-22-42z",
[taskcluster 2024-11-22T23:57:25.312Z]     "instance-id": "5329559186251228962",
[taskcluster 2024-11-22T23:57:25.312Z]     "instance-type": "projects/887720501152/machineTypes/custom-40-262144",
[taskcluster 2024-11-22T23:57:25.312Z]     "local-ipv4": "10.138.0.73",
[taskcluster 2024-11-22T23:57:25.312Z]     "project-id": "fxci-production-level1-workers",

...(147 lines hidden)...

[task 2024-11-22T23:59:45.604Z] + set -euo pipefail
[task 2024-11-22T23:59:45.604Z] + test -v GPUS
[task 2024-11-22T23:59:45.604Z] + test -v MARIAN
[task 2024-11-22T23:59:45.604Z] + test -v WORKSPACE
[task 2024-11-22T23:59:45.604Z] + input=/home/ubuntu/tasks/task_173231984523456/fetches/file.1
[task 2024-11-22T23:59:45.604Z] + vocab=/home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm
[task 2024-11-22T23:59:45.604Z] + models=("${@:3}")
[task 2024-11-22T23:59:45.604Z] + output=/home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest
[task 2024-11-22T23:59:45.605Z] ++ dirname /home/ubuntu/tasks/task_173231984523456/checkouts/vcs/pipeline/translate/translate-nbest.sh
[task 2024-11-22T23:59:45.606Z] + cd /home/ubuntu/tasks/task_173231984523456/checkouts/vcs/pipeline/translate
[task 2024-11-22T23:59:45.606Z] + /home/ubuntu/tasks/task_173231984523456/fetches/marian-decoder --config decoder.yml --models /home/ubuntu/tasks/task_173231984523456/fetches/model1/final.model.npz.best-chrf.npz --mini-batch-words 1000 --precision float16 --vocabs /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm --input /home/ubuntu/tasks/task_173231984523456/fetches/file.1 --output /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest --log /home/ubuntu/tasks/task_173231984523456/fetches/file.1.log --n-best --devices 0 1 2 3 --workspace 12000
[task 2024-11-22T23:59:56.248Z] [2024-11-22 23:59:56] [marian] Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-11-22T23:59:56.248Z] [2024-11-22 23:59:56] [marian] Running on translations-1-b-linux-v100-gpu-4-1tb-luietkrprguuxzzuhj2-jg as process 4100 with command line:
[task 2024-11-22T23:59:56.248Z] [2024-11-22 23:59:56] [marian] /home/ubuntu/tasks/task_173231984523456/fetches/marian-decoder --config decoder.yml --models /home/ubuntu/tasks/task_173231984523456/fetches/model1/final.model.npz.best-chrf.npz --mini-batch-words 1000 --precision float16 --vocabs /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm --input /home/ubuntu/tasks/task_173231984523456/fetches/file.1 --output /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest --log /home/ubuntu/tasks/task_173231984523456/fetches/file.1.log --n-best --devices 0 1 2 3 --workspace 12000
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] alignment: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] allow-special: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] allow-unk: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] authors: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] beam-size: 8
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] bert-class-symbol: "[CLS]"
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] bert-mask-symbol: "[MASK]"
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] bert-masking-fraction: 0.15
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] bert-sep-symbol: "[SEP]"
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] bert-train-type-embeddings: true
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] bert-type-vocab-size: 2
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] best-deep: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] build-info: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] check-nan: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] cite: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-augment-bad: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-dropout: 0.1
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-final-sigmoid: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-mix: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-mix-norm: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-mixup: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-mixup-reg: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-pooler-ffn:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 2048
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 1024
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-prepend-zero: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] comet-stop-grad: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] cpu-threads: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] data-threads: 8
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dec-cell: gru
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dec-cell-base-depth: 2
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dec-cell-high-depth: 1
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dec-depth: 6
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] devices:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 1
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 2
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 3
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dim-emb: 512
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dim-rnn: 1024
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dim-vocabs:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 1000
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - 1000
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] dump-config: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] enc-cell: gru
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] enc-cell-depth: 1
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] enc-depth: 6
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] enc-type: bidirectional
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] factors-combine: sum
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] factors-dim-emb: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] force-decode: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] gemm-type: float32
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] ignore-model-config: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] input:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - /home/ubuntu/tasks/task_173231984523456/fetches/file.1
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] input-types:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   []
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] interpolate-env-vars: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] layer-normalization: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] lemma-dependency: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] lemma-dim-emb: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] log: /home/ubuntu/tasks/task_173231984523456/fetches/file.1.log
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] log-level: info
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] log-time-zone: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] max-length: 200
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] max-length-crop: true
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] max-length-factor: 3
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] maxi-batch: 10000
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] maxi-batch-sort: src
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] mini-batch: 1
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] mini-batch-words: 1000
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] model-mmap: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] models:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - /home/ubuntu/tasks/task_173231984523456/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] n-best: true
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] no-spm-decode: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] no-spm-encode: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] normalize: 1.0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] optimize: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] output: /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] output-approx-knn:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   []
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] output-omit-bias: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] output-sampling:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   []
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] precision:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - float16
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] quantize-range: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] quiet: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] quiet-translation: True
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] relative-paths: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] right-left: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] seed: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] shortlist:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   []
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] skip: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] skip-cost: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] stat-freq: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] tied-embeddings: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] tied-embeddings-all: true
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] tied-embeddings-src: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-aan-activation: swish
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-aan-depth: 2
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-aan-nogate: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-decoder-autoreg: self-attention
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-decoder-dim-ffn: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-decoder-ffn-depth: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-depth-scaling: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-dim-aan: 2048
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-dim-ffn: 2048
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-ffn-activation: relu
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-ffn-depth: 2
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-guided-alignment-layer: last
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-heads: 8
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-no-affine: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-no-bias: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-no-projection: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-pool: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-postprocess: dan
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-postprocess-emb: d
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-postprocess-top: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-preprocess: ""
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-rnn-projection: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-tied-layers:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   []
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] transformer-train-position-embeddings: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] tsv: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] tsv-fields: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] type: transformer
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] ulr: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] ulr-dim-emb: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] ulr-trainable-transformation: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] version: v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] vocabs:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   - /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] weights:
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config]   []
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] word-penalty: 0
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] word-scores: false
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] workspace: 12000
[task 2024-11-22T23:59:56.251Z] [2024-11-22 23:59:56] [config] Loaded model has been created with Marian v1.12.14 2d067af 2024-02-16 11:44:13 -0500
[task 2024-11-22T23:59:56.253Z] [2024-11-22 23:59:56] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm
[task 2024-11-22T23:59:56.257Z] [2024-11-22 23:59:56] [data] Loading SentencePiece vocabulary from file /home/ubuntu/tasks/task_173231984523456/fetches/vocab.spm
[task 2024-11-22T23:59:56.260Z] [2024-11-22 23:59:56] Loading model from /home/ubuntu/tasks/task_173231984523456/fetches/model1/final.model.npz.best-chrf.npz
[task 2024-11-22T23:59:57.300Z] [2024-11-22 23:59:57] [memory] Extending reserved space to 12032 MB (device gpu3)
[task 2024-11-22T23:59:57.300Z] [2024-11-22 23:59:57] [memory] Extending reserved space to 12032 MB (device gpu2)
[task 2024-11-22T23:59:57.300Z] [2024-11-22 23:59:57] [memory] Extending reserved space to 12032 MB (device gpu0)
[task 2024-11-22T23:59:57.300Z] [2024-11-22 23:59:57] [memory] Extending reserved space to 12032 MB (device gpu1)
[task 2024-11-22T23:59:57.603Z] [2024-11-22 23:59:57] Loaded model config
[task 2024-11-22T23:59:57.603Z] [2024-11-22 23:59:57] Loaded model config
[task 2024-11-22T23:59:57.603Z] [2024-11-22 23:59:57] Loaded model config
[task 2024-11-22T23:59:57.604Z] [2024-11-22 23:59:57] Loaded model config
[task 2024-11-22T23:59:57.751Z] [2024-11-22 23:59:57] Loading scorer of type transformer as feature F0
[task 2024-11-22T23:59:57.752Z] [2024-11-22 23:59:57] Loading scorer of type transformer as feature F0
[task 2024-11-22T23:59:57.752Z] [2024-11-22 23:59:57] Loading scorer of type transformer as feature F0
[task 2024-11-22T23:59:57.754Z] [2024-11-22 23:59:57] Loading scorer of type transformer as feature F0
[task 2024-11-22T23:59:57.958Z] [2024-11-22 23:59:57] [memory] Reserving 85 MB, device gpu0
[task 2024-11-22T23:59:57.959Z] [2024-11-22 23:59:57] [memory] Reserving 85 MB, device gpu1
[task 2024-11-22T23:59:57.960Z] [2024-11-22 23:59:57] [memory] Reserving 85 MB, device gpu2
[task 2024-11-22T23:59:57.964Z] [2024-11-22 23:59:57] [memory] Reserving 85 MB, device gpu3
[task 2024-11-22T23:59:58.774Z] [2024-11-22 23:59:58] [gpu] 16-bit TensorCores enabled for float32 matrix operations
[task 2024-11-23T00:00:09.421Z] [2024-11-23 00:00:09] Total time: 11.35114s wall
[task 2024-11-23T00:00:16.036Z] ++ wc -l
[task 2024-11-23T00:00:16.169Z] ++ wc -l
[task 2024-11-23T00:00:16.171Z] + test 4000 -eq 4000
[task 2024-11-23T00:00:16.172Z] + zstd --rm /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest
[task 2024-11-23T00:00:16.173Z] 
[task 2024-11-23T00:00:16.173Z]                                                                                
[task 2024-11-23T00:00:16.181Z] Read :  0 /  3 MB ==>  0%
[task 2024-11-23T00:00:16.181Z]                                                                                
[task 2024-11-23T00:00:16.181Z] /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest :  1.76%   (3659939 =>  64541 bytes, /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest.zst) 
[task 2024-11-23T00:00:16.182Z] + cp /home/ubuntu/tasks/task_173231984523456/fetches/file.1.nbest.zst artifacts
[fetches 2024-11-23T00:00:16.185Z] removing /home/ubuntu/tasks/task_173231984523456/fetches
[fetches 2024-11-23T00:00:18.892Z] finished
[taskcluster 2024-11-23T00:00:18.903Z]    Exit Code: 0
[taskcluster 2024-11-23T00:00:18.903Z]    User Time: 1m18.849842s
[taskcluster 2024-11-23T00:00:18.903Z]  Kernel Time: 31.451145s
[taskcluster 2024-11-23T00:00:18.903Z]    Wall Time: 2m52.881179189s
[taskcluster 2024-11-23T00:00:18.903Z]       Result: SUCCEEDED
[taskcluster 2024-11-23T00:00:18.904Z] === Task Finished ===
[taskcluster 2024-11-23T00:00:18.904Z] Task Duration: 2m52.884198738s
[taskcluster 2024-11-23T00:00:18.937Z] Uploading artifact public/build/file.1.nbest.zst from file /home/ubuntu/tasks/task_173231984523456/artifacts/file.1.nbest.zst with content encoding "identity", mime type "application/zstd" and expiry 2025-11-17T22:50:30.792Z
[taskcluster 2024-11-23T00:00:19.131Z] [mounts] Preserving cache: Moving "/home/ubuntu/tasks/task_173231984523456/checkouts" to "/home/ubuntu/caches/PRjZQ5BKSii_44_sciwOIg"
[taskcluster 2024-11-23T00:00:19.168Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-11-17T22:50:30.792Z