Skip to content

Commit

Permalink
Results from self hosted Github actions - GO-phoenix
Browse files Browse the repository at this point in the history
arjunsuresh committed Jan 30, 2025
1 parent d2bf2ae commit a0eda35
Showing 16 changed files with 438 additions and 438 deletions.
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|--------------|------------|------------------------------------------------|--------------|-------------------|
| mixtral-8x7b | offline | (60.7242, 44.8179, 50.6964, 327.3, 100.0, 0.0) | 0.015 | - |
| mixtral-8x7b | offline | (70.1571, 41.2698, 45.0262, 245.3, 100.0, 0.0) | 0.01 | - |
Original file line number Diff line number Diff line change
@@ -37,12 +37,12 @@ Platform: gh_action-reference-cpu-pytorch_v2.6.0-default_config
Model Precision: fp32

### Accuracy Results
`ROUGE1`: `60.7242`, Required accuracy for closed division `>= 45.14291`
`ROUGE2`: `44.8179`, Required accuracy for closed division `>= 23.11907`
`ROUGEL`: `50.6964`, Required accuracy for closed division `>= 30.15619`
`TOKENS_PER_SAMPLE`: `327.3`, Required accuracy for closed division `>= 130.356` and `<= 160.49`
`ROUGE1`: `70.1571`, Required accuracy for closed division `>= 45.14291`
`ROUGE2`: `41.2698`, Required accuracy for closed division `>= 23.11907`
`ROUGEL`: `45.0262`, Required accuracy for closed division `>= 30.15619`
`TOKENS_PER_SAMPLE`: `245.3`, Required accuracy for closed division `>= 130.356` and `<= 160.49`
`gsm8k_accuracy`: `100.0`, Required accuracy for closed division `>= 72.9234`
`mbxp_accuracy`: `0.0`, Required accuracy for closed division `>= 59.5584`

### Performance Results
`Samples per second`: `0.0152169`
`Samples per second`: `0.0102599`
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
Loading dataset...
Finished loading dataset.
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:01<00:18, 1.01s/it]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:18, 1.07s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:17, 1.08s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:16, 1.08s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:15, 1.08s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:06<00:14, 1.09s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:08<00:14, 1.24s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:09<00:14, 1.35s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:11<00:15, 1.53s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:13<00:14, 1.65s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:15<00:15, 1.91s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:20<00:19, 2.80s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:22<00:15, 2.51s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:22<00:00, 1.19s/it]
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:01<00:20, 1.12s/it]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:20, 1.20s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:19, 1.20s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:17, 1.18s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:16, 1.15s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:06<00:14, 1.13s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:08<00:14, 1.25s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:13<00:27, 2.52s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:15<00:23, 2.35s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:17<00:19, 2.21s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:19<00:17, 2.15s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:22<00:17, 2.50s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:26<00:16, 2.79s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:26<00:00, 1.38s/it]
WARNING:accelerate.big_modeling:Some parameters are on the meta device because they were offloaded to the disk and cpu.
INFO:Mixtral-8x7B-Instruct-v0.1-MAIN:Starting Benchmark run
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
@@ -19,19 +19,19 @@ IssueQuery started with 3 samples
IssueQuery done
Saving outputs to run_outputs/q0.pkl
Samples run: 1
BatchMaker time: 0.004811286926269531
Inference time: 5554.25427532196
Postprocess time: 0.02920985221862793
==== Total time: 5554.288296461105
BatchMaker time: 0.004904270172119141
Inference time: 6110.053489208221
Postprocess time: 0.03488302230834961
==== Total time: 6110.093276500702
Saving outputs to run_outputs/q2.pkl
Samples run: 2
BatchMaker time: 0.11371326446533203
Inference time: 16673.079436063766
Postprocess time: 0.030445575714111328
==== Total time: 16673.223594903946
BatchMaker time: 0.07381916046142578
Inference time: 6800.104888916016
Postprocess time: 0.023260831832885742
==== Total time: 6800.20196890831
Saving outputs to run_outputs/q1.pkl
Samples run: 3
BatchMaker time: 0.05492806434631348
Inference time: 9988.861637353897
Postprocess time: 0.03887295722961426
==== Total time: 9988.955438375473
BatchMaker time: 0.060442447662353516
Inference time: 23514.97544693947
Postprocess time: 0.03243660926818848
==== Total time: 23515.0683259964
Original file line number Diff line number Diff line change
@@ -13,16 +13,16 @@ graph TD
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> get,git,repo,_branch.dev,_repo.https://github.com/mlcommons/inference
get-mlperf-inference-utils,e341e5f86d8342e5 --> get,mlperf,inference,src,_branch.dev
app-mlperf-inference,d775cac873ee4231_(_reference,_mixtral-8x7b,_pytorch,_cpu,_test,_r5.0-dev_default,_float16,_offline_) --> get,mlperf,inference,utils
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> detect,cpu
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,sys-utils-cm
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,python
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> detect,cpu
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,sys-utils-cm
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,python
get-generic-python-lib,94b62a682bc44791_(_torch_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_torch
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_torch
get-generic-python-lib,94b62a682bc44791_(_torchvision_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_torchvision
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,ml-model,mixtral,raw,_batch_size.1,_pytorch
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_torchvision
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,ml-model,mixtral,raw,_batch_size.1,_pytorch
get-generic-python-lib,94b62a682bc44791_(_package.pandas_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_package.pandas_) --> detect,cpu
@@ -34,7 +34,7 @@ graph TD
download-file,9cdc8dc41aae437e_(_cmutil,_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl_) --> download,file,_cmutil,_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl
get-dataset-mlperf-inference-mixtral,89e7c91444804775_(_size.1_) --> download-and-extract,_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,dataset-mixtral,openorca-mbxp-gsm8k-combined,_size.1
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,dataset-mixtral,openorca-mbxp-gsm8k-combined,_size.1
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,cpu
@@ -45,35 +45,35 @@ graph TD
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,mlcommons,inference,src,_branch.dev
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,sut,configs
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> generate,user-conf,mlperf,inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,loadgen
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> generate,user-conf,mlperf,inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,loadgen
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> detect,os
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> get,python3
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> get,git,repo,_branch.dev,_repo.https://github.com/mlcommons/inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,mlcommons,inference,src,_branch.dev
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,mlcommons,inference,src
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,mlcommons,inference,src,_branch.dev
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,mlcommons,inference,src
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.psutil
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,rust-compiler
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.psutil
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,rust-compiler
get-generic-python-lib,94b62a682bc44791_(_package.transformers_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.transformers
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.transformers
get-generic-python-lib,94b62a682bc44791_(_package.datasets_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.datasets
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.datasets
get-generic-python-lib,94b62a682bc44791_(_package.sentencepiece_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.sentencepiece
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.sentencepiece
get-generic-python-lib,94b62a682bc44791_(_package.protobuf_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.protobuf
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.protobuf
get-generic-python-lib,94b62a682bc44791_(_package.accelerate_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.accelerate
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.accelerate
get-generic-python-lib,94b62a682bc44791_(_package.absl-py_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.absl-py
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.absl-py
get-generic-python-lib,94b62a682bc44791_(_package.evaluate_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.evaluate
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.evaluate
get-generic-python-lib,94b62a682bc44791_(_package.nltk_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.nltk
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.nltk
get-generic-python-lib,94b62a682bc44791_(_mxeval_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_mxeval
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_mxeval
detect-cpu,586c8a43320142f7 --> detect,os
benchmark-program,19f369ef47084895 --> detect,cpu
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> benchmark-mlperf
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> benchmark-mlperf
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -147,7 +147,7 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -167,7 +167,7 @@
"script_tags": "detect,cpu,detect-cpu,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -177,7 +177,7 @@
"script_tags": "get,sys-utils-cm,sys-utils-mlc",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -187,7 +187,7 @@
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.10.12",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -207,7 +207,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "torch",
"version": "2.6.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -227,7 +227,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "torchvision",
"version": "0.21.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -237,7 +237,7 @@
"script_tags": "get,raw,ml-model,language-processing,mixtral,mixtral-8x7b",
"script_variations": "batch_size.1,pytorch",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -357,7 +357,7 @@
"script_tags": "get,dataset-mixtral,openorca-mbxp-gsm8k-combined",
"script_variations": "size.1",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -467,7 +467,7 @@
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -477,7 +477,7 @@
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
"script_variations": "",
"version": "master",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -517,7 +517,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "branch.dev",
"version": "r5.0-git-76c250b89fcbcbc89bfed2d921274eda76244216",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -527,7 +527,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "",
"version": "r5.0-git-76c250b89fcbcbc89bfed2d921274eda76244216",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -547,7 +547,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.psutil",
"version": "6.1.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -557,7 +557,7 @@
"script_tags": "get,rust-compiler",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -577,7 +577,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.transformers",
"version": "4.48.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -597,7 +597,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.datasets",
"version": "3.2.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -617,7 +617,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.sentencepiece",
"version": "0.2.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -637,7 +637,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.protobuf",
"version": "5.29.3",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -657,7 +657,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.accelerate",
"version": "1.3.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -677,7 +677,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.absl-py",
"version": "2.1.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -697,7 +697,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.evaluate",
"version": "0.4.3",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -717,7 +717,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.nltk",
"version": "3.9.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -737,7 +737,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "mxeval",
"version": "1.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -777,7 +777,7 @@
"script_tags": "mlperf,benchmark-mlperf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
}
]
Original file line number Diff line number Diff line change
@@ -26,5 +26,5 @@
],
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
"MLC_HOST_PYTHON_BITS": "64",
"MLC_HOST_SYSTEM_NAME": "23bc234306b0"
"MLC_HOST_SYSTEM_NAME": "0d8de881f608"
}
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
Loading dataset...
Finished loading dataset.
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:00<00:17, 1.04it/s]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:19, 1.15s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:18, 1.13s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:17, 1.14s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:15, 1.14s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:07<00:16, 1.24s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:09<00:17, 1.48s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:11<00:19, 1.73s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:14<00:20, 2.06s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:16<00:18, 2.04s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:20<00:21, 2.67s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:22<00:18, 2.63s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:24<00:14, 2.40s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:24<00:00, 1.30s/it]
WARNING:accelerate.big_modeling:Some parameters are on the meta device because they were offloaded to the cpu and disk.
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:01<00:20, 1.12s/it]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:20, 1.19s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:19, 1.20s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:17, 1.18s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:16, 1.17s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:06<00:14, 1.14s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:08<00:15, 1.28s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:10<00:18, 1.64s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:13<00:18, 1.82s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:15<00:16, 1.88s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:17<00:16, 2.08s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:22<00:20, 2.90s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:24<00:15, 2.60s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:24<00:00, 1.28s/it]
WARNING:accelerate.big_modeling:Some parameters are on the meta device because they were offloaded to the disk and cpu.
INFO:Mixtral-8x7B-Instruct-v0.1-MAIN:Starting Benchmark run
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
@@ -12,8 +12,8 @@ MLPerf Results Summary
SUT name : PySUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 9.29751e-05
Tokens per second: 0.0152169
Samples per second: 8.36406e-05
Tokens per second: 0.0102599
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -22,15 +22,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 5693776493834
Max latency (ns) : 32266692251603
Mean latency (ns) : 19994856593130
50.00 percentile latency (ns) : 22024101033954
90.00 percentile latency (ns) : 32266692251603
95.00 percentile latency (ns) : 32266692251603
97.00 percentile latency (ns) : 32266692251603
99.00 percentile latency (ns) : 32266692251603
99.90 percentile latency (ns) : 32266692251603
Min latency (ns) : 5912063508778
Max latency (ns) : 35867763208530
Mean latency (ns) : 18136339264804
50.00 percentile latency (ns) : 12629191077104
90.00 percentile latency (ns) : 35867763208530
95.00 percentile latency (ns) : 35867763208530
97.00 percentile latency (ns) : 35867763208530
99.00 percentile latency (ns) : 35867763208530
99.90 percentile latency (ns) : 35867763208530


================================================
@@ -69,19 +69,19 @@ IssueQuery started with 3 samples
IssueQuery done
Saving outputs to run_outputs/q0.pkl
Samples run: 1
BatchMaker time: 0.0054056644439697266
Inference time: 5693.734073638916
Postprocess time: 0.03768277168273926
==== Total time: 5693.777162075043
BatchMaker time: 0.004534482955932617
Inference time: 5912.022013664246
Postprocess time: 0.03786134719848633
==== Total time: 5912.0644094944
Saving outputs to run_outputs/q2.pkl
Samples run: 2
BatchMaker time: 0.11400723457336426
Inference time: 16330.180698871613
Postprocess time: 0.023488283157348633
==== Total time: 16330.318194389343
BatchMaker time: 0.0733802318572998
Inference time: 6717.017740011215
Postprocess time: 0.029738903045654297
==== Total time: 6717.120859146118
Saving outputs to run_outputs/q1.pkl
Samples run: 3
BatchMaker time: 0.05829310417175293
Inference time: 10242.491039037704
Postprocess time: 0.036077260971069336
==== Total time: 10242.585409402847
BatchMaker time: 0.06183290481567383
Inference time: 23238.471618890762
Postprocess time: 0.03302335739135742
==== Total time: 23238.56647515297
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux 23bc234306b0 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux 0d8de881f608 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
08:27:49 up 2 days, 12:31, 0 users, load average: 2.09, 2.54, 2.93
06:17:13 up 3 days, 10:21, 0 users, load average: 2.86, 3.38, 3.60
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -41,7 +41,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4622.721
cpu MHz : 4528.630
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -69,7 +69,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5494.386
cpu MHz : 3687.220
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -97,7 +97,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3331.765
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -125,7 +125,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.364
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -153,7 +153,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3306.334
cpu MHz : 5485.925
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -209,7 +209,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3132.374
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -237,7 +237,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.745
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -349,7 +349,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5414.644
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -377,7 +377,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5417.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -405,7 +405,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5408.707
cpu MHz : 5489.336
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -461,7 +461,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 3537.505
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -489,7 +489,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4564.277
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -517,7 +517,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.670
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -573,7 +573,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4196.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -601,7 +601,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5485.051
cpu MHz : 5621.383
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -629,7 +629,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 5510.506
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -976,49 +976,49 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
node 0 size: 128007 MB
node 0 free: 94237 MB
node 0 free: 94427 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 131080068 kB
MemFree: 96504872 kB
MemAvailable: 126866620 kB
Buffers: 27460 kB
Cached: 31725920 kB
SwapCached: 151080 kB
Active: 5568672 kB
Inactive: 26381856 kB
Active(anon): 115044 kB
Inactive(anon): 93848 kB
Active(file): 5453628 kB
Inactive(file): 26288008 kB
MemFree: 96693280 kB
MemAvailable: 127684456 kB
Buffers: 24648 kB
Cached: 31729948 kB
SwapCached: 170544 kB
Active: 31695920 kB
Inactive: 270664 kB
Active(anon): 113060 kB
Inactive(anon): 109504 kB
Active(file): 31582860 kB
Inactive(file): 161160 kB
Unevictable: 4360 kB
Mlocked: 0 kB
SwapTotal: 683591672 kB
SwapFree: 682840056 kB
SwapFree: 682846968 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 21796 kB
Dirty: 21840 kB
Writeback: 0 kB
AnonPages: 198960 kB
Mapped: 78072 kB
Shmem: 7112 kB
KReclaimable: 313776 kB
Slab: 808092 kB
SReclaimable: 313776 kB
SUnreclaim: 494316 kB
KernelStack: 18672 kB
PageTables: 23548 kB
AnonPages: 212552 kB
Mapped: 84036 kB
Shmem: 6152 kB
KReclaimable: 650292 kB
Slab: 1151580 kB
SReclaimable: 650292 kB
SUnreclaim: 501288 kB
KernelStack: 18768 kB
PageTables: 23600 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 749131704 kB
Committed_AS: 5796080 kB
Committed_AS: 5773568 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266844 kB
VmallocUsed: 266908 kB
VmallocChunk: 0 kB
Percpu: 40576 kB
HardwareCorrupted: 0 kB
@@ -1083,18 +1083,18 @@ sudo.service masked
BOOT_IMAGE=/boot/vmlinuz-6.8.0-51-generic root=UUID=5e5651b9-cb50-4da6-b556-812171c5d457 ro quiet splash vt.handoff=7
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 5:
analyzing CPU 1:
driver: amd-pstate-epp
CPUs which run at the same hardware frequency: 5
CPUs which need to have their frequency coordinated by software: 5
CPUs which run at the same hardware frequency: 1
CPUs which need to have their frequency coordinated by software: 1
maximum transition latency: Cannot determine or is not supported.
hardware limits: 400 MHz - 5.88 GHz
available cpufreq governors: performance powersave
current policy: frequency should be within 400 MHz and 5.88 GHz.
The governor "powersave" may decide which speed to use
within this range.
current CPU frequency: Unable to call hardware
current CPU frequency: 5.49 GHz (asserted by call to kernel)
current CPU frequency: 400 MHz (asserted by call to kernel)
boost state support:
Supported: yes
Active: yes
@@ -1149,16 +1149,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 43964 14682 45 0 9363 0
fs.dentry-state = 221631 125365 45 0 19867 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 29163675
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 7328 0 9223372036854775807
fs.inode-nr = 39021 3639
fs.inode-state = 39021 3639 0 0 0 0 0
fs.file-nr = 7392 0 9223372036854775807
fs.inode-nr = 304291 101567
fs.inode-state = 304291 101567 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
@@ -1186,7 +1186,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 862
fs.quota.syncs = 868
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
@@ -1228,7 +1228,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = 23bc234306b0
kernel.hostname = 0d8de881f608
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -1260,7 +1260,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 2271
kernel.ns_last_pid = 2275
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -1297,7 +1297,7 @@ kernel.random.boot_id = c0b98264-3c53-45e2-aeb4-dfbcdd1b8140
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 4e7d3082-cea5-4ae9-8697-c01736d0ec52
kernel.random.uuid = feffeb81-8106-4e98-878a-2c327a6ff859
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux 23bc234306b0 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux 0d8de881f608 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
08:27:49 up 2 days, 12:31, 0 users, load average: 2.09, 2.54, 2.93
06:17:13 up 3 days, 10:21, 0 users, load average: 2.86, 3.38, 3.60
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -41,7 +41,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4622.721
cpu MHz : 4528.630
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -69,7 +69,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5494.386
cpu MHz : 3687.220
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -97,7 +97,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3331.765
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -125,7 +125,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.364
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -153,7 +153,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3306.334
cpu MHz : 5485.925
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -209,7 +209,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3132.374
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -237,7 +237,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.745
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -349,7 +349,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5414.644
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -377,7 +377,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5417.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -405,7 +405,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5408.707
cpu MHz : 5489.336
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -461,7 +461,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 3537.505
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -489,7 +489,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4564.277
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -517,7 +517,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.670
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -573,7 +573,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4196.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -601,7 +601,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5485.051
cpu MHz : 5621.383
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -629,7 +629,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 5510.506
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -976,49 +976,49 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
node 0 size: 128007 MB
node 0 free: 94237 MB
node 0 free: 94427 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 131080068 kB
MemFree: 96504872 kB
MemAvailable: 126866620 kB
Buffers: 27460 kB
Cached: 31725920 kB
SwapCached: 151080 kB
Active: 5568672 kB
Inactive: 26381856 kB
Active(anon): 115044 kB
Inactive(anon): 93848 kB
Active(file): 5453628 kB
Inactive(file): 26288008 kB
MemFree: 96693280 kB
MemAvailable: 127684456 kB
Buffers: 24648 kB
Cached: 31729948 kB
SwapCached: 170544 kB
Active: 31695920 kB
Inactive: 270664 kB
Active(anon): 113060 kB
Inactive(anon): 109504 kB
Active(file): 31582860 kB
Inactive(file): 161160 kB
Unevictable: 4360 kB
Mlocked: 0 kB
SwapTotal: 683591672 kB
SwapFree: 682840056 kB
SwapFree: 682846968 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 21796 kB
Dirty: 21840 kB
Writeback: 0 kB
AnonPages: 198960 kB
Mapped: 78072 kB
Shmem: 7112 kB
KReclaimable: 313776 kB
Slab: 808092 kB
SReclaimable: 313776 kB
SUnreclaim: 494316 kB
KernelStack: 18672 kB
PageTables: 23548 kB
AnonPages: 212552 kB
Mapped: 84036 kB
Shmem: 6152 kB
KReclaimable: 650292 kB
Slab: 1151580 kB
SReclaimable: 650292 kB
SUnreclaim: 501288 kB
KernelStack: 18768 kB
PageTables: 23600 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 749131704 kB
Committed_AS: 5796080 kB
Committed_AS: 5773568 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266844 kB
VmallocUsed: 266908 kB
VmallocChunk: 0 kB
Percpu: 40576 kB
HardwareCorrupted: 0 kB
@@ -1083,18 +1083,18 @@ sudo.service masked
BOOT_IMAGE=/boot/vmlinuz-6.8.0-51-generic root=UUID=5e5651b9-cb50-4da6-b556-812171c5d457 ro quiet splash vt.handoff=7
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 5:
analyzing CPU 1:
driver: amd-pstate-epp
CPUs which run at the same hardware frequency: 5
CPUs which need to have their frequency coordinated by software: 5
CPUs which run at the same hardware frequency: 1
CPUs which need to have their frequency coordinated by software: 1
maximum transition latency: Cannot determine or is not supported.
hardware limits: 400 MHz - 5.88 GHz
available cpufreq governors: performance powersave
current policy: frequency should be within 400 MHz and 5.88 GHz.
The governor "powersave" may decide which speed to use
within this range.
current CPU frequency: Unable to call hardware
current CPU frequency: 5.49 GHz (asserted by call to kernel)
current CPU frequency: 400 MHz (asserted by call to kernel)
boost state support:
Supported: yes
Active: yes
@@ -1149,16 +1149,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 43964 14682 45 0 9363 0
fs.dentry-state = 221631 125365 45 0 19867 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 29163675
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 7328 0 9223372036854775807
fs.inode-nr = 39021 3639
fs.inode-state = 39021 3639 0 0 0 0 0
fs.file-nr = 7392 0 9223372036854775807
fs.inode-nr = 304291 101567
fs.inode-state = 304291 101567 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
@@ -1186,7 +1186,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 862
fs.quota.syncs = 868
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
@@ -1228,7 +1228,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = 23bc234306b0
kernel.hostname = 0d8de881f608
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -1260,7 +1260,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 2271
kernel.ns_last_pid = 2275
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -1297,7 +1297,7 @@ kernel.random.boot_id = c0b98264-3c53-45e2-aeb4-dfbcdd1b8140
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 4e7d3082-cea5-4ae9-8697-c01736d0ec52
kernel.random.uuid = feffeb81-8106-4e98-878a-2c327a6ff859
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux 23bc234306b0 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux 0d8de881f608 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
08:27:49 up 2 days, 12:31, 0 users, load average: 2.09, 2.54, 2.93
06:17:13 up 3 days, 10:21, 0 users, load average: 2.86, 3.38, 3.60
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -41,7 +41,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4622.721
cpu MHz : 4528.630
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -69,7 +69,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5494.386
cpu MHz : 3687.220
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -97,7 +97,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3331.765
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -125,7 +125,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.364
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -153,7 +153,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3306.334
cpu MHz : 5485.925
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -209,7 +209,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3132.374
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -237,7 +237,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.745
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -349,7 +349,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5414.644
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -377,7 +377,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5417.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -405,7 +405,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5408.707
cpu MHz : 5489.336
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -461,7 +461,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 3537.505
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -489,7 +489,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4564.277
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -517,7 +517,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.670
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -573,7 +573,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4196.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -601,7 +601,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5485.051
cpu MHz : 5621.383
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -629,7 +629,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 5510.506
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -976,49 +976,49 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
node 0 size: 128007 MB
node 0 free: 94237 MB
node 0 free: 94427 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 131080068 kB
MemFree: 96504872 kB
MemAvailable: 126866620 kB
Buffers: 27460 kB
Cached: 31725920 kB
SwapCached: 151080 kB
Active: 5568672 kB
Inactive: 26381856 kB
Active(anon): 115044 kB
Inactive(anon): 93848 kB
Active(file): 5453628 kB
Inactive(file): 26288008 kB
MemFree: 96693280 kB
MemAvailable: 127684456 kB
Buffers: 24648 kB
Cached: 31729948 kB
SwapCached: 170544 kB
Active: 31695920 kB
Inactive: 270664 kB
Active(anon): 113060 kB
Inactive(anon): 109504 kB
Active(file): 31582860 kB
Inactive(file): 161160 kB
Unevictable: 4360 kB
Mlocked: 0 kB
SwapTotal: 683591672 kB
SwapFree: 682840056 kB
SwapFree: 682846968 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 21796 kB
Dirty: 21840 kB
Writeback: 0 kB
AnonPages: 198960 kB
Mapped: 78072 kB
Shmem: 7112 kB
KReclaimable: 313776 kB
Slab: 808092 kB
SReclaimable: 313776 kB
SUnreclaim: 494316 kB
KernelStack: 18672 kB
PageTables: 23548 kB
AnonPages: 212552 kB
Mapped: 84036 kB
Shmem: 6152 kB
KReclaimable: 650292 kB
Slab: 1151580 kB
SReclaimable: 650292 kB
SUnreclaim: 501288 kB
KernelStack: 18768 kB
PageTables: 23600 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 749131704 kB
Committed_AS: 5796080 kB
Committed_AS: 5773568 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266844 kB
VmallocUsed: 266908 kB
VmallocChunk: 0 kB
Percpu: 40576 kB
HardwareCorrupted: 0 kB
@@ -1083,18 +1083,18 @@ sudo.service masked
BOOT_IMAGE=/boot/vmlinuz-6.8.0-51-generic root=UUID=5e5651b9-cb50-4da6-b556-812171c5d457 ro quiet splash vt.handoff=7
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 5:
analyzing CPU 1:
driver: amd-pstate-epp
CPUs which run at the same hardware frequency: 5
CPUs which need to have their frequency coordinated by software: 5
CPUs which run at the same hardware frequency: 1
CPUs which need to have their frequency coordinated by software: 1
maximum transition latency: Cannot determine or is not supported.
hardware limits: 400 MHz - 5.88 GHz
available cpufreq governors: performance powersave
current policy: frequency should be within 400 MHz and 5.88 GHz.
The governor "powersave" may decide which speed to use
within this range.
current CPU frequency: Unable to call hardware
current CPU frequency: 5.49 GHz (asserted by call to kernel)
current CPU frequency: 400 MHz (asserted by call to kernel)
boost state support:
Supported: yes
Active: yes
@@ -1149,16 +1149,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 43964 14682 45 0 9363 0
fs.dentry-state = 221631 125365 45 0 19867 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 29163675
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 7328 0 9223372036854775807
fs.inode-nr = 39021 3639
fs.inode-state = 39021 3639 0 0 0 0 0
fs.file-nr = 7392 0 9223372036854775807
fs.inode-nr = 304291 101567
fs.inode-state = 304291 101567 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
@@ -1186,7 +1186,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 862
fs.quota.syncs = 868
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
@@ -1228,7 +1228,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = 23bc234306b0
kernel.hostname = 0d8de881f608
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -1260,7 +1260,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 2271
kernel.ns_last_pid = 2275
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -1297,7 +1297,7 @@ kernel.random.boot_id = c0b98264-3c53-45e2-aeb4-dfbcdd1b8140
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 4e7d3082-cea5-4ae9-8697-c01736d0ec52
kernel.random.uuid = feffeb81-8106-4e98-878a-2c327a6ff859
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Processed 1 in 0.013320872007170692s
Processed 1 in 0.012352794990874827s
0.00% pass@1
{'javascript': 0} {'javascript': 1}
{'php': 0} {'php': 1}

Results

{'rouge1': 60.7242, 'rouge2': 44.8179, 'rougeL': 50.6964, 'rougeLsum': 59.0529, 'gsm8k': 100.0, 'mbxp': 0.0, 'gen_len': 1450, 'gen_num': 3, 'gen_tok_len': 982, 'tokens_per_sample': 327.3}
{'rouge1': 70.1571, 'rouge2': 41.2698, 'rougeL': 45.0262, 'rougeLsum': 67.0157, 'gsm8k': 100.0, 'mbxp': 0.0, 'gen_len': 623, 'gen_num': 3, 'gen_tok_len': 736, 'tokens_per_sample': 245.3}

hash=dcba7b51b6cfb0ea8ac14dcc5b6750e5d984b48fd3b306950dbccecb2eb6fd81
hash=4ea4d9df2f90e7974e9569307868eb0a714e4df749796275b8f532315f0d27c3

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -4,8 +4,8 @@ MLPerf Results Summary
SUT name : PySUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 9.29751e-05
Tokens per second: 0.0152169
Samples per second: 8.36406e-05
Tokens per second: 0.0102599
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -14,15 +14,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 5693776493834
Max latency (ns) : 32266692251603
Mean latency (ns) : 19994856593130
50.00 percentile latency (ns) : 22024101033954
90.00 percentile latency (ns) : 32266692251603
95.00 percentile latency (ns) : 32266692251603
97.00 percentile latency (ns) : 32266692251603
99.00 percentile latency (ns) : 32266692251603
99.90 percentile latency (ns) : 32266692251603
Min latency (ns) : 5912063508778
Max latency (ns) : 35867763208530
Mean latency (ns) : 18136339264804
50.00 percentile latency (ns) : 12629191077104
90.00 percentile latency (ns) : 35867763208530
95.00 percentile latency (ns) : 35867763208530
97.00 percentile latency (ns) : 35867763208530
99.00 percentile latency (ns) : 35867763208530
99.90 percentile latency (ns) : 35867763208530


================================================

0 comments on commit a0eda35

Please sign in to comment.