Skip to content

Commit

Permalink
Loading
Loading status checks…
Results from self hosted Github actions - GO-phoenix
Browse files Browse the repository at this point in the history
@arjunsuresh
arjunsuresh committed Jan 30, 2025
1 parent d2bf2ae commit a0eda35
Showing 16 changed files with 438 additions and 438 deletions.
2 changes: 1 addition & 1 deletion ...ns/measurements/gh_action-reference-cpu-pytorch_v2.6.0-default_config/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|--------------|------------|------------------------------------------------|--------------|-------------------|
| mixtral-8x7b | offline | (60.7242, 44.8179, 50.6964, 327.3, 100.0, 0.0) | 0.015 | - |
| mixtral-8x7b | offline | (70.1571, 41.2698, 45.0262, 245.3, 100.0, 0.0) | 0.01 | - |
10 changes: 5 additions & 5 deletions ...tion-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/README.md
View file
Original file line number Diff line number Diff line change
@@ -37,12 +37,12 @@ Platform: gh_action-reference-cpu-pytorch_v2.6.0-default_config
Model Precision: fp32

### Accuracy Results
`ROUGE1`: `60.7242`, Required accuracy for closed division `>= 45.14291`
`ROUGE2`: `44.8179`, Required accuracy for closed division `>= 23.11907`
`ROUGEL`: `50.6964`, Required accuracy for closed division `>= 30.15619`
`TOKENS_PER_SAMPLE`: `327.3`, Required accuracy for closed division `>= 130.356` and `<= 160.49`
`ROUGE1`: `70.1571`, Required accuracy for closed division `>= 45.14291`
`ROUGE2`: `41.2698`, Required accuracy for closed division `>= 23.11907`
`ROUGEL`: `45.0262`, Required accuracy for closed division `>= 30.15619`
`TOKENS_PER_SAMPLE`: `245.3`, Required accuracy for closed division `>= 130.356` and `<= 160.49`
`gsm8k_accuracy`: `100.0`, Required accuracy for closed division `>= 72.9234`
`mbxp_accuracy`: `0.0`, Required accuracy for closed division `>= 59.5584`

### Performance Results
`Samples per second`: `0.0152169`
`Samples per second`: `0.0102599`
26 changes: 13 additions & 13 deletions ...ion-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/accuracy_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
Loading dataset...
Finished loading dataset.
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:01<00:18, 1.01s/it]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:18, 1.07s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:17, 1.08s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:16, 1.08s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:15, 1.08s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:06<00:14, 1.09s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:08<00:14, 1.24s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:09<00:14, 1.35s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:11<00:15, 1.53s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:13<00:14, 1.65s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:15<00:15, 1.91s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:20<00:19, 2.80s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:22<00:15, 2.51s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:22<00:00, 1.19s/it]
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:01<00:20, 1.12s/it]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:20, 1.20s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:19, 1.20s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:17, 1.18s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:16, 1.15s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:06<00:14, 1.13s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:08<00:14, 1.25s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:13<00:27, 2.52s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:15<00:23, 2.35s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:17<00:19, 2.21s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:19<00:17, 2.15s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:22<00:17, 2.50s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:26<00:16, 2.79s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:26<00:00, 1.38s/it]
WARNING:accelerate.big_modeling:Some parameters are on the meta device because they were offloaded to the disk and cpu.
INFO:Mixtral-8x7B-Instruct-v0.1-MAIN:Starting Benchmark run
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
@@ -19,19 +19,19 @@ IssueQuery started with 3 samples
IssueQuery done
Saving outputs to run_outputs/q0.pkl
Samples run: 1
BatchMaker time: 0.004811286926269531
Inference time: 5554.25427532196
Postprocess time: 0.02920985221862793
==== Total time: 5554.288296461105
BatchMaker time: 0.004904270172119141
Inference time: 6110.053489208221
Postprocess time: 0.03488302230834961
==== Total time: 6110.093276500702
Saving outputs to run_outputs/q2.pkl
Samples run: 2
BatchMaker time: 0.11371326446533203
Inference time: 16673.079436063766
Postprocess time: 0.030445575714111328
==== Total time: 16673.223594903946
BatchMaker time: 0.07381916046142578
Inference time: 6800.104888916016
Postprocess time: 0.023260831832885742
==== Total time: 6800.20196890831
Saving outputs to run_outputs/q1.pkl
Samples run: 3
BatchMaker time: 0.05492806434631348
Inference time: 9988.861637353897
Postprocess time: 0.03887295722961426
==== Total time: 9988.955438375473
BatchMaker time: 0.060442447662353516
Inference time: 23514.97544693947
Postprocess time: 0.03243660926818848
==== Total time: 23515.0683259964
48 changes: 24 additions & 24 deletions ...s/gh_action-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/mlc-deps.mmd
View file
Original file line number Diff line number Diff line change
@@ -13,16 +13,16 @@ graph TD
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> get,git,repo,_branch.dev,_repo.https://github.com/mlcommons/inference
get-mlperf-inference-utils,e341e5f86d8342e5 --> get,mlperf,inference,src,_branch.dev
app-mlperf-inference,d775cac873ee4231_(_reference,_mixtral-8x7b,_pytorch,_cpu,_test,_r5.0-dev_default,_float16,_offline_) --> get,mlperf,inference,utils
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> detect,cpu
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,sys-utils-cm
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,python
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> detect,cpu
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,sys-utils-cm
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,python
get-generic-python-lib,94b62a682bc44791_(_torch_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_torch
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_torch
get-generic-python-lib,94b62a682bc44791_(_torchvision_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_torchvision
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,ml-model,mixtral,raw,_batch_size.1,_pytorch
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_torchvision
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,ml-model,mixtral,raw,_batch_size.1,_pytorch
get-generic-python-lib,94b62a682bc44791_(_package.pandas_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_package.pandas_) --> detect,cpu
@@ -34,7 +34,7 @@ graph TD
download-file,9cdc8dc41aae437e_(_cmutil,_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl_) --> download,file,_cmutil,_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl
get-dataset-mlperf-inference-mixtral,89e7c91444804775_(_size.1_) --> download-and-extract,_url.https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,dataset-mixtral,openorca-mbxp-gsm8k-combined,_size.1
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,dataset-mixtral,openorca-mbxp-gsm8k-combined,_size.1
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,cpu
@@ -45,35 +45,35 @@ graph TD
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,mlcommons,inference,src,_branch.dev
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,sut,configs
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> generate,user-conf,mlperf,inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,loadgen
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> generate,user-conf,mlperf,inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,loadgen
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> detect,os
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> get,python3
get-mlperf-inference-src,4b57186581024797_(_branch.dev_) --> get,git,repo,_branch.dev,_repo.https://github.com/mlcommons/inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,mlcommons,inference,src,_branch.dev
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,mlcommons,inference,src
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,mlcommons,inference,src,_branch.dev
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,mlcommons,inference,src
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.psutil
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,rust-compiler
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.psutil
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,rust-compiler
get-generic-python-lib,94b62a682bc44791_(_package.transformers_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.transformers
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.transformers
get-generic-python-lib,94b62a682bc44791_(_package.datasets_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.datasets
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.datasets
get-generic-python-lib,94b62a682bc44791_(_package.sentencepiece_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.sentencepiece
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.sentencepiece
get-generic-python-lib,94b62a682bc44791_(_package.protobuf_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.protobuf
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.protobuf
get-generic-python-lib,94b62a682bc44791_(_package.accelerate_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.accelerate
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.accelerate
get-generic-python-lib,94b62a682bc44791_(_package.absl-py_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.absl-py
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.absl-py
get-generic-python-lib,94b62a682bc44791_(_package.evaluate_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.evaluate
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.evaluate
get-generic-python-lib,94b62a682bc44791_(_package.nltk_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_package.nltk
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_package.nltk
get-generic-python-lib,94b62a682bc44791_(_mxeval_) --> get,python3
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> get,generic-python-lib,_mxeval
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> get,generic-python-lib,_mxeval
detect-cpu,586c8a43320142f7 --> detect,os
benchmark-program,19f369ef47084895 --> detect,cpu
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16_) --> benchmark-mlperf
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16_) --> benchmark-mlperf
Binary file modified ...n-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/mlc-deps.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
48 changes: 24 additions & 24 deletions ...on-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/mlc-version-info.json
View file
Original file line number Diff line number Diff line change
@@ -147,7 +147,7 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -167,7 +167,7 @@
"script_tags": "detect,cpu,detect-cpu,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -177,7 +177,7 @@
"script_tags": "get,sys-utils-cm,sys-utils-mlc",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -187,7 +187,7 @@
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.10.12",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -207,7 +207,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "torch",
"version": "2.6.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -227,7 +227,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "torchvision",
"version": "0.21.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -237,7 +237,7 @@
"script_tags": "get,raw,ml-model,language-processing,mixtral,mixtral-8x7b",
"script_variations": "batch_size.1,pytorch",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -357,7 +357,7 @@
"script_tags": "get,dataset-mixtral,openorca-mbxp-gsm8k-combined",
"script_variations": "size.1",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -467,7 +467,7 @@
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -477,7 +477,7 @@
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
"script_variations": "",
"version": "master",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -517,7 +517,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "branch.dev",
"version": "r5.0-git-76c250b89fcbcbc89bfed2d921274eda76244216",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -527,7 +527,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "",
"version": "r5.0-git-76c250b89fcbcbc89bfed2d921274eda76244216",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -547,7 +547,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.psutil",
"version": "6.1.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -557,7 +557,7 @@
"script_tags": "get,rust-compiler",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -577,7 +577,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.transformers",
"version": "4.48.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -597,7 +597,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.datasets",
"version": "3.2.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -617,7 +617,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.sentencepiece",
"version": "0.2.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -637,7 +637,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.protobuf",
"version": "5.29.3",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -657,7 +657,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.accelerate",
"version": "1.3.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -677,7 +677,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.absl-py",
"version": "2.1.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -697,7 +697,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.evaluate",
"version": "0.4.3",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -717,7 +717,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.nltk",
"version": "3.9.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -737,7 +737,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "mxeval",
"version": "1.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
},
{
@@ -777,7 +777,7 @@
"script_tags": "mlperf,benchmark-mlperf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_batch_size.1,_cpu,_mixtral-8x7b,_pytorch,_float16 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( pytorch,_batch_size.1,_offline,_mixtral-8x7b,_cpu,_float16 )"
}
}
]
2 changes: 1 addition & 1 deletion ...s/gh_action-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/os_info.json
View file
Original file line number Diff line number Diff line change
@@ -26,5 +26,5 @@
],
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
"MLC_HOST_PYTHON_BITS": "64",
"MLC_HOST_SYSTEM_NAME": "23bc234306b0"
"MLC_HOST_SYSTEM_NAME": "0d8de881f608"
}
50 changes: 25 additions & 25 deletions ...-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/performance_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
Loading dataset...
Finished loading dataset.
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:00<00:17, 1.04it/s]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:19, 1.15s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:18, 1.13s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:17, 1.14s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:15, 1.14s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:07<00:16, 1.24s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:09<00:17, 1.48s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:11<00:19, 1.73s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:14<00:20, 2.06s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:16<00:18, 2.04s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:20<00:21, 2.67s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:22<00:18, 2.63s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:24<00:14, 2.40s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:24<00:00, 1.30s/it]
WARNING:accelerate.big_modeling:Some parameters are on the meta device because they were offloaded to the cpu and disk.
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]Loading checkpoint shards: 5%|▌ | 1/19 [00:01<00:20, 1.12s/it]Loading checkpoint shards: 11%|█ | 2/19 [00:02<00:20, 1.19s/it]Loading checkpoint shards: 16%|█▌ | 3/19 [00:03<00:19, 1.20s/it]Loading checkpoint shards: 21%|██ | 4/19 [00:04<00:17, 1.18s/it]Loading checkpoint shards: 26%|██▋ | 5/19 [00:05<00:16, 1.17s/it]Loading checkpoint shards: 32%|███▏ | 6/19 [00:06<00:14, 1.14s/it]Loading checkpoint shards: 37%|███▋ | 7/19 [00:08<00:15, 1.28s/it]Loading checkpoint shards: 42%|████▏ | 8/19 [00:10<00:18, 1.64s/it]Loading checkpoint shards: 47%|████▋ | 9/19 [00:13<00:18, 1.82s/it]Loading checkpoint shards: 53%|█████▎ | 10/19 [00:15<00:16, 1.88s/it]Loading checkpoint shards: 58%|█████▊ | 11/19 [00:17<00:16, 2.08s/it]Loading checkpoint shards: 63%|██████▎ | 12/19 [00:22<00:20, 2.90s/it]Loading checkpoint shards: 68%|██████▊ | 13/19 [00:24<00:15, 2.60s/it]Loading checkpoint shards: 100%|██████████| 19/19 [00:24<00:00, 1.28s/it]
WARNING:accelerate.big_modeling:Some parameters are on the meta device because they were offloaded to the disk and cpu.
INFO:Mixtral-8x7B-Instruct-v0.1-MAIN:Starting Benchmark run
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
@@ -12,8 +12,8 @@ MLPerf Results Summary
SUT name : PySUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 9.29751e-05
Tokens per second: 0.0152169
Samples per second: 8.36406e-05
Tokens per second: 0.0102599
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -22,15 +22,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 5693776493834
Max latency (ns) : 32266692251603
Mean latency (ns) : 19994856593130
50.00 percentile latency (ns) : 22024101033954
90.00 percentile latency (ns) : 32266692251603
95.00 percentile latency (ns) : 32266692251603
97.00 percentile latency (ns) : 32266692251603
99.00 percentile latency (ns) : 32266692251603
99.90 percentile latency (ns) : 32266692251603
Min latency (ns) : 5912063508778
Max latency (ns) : 35867763208530
Mean latency (ns) : 18136339264804
50.00 percentile latency (ns) : 12629191077104
90.00 percentile latency (ns) : 35867763208530
95.00 percentile latency (ns) : 35867763208530
97.00 percentile latency (ns) : 35867763208530
99.00 percentile latency (ns) : 35867763208530
99.90 percentile latency (ns) : 35867763208530


================================================
@@ -69,19 +69,19 @@ IssueQuery started with 3 samples
IssueQuery done
Saving outputs to run_outputs/q0.pkl
Samples run: 1
BatchMaker time: 0.0054056644439697266
Inference time: 5693.734073638916
Postprocess time: 0.03768277168273926
==== Total time: 5693.777162075043
BatchMaker time: 0.004534482955932617
Inference time: 5912.022013664246
Postprocess time: 0.03786134719848633
==== Total time: 5912.0644094944
Saving outputs to run_outputs/q2.pkl
Samples run: 2
BatchMaker time: 0.11400723457336426
Inference time: 16330.180698871613
Postprocess time: 0.023488283157348633
==== Total time: 16330.318194389343
BatchMaker time: 0.0733802318572998
Inference time: 6717.017740011215
Postprocess time: 0.029738903045654297
==== Total time: 6717.120859146118
Saving outputs to run_outputs/q1.pkl
Samples run: 3
BatchMaker time: 0.05829310417175293
Inference time: 10242.491039037704
Postprocess time: 0.036077260971069336
==== Total time: 10242.585409402847
BatchMaker time: 0.06183290481567383
Inference time: 23238.471618890762
Postprocess time: 0.03302335739135742
==== Total time: 23238.56647515297
110 changes: 55 additions & 55 deletions ...h_action-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux 23bc234306b0 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux 0d8de881f608 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
08:27:49 up 2 days, 12:31, 0 users, load average: 2.09, 2.54, 2.93
06:17:13 up 3 days, 10:21, 0 users, load average: 2.86, 3.38, 3.60
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -41,7 +41,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4622.721
cpu MHz : 4528.630
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -69,7 +69,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5494.386
cpu MHz : 3687.220
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -97,7 +97,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3331.765
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -125,7 +125,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.364
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -153,7 +153,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3306.334
cpu MHz : 5485.925
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -209,7 +209,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3132.374
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -237,7 +237,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.745
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -349,7 +349,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5414.644
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -377,7 +377,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5417.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -405,7 +405,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5408.707
cpu MHz : 5489.336
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -461,7 +461,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 3537.505
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -489,7 +489,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4564.277
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -517,7 +517,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.670
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -573,7 +573,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4196.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -601,7 +601,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5485.051
cpu MHz : 5621.383
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -629,7 +629,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 5510.506
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -976,49 +976,49 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
node 0 size: 128007 MB
node 0 free: 94237 MB
node 0 free: 94427 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 131080068 kB
MemFree: 96504872 kB
MemAvailable: 126866620 kB
Buffers: 27460 kB
Cached: 31725920 kB
SwapCached: 151080 kB
Active: 5568672 kB
Inactive: 26381856 kB
Active(anon): 115044 kB
Inactive(anon): 93848 kB
Active(file): 5453628 kB
Inactive(file): 26288008 kB
MemFree: 96693280 kB
MemAvailable: 127684456 kB
Buffers: 24648 kB
Cached: 31729948 kB
SwapCached: 170544 kB
Active: 31695920 kB
Inactive: 270664 kB
Active(anon): 113060 kB
Inactive(anon): 109504 kB
Active(file): 31582860 kB
Inactive(file): 161160 kB
Unevictable: 4360 kB
Mlocked: 0 kB
SwapTotal: 683591672 kB
SwapFree: 682840056 kB
SwapFree: 682846968 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 21796 kB
Dirty: 21840 kB
Writeback: 0 kB
AnonPages: 198960 kB
Mapped: 78072 kB
Shmem: 7112 kB
KReclaimable: 313776 kB
Slab: 808092 kB
SReclaimable: 313776 kB
SUnreclaim: 494316 kB
KernelStack: 18672 kB
PageTables: 23548 kB
AnonPages: 212552 kB
Mapped: 84036 kB
Shmem: 6152 kB
KReclaimable: 650292 kB
Slab: 1151580 kB
SReclaimable: 650292 kB
SUnreclaim: 501288 kB
KernelStack: 18768 kB
PageTables: 23600 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 749131704 kB
Committed_AS: 5796080 kB
Committed_AS: 5773568 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266844 kB
VmallocUsed: 266908 kB
VmallocChunk: 0 kB
Percpu: 40576 kB
HardwareCorrupted: 0 kB
@@ -1083,18 +1083,18 @@ sudo.service masked
BOOT_IMAGE=/boot/vmlinuz-6.8.0-51-generic root=UUID=5e5651b9-cb50-4da6-b556-812171c5d457 ro quiet splash vt.handoff=7
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 5:
analyzing CPU 1:
driver: amd-pstate-epp
CPUs which run at the same hardware frequency: 5
CPUs which need to have their frequency coordinated by software: 5
CPUs which run at the same hardware frequency: 1
CPUs which need to have their frequency coordinated by software: 1
maximum transition latency: Cannot determine or is not supported.
hardware limits: 400 MHz - 5.88 GHz
available cpufreq governors: performance powersave
current policy: frequency should be within 400 MHz and 5.88 GHz.
The governor "powersave" may decide which speed to use
within this range.
current CPU frequency: Unable to call hardware
current CPU frequency: 5.49 GHz (asserted by call to kernel)
current CPU frequency: 400 MHz (asserted by call to kernel)
boost state support:
Supported: yes
Active: yes
@@ -1149,16 +1149,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 43964 14682 45 0 9363 0
fs.dentry-state = 221631 125365 45 0 19867 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 29163675
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 7328 0 9223372036854775807
fs.inode-nr = 39021 3639
fs.inode-state = 39021 3639 0 0 0 0 0
fs.file-nr = 7392 0 9223372036854775807
fs.inode-nr = 304291 101567
fs.inode-state = 304291 101567 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
@@ -1186,7 +1186,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 862
fs.quota.syncs = 868
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
@@ -1228,7 +1228,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = 23bc234306b0
kernel.hostname = 0d8de881f608
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -1260,7 +1260,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 2271
kernel.ns_last_pid = 2275
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -1297,7 +1297,7 @@ kernel.random.boot_id = c0b98264-3c53-45e2-aeb4-dfbcdd1b8140
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 4e7d3082-cea5-4ae9-8697-c01736d0ec52
kernel.random.uuid = feffeb81-8106-4e98-878a-2c327a6ff859
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
110 changes: 55 additions & 55 deletions ...ements/gh_action-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux 23bc234306b0 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux 0d8de881f608 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
08:27:49 up 2 days, 12:31, 0 users, load average: 2.09, 2.54, 2.93
06:17:13 up 3 days, 10:21, 0 users, load average: 2.86, 3.38, 3.60
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -41,7 +41,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4622.721
cpu MHz : 4528.630
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -69,7 +69,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5494.386
cpu MHz : 3687.220
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -97,7 +97,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3331.765
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -125,7 +125,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.364
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -153,7 +153,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3306.334
cpu MHz : 5485.925
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -209,7 +209,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3132.374
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -237,7 +237,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.745
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -349,7 +349,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5414.644
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -377,7 +377,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5417.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -405,7 +405,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5408.707
cpu MHz : 5489.336
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -461,7 +461,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 3537.505
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -489,7 +489,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4564.277
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -517,7 +517,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.670
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -573,7 +573,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4196.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -601,7 +601,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5485.051
cpu MHz : 5621.383
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -629,7 +629,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 5510.506
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -976,49 +976,49 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
node 0 size: 128007 MB
node 0 free: 94237 MB
node 0 free: 94427 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 131080068 kB
MemFree: 96504872 kB
MemAvailable: 126866620 kB
Buffers: 27460 kB
Cached: 31725920 kB
SwapCached: 151080 kB
Active: 5568672 kB
Inactive: 26381856 kB
Active(anon): 115044 kB
Inactive(anon): 93848 kB
Active(file): 5453628 kB
Inactive(file): 26288008 kB
MemFree: 96693280 kB
MemAvailable: 127684456 kB
Buffers: 24648 kB
Cached: 31729948 kB
SwapCached: 170544 kB
Active: 31695920 kB
Inactive: 270664 kB
Active(anon): 113060 kB
Inactive(anon): 109504 kB
Active(file): 31582860 kB
Inactive(file): 161160 kB
Unevictable: 4360 kB
Mlocked: 0 kB
SwapTotal: 683591672 kB
SwapFree: 682840056 kB
SwapFree: 682846968 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 21796 kB
Dirty: 21840 kB
Writeback: 0 kB
AnonPages: 198960 kB
Mapped: 78072 kB
Shmem: 7112 kB
KReclaimable: 313776 kB
Slab: 808092 kB
SReclaimable: 313776 kB
SUnreclaim: 494316 kB
KernelStack: 18672 kB
PageTables: 23548 kB
AnonPages: 212552 kB
Mapped: 84036 kB
Shmem: 6152 kB
KReclaimable: 650292 kB
Slab: 1151580 kB
SReclaimable: 650292 kB
SUnreclaim: 501288 kB
KernelStack: 18768 kB
PageTables: 23600 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 749131704 kB
Committed_AS: 5796080 kB
Committed_AS: 5773568 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266844 kB
VmallocUsed: 266908 kB
VmallocChunk: 0 kB
Percpu: 40576 kB
HardwareCorrupted: 0 kB
@@ -1083,18 +1083,18 @@ sudo.service masked
BOOT_IMAGE=/boot/vmlinuz-6.8.0-51-generic root=UUID=5e5651b9-cb50-4da6-b556-812171c5d457 ro quiet splash vt.handoff=7
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 5:
analyzing CPU 1:
driver: amd-pstate-epp
CPUs which run at the same hardware frequency: 5
CPUs which need to have their frequency coordinated by software: 5
CPUs which run at the same hardware frequency: 1
CPUs which need to have their frequency coordinated by software: 1
maximum transition latency: Cannot determine or is not supported.
hardware limits: 400 MHz - 5.88 GHz
available cpufreq governors: performance powersave
current policy: frequency should be within 400 MHz and 5.88 GHz.
The governor "powersave" may decide which speed to use
within this range.
current CPU frequency: Unable to call hardware
current CPU frequency: 5.49 GHz (asserted by call to kernel)
current CPU frequency: 400 MHz (asserted by call to kernel)
boost state support:
Supported: yes
Active: yes
@@ -1149,16 +1149,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 43964 14682 45 0 9363 0
fs.dentry-state = 221631 125365 45 0 19867 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 29163675
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 7328 0 9223372036854775807
fs.inode-nr = 39021 3639
fs.inode-state = 39021 3639 0 0 0 0 0
fs.file-nr = 7392 0 9223372036854775807
fs.inode-nr = 304291 101567
fs.inode-state = 304291 101567 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
@@ -1186,7 +1186,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 862
fs.quota.syncs = 868
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
@@ -1228,7 +1228,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = 23bc234306b0
kernel.hostname = 0d8de881f608
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -1260,7 +1260,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 2271
kernel.ns_last_pid = 2275
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -1297,7 +1297,7 @@ kernel.random.boot_id = c0b98264-3c53-45e2-aeb4-dfbcdd1b8140
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 4e7d3082-cea5-4ae9-8697-c01736d0ec52
kernel.random.uuid = feffeb81-8106-4e98-878a-2c327a6ff859
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
110 changes: 55 additions & 55 deletions ...ommons/measurements/gh_action-reference-cpu-pytorch_v2.6.0-default_config/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux 23bc234306b0 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux 0d8de881f608 6.8.0-51-generic #52-Ubuntu SMP PREEMPT_DYNAMIC Thu Dec 5 13:09:44 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
08:27:49 up 2 days, 12:31, 0 users, load average: 2.09, 2.54, 2.93
06:17:13 up 3 days, 10:21, 0 users, load average: 2.86, 3.38, 3.60
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -41,7 +41,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4622.721
cpu MHz : 4528.630
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -69,7 +69,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5494.386
cpu MHz : 3687.220
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -97,7 +97,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3331.765
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -125,7 +125,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.364
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -153,7 +153,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3306.334
cpu MHz : 5485.925
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -209,7 +209,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 3132.374
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -237,7 +237,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.745
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -349,7 +349,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5414.644
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -377,7 +377,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5417.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -405,7 +405,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5408.707
cpu MHz : 5489.336
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -461,7 +461,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 3537.505
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -489,7 +489,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4564.277
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -517,7 +517,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5489.670
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -573,7 +573,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 4196.930
cpu MHz : 400.000
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -601,7 +601,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 5485.051
cpu MHz : 5621.383
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -629,7 +629,7 @@ model : 97
model name : AMD Ryzen 9 7950X 16-Core Processor
stepping : 2
microcode : 0xa601206
cpu MHz : 400.000
cpu MHz : 5510.506
cache size : 1024 KB
physical id : 0
siblings : 32
@@ -976,49 +976,49 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
node 0 size: 128007 MB
node 0 free: 94237 MB
node 0 free: 94427 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 131080068 kB
MemFree: 96504872 kB
MemAvailable: 126866620 kB
Buffers: 27460 kB
Cached: 31725920 kB
SwapCached: 151080 kB
Active: 5568672 kB
Inactive: 26381856 kB
Active(anon): 115044 kB
Inactive(anon): 93848 kB
Active(file): 5453628 kB
Inactive(file): 26288008 kB
MemFree: 96693280 kB
MemAvailable: 127684456 kB
Buffers: 24648 kB
Cached: 31729948 kB
SwapCached: 170544 kB
Active: 31695920 kB
Inactive: 270664 kB
Active(anon): 113060 kB
Inactive(anon): 109504 kB
Active(file): 31582860 kB
Inactive(file): 161160 kB
Unevictable: 4360 kB
Mlocked: 0 kB
SwapTotal: 683591672 kB
SwapFree: 682840056 kB
SwapFree: 682846968 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 21796 kB
Dirty: 21840 kB
Writeback: 0 kB
AnonPages: 198960 kB
Mapped: 78072 kB
Shmem: 7112 kB
KReclaimable: 313776 kB
Slab: 808092 kB
SReclaimable: 313776 kB
SUnreclaim: 494316 kB
KernelStack: 18672 kB
PageTables: 23548 kB
AnonPages: 212552 kB
Mapped: 84036 kB
Shmem: 6152 kB
KReclaimable: 650292 kB
Slab: 1151580 kB
SReclaimable: 650292 kB
SUnreclaim: 501288 kB
KernelStack: 18768 kB
PageTables: 23600 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 749131704 kB
Committed_AS: 5796080 kB
Committed_AS: 5773568 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266844 kB
VmallocUsed: 266908 kB
VmallocChunk: 0 kB
Percpu: 40576 kB
HardwareCorrupted: 0 kB
@@ -1083,18 +1083,18 @@ sudo.service masked
BOOT_IMAGE=/boot/vmlinuz-6.8.0-51-generic root=UUID=5e5651b9-cb50-4da6-b556-812171c5d457 ro quiet splash vt.handoff=7
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 5:
analyzing CPU 1:
driver: amd-pstate-epp
CPUs which run at the same hardware frequency: 5
CPUs which need to have their frequency coordinated by software: 5
CPUs which run at the same hardware frequency: 1
CPUs which need to have their frequency coordinated by software: 1
maximum transition latency: Cannot determine or is not supported.
hardware limits: 400 MHz - 5.88 GHz
available cpufreq governors: performance powersave
current policy: frequency should be within 400 MHz and 5.88 GHz.
The governor "powersave" may decide which speed to use
within this range.
current CPU frequency: Unable to call hardware
current CPU frequency: 5.49 GHz (asserted by call to kernel)
current CPU frequency: 400 MHz (asserted by call to kernel)
boost state support:
Supported: yes
Active: yes
@@ -1149,16 +1149,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 43964 14682 45 0 9363 0
fs.dentry-state = 221631 125365 45 0 19867 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 29163675
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 7328 0 9223372036854775807
fs.inode-nr = 39021 3639
fs.inode-state = 39021 3639 0 0 0 0 0
fs.file-nr = 7392 0 9223372036854775807
fs.inode-nr = 304291 101567
fs.inode-state = 304291 101567 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
@@ -1186,7 +1186,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 862
fs.quota.syncs = 868
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
@@ -1228,7 +1228,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = 23bc234306b0
kernel.hostname = 0d8de881f608
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -1260,7 +1260,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 2271
kernel.ns_last_pid = 2275
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -1297,7 +1297,7 @@ kernel.random.boot_id = c0b98264-3c53-45e2-aeb4-dfbcdd1b8140
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 4e7d3082-cea5-4ae9-8697-c01736d0ec52
kernel.random.uuid = feffeb81-8106-4e98-878a-2c327a6ff859
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
8 changes: 4 additions & 4 deletions ...on-reference-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/accuracy/accuracy.txt
View file
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Processed 1 in 0.013320872007170692s
Processed 1 in 0.012352794990874827s
0.00% pass@1
{'javascript': 0} {'javascript': 1}
{'php': 0} {'php': 1}

Results

{'rouge1': 60.7242, 'rouge2': 44.8179, 'rougeL': 50.6964, 'rougeLsum': 59.0529, 'gsm8k': 100.0, 'mbxp': 0.0, 'gen_len': 1450, 'gen_num': 3, 'gen_tok_len': 982, 'tokens_per_sample': 327.3}
{'rouge1': 70.1571, 'rouge2': 41.2698, 'rougeL': 45.0262, 'rougeLsum': 67.0157, 'gsm8k': 100.0, 'mbxp': 0.0, 'gen_len': 623, 'gen_num': 3, 'gen_tok_len': 736, 'tokens_per_sample': 245.3}

hash=dcba7b51b6cfb0ea8ac14dcc5b6750e5d984b48fd3b306950dbccecb2eb6fd81
hash=4ea4d9df2f90e7974e9569307868eb0a714e4df749796275b8f532315f0d27c3
8 changes: 4 additions & 4 deletions ...-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/accuracy/mlperf_log_accuracy.json
View file

Large diffs are not rendered by default.

142 changes: 71 additions & 71 deletions ...nce-cpu-pytorch_v2.6.0-default_config/mixtral-8x7b/offline/accuracy/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

180 changes: 90 additions & 90 deletions ...ytorch_v2.6.0-default_config/mixtral-8x7b/offline/performance/run_1/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

22 changes: 11 additions & 11 deletions ...torch_v2.6.0-default_config/mixtral-8x7b/offline/performance/run_1/mlperf_log_summary.txt
View file
Original file line number Diff line number Diff line change
@@ -4,8 +4,8 @@ MLPerf Results Summary
SUT name : PySUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 9.29751e-05
Tokens per second: 0.0152169
Samples per second: 8.36406e-05
Tokens per second: 0.0102599
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -14,15 +14,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 5693776493834
Max latency (ns) : 32266692251603
Mean latency (ns) : 19994856593130
50.00 percentile latency (ns) : 22024101033954
90.00 percentile latency (ns) : 32266692251603
95.00 percentile latency (ns) : 32266692251603
97.00 percentile latency (ns) : 32266692251603
99.00 percentile latency (ns) : 32266692251603
99.90 percentile latency (ns) : 32266692251603
Min latency (ns) : 5912063508778
Max latency (ns) : 35867763208530
Mean latency (ns) : 18136339264804
50.00 percentile latency (ns) : 12629191077104
90.00 percentile latency (ns) : 35867763208530
95.00 percentile latency (ns) : 35867763208530
97.00 percentile latency (ns) : 35867763208530
99.00 percentile latency (ns) : 35867763208530
99.90 percentile latency (ns) : 35867763208530


================================================

0 comments on commit a0eda35

Please sign in to comment.