Skip to content

Commit

Permalink
Loading
Loading status checks…
Auto-merge updates from auto-update branch
Browse files Browse the repository at this point in the history
@mlcommons-bot
mlcommons-bot committed Jan 31, 2025

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode
2 parents 1dcad10 + ee3e109 commit 412dfd6
Showing 47 changed files with 1,259 additions and 1,454 deletions.
6 changes: 3 additions & 3 deletions ...nts/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|----------|------------|------------|--------------|-------------------|
| resnet50 | offline | 76 | 22.935 | - |
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|-----------|------------|------------|--------------|-------------------|
| retinanet | offline | () | 0.425 | - |
12 changes: 6 additions & 6 deletions ...st_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/README.md
View file
Original file line number Diff line number Diff line change
@@ -5,7 +5,7 @@
* OS version: Linux-6.8.0-1020-azure-x86_64-with-glibc2.39
* CPU version: x86_64
* Python version: 3.12.8 (main, Dec 4 2024, 06:20:31) [GCC 13.2.0]
* MLC version: 0.1.0
* MLC version: unknown

## CM Run Command

@@ -16,16 +16,16 @@ pip install -U mlcflow

mlc rm cache -f

mlc pull repo anandhu-eng@mlperf-automations --checkout=522dda5f5d277b5943abef849a421c25ecea9d4e
mlc pull repo mlcommons@mlperf-automations --checkout=02683cf5e8beb0cc5baaf27802daafc08fe42e67


```
*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf,
you should simply reload anandhu-eng@mlperf-automations without checkout and clean MLC cache as follows:*
you should simply reload mlcommons@mlperf-automations without checkout and clean MLC cache as follows:*

```bash
mlc rm repo anandhu-eng@mlperf-automations
mlc pull repo anandhu-eng@mlperf-automations
mlc rm repo mlcommons@mlperf-automations
mlc pull repo mlcommons@mlperf-automations
mlc rm cache -f

```
@@ -39,4 +39,4 @@ Model Precision: fp32
### Accuracy Results

### Performance Results
`Samples per second`: `0.42546`
`Samples per second`: `0.425185`
8 changes: 4 additions & 4 deletions ...t_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
MLPerf Conf path: /home/runner/MLC/repos/local/cache/get-git-repo_e71c543f/inference/mlperf.conf
User Conf path: /home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/acd6959766d64bfcb2a9a589bec1d67b.conf
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_7ac6cb19
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_7ac6cb19/annotations/openimages-mlperf.json
MLPerf Conf path: /home/runner/MLC/repos/local/cache/get-git-repo_638313d0/inference/mlperf.conf
User Conf path: /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/125d994af984462d96652017f6862e85.conf
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_9a4e81ce
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_9a4e81ce/annotations/openimages-mlperf.json
Scenario: Offline
Mode: AccuracyOnly
Batch size: 1
38 changes: 10 additions & 28 deletions ...tu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-deps.mmd
View file
Original file line number Diff line number Diff line change
@@ -8,20 +8,14 @@ graph TD
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,mlcommons,inference,src
pull-git-repo,c23132ed65c4421d --> detect,os
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> pull,git,repo
get-mlperf-inference-src,4b57186581024797 --> detect,os
get-mlperf-inference-src,4b57186581024797 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
get-mlperf-inference-utils,e341e5f86d8342e5 --> get,mlperf,inference,src
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,mlperf,inference,utils
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> detect,os
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> detect,cpu
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> detect,cpu
get-sys-utils-cm,bc90993277e84b8e --> detect,os
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> detect,os
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> detect,os
get-mlperf-inference-src,4b57186581024797 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,mlcommons,inference,src
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,compiler
detect-cpu,586c8a43320142f7 --> detect,os
@@ -50,13 +44,10 @@ graph TD
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_package.setuptools_) --> get,generic-python-lib,_pip
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,generic-python-lib,_package.setuptools
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> get,loadgen
get-mlperf-inference-src,4b57186581024797 --> detect,os
get-mlperf-inference-src,4b57186581024797 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> get,mlcommons,inference,src
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> get,loadgen
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> get,mlcommons,inference,src
get-onnxruntime-prebuilt,be02c84ff57c4244_(_cpu_) --> detect,os
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> get,lib,onnxruntime,lang-cpp,_cpu
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> get,lib,onnxruntime,lang-cpp,_cpu
get-preprocessed-dataset-openimages,9842f1be8cba4c7b_(_validation,_NCHW_) --> get,python3
get-dataset-openimages,0a9d49b644cf4142_(_validation,_50,_default-annotations_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_requests_) --> detect,os
@@ -66,9 +57,6 @@ graph TD
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_requests_) --> get,generic-python-lib,_pip
get-dataset-openimages,0a9d49b644cf4142_(_validation,_50,_default-annotations_) --> get,generic-python-lib,_requests
get-mlperf-inference-src,4b57186581024797 --> detect,os
get-mlperf-inference-src,4b57186581024797 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
get-dataset-openimages,0a9d49b644cf4142_(_validation,_50,_default-annotations_) --> mlperf,inference,source
get-generic-python-lib,94b62a682bc44791_(_boto3_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
@@ -113,9 +101,6 @@ graph TD
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> get,generic-python-lib,_pip
get-dataset-openimages,0a9d49b644cf4142_(_validation,_50,_default-annotations_) --> get,generic-python-lib,_pycocotools
get-preprocessed-dataset-openimages,9842f1be8cba4c7b_(_validation,_NCHW_) --> get,dataset,object-detection,openimages,original,_validation,_50,_default-annotations
get-mlperf-inference-src,4b57186581024797 --> detect,os
get-mlperf-inference-src,4b57186581024797 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
get-preprocessed-dataset-openimages,9842f1be8cba4c7b_(_validation,_NCHW_) --> mlperf,mlcommons,inference,source,src
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> get,python3
get-preprocessed-dataset-openimages,9842f1be8cba4c7b_(_validation,_NCHW_) --> get,generic-python-lib,_pycocotools
@@ -139,30 +124,27 @@ graph TD
get-preprocessed-dataset-openimages,9842f1be8cba4c7b_(_validation,_NCHW_) --> get,generic-python-lib,_numpy
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> get,python3
get-preprocessed-dataset-openimages,9842f1be8cba4c7b_(_validation,_NCHW_) --> get,generic-python-lib,_numpy
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> get,dataset,preprocessed,openimages,_validation,_NCHW
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> get,dataset,preprocessed,openimages,_validation,_NCHW
download-file,9cdc8dc41aae437e_(_cmutil,_url.https://zenodo.org/record/6617879/files/resnext50_32x4d_fpn.onnx_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_url.https://zenodo.org/record/6617879/files/resnext50_32x4d_fpn.onnx_) --> download,file,_cmutil,_url.https://zenodo.org/record/6617879/files/resnext50_32x4d_fpn.onnx
get-ml-model-retinanet,427bc5665e4541c2_(_onnx,_fp32_) --> download-and-extract,_url.https://zenodo.org/record/6617879/files/resnext50_32x4d_fpn.onnx
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> get,ml-model,retinanet,_onnx,_fp32
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> get,ml-model,retinanet,_onnx,_fp32
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,cpu
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,python
get-mlperf-inference-src,4b57186581024797 --> detect,os
get-mlperf-inference-src,4b57186581024797 --> get,python3
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,mlcommons,inference,src
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,sut,configs
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> generate,user-conf,mlperf,inference
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> generate,user-conf,mlperf,inference
detect-cpu,586c8a43320142f7 --> detect,os
compile-program,c05042ba005a4bfa --> detect,cpu
compile-program,c05042ba005a4bfa --> get,compiler
detect-cpu,586c8a43320142f7 --> detect,os
get-compiler-flags,31be8b74a69742f8 --> detect,cpu
compile-program,c05042ba005a4bfa --> get,compiler-flags
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> compile,cpp-program
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> compile,cpp-program
detect-cpu,586c8a43320142f7 --> detect,os
benchmark-program,19f369ef47084895 --> detect,cpu
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_retinanet,_cpu,_offline_) --> benchmark-mlperf
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_offline,_cpu,_onnxruntime_) --> benchmark-mlperf
Binary file modified ...x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-deps.png
View file

Unable to render rich display
200 changes: 10 additions & 190 deletions ..._x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-version-info.json
View file
Original file line number Diff line number Diff line change
@@ -90,36 +90,6 @@
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline )"
}
},
{
"detect,os": {
"script_uid": "863735b7db8c44fc",
"script_alias": "detect-os",
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,python3": {
"script_uid": "d0b5dd74373f4a62",
"script_alias": "get-python3",
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
"script_uid": "ed603e7292974f10",
"script_alias": "get-git-repo",
"script_tags": "get,git,repo,repository,clone",
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,mlperf,inference,src": {
"script_uid": "4b57186581024797",
@@ -147,7 +117,7 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -167,7 +137,7 @@
"script_tags": "detect,cpu,detect-cpu,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -200,36 +170,6 @@
"parent": "get-mlperf-inference-loadgen,64c3d98d0ba04950"
}
},
{
"detect,os": {
"script_uid": "863735b7db8c44fc",
"script_alias": "detect-os",
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,python3": {
"script_uid": "d0b5dd74373f4a62",
"script_alias": "get-python3",
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
"script_uid": "ed603e7292974f10",
"script_alias": "get-git-repo",
"script_tags": "get,git,repo,repository,clone",
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,mlcommons,inference,src": {
"script_uid": "4b57186581024797",
@@ -517,37 +457,7 @@
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
"script_variations": "",
"version": "master",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
}
},
{
"detect,os": {
"script_uid": "863735b7db8c44fc",
"script_alias": "detect-os",
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,python3": {
"script_uid": "d0b5dd74373f4a62",
"script_alias": "get-python3",
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
"script_uid": "ed603e7292974f10",
"script_alias": "get-git-repo",
"script_tags": "get,git,repo,repository,clone",
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -557,7 +467,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "",
"version": "r5.0-git-9b32a74c53fcfa6a7f6b529dec6bba534e10cc29",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -577,7 +487,7 @@
"script_tags": "install,onnxruntime,get,prebuilt,lib,lang-c,lang-cpp",
"script_variations": "cpu",
"version": "1.16.3",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -670,36 +580,6 @@
"parent": "get-dataset-openimages,0a9d49b644cf4142 ( validation,_50,_default-annotations )"
}
},
{
"detect,os": {
"script_uid": "863735b7db8c44fc",
"script_alias": "detect-os",
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,python3": {
"script_uid": "d0b5dd74373f4a62",
"script_alias": "get-python3",
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
"script_uid": "ed603e7292974f10",
"script_alias": "get-git-repo",
"script_tags": "get,git,repo,repository,clone",
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"mlperf,inference,source": {
"script_uid": "4b57186581024797",
@@ -1140,36 +1020,6 @@
"parent": "get-preprocessed-dataset-openimages,9842f1be8cba4c7b ( validation,_NCHW )"
}
},
{
"detect,os": {
"script_uid": "863735b7db8c44fc",
"script_alias": "detect-os",
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,python3": {
"script_uid": "d0b5dd74373f4a62",
"script_alias": "get-python3",
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
"script_uid": "ed603e7292974f10",
"script_alias": "get-git-repo",
"script_tags": "get,git,repo,repository,clone",
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"mlperf,mlcommons,inference,source,src": {
"script_uid": "4b57186581024797",
@@ -1407,7 +1257,7 @@
"script_tags": "get,dataset,openimages,open-images,object-detection,preprocessed",
"script_variations": "validation,NCHW",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -1447,7 +1297,7 @@
"script_tags": "get,ml-model,raw,resnext50,retinanet,object-detection",
"script_variations": "onnx,fp32",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -1490,36 +1340,6 @@
"parent": "generate-mlperf-inference-user-conf,3af4475745964b93"
}
},
{
"detect,os": {
"script_uid": "863735b7db8c44fc",
"script_alias": "detect-os",
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,python3": {
"script_uid": "d0b5dd74373f4a62",
"script_alias": "get-python3",
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
"script_uid": "ed603e7292974f10",
"script_alias": "get-git-repo",
"script_tags": "get,git,repo,repository,clone",
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
"version": "",
"parent": "get-mlperf-inference-src,4b57186581024797"
}
},
{
"get,mlcommons,inference,src": {
"script_uid": "4b57186581024797",
@@ -1557,7 +1377,7 @@
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -1627,7 +1447,7 @@
"script_tags": "compile,program,c-program,cpp-program,compile-program,compile-c-program,compile-cpp-program",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
},
{
@@ -1667,7 +1487,7 @@
"script_tags": "mlperf,benchmark-mlperf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_retinanet,_cpu,_offline )"
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_offline,_cpu,_onnxruntime )"
}
}
]
2 changes: 1 addition & 1 deletion ...tu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/os_info.json
View file
Original file line number Diff line number Diff line change
@@ -26,5 +26,5 @@
],
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
"MLC_HOST_PYTHON_BITS": "64",
"MLC_HOST_SYSTEM_NAME": "fv-az1065-242"
"MLC_HOST_SYSTEM_NAME": "fv-az1384-73"
}
8 changes: 4 additions & 4 deletions ...86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/performance_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
MLPerf Conf path: /home/runner/MLC/repos/local/cache/get-git-repo_e71c543f/inference/mlperf.conf
User Conf path: /home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/94445e13d26a4835a22fe27854f1c083.conf
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_7ac6cb19
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_7ac6cb19/annotations/openimages-mlperf.json
MLPerf Conf path: /home/runner/MLC/repos/local/cache/get-git-repo_638313d0/inference/mlperf.conf
User Conf path: /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/8ea358902dbf400caa9321329a2f2479.conf
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_9a4e81ce
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_9a4e81ce/annotations/openimages-mlperf.json
Scenario: Offline
Mode: PerformanceOnly
Batch size: 1
106 changes: 53 additions & 53 deletions ...latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1065-242 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az1384-73 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
07:00:12 up 4 min, 0 user, load average: 1.48, 0.59, 0.23
10:02:15 up 5 min, 0 user, load average: 1.45, 0.61, 0.24
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -46,7 +46,7 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-18*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| | `-15*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-15*[{provisioner}]
|-python3---python3---4*[{python3}]
@@ -67,7 +67,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2603.795
cpu MHz : 3243.499
cache size : 512 KB
physical id : 0
siblings : 4
@@ -95,7 +95,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3238.925
cpu MHz : 2445.425
cache size : 512 KB
physical id : 0
siblings : 4
@@ -123,7 +123,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2445.425
cpu MHz : 2662.541
cache size : 512 KB
physical id : 0
siblings : 4
@@ -151,7 +151,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3240.439
cpu MHz : 2632.063
cache size : 512 KB
physical id : 0
siblings : 4
@@ -218,53 +218,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 8221 MB
node 0 free: 8236 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373796 kB
MemFree: 8418376 kB
MemAvailable: 15349176 kB
Buffers: 203116 kB
Cached: 6688916 kB
MemFree: 8433588 kB
MemAvailable: 15364032 kB
Buffers: 201948 kB
Cached: 6688768 kB
SwapCached: 0 kB
Active: 1327560 kB
Inactive: 5859916 kB
Active(anon): 375504 kB
Active: 1337000 kB
Inactive: 5860724 kB
Active(anon): 386152 kB
Inactive(anon): 0 kB
Active(file): 952056 kB
Inactive(file): 5859916 kB
Active(file): 950848 kB
Inactive(file): 5860724 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 553604 kB
Dirty: 178252 kB
Writeback: 0 kB
AnonPages: 339356 kB
Mapped: 340928 kB
Shmem: 71308 kB
KReclaimable: 464740 kB
Slab: 561852 kB
SReclaimable: 464740 kB
SUnreclaim: 97112 kB
KernelStack: 4108 kB
PageTables: 6368 kB
AnonPages: 352760 kB
Mapped: 341720 kB
Shmem: 70388 kB
KReclaimable: 464784 kB
Slab: 562228 kB
SReclaimable: 464784 kB
SUnreclaim: 97444 kB
KernelStack: 4196 kB
PageTables: 6376 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2150112 kB
Committed_AS: 2208296 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 35168 kB
VmallocUsed: 35264 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 149504 kB
AnonHugePages: 163840 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +276,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 116672 kB
DirectMap2M: 4077568 kB
DirectMap1G: 14680064 kB
DirectMap4k: 110528 kB
DirectMap2M: 3035136 kB
DirectMap1G: 15728640 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-31 06:55
run-level 5 2025-01-31 09:57
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -732,7 +732,7 @@ xfs_scrub_all.timer disabled enabled
BOOT_IMAGE=/vmlinuz-6.8.0-1020-azure root=PARTUUID=8be7931c-8315-4344-95d4-bcbd379998fb ro console=tty1 console=ttyS0 earlyprintk=ttyS0 nvme_core.io_timeout=240 panic=-1
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 2:
analyzing CPU 3:
no or unknown cpufreq driver is active on this CPU
CPUs which run at the same hardware frequency: Not Available
CPUs which need to have their frequency coordinated by software: Not Available
@@ -808,16 +808,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 231845 224372 45 0 15936 0
fs.dentry-state = 231877 224407 45 0 15884 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1696 0 9223372036854775807
fs.inode-nr = 215877 568
fs.inode-state = 215877 568 0 0 0 0 0
fs.inode-nr = 215968 568
fs.inode-state = 215968 568 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +876,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1065-242
kernel.hostname = fv-az1384-73
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +909,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 7415
kernel.ns_last_pid = 7153
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +942,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 401a91fa-bbb0-467e-a3eb-a1c6fd27a338
kernel.random.boot_id = e4bfd69a-668d-4878-b058-f12d9b9241a6
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = d937e8ad-95dc-484f-ac1d-bcc2d2d2821d
kernel.random.uuid = 78fde51a-57e1-4a22-bad6-20a9159617bf
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1359,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = 2293309d-cb647136-0d927489-a4a8de4e
net.ipv4.tcp_fastopen_key = 38be2d65-8ac97d59-6771edd3-44962065
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1833,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 188
net.netfilter.nf_conntrack_count = 249
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -1981,12 +1981,12 @@ LOGO=ubuntu-logo
19. Disk information
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 75G 0 disk
└─sda1 8:1 0 75G 0 part /mnt
├─sda1 8:1 0 74G 0 part /
├─sda14 8:14 0 4M 0 part
├─sda15 8:15 0 106M 0 part /boot/efi
└─sda16 259:0 0 913M 0 part /boot
sdb 8:16 0 75G 0 disk
├─sdb1 8:17 0 74G 0 part /
├─sdb14 8:30 0 4M 0 part
├─sdb15 8:31 0 106M 0 part /boot/efi
└─sdb16 259:0 0 913M 0 part /boot
└─sdb1 8:17 0 75G 0 part /mnt
------------------------------------------------------------
20. /sys/devices/virtual/dmi/id
bios_date
@@ -2056,24 +2056,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0008-1998-4831-1252-5373-35
UUID: 98b6cb71-4b2c-f74f-8e55-3e3e3d1c360c
Serial Number: 0000-0014-0788-1554-0880-8190-72
UUID: 240062c3-7344-8043-a4f2-bcdf5911cf7d
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0010-2561-7216-3440-3261-56
Serial Number: 0000-0011-8857-7003-4042-2286-05

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 1535-6332-1885-9128-4969-4627-12
Serial Number: 1067-1208-3393-8543-5073-3104-33
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
106 changes: 53 additions & 53 deletions ..._ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1065-242 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az1384-73 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
07:00:12 up 4 min, 0 user, load average: 1.48, 0.59, 0.23
10:02:15 up 5 min, 0 user, load average: 1.45, 0.61, 0.24
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -46,7 +46,7 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-18*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| | `-15*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-15*[{provisioner}]
|-python3---python3---4*[{python3}]
@@ -67,7 +67,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2603.795
cpu MHz : 3243.499
cache size : 512 KB
physical id : 0
siblings : 4
@@ -95,7 +95,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3238.925
cpu MHz : 2445.425
cache size : 512 KB
physical id : 0
siblings : 4
@@ -123,7 +123,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2445.425
cpu MHz : 2662.541
cache size : 512 KB
physical id : 0
siblings : 4
@@ -151,7 +151,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3240.439
cpu MHz : 2632.063
cache size : 512 KB
physical id : 0
siblings : 4
@@ -218,53 +218,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 8221 MB
node 0 free: 8236 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373796 kB
MemFree: 8418376 kB
MemAvailable: 15349176 kB
Buffers: 203116 kB
Cached: 6688916 kB
MemFree: 8433588 kB
MemAvailable: 15364032 kB
Buffers: 201948 kB
Cached: 6688768 kB
SwapCached: 0 kB
Active: 1327560 kB
Inactive: 5859916 kB
Active(anon): 375504 kB
Active: 1337000 kB
Inactive: 5860724 kB
Active(anon): 386152 kB
Inactive(anon): 0 kB
Active(file): 952056 kB
Inactive(file): 5859916 kB
Active(file): 950848 kB
Inactive(file): 5860724 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 553604 kB
Dirty: 178252 kB
Writeback: 0 kB
AnonPages: 339356 kB
Mapped: 340928 kB
Shmem: 71308 kB
KReclaimable: 464740 kB
Slab: 561852 kB
SReclaimable: 464740 kB
SUnreclaim: 97112 kB
KernelStack: 4108 kB
PageTables: 6368 kB
AnonPages: 352760 kB
Mapped: 341720 kB
Shmem: 70388 kB
KReclaimable: 464784 kB
Slab: 562228 kB
SReclaimable: 464784 kB
SUnreclaim: 97444 kB
KernelStack: 4196 kB
PageTables: 6376 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2150112 kB
Committed_AS: 2208296 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 35168 kB
VmallocUsed: 35264 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 149504 kB
AnonHugePages: 163840 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +276,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 116672 kB
DirectMap2M: 4077568 kB
DirectMap1G: 14680064 kB
DirectMap4k: 110528 kB
DirectMap2M: 3035136 kB
DirectMap1G: 15728640 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-31 06:55
run-level 5 2025-01-31 09:57
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -732,7 +732,7 @@ xfs_scrub_all.timer disabled enabled
BOOT_IMAGE=/vmlinuz-6.8.0-1020-azure root=PARTUUID=8be7931c-8315-4344-95d4-bcbd379998fb ro console=tty1 console=ttyS0 earlyprintk=ttyS0 nvme_core.io_timeout=240 panic=-1
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 2:
analyzing CPU 3:
no or unknown cpufreq driver is active on this CPU
CPUs which run at the same hardware frequency: Not Available
CPUs which need to have their frequency coordinated by software: Not Available
@@ -808,16 +808,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 231845 224372 45 0 15936 0
fs.dentry-state = 231877 224407 45 0 15884 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1696 0 9223372036854775807
fs.inode-nr = 215877 568
fs.inode-state = 215877 568 0 0 0 0 0
fs.inode-nr = 215968 568
fs.inode-state = 215968 568 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +876,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1065-242
kernel.hostname = fv-az1384-73
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +909,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 7415
kernel.ns_last_pid = 7153
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +942,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 401a91fa-bbb0-467e-a3eb-a1c6fd27a338
kernel.random.boot_id = e4bfd69a-668d-4878-b058-f12d9b9241a6
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = d937e8ad-95dc-484f-ac1d-bcc2d2d2821d
kernel.random.uuid = 78fde51a-57e1-4a22-bad6-20a9159617bf
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1359,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = 2293309d-cb647136-0d927489-a4a8de4e
net.ipv4.tcp_fastopen_key = 38be2d65-8ac97d59-6771edd3-44962065
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1833,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 188
net.netfilter.nf_conntrack_count = 249
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -1981,12 +1981,12 @@ LOGO=ubuntu-logo
19. Disk information
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 75G 0 disk
└─sda1 8:1 0 75G 0 part /mnt
├─sda1 8:1 0 74G 0 part /
├─sda14 8:14 0 4M 0 part
├─sda15 8:15 0 106M 0 part /boot/efi
└─sda16 259:0 0 913M 0 part /boot
sdb 8:16 0 75G 0 disk
├─sdb1 8:17 0 74G 0 part /
├─sdb14 8:30 0 4M 0 part
├─sdb15 8:31 0 106M 0 part /boot/efi
└─sdb16 259:0 0 913M 0 part /boot
└─sdb1 8:17 0 75G 0 part /mnt
------------------------------------------------------------
20. /sys/devices/virtual/dmi/id
bios_date
@@ -2056,24 +2056,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0008-1998-4831-1252-5373-35
UUID: 98b6cb71-4b2c-f74f-8e55-3e3e3d1c360c
Serial Number: 0000-0014-0788-1554-0880-8190-72
UUID: 240062c3-7344-8043-a4f2-bcdf5911cf7d
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0010-2561-7216-3440-3261-56
Serial Number: 0000-0011-8857-7003-4042-2286-05

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 1535-6332-1885-9128-4969-4627-12
Serial Number: 1067-1208-3393-8543-5073-3104-33
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
120 changes: 60 additions & 60 deletions ...rements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1344-602 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az1384-73 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
09:11:45 up 3 min, 0 user, load average: 2.10, 0.78, 0.29
10:02:15 up 5 min, 0 user, load average: 1.45, 0.61, 0.24
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -45,10 +45,10 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-17*[{Runner.Worker}]
| | | `-18*[{Runner.Worker}]
| | `-15*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-13*[{provisioner}]
| `-15*[{provisioner}]
|-python3---python3---4*[{python3}]
|-rsyslogd---3*[{rsyslogd}]
|-systemd---(sd-pam)
@@ -67,7 +67,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2597.989
cpu MHz : 3243.499
cache size : 512 KB
physical id : 0
siblings : 4
@@ -81,7 +81,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.86
bogomips : 4890.85
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -95,7 +95,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3242.012
cpu MHz : 2445.425
cache size : 512 KB
physical id : 0
siblings : 4
@@ -109,7 +109,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.86
bogomips : 4890.85
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -123,7 +123,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2445.432
cpu MHz : 2662.541
cache size : 512 KB
physical id : 0
siblings : 4
@@ -137,7 +137,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.86
bogomips : 4890.85
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -151,7 +151,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3243.826
cpu MHz : 2632.063
cache size : 512 KB
physical id : 0
siblings : 4
@@ -165,7 +165,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.86
bogomips : 4890.85
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -188,7 +188,7 @@ Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
BogoMIPS: 4890.85
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
@@ -218,53 +218,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 8496 MB
node 0 free: 8236 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373792 kB
MemFree: 8700072 kB
MemAvailable: 15349060 kB
Buffers: 169920 kB
Cached: 6452432 kB
MemTotal: 16373796 kB
MemFree: 8433588 kB
MemAvailable: 15364032 kB
Buffers: 201948 kB
Cached: 6688768 kB
SwapCached: 0 kB
Active: 1323960 kB
Inactive: 5592516 kB
Active(anon): 373344 kB
Active: 1337000 kB
Inactive: 5860724 kB
Active(anon): 386152 kB
Inactive(anon): 0 kB
Active(file): 950616 kB
Inactive(file): 5592516 kB
Active(file): 950848 kB
Inactive(file): 5860724 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 5792 kB
Dirty: 178252 kB
Writeback: 0 kB
AnonPages: 340700 kB
Mapped: 341680 kB
Shmem: 70468 kB
KReclaimable: 451768 kB
Slab: 546668 kB
SReclaimable: 451768 kB
SUnreclaim: 94900 kB
KernelStack: 4064 kB
PageTables: 6140 kB
AnonPages: 352760 kB
Mapped: 341720 kB
Shmem: 70388 kB
KReclaimable: 464784 kB
Slab: 562228 kB
SReclaimable: 464784 kB
SUnreclaim: 97444 kB
KernelStack: 4196 kB
PageTables: 6376 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2165700 kB
Committed_AS: 2208296 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 35152 kB
VmallocUsed: 35264 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 153600 kB
AnonHugePages: 163840 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +276,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 114624 kB
DirectMap2M: 5128192 kB
DirectMap1G: 13631488 kB
DirectMap4k: 110528 kB
DirectMap2M: 3035136 kB
DirectMap1G: 15728640 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-31 09:08
run-level 5 2025-01-31 09:57
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -732,7 +732,7 @@ xfs_scrub_all.timer disabled enabled
BOOT_IMAGE=/vmlinuz-6.8.0-1020-azure root=PARTUUID=8be7931c-8315-4344-95d4-bcbd379998fb ro console=tty1 console=ttyS0 earlyprintk=ttyS0 nvme_core.io_timeout=240 panic=-1
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 1:
analyzing CPU 3:
no or unknown cpufreq driver is active on this CPU
CPUs which run at the same hardware frequency: Not Available
CPUs which need to have their frequency coordinated by software: Not Available
@@ -808,16 +808,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 270064 262573 45 0 63178 0
fs.dentry-state = 231877 224407 45 0 15884 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1696 0 9223372036854775807
fs.inode-nr = 206836 568
fs.inode-state = 206836 568 0 0 0 0 0
fs.inode-nr = 215968 568
fs.inode-state = 215968 568 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +876,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1344-602
kernel.hostname = fv-az1384-73
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +909,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 6059
kernel.ns_last_pid = 7153
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +942,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = ecc3df4f-667a-4fe8-ac14-47bf6ded55ed
kernel.random.boot_id = e4bfd69a-668d-4878-b058-f12d9b9241a6
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 623714b2-a490-44e9-9ec9-75d0f85acfaf
kernel.random.uuid = 78fde51a-57e1-4a22-bad6-20a9159617bf
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1359,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = 70601096-7c76b114-816ffc39-79b317cb
net.ipv4.tcp_fastopen_key = 38be2d65-8ac97d59-6771edd3-44962065
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1833,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 157
net.netfilter.nf_conntrack_count = 249
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -1981,12 +1981,12 @@ LOGO=ubuntu-logo
19. Disk information
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 75G 0 disk
└─sda1 8:1 0 75G 0 part /mnt
├─sda1 8:1 0 74G 0 part /
├─sda14 8:14 0 4M 0 part
├─sda15 8:15 0 106M 0 part /boot/efi
└─sda16 259:0 0 913M 0 part /boot
sdb 8:16 0 75G 0 disk
├─sdb1 8:17 0 74G 0 part /
├─sdb14 8:30 0 4M 0 part
├─sdb15 8:31 0 106M 0 part /boot/efi
└─sdb16 259:0 0 913M 0 part /boot
└─sdb1 8:17 0 75G 0 part /mnt
------------------------------------------------------------
20. /sys/devices/virtual/dmi/id
bios_date
@@ -2056,24 +2056,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0004-1293-5797-6927-6184-33
UUID: 336d4e39-32a5-8145-8010-16452969020b
Serial Number: 0000-0014-0788-1554-0880-8190-72
UUID: 240062c3-7344-8043-a4f2-bcdf5911cf7d
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0009-2279-0012-2785-4484-59
Serial Number: 0000-0011-8857-7003-4042-2286-05

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 6159-8344-0167-1311-0160-3178-77
Serial Number: 1067-1208-3393-8543-5073-3104-33
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
2 changes: 1 addition & 1 deletion ...gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.20.1-default_config/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|----------|------------|------------|--------------|-------------------|
| resnet50 | offline | 76 | 23.163 | - |
| resnet50 | offline | 76 | 23.169 | - |
10 changes: 5 additions & 5 deletions ...x86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/README.md
View file
Original file line number Diff line number Diff line change
@@ -16,16 +16,16 @@ pip install -U mlcflow

mlc rm cache -f

mlc pull repo GATEOverflow@mlperf-automations --checkout=d89196b1a770d1593191bcc0901de0d86b4e8d6b
mlc pull repo mlcommons@mlperf-automations --checkout=02683cf5e8beb0cc5baaf27802daafc08fe42e67


```
*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf,
you should simply reload GATEOverflow@mlperf-automations without checkout and clean MLC cache as follows:*
you should simply reload mlcommons@mlperf-automations without checkout and clean MLC cache as follows:*

```bash
mlc rm repo GATEOverflow@mlperf-automations
mlc pull repo GATEOverflow@mlperf-automations
mlc rm repo mlcommons@mlperf-automations
mlc pull repo mlcommons@mlperf-automations
mlc rm cache -f

```
@@ -40,4 +40,4 @@ Model Precision: fp32
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`

### Performance Results
`Samples per second`: `23.163`
`Samples per second`: `23.1692`
6 changes: 3 additions & 3 deletions ...86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/accuracy_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
python3 python/main.py --profile resnet50-onnxruntime --model "/home/runner/MLC/repos/local/cache/download-file_8a5135a0/resnet50_v1.onnx" --dataset-path /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357 --output "/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_2d2ae342/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/accuracy" --scenario Offline --count 500 --threads 4 --user_conf /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/d32da5e24b354e62870f8d3ca1333125.conf --accuracy --use_preprocessed_dataset --cache_dir /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357 --dataset-list /home/runner/MLC/repos/local/cache/extract-file_95cf384e/val.txt
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357', dataset_list='/home/runner/MLC/repos/local/cache/extract-file_95cf384e/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/runner/MLC/repos/local/cache/download-file_8a5135a0/resnet50_v1.onnx', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_2d2ae342/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/accuracy', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=4, qps=None, cache=0, cache_dir='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=True, find_peak_performance=False, debug=False, user_conf='/home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/d32da5e24b354e62870f8d3ca1333125.conf', audit_conf='audit.config', time=None, count=500, performance_sample_count=None, max_latency=None, samples_per_query=8)
python3 python/main.py --profile resnet50-onnxruntime --model "/home/runner/MLC/repos/local/cache/download-file_b776794b/resnet50_v1.onnx" --dataset-path /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da --output "/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_d3cd6d60/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/accuracy" --scenario Offline --count 500 --threads 4 --user_conf /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/bc2ad4bb30694ce589e9b2d41e806a6a.conf --accuracy --use_preprocessed_dataset --cache_dir /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da --dataset-list /home/runner/MLC/repos/local/cache/extract-file_91fed7e4/val.txt
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da', dataset_list='/home/runner/MLC/repos/local/cache/extract-file_91fed7e4/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/runner/MLC/repos/local/cache/download-file_b776794b/resnet50_v1.onnx', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_d3cd6d60/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/accuracy', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=4, qps=None, cache=0, cache_dir='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=True, find_peak_performance=False, debug=False, user_conf='/home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/bc2ad4bb30694ce589e9b2d41e806a6a.conf', audit_conf='audit.config', time=None, count=500, performance_sample_count=None, max_latency=None, samples_per_query=8)
INFO:imagenet:Loading 500 preprocessed images using 4 threads
INFO:imagenet:loaded 500 images, cache=0, already_preprocessed=True, took=0.0sec
INFO:main:starting TestScenario.Offline
TestScenario.Offline qps=0.74, mean=13.5786, time=21.633, acc=76.000%, queries=16, tiles=50.0:13.8288,80.0:20.9539,90.0:21.1509,95.0:21.3333,99.0:21.4312,99.9:21.4532
TestScenario.Offline qps=0.74, mean=13.5424, time=21.505, acc=76.000%, queries=16, tiles=50.0:13.8017,80.0:21.1621,90.0:21.2197,95.0:21.2636,99.0:21.3338,99.9:21.3496
40 changes: 20 additions & 20 deletions ...latest_x86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/mlc-deps.mmd
View file
Original file line number Diff line number Diff line change
@@ -12,32 +12,32 @@ graph TD
app-mlperf-inference,d775cac873ee4231_(_python,_resnet50,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,mlperf,inference,utils
download-file,9cdc8dc41aae437e_(_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz_) --> download,file,_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz
extract-file,3f0b76219d004817_(_path./home/runner/MLC/repos/local/cache/download-file_8b5fe4f4/caffe_ilsvrc12.tar.gz_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz_) --> extract,file,_path./home/runner/MLC/repos/local/cache/download-file_8b5fe4f4/caffe_ilsvrc12.tar.gz
extract-file,3f0b76219d004817_(_path./home/runner/MLC/repos/local/cache/download-file_39586d78/caffe_ilsvrc12.tar.gz_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz_) --> extract,file,_path./home/runner/MLC/repos/local/cache/download-file_39586d78/caffe_ilsvrc12.tar.gz
get-dataset-imagenet-aux,bb2c6dd8c8c64217 --> download-and-extract,_extract,_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz
app-mlperf-inference,d775cac873ee4231_(_python,_resnet50,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,dataset-aux,imagenet-aux
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> detect,cpu
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> detect,cpu
get-sys-utils-cm,bc90993277e84b8e --> detect,os
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,python
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,python
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> detect,cpu
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_onnxruntime_) --> get,generic-python-lib,_pip
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,generic-python-lib,_onnxruntime
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,generic-python-lib,_onnxruntime
download-file,9cdc8dc41aae437e_(_cmutil,_url.https://zenodo.org/record/4735647/files/resnet50_v1.onnx_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_url.https://zenodo.org/record/4735647/files/resnet50_v1.onnx_) --> download,file,_cmutil,_url.https://zenodo.org/record/4735647/files/resnet50_v1.onnx
get-ml-model-resnet50,56203e4e998b4bc0_(_fp32,_onnx_) --> download-and-extract,_url.https://zenodo.org/record/4735647/files/resnet50_v1.onnx
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,ml-model,image-classification,resnet50,raw,_fp32,_onnx
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,ml-model,image-classification,resnet50,raw,_fp32,_onnx
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,python3
get-dataset-imagenet-val,7afd58d287fe4f11_(_size.500,_2012_) --> detect,os
download-file,9cdc8dc41aae437e_(_cmutil,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> download,file,_cmutil,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar
extract-file,3f0b76219d004817_(_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_8a799bd5/ILSVRC2012_img_val_500.tar_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> extract,file,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_8a799bd5/ILSVRC2012_img_val_500.tar
extract-file,3f0b76219d004817_(_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_9f64cef0/ILSVRC2012_img_val_500.tar_) --> detect,os
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> extract,file,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_9f64cef0/ILSVRC2012_img_val_500.tar
get-dataset-imagenet-val,7afd58d287fe4f11_(_size.500,_2012_) --> download-and-extract,file,_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,dataset,image-classification,original,_size.500,_2012
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,dataset-aux,image-classification,imagenet-aux
@@ -56,16 +56,16 @@ graph TD
get-generic-python-lib,94b62a682bc44791_(_pillow_) --> get,generic-python-lib,_pip
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,generic-python-lib,_pillow
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> mlperf,mlcommons,inference,source,src
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,dataset,image-classification,imagenet,preprocessed,_NCHW
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,dataset-aux,image-classification,imagenet-aux
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,dataset,image-classification,imagenet,preprocessed,_NCHW
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,dataset-aux,image-classification,imagenet-aux
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,cpu
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,python
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,mlcommons,inference,src
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
generate-mlperf-inference-user-conf,3af4475745964b93 --> get,sut,configs
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> generate,user-conf,mlperf,inference
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> generate,user-conf,mlperf,inference
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> detect,os
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,python3
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,mlcommons,inference,src
@@ -96,38 +96,38 @@ graph TD
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_package.setuptools_) --> get,generic-python-lib,_pip
get-mlperf-inference-loadgen,64c3d98d0ba04950 --> get,generic-python-lib,_package.setuptools
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,loadgen
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,mlcommons,inference,src
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,mlcommons,inference,src
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,loadgen
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,mlcommons,inference,src
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,mlcommons,inference,src
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> detect,cpu
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_package.psutil_) --> get,generic-python-lib,_pip
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,generic-python-lib,_package.psutil
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,generic-python-lib,_package.psutil
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> detect,cpu
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_opencv-python_) --> get,generic-python-lib,_pip
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,generic-python-lib,_opencv-python
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,generic-python-lib,_opencv-python
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> detect,cpu
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_numpy_) --> get,generic-python-lib,_pip
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,generic-python-lib,_numpy
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,generic-python-lib,_numpy
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> detect,os
detect-cpu,586c8a43320142f7 --> detect,os
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> detect,cpu
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
get-generic-python-lib,94b62a682bc44791_(_pycocotools_) --> get,generic-python-lib,_pip
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> get,generic-python-lib,_pycocotools
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> get,generic-python-lib,_pycocotools
detect-cpu,586c8a43320142f7 --> detect,os
benchmark-program,19f369ef47084895 --> detect,cpu
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_cpu,_offline,_resnet50,_onnxruntime,_fp32_) --> benchmark-mlperf
app-mlperf-inference-mlcommons-python,ff149e9781fc4b65_(_offline,_onnxruntime,_cpu,_resnet50,_fp32_) --> benchmark-mlperf
Binary file modified ...-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/mlc-deps.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
44 changes: 22 additions & 22 deletions ...6-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/mlc-version-info.json
View file
Original file line number Diff line number Diff line change
@@ -137,15 +137,15 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "extract-file,3f0b76219d004817 ( path./home/runner/MLC/repos/local/cache/download-file_8b5fe4f4/caffe_ilsvrc12.tar.gz )"
"parent": "extract-file,3f0b76219d004817 ( path./home/runner/MLC/repos/local/cache/download-file_39586d78/caffe_ilsvrc12.tar.gz )"
}
},
{
"extract,file,_path./home/runner/MLC/repos/local/cache/download-file_8b5fe4f4/caffe_ilsvrc12.tar.gz": {
"extract,file,_path./home/runner/MLC/repos/local/cache/download-file_39586d78/caffe_ilsvrc12.tar.gz": {
"script_uid": "3f0b76219d004817",
"script_alias": "extract-file",
"script_tags": "extract,file",
"script_variations": "path./home/runner/MLC/repos/local/cache/download-file_8b5fe4f4/caffe_ilsvrc12.tar.gz",
"script_variations": "path./home/runner/MLC/repos/local/cache/download-file_39586d78/caffe_ilsvrc12.tar.gz",
"version": "",
"parent": "download-and-extract,c67e81a4ce2649f5 ( extract,_wget,_url.http://dl.caffe.berkeleyvision.org/caffe_ilsvrc12.tar.gz )"
}
@@ -177,7 +177,7 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -197,7 +197,7 @@
"script_tags": "detect,cpu,detect-cpu,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -217,7 +217,7 @@
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -287,7 +287,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "onnxruntime",
"version": "1.20.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -327,7 +327,7 @@
"script_tags": "get,raw,ml-model,resnet50,ml-model-resnet50,image-classification",
"script_variations": "fp32,onnx",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -377,15 +377,15 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "extract-file,3f0b76219d004817 ( path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_8a799bd5/ILSVRC2012_img_val_500.tar )"
"parent": "extract-file,3f0b76219d004817 ( path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_9f64cef0/ILSVRC2012_img_val_500.tar )"
}
},
{
"extract,file,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_8a799bd5/ILSVRC2012_img_val_500.tar": {
"extract,file,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_9f64cef0/ILSVRC2012_img_val_500.tar": {
"script_uid": "3f0b76219d004817",
"script_alias": "extract-file",
"script_tags": "extract,file",
"script_variations": "path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_8a799bd5/ILSVRC2012_img_val_500.tar",
"script_variations": "path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_9f64cef0/ILSVRC2012_img_val_500.tar",
"version": "",
"parent": "download-and-extract,c67e81a4ce2649f5 ( extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar )"
}
@@ -577,7 +577,7 @@
"script_tags": "get,dataset,imagenet,ILSVRC,image-classification,preprocessed",
"script_variations": "NCHW",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -587,7 +587,7 @@
"script_tags": "get,aux,dataset-aux,image-classification,imagenet-aux",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -667,7 +667,7 @@
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -977,7 +977,7 @@
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
"script_variations": "",
"version": "master",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -987,7 +987,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "",
"version": "r5.0-git-9b32a74c53fcfa6a7f6b529dec6bba534e10cc29",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -997,7 +997,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "",
"version": "master-git-9b32a74c53fcfa6a7f6b529dec6bba534e10cc29",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -1067,7 +1067,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.psutil",
"version": "6.1.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -1137,7 +1137,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "opencv-python",
"version": "4.11.0.86",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -1207,7 +1207,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "numpy",
"version": "1.26.4",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -1277,7 +1277,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "pycocotools",
"version": "2.0.8",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
},
{
@@ -1317,7 +1317,7 @@
"script_tags": "mlperf,benchmark-mlperf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_offline,_resnet50,_onnxruntime,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( offline,_onnxruntime,_cpu,_resnet50,_fp32 )"
}
}
]
2 changes: 1 addition & 1 deletion ...latest_x86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/os_info.json
View file
Original file line number Diff line number Diff line change
@@ -26,5 +26,5 @@
],
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
"MLC_HOST_PYTHON_BITS": "64",
"MLC_HOST_SYSTEM_NAME": "fv-az1280-171"
"MLC_HOST_SYSTEM_NAME": "fv-az789-390"
}
6 changes: 3 additions & 3 deletions ...reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/performance_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
python3 python/main.py --profile resnet50-onnxruntime --model "/home/runner/MLC/repos/local/cache/download-file_8a5135a0/resnet50_v1.onnx" --dataset-path /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357 --output "/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_2d2ae342/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1" --scenario Offline --threads 4 --user_conf /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/537eb041324b459db918e9d37836c74c.conf --use_preprocessed_dataset --cache_dir /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357 --dataset-list /home/runner/MLC/repos/local/cache/extract-file_95cf384e/val.txt
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357', dataset_list='/home/runner/MLC/repos/local/cache/extract-file_95cf384e/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/runner/MLC/repos/local/cache/download-file_8a5135a0/resnet50_v1.onnx', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_2d2ae342/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=4, qps=None, cache=0, cache_dir='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_23548357', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=False, find_peak_performance=False, debug=False, user_conf='/home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/537eb041324b459db918e9d37836c74c.conf', audit_conf='audit.config', time=None, count=None, performance_sample_count=None, max_latency=None, samples_per_query=8)
python3 python/main.py --profile resnet50-onnxruntime --model "/home/runner/MLC/repos/local/cache/download-file_b776794b/resnet50_v1.onnx" --dataset-path /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da --output "/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_d3cd6d60/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1" --scenario Offline --threads 4 --user_conf /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9b512a7a5ce044eb868702cd1da308f7.conf --use_preprocessed_dataset --cache_dir /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da --dataset-list /home/runner/MLC/repos/local/cache/extract-file_91fed7e4/val.txt
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da', dataset_list='/home/runner/MLC/repos/local/cache/extract-file_91fed7e4/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='Offline', max_batchsize=32, model='/home/runner/MLC/repos/local/cache/download-file_b776794b/resnet50_v1.onnx', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_d3cd6d60/test_results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/offline/performance/run_1', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=4, qps=None, cache=0, cache_dir='/home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_379126da', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=False, find_peak_performance=False, debug=False, user_conf='/home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9b512a7a5ce044eb868702cd1da308f7.conf', audit_conf='audit.config', time=None, count=None, performance_sample_count=None, max_latency=None, samples_per_query=8)
INFO:imagenet:Loading 50000 preprocessed images using 4 threads
INFO:imagenet:reduced image list, 49500 images not found
INFO:imagenet:loaded 500 images, cache=0, already_preprocessed=True, took=1.1sec
INFO:main:starting TestScenario.Offline
TestScenario.Offline qps=0.74, mean=13.5595, time=21.632, queries=16, tiles=50.0:13.7440,80.0:20.8913,90.0:21.0453,95.0:21.2512,99.0:21.4173,99.9:21.4547
TestScenario.Offline qps=0.74, mean=13.5443, time=21.629, queries=16, tiles=50.0:13.4418,80.0:21.0139,90.0:21.1964,95.0:21.3541,99.0:21.4279,99.9:21.4445
2 changes: 1 addition & 1 deletion ...est_x86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/pip_freeze.json
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"pip_freeze": {
"certifi": "2024.12.14",
"certifi": "2025.1.31",
"charset-normalizer": "3.4.1",
"colorama": "0.4.6",
"coloredlogs": "15.0.1",
99 changes: 50 additions & 49 deletions ...est_x86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1280-171 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az789-390 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
20:34:51 up 3 min, 0 user, load average: 2.53, 0.85, 0.32
10:02:11 up 5 min, 0 user, load average: 2.92, 1.13, 0.46
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -38,15 +38,16 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-cron
|-dbus-daemon
|-dockerd---9*[{dockerd}]
|-fwupd---5*[{fwupd}]
|-haveged
|-hv_kvp_daemon
|-multipathd---6*[{multipathd}]
|-networkd-dispat
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-17*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| | | `-18*[{Runner.Worker}]
| | `-15*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-14*[{provisioner}]
|-python3---python3---4*[{python3}]
@@ -67,7 +68,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3204.116
cpu MHz : 3240.273
cache size : 512 KB
physical id : 0
siblings : 4
@@ -95,7 +96,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3240.926
cpu MHz : 3201.812
cache size : 512 KB
physical id : 0
siblings : 4
@@ -123,7 +124,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2445.430
cpu MHz : 2609.336
cache size : 512 KB
physical id : 0
siblings : 4
@@ -151,7 +152,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2621.240
cpu MHz : 2445.431
cache size : 512 KB
physical id : 0
siblings : 4
@@ -218,53 +219,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 8149 MB
node 0 free: 8071 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373796 kB
MemFree: 8345272 kB
MemAvailable: 15379132 kB
Buffers: 175716 kB
Cached: 6809724 kB
MemFree: 8265368 kB
MemAvailable: 15329280 kB
Buffers: 176272 kB
Cached: 6838280 kB
SwapCached: 0 kB
Active: 1291436 kB
Inactive: 5989392 kB
Active(anon): 375676 kB
Active: 1329644 kB
Inactive: 6006680 kB
Active(anon): 402000 kB
Inactive(anon): 0 kB
Active(file): 915760 kB
Inactive(file): 5989392 kB
Active(file): 927644 kB
Inactive(file): 6006680 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 73296 kB
Dirty: 145756 kB
Writeback: 0 kB
AnonPages: 341336 kB
Mapped: 341240 kB
Shmem: 71536 kB
KReclaimable: 474620 kB
Slab: 572344 kB
SReclaimable: 474620 kB
SUnreclaim: 97724 kB
KernelStack: 4156 kB
PageTables: 6300 kB
AnonPages: 365928 kB
Mapped: 361424 kB
Shmem: 71476 kB
KReclaimable: 475500 kB
Slab: 573824 kB
SReclaimable: 475500 kB
SUnreclaim: 98324 kB
KernelStack: 4224 kB
PageTables: 6756 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2162520 kB
Committed_AS: 2403960 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 35248 kB
VmallocUsed: 35380 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 165888 kB
AnonHugePages: 137216 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +277,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 112576 kB
DirectMap2M: 3033088 kB
DirectMap1G: 15728640 kB
DirectMap4k: 110528 kB
DirectMap2M: 5132288 kB
DirectMap1G: 13631488 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-30 20:31
run-level 5 2025-01-31 09:57
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -808,16 +809,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 276074 268595 45 0 62581 0
fs.dentry-state = 276760 269212 45 0 62944 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1728 0 9223372036854775807
fs.inode-nr = 213454 568
fs.inode-state = 213454 568 0 0 0 0 0
fs.file-nr = 1792 0 9223372036854775807
fs.inode-nr = 213774 568
fs.inode-state = 213774 568 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +877,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1280-171
kernel.hostname = fv-az789-390
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +910,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 6664
kernel.ns_last_pid = 6732
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +943,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 926b9ce6-19db-44f0-b96f-ac3b1e885e1a
kernel.random.boot_id = b18b20bf-e361-4c2d-aff3-64a7111e2f2d
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = d2806b87-bd9c-4cad-871c-883d2b6eac32
kernel.random.uuid = 256e288f-7f7f-46a3-a8c1-e4475fb16255
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1360,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = 5000758b-bbb6f388-583f0011-fea0a06d
net.ipv4.tcp_fastopen_key = 07ba0956-83d6a54e-8d2b112a-c94a53a4
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1834,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 171
net.netfilter.nf_conntrack_count = 108
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -2056,24 +2057,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0005-3835-1202-5699-0112-09
UUID: aa13b64a-d50f-894a-8b99-944bdb1e6843
Serial Number: 0000-0010-7473-8315-1396-4711-96
UUID: 08602695-01bc-9c41-8ccb-d633337902c8
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0010-0592-3429-6228-3745-95
Serial Number: 0000-0010-1454-3810-0977-4189-52

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 5169-2808-5722-4117-7101-1237-39
Serial Number: 4008-0631-5716-3628-9830-1469-94
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
99 changes: 50 additions & 49 deletions ...untu-latest_x86-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1280-171 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az789-390 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
20:34:51 up 3 min, 0 user, load average: 2.53, 0.85, 0.32
10:02:11 up 5 min, 0 user, load average: 2.92, 1.13, 0.46
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -38,15 +38,16 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-cron
|-dbus-daemon
|-dockerd---9*[{dockerd}]
|-fwupd---5*[{fwupd}]
|-haveged
|-hv_kvp_daemon
|-multipathd---6*[{multipathd}]
|-networkd-dispat
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-17*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| | | `-18*[{Runner.Worker}]
| | `-15*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-14*[{provisioner}]
|-python3---python3---4*[{python3}]
@@ -67,7 +68,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3204.116
cpu MHz : 3240.273
cache size : 512 KB
physical id : 0
siblings : 4
@@ -95,7 +96,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3240.926
cpu MHz : 3201.812
cache size : 512 KB
physical id : 0
siblings : 4
@@ -123,7 +124,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2445.430
cpu MHz : 2609.336
cache size : 512 KB
physical id : 0
siblings : 4
@@ -151,7 +152,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2621.240
cpu MHz : 2445.431
cache size : 512 KB
physical id : 0
siblings : 4
@@ -218,53 +219,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 8149 MB
node 0 free: 8071 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373796 kB
MemFree: 8345272 kB
MemAvailable: 15379132 kB
Buffers: 175716 kB
Cached: 6809724 kB
MemFree: 8265368 kB
MemAvailable: 15329280 kB
Buffers: 176272 kB
Cached: 6838280 kB
SwapCached: 0 kB
Active: 1291436 kB
Inactive: 5989392 kB
Active(anon): 375676 kB
Active: 1329644 kB
Inactive: 6006680 kB
Active(anon): 402000 kB
Inactive(anon): 0 kB
Active(file): 915760 kB
Inactive(file): 5989392 kB
Active(file): 927644 kB
Inactive(file): 6006680 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 73296 kB
Dirty: 145756 kB
Writeback: 0 kB
AnonPages: 341336 kB
Mapped: 341240 kB
Shmem: 71536 kB
KReclaimable: 474620 kB
Slab: 572344 kB
SReclaimable: 474620 kB
SUnreclaim: 97724 kB
KernelStack: 4156 kB
PageTables: 6300 kB
AnonPages: 365928 kB
Mapped: 361424 kB
Shmem: 71476 kB
KReclaimable: 475500 kB
Slab: 573824 kB
SReclaimable: 475500 kB
SUnreclaim: 98324 kB
KernelStack: 4224 kB
PageTables: 6756 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2162520 kB
Committed_AS: 2403960 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 35248 kB
VmallocUsed: 35380 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 165888 kB
AnonHugePages: 137216 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +277,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 112576 kB
DirectMap2M: 3033088 kB
DirectMap1G: 15728640 kB
DirectMap4k: 110528 kB
DirectMap2M: 5132288 kB
DirectMap1G: 13631488 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-30 20:31
run-level 5 2025-01-31 09:57
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -808,16 +809,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 276074 268595 45 0 62581 0
fs.dentry-state = 276760 269212 45 0 62944 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1728 0 9223372036854775807
fs.inode-nr = 213454 568
fs.inode-state = 213454 568 0 0 0 0 0
fs.file-nr = 1792 0 9223372036854775807
fs.inode-nr = 213774 568
fs.inode-state = 213774 568 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +877,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1280-171
kernel.hostname = fv-az789-390
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +910,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 6664
kernel.ns_last_pid = 6732
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +943,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 926b9ce6-19db-44f0-b96f-ac3b1e885e1a
kernel.random.boot_id = b18b20bf-e361-4c2d-aff3-64a7111e2f2d
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = d2806b87-bd9c-4cad-871c-883d2b6eac32
kernel.random.uuid = 256e288f-7f7f-46a3-a8c1-e4475fb16255
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1360,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = 5000758b-bbb6f388-583f0011-fea0a06d
net.ipv4.tcp_fastopen_key = 07ba0956-83d6a54e-8d2b112a-c94a53a4
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1834,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 171
net.netfilter.nf_conntrack_count = 108
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -2056,24 +2057,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0005-3835-1202-5699-0112-09
UUID: aa13b64a-d50f-894a-8b99-944bdb1e6843
Serial Number: 0000-0010-7473-8315-1396-4711-96
UUID: 08602695-01bc-9c41-8ccb-d633337902c8
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0010-0592-3429-6228-3745-95
Serial Number: 0000-0010-1454-3810-0977-4189-52

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 5169-2808-5722-4117-7101-1237-39
Serial Number: 4008-0631-5716-3628-9830-1469-94
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
99 changes: 50 additions & 49 deletions ...nts/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.20.1-default_config/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1280-171 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az789-390 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
20:34:51 up 3 min, 0 user, load average: 2.53, 0.85, 0.32
10:02:11 up 5 min, 0 user, load average: 2.92, 1.13, 0.46
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -38,15 +38,16 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-cron
|-dbus-daemon
|-dockerd---9*[{dockerd}]
|-fwupd---5*[{fwupd}]
|-haveged
|-hv_kvp_daemon
|-multipathd---6*[{multipathd}]
|-networkd-dispat
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-17*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| | | `-18*[{Runner.Worker}]
| | `-15*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-14*[{provisioner}]
|-python3---python3---4*[{python3}]
@@ -67,7 +68,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3204.116
cpu MHz : 3240.273
cache size : 512 KB
physical id : 0
siblings : 4
@@ -95,7 +96,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3240.926
cpu MHz : 3201.812
cache size : 512 KB
physical id : 0
siblings : 4
@@ -123,7 +124,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2445.430
cpu MHz : 2609.336
cache size : 512 KB
physical id : 0
siblings : 4
@@ -151,7 +152,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 2621.240
cpu MHz : 2445.431
cache size : 512 KB
physical id : 0
siblings : 4
@@ -218,53 +219,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 8149 MB
node 0 free: 8071 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373796 kB
MemFree: 8345272 kB
MemAvailable: 15379132 kB
Buffers: 175716 kB
Cached: 6809724 kB
MemFree: 8265368 kB
MemAvailable: 15329280 kB
Buffers: 176272 kB
Cached: 6838280 kB
SwapCached: 0 kB
Active: 1291436 kB
Inactive: 5989392 kB
Active(anon): 375676 kB
Active: 1329644 kB
Inactive: 6006680 kB
Active(anon): 402000 kB
Inactive(anon): 0 kB
Active(file): 915760 kB
Inactive(file): 5989392 kB
Active(file): 927644 kB
Inactive(file): 6006680 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 73296 kB
Dirty: 145756 kB
Writeback: 0 kB
AnonPages: 341336 kB
Mapped: 341240 kB
Shmem: 71536 kB
KReclaimable: 474620 kB
Slab: 572344 kB
SReclaimable: 474620 kB
SUnreclaim: 97724 kB
KernelStack: 4156 kB
PageTables: 6300 kB
AnonPages: 365928 kB
Mapped: 361424 kB
Shmem: 71476 kB
KReclaimable: 475500 kB
Slab: 573824 kB
SReclaimable: 475500 kB
SUnreclaim: 98324 kB
KernelStack: 4224 kB
PageTables: 6756 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2162520 kB
Committed_AS: 2403960 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 35248 kB
VmallocUsed: 35380 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 165888 kB
AnonHugePages: 137216 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +277,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 112576 kB
DirectMap2M: 3033088 kB
DirectMap1G: 15728640 kB
DirectMap4k: 110528 kB
DirectMap2M: 5132288 kB
DirectMap1G: 13631488 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-30 20:31
run-level 5 2025-01-31 09:57
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -808,16 +809,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 276074 268595 45 0 62581 0
fs.dentry-state = 276760 269212 45 0 62944 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1728 0 9223372036854775807
fs.inode-nr = 213454 568
fs.inode-state = 213454 568 0 0 0 0 0
fs.file-nr = 1792 0 9223372036854775807
fs.inode-nr = 213774 568
fs.inode-state = 213774 568 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +877,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1280-171
kernel.hostname = fv-az789-390
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +910,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 6664
kernel.ns_last_pid = 6732
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +943,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 926b9ce6-19db-44f0-b96f-ac3b1e885e1a
kernel.random.boot_id = b18b20bf-e361-4c2d-aff3-64a7111e2f2d
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = d2806b87-bd9c-4cad-871c-883d2b6eac32
kernel.random.uuid = 256e288f-7f7f-46a3-a8c1-e4475fb16255
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1360,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = 5000758b-bbb6f388-583f0011-fea0a06d
net.ipv4.tcp_fastopen_key = 07ba0956-83d6a54e-8d2b112a-c94a53a4
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1834,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 171
net.netfilter.nf_conntrack_count = 108
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -2056,24 +2057,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0005-3835-1202-5699-0112-09
UUID: aa13b64a-d50f-894a-8b99-944bdb1e6843
Serial Number: 0000-0010-7473-8315-1396-4711-96
UUID: 08602695-01bc-9c41-8ccb-d633337902c8
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0010-0592-3429-6228-3745-95
Serial Number: 0000-0010-1454-3810-0977-4189-52

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 5169-2808-5722-4117-7101-1237-39
Serial Number: 4008-0631-5716-3628-9830-1469-94
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
2 changes: 1 addition & 1 deletion ...ents/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|---------|------------|------------|--------------|-------------------|
| rgat | offline | 75.2 | 10.199 | - |
| rgat | offline | 74.8 | 9.995 | - |
6 changes: 3 additions & 3 deletions ...u-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/README.md
View file
Original file line number Diff line number Diff line change
@@ -16,7 +16,7 @@ pip install -U mlcflow

mlc rm cache -f

mlc pull repo anandhu-eng@mlperf-automations --checkout=366d64ecb1e59c584b00786c0a77d68550b7d310
mlc pull repo anandhu-eng@mlperf-automations --checkout=1f96d618bd4cf7b066754f916ae942de5b99ce3a


```
@@ -37,7 +37,7 @@ Platform: gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config
Model Precision: fp32

### Accuracy Results
`acc`: `75.2`, Required accuracy for closed division `>= 0.72131`
`acc`: `74.8`, Required accuracy for closed division `>= 0.72131`

### Performance Results
`Samples per second`: `10.1992`
`Samples per second`: `9.99473`
10 changes: 5 additions & 5 deletions ...-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/accuracy_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
INFO:main:Namespace(dataset='igbh-dgl-tiny', dataset_path='/home/runner/MLC/repos/local/cache/get-dataset-igbh_43f808e4', layout='COO', profile='debug-dgl', scenario='Offline', max_batchsize=1, threads=4, accuracy=True, find_peak_performance=False, backend='dgl', model_name='rgat', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_ef0ec58e/test_results/gh_ubuntu-latest_x86-reference-cpu-pytorch-v2.4.0-default_config/rgat/offline/accuracy', qps=None, model_path='/home/runner/MLC/repos/local/cache/download-file_79babd4e/RGAT/RGAT.pt', dtype='fp32', device='cpu', user_conf='/home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/1dc82411c6ea434d990d3edfeb3816a4.conf', audit_conf='audit.config', time=None, count=500, debug=False, performance_sample_count=5000, max_latency=None, samples_per_query=8)
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:231: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:206.)
INFO:main:Namespace(dataset='igbh-dgl-tiny', dataset_path='/home/runner/MLC/repos/local/cache/get-dataset-igbh_92121abb', layout='COO', profile='debug-dgl', scenario='Offline', max_batchsize=1, threads=4, accuracy=True, find_peak_performance=False, backend='dgl', model_name='rgat', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_292e922f/test_results/gh_ubuntu-latest_x86-reference-cpu-pytorch-v2.4.0-default_config/rgat/offline/accuracy', qps=None, model_path='/home/runner/MLC/repos/local/cache/download-file_1889c34a/RGAT/RGAT.pt', dtype='fp32', device='cpu', user_conf='/home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/67256ec64bfa4f91a30a8a2d968dd943.conf', audit_conf='audit.config', time=None, count=500, debug=False, performance_sample_count=5000, max_latency=None, samples_per_query=8)
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:231: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:206.)
return edge, torch.from_numpy(
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:312: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:312: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
torch.load(
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:318: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:318: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
torch.load(
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/backend_dgl.py:70: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/backend_dgl.py:70: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
ckpt = torch.load(ckpt_path, map_location=self.device)
INFO:main:starting TestScenario.Offline
50 changes: 25 additions & 25 deletions ...h_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/mlc-deps.mmd
View file

Large diffs are not rendered by default.

Binary file modified ...atest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/mlc-deps.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
50 changes: 25 additions & 25 deletions ...latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/mlc-version-info.json
View file
Original file line number Diff line number Diff line change
@@ -117,7 +117,7 @@
"script_tags": "detect-os,detect,os,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -137,7 +137,7 @@
"script_tags": "detect,cpu,detect-cpu,info",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -157,7 +157,7 @@
"script_tags": "get,python,python3,get-python,get-python3",
"script_variations": "",
"version": "3.12.8",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -227,7 +227,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "torch",
"version": "2.4.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -287,7 +287,7 @@
"script_tags": "get,raw,ml-model,rgat",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -527,7 +527,7 @@
"script_tags": "get,dataset,mlperf,rgat,igbh,inference",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -607,7 +607,7 @@
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -957,7 +957,7 @@
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
"script_variations": "",
"version": "master",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -967,7 +967,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "branch.dev",
"version": "r5.0-git-cdc1eafcfdc2f02748a3c62c1238ac2269ba06c8",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -977,7 +977,7 @@
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
"script_variations": "",
"version": "custom-git-cdc1eafcfdc2f02748a3c62c1238ac2269ba06c8",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1047,7 +1047,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.psutil",
"version": "6.1.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1067,7 +1067,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.colorama",
"version": "0.4.6",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1087,7 +1087,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.tqdm",
"version": "4.67.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1157,7 +1157,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.requests",
"version": "2.32.3",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1227,7 +1227,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.torchdata",
"version": "0.10.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1247,7 +1247,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.pybind11",
"version": "2.13.6",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1317,7 +1317,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.PyYAML",
"version": "6.0.2",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1387,7 +1387,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.numpy",
"version": "1.26.4",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1457,7 +1457,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.pydantic",
"version": "2.10.6",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1527,7 +1527,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.igb,url.git+https://github.com/IllinoisGraphBenchmark/IGB-Datasets.git",
"version": "0.1.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1597,7 +1597,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.torch-geometric,find_links_url.https://data.pyg.org/whl/torch-2.4.0+cpu.html",
"version": "2.6.1",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1667,7 +1667,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.torch-scatter,find_links_url.https://data.pyg.org/whl/torch-2.4.0+cpu.html",
"version": "2.1.2",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1737,7 +1737,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.torch-sparse,find_links_url.https://data.pyg.org/whl/torch-2.4.0+cpu.html",
"version": "0.6.18",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1807,7 +1807,7 @@
"script_tags": "get,install,generic,pip-package,generic-python-lib",
"script_variations": "package.dgl,find_links_url.https://data.dgl.ai/wheels/torch-2.4/repo.html",
"version": "2.4.0",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
},
{
@@ -1847,7 +1847,7 @@
"script_tags": "mlperf,benchmark-mlperf",
"script_variations": "",
"version": "",
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( rgat,_cpu,_offline,_pytorch,_fp32 )"
"parent": "app-mlperf-inference-mlcommons-python,ff149e9781fc4b65 ( cpu,_pytorch,_offline,_rgat,_fp32 )"
}
}
]
2 changes: 1 addition & 1 deletion ...h_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/os_info.json
View file
Original file line number Diff line number Diff line change
@@ -26,5 +26,5 @@
],
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
"MLC_HOST_PYTHON_BITS": "64",
"MLC_HOST_SYSTEM_NAME": "fv-az1779-710"
"MLC_HOST_SYSTEM_NAME": "fv-az1982-59"
}
10 changes: 5 additions & 5 deletions ...test_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/performance_console.out
View file
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
INFO:main:Namespace(dataset='igbh-dgl-tiny', dataset_path='/home/runner/MLC/repos/local/cache/get-dataset-igbh_43f808e4', layout='COO', profile='debug-dgl', scenario='Offline', max_batchsize=1, threads=4, accuracy=False, find_peak_performance=False, backend='dgl', model_name='rgat', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_ef0ec58e/test_results/gh_ubuntu-latest_x86-reference-cpu-pytorch-v2.4.0-default_config/rgat/offline/performance/run_1', qps=None, model_path='/home/runner/MLC/repos/local/cache/download-file_79babd4e/RGAT/RGAT.pt', dtype='fp32', device='cpu', user_conf='/home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/108a9ae2f84f42d5b12a130fe56d752c.conf', audit_conf='audit.config', time=None, count=None, debug=False, performance_sample_count=5000, max_latency=None, samples_per_query=8)
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:231: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:206.)
INFO:main:Namespace(dataset='igbh-dgl-tiny', dataset_path='/home/runner/MLC/repos/local/cache/get-dataset-igbh_92121abb', layout='COO', profile='debug-dgl', scenario='Offline', max_batchsize=1, threads=4, accuracy=False, find_peak_performance=False, backend='dgl', model_name='rgat', output='/home/runner/MLC/repos/local/cache/get-mlperf-inference-results-dir_292e922f/test_results/gh_ubuntu-latest_x86-reference-cpu-pytorch-v2.4.0-default_config/rgat/offline/performance/run_1', qps=None, model_path='/home/runner/MLC/repos/local/cache/download-file_1889c34a/RGAT/RGAT.pt', dtype='fp32', device='cpu', user_conf='/home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/a0d78dd04c8f47ebae79101e4d2f0e6b.conf', audit_conf='audit.config', time=None, count=None, debug=False, performance_sample_count=5000, max_latency=None, samples_per_query=8)
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:231: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:206.)
return edge, torch.from_numpy(
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:312: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:312: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
torch.load(
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:318: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/dgl_utilities/feature_fetching.py:318: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
torch.load(
DGL backend not selected or invalid. Assuming PyTorch for now.
/home/runner/MLC/repos/local/cache/get-git-repo_2fd30ee0/inference/graph/R-GAT/backend_dgl.py:70: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
/home/runner/MLC/repos/local/cache/get-git-repo_4248c027/inference/graph/R-GAT/backend_dgl.py:70: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
ckpt = torch.load(ckpt_path, map_location=self.device)
INFO:main:starting TestScenario.Offline
Setting the default backend to "pytorch". You can change it in the ~/.dgl/config.json file or export the DGLBACKEND environment variable. Valid options are: pytorch, mxnet, tensorflow (all lowercase)
118 changes: 59 additions & 59 deletions ...buntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1779-710 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az1982-59 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
07:03:30 up 7 min, 0 user, load average: 3.05, 1.33, 0.59
09:14:13 up 5 min, 0 user, load average: 2.25, 1.13, 0.49
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -45,7 +45,7 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-16*[{Runner.Worker}]
| | | `-17*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-14*[{provisioner}]
@@ -67,7 +67,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3242.728
cpu MHz : 2445.430
cache size : 512 KB
physical id : 0
siblings : 4
@@ -81,7 +81,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -95,7 +95,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3158.708
cpu MHz : 3244.927
cache size : 512 KB
physical id : 0
siblings : 4
@@ -109,7 +109,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -123,7 +123,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3241.473
cpu MHz : 3243.296
cache size : 512 KB
physical id : 0
siblings : 4
@@ -137,7 +137,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -151,7 +151,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3243.506
cpu MHz : 3112.880
cache size : 512 KB
physical id : 0
siblings : 4
@@ -165,7 +165,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -188,7 +188,7 @@ Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
@@ -218,53 +218,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 5453 MB
node 0 free: 5439 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373792 kB
MemFree: 5584220 kB
MemAvailable: 15371688 kB
Buffers: 190172 kB
Cached: 9446392 kB
MemTotal: 16373796 kB
MemFree: 5570092 kB
MemAvailable: 15359004 kB
Buffers: 190112 kB
Cached: 9447672 kB
SwapCached: 0 kB
Active: 1237460 kB
Inactive: 8696544 kB
Active(anon): 377276 kB
Active: 1236084 kB
Inactive: 8696668 kB
Active(anon): 374484 kB
Inactive(anon): 0 kB
Active(file): 860184 kB
Inactive(file): 8696544 kB
Active(file): 861600 kB
Inactive(file): 8696668 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 1216 kB
Dirty: 3924 kB
Writeback: 0 kB
AnonPages: 343024 kB
Mapped: 341588 kB
Shmem: 71084 kB
KReclaimable: 576652 kB
Slab: 688148 kB
SReclaimable: 576652 kB
SUnreclaim: 111496 kB
KernelStack: 3888 kB
PageTables: 6332 kB
AnonPages: 339652 kB
Mapped: 339900 kB
Shmem: 70764 kB
KReclaimable: 576556 kB
Slab: 688276 kB
SReclaimable: 576556 kB
SUnreclaim: 111720 kB
KernelStack: 3944 kB
PageTables: 6420 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2199180 kB
Committed_AS: 2202068 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 34992 kB
VmallocUsed: 35024 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 163840 kB
AnonHugePages: 157696 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +276,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 126912 kB
DirectMap2M: 4067328 kB
DirectMap4k: 120768 kB
DirectMap2M: 4073472 kB
DirectMap1G: 14680064 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-31 06:56
run-level 5 2025-01-31 09:08
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -732,7 +732,7 @@ xfs_scrub_all.timer disabled enabled
BOOT_IMAGE=/vmlinuz-6.8.0-1020-azure root=PARTUUID=8be7931c-8315-4344-95d4-bcbd379998fb ro console=tty1 console=ttyS0 earlyprintk=ttyS0 nvme_core.io_timeout=240 panic=-1
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 1:
analyzing CPU 2:
no or unknown cpufreq driver is active on this CPU
CPUs which run at the same hardware frequency: Not Available
CPUs which need to have their frequency coordinated by software: Not Available
@@ -808,16 +808,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 250178 242771 45 0 14820 0
fs.dentry-state = 250193 242789 45 0 14818 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1696 0 9223372036854775807
fs.inode-nr = 235344 568
fs.inode-state = 235344 568 0 0 0 0 0
fs.file-nr = 1664 0 9223372036854775807
fs.inode-nr = 235361 566
fs.inode-state = 235361 566 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +876,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1779-710
kernel.hostname = fv-az1982-59
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +909,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 8154
kernel.ns_last_pid = 8211
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +942,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 86c3f062-784b-45c8-b3cf-09bbb280e813
kernel.random.boot_id = 1f8d496f-b32f-437c-bf0c-040ce548c4f3
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 7b8ab1e3-81e1-43cb-b2f8-5ff472b1a214
kernel.random.uuid = 849debe1-ea43-4b80-b2cc-91407501de4f
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1359,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = e15f3eaa-36663d5e-4d80840b-1d5ef223
net.ipv4.tcp_fastopen_key = de108fe3-d77e1748-5c2c76ec-e942d108
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1833,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 120
net.netfilter.nf_conntrack_count = 152
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -1981,12 +1981,12 @@ LOGO=ubuntu-logo
19. Disk information
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 75G 0 disk
└─sda1 8:1 0 75G 0 part /mnt
├─sda1 8:1 0 74G 0 part /
├─sda14 8:14 0 4M 0 part
├─sda15 8:15 0 106M 0 part /boot/efi
└─sda16 259:0 0 913M 0 part /boot
sdb 8:16 0 75G 0 disk
├─sdb1 8:17 0 74G 0 part /
├─sdb14 8:30 0 4M 0 part
├─sdb15 8:31 0 106M 0 part /boot/efi
└─sdb16 259:0 0 913M 0 part /boot
└─sdb1 8:17 0 75G 0 part /mnt
------------------------------------------------------------
20. /sys/devices/virtual/dmi/id
bios_date
@@ -2056,24 +2056,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0007-8594-0974-9864-8924-88
UUID: 863b126d-f0cc-4848-bd14-93545148dde3
Serial Number: 0000-0003-8796-8978-7049-7233-73
UUID: 4e6dd735-cf4b-ed45-98f5-ddb3d8fd272a
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0013-6246-7676-3052-8588-51
Serial Number: 0000-0011-0219-5942-7568-5107-62

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 5139-5942-7520-7050-8982-0898-04
Serial Number: 2823-1872-0663-3618-1429-5535-00
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
118 changes: 59 additions & 59 deletions ...nts/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1779-710 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az1982-59 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
07:03:30 up 7 min, 0 user, load average: 3.05, 1.33, 0.59
09:14:13 up 5 min, 0 user, load average: 2.25, 1.13, 0.49
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -45,7 +45,7 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-16*[{Runner.Worker}]
| | | `-17*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-14*[{provisioner}]
@@ -67,7 +67,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3242.728
cpu MHz : 2445.430
cache size : 512 KB
physical id : 0
siblings : 4
@@ -81,7 +81,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -95,7 +95,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3158.708
cpu MHz : 3244.927
cache size : 512 KB
physical id : 0
siblings : 4
@@ -109,7 +109,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -123,7 +123,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3241.473
cpu MHz : 3243.296
cache size : 512 KB
physical id : 0
siblings : 4
@@ -137,7 +137,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -151,7 +151,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3243.506
cpu MHz : 3112.880
cache size : 512 KB
physical id : 0
siblings : 4
@@ -165,7 +165,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -188,7 +188,7 @@ Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
@@ -218,53 +218,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 5453 MB
node 0 free: 5439 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373792 kB
MemFree: 5584220 kB
MemAvailable: 15371688 kB
Buffers: 190172 kB
Cached: 9446392 kB
MemTotal: 16373796 kB
MemFree: 5570092 kB
MemAvailable: 15359004 kB
Buffers: 190112 kB
Cached: 9447672 kB
SwapCached: 0 kB
Active: 1237460 kB
Inactive: 8696544 kB
Active(anon): 377276 kB
Active: 1236084 kB
Inactive: 8696668 kB
Active(anon): 374484 kB
Inactive(anon): 0 kB
Active(file): 860184 kB
Inactive(file): 8696544 kB
Active(file): 861600 kB
Inactive(file): 8696668 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 1216 kB
Dirty: 3924 kB
Writeback: 0 kB
AnonPages: 343024 kB
Mapped: 341588 kB
Shmem: 71084 kB
KReclaimable: 576652 kB
Slab: 688148 kB
SReclaimable: 576652 kB
SUnreclaim: 111496 kB
KernelStack: 3888 kB
PageTables: 6332 kB
AnonPages: 339652 kB
Mapped: 339900 kB
Shmem: 70764 kB
KReclaimable: 576556 kB
Slab: 688276 kB
SReclaimable: 576556 kB
SUnreclaim: 111720 kB
KernelStack: 3944 kB
PageTables: 6420 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2199180 kB
Committed_AS: 2202068 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 34992 kB
VmallocUsed: 35024 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 163840 kB
AnonHugePages: 157696 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +276,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 126912 kB
DirectMap2M: 4067328 kB
DirectMap4k: 120768 kB
DirectMap2M: 4073472 kB
DirectMap1G: 14680064 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-31 06:56
run-level 5 2025-01-31 09:08
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -732,7 +732,7 @@ xfs_scrub_all.timer disabled enabled
BOOT_IMAGE=/vmlinuz-6.8.0-1020-azure root=PARTUUID=8be7931c-8315-4344-95d4-bcbd379998fb ro console=tty1 console=ttyS0 earlyprintk=ttyS0 nvme_core.io_timeout=240 panic=-1
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 1:
analyzing CPU 2:
no or unknown cpufreq driver is active on this CPU
CPUs which run at the same hardware frequency: Not Available
CPUs which need to have their frequency coordinated by software: Not Available
@@ -808,16 +808,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 250178 242771 45 0 14820 0
fs.dentry-state = 250193 242789 45 0 14818 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1696 0 9223372036854775807
fs.inode-nr = 235344 568
fs.inode-state = 235344 568 0 0 0 0 0
fs.file-nr = 1664 0 9223372036854775807
fs.inode-nr = 235361 566
fs.inode-state = 235361 566 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +876,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1779-710
kernel.hostname = fv-az1982-59
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +909,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 8154
kernel.ns_last_pid = 8211
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +942,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 86c3f062-784b-45c8-b3cf-09bbb280e813
kernel.random.boot_id = 1f8d496f-b32f-437c-bf0c-040ce548c4f3
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 7b8ab1e3-81e1-43cb-b2f8-5ff472b1a214
kernel.random.uuid = 849debe1-ea43-4b80-b2cc-91407501de4f
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1359,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = e15f3eaa-36663d5e-4d80840b-1d5ef223
net.ipv4.tcp_fastopen_key = de108fe3-d77e1748-5c2c76ec-e942d108
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1833,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 120
net.netfilter.nf_conntrack_count = 152
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -1981,12 +1981,12 @@ LOGO=ubuntu-logo
19. Disk information
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 75G 0 disk
└─sda1 8:1 0 75G 0 part /mnt
├─sda1 8:1 0 74G 0 part /
├─sda14 8:14 0 4M 0 part
├─sda15 8:15 0 106M 0 part /boot/efi
└─sda16 259:0 0 913M 0 part /boot
sdb 8:16 0 75G 0 disk
├─sdb1 8:17 0 74G 0 part /
├─sdb14 8:30 0 4M 0 part
├─sdb15 8:31 0 106M 0 part /boot/efi
└─sdb16 259:0 0 913M 0 part /boot
└─sdb1 8:17 0 75G 0 part /mnt
------------------------------------------------------------
20. /sys/devices/virtual/dmi/id
bios_date
@@ -2056,24 +2056,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0007-8594-0974-9864-8924-88
UUID: 863b126d-f0cc-4848-bd14-93545148dde3
Serial Number: 0000-0003-8796-8978-7049-7233-73
UUID: 4e6dd735-cf4b-ed45-98f5-ddb3d8fd272a
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0013-6246-7676-3052-8588-51
Serial Number: 0000-0011-0219-5942-7568-5107-62

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 5139-5942-7520-7050-8982-0898-04
Serial Number: 2823-1872-0663-3618-1429-5535-00
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
118 changes: 59 additions & 59 deletions ...urements/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/system_info.txt
View file
Original file line number Diff line number Diff line change
@@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux fv-az1779-710 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Linux fv-az1982-59 6.8.0-1020-azure #23-Ubuntu SMP Mon Dec 9 16:58:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
07:03:30 up 7 min, 0 user, load average: 3.05, 1.33, 0.59
09:14:13 up 5 min, 0 user, load average: 2.25, 1.13, 0.49
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
@@ -45,7 +45,7 @@ systemd-+-ModemManager---3*[{ModemManager}]
|-php-fpm8.3---2*[php-fpm8.3]
|-polkitd---3*[{polkitd}]
|-provisioner-+-Runner.Listener-+-Runner.Worker-+-bash---mlcr---sh---bash---pstree
| | | `-16*[{Runner.Worker}]
| | | `-17*[{Runner.Worker}]
| | `-14*[{Runner.Listener}]
| |-provjobd---9*[{provjobd}]
| `-14*[{provisioner}]
@@ -67,7 +67,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3242.728
cpu MHz : 2445.430
cache size : 512 KB
physical id : 0
siblings : 4
@@ -81,7 +81,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -95,7 +95,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3158.708
cpu MHz : 3244.927
cache size : 512 KB
physical id : 0
siblings : 4
@@ -109,7 +109,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -123,7 +123,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3241.473
cpu MHz : 3243.296
cache size : 512 KB
physical id : 0
siblings : 4
@@ -137,7 +137,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -151,7 +151,7 @@ model : 1
model name : AMD EPYC 7763 64-Core Processor
stepping : 1
microcode : 0xffffffff
cpu MHz : 3243.506
cpu MHz : 3112.880
cache size : 512 KB
physical id : 0
siblings : 4
@@ -165,7 +165,7 @@ cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
bugs : sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass srso
bogomips : 4890.85
bogomips : 4890.86
TLB size : 2560 4K pages
clflush size : 64
cache_alignment : 64
@@ -188,7 +188,7 @@ Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
@@ -218,53 +218,53 @@ Vulnerability Tsx async abort: Not affected
available: 1 nodes (0)
node 0 cpus: 0 1 2 3
node 0 size: 15990 MB
node 0 free: 5453 MB
node 0 free: 5439 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 16373792 kB
MemFree: 5584220 kB
MemAvailable: 15371688 kB
Buffers: 190172 kB
Cached: 9446392 kB
MemTotal: 16373796 kB
MemFree: 5570092 kB
MemAvailable: 15359004 kB
Buffers: 190112 kB
Cached: 9447672 kB
SwapCached: 0 kB
Active: 1237460 kB
Inactive: 8696544 kB
Active(anon): 377276 kB
Active: 1236084 kB
Inactive: 8696668 kB
Active(anon): 374484 kB
Inactive(anon): 0 kB
Active(file): 860184 kB
Inactive(file): 8696544 kB
Active(file): 861600 kB
Inactive(file): 8696668 kB
Unevictable: 46772 kB
Mlocked: 43700 kB
SwapTotal: 4194300 kB
SwapFree: 4194300 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 1216 kB
Dirty: 3924 kB
Writeback: 0 kB
AnonPages: 343024 kB
Mapped: 341588 kB
Shmem: 71084 kB
KReclaimable: 576652 kB
Slab: 688148 kB
SReclaimable: 576652 kB
SUnreclaim: 111496 kB
KernelStack: 3888 kB
PageTables: 6332 kB
AnonPages: 339652 kB
Mapped: 339900 kB
Shmem: 70764 kB
KReclaimable: 576556 kB
Slab: 688276 kB
SReclaimable: 576556 kB
SUnreclaim: 111720 kB
KernelStack: 3944 kB
PageTables: 6420 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 12381196 kB
Committed_AS: 2199180 kB
Committed_AS: 2202068 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 34992 kB
VmallocUsed: 35024 kB
VmallocChunk: 0 kB
Percpu: 2208 kB
HardwareCorrupted: 0 kB
AnonHugePages: 163840 kB
AnonHugePages: 157696 kB
ShmemHugePages: 0 kB
ShmemPmdMapped: 0 kB
FileHugePages: 0 kB
@@ -276,12 +276,12 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 126912 kB
DirectMap2M: 4067328 kB
DirectMap4k: 120768 kB
DirectMap2M: 4073472 kB
DirectMap1G: 14680064 kB
------------------------------------------------------------
10. who -r
run-level 5 2025-01-31 06:56
run-level 5 2025-01-31 09:08
------------------------------------------------------------
11. Systemd service manager version
systemd 255 (255.4-1ubuntu8.4)
@@ -732,7 +732,7 @@ xfs_scrub_all.timer disabled enabled
BOOT_IMAGE=/vmlinuz-6.8.0-1020-azure root=PARTUUID=8be7931c-8315-4344-95d4-bcbd379998fb ro console=tty1 console=ttyS0 earlyprintk=ttyS0 nvme_core.io_timeout=240 panic=-1
------------------------------------------------------------
14. cpupower frequency-info
analyzing CPU 1:
analyzing CPU 2:
no or unknown cpufreq driver is active on this CPU
CPUs which run at the same hardware frequency: Not Available
CPUs which need to have their frequency coordinated by software: Not Available
@@ -808,16 +808,16 @@ fs.binfmt_misc.llvm-16-runtime/binfmt = flags:
fs.binfmt_misc.llvm-16-runtime/binfmt = offset 0
fs.binfmt_misc.llvm-16-runtime/binfmt = magic 4243
fs.binfmt_misc.status = enabled
fs.dentry-state = 250178 242771 45 0 14820 0
fs.dentry-state = 250193 242789 45 0 14818 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 3643703
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 132601
fs.file-max = 9223372036854775807
fs.file-nr = 1696 0 9223372036854775807
fs.inode-nr = 235344 568
fs.inode-state = 235344 568 0 0 0 0 0
fs.file-nr = 1664 0 9223372036854775807
fs.inode-nr = 235361 566
fs.inode-state = 235361 566 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 1280
fs.inotify.max_user_watches = 655360
@@ -876,7 +876,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = fv-az1779-710
kernel.hostname = fv-az1982-59
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
@@ -909,7 +909,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 0
kernel.ns_last_pid = 8154
kernel.ns_last_pid = 8211
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
@@ -942,11 +942,11 @@ kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 0
kernel.pty.reserve = 1024
kernel.random.boot_id = 86c3f062-784b-45c8-b3cf-09bbb280e813
kernel.random.boot_id = 1f8d496f-b32f-437c-bf0c-040ce548c4f3
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 7b8ab1e3-81e1-43cb-b2f8-5ff472b1a214
kernel.random.uuid = 849debe1-ea43-4b80-b2cc-91407501de4f
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
@@ -1359,7 +1359,7 @@ net.ipv4.tcp_ehash_entries = 131072
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 0
net.ipv4.tcp_fastopen_key = e15f3eaa-36663d5e-4d80840b-1d5ef223
net.ipv4.tcp_fastopen_key = de108fe3-d77e1748-5c2c76ec-e942d108
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
@@ -1833,7 +1833,7 @@ net.mptcp.stale_loss_cnt = 4
net.netfilter.nf_conntrack_acct = 0
net.netfilter.nf_conntrack_buckets = 262144
net.netfilter.nf_conntrack_checksum = 1
net.netfilter.nf_conntrack_count = 120
net.netfilter.nf_conntrack_count = 152
net.netfilter.nf_conntrack_dccp_loose = 1
net.netfilter.nf_conntrack_dccp_timeout_closereq = 64
net.netfilter.nf_conntrack_dccp_timeout_closing = 64
@@ -1981,12 +1981,12 @@ LOGO=ubuntu-logo
19. Disk information
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 75G 0 disk
└─sda1 8:1 0 75G 0 part /mnt
├─sda1 8:1 0 74G 0 part /
├─sda14 8:14 0 4M 0 part
├─sda15 8:15 0 106M 0 part /boot/efi
└─sda16 259:0 0 913M 0 part /boot
sdb 8:16 0 75G 0 disk
├─sdb1 8:17 0 74G 0 part /
├─sdb14 8:30 0 4M 0 part
├─sdb15 8:31 0 106M 0 part /boot/efi
└─sdb16 259:0 0 913M 0 part /boot
└─sdb1 8:17 0 75G 0 part /mnt
------------------------------------------------------------
20. /sys/devices/virtual/dmi/id
bios_date
@@ -2056,24 +2056,24 @@ System Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0007-8594-0974-9864-8924-88
UUID: 863b126d-f0cc-4848-bd14-93545148dde3
Serial Number: 0000-0003-8796-8978-7049-7233-73
UUID: 4e6dd735-cf4b-ed45-98f5-ddb3d8fd272a
Wake-up Type: Power Switch

Handle 0x0002, DMI type 2, 8 bytes
Base Board Information
Manufacturer: Microsoft Corporation
Product Name: Virtual Machine
Version: 7.0
Serial Number: 0000-0013-6246-7676-3052-8588-51
Serial Number: 0000-0011-0219-5942-7568-5107-62

Handle 0x0003, DMI type 3, 17 bytes
Chassis Information
Manufacturer: Microsoft Corporation
Type: Desktop
Lock: Not Present
Version: 7.0
Serial Number: 5139-5942-7520-7050-8982-0898-04
Serial Number: 2823-1872-0663-3618-1429-5535-00
Asset Tag: 7783-7084-3265-9085-8269-3286-77
Boot-up State: Safe
Power Supply State: Safe
142 changes: 71 additions & 71 deletions ...mmons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

176 changes: 88 additions & 88 deletions ...-cpu-onnxruntime-default_config/retinanet/offline/performance/run_1/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

20 changes: 10 additions & 10 deletions ...cpu-onnxruntime-default_config/retinanet/offline/performance/run_1/mlperf_log_summary.txt
View file
Original file line number Diff line number Diff line change
@@ -4,7 +4,7 @@ MLPerf Results Summary
SUT name : QueueSUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 0.42546
Samples per second: 0.425185
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -13,15 +13,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 2372264362
Max latency (ns) : 11751990518
Mean latency (ns) : 7077321447
50.00 percentile latency (ns) : 7076274137
90.00 percentile latency (ns) : 11751990518
95.00 percentile latency (ns) : 11751990518
97.00 percentile latency (ns) : 11751990518
99.00 percentile latency (ns) : 11751990518
99.90 percentile latency (ns) : 11751990518
Min latency (ns) : 2349515175
Max latency (ns) : 11759590308
Mean latency (ns) : 7078264752
50.00 percentile latency (ns) : 7106866703
90.00 percentile latency (ns) : 11759590308
95.00 percentile latency (ns) : 11759590308
97.00 percentile latency (ns) : 11759590308
99.00 percentile latency (ns) : 11759590308
99.90 percentile latency (ns) : 11759590308

================================================
Test Parameters Used
2 changes: 1 addition & 1 deletion ...6-reference-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/accuracy/accuracy.txt
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
accuracy=76.000%, good=380, total=500

hash=85f2a8434e74092206ea2a2008fc008a37703af14d4e5b3839003d315b266495
hash=9c40e1a3c0c1624da382955cba3ed8cb6e3337427f4a2d5351f706fc15fd4bd5
132 changes: 66 additions & 66 deletions ...cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,36 @@
[
{ "seq_id" : 64, "qsl_idx" : 478, "data" : "00C05A44" },
{ "seq_id" : 65, "qsl_idx" : 466, "data" : "00800844" },
{ "seq_id" : 66, "qsl_idx" : 138, "data" : "00C07144" },
{ "seq_id" : 67, "qsl_idx" : 291, "data" : "00005644" },
{ "seq_id" : 68, "qsl_idx" : 280, "data" : "00001944" },
{ "seq_id" : 69, "qsl_idx" : 116, "data" : "00801F44" },
{ "seq_id" : 70, "qsl_idx" : 253, "data" : "00002544" },
{ "seq_id" : 71, "qsl_idx" : 161, "data" : "00805F44" },
{ "seq_id" : 72, "qsl_idx" : 164, "data" : "00406A44" },
{ "seq_id" : 73, "qsl_idx" : 361, "data" : "00001442" },
{ "seq_id" : 74, "qsl_idx" : 72, "data" : "0000A841" },
{ "seq_id" : 75, "qsl_idx" : 111, "data" : "00806E44" },
{ "seq_id" : 76, "qsl_idx" : 268, "data" : "00808043" },
{ "seq_id" : 77, "qsl_idx" : 346, "data" : "0000EC43" },
{ "seq_id" : 78, "qsl_idx" : 254, "data" : "00C07544" },
{ "seq_id" : 79, "qsl_idx" : 283, "data" : "00405C44" },
{ "seq_id" : 80, "qsl_idx" : 255, "data" : "00400544" },
{ "seq_id" : 81, "qsl_idx" : 91, "data" : "0000C043" },
{ "seq_id" : 82, "qsl_idx" : 178, "data" : "0080A943" },
{ "seq_id" : 83, "qsl_idx" : 329, "data" : "00400344" },
{ "seq_id" : 84, "qsl_idx" : 133, "data" : "00006A43" },
{ "seq_id" : 85, "qsl_idx" : 433, "data" : "00C02844" },
{ "seq_id" : 86, "qsl_idx" : 276, "data" : "0000E843" },
{ "seq_id" : 87, "qsl_idx" : 183, "data" : "0080DE43" },
{ "seq_id" : 88, "qsl_idx" : 199, "data" : "00407844" },
{ "seq_id" : 89, "qsl_idx" : 491, "data" : "0000A041" },
{ "seq_id" : 90, "qsl_idx" : 369, "data" : "0000B642" },
{ "seq_id" : 91, "qsl_idx" : 443, "data" : "0000AF43" },
{ "seq_id" : 92, "qsl_idx" : 21, "data" : "00003043" },
{ "seq_id" : 93, "qsl_idx" : 174, "data" : "0000DA43" },
{ "seq_id" : 94, "qsl_idx" : 307, "data" : "00C01744" },
{ "seq_id" : 95, "qsl_idx" : 127, "data" : "0000A841" },
{ "seq_id" : 32, "qsl_idx" : 399, "data" : "00C07044" },
{ "seq_id" : 33, "qsl_idx" : 464, "data" : "00003244" },
{ "seq_id" : 34, "qsl_idx" : 187, "data" : "00008843" },
@@ -39,81 +71,49 @@
{ "seq_id" : 5, "qsl_idx" : 112, "data" : "00006343" },
{ "seq_id" : 6, "qsl_idx" : 240, "data" : "00000544" },
{ "seq_id" : 7, "qsl_idx" : 386, "data" : "00002644" },
{ "seq_id" : 8, "qsl_idx" : 159, "data" : "00802144" },
{ "seq_id" : 9, "qsl_idx" : 379, "data" : "00807544" },
{ "seq_id" : 10, "qsl_idx" : 33, "data" : "00407544" },
{ "seq_id" : 11, "qsl_idx" : 51, "data" : "0000E841" },
{ "seq_id" : 12, "qsl_idx" : 73, "data" : "0000EE43" },
{ "seq_id" : 13, "qsl_idx" : 6, "data" : "0000A743" },
{ "seq_id" : 14, "qsl_idx" : 368, "data" : "00003A44" },
{ "seq_id" : 15, "qsl_idx" : 337, "data" : "00402C44" },
{ "seq_id" : 16, "qsl_idx" : 4, "data" : "00000144" },
{ "seq_id" : 17, "qsl_idx" : 200, "data" : "00003044" },
{ "seq_id" : 18, "qsl_idx" : 281, "data" : "00801844" },
{ "seq_id" : 19, "qsl_idx" : 194, "data" : "0000EC42" },
{ "seq_id" : 20, "qsl_idx" : 213, "data" : "00807444" },
{ "seq_id" : 21, "qsl_idx" : 401, "data" : "00C05944" },
{ "seq_id" : 22, "qsl_idx" : 385, "data" : "0000D642" },
{ "seq_id" : 23, "qsl_idx" : 132, "data" : "00008A43" },
{ "seq_id" : 24, "qsl_idx" : 387, "data" : "0000D243" },
{ "seq_id" : 25, "qsl_idx" : 441, "data" : "00C03644" },
{ "seq_id" : 26, "qsl_idx" : 489, "data" : "00C06444" },
{ "seq_id" : 27, "qsl_idx" : 256, "data" : "00801344" },
{ "seq_id" : 28, "qsl_idx" : 104, "data" : "00004943" },
{ "seq_id" : 29, "qsl_idx" : 471, "data" : "00407844" },
{ "seq_id" : 30, "qsl_idx" : 432, "data" : "00003B44" },
{ "seq_id" : 31, "qsl_idx" : 333, "data" : "00001A44" },
{ "seq_id" : 96, "qsl_idx" : 274, "data" : "00403E44" },
{ "seq_id" : 97, "qsl_idx" : 347, "data" : "00809243" },
{ "seq_id" : 98, "qsl_idx" : 293, "data" : "00805844" },
{ "seq_id" : 99, "qsl_idx" : 405, "data" : "00C06944" },
{ "seq_id" : 100, "qsl_idx" : 485, "data" : "0000BA43" },
{ "seq_id" : 101, "qsl_idx" : 336, "data" : "00007842" },
{ "seq_id" : 102, "qsl_idx" : 13, "data" : "00403D44" },
{ "seq_id" : 103, "qsl_idx" : 177, "data" : "00007843" },
{ "seq_id"
{ "seq_

...

"seq_id" : 397, "qsl_idx" : 198, "data" : "00000944" },
{ "seq_id" : 398, "qsl_idx" : 168, "data" : "00C01144" },
{ "seq_id" : 399, "qsl_idx" : 106, "data" : "00008C42" },
{ "seq_id" : 400, "qsl_idx" : 415, "data" : "00005644" },
{ "seq_id" : 401, "qsl_idx" : 313, "data" : "00002444" },
{ "seq_id" : 402, "qsl_idx" : 413, "data" : "00006041" },
{ "seq_id" : 403, "qsl_idx" : 350, "data" : "00406244" },
{ "seq_id" : 404, "qsl_idx" : 249, "data" : "00805F44" },
{ "seq_id" : 405, "qsl_idx" : 402, "data" : "0000FF43" },
{ "seq_id" : 406, "qsl_idx" : 58, "data" : "00005244" },
{ "seq_id" : 407, "qsl_idx" : 54, "data" : "0080B343" },
{ "seq_id" : 408, "qsl_idx" : 158, "data" : "00C01044" },
{ "seq_id" : 409, "qsl_idx" : 406, "data" : "00009B43" },
{ "seq_id" : 410, "qsl_idx" : 278, "data" : "00001B43" },
{ "seq_id" : 411, "qsl_idx" : 223, "data" : "00004F43" },
{ "seq_id" : 412, "qsl_idx" : 426, "data" : "00805344" },
{ "seq_id" : 413, "qsl_idx" : 201, "data" : "0080E443" },
{ "seq_id" : 414, "qsl_idx" : 404, "data" : "00003143" },
{ "seq_id" : 415, "qsl_idx" : 316, "data" : "00801644" },
{ "seq_id" : 480, "qsl_idx" : 438, "data" : "00008041" },
{ "seq_id" : 481, "qsl_idx" : 121, "data" : "0080F143" },
{ "seq_id" : 482, "qsl_idx" : 82, "data" : "00004544" },
{ "seq_id" : 483, "qsl_idx" : 373, "data" : "00800844" },
{ "seq_id" : 484, "qsl_idx" : 89, "data" : "00004842" },
{ "seq_id" : 485, "qsl_idx" : 244, "data" : "0000FA42" },
{ "seq_id" : 486, "qsl_idx" : 494, "data" : "0000BC43" },
{ "seq_id" : 487, "qsl_idx" : 80, "data" : "00807244" },
{ "seq_id" : 488, "qsl_idx" : 315, "data" : "0000C343" },
{ "seq_id" : 489, "qsl_idx" : 480, "data" : "0000C243" },
{ "seq_id" : 490, "qsl_idx" : 96, "data" : "0000A543" },
{ "seq_id" : 491, "qsl_idx" : 45, "data" : "00C06044" },
{ "seq_id" : 492, "qsl_idx" : 483, "data" : "00807944" },
{ "seq_id" : 493, "qsl_idx" : 90, "data" : "00008743" },
"seq_id" : 493, "qsl_idx" : 90, "data" : "00008743" },
{ "seq_id" : 494, "qsl_idx" : 419, "data" : "0000B842" },
{ "seq_id" : 495, "qsl_idx" : 153, "data" : "0000E642" },
{ "seq_id" : 496, "qsl_idx" : 59, "data" : "00001344" },
{ "seq_id" : 497, "qsl_idx" : 331, "data" : "00806A44" },
{ "seq_id" : 498, "qsl_idx" : 209, "data" : "0080D743" },
{ "seq_id" : 499, "qsl_idx" : 19, "data" : "00400144" },
{ "seq_id" : 416, "qsl_idx" : 411, "data" : "00807944" },
{ "seq_id" : 417, "qsl_idx" : 131, "data" : "00400A44" },
{ "seq_id" : 418, "qsl_idx" : 22, "data" : "00006D44" },
{ "seq_id" : 419, "qsl_idx" : 32, "data" : "00001643" },
{ "seq_id" : 420, "qsl_idx" : 497, "data" : "0000D041" },
{ "seq_id" : 421, "qsl_idx" : 266, "data" : "00C06F44" },
{ "seq_id" : 422, "qsl_idx" : 181, "data" : "00406344" },
{ "seq_id" : 423, "qsl_idx" : 31, "data" : "00400F44" },
{ "seq_id" : 424, "qsl_idx" : 319, "data" : "00806E44" },
{ "seq_id" : 425, "qsl_idx" : 229, "data" : "00403944" },
{ "seq_id" : 426, "qsl_idx" : 214, "data" : "0080ED43" },
{ "seq_id" : 427, "qsl_idx" : 424, "data" : "00008543" },
{ "seq_id" : 428, "qsl_idx" : 216, "data" : "00008041" },
{ "seq_id" : 429, "qsl_idx" : 344, "data" : "00403A44" },
{ "seq_id" : 430, "qsl_idx" : 412, "data" : "00005144" },
{ "seq_id" : 431, "qsl_idx" : 237, "data" : "0000F242" },
{ "seq_id" : 432, "qsl_idx" : 476, "data" : "00001244" },
{ "seq_id" : 433, "qsl_idx" : 18, "data" : "0000EF43" },
{ "seq_id" : 434, "qsl_idx" : 115, "data" : "00C06F44" },
{ "seq_id" : 435, "qsl_idx" : 11, "data" : "00008F43" },
{ "seq_id" : 436, "qsl_idx" : 339, "data" : "0000BE43" },
{ "seq_id" : 437, "qsl_idx" : 323, "data" : "00008242" },
{ "seq_id" : 438, "qsl_idx" : 388, "data" : "00000443" },
{ "seq_id" : 439, "qsl_idx" : 184, "data" : "00C01C44" },
{ "seq_id" : 440, "qsl_idx" : 67, "data" : "00C05D44" },
{ "seq_id" : 441, "qsl_idx" : 147, "data" : "00802B44" },
{ "seq_id" : 442, "qsl_idx" : 68, "data" : "00805944" },
{ "seq_id" : 443, "qsl_idx" : 105, "data" : "00806244" },
{ "seq_id" : 444, "qsl_idx" : 211, "data" : "00405E44" },
{ "seq_id" : 445, "qsl_idx" : 420, "data" : "00403F44" },
{ "seq_id" : 446, "qsl_idx" : 238, "data" : "00005B44" },
{ "seq_id" : 447, "qsl_idx" : 108, "data" : "00001E44" },
{ "seq_id" : 448, "qsl_idx" : 61, "data" : "00808543" },
{ "seq_id" : 449, "qsl_idx" : 235, "data" : "0000E642" },
{ "seq_id" : 450, "qsl_idx" : 322, "data" : "00008C43" },
140 changes: 70 additions & 70 deletions ...ce-cpu-onnxruntime_v1.20.1-default_config/resnet50/offline/accuracy/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

174 changes: 87 additions & 87 deletions ...nxruntime_v1.20.1-default_config/resnet50/offline/performance/run_1/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

20 changes: 10 additions & 10 deletions ...xruntime_v1.20.1-default_config/resnet50/offline/performance/run_1/mlperf_log_summary.txt
View file
Original file line number Diff line number Diff line change
@@ -4,7 +4,7 @@ MLPerf Results Summary
SUT name : PySUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 23.163
Samples per second: 23.1692
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -13,15 +13,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 5044900341
Max latency (ns) : 21586110482
Mean latency (ns) : 13454352963
50.00 percentile latency (ns) : 11759457458
90.00 percentile latency (ns) : 21302756664
95.00 percentile latency (ns) : 21586110482
97.00 percentile latency (ns) : 21586110482
99.00 percentile latency (ns) : 21586110482
99.90 percentile latency (ns) : 21586110482
Min latency (ns) : 5208782284
Max latency (ns) : 21580389056
Mean latency (ns) : 13437218894
50.00 percentile latency (ns) : 11514834655
90.00 percentile latency (ns) : 21463501782
95.00 percentile latency (ns) : 21580389056
97.00 percentile latency (ns) : 21580389056
99.00 percentile latency (ns) : 21580389056
99.90 percentile latency (ns) : 21580389056

================================================
Test Parameters Used
4 changes: 2 additions & 2 deletions ...latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/accuracy/accuracy.txt
View file
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
accuracy=75.200%, good=376, total=500
hash=860352bb233206fea1c48f25756460b160646446851c58b0812c9dbaa4ff54a6
accuracy=74.800%, good=374, total=500
hash=2e31342aa0323df39ac35203de793ab0df8a160e10e8f6b5d203ffff279a931e
70 changes: 35 additions & 35 deletions ...eference-cpu-pytorch_v2.4.0-default_config/rgat/offline/accuracy/mlperf_log_accuracy.json
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[
{ "seq_id" : 3, "qsl_idx" : 154, "data" : "03" },
{ "seq_id" : 1, "qsl_idx" : 224, "data" : "41" },
{ "seq_id" : 3, "qsl_idx" : 154, "data" : "03" },
{ "seq_id" : 2, "qsl_idx" : 289, "data" : "03" },
{ "seq_id" : 0, "qsl_idx" : 465, "data" : "11" },
{ "seq_id" : 4, "qsl_idx" : 47, "data" : "03" },
@@ -9,8 +9,8 @@
{ "seq_id" : 7, "qsl_idx" : 386, "data" : "20" },
{ "seq_id" : 8, "qsl_idx" : 159, "data" : "02" },
{ "seq_id" : 9, "qsl_idx" : 379, "data" : "03" },
{ "seq_id" : 10, "qsl_idx" : 33, "data" : "11" },
{ "seq_id" : 11, "qsl_idx" : 51, "data" : "07" },
{ "seq_id" : 10, "qsl_idx" : 33, "data" : "11" },
{ "seq_id" : 12, "qsl_idx" : 73, "data" : "03" },
{ "seq_id" : 13, "qsl_idx" : 6, "data" : "03" },
{ "seq_id" : 14, "qsl_idx" : 368, "data" : "0B" },
@@ -19,8 +19,8 @@
{ "seq_id" : 16, "qsl_idx" : 4, "data" : "03" },
{ "seq_id" : 18, "qsl_idx" : 281, "data" : "0A" },
{ "seq_id" : 19, "qsl_idx" : 194, "data" : "11" },
{ "seq_id" : 20, "qsl_idx" : 213, "data" : "08" },
{ "seq_id" : 21, "qsl_idx" : 401, "data" : "0D" },
{ "seq_id" : 20, "qsl_idx" : 213, "data" : "08" },
{ "seq_id" : 22, "qsl_idx" : 385, "data" : "03" },
{ "seq_id" : 23, "qsl_idx" : 132, "data" : "0B" },
{ "seq_id" : 24, "qsl_idx" : 387, "data" : "03" },
@@ -29,26 +29,26 @@
{ "seq_id" : 26, "qsl_idx" : 489, "data" : "11" },
{ "seq_id" : 28, "qsl_idx" : 104, "data" : "08" },
{ "seq_id" : 29, "qsl_idx" : 471, "data" : "0E" },
{ "seq_id" : 31, "qsl_idx" : 333, "data" : "02" },
{ "seq_id" : 30, "qsl_idx" : 432, "data" : "11" },
{ "seq_id" : 31, "qsl_idx" : 333, "data" : "02" },
{ "seq_id" : 32, "qsl_idx" : 399, "data" : "08" },
{ "seq_id" : 33, "qsl_idx" : 464, "data" : "03" },
{ "seq_id" : 35, "qsl_idx" : 152, "data" : "11" },
{ "seq_id" : 34, "qsl_idx" : 187, "data" : "11" },
{ "seq_id" : 36, "qsl_idx" : 421, "data" : "15" },
{ "seq_id" : 37, "qsl_idx" : 83, "data" : "0B" },
{ "seq_id" : 38, "qsl_idx" : 397, "data" : "03" },
{ "seq_id" : 39, "qsl_idx" : 142, "data" : "20" },
{ "seq_id" : 38, "qsl_idx" : 397, "data" : "03" },
{ "seq_id" : 40, "qsl_idx" : 477, "data" : "11" },
{ "seq_id" : 41, "qsl_idx" : 125, "data" : "11" },
{ "seq_id" : 42, "qsl_idx" : 219, "data" : "11" },
{ "seq_id" : 43, "qsl_idx" : 394, "data" : "11" },
{ "seq_id" : 44, "qsl_idx" : 496, "data" : "19" },
{ "seq_id" : 43, "qsl_idx" : 394, "data" : "11" },
{ "seq_id" : 45, "qsl_idx" : 163, "data" : "09" },
{ "seq_id" : 46, "qsl_idx" : 262, "data" : "03" },
{ "seq_id" : 48, "qsl_idx" : 321, "data" : "11" },
{ "seq_id" : 47, "qsl_idx" : 261, "data" : "15" },
{ "seq_id" : 49, "qsl_idx" : 206, "data" : "14" },
{ "seq_id" : 47, "qsl_idx" : 261, "data" : "15" },
{ "seq_id" : 48, "qsl_idx" : 321, "data" : "11" },
{ "seq_id" : 50, "qsl_idx" : 453, "data" : "0B" },
{ "seq_id" : 52, "qsl_idx" : 320, "data" : "15" },
{ "seq_id" : 51, "qsl_idx" : 484, "data" : "03" },
@@ -63,21 +63,21 @@
{ "seq_id" : 61, "qsl_idx" : 9, "data" : "11" },
{ "seq_id" : 62, "qsl_idx" : 62, "data" : "12" },
{ "seq_id" : 63, "qsl_idx" : 447, "data" : "11" },
{ "seq_id" : 64, "qsl_idx" : 478, "data" : "16" },
{ "seq_id" : 66, "qsl_idx" : 138, "data" : "0A" },
{ "seq_id" : 64, "qsl_idx" : 478, "data" : "16" },
{ "seq_id" : 65, "qsl_idx" : 466, "data" : "12" },
{ "seq_id" : 67, "qsl_idx" : 291, "data" : "12" },
{ "seq_id" : 67, "qsl_idx" : 291, "data" : "03" },
{ "seq_id" : 68, "qsl_idx" : 280, "data" : "0E" },
{ "seq_id" : 69, "qsl_idx" : 116, "data" : "11" },
{ "seq_id" : 70, "qsl_idx" : 253, "data" : "0C" },
{ "seq_id" : 71, "qsl_idx" : 161, "data" : "11" },
{ "seq_id" : 69, "qsl_idx" : 116, "data" : "11" },
{ "seq_id" : 72, "qsl_idx" : 164, "data" : "0C" },
{ "seq_id" : 71, "qsl_idx" : 161, "data" : "11" },
{ "seq_id" : 73, "qsl_idx" : 361, "data" : "0D" },
{ "seq_id" : 74, "qsl_idx" : 72, "data" : "11" },
{ "seq_id" : 75, "qsl_idx" : 111, "data" : "01" },
{ "seq_id" : 75, "qsl_idx" : 111, "data" : "13" },
{ "seq_id" : 76, "qsl_idx" : 268, "data" : "11" },
{ "seq_id" : 77, "qsl_idx" : 346, "data" : "0B" },
{ "seq_id" : 78, "qsl_idx" : 254, "data" : "11" },
{ "seq_id" : 77, "qsl_idx" : 346, "data" : "0B" },
{ "seq_id" : 79, "qsl_idx" : 283, "data" : "02" },
{ "seq_id" : 80, "qsl_idx" : 255, "dat

@@ -87,80 +87,80 @@
{ "seq_id" : 421, "qsl_idx" : 266, "data" : "03" },
{ "seq_id" : 422, "qsl_idx" : 181, "data" : "03" },
{ "seq_id" : 423, "qsl_idx" : 31, "data" : "11" },
{ "seq_id" : 424, "qsl_idx" : 319, "data" : "0C" },
{ "seq_id" : 424, "qsl_idx" : 319, "data" : "12" },
{ "seq_id" : 425, "qsl_idx" : 229, "data" : "0C" },
{ "seq_id" : 426, "qsl_idx" : 214, "data" : "12" },
{ "seq_id" : 427, "qsl_idx" : 424, "data" : "15" },
{ "seq_id" : 428, "qsl_idx" : 216, "data" : "32" },
{ "seq_id" : 426, "qsl_idx" : 214, "data" : "12" },
{ "seq_id" : 429, "qsl_idx" : 344, "data" : "11" },
{ "seq_id" : 431, "qsl_idx" : 237, "data" : "08" },
{ "seq_id" : 428, "qsl_idx" : 216, "data" : "32" },
{ "seq_id" : 430, "qsl_idx" : 412, "data" : "0E" },
{ "seq_id" : 431, "qsl_idx" : 237, "data" : "08" },
{ "seq_id" : 433, "qsl_idx" : 18, "data" : "12" },
{ "seq_id" : 432, "qsl_idx" : 476, "data" : "02" },
{ "seq_id" : 435, "qsl_idx" : 11, "data" : "0D" },
{ "seq_id" : 434, "qsl_idx" : 115, "data" : "03" },
{ "seq_id" : 433, "qsl_idx" : 18, "data" : "12" },
{ "seq_id" : 435, "qsl_idx" : 11, "data" : "0D" },
{ "seq_id" : 436, "qsl_idx" : 339, "data" : "07" },
{ "seq_id" : 438, "qsl_idx" : 388, "data" : "03" },
{ "seq_id" : 438, "qsl_idx" : 388, "data" : "11" },
{ "seq_id" : 439, "qsl_idx" : 184, "data" : "0A" },
{ "seq_id" : 437, "qsl_idx" : 323, "data" : "11" },
{ "seq_id" : 440, "qsl_idx" : 67, "data" : "08" },
{ "seq_id" : 441, "qsl_idx" : 147, "data" : "11" },
{ "seq_id" : 442, "qsl_idx" : 68, "data" : "03" },
{ "seq_id" : 443, "qsl_idx" : 105, "data" : "13" },
{ "seq_id" : 442, "qsl_idx" : 68, "data" : "03" },
{ "seq_id" : 444, "qsl_idx" : 211, "data" : "09" },
{ "seq_id" : 445, "qsl_idx" : 420, "data" : "11" },
{ "seq_id" : 447, "qsl_idx" : 108, "data" : "03" },
{ "seq_id" : 446, "qsl_idx" : 238, "data" : "11" },
{ "seq_id" : 448, "qsl_idx" : 61, "data" : "03" },
{ "seq_id" : 449, "qsl_idx" : 235, "data" : "03" },
{ "seq_id" : 450, "qsl_idx" : 322, "data" : "09" },
{ "seq_id" : 451, "qsl_idx" : 457, "data" : "09" },
{ "seq_id" : 452, "qsl_idx" : 77, "data" : "15" },
{ "seq_id" : 451, "qsl_idx" : 457, "data" : "02" },
{ "seq_id" : 453, "qsl_idx" : 248, "data" : "0B" },
{ "seq_id" : 454, "qsl_idx" : 302, "data" : "0E" },
{ "seq_id" : 455, "qsl_idx" : 120, "data" : "0E" },
{ "seq_id" : 456, "qsl_idx" : 215, "data" : "11" },
{ "seq_id" : 457, "qsl_idx" : 246, "data" : "13" },
{ "seq_id" : 460, "qsl_idx" : 360, "data" : "02" },
{ "seq_id" : 458, "qsl_idx" : 417, "data" : "32" },
{ "seq_id" : 460, "qsl_idx" : 360, "data" : "02" },
{ "seq_id" : 459, "qsl_idx" : 310, "data" : "03" },
{ "seq_id" : 461, "qsl_idx" : 205, "data" : "10" },
{ "seq_id" : 464, "qsl_idx" : 259, "data" : "0C" },
{ "seq_id" : 463, "qsl_idx" : 28, "data" : "0E" },
{ "seq_id" : 464, "qsl_idx" : 259, "data" : "0C" },
{ "seq_id" : 462, "qsl_idx" : 454, "data" : "12" },
{ "seq_id" : 465, "qsl_idx" : 0, "data" : "11" },
{ "seq_id" : 466, "qsl_idx" : 366, "data" : "20" },
{ "seq_id" : 467, "qsl_idx" : 10, "data" : "0C" },
{ "seq_id" : 468, "qsl_idx" : 218, "data" : "0E" },
{ "seq_id" : 471, "qsl_idx" : 431, "data" : "11" },
{ "seq_id" : 469, "qsl_idx" : 78, "data" : "11" },
{ "seq_id" : 470, "qsl_idx" : 290, "data" : "11" },
{ "seq_id" : 471, "qsl_idx" : 431, "data" : "11" },
{ "seq_id" : 472, "qsl_idx" : 94, "data" : "16" },
{ "seq_id" : 473, "qsl_idx" : 110, "data" : "0F" },
{ "seq_id" : 474, "qsl_idx" : 148, "data" : "02" },
{ "seq_id" : 475, "qsl_idx" : 50, "data" : "09" },
{ "seq_id" : 473, "qsl_idx" : 110, "data" : "0F" },
{ "seq_id" : 476, "qsl_idx" : 55, "data" : "0C" },
{ "seq_id" : 478, "qsl_idx" : 343, "data" : "15" },
{ "seq_id" : 477, "qsl_idx" : 65, "data" : "11" },
{ "seq_id" : 478, "qsl_idx" : 343, "data" : "15" },
{ "seq_id" : 479, "qsl_idx" : 258, "data" : "0E" },
{ "seq_id" : 480, "qsl_idx" : 438, "data" : "03" },
{ "seq_id" : 481, "qsl_idx" : 121, "data" : "0D" },
{ "seq_id" : 482, "qsl_idx" : 82, "data" : "0F" },
{ "seq_id" : 483, "qsl_idx" : 373, "data" : "20" },
{ "seq_id" : 484, "qsl_idx" : 89, "data" : "11" },
{ "seq_id" : 485, "qsl_idx" : 244, "data" : "11" },
{ "seq_id" : 486, "qsl_idx" : 494, "data" : "09" },
{ "seq_id" : 484, "qsl_idx" : 89, "data" : "11" },
{ "seq_id" : 487, "qsl_idx" : 80, "data" : "11" },
{ "seq_id" : 488, "qsl_idx" : 315, "data" : "02" },
{ "seq_id" : 489, "qsl_idx" : 480, "data" : "16" },
{ "seq_id" : 489, "qsl_idx" : 480, "data" : "03" },
{ "seq_id" : 490, "qsl_idx" : 96, "data" : "03" },
{ "seq_id" : 488, "qsl_idx" : 315, "data" : "02" },
{ "seq_id" : 491, "qsl_idx" : 45, "data" : "11" },
{ "seq_id" : 492, "qsl_idx" : 483, "data" : "03" },
{ "seq_id" : 493, "qsl_idx" : 90, "data" : "11" },
{ "seq_id" : 497, "qsl_idx" : 331, "data" : "03" },
{ "seq_id" : 496, "qsl_idx" : 59, "data" : "03" },
{ "seq_id" : 494, "qsl_idx" : 419, "data" : "03" },
{ "seq_id" : 495, "qsl_idx" : 153, "data" : "11" },
{ "seq_id" : 499, "qsl_idx" : 19, "data" : "02" },
{ "seq_id" : 498, "qsl_idx" : 209, "data" : "03" }
{ "seq_id" : 496, "qsl_idx" : 59, "data" : "03" },
{ "seq_id" : 497, "qsl_idx" : 331, "data" : "03" },
{ "seq_id" : 498, "qsl_idx" : 209, "data" : "03" },
{ "seq_id" : 499, "qsl_idx" : 19, "data" : "02" }
]
140 changes: 70 additions & 70 deletions ...6-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline/accuracy/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

174 changes: 87 additions & 87 deletions ...ce-cpu-pytorch_v2.4.0-default_config/rgat/offline/performance/run_1/mlperf_log_detail.txt
View file

Large diffs are not rendered by default.

20 changes: 10 additions & 10 deletions ...e-cpu-pytorch_v2.4.0-default_config/rgat/offline/performance/run_1/mlperf_log_summary.txt
View file
Original file line number Diff line number Diff line change
@@ -4,7 +4,7 @@ MLPerf Results Summary
SUT name : PySUT
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 10.1992
Samples per second: 9.99473
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
@@ -13,15 +13,15 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 460463542
Max latency (ns) : 49023528136
Mean latency (ns) : 24896457199
50.00 percentile latency (ns) : 24937050242
90.00 percentile latency (ns) : 44496983274
95.00 percentile latency (ns) : 46944054808
97.00 percentile latency (ns) : 47918762594
99.00 percentile latency (ns) : 48889816244
99.90 percentile latency (ns) : 49023528136
Min latency (ns) : 500770724
Max latency (ns) : 50026345127
Mean latency (ns) : 25385684652
50.00 percentile latency (ns) : 25422035817
90.00 percentile latency (ns) : 45267383348
95.00 percentile latency (ns) : 47778423683
97.00 percentile latency (ns) : 48745315779
99.00 percentile latency (ns) : 49886177062
99.90 percentile latency (ns) : 50026345127

================================================
Test Parameters Used

0 comments on commit 412dfd6

Please sign in to comment.