OpenCL-Benchmark

A small OpenCL benchmark program to measure peak GPU/CPU performance.

Works with any GPU in Windows, Linux, macOS and Android.

Measurements

• compute performance (FP64, FP32, FP16, INT64, INT32, INT16, INT8)
  • closest possible fraction/multiplicator of measured compute performance divided by reported theoretical FP32 performance is shown in (round brackets)
    • for example when OpenCL reports 19.492 TFLOPs/s theoretical FP32, and the benchmark measures 9.512 TFLOPs/s for FP64, the ratio of (measured FP64)/(theoretical FP32) = 9.512/19.492 = 1/2.05 is rounded to the next possible value of 1/2 and reported as such
    • these ratios for any GPU/CPU architecture can only be either 1/64, 1/32, 1/24, 1/16, 1/12, 1/8, 1/4, 1/3, 1/2, 2/3, 1x, 2x, 4x, 8x, 16x, 32x, 64x, and nothing in between
• memory bandwidth (coalesced/misaligned read/write)
• PCIe bandwidth (send/receive/bidirectional)
  • PCIe Gen is estimated based on measured PCIe bandwidth and assumed x16 link width

How to use?

Windows

• Download and install Visual Studio Community. In Visual Studio Installer, add:
  • Desktop development with C++
  • MSVC v142
  • Windows 10 SDK
• Open OpenCL-Benchmark.sln in Visual Studio Community.
• Compile and run by clicking the ► Local Windows Debugger button.
• To run outside of Visual Studio Community, open Windows CMD in the OpenCL-Benchmark folder (type cmd in File Explorer in the directory field and press Enter), then run

  OpenCL-Benchmark.exe
  

Linux / macOS / Android

• Download, compile and run:

  git clone https://github.com/ProjectPhysX/OpenCL-Benchmark.git
  cd OpenCL-Benchmark
  chmod +x make.sh
  ./make.sh
  

• Run

  bin/OpenCL-Benchmark
  

Run only for a specified list of devices

• call bin\OpenCL-Benchmark.exe 0 2 5 (Windows) or bin/OpenCL-Benchmark 0 2 5 (Linux/macOS) with the number(s) being the device IDs to be benchmarked

Examples

.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID    0 | NVIDIA A100-PCIE-40GB                                      |
| Device ID    1 | NVIDIA GeForce RTX 2080 Ti                                 |
| Device ID    2 | NVIDIA GeForce RTX 2080 Ti                                 |
| Device ID    3 | NVIDIA GeForce RTX 2080 Ti                                 |
| Device ID    4 | NVIDIA GeForce RTX 2080 Ti                                 |
| Device ID    5 | NVIDIA GeForce RTX 2080 Ti                                 |
| Device ID    6 | NVIDIA GeForce RTX 2080 Ti                                 |
| Device ID    7 | NVIDIA GeForce RTX 2080 Ti                                 |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 0                                                          |
| Device Name    | NVIDIA A100-PCIE-40GB                                      |
| Device Vendor  | NVIDIA Corporation                                         |
| Device Driver  | 525.89.02                                                  |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 108 at 1410 MHz (6912 cores, 19.492 TFLOPs/s)              |
| Memory, Cache  | 40513 MB, 3024 KB global / 48 KB local                     |
| Buffer Limits  | 10128 MB global, 64 KB constant                            |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         9.512 TFLOPs/s (1/2 ) |
| FP32  compute                                        19.283 TFLOPs/s ( 1x ) |
| FP16  compute                                          not supported        |
| INT64 compute                                         2.664  TIOPs/s (1/8 ) |
| INT32 compute                                        19.245  TIOPs/s ( 1x ) |
| INT16 compute                                        15.397  TIOPs/s (2/3 ) |
| INT8  compute                                        18.052  TIOPs/s ( 1x ) |
| Memory Bandwidth ( coalesced read      )                       1350.39 GB/s |
| Memory Bandwidth ( coalesced      write)                       1503.39 GB/s |
| Memory Bandwidth (misaligned read      )                       1226.41 GB/s |
| Memory Bandwidth (misaligned      write)                        210.83 GB/s |
| PCIe   Bandwidth (send                 )                         22.06 GB/s |
| PCIe   Bandwidth (   receive           )                         21.16 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)    8.77 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 1                                                          |
| Device Name    | NVIDIA GeForce RTX 2080 Ti                                 |
| Device Vendor  | NVIDIA Corporation                                         |
| Device Driver  | 525.89.02                                                  |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 68 at 1545 MHz (4352 cores, 13.448 TFLOPs/s)               |
| Memory, Cache  | 11011 MB, 2176 KB global / 48 KB local                     |
| Buffer Limits  | 2752 MB global, 64 KB constant                             |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.507 TFLOPs/s (1/24) |
| FP32  compute                                        16.450 TFLOPs/s ( 1x ) |
| FP16  compute                                          not supported        |
| INT64 compute                                         3.524  TIOPs/s (1/4 ) |
| INT32 compute                                        16.265  TIOPs/s ( 1x ) |
| INT16 compute                                        12.897  TIOPs/s ( 1x ) |
| INT8  compute                                        10.158  TIOPs/s (2/3 ) |
| Memory Bandwidth ( coalesced read      )                        533.08 GB/s |
| Memory Bandwidth ( coalesced      write)                        550.67 GB/s |
| Memory Bandwidth (misaligned read      )                        533.38 GB/s |
| Memory Bandwidth (misaligned      write)                        156.57 GB/s |
| PCIe   Bandwidth (send                 )                         12.87 GB/s |
| PCIe   Bandwidth (   receive           )                         12.86 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)    6.35 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit.                                                  |
'-----------------------------------------------------------------------------'

.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID    0 | gfx906:sramecc+:xnack-                                     |
| Device ID    1 | gfx906:sramecc+:xnack-                                     |
| Device ID    2 | gfx906:sramecc+:xnack-                                     |
| Device ID    3 | gfx906:sramecc+:xnack-                                     |
| Device ID    4 | gfx906:sramecc+:xnack-                                     |
| Device ID    5 | gfx906:sramecc+:xnack-                                     |
| Device ID    6 | gfx90a:sramecc+:xnack-                                     |
| Device ID    7 | gfx906:sramecc+:xnack-                                     |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 6                                                          |
| Device Name    | gfx90a:sramecc+:xnack-                                     |
| Device Vendor  | Advanced Micro Devices, Inc.                               |
| Device Driver  | 3513.0 (HSA1.1,LC)                                         |
| OpenCL Version | OpenCL C 2.0                                               |
| Compute Units  | 104 at 1700 MHz (6656 cores, 22.630 TFLOPs/s)              |
| Memory, Cache  | 65520 MB, 16 KB global / 64 KB local                       |
| Buffer Limits  | 55692 MB global, 57028608 KB constant                      |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                        17.356 TFLOPs/s (2/3 ) |
| FP32  compute                                        19.995 TFLOPs/s ( 1x ) |
| FP16  compute                                        39.680 TFLOPs/s ( 2x ) |
| INT64 compute                                         1.511  TIOPs/s (1/16) |
| INT32 compute                                        18.441  TIOPs/s (2/3 ) |
| INT16 compute                                        19.679  TIOPs/s ( 1x ) |
| INT8  compute                                        13.294  TIOPs/s (2/3 ) |
| Memory Bandwidth ( coalesced read      )                        967.34 GB/s |
| Memory Bandwidth ( coalesced      write)                        979.27 GB/s |
| Memory Bandwidth (misaligned read      )                       1302.28 GB/s |
| Memory Bandwidth (misaligned      write)                        634.80 GB/s |
| PCIe   Bandwidth (send                 )                         17.66 GB/s |
| PCIe   Bandwidth (   receive           )                         17.60 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   17.30 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 7                                                          |
| Device Name    | gfx906:sramecc+:xnack-                                     |
| Device Vendor  | Advanced Micro Devices, Inc.                               |
| Device Driver  | 3513.0 (HSA1.1,LC)                                         |
| OpenCL Version | OpenCL C 2.0                                               |
| Compute Units  | 60 at 1801 MHz (3840 cores, 13.832 TFLOPs/s)               |
| Memory, Cache  | 16368 MB, 16 KB global / 64 KB local                       |
| Buffer Limits  | 13912 MB global, 14246707 KB constant                      |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         3.130 TFLOPs/s (1/4 ) |
| FP32  compute                                        12.440 TFLOPs/s ( 1x ) |
| FP16  compute                                        24.593 TFLOPs/s ( 2x ) |
| INT64 compute                                         0.809  TIOPs/s (1/16) |
| INT32 compute                                         6.273  TIOPs/s (1/2 ) |
| INT16 compute                                        12.488  TIOPs/s ( 1x ) |
| INT8  compute                                         8.314  TIOPs/s (2/3 ) |
| Memory Bandwidth ( coalesced read      )                        693.40 GB/s |
| Memory Bandwidth ( coalesced      write)                        654.52 GB/s |
| Memory Bandwidth (misaligned read      )                        805.20 GB/s |
| Memory Bandwidth (misaligned      write)                        400.12 GB/s |
| PCIe   Bandwidth (send                 )                         10.36 GB/s |
| PCIe   Bandwidth (   receive           )                         10.28 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   10.32 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit.                                                  |
'-----------------------------------------------------------------------------'

.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID    0 | Intel(R) FPGA Emulation Device                             |
| Device ID    1 | Intel(R) Xeon(R) Platinum 8480+                            |
| Device ID    2 | Intel(R) Data Center GPU Max 1100                          |
| Device ID    3 | Intel(R) Data Center GPU Max 1100                          |
| Device ID    4 | Intel(R) Data Center GPU Max 1100                          |
| Device ID    5 | Intel(R) Data Center GPU Max 1100                          |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 2                                                          |
| Device Name    | Intel(R) Data Center GPU Max 1100                          |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 23.17.26241.33                                             |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 448 at 1550 MHz (7168 cores, 22.221 TFLOPs/s)              |
| Memory, Cache  | 46679 MB, 196608 KB global / 128 KB local                  |
| Buffer Limits  | 46679 MB global, 47799500 KB constant                      |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                        16.314 TFLOPs/s ( 1x ) |
| FP32  compute                                        21.932 TFLOPs/s ( 2x ) |
| FP16  compute                                        41.413 TFLOPs/s ( 4x ) |
| INT64 compute                                         1.082  TIOPs/s (1/12) |
| INT32 compute                                         7.028  TIOPs/s (2/3 ) |
| INT16 compute                                        60.320  TIOPs/s ( 4x ) |
| INT8  compute                                        38.822  TIOPs/s ( 4x ) |
| Memory Bandwidth ( coalesced read      )                        739.91 GB/s |
| Memory Bandwidth ( coalesced      write)                        888.49 GB/s |
| Memory Bandwidth (misaligned read      )                        718.96 GB/s |
| Memory Bandwidth (misaligned      write)                        319.63 GB/s |
| PCIe   Bandwidth (send                 )                         25.42 GB/s |
| PCIe   Bandwidth (   receive           )                         23.10 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   32.31 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit.                                                  |
'-----------------------------------------------------------------------------'

.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID    0 | NVIDIA TITAN Xp                                            |
| Device ID    1 | Tesla K40m                                                 |
| Device ID    2 | Tesla K40m                                                 |
| Device ID    3 | Tesla K40m                                                 |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 1                                                          |
| Device Name    | Tesla K40m                                                 |
| Device Vendor  | NVIDIA Corporation                                         |
| Device Driver  | 470.103.01                                                 |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 15 at 745 MHz (2880 cores, 4.291 TFLOPs/s)                 |
| Memory, Cache  | 11441 MB, 240 KB global / 48 KB local                      |
| Buffer Limits  | 2860 MB global, 64 KB constant                             |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         1.213 TFLOPs/s (1/4 ) |
| FP32  compute                                         2.437 TFLOPs/s (1/2 ) |
| FP16  compute                                          not supported        |
| INT64 compute                                         0.618  TIOPs/s (1/8 ) |
| INT32 compute                                         0.714  TIOPs/s (1/8 ) |
| INT16 compute                                         0.689  TIOPs/s (1/8 ) |
| INT8  compute                                         0.679  TIOPs/s (1/8 ) |
| Memory Bandwidth ( coalesced read      )                        175.44 GB/s |
| Memory Bandwidth ( coalesced      write)                        191.03 GB/s |
| Memory Bandwidth (misaligned read      )                         41.45 GB/s |
| Memory Bandwidth (misaligned      write)                         37.91 GB/s |
| PCIe   Bandwidth (send                 )                          7.67 GB/s |
| PCIe   Bandwidth (   receive           )                          4.35 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen3 x16)    5.79 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit.                                                  |
'-----------------------------------------------------------------------------'

.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID    0 | NVIDIA TITAN Xp                                            |
| Device ID    1 | Intel(R) UHD Graphics 630                                  |
| Device ID    2 | Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz                   |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 0                                                          |
| Device Name    | NVIDIA TITAN Xp                                            |
| Device Vendor  | NVIDIA Corporation                                         |
| Device Driver  | 531.18                                                     |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 30 at 1582 MHz (3840 cores, 12.150 TFLOPs/s)               |
| Memory, Cache  | 12287 MB, 1440 KB global / 48 KB local                     |
| Buffer Limits  | 3071 MB global, 64 KB constant                             |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.441 TFLOPs/s (1/32) |
| FP32  compute                                        12.880 TFLOPs/s ( 1x ) |
| FP16  compute                                          not supported        |
| INT64 compute                                         1.436  TIOPs/s (1/8 ) |
| INT32 compute                                         4.001  TIOPs/s (1/3 ) |
| INT16 compute                                        12.733  TIOPs/s ( 1x ) |
| INT8  compute                                        13.148  TIOPs/s ( 1x ) |
| Memory Bandwidth ( coalesced read      )                        415.77 GB/s |
| Memory Bandwidth ( coalesced      write)                        475.51 GB/s |
| Memory Bandwidth (misaligned read      )                        168.69 GB/s |
| Memory Bandwidth (misaligned      write)                        104.66 GB/s |
| PCIe   Bandwidth (send                 )                         11.40 GB/s |
| PCIe   Bandwidth (   receive           )                         11.06 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   11.22 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 1                                                          |
| Device Name    | Intel(R) UHD Graphics 630                                  |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 31.0.101.2114                                              |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 24 at 1200 MHz (192 cores, 0.461 TFLOPs/s)                 |
| Memory, Cache  | 6500 MB, 768 KB global / 64 KB local                       |
| Buffer Limits  | 3250 MB global, 3328048 KB constant                        |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.112 TFLOPs/s (1/4 ) |
| FP32  compute                                         0.454 TFLOPs/s ( 1x ) |
| FP16  compute                                         0.781 TFLOPs/s ( 2x ) |
| INT64 compute                                         0.016  TIOPs/s (1/32) |
| INT32 compute                                         0.153  TIOPs/s (1/3 ) |
| INT16 compute                                         0.863  TIOPs/s ( 2x ) |
| INT8  compute                                         0.151  TIOPs/s (1/3 ) |
| Memory Bandwidth ( coalesced read      )                         20.14 GB/s |
| Memory Bandwidth ( coalesced      write)                         22.94 GB/s |
| Memory Bandwidth (misaligned read      )                         34.83 GB/s |
| Memory Bandwidth (misaligned      write)                         12.64 GB/s |
| PCIe   Bandwidth (send                 )                         14.46 GB/s |
| PCIe   Bandwidth (   receive           )                         14.48 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)    9.38 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 2                                                          |
| Device Name    | Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz                   |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 2022.14.11.0.01_160000.xmain-hotfix                        |
| OpenCL Version | OpenCL C 3.0                                               |
| Compute Units  | 12 at 3700 MHz (6 cores, 0.710 TFLOPs/s)                   |
| Memory, Cache  | 16250 MB, 256 KB global / 32 KB local                      |
| Buffer Limits  | 8125 MB global, 128 KB constant                            |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                         0.179 TFLOPs/s (1/4 ) |
| FP32  compute                                         0.176 TFLOPs/s (1/4 ) |
| FP16  compute                                          not supported        |
| INT64 compute                                         0.053  TIOPs/s (1/12) |
| INT32 compute                                         0.061  TIOPs/s (1/12) |
| INT16 compute                                         0.222  TIOPs/s (1/3 ) |
| INT8  compute                                         0.242  TIOPs/s (1/3 ) |
| Memory Bandwidth ( coalesced read      )                         22.74 GB/s |
| Memory Bandwidth ( coalesced      write)                         11.16 GB/s |
| Memory Bandwidth (misaligned read      )                         41.23 GB/s |
| Memory Bandwidth (misaligned      write)                         14.21 GB/s |
| PCIe   Bandwidth (send                 )                         15.45 GB/s |
| PCIe   Bandwidth (   receive           )                         14.96 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen4 x16)   15.02 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit.                                                  |
'-----------------------------------------------------------------------------'

.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID    0 | Intel(R) Arc(TM) A750 Graphics                             |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID      | 0                                                          |
| Device Name    | Intel(R) Arc(TM) A750 Graphics                             |
| Device Vendor  | Intel(R) Corporation                                       |
| Device Driver  | 23.05.25593.18                                             |
| OpenCL Version | OpenCL C 1.2                                               |
| Compute Units  | 448 at 2400 MHz (3584 cores, 17.203 TFLOPs/s)              |
| Memory, Cache  | 8127 MB, 512 KB global / 64 KB local                       |
| Buffer Limits  | 3860 MB global, 3953458 KB constant                        |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled.                                  |
| FP64  compute                                          not supported        |
| FP32  compute                                        10.254 TFLOPs/s (2/3 ) |
| FP16  compute                                        15.629 TFLOPs/s ( 1x ) |
| INT64 compute                                         1.032  TIOPs/s (1/16) |
| INT32 compute                                         3.896  TIOPs/s (1/4 ) |
| INT16 compute                                        25.614  TIOPs/s ( 1x ) |
| INT8  compute                                         9.434  TIOPs/s (1/2 ) |
| Memory Bandwidth ( coalesced read      )                        198.56 GB/s |
| Memory Bandwidth ( coalesced      write)                        407.12 GB/s |
| Memory Bandwidth (misaligned read      )                        384.15 GB/s |
| Memory Bandwidth (misaligned      write)                        285.33 GB/s |
| PCIe   Bandwidth (send                 )                          1.33 GB/s |
| PCIe   Bandwidth (   receive           )                          1.28 GB/s |
| PCIe   Bandwidth (        bidirectional)            (Gen1 x16)    1.34 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit.                                                  |
'-----------------------------------------------------------------------------'