Skip to content

Commit

Permalink
Add new results
Browse files Browse the repository at this point in the history
  • Loading branch information
siqi committed Aug 28, 2023
1 parent 1fd992b commit b5ed392
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 9 deletions.
5 changes: 2 additions & 3 deletions OpenMLDB/leaderboard/2_755_cent7.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,8 +47,7 @@
**Q5**
| tp0 | tp50 | tp90 | tp95 | tp99 | tp999 | tp9999 |
| --- | ---- | ---- | ---- | ---- | ----- | ------ |
|21.398|23.691|25.854|26.87|29.196|41.701|83.928|
**
|9.011|10.322|12.403|13.222|15.155|19.187|192.414|270.533|

#### Throughput (ops/s)

Expand Down Expand Up @@ -80,4 +79,4 @@
**Q5**
| min | avg | max |
| --- | ---- | ---- |
***|206.9|210.52|212.8|
|452.2|464.06|471.7|
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,15 +58,15 @@ This leaderboard showcases the performance of executing FEBench on various hardw

| Contributor | Hardware | Average TP50/90/99 Performance (ms)     | Submit Date |
| ----------- | ------------------------------------------------------------ | ------------------------------------------------- | ----------- |
| Tsinghua | [Dual Xeon, 755GB DDR4, CentOS 7](OpenMLDB/leaderboard/2_755_cent7.md) | 17.642/22.045/24.534 | 2023/8 |
| 4Paradigm | [ FusionServer 2288H V7, Dual Xeon, 438GB DDR5, Rocky 9](OpenMLDB/leaderboard/2_438_rocky9.md) | 10.697/12.676/15.039 | 2023/8 |
| Tsinghua | [Dual Xeon, 755GB DDR4, CentOS 7](OpenMLDB/leaderboard/2_755_cent7.md) | 21.31/25.1/27.69 | 2023/8 |
| 4Paradigm | [ FusionServer 2288H V7, Dual Xeon, 438GB DDR5, Rocky 9](OpenMLDB/leaderboard/2_438_rocky9.md) | 15.82/18.51/21.8 | 2023/8 |

**Leaderboard - Throughput**

| Contributor | Hardware | Average Performance (ops/s)     | Submit Date |
| ----------- | ------------------------------------------------------------ | ------------------------------------------- | ----------- |
| Tsinghua | [Dual Xeon, 755GB DDR4, CentOS 7](OpenMLDB/leaderboard/2_755_cent7.md) | 703 | 2023/8 |
| 4Paradigm | [ FusionServer 2288H V7, Dual Xeon, 438GB DDR5, Rocky 9](OpenMLDB/leaderboard/2_438_rocky9.md) | 1332 | 2023/8 |
| Tsinghua | [Dual Xeon, 755GB DDR4, CentOS 7](OpenMLDB/leaderboard/2_755_cent7.md) | 479.6 | 2023/8 |
| 4Paradigm | [ FusionServer 2288H V7, Dual Xeon, 438GB DDR5, Rocky 9](OpenMLDB/leaderboard/2_438_rocky9.md) | 685.7 | 2023/8 |

Note we utilize the performance results of **OpenMLDB** as the basis for ranking. To participate, kindly implement FEBench following our [Standard Specification](https://github.com/decis-bench/febench/blob/main/report/Feature_Extraction_Benchmark_Standard_Specification.pdf) and upload your results by following the [Result Uploading](#-result-uploading) guidelines.

Expand Down Expand Up @@ -139,14 +139,14 @@ cd /work/febench/OpenMLDB
./compile_test.sh #compile test
./test.sh <dataset_ID> #run task <dataset_ID>
```
![image](../imgs/openmldb-jmh.png)
![image](./imgs/openmldb-jmh.png)
* Flink
```bash
cd /work/febench/flink
./compile_test.sh <dataset_ID> #compile and run test of task <dataset_ID>
./test.sh #rerun test of task <dataset_ID>
```
![image](../imgs/flink-jmh.png)
![image](./imgs/flink-jmh.png)

For native execution and customizations, you can refer to the guide [here](report/customization.md).

Expand Down

0 comments on commit b5ed392

Please sign in to comment.