Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce CrateDB to the benchmark [draft] #29

Open
wants to merge 16 commits into
base: master
Choose a base branch
from

Conversation

widmogrod
Copy link

@widmogrod widmogrod commented Jul 2, 2024

rockbench now can run benchmarks agains https://cratedb.com

Implementation is missing patch mode

PR introduce also docker compose to allow running some of the benchmarks locally

docker compose -f dev/compose.yml up -d

# To test CrateDB part run:
CRATEDB_URI="postgres://crate:@localhost:5432/test?pool_max_conns=10&pool_min_conns=3" go test ./... 

To run some benchmarks on docker compose locally, there is small utility script to help you started

dev/run.sh  

Example output

dev/run.sh
[+] Running 3/3
 ✔ Network dev_default      Created                                                                                                                                                                                                                                                                             0.1s 
 ✔ Container opensearch     Started                                                                                                                                                                                                                                                                             0.4s 
 ✔ Container dev-cratedb-1  Started                                                                                                                                                                                                                                                                             0.4s 
Build rockbench
Wait for 15s for compose containers to start...
Benchmarking Elastic
Generator identifier:  thyb6zEs7J
Initial sleep of 4s and polling period of 25s
Sleep done. Now issuing requests to calculate e2e latency.
Latency: 1.019278s
Latency: 1.026499s
Latency: 1.036756s
Latency: 1.026115s
Latency: 1.023782s
Latency: 1.040088s
Latency: 1.02546s
Latency: 1.026143s
Latency: 1.029186s
^C
signal received: interrupt
2024/07/03 19:42:07 done
Benchmarking CrateDB
Generator identifier:  YkpJ0rknGL
Initial sleep of 2s and polling period of 25s
Sleep done. Now issuing requests to calculate e2e latency.
Latency: 1.050514s
Latency: 106.732ms
Latency: 88.5ms
Latency: 90.912ms
Latency: 95.79ms
Latency: 135.561ms
Latency: 88.375ms
Latency: 100.388ms
Latency: 90.523ms
^C
signal received: interrupt
2024/07/03 19:45:54 done
[+] Running 3/3
 ✔ Container dev-cratedb-1  Removed                                                                                                                                                                                                                                                                             0.8s 
 ✔ Container opensearch     Removed                                                                                                                                                                                                                                                                            10.4s 
 ✔ Network dev_default      Removed 

@widmogrod widmogrod changed the title working draft Introduce CrateDB to the benchmark Jul 3, 2024
@widmogrod widmogrod changed the title Introduce CrateDB to the benchmark Introduce CrateDB to the benchmark [draft] Jul 3, 2024
@widmogrod widmogrod marked this pull request as draft July 3, 2024 08:49
@widmogrod widmogrod marked this pull request as ready for review July 3, 2024 19:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant