Skip to content

Introduce CrateDB to the benchmark [draft]#29

Open
widmogrod wants to merge 16 commits intorockset:masterfrom
widmogrod:feature/crate-db
Open

Introduce CrateDB to the benchmark [draft]#29
widmogrod wants to merge 16 commits intorockset:masterfrom
widmogrod:feature/crate-db

Conversation

@widmogrod
Copy link

@widmogrod widmogrod commented Jul 2, 2024

rockbench now can run benchmarks agains https://cratedb.com

Implementation is missing patch mode

PR introduce also docker compose to allow running some of the benchmarks locally

docker compose -f dev/compose.yml up -d

# To test CrateDB part run:
CRATEDB_URI="postgres://crate:@localhost:5432/test?pool_max_conns=10&pool_min_conns=3" go test ./... 

To run some benchmarks on docker compose locally, there is small utility script to help you started

dev/run.sh  

Example output

dev/run.sh
[+] Running 3/3
 ✔ Network dev_default      Created                                                                                                                                                                                                                                                                             0.1s 
 ✔ Container opensearch     Started                                                                                                                                                                                                                                                                             0.4s 
 ✔ Container dev-cratedb-1  Started                                                                                                                                                                                                                                                                             0.4s 
Build rockbench
Wait for 15s for compose containers to start...
Benchmarking Elastic
Generator identifier:  thyb6zEs7J
Initial sleep of 4s and polling period of 25s
Sleep done. Now issuing requests to calculate e2e latency.
Latency: 1.019278s
Latency: 1.026499s
Latency: 1.036756s
Latency: 1.026115s
Latency: 1.023782s
Latency: 1.040088s
Latency: 1.02546s
Latency: 1.026143s
Latency: 1.029186s
^C
signal received: interrupt
2024/07/03 19:42:07 done
Benchmarking CrateDB
Generator identifier:  YkpJ0rknGL
Initial sleep of 2s and polling period of 25s
Sleep done. Now issuing requests to calculate e2e latency.
Latency: 1.050514s
Latency: 106.732ms
Latency: 88.5ms
Latency: 90.912ms
Latency: 95.79ms
Latency: 135.561ms
Latency: 88.375ms
Latency: 100.388ms
Latency: 90.523ms
^C
signal received: interrupt
2024/07/03 19:45:54 done
[+] Running 3/3
 ✔ Container dev-cratedb-1  Removed                                                                                                                                                                                                                                                                             0.8s 
 ✔ Container opensearch     Removed                                                                                                                                                                                                                                                                            10.4s 
 ✔ Network dev_default      Removed 

@widmogrod widmogrod changed the title working draft Introduce CrateDB to the benchmark Jul 3, 2024
@widmogrod widmogrod changed the title Introduce CrateDB to the benchmark Introduce CrateDB to the benchmark [draft] Jul 3, 2024
@widmogrod widmogrod marked this pull request as draft July 3, 2024 08:49
@widmogrod widmogrod marked this pull request as ready for review July 3, 2024 19:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant