Through KVBench, we have performed reproducible, preliminary benchmarking of Apache Ignite, Apache Cassandra, TikV and etcd using YCSB[1, 2] workloads.
This work was done as a part of our Course Project for CSE 590: Distributed and Decentralized Data Management, taught by Prof. Mohammad Javad Amiri at Stony Brook University in Spring 2024.
The benchmarks were performed on CloudLab
On CloudLab, we chose the following configuration for our server
- Profile: ubuntu-22.04
- Hardware Type: c220g2 (CloudLab Wisconsin)
- RAM: 157 GB
- Swap Space: 8 GB
- Disk Space: 63 GB
- Number of CPUs: 40
- Model Name: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
- Linux Kernel Version: 5.15.0-86-generic
(Note: For all KV stores evaluated, we spun up multi-node clusters on a single server itself.)
We have chosen the YCSB workload parameters to be the default ones: operationcount = 100000 , recordcount = 100000 and threadcount = 4 to make comparison across the systems.
To learn more about how to go ahead and perform the benchmarking results, checkout the links for the respective Key-Value stores. For a more detailed comparison and in-depth interpretation of the benchmarks, have a look at our attached Project report.