diff --git a/README.md b/README.md index b7bf510..b37b561 100644 --- a/README.md +++ b/README.md @@ -52,7 +52,8 @@ Test Description | Hardware | Duration |Avg TPS | Delta 8KB value, 60 workers, sync | 5 x i2.2x | 4 hr | 12,679.91 | + 70.81% | + 63.99% 8KB value, 100 workers, no_sync | 5 x i2.2x | 6 hr | 14,100.19 | + 16.15% | + 35.92% 8KB value, 50 workers, no_sync | 5 x d2.2x | 4 hr | 10,400.29 | + 8.37% | + 23.51% -4KB value, 100 workers, no_sync | 5 x i2.2x | 6 hr | 14,993.95 | - 10.44% | - 4.48% +4KB value, 100 workers, no_sync | 5 x i2.2x | 6 hr | 14,993.95 | - 10.44% | - 4.48% +16KB value, 60 workers, no_sync | 5 x i2.2x | 6 hr | 14,993.95 | + 80.48% | + 113.55% Tests generally show a 5:1 improvement in tail latency for LevelEd. diff --git a/docs/VOLUME.md b/docs/VOLUME.md index 77ce178..3a13eb5 100644 --- a/docs/VOLUME.md +++ b/docs/VOLUME.md @@ -32,6 +32,7 @@ This test has the following specific characteristics - 60 concurrent basho_bench workers running at 'max' - i2.2xlarge instances - allow_mult=false, lww=false +- sync_on_write = on Comparison charts for this test: @@ -47,6 +48,7 @@ This test has the following specific characteristics - 100 concurrent basho_bench workers running at 'max' - i2.2xlarge instances - allow_mult=false, lww=false +- sync_on_write = off Comparison charts for this test: @@ -60,8 +62,9 @@ This test has the following specific characteristics - An 8KB value size (based on crypto:rand_bytes/1 - so cannot be effectively compressed) - 50 concurrent basho_bench workers running at 'max' -- d2.2xlarge instances +- d2.2xlarge instances - allow_mult=false, lww=false +- sync_on_write = off Comparison charts for this test: @@ -74,11 +77,37 @@ This is the stage when the volume of data has begun to exceed the volume support ### Half-Size Object, SSDs, No Sync-On-Write -to be completed +This test has the following specific characteristics + +- A 4KB value size (based on crypto:rand_bytes/1 - so cannot be effectively compressed) +- 100 concurrent basho_bench workers running at 'max' +- i2.2xlarge instances +- allow_mult=false, lww=false +- sync_on_write = off + +Comparison charts for this test: + +Riak + leveled | Riak + eleveldb +:-------------------------:|:-------------------------: +![](../test/volume/cluster_four/output/summary_leveled_5n_100t_i2_4KB_nosync.png "LevelEd") | ![](../test/volume/cluster_four/output/summary_leveldb_5n_100t_i2_4KB_nosync.png "LevelDB") + ### Double-Size Object, SSDs, No Sync-On-Write -to be completed +This test has the following specific characteristics + +- A 16KB value size (based on crypto:rand_bytes/1 - so cannot be effectively compressed) +- 60 concurrent basho_bench workers running at 'max' +- i2.2xlarge instances +- allow_mult=false, lww=false +- sync_on_write = off + +Comparison charts for this test: + +Riak + leveled | Riak + eleveldb +:-------------------------:|:-------------------------: +![](../test/volume/cluster_five/output/summary_leveled_5n_60t_i2_16KB_nosync.png "LevelEd") | ![](../test/volume/cluster_five/output/summary_leveldb_5n_60t_i2_16KB_nosync.png "LevelDB") + ### Lies, damned lies etc @@ -90,11 +119,14 @@ Both leveled and leveldb are optimised for finding non-presence through the use So it is better to focus on the results at the tail of the tests, as at the tail the results are a more genuine reflection of behaviour against the advertised test parameters. + Test Description | Hardware | Duration |Avg TPS | Delta (Overall) | Delta (Last Hour) :---------------------------------|:-------------|:--------:|----------:|-----------------:|-------------------: 8KB value, 60 workers, sync | 5 x i2.2x | 4 hr | 12,679.91 | + 70.81% | + 63.99% 8KB value, 100 workers, no_sync | 5 x i2.2x | 6 hr | 14,100.19 | + 16.15% | + 35.92% -8KB value, 50 workers, no_sync | 5 x d2.2x | 6 hr | 10,400.29 | + 8.37% | + 23.51% +8KB value, 50 workers, no_sync | 5 x d2.2x | 4 hr | 10,400.29 | + 8.37% | + 23.51% +4KB value, 100 workers, no_sync | 5 x i2.2x | 6 hr | 14,993.95 | - 10.44% | - 4.48% +16KB value, 60 workers, no_sync | 5 x i2.2x | 6 hr | 14,993.95 | + 80.48% | + 113.55% Leveled, like bitcask, will defer compaction work until a designated compaction window, and these tests were run outside of that compaction window. So although the throughput of leveldb is lower, it has no deferred work at the end of the test. Future testing work is scheduled to examine leveled throughput during a compaction window. diff --git a/test/volume/cluster_five/output/summary_leveldb_5n_60t_i2_16KB_nosync.png b/test/volume/cluster_five/output/summary_leveldb_5n_60t_i2_16KB_nosync.png new file mode 100644 index 0000000..b411e98 Binary files /dev/null and b/test/volume/cluster_five/output/summary_leveldb_5n_60t_i2_16KB_nosync.png differ diff --git a/test/volume/cluster_five/output/summary_leveled_5n_60t_i2_16KB_nosync.png b/test/volume/cluster_five/output/summary_leveled_5n_60t_i2_16KB_nosync.png new file mode 100644 index 0000000..ca6bdcb Binary files /dev/null and b/test/volume/cluster_five/output/summary_leveled_5n_60t_i2_16KB_nosync.png differ diff --git a/test/volume/cluster_four/output/summary_leveldb_5n_100t_i2_4KB_nosync.png b/test/volume/cluster_four/output/summary_leveldb_5n_100t_i2_4KB_nosync.png new file mode 100644 index 0000000..ef83156 Binary files /dev/null and b/test/volume/cluster_four/output/summary_leveldb_5n_100t_i2_4KB_nosync.png differ diff --git a/test/volume/cluster_four/output/summary_leveled_5n_100t_i2_4KB_nosync.png b/test/volume/cluster_four/output/summary_leveled_5n_100t_i2_4KB_nosync.png new file mode 100644 index 0000000..3631d8d Binary files /dev/null and b/test/volume/cluster_four/output/summary_leveled_5n_100t_i2_4KB_nosync.png differ