martinsumner
400f65f557
Switch to binary metadata
...
Trya nd maintain binary format when stored in Ledger so less
swapping/changing as added and removed.
2017-04-04 10:02:35 +00:00
Martin Sumner
1335b11d82
Merge pull request #55 from martinsumner/mas-docs2i
...
Mas docs2i
2017-03-24 16:09:17 +00:00
martinsumner
5e1482d71b
2i query test results
...
Write-up of 2i query test results
2017-03-24 15:20:03 +00:00
martinsumner
97312e1356
Test to reflect vclock not binary
2017-03-21 18:28:28 +00:00
Martin Sumner
a2c164e1dd
Switch to binary vclock
2017-03-20 22:44:19 +00:00
Martin Sumner
994d9758b0
Object now 4 bytes larger
...
due to addition of key changes length
2017-03-20 16:21:49 +00:00
martinsumner
32cdf26ffb
Correct to catch new response to snapshot request
2017-03-06 19:37:43 +00:00
martinsumner
db73ecf26c
Add bitcask volume test results
2017-02-28 21:19:46 +00:00
martinsumner
842639a90a
Add smaller/larger object size test results
2017-02-27 23:04:31 +00:00
martinsumner
41e5686a66
Test coverage - missing 1%
2017-02-26 20:52:40 +00:00
martinsumner
27a819c04e
Chart fix
2017-02-26 12:52:56 +00:00
martinsumner
c45e50e195
Update volume testing results
2017-02-26 12:50:16 +00:00
martinsumner
7ee26fc78c
Filename change
2017-02-22 18:25:54 +00:00
martinsumner
5ad1e39f69
Alter volume charts to fixed axis with clearer delta
2017-02-22 18:22:08 +00:00
martinsumner
ec021d73e3
Fixed axis charts
...
Also compariosn betwen 6 hour and 8 hour tests
2017-02-21 12:10:05 +00:00
martinsumner
ede93c5bb6
Putting charts on fixed axis
2017-02-21 11:49:06 +00:00
martinsumner
79f927c4fc
Change charts to be fixed axis comparison
...
Also removed 99.9th percentile
2017-02-21 11:29:57 +00:00
martinsumner
0bbcac0460
Add more volume test details
2017-02-20 12:06:24 +00:00
martinsumner
ea9a5fab26
More volume results
2017-02-08 17:01:27 +00:00
martinsumner
c533e829ff
Add charts from Riak cluster testing
2017-02-02 12:57:50 +00:00
martinsumner
946edaef30
Initial draft of volume test writeup
2017-02-02 12:25:59 +00:00
martinsumner
0ddaaf9ac3
Stopped unnecessary seek for last_key
...
When rolling we already know the last_key - no need to seek for it on
startup.
The time it takes for this seek needs to be considered with regards to
startup time. Can we do without knowing lastkey?
2016-12-22 19:51:39 +00:00
martinsumner
9e28287231
Resolve failing recovery test
...
Now passing consistently with a number of different corruptions catered
for (including corruption of the Tag in the Inker Key)
2016-12-16 23:18:55 +00:00
martinsumner
3417baa3b8
Simple test
...
To try and pinpoint any issue with _int index (as seen in Riak
integrtaion testing)
2016-12-02 17:39:28 +00:00
martinsumner
b62b38caa6
Tidy up test at end
...
May cause issues otherwise if there is an attempt to corrupt the journal
running in another bookie
2016-11-28 23:00:12 +00:00
martinsumner
e8c1d39df9
Switch to binary format Riak object
...
Initial change to try and test assuming that leveled received the binary
format of Riak objects (and parses that for metadata).
2016-11-28 22:26:09 +00:00
martinsumner
45f7fcb41a
Datasync added for riak_sync strategy
2016-11-27 00:16:49 +00:00
martinsumner
196c807b5e
Pass through sync_strategy
...
Allow to switch for Riak to use o_sync as the sync flag rather than sync
2016-11-25 17:41:08 +00:00
martinsumner
51dbad95c0
Change FoldBucketsFun to take just bucket
...
FoldBucketsFun does not take keys should be a 2-arity function (Bucket,
Acc).
2016-11-21 14:12:17 +00:00
martinsumner
0f7e421371
Add destruction
...
Allow a store to be cleared out and destroyed
2016-11-21 12:34:40 +00:00
martinsumner
386d40928b
Fast List Buckets
...
Copied the technique from HanoiDB to speed up list buckets.
2016-11-20 21:21:31 +00:00
martinsumner
427b97873c
Change FoldKeysFun
2016-11-18 17:58:43 +00:00
martinsumner
57727e74f9
D'oh
2016-11-18 17:14:01 +00:00
martinsumner
f5944f2466
Change test foler to return (Bucket, Key} as expeceted
2016-11-18 16:52:53 +00:00
martinsumner
ec18f9ab4c
Uncomment test
2016-11-18 16:34:16 +00:00
martinsumner
6684e8e1d3
Refine query to accept fold functions
...
Need to be able to pass external fold functions into different queries,
to work as a Riak backend
2016-11-18 15:53:22 +00:00
martinsumner
ac223ced68
Add FoldKeysFun
...
Add the capability to pass FoldKeysFun into the index_query to allow for
compatability with riak backend requirements.
2016-11-18 11:53:14 +00:00
martinsumner
e3004faa6e
Add support for folding keys on a single bucket
2016-11-17 15:55:29 +00:00
Martin Sumner
67a9f5bae6
Initial Load Tests with results
...
Initial tests run comparing throughput when first populating and then
loading data into levelled and eleveledb.
The tests were run in series, populating first and then loading. The
population tests were run again in-between to try and add a roughly
even underlying volume into the stores.
The initial tests were run on on a quad core iMac with 8GB of RAM and a
fusion drive. Due to the limited footprint of the hardware, the number
of concurrent database instances was reduced to 12, rather than the 32
in the off0the-shelf leveldb test.
2016-11-17 08:20:17 +00:00
martinsumner
630f802780
Inker Close nastiness
...
Try to stop some of the potential deadlocking around Inker close and
prove that snapshots at higher Manifest SQNs can be ignored
2016-11-14 19:34:11 +00:00
martinsumner
44738f7c75
Deferred Deletion of Journals
...
This allows for deleted journals to be retained for a period (the
waste_retnetion_period). The idea being that a backup strategy can
ensure that all journals are backed up, even ones created and removed
from within a backup period - so that any restore pont is possible.
This is also a pre-cursor to removing some of the PromptDelete
complexity from the Inker Clerk - all compactions can prompt deletion as
deletion is now deferred.
2016-11-14 11:17:14 +00:00
martinsumner
dbb840d75e
Ooops - test commenting
2016-11-09 22:06:02 +00:00
martinsumner
16c424cd7b
Add tombstone to compaction problem
...
Minor test refinement
2016-11-09 20:03:44 +00:00
martinsumner
feb3c2a524
Add recovr strategy test
2016-11-09 16:27:47 +00:00
martinsumner
b9090a3109
Testutil and pause
2016-11-07 12:19:17 +00:00
martinsumner
e2670e6e8c
Testutil and Pause
...
Part of the testutil code is not recognising pause
2016-11-07 12:18:00 +00:00
martinsumner
8f068c1280
Fixup API to allow for Tags to be passed
...
plus fixes to previous commits moving API functions into testutil
2016-11-07 10:42:49 +00:00
martinsumner
37c23a5b38
Shift pause out of leveled
...
Leveled will now signal the need for a pause due to back-pressure, but
not actually pause itself. The hope is that in a riak implementation
this pause can be managed by the put_fsm, and so not lock the store.
2016-11-07 10:27:38 +00:00
martinsumner
4583460328
Clean API of Riak-specific Methods
...
Clena the API of Riak specific methods, and also resolve timing issue in
simple_server unit test. Previously this would end up with missing data
(and a lower sequence number after start) because of the penciller_clerk
timeout being relatively large in the context of this test. Now the
timeout has bene reduced the L0 slot is cleared by the time of the
close. To make sure an extra sleep has been added as a precaution to
avoid any intermittent issues.
2016-11-07 10:11:57 +00:00
martinsumner
a251f3eab0
Speed up query count test
...
Less individual querys to make count will speed up this taste, without
changing the nature of it
2016-11-04 18:20:00 +00:00
