martinsumner
96b9e1faa3
Initial Commit for SkipLists
...
To speed check on alternate platform
2016-11-22 23:21:47 +00:00
martinsumner
e06888ad58
Merge pull request #5 from martinsumner/initial-setup
...
Correctly set array type
2016-11-21 22:27:42 +00:00
martinsumner
638fc69e01
Correctly set array type
...
Otherwise cannot compile in both OTP 16 and 17
2016-11-21 22:26:12 +00:00
martinsumner
4099f05616
Merge pull request #4 from martinsumner/initial-setup
...
Initial setup
2016-11-21 19:29:25 +00:00
martinsumner
51dbad95c0
Change FoldBucketsFun to take just bucket
...
FoldBucketsFun does not take keys should be a 2-arity function (Bucket,
Acc).
2016-11-21 14:12:17 +00:00
martinsumner
acdc702e7d
Check not snap
...
Make sure snapshots cannot trigger deletion
2016-11-21 12:35:20 +00:00
martinsumner
0f7e421371
Add destruction
...
Allow a store to be cleared out and destroyed
2016-11-21 12:34:40 +00:00
martinsumner
386d40928b
Fast List Buckets
...
Copied the technique from HanoiDB to speed up list buckets.
2016-11-20 21:21:31 +00:00
martinsumner
f40ecdd529
Pick-up test misses
...
There were some coverage misses in tests, so check in unit test coverage
or remove branches not currently needed.
2016-11-18 21:35:45 +00:00
martinsumner
427b97873c
Change FoldKeysFun
2016-11-18 17:58:43 +00:00
martinsumner
57727e74f9
D'oh
2016-11-18 17:14:01 +00:00
martinsumner
f5944f2466
Change test foler to return (Bucket, Key} as expeceted
2016-11-18 16:52:53 +00:00
martinsumner
ec18f9ab4c
Uncomment test
2016-11-18 16:34:16 +00:00
martinsumner
6684e8e1d3
Refine query to accept fold functions
...
Need to be able to pass external fold functions into different queries,
to work as a Riak backend
2016-11-18 15:53:22 +00:00
martinsumner
ac223ced68
Add FoldKeysFun
...
Add the capability to pass FoldKeysFun into the index_query to allow for
compatability with riak backend requirements.
2016-11-18 11:53:14 +00:00
martinsumner
e3004faa6e
Add support for folding keys on a single bucket
2016-11-17 15:55:29 +00:00
Martin Sumner
67a9f5bae6
Initial Load Tests with results
...
Initial tests run comparing throughput when first populating and then
loading data into levelled and eleveledb.
The tests were run in series, populating first and then loading. The
population tests were run again in-between to try and add a roughly
even underlying volume into the stores.
The initial tests were run on on a quad core iMac with 8GB of RAM and a
fusion drive. Due to the limited footprint of the hardware, the number
of concurrent database instances was reduced to 12, rather than the 32
in the off0the-shelf leveldb test.
2016-11-17 08:20:17 +00:00
martinsumner
0fc1a20f27
Redme readability
2016-11-15 20:26:18 +00:00
martinsumner
5c9b999eb5
Readability improvements
2016-11-15 13:28:52 +00:00
martinsumner
aa355a0aae
Coverage cheat pt 2
2016-11-14 20:56:59 +00:00
martinsumner
8cbe2ef93a
Coverage cheats
...
You juke the stats, and majors become colonels. I've been here before
2016-11-14 20:43:38 +00:00
martinsumner
630f802780
Inker Close nastiness
...
Try to stop some of the potential deadlocking around Inker close and
prove that snapshots at higher Manifest SQNs can be ignored
2016-11-14 19:34:11 +00:00
martinsumner
75d6af75c6
Penciller review
...
The penciller attempt to close the L0 file if pending was unpredictable
in behaviour. If a L0 file is still pending it will be lost - but this
is at least a predictable event.
2016-11-14 17:18:28 +00:00
martinsumner
eb76a6dbcd
Multi-key test
...
Now failing with timeout coverage enabled. 100 keys is unnecessray so
reduce to 20 per loop, but suspect this is another issue
2016-11-14 12:43:45 +00:00
martinsumner
c0e1455430
Remove PromptDelete
...
Now that deleted journals are stored in waste for the retention period -
don't worry about deleting them
2016-11-14 11:40:02 +00:00
martinsumner
44738f7c75
Deferred Deletion of Journals
...
This allows for deleted journals to be retained for a period (the
waste_retnetion_period). The idea being that a backup strategy can
ensure that all journals are backed up, even ones created and removed
from within a backup period - so that any restore pont is possible.
This is also a pre-cursor to removing some of the PromptDelete
complexity from the Inker Clerk - all compactions can prompt deletion as
deletion is now deferred.
2016-11-14 11:17:14 +00:00
martinsumner
dbb840d75e
Ooops - test commenting
2016-11-09 22:06:02 +00:00
martinsumner
16c424cd7b
Add tombstone to compaction problem
...
Minor test refinement
2016-11-09 20:03:44 +00:00
martinsumner
3d737dcf3c
More sensible test assertion
...
Also better for test coverage stats
2016-11-09 19:38:02 +00:00
martinsumner
2458a90fb3
Remove overlapped case clause
2016-11-09 16:35:13 +00:00
martinsumner
feb3c2a524
Add recovr strategy test
2016-11-09 16:27:47 +00:00
martinsumner
3a77591da9
Removed unnecessary timeout condition from rolling state in CDB
2016-11-09 00:14:57 +00:00
martinsumner
0cf96e7198
Removed daft last function from SFT
2016-11-09 00:13:52 +00:00
martinsumner
0905ea51e2
Further corrupt file unit test for CDB
2016-11-08 23:07:03 +00:00
martinsumner
cc3cbc983b
Tidy up closure of CDB Files
2016-11-08 22:43:22 +00:00
martinsumner
eedf5d85b0
Update readme text
2016-11-08 01:12:49 +00:00
martinsumner
8b8652e2d7
Coverage Tests
...
Add nonsense tests for nonsense coverage on standard methods.
Look at CDB search_hash_table - looks like it doubled-up on break-outs
so that one would never get hit
2016-11-08 01:03:09 +00:00
martinsumner
b43ec0de7e
Fix the fix
2016-11-08 00:46:01 +00:00
martinsumner
6f0abea401
Stop unncessary handling of pending_delete in test
2016-11-08 00:44:51 +00:00
martinsumner
105d3b66f2
Add hash clash unit tests
...
Add unit tests for keys with clashing hashes
2016-11-07 23:53:14 +00:00
martinsumner
b47f8963d5
Speed of corrupted sft unit test
...
Test too slow when running with coverage
2016-11-07 19:20:46 +00:00
martinsumner
5a36f053d9
End-to-end testing of corrupted bloom
...
Add a unit test calling the API of a SFT file clerk with a corrupted
bloom
2016-11-07 18:26:55 +00:00
martinsumner
05338a1e85
Switch SFT to fsm
...
To amke it easier to context switch between the two file formats, make
the SFT file clerk a FSM like the CDB one.
2016-11-07 17:08:50 +00:00
martinsumner
aacf377f0a
Provide project summary
2016-11-07 15:02:09 +00:00
martinsumner
b9090a3109
Testutil and pause
2016-11-07 12:19:17 +00:00
martinsumner
e2670e6e8c
Testutil and Pause
...
Part of the testutil code is not recognising pause
2016-11-07 12:18:00 +00:00
martinsumner
485ea3bfab
Merge pull request #3 from martinsumner/initial-setup
...
Initial setup - Further tidy
2016-11-07 11:18:57 +00:00
martinsumner
8035583301
Comment review
2016-11-07 11:17:13 +00:00
martinsumner
079e713e16
Comment fiddling
2016-11-07 11:07:12 +00:00
martinsumner
6bf72849bc
Comments reviewed
2016-11-07 11:02:38 +00:00
