umgeher/leveled
0
Fork 0
Code Issues Pull requests Releases Activity Actions
527 commits 1 branch 0 tags 25 MiB
Commit graph

527 commits

This branch
This branch
All branches
Author SHA1 Message Date
martinsumner
444f96ddc4 Add more details to design overview 2017-02-10 15:13:53 +00:00
martinsumner
71d60005f3 Some more why answers 
These potential optimisations occupied a lot of time at the start, and
ultimately the desire to simplify rather than optimise won through.
 2017-02-10 11:09:32 +00:00
martinsumner
0e9cc22d3d Merge remote-tracking branch 'refs/remotes/origin/master' into mas-docs2 2017-02-10 10:46:00 +00:00
martinsumner
5ae93ecb17 Merge pull request #23 from martinsumner/mas-pclerkcrash-3 
Mas pclerkcrash 3
 2017-02-10 00:33:39 +00:00
martinsumner
8077c70486 More conservative approach to ongoing work monitoring 
As per comments though - if we auto-restart pclerk in the future this
will have to be re-considered.

Perhaps a re-starting pclerk should force some reset of this boolean on
startup perhaps by making a different work_for_clerk if in a virgin
state.
 2017-02-09 23:49:12 +00:00
martinsumner
793977b76c Prevent double work ongoing 
This was the cause of the pclerk crash.  The concurrent work would lead
to the attempt to re-fetch the prompted deletions after they had been
deleted.
 2017-02-09 23:41:28 +00:00
martinsumner
b12cd13bba Merge pull request #22 from martinsumner/mas-pclerkcrash-2 
is_empty not in OTP16
 2017-02-09 21:19:12 +00:00
martinsumner
05b2d8faaf is_empty not in OTP16 
bloody OTP16 strikes again - is_empty isn't there
 2017-02-09 21:12:01 +00:00
martinsumner
62a39936a5 Merge pull request #21 from martinsumner/mas-pclerkcrash 
Resolve pclerk crash
 2017-02-09 16:03:55 +00:00
martinsumner
adb78f5c5a Resolve pclerk crash 
Need to add extra logging to understand why pclerk crashes in some
volume tests.

Penciller's Clerk <0.813.0> shutdown now complete for reason
{badarg,[{dict,fetch,[63,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}}],[{file,[100,105,99,116,46,101,114,108]},{line,126}]},{leveled_pclerk,handle_cast,2,[{file,[115,114,99,47,108,101,118,101,108,101,100,95,112,99,108,101,114,107,46,101,114,108]},{line,96}]},{gen_server,handle_msg,5,[{file,[103,101,110,95,115,101,114,118,101,114,46,101,114,108]},{line,604}]},{proc_lib,init_p_do_apply,3,[{file,[112,114,111,99,95,108,105,98,46,101,114,108]},{line,239}]}]}

Should only be prompted after prompt deletions had bene updated.
Perhaps a race whereby somehow it is prompted again after it is emptied.
 2017-02-09 14:33:39 +00:00
martinsumner
33b7855c68 More docs stuff 2017-02-08 17:14:28 +00:00
martinsumner
ac3c5ab5cc Corrections, more text 2017-02-08 17:11:51 +00:00
martinsumner
ea9a5fab26 More volume results 2017-02-08 17:01:27 +00:00
martinsumner
1a8b77e87b Additional text on naming 2017-02-08 16:39:58 +00:00
martinsumner
ab19fe74b4 Correct file references 2017-02-08 16:28:23 +00:00
martinsumner
d6a45d7754 Correct docs 
Following feedback from RDB
 2017-02-08 16:22:58 +00:00
martinsumner
5d8095018f Merge pull request #20 from martinsumner/mas-introduction 
Mas introduction
 2017-02-02 17:17:54 +00:00
martinsumner
4c9894781a Corrections 2017-02-02 17:16:33 +00:00
martinsumner
6570f8dfc6 Typo 2017-02-02 16:15:59 +00:00
martinsumner
143f3d0e65 Add why section 2017-02-02 16:11:46 +00:00
martinsumner
ca222684c7 More edits 2017-02-02 15:13:49 +00:00
martinsumner
ae4404b6e4 Ongoing edits 2017-02-02 15:06:15 +00:00
martinsumner
cc010b22f5 Note on scale difference 2017-02-02 13:13:30 +00:00
martinsumner
02bb60cc1f Title change 2017-02-02 13:10:45 +00:00
martinsumner
b87bf88df5 Further test info 2017-02-02 13:09:04 +00:00
martinsumner
b5ef0d8fd5 Split out pre-riak test report 2017-02-02 13:05:09 +00:00
martinsumner
1e2db49af3 Add emphasis 2017-02-02 12:59:33 +00:00
martinsumner
c533e829ff Add charts from Riak cluster testing 2017-02-02 12:57:50 +00:00
martinsumner
e22e2c42c8 side-by-side compairson 2017-02-02 12:30:42 +00:00
martinsumner
946edaef30 Initial draft of volume test writeup 2017-02-02 12:25:59 +00:00
martinsumner
92df0402ca Edits 2017-02-02 12:14:51 +00:00
martinsumner
bef791a8f8 Edits 2017-02-02 12:06:23 +00:00
martinsumner
e55571697a Extend the Intro 2017-02-02 12:01:14 +00:00
martinsumner
7cfbbc30fc Tidy docs 2017-02-02 11:17:52 +00:00
martinsumner
cbe663ebb6 Clean-up readme 2017-02-02 11:16:21 +00:00
martinsumner
3330b39b73 Ongoing work on documents 2017-02-01 13:58:09 +00:00
martinsumner
f55753cfc3 First draft 2017-01-31 13:21:52 +00:00
martinsumner
67d372e051 Merge pull request #19 from martinsumner/mas-tinybloom 
Mas tinybloom
 2017-01-25 12:46:11 +00:00
martinsumner
7320b34681 Comment update 2017-01-25 12:38:33 +00:00
martinsumner
684f1bcd99 Increase bloom size 2017-01-25 01:07:15 +00:00
martinsumner
10a64b86be Remove rogue timestamp 2017-01-24 21:53:43 +00:00
martinsumner
d57b74d967 Re-introduce tinybloom to SST 
This had been removed due to the CPU cost of adding - however then the
tinybloom wa simplemented by directly manipulating bits through binary
comprehension - rather than applying bor band bsl bsr operations.

With these operations the cost of producing and checking the bloom is
<10% by comparison.
 2017-01-24 21:51:12 +00:00
Martin Sumner
f8f2e02d92 Use bel for powers of two 
D’oh.  That’s much much faster of course!
 2017-01-24 18:09:51 +00:00
martinsumner
8c3d0fc493 Alternate implementation 2017-01-24 17:15:39 +00:00
martinsumner
9d95057518 Do it daft way - will it be faster? 2017-01-24 17:00:30 +00:00
martinsumner
93448b76ba Add some extra length checks 2017-01-24 15:49:19 +00:00
martinsumner
a8488663c7 Alternate tinybloom 
Previously the code had used a tiny bloom - but this proved to be
expensive to build.  Looking at the alternative of a slot-size only tiny
bloom
 2017-01-24 15:48:12 +00:00
martinsumner
266e851a96 Merge pull request #18 from martinsumner/mas-leveledtree 
Mas leveledtree
 2017-01-24 02:39:24 +00:00
martinsumner
d225f4d7f5 Add use of leveled_tree to sst summary 2017-01-23 22:58:51 +00:00
martinsumner
1102133723 Use skpl as ledger_cache 
Under assumption that it generates less GC noise (based on
micro-benchmark in leveled_tree eunit testing).

Note to confirm, needed to swap around the test order, and this showed
less collections in each position for skpl - and a < 10% performance hit
 2017-01-23 21:45:34 +00:00