umgeher/leveled
0
Fork 0
Code Issues Pull requests Releases Activity Actions

Rolback hash|no_hash and batch journal compaction

Browse source 
The no_hash option in CDB files became too hard to manage, in particular
the need to scan the whole file to find the last_key rather than cheat
and use the index.  It has been removed for now.

The writing to the journal during journal compaction has now been
enhanced by a mput option on the CDB file write - so it can write each
batch as one pwrite operation.
This commit is contained in:
martinsumner 2016-10-26 11:39:27 +01:00
parent 97087a6b2b
commit 2a47acc758
5 changed files with 103 additions and 68 deletions
Download patch file Download diff file Expand all files Collapse all files

8
src/leveled_codec.erl
View file

@ -143,9 +143,9 @@ to_ledgerkey(Bucket, Key, Tag) ->
to_inkerkv(LedgerKey, SQN, to_fetch, null) ->
{{SQN, ?INKT_STND, LedgerKey}, null, true};
to_inkerkv(LedgerKey, SQN, Object, KeyChanges) ->
{InkerType, HashOpt} = check_forinkertype(LedgerKey, Object),
InkerType = check_forinkertype(LedgerKey, Object),
Value = create_value_for_journal({Object, KeyChanges}),
{{SQN, InkerType, LedgerKey}, Value, HashOpt}.
{{SQN, InkerType, LedgerKey}, Value}.
%% Used when fetching objects, so only handles standard, hashable entries
from_inkerkv(Object) ->
@ -192,9 +192,9 @@ split_inkvalue(VBin) ->
end.
check_forinkertype(_LedgerKey, delete) ->
{?INKT_TOMB, no_hash};
?INKT_TOMB;
check_forinkertype(_LedgerKey, _Object) ->
{?INKT_STND, hash}.
?INKT_STND.
create_value_for_journal(Value) ->
case Value of