umgeher/leveled
0
Fork 0
Code Issues Pull requests Releases Activity Actions
1413 commits 1 branch 0 tags 25 MiB
Commit graph

1413 commits

This branch
This branch
All branches
Author SHA1 Message Date
Martin Sumner
10f250e4be Update leveled.schema 
To set log level
 2019-02-13 14:36:45 +00:00
Martin Sumner
31badfd601 Log rationalisation and format improvements 2019-02-13 13:06:28 +00:00
Martin Sumner
baa8353db7 Issue 243 2019-02-13 11:15:38 +00:00
Martin Sumner
2061ff85db Revert "Resolve Issue 243" 
This reverts commit 0b0fde2f23.
 2019-02-13 11:14:48 +00:00
Martin Sumner
0b0fde2f23 Resolve Issue 243 2019-02-13 11:10:56 +00:00
Martin Sumner
5563510da7
Merge pull request #253 from martinsumner/mas-i249-sstcloseraces 
Mas i249 sstcloseraces
 2019-01-29 15:32:06 +00:00
Martin Sumner
509d541c9f Allow for false to close not crash 
If PID has gone away
 2019-01-29 13:46:25 +00:00
Martin Sumner
be6e23f7de Change cache_size in sst tests 
Makes results more predictable (with coin toss variations)
 2019-01-29 13:40:55 +00:00
Martin Sumner
51a0260a60 Get new file to check initiater is alive 
If no activity within timeout.  Make sure that the process has been orphaned by pclerk ending before manifest entry update made.
 2019-01-29 13:18:39 +00:00
Martin Sumner
e5a5da35eb Level Zero constructor to get close 
Allows for the L0 constructor to be closed (even though not yet in the manifest) on shutdown
 2019-01-29 13:06:00 +00:00
Martin Sumner
b12b6e4c91
Merge pull request #252 from martinsumner/mas-i249-iclerkandconfig 
Mas i249 iclerkandconfig
 2019-01-28 08:56:36 +00:00
Martin Sumner
e3bd83179a Uncomment tests! 2019-01-27 23:31:44 +00:00
Martin Sumner
db0db67c45 Delete leveledjc_eqc.erl 
Remove this for now, until issues with running tests without QC installed can be resolved.

Allow for changes to support QC to be merged into master.
 2019-01-27 22:09:48 +00:00
Martin Sumner
8f6862a10b Test sst slot configuration change 
Confirm it results in many more files, if the slot count reduced.  Has to handle the fact that Level 0 file has unlimited slots regardless of number of slots configured
 2019-01-27 22:03:55 +00:00
Martin Sumner
ae9b03ab3c Fix unit tests - and make slot size configurable 2019-01-26 16:57:25 +00:00
Martin Sumner
f907fb5c97 Close in all cases 
in leveled_imanifest
 2019-01-25 19:27:42 +00:00
Martin Sumner
a04ed53855 Merge branch 'mas-qc-inkercompaction' of https://github.com/martinsumner/leveled into mas-qc-inkercompaction 2019-01-25 19:11:37 +00:00
Martin Sumner
f7022627e5 Check not pending before compacting 
Also check for existence before deleting a CDB file
 2019-01-25 19:11:34 +00:00
Martin Sumner
a41183b8cb
Merge pull request #251 from martinsumner/mas-i249-iclerkfsm 
Mas i249 iclerkfsm
 2019-01-25 15:16:08 +00:00
Martin Sumner
c9a955f2dd
Merge branch 'mas-qc-inkercompaction' into mas-i249-iclerkfsm 2019-01-25 15:15:29 +00:00
Martin Sumner
5b54affbf0 Have inker reopen compacted files 
The inker cler will now close compacted files before prompting the inker to update the manifest.  The inker should reopen those files, so that the file processes are linked to it and not the clerk.

This also stops a stopped clerk leading to orphaned cdb files.
 2019-01-25 14:32:41 +00:00
Martin Sumner
e349774167 Allow clerk to be stopped during compaction scoring 
This will stop needless compaction work from being completed when the iclerk is sent a close at this stage.
 2019-01-25 12:11:42 +00:00
Martin Sumner
5fab9e2d62 Update .gitignore 2019-01-25 10:25:55 +00:00
Martin Sumner
7801f16de9 Update .gitignore 2019-01-25 10:24:47 +00:00
Martin Sumner
2c1503b6b5
Merge pull request #250 from martinsumner/mas-i249-iclerkshutdown 
Mas i249 iclerkshutdown
 2019-01-25 09:54:14 +00:00
Martin Sumner
00a59f4f8f
Merge branch 'mas-qc-inkercompaction' into mas-i249-iclerkshutdown 2019-01-25 09:53:56 +00:00
Martin Sumner
0333604fd9 Change to cast in inker/iclerk interaction 
This allows for leveled_iclerk:clerk_stop to be a sync call, so that files will only be closed once the iclerk has stopped.  This is designed ot prevent iclerk crashes during shutdowns when files it is depnding on are closed mid shutdown.
 2019-01-24 21:32:54 +00:00
Martin Sumner
28d0aef5fe Make check that compaction not ongoing before accepting new compaction 
Respond 'busy' if compaction is ongoing
 2019-01-24 15:46:17 +00:00
Martin Sumner
c9bf43953b Expect TS in snapshot references from manifest 
Add type to prevent re-occurence.  This is also detected by failure in eqc tests.
 2019-01-24 14:32:01 +00:00
Martin Sumner
a13a6ae45f Updated model 
This has inappropriate default parameter changes.
 2019-01-22 12:53:31 +00:00
Martin Sumner
b713ce60a8 Initial eqc setup 2019-01-21 10:51:07 +00:00
Martin Sumner
67104c85c1
Merge pull request #248 from martinsumner/mas-i246-dotdotwhy 
Change file references in unit tests
 2019-01-17 21:03:20 +00:00
Martin Sumner
7f08fd5a68 Change file references in unit tests 
Write into test folder within the repo, not outside of it.  Try and resolve issues wiht make test in riak
 2019-01-17 21:02:29 +00:00
Martin Sumner
3e75eb3647
Merge pull request #247 from martinsumner/mas-i246-maketestfail 
Remove pointless test
 2019-01-17 11:31:17 +00:00
Martin Sumner
86128ddf56 Remove pointless test 
Was testing a test admin function for coverage reasons
 2019-01-17 11:30:50 +00:00
Martin Sumner
267e103e58
Merge pull request #245 from martinsumner/mas-i244-startupcachesizes 
Mas i244 startupcachesizes
 2019-01-14 18:48:39 +00:00
Martin Sumner
a4d89ad6d1 Add log of higher than expected ratio of cache sizes 
Warn at startup if this ratio is high.  Not sure how snapshots will perform if there are a lot of ledger cache sin the list.  However, it should still work.  basic_SUITE/load_count test intended to demonstrate that a large ratio is still functional
 2019-01-14 16:11:04 +00:00
Martin Sumner
c060c0e41d Handle L0 cache being full 
A test thta will cause leveled to crash due to a low cache size being set - but protect against this (as well as the general scenario of the cache being full).

There could be a potential case where a L0 file present (post pending) without work backlog being set.  In this case we want to roll the level zero to memory, but don't accept the cache update if the L0 cache is already full.
 2019-01-14 12:27:51 +00:00
Martin Sumner
d5a9f2e8b7
Merge pull request #242 from martinsumner/mas-i241-eunitfailure 
Creating the file is unnecessary
 2018-12-18 16:27:38 +00:00
Martin Sumner
e77451f60b Creating the file is unnecessary 2018-12-18 16:26:48 +00:00
Martin Sumner
0a43d696f9
Merge pull request #240 from martinsumner/mas-i239-schemaalign 
Correct defaults
 2018-12-18 11:23:27 +00:00
Martin Sumner
32ea4380b2 correct defaults 2018-12-18 11:22:25 +00:00
Martin Sumner
420322c14f
Merge pull request #238 from martinsumner/mas-innn-schemamixup 
Typo
 2018-12-14 22:43:46 +00:00
Martin Sumner
8ccb985775 Typo 2018-12-14 22:43:21 +00:00
Martin Sumner
d246fd363e
Merge pull request #237 from martinsumner/mas-i233-multibackend 
Mas i233 multibackend
 2018-12-14 22:00:03 +00:00
Martin Sumner
5b578ea2bb Add new snapshot timeout to multi-backend 2018-12-14 19:57:32 +00:00
Martin Sumner
e6d868f8cd Merge branch 'master' into mas-i233-multibackend 2018-12-14 19:55:34 +00:00
Martin Sumner
534fcdb1b6
Merge pull request #236 from martinsumner/mas-i234-snapshottimeout 
Mas i234 snapshottimeout
 2018-12-14 19:49:06 +00:00
Martin Sumner
ceea196cc0 Update priv/leveled.schema 
The snapshottimeouts would not normally eb changed - so make them hidden
 2018-12-14 14:27:44 +00:00
Martin Sumner
ef068326a0 Update priv/leveled.schema 2018-12-14 14:13:44 +00:00