Commit graph

144 commits

Author SHA1 Message Date
Martin Sumner
ed0301e2cf
Mas i335 otp24 (#336)
* Address OTP24 warnings, ct and eunit paths

* Reorg to add OTP 24 support

* Update VOLUME.md

* Correct broken refs

* Update README.md

* CI on all main branches

Co-authored-by: Ulf Wiger <ulf@wiger.net>
2021-05-25 13:41:20 +01:00
Martin Sumner
0690136ab2 Clarify how the new option will be controlled in Riak 2020-11-27 03:01:38 +00:00
Martin Sumner
b4c79caf7a Allow for caching of compaction scores
Potentially reduce the overheads of scoring each file on every run.

The change also alters the default thresholds for compaction to favour longer runs (which will tend towards greater storage efficiency).
2020-11-27 02:35:27 +00:00
Martin Sumner
48aad689f4
Update FUTURE.md
Confirm previous list of needs for production readiness have now been met
2020-08-18 14:10:28 +01:00
Martin Sumner
e175948378 Remove references ot 'skip' strategy
Now called `recovr`
2020-03-26 14:25:09 +00:00
Martin Sumner
20a7a22571 Add documentation for recalc option 2020-03-24 20:21:44 +00:00
Martin Sumner
2741c46daa Add timeout for inker snapshots
So that they can also be released if they silently crash without closing neatly.
2018-12-14 13:53:36 +00:00
Martin Sumner
fe177f306d Update docs 2018-12-07 11:42:59 +00:00
Martin Sumner
578a9f88e0 Support for log settings at startup
Both log level and forced_logs.  Allows for log_level to be changed at startup ad runtime.  Also allow for a list of forced logs, so if log_level is set > info, individual info logs can be forced to be seen (such as to see stats logs).
2018-12-05 00:17:39 +00:00
Martin Sumner
3df481941f Record time to calculate compation run
As this is a factor in assessing suitability of Journal size
2018-09-26 10:19:24 +01:00
Martin Sumner
8d8a0a3f5b Improve explanation of max_journal_size
Tighten guidance with regards to very small values, which aren't expected to make sense
2018-09-26 09:37:50 +01:00
Russell Brown
77ade3b194 Explain max_journalsize more fully 2018-09-10 16:29:30 +01:00
Martin Sumner
cd7e64712b Add description 2018-09-09 18:17:19 +01:00
Martin Sumner
499a30716b Head only mode 2018-09-03 09:54:45 +01:00
Martin Sumner
0796a372d0 Add docs for journal compaction startup options 2018-07-23 13:59:24 +01:00
Martin Sumner
1ed37a8ab0 Typos 2018-05-02 15:50:10 +01:00
Martin Sumner
ef9ac57c5e Add information on startup options 2018-05-02 15:48:16 +01:00
Martin Sumner
6ed40ad959 Add some further details - IndexNs
Following discussions with Russell, try and explain the as-is status of hashtrees a bit more clearly
2018-03-16 14:45:17 +00:00
Martin Sumner
75467be642 Initial re-wording to reflect low-level design changes
This might change back again.  It is easier to make the KeyStore and TreeCaches to manage more directly the rebuild process.  The only issue is whther this would "lock up" thevnode should the vnode ever wait on a response for example for a tree root (when the TreeCache is finishing the load)
2018-03-05 11:08:17 +00:00
Martin Sumner
c6b3fe78f4 Add 24 Hour Test results 2018-03-02 09:47:34 +00:00
Martin Sumner
6f9d7e8fc1 Merge branch 'master' into mas-i115-simplettcache 2018-03-02 09:35:34 +00:00
Martin Sumner
cb8fe0c2d3
Update VOLUME.md 2018-02-26 15:54:49 +00:00
Martin Sumner
002f060808 Add Phase 6 Volume overview
Initial test from phase 6 - real hardware
2018-02-26 15:36:01 +00:00
Pedram Nimreezi
6e525de76b
Update GENERAL_TICTACAAE_FOR_RIAK.md
Just a small typo
2018-02-19 14:40:25 -05:00
Pedram Nimreezi
aad21c3a34
Update ANTI_ENTROPY.md
Small typo
2018-02-19 14:21:27 -05:00
Martin Sumner
a91726f990 More details on rebuilds/rehashes 2018-02-17 11:45:19 +00:00
Martin Sumner
7751be1431 Initial write-up
... of what we're trying to achieve
2018-02-16 15:09:03 +00:00
Martin Sumner
fea87c21ec Notes testing on non-compressed L1 2017-12-04 13:08:24 +00:00
Martin Sumner
9a6cfa6522 Typos 2017-12-01 14:24:00 +00:00
Martin Sumner
e59f051c54 Further details on merge time 2017-11-30 13:59:32 +00:00
Martin Sumner
54e2e2344c Further review
Looks like we have idnetified the real CPU burner.  But how to address?
2017-11-30 13:41:12 +00:00
Martin Sumner
7581c4eba3 Update HeadTime charts 2017-11-29 14:46:24 +00:00
Martin Sumner
ad36578434 Add updated HeadTime charts 2017-11-29 14:31:07 +00:00
Martin Sumner
676879a335 Start of write-up on latency 2017-11-28 19:03:06 +00:00
Martin Sumner
056e65ff74 Edited for clarity 2017-09-29 10:28:35 +01:00
Martin Sumner
855b1d3ad8 More edits 2017-09-28 20:23:29 +01:00
Martin Sumner
ed9a444805 Initial edits, more info on cache experiment 2017-09-28 20:14:18 +01:00
Martin Sumner
e81a53b539 Initial draft of option comparison
n HEADs and 1 GET

or

1 GET and n-1 HEADs
2017-09-28 20:04:21 +01:00
Martin Sumner
9f97c82d0d Add import/export support
Also fix for fold_heads unit tests to reflect new booleans required by changes to support there use in MapFolds
2017-08-16 16:58:38 +01:00
Martin Sumner
9aaa144f7a Major mixup!
Got my leveled and leveldb results the wrong way round.
2017-08-11 11:13:43 +01:00
Martin Sumner
bfb77eacf7 Clarify on AAE locks 2017-08-10 17:15:27 +01:00
Martin Sumner
e91a3034df Update volume chart
Looks better this way
2017-08-10 16:46:56 +01:00
Martin Sumner
107c28b385 Add comparison of just adding AAE
Provide some actual measurement of the cost of turning on active AAE.  It is higher than I expected!
2017-08-10 16:41:32 +01:00
Martin Sumner
22709abcd6 Buit what if build initiated during fold 2017-08-04 18:35:16 +01:00
Martin Sumner
bea40ffc72 More info on hashtree locks 2017-08-04 18:30:29 +01:00
Martin Sumner
76692ae589 The problem of the lock
Still need to investigate behaviour under get_lock()
2017-08-04 16:30:25 +01:00
Martin Sumner
b99539fc8a Add most recent thoughts on implementation
Especially how to manage alternate backends to leveled
2017-08-04 16:19:40 +01:00
Martin Sumner
f9b61fb5e7 Minor edit 2017-08-01 14:01:41 +01:00
Martin Sumner
82a1619846 Mini edit 2017-08-01 13:25:50 +01:00
Martin Sumner
a046666e4a Add further stats 2017-08-01 13:23:10 +01:00