Commit graph

1442 commits

Author SHA1 Message Date
Martin Sumner
b15fef8cf6 Add unit test of corrupted keys
To be detected in direct fetch
2018-09-27 14:20:13 +01:00
Martin Sumner
39e366a31b Add ct test
Which passes
2018-09-27 11:32:42 +01:00
Martin Sumner
0fb35e658f Add support for buckets that are tuples
Only {binary(), binary()} tuples
2018-09-27 09:34:40 +01:00
Martin Sumner
cbd7713c71
Merge pull request #188 from martinsumner/mas-i186-iclerkscore
Mas i186 iclerkscore
2018-09-26 17:36:43 +01:00
Martin Sumner
36537b4ae2 May need to wait longer for completion
As esting more keys
2018-09-26 15:38:43 +01:00
Martin Sumner
b2fce95b14 Add explainer to NaiveBestRun 2018-09-26 14:11:02 +01:00
Martin Sumner
7885f93ba6 Boost docs
Try and make this easier to follow with docs and specs
2018-09-26 14:07:44 +01:00
Martin Sumner
979c65f0af Merge branch 'mas-i185-docupdate' into mas-i186-iclerkscore 2018-09-26 13:33:07 +01:00
Martin Sumner
d9229c9782 Change score assessment
Wans't actually calculating scores correctly previously.
2018-09-26 12:56:28 +01:00
Martin Sumner
3df481941f Record time to calculate compation run
As this is a factor in assessing suitability of Journal size
2018-09-26 10:19:24 +01:00
Martin Sumner
8d8a0a3f5b Improve explanation of max_journal_size
Tighten guidance with regards to very small values, which aren't expected to make sense
2018-09-26 09:37:50 +01:00
Martin Sumner
908f762a48
Merge pull request #186 from martinsumner/mas-i185-emptyjournal
Mas i185 emptyjournal
2018-09-25 19:54:57 +01:00
Martin Sumner
0772317247 Test mistake
If random integer was low, total could be below threshold - so calculate total correctly.

Should make value re-generate random uniform, but test is still valid without this
2018-09-25 18:32:48 +01:00
Martin Sumner
051fcd672c Add test of switching from a big journal to a little journal
And sending objects over the journal size
2018-09-25 16:56:24 +01:00
Martin Sumner
ab74d5c0dd
Merge pull request #184 from martinsumner/mas-i183-thowinasyncfold
Mas i183 thowinasyncfold
2018-09-24 22:41:12 +01:00
Martin Sumner
f4b365438c Further comments in API docs 2018-09-24 20:43:21 +01:00
Martin Sumner
bed155761b Added comments
This is still a clumsy feature, in terms of implementation.

Is the fact that some folds handle a throw, and some don't an issue?
2018-09-24 20:05:48 +01:00
Martin Sumner
a9b097e392 Add a wrapper to fold_keys queries
Queries that in Riak will be based on fold_keys need to be able to catch throws, and re-throw them to be detected by the worker (whilst still clearing up the snapshot)
2018-09-24 19:54:28 +01:00
Martin Sumner
bcda272fb9
Merge pull request #182 from martinsumner/mas-i180-dollarbucketregex
Mas i180 dollarbucketregex
2018-09-24 16:37:25 +01:00
Martin Sumner
8f320a054e Add object deletion to test of dolerkey index
Related to tracking a failure in riak_test
2018-09-21 17:08:59 +01:00
Martin Sumner
37f784f041 Add regex tests for dollar bucket queries
Proce this works as well as for dollar key.  This isn't tested in riak_test currently, but seems illogical not to support it her eif it is supported on $key queries.
2018-09-21 15:17:29 +01:00
Martin Sumner
041e86fed9
Merge pull request #181 from martinsumner/mas-i180-dollarkeyregex
Mas i180 dollarkeyregex
2018-09-21 13:27:53 +01:00
Martin Sumner
ba93ea149f Account for slower tests in older Erlang versions
Tests run slower in OTP16 - so do less work in this version.
2018-09-21 13:27:10 +01:00
Martin Sumner
1a3d3daa89 Add regex support to $key index
Regex to be applied to key only
2018-09-21 12:04:32 +01:00
Martin Sumner
d27be07f67
Merge pull request #179 from martinsumner/mas-i178-bookhead
Mas i178 bookhead
2018-09-20 14:24:17 +01:00
Martin Sumner
d999bc1e4a Merge branch 'master' into mas-i178-bookhead 2018-09-20 12:08:46 +01:00
Martin Sumner
c439e4144a Add new book_headonly/4 API
To address special situation of performing a head requets in head_only mode - where a sub-key is a required input.
2018-09-20 12:08:33 +01:00
Martin Sumner
9c15a39023
Merge pull request #177 from martinsumner/rdb/quviq-i13-startkey-doc
Update docs for start key
2018-09-20 12:02:08 +01:00
Russell Brown
f12d277875 Update docs for start key
Quviq/leveled/issues/13 shows the confusion around the purpose of
start key. Hopefully this commit clarifies that start key is a further
refinement to the range start. It's essentially and AND.
2018-09-20 11:21:55 +01:00
Martin Sumner
f4a7a729ae
Merge pull request #175 from martinsumner/rdb/quviq-i15-regex-doc
Update docs to clarify that regex cannot be run on integers
2018-09-19 18:31:39 +01:00
Martin Sumner
572befbcfa
Merge pull request #176 from martinsumner/mas-i174-refactorsaferead
Refactor safe_read
2018-09-19 18:30:15 +01:00
Russell Brown
bc35a7aa1e Update docs to clarify that regex cannot be run on integers 2018-09-19 16:28:28 +01:00
Martin Sumner
e02c6df3ed Refactor safe_read
Make safe_read a bit more flexible,and allow it to catch a wider number of errors.
2018-09-19 13:03:00 +01:00
Martin Sumner
d088a6baf0
Merge pull request #173 from martinsumner/rdb/quviq-bug-9-bucket-fold
Callers of bucket list expect the traversal to be in order
2018-09-18 16:02:52 +01:00
Russell Brown
5a95e82af0 Callers of bucket list expect the traversal to be in order
Due to the internal fold over buckets returning an un-reversed
accumulator, the API bucketlist code caller's fold fun traversed the
bucket list in reverse order. This lead to some inconsistencies when
comparing a buckelist of all buckets, vs, first bucket only. i.e. the
'first' bucket passed to the foldfun was in fact the last bucket read
from the ledger.
2018-09-18 15:40:44 +01:00
Martin Sumner
b34c0ff072
Merge pull request #172 from martinsumner/mas-iq6-rootpathundefined
Mas iq6 rootpathundefined
2018-09-17 12:02:50 +01:00
Martin Sumner
63f208cd5f Merge branch 'master' into mas-iq6-rootpathundefined 2018-09-17 10:19:35 +01:00
Martin Sumner
2633286ec6
Merge pull request #171 from martinsumner/rdb-pp-quviq/test-obj-gen
For quviq and TA, helper for eqc object generation
2018-09-17 10:19:16 +01:00
Martin Sumner
413b8af900 Confirm undefined root_path fails 2018-09-17 10:09:57 +01:00
Russell Brown
ad7a3e7593 For quviq and TA, helper for eqc object generation 2018-09-17 10:09:28 +01:00
Martin Sumner
4e61582edf
Merge pull request #170 from martinsumner/mas-iq5-mincachesize
Mas iq5 mincachesize
2018-09-14 19:47:39 +01:00
Martin Sumner
8ada5e78fa Max penciller cache change
Missed a bit
2018-09-14 17:22:25 +01:00
Martin Sumner
e18d681043 Need to support undefined max penciller cache size
Without first converting it to the minimum.  So catch the undefined, at set_default
2018-09-14 10:36:10 +01:00
Martin Sumner
534bf87a51 Set minimum cache sizes
This avoids a divide by zero (if the Bookie's memory cache size is smaller than 4).
2018-09-14 10:19:25 +01:00
Martin Sumner
80e5ff9b4e
Merge pull request #169 from martinsumner/rdb/max-journal-size-docs
Explain max_journalsize more fully
2018-09-10 16:52:07 +01:00
Russell Brown
77ade3b194 Explain max_journalsize more fully 2018-09-10 16:29:30 +01:00
Martin Sumner
8f8e393227
Merge pull request #168 from martinsumner/mas-i164-hotbackup
Mas i164 hotbackup
2018-09-09 19:47:06 +01:00
Martin Sumner
6a87f398f2 Reduce object count in simple backup
This test is almost entirely covered by `hot_backup_changes` now.
2018-09-09 18:19:25 +01:00
Martin Sumner
cd7e64712b Add description 2018-09-09 18:17:19 +01:00
Martin Sumner
0cfdcb1976 Remove double test
should now be covered by the _changes test
2018-09-07 21:03:09 +01:00