Commit graph

828 commits

Author SHA1 Message Date
Martin Sumner
a49d3bbfec Merge pull request #84 from martinsumner/mas-aaeexpiry-i82
Add extra second to sleep
2017-08-01 00:14:48 +01:00
Martin Sumner
8748fef28c Add extra second to sleep
Sleep for just one more second to resolve intermittent failure
2017-08-01 00:14:31 +01:00
Martin Sumner
7f6f51efcd Merge pull request #80 from project-fifo/dialyzer
Fix dialyzer warnings for newer erlang releases
2017-07-31 21:42:50 +01:00
Heinz N. Gies
379e33ba84 Cleanup dialyzer errrors in leveled_bookie 2017-07-31 19:58:56 +02:00
Heinz N. Gies
8717d42ffe Cleanup dialyzer errrors in leveled_cdb 2017-07-31 19:55:09 +02:00
Heinz N. Gies
e8ed7954cc Cleanup dialyzer errrors in leveled_iclerk 2017-07-31 19:53:01 +02:00
Heinz N. Gies
eece253222 Cleanup most dialyzer errrors in leveled_inker 2017-07-31 19:47:58 +02:00
Heinz N. Gies
44fd603474 Cleanup dialyzer errrors in leveled_pclerk 2017-07-31 19:41:26 +02:00
Heinz N. Gies
369bdece5f Cleanup dialyzer errrors in leveled_penciller 2017-07-31 19:39:40 +02:00
Heinz N. Gies
858ee9a915 Cleanup dialyzer errrors in leveled_pmanifest 2017-07-31 19:32:06 +02:00
Heinz N. Gies
5e6df539cb Cleanup dialyzer errrors in leveled_sst 2017-07-31 19:30:29 +02:00
Martin Sumner
4ccd67a3c2 Merge pull request #79 from martinsumner/mas-tictac
TicTac Merkle Tree for AAE
2017-07-21 11:10:46 +01:00
Martin Sumner
2297c0fab1 Change snap_async to snap
As currently implemented in riak_core branch
2017-07-21 10:27:43 +01:00
Martin Sumner
9c4910fe26 Edits to AAE write-up
Further re-read before push
2017-07-21 10:21:54 +01:00
Martin Sumner
2ad1ac0baf node_worker_pool
Having a separate vnode_worker_pool wouldn't reoslve he parallelism issue obviously!  Need a node_worker_pool instead.
2017-07-13 17:40:06 +01:00
martinsumner
cb5f09496f Update thoughts on concurrency management
After reviewing the code it looks easier to have  separate pool of vnode
workers to manage concurrency, rather than trying to alter the coverage
FSM itself.  This will make it easier to adjust for different backend
capabilities (i.e. worst case it would fallback to unthrottled).
2017-07-12 14:50:38 +01:00
martinsumner
2adf60e974 Look at super-async folds and rollingcoverage_fsm 2017-07-11 19:48:12 +01:00
Martin Sumner
65fd029ca6 typo - backlist/blacklist 2017-07-11 12:25:06 +01:00
martinsumner
80fd2615f6 Implement blacklist/whitelist
Change from the all/whitelist ebhavior to the blacklist/whitelist
behaviour documented in the write-up
2017-07-11 11:44:01 +01:00
martinsumner
7c86de2491 Clarification on NRT query 2017-07-11 10:29:50 +01:00
martinsumner
e4a2a8ecea Stuff on read repair 2017-07-11 10:28:34 +01:00
martinsumner
b5ca2a8541 Word wrangling 2017-07-10 16:47:39 +01:00
martinsumner
185d4e9747 Notes on Riak Implementation options 2017-07-10 16:36:01 +01:00
martinsumner
03d0b913d5 Add new background section 2017-07-10 11:45:35 +01:00
Martin Sumner
3ed41a0e74 Merge pull request #78 from martinsumner/rdb/review/mas-tictac
Some proposed edits
2017-07-10 09:50:40 +01:00
martinsumner
e7c322d956 Clarify pointer to research 2017-07-10 09:49:20 +01:00
Russell Brown
6439da626a Some proposed edits 2017-07-09 17:06:50 +01:00
martinsumner
414785802e Minor edits 2017-07-07 16:38:02 +01:00
martinsumner
d5a365b368 More word wrangling 2017-07-07 10:23:21 +01:00
martinsumner
417687c004 Word wrangling 2017-07-07 10:13:37 +01:00
martinsumner
4cbe838b52 Ongoing updates 2017-07-06 17:37:59 +01:00
martinsumner
74f0e2bb6d Further updates 2017-07-06 17:22:09 +01:00
martinsumner
780bf8aeb8 Wording changes
Attempt to clarify
2017-07-06 17:01:19 +01:00
martinsumner
57f7614b40 Initial edits
Part way through read-through.  Disovered when referencing Cassandra
Merkle Trees that they also use XOR of hashes rather than concatenation
before hashing
2017-07-06 16:51:07 +01:00
martinsumner
3105656d2e Add test descriptions and further documentation 2017-07-06 15:40:30 +01:00
martinsumner
0d72b353fe Add test of expiry of nrt aae terms 2017-07-04 13:29:40 +01:00
martinsumner
439bf8c3b8 Add bucket whitelist test 2017-07-04 10:55:53 +01:00
Martin Sumner
1af9ac56dc Revert passing Bucket
Bad edit.  Reverted
2017-07-03 19:06:41 +01:00
martinsumner
97fdd36d53 Returning bucket when bucket is all
Need to know {Bucket, Key} not just Key if all buckets are being covered
by nrt aae.  So shoehorning this in - will also allow for proper use of
FilterFun when filtering by partition.
2017-07-03 18:03:13 +01:00
martinsumner
b143ea1c08 Anti-entropy write-up
Some initial jottings
2017-07-03 11:12:03 +01:00
martinsumner
d0a825a145 Extend test to detect keys
When comparing recent changes demonstration the detection of the keys
which have changed with a follow-up query
2017-07-03 10:33:34 +01:00
Martin Sumner
fd84e4f608 Test timeouts
So that coverage testing will run.
2017-07-02 22:23:02 +01:00
martinsumner
52ca0e4b6c Test expansion
Detect a recent difference
2017-07-02 19:33:18 +01:00
martinsumner
da53808e2e Extend test beyond restart
Prove that recency check still works after a restart
2017-07-01 08:24:58 +01:00
martinsumner
a15c046887 Re-introduce commented tests 2017-06-30 16:31:48 +01:00
martinsumner
954995e23f Support for recent AAE index
With basic ct test.

Doesn't currently prove expiry of index.  Doesn't prove ability to find
segments.

Assumes that either "all" buckets or a special list of buckets require
indexing this way.  Will lead to unexpected results if the same bucket
name is used across different Tags.

The format of the index has been chosen so that hopeully standard index
features can be used (e.g. return_terms).
2017-06-30 16:31:22 +01:00
martinsumner
8da8722b9e Add temporary aae index
Pending ct tests.  The aae index should expire after limit_minutes and
be on an index which is rounded to unit_minutes.
2017-06-30 10:03:36 +01:00
martinsumner
2dd303237b Change XOR 2017-06-28 10:55:54 +01:00
martinsumner
8e7aaf0ee7 Correct testutil to understand riak_extract_metadata
Change, but change not reflected in tets code
2017-06-27 17:11:13 +01:00
martinsumner
ebef27f021 Extract Last Modified Date from Riak Object
As part of process to supporting a recent changes index for
near-real-time anti-entropy
2017-06-27 16:25:18 +01:00