Commit graph

21 commits

Author SHA1 Message Date
Martin Sumner
182395ee00 Schema clarifications 2020-12-09 09:18:38 +00:00
Martin Sumner
a210aa6846 Promote cache when scanning
When scanning over a leveled store with a helper (e.g. segment filter and last modified date range), applying the filter will speed up the query when the block index cache is available to get_slots.

If it is not available, previously the leveled_sst did not then promote the cache after it had accessed the underlying blocks.

Now the code does this, and also when the cache has all been added, it extracts the largest last modified date so that sst files older than the passed in date can be immediately dismissed
2020-12-02 13:29:50 +00:00
Martin Sumner
be562c85cb Don't hide option 2020-11-27 03:12:35 +00:00
Martin Sumner
b4c79caf7a Allow for caching of compaction scores
Potentially reduce the overheads of scoring each file on every run.

The change also alters the default thresholds for compaction to favour longer runs (which will tend towards greater storage efficiency).
2020-11-27 02:35:27 +00:00
Martin Sumner
57d73fc548 Make page cache level configurable 2019-07-25 12:23:10 +01:00
Martin Sumner
dab9652f6c Add ability to control journal size by object count
This helps when there are files wiht large numbers of key deltas (and hence small values), where otherwise the object count may get out of control.
2019-07-25 09:45:23 +01:00
Martin Sumner
fd2e0e870c Align cache with default
Stop L0 from growing too large i.e. 127 * 4K is more than 10 times bigger than the default.
2019-02-25 23:35:12 +00:00
Martin Sumner
10f250e4be Update leveled.schema
To set log level
2019-02-13 14:36:45 +00:00
Martin Sumner
32ea4380b2 correct defaults 2018-12-18 11:22:25 +00:00
Martin Sumner
8ccb985775 Typo 2018-12-14 22:43:21 +00:00
Martin Sumner
5b578ea2bb Add new snapshot timeout to multi-backend 2018-12-14 19:57:32 +00:00
Martin Sumner
e6d868f8cd Merge branch 'master' into mas-i233-multibackend 2018-12-14 19:55:34 +00:00
Martin Sumner
ceea196cc0 Update priv/leveled.schema
The snapshottimeouts would not normally eb changed - so make them hidden
2018-12-14 14:27:44 +00:00
Martin Sumner
ef068326a0 Update priv/leveled.schema 2018-12-14 14:13:44 +00:00
Martin Sumner
45f62ffa56 Make all multi schema hidden 2018-12-13 16:24:33 +00:00
Martin Sumner
f211e587f7 Make multi_schema mainly hidden
As wiht other schemas - make the multi_backend schema mainly hidden
2018-12-12 16:16:47 +00:00
Martin Sumner
52c523dbab Add multi_backend schema 2018-12-12 09:56:06 +00:00
Martin Sumner
66a75923e8 Expose configuration of Compactio Percentage targets
I think these should be set differently, so make them configurable.
2018-07-23 12:46:42 +01:00
Martin Sumner
d60725ad1b Add schema document 2018-06-08 13:23:45 +01:00
Martin Sumner
95aa1c632b Comment change 2018-06-07 16:56:10 +01:00
Martin Sumner
feb7149a8d Add schema file 2016-11-26 22:10:51 +00:00