Add updated HeadTime charts
This commit is contained in:
parent
41c308c5fd
commit
ad36578434
3 changed files with 10 additions and 0 deletions
|
@ -38,6 +38,14 @@ The time for Head requests is broken down in two ways: the time based on the lev
|
||||||
|
|
||||||
The timings for the merge tree are surprisingly high for missing entries (which largely should be covered by bloom filter checks), and there is a surprisingly high gap between the timings for different levels (again given the expected speed of the bloom checks).
|
The timings for the merge tree are surprisingly high for missing entries (which largely should be covered by bloom filter checks), and there is a surprisingly high gap between the timings for different levels (again given the expected speed of the bloom checks).
|
||||||
|
|
||||||
|
This has been improved, first by changing the bloom filter and passing the bloom so that it can be accessed directly without a message pass from the penciller:
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
A second improvement was to include a small (32) cache of recently fetched keys in each SST process to be checked before the expensive slot_fetch:
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
Within the SST file, the timings are broken down between index_query (the time taken to find the slot in the tree), tiny_bloom (the time taken to check against the bloom filter for that slot), slot_index (the time taken to look up the position in the slot - which may also double as a bloom filter to determine non_presence) and slot_fetch (the time taken to fetch the block from disk and perform binary_to_term and then walk to the position).
|
Within the SST file, the timings are broken down between index_query (the time taken to find the slot in the tree), tiny_bloom (the time taken to check against the bloom filter for that slot), slot_index (the time taken to look up the position in the slot - which may also double as a bloom filter to determine non_presence) and slot_fetch (the time taken to fetch the block from disk and perform binary_to_term and then walk to the position).
|
||||||
|
|
||||||

|

|
||||||
|
@ -52,4 +60,6 @@ This can also be broken down for each individual SST file request (note that mos
|
||||||
|
|
||||||

|

|
||||||
|
|
||||||
|
80% of file requests exit after the bloom check. Very few false positives are discovered after the bloom check in the slot_index check, so 20% of fetch requests to files result in a slot_fetch.
|
||||||
|
|
||||||
## Merge Time
|
## Merge Time
|
||||||
|
|
BIN
docs/pics/28Nov_HeadTimeChart.png
Normal file
BIN
docs/pics/28Nov_HeadTimeChart.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 342 KiB |
BIN
docs/pics/29Nov_HeadTimeChart.png
Normal file
BIN
docs/pics/29Nov_HeadTimeChart.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 300 KiB |
Loading…
Add table
Add a link
Reference in a new issue