Skip to content

Commit

Permalink
chore: add a configuraiton toml for serving-only CN
Browse files Browse the repository at this point in the history
  • Loading branch information
lmatz committed Nov 3, 2023
1 parent 31bf68e commit 27d22a8
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions src/config/serving-only.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
[storage]
# Shared buffer is useless to a serving-only compute node.
shared_buffer_capacity_mb = 1
# Compactor is irrelevant to a serving-only compute node.
compactor_memory_limit_mb = 1
# Suppose a serving-only CN has 16GB memory in total, we recommend using 30% by default: 16*0.3=4.8
block_cache_capacity_mb = 4800
# Suppose a serving-only CN has 16GB memory in toal, we recommend using 10% by default: 16*0.1=1.6
meta_cache_capacity_mb = 1600
# There will be 16GB - 4.8GB - 1.6GB - reserved memory 16GB * 0.2 = 6.4GB for executing serving queries. We call it "compute memory".

# If one batch query is resource-intensive and its runtime memory consumption exceeds 6.4GB, it will kill itself automatically without triggering out-of-memory error. The reserved memory is allocated for all types of temporary memory usage and slackness.
# Although we don't recommend users to execute OLAP-style batch queries that takes a huge amount of input data, e.g. more than dozens of GB, users can adjust the configuration if such batch query is needed and the default configuration left too few "compute memory", feel free to allocate less memory for "block cache" and "meta cache" to increase "compute memory".

0 comments on commit 27d22a8

Please sign in to comment.