From 1eeedee02ccdb674b5b2598bec8531e8eac49bf9 Mon Sep 17 00:00:00 2001 From: Zakelly Date: Sun, 7 Apr 2024 15:59:09 +0800 Subject: [PATCH] [hotfix][doc] Generate and use docs of RpcOptions instead of AkkaOptions --- docs/content.zh/docs/deployment/config.md | 2 +- docs/content/docs/deployment/config.md | 2 +- .../generated/rpc_configuration.html | 150 ++++++++++++++++++ 3 files changed, 152 insertions(+), 2 deletions(-) create mode 100644 docs/layouts/shortcodes/generated/rpc_configuration.html diff --git a/docs/content.zh/docs/deployment/config.md b/docs/content.zh/docs/deployment/config.md index 56d9206ab06a2b..711d97aef40f7b 100644 --- a/docs/content.zh/docs/deployment/config.md +++ b/docs/content.zh/docs/deployment/config.md @@ -562,7 +562,7 @@ These options are for the network stack that handles the streaming and batch dat Flink uses Pekko for RPC between components (JobManager/TaskManager/ResourceManager). Flink does not use Pekko for data transport. -{{< generated/akka_configuration >}} +{{< generated/rpc_configuration >}} ---- ---- diff --git a/docs/content/docs/deployment/config.md b/docs/content/docs/deployment/config.md index f7927e260b4afc..cc903eb34f21f5 100644 --- a/docs/content/docs/deployment/config.md +++ b/docs/content/docs/deployment/config.md @@ -564,7 +564,7 @@ These options are for the network stack that handles the streaming and batch dat Flink uses Pekko for RPC between components (JobManager/TaskManager/ResourceManager). Flink does not use Pekko for data transport. -{{< generated/akka_configuration >}} +{{< generated/rpc_configuration >}} ---- ---- diff --git a/docs/layouts/shortcodes/generated/rpc_configuration.html b/docs/layouts/shortcodes/generated/rpc_configuration.html new file mode 100644 index 00000000000000..901f491b37b0c4 --- /dev/null +++ b/docs/layouts/shortcodes/generated/rpc_configuration.html @@ -0,0 +1,150 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
KeyDefaultTypeDescription
pekko.ask.callstack
trueBooleanIf true, call stack for asynchronous asks are captured. That way, when an ask fails (for example times out), you get a proper exception, describing to the original method call and call site. Note that in case of having millions of concurrent RPC calls, this may add to the memory footprint.
pekko.ask.timeout
10 sDurationTimeout used for all futures and blocking Pekko calls. If Flink fails due to timeouts then you should try to increase this value. Timeouts can be caused by slow machines or a congested network. The timeout value requires a time-unit specifier (ms/s/min/h/d).
pekko.client-socket-worker-pool.pool-size-factor
1.0DoubleThe pool size factor is used to determine thread pool size using the following formula: ceil(available processors * factor). Resulting size is then bounded by the pool-size-min and pool-size-max values.
pekko.client-socket-worker-pool.pool-size-max
2IntegerMax number of threads to cap factor-based number to.
pekko.client-socket-worker-pool.pool-size-min
1IntegerMin number of threads to cap factor-based number to.
pekko.fork-join-executor.parallelism-factor
2.0DoubleThe parallelism factor is used to determine thread pool size using the following formula: ceil(available processors * factor). Resulting size is then bounded by the parallelism-min and parallelism-max values.
pekko.fork-join-executor.parallelism-max
64IntegerMax number of threads to cap factor-based parallelism number to.
pekko.fork-join-executor.parallelism-min
8IntegerMin number of threads to cap factor-based parallelism number to.
pekko.framesize
"10485760b"StringMaximum size of messages which are sent between the JobManager and the TaskManagers. If Flink fails because messages exceed this limit, then you should increase it. The message size requires a size-unit specifier.
pekko.jvm-exit-on-fatal-error
trueBooleanExit JVM on fatal Pekko errors.
pekko.log.lifecycle.events
falseBooleanTurns on the Pekko’s remote logging of events. Set this value to 'true' in case of debugging.
pekko.lookup.timeout
10 sDurationTimeout used for the lookup of the JobManager. The timeout value has to contain a time-unit specifier (ms/s/min/h/d).
pekko.remote-fork-join-executor.parallelism-factor
2.0DoubleThe parallelism factor is used to determine thread pool size using the following formula: ceil(available processors * factor). Resulting size is then bounded by the parallelism-min and parallelism-max values.
pekko.remote-fork-join-executor.parallelism-max
16IntegerMax number of threads to cap factor-based parallelism number to.
pekko.remote-fork-join-executor.parallelism-min
8IntegerMin number of threads to cap factor-based parallelism number to.
pekko.retry-gate-closed-for
50LongMilliseconds a gate should be closed for after a remote connection was disconnected.
pekko.server-socket-worker-pool.pool-size-factor
1.0DoubleThe pool size factor is used to determine thread pool size using the following formula: ceil(available processors * factor). Resulting size is then bounded by the pool-size-min and pool-size-max values.
pekko.server-socket-worker-pool.pool-size-max
2IntegerMax number of threads to cap factor-based number to.
pekko.server-socket-worker-pool.pool-size-min
1IntegerMin number of threads to cap factor-based number to.
pekko.ssl.enabled
trueBooleanTurns on SSL for Pekko’s remote communication. This is applicable only when the global ssl flag security.ssl.enabled is set to true.
pekko.startup-timeout
(none)StringTimeout after which the startup of a remote component is considered being failed.
pekko.tcp.timeout
"20 s"StringTimeout for all outbound connections. If you should experience problems with connecting to a TaskManager due to a slow network, you should increase this value.
pekko.throughput
15IntegerNumber of messages that are processed in a batch before returning the thread to the pool. Low values denote a fair scheduling whereas high values can increase the performance at the cost of unfairness.