From: Chris Horn Date: Thu, 27 Jul 2023 15:47:22 +0000 (-0600) Subject: LU-16997 kfilnd: Correct RX buffer size X-Git-Tag: 2.15.58~82 X-Git-Url: https://git.whamcloud.com/gitweb?a=commitdiff_plain;h=refs%2Fchanges%2F89%2F51789%2F2;p=fs%2Flustre-release.git LU-16997 kfilnd: Correct RX buffer size The immediate receive buffers are large buffers where incoming messages are byte packed into the buffer until all buffer space is exhausted. The size of the buffer is kkfilnd module parameter credits * 4096. The number of buffers is controlled by kkfilnd module parameter immediate_rx_buf_count. With the current defaults this results in only 1MiB of buffers per RX context (i.e. CPT) to sync these messages. While kfilnd tries to replenish these buffers as fast as possible, it may not be fast enough and replenishing can be delayed based on CPU availability. Change default credits to 512 so that we have have 8x 2MiB buffers. Test-Parameters: trivial HPE-bug-id: LUS-10548 Signed-off-by: Chris Horn Change-Id: I83f813ba2e295e6087131dcdfb12fc0feebb4834 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51789 Tested-by: jenkins Tested-by: Maloo Reviewed-by: Ron Gredvig Reviewed-by: Ian Ziemba Reviewed-by: Oleg Drokin --- diff --git a/lnet/klnds/kfilnd/kfilnd_modparams.c b/lnet/klnds/kfilnd/kfilnd_modparams.c index 41d31d5..70c29e6 100644 --- a/lnet/klnds/kfilnd/kfilnd_modparams.c +++ b/lnet/klnds/kfilnd/kfilnd_modparams.c @@ -86,7 +86,7 @@ MODULE_PARM_DESC(wq_max_active, "Max work queue work items active per CPU. Default is 512. Valid values 0 to 512."); /* Common LND network tunables. */ -static int credits = 256; +static int credits = 512; module_param(credits, int, 0444); MODULE_PARM_DESC(credits, "Number of concurrent sends on network");