From aa8df6a4a3f50dc86554764f6ccb72db027633f8 Mon Sep 17 00:00:00 2001 From: Chris Horn Date: Thu, 27 Jul 2023 09:47:22 -0600 Subject: [PATCH] LU-16997 kfilnd: Correct RX buffer size The immediate receive buffers are large buffers where incoming messages are byte packed into the buffer until all buffer space is exhausted. The size of the buffer is kkfilnd module parameter credits * 4096. The number of buffers is controlled by kkfilnd module parameter immediate_rx_buf_count. With the current defaults this results in only 1MiB of buffers per RX context (i.e. CPT) to sync these messages. While kfilnd tries to replenish these buffers as fast as possible, it may not be fast enough and replenishing can be delayed based on CPU availability. Change default credits to 512 so that we have have 8x 2MiB buffers. Test-Parameters: trivial HPE-bug-id: LUS-10548 Signed-off-by: Chris Horn Change-Id: I83f813ba2e295e6087131dcdfb12fc0feebb4834 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51789 Tested-by: jenkins Tested-by: Maloo Reviewed-by: Ron Gredvig Reviewed-by: Ian Ziemba Reviewed-by: Oleg Drokin --- lnet/klnds/kfilnd/kfilnd_modparams.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lnet/klnds/kfilnd/kfilnd_modparams.c b/lnet/klnds/kfilnd/kfilnd_modparams.c index 41d31d5..70c29e6 100644 --- a/lnet/klnds/kfilnd/kfilnd_modparams.c +++ b/lnet/klnds/kfilnd/kfilnd_modparams.c @@ -86,7 +86,7 @@ MODULE_PARM_DESC(wq_max_active, "Max work queue work items active per CPU. Default is 512. Valid values 0 to 512."); /* Common LND network tunables. */ -static int credits = 256; +static int credits = 512; module_param(credits, int, 0444); MODULE_PARM_DESC(credits, "Number of concurrent sends on network"); -- 1.8.3.1