LU-16997 kfilnd: Correct RX buffer size

The immediate receive buffers are large buffers where incoming
messages are byte packed into the buffer until all buffer space is
exhausted. The size of the buffer is kkfilnd module parameter
credits * 4096. The number of buffers is controlled by kkfilnd module
parameter immediate_rx_buf_count.

With the current defaults this results in only 1MiB of buffers per RX
context (i.e. CPT) to sync these messages. While kfilnd tries to
replenish these buffers as fast as possible, it may not be fast enough
and replenishing can be delayed based on CPU availability. Change
default credits to 512 so that we have have 8x 2MiB buffers.

Test-Parameters: trivial
HPE-bug-id: LUS-10548
Signed-off-by: Chris Horn <chris.horn@hpe.com>
Change-Id: I83f813ba2e295e6087131dcdfb12fc0feebb4834
Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51789
Tested-by: jenkins <devops@whamcloud.com>
Tested-by: Maloo <maloo@whamcloud.com>
Reviewed-by: Ron Gredvig <ron.gredvig@hpe.com>
Reviewed-by: Ian Ziemba <ian.ziemba@hpe.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

diff --git a/lnet/klnds/kfilnd/kfilnd_modparams.c b/lnet/klnds/kfilnd/kfilnd_modparams.c
index 41d31d5..70c29e6 100644 (file)
--- a/lnet/klnds/kfilnd/kfilnd_modparams.c
+++ b/lnet/klnds/kfilnd/kfilnd_modparams.c
@@ -86,7 +86,7 @@ MODULE_PARM_DESC(wq_max_active,
                 "Max work queue work items active per CPU. Default is 512. Valid values 0 to 512.");
 
 /* Common LND network tunables. */
-static int credits = 256;
+static int credits = 512;
 module_param(credits, int, 0444);
 MODULE_PARM_DESC(credits, "Number of concurrent sends on network");