From: James Shimek Date: Mon, 18 Jan 2016 15:55:16 +0000 (-0500) Subject: LU-7578 gnilnd: Revert max_immediate setting X-Git-Tag: 2.7.90~34 X-Git-Url: https://git.whamcloud.com/?p=fs%2Flustre-release.git;a=commitdiff_plain;h=928c5050f7d2a8a2cabb6eeb3993b29166fdaf1e LU-7578 gnilnd: Revert max_immediate setting max_immediate was changed based on performance testing for 5.2UP04 and 6.0, this caused the eager_recv path to always use vmalloc when allocating space for new eager messages. The vmalloc path is very slow especially when constantly freeing at the same time across all CPU's This change will also cause more messages to be governed by the service nodes rdma engine. Modifications max_immediate default is now 2048. max_immediate is now read only. eager_credits is now writeable at run time. Signed-off-by: James Shimek Signed-off-by: Chris Horn Change-Id: I2754d28b1f05a7aeaaeac7fc5f41f1f36568d79c Reviewed-on: http://review.whamcloud.com/17667 Tested-by: Jenkins Tested-by: Maloo Reviewed-by: James Simmons Reviewed-by: Dmitry Eremin Reviewed-by: Oleg Drokin --- diff --git a/lnet/klnds/gnilnd/gnilnd_modparams.c b/lnet/klnds/gnilnd/gnilnd_modparams.c index 3436a96..8747848 100644 --- a/lnet/klnds/gnilnd/gnilnd_modparams.c +++ b/lnet/klnds/gnilnd/gnilnd_modparams.c @@ -30,7 +30,7 @@ CFS_MODULE_PARM(credits, "i", int, 0444, "# concurrent sends"); static int eager_credits = 256 * 1024; -CFS_MODULE_PARM(eager_credits, "i", int, 0444, +CFS_MODULE_PARM(eager_credits, "i", int, 0644, "# eager buffers"); static int peer_credits = 16; @@ -66,8 +66,8 @@ static int max_reconnect_interval = GNILND_MAX_RECONNECT_TO; CFS_MODULE_PARM(max_reconnect_interval, "i", int, 0644, "maximum connection retry interval (seconds)"); -static int max_immediate = 8192; -CFS_MODULE_PARM(max_immediate, "i", int, 0644, +static int max_immediate = 2048; +CFS_MODULE_PARM(max_immediate, "i", int, 0444, "immediate/RDMA breakpoint"); static int checksum = GNILND_CHECKSUM_DEFAULT;