LU-9121 lnet: select best peer and local net

LU-9121 lnet: select best peer and local net

Select the healthiest and highest priority peer and local net when
sending a message.

Lustre-change: https://review.whamcloud.com/34352
Lustre-commit: dff6587805ddad212ab48e5bedacbc7846542b7b

Test-Parameters: trivial testlist=lnet-selftest,sanity-lnet
Signed-off-by: Amir Shehata <ashehata@whamcloud.com>
Change-Id: I42717e7fdc3226c6faa7c59c713f18422e27f2e5
Reviewed-on: https://review.whamcloud.com/c/ex/lustre-release/+/52444
Tested-by: jenkins <devops@whamcloud.com>
Tested-by: Maloo <maloo@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Frank Sehr <fsehr@whamcloud.com>