From: Liang Zhen Date: Tue, 25 Nov 2014 19:21:34 +0000 (-0800) Subject: LU-5545 ptlrpc: false alarm in AT network latency measuring X-Git-Tag: 2.5.3.90~43 X-Git-Url: https://git.whamcloud.com/?a=commitdiff_plain;h=refs%2Fchanges%2F55%2F12855%2F2;p=fs%2Flustre-release.git LU-5545 ptlrpc: false alarm in AT network latency measuring If early reply of client RPC is lost and client RPC is expired and resent, server will drop the resent RPC because it's already in processing, server may also send reply or early reply to client, which can still match reply buffer of the original request. In this case, client is measuring time from resent time, but server is reporting service time of original RPC, which is longer than the time measured by client. This patch is back-ported from the following one: Lustre-commit: c238be0bd02367b634c1061a30bbe161dfd9d8e9 Lustre-change: http://review.whamcloud.com/12018 Signed-off-by: Liang Zhen Change-Id: I5bdcdee9dd6b439d5d650fa812ea65527458c590 Reviewed-on: http://review.whamcloud.com/12855 Tested-by: Jenkins Tested-by: Maloo Reviewed-by: Li Wei Reviewed-by: Johann Lombardi --- diff --git a/lustre/ptlrpc/client.c b/lustre/ptlrpc/client.c index f3793ca..e1a467a 100644 --- a/lustre/ptlrpc/client.c +++ b/lustre/ptlrpc/client.c @@ -294,14 +294,27 @@ static void ptlrpc_at_adj_net_latency(struct ptlrpc_request *req, time_t now = cfs_time_current_sec(); LASSERT(req->rq_import); - at = &req->rq_import->imp_at; + + if (service_time > now - req->rq_sent + 3) { + /* bz16408, however, this can also happen if early reply + * is lost and client RPC is expired and resent, early reply + * or reply of original RPC can still be fit in reply buffer + * of resent RPC, now client is measuring time from the + * resent time, but server sent back service time of original + * RPC. + */ + CDEBUG((lustre_msg_get_flags(req->rq_reqmsg) & MSG_RESENT) ? + D_ADAPTTO : D_WARNING, + "Reported service time %u > total measured time " + CFS_DURATION_T"\n", service_time, + cfs_time_sub(now, req->rq_sent)); + return; + } /* Network latency is total time less server processing time */ - nl = max_t(int, now - req->rq_sent - service_time, 0) +1/*st rounding*/; - if (service_time > now - req->rq_sent + 3 /* bz16408 */) - CWARN("Reported service time %u > total measured time " - CFS_DURATION_T"\n", service_time, - cfs_time_sub(now, req->rq_sent)); + nl = max_t(int, now - req->rq_sent - + service_time, 0) + 1; /* st rounding */ + at = &req->rq_import->imp_at; oldnl = at_measured(&at->iat_net_latency, nl); if (oldnl != 0)