Whamcloud - gitweb
LU-17434 lmv: add exclude list for remote dir
authorLai Siyao <lai.siyao@whamcloud.com>
Tue, 16 Jan 2024 19:18:30 +0000 (14:18 -0500)
committerAndreas Dilger <adilger@whamcloud.com>
Sat, 23 Mar 2024 20:29:06 +0000 (20:29 +0000)
commit4e784a001eef9ba879e155a4211b0635dbcb7a07
tree1f846e17c403e8d9374e782be93d5c5f35488c98
parent6caa8a5223a5d02bb896e4cbe079466f55cff785
LU-17434 lmv: add exclude list for remote dir

Apache Spark creating a _temporary subdirectory for staging files, and
it should be created on the same MDT as its parent directory. Add a
tunable lmv.*.qos_exclude_prefixes, if directory prefix is in this
list, lmv_create() should put it on its parent MDT.

This prefix list follows the same rule of shell environment PATH: use
':' as separator for prefixes. And for convenience '+/-' can be used
to add/remove prefixes.

Add sanity 413k.

Lustre-change: https://review.whamcloud.com/53780
Lustre-commit: 5b07dce19b1830769d7a1f7bba8b559d3ead9dfb

Signed-off-by: Lai Siyao <lai.siyao@whamcloud.com>
Change-Id: I4c8a118f0630c19054934a87bee3599bdb1fe7bb
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Sebastien Buisson <sbuisson@ddn.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-on: https://review.whamcloud.com/c/ex/lustre-release/+/54462
Tested-by: jenkins <devops@whamcloud.com>
Tested-by: Maloo <maloo@whamcloud.com>
lustre/include/obd.h
lustre/lmv/lmv_internal.h
lustre/lmv/lmv_obd.c
lustre/lmv/lproc_lmv.c
lustre/tests/sanity.sh