Whamcloud - gitweb
LU-17434 lmv: add exclude list for remote dir 80/53780/5
authorLai Siyao <lai.siyao@whamcloud.com>
Tue, 16 Jan 2024 19:18:30 +0000 (14:18 -0500)
committerOleg Drokin <green@whamcloud.com>
Wed, 13 Mar 2024 03:23:48 +0000 (03:23 +0000)
commit5b07dce19b1830769d7a1f7bba8b559d3ead9dfb
tree1070c652e23637ae92c8af42f03e63263938307e
parent414467762f8a034c72903bab8ebfce6e1feb8e79
LU-17434 lmv: add exclude list for remote dir

Apache Spark creating a _temporary subdirectory for staging files, and
it should be created on the same MDT as its parent directory. Add a
tunable lmv.*.qos_exclude_prefixes, if directory prefix is in this
list, lmv_create() should put it on its parent MDT.

This prefix list follows the same rule of shell environment PATH: use
':' as separator for prefixes. And for convenience '+/-' can be used
to add/remove prefixes.

Add sanity 413k.

Signed-off-by: Lai Siyao <lai.siyao@whamcloud.com>
Change-Id: I4c8a118f0630c19054934a87bee3599bdb1fe7bb
Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53780
Tested-by: jenkins <devops@whamcloud.com>
Tested-by: Maloo <maloo@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Sebastien Buisson <sbuisson@ddn.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
lustre/include/obd.h
lustre/lmv/lmv_internal.h
lustre/lmv/lmv_obd.c
lustre/lmv/lproc_lmv.c
lustre/tests/sanity.sh