Whamcloud - gitweb
LU-14825 lod: pool spilling
authorAlex Zhuravlev <bzzz@whamcloud.com>
Wed, 14 Jul 2021 09:09:39 +0000 (12:09 +0300)
committerAndreas Dilger <adilger@whamcloud.com>
Wed, 8 Sep 2021 04:57:43 +0000 (04:57 +0000)
commit66972734fdd35a2813ceb7f50aeb4fefa064ad2d
tree53472b43da5db25c5e0c7cf2adbc65d63b77eba3
parentece25ea4a97d67572ec270e04688f3aa3e6b5315
LU-14825 lod: pool spilling

To avoid the problem of the fast pool becoming full this patch
introduces so-called pool spilling: for every OST pool a target
pool can be assigned which will be used instead of original one
if the original one's use is over specified threshold:

  lctl set_param lod.*.pool.pool1.spill_target=pool2
  lctl set_param lod.*.pool.pool1.spill_threshold_pct=80

i.e. once pool1 is 80+% used, then new files will be created on
pool2.

A chain (up to 10 at the moment) can be configured using the
settings like above when different OST pools are considered
one by one.

Lustre-change: https://review.whamcloud.com/43989
Lustre-commit: TBD (from be958a7bde7351856db6632d06e72e23ce916b13)

Test-Parameters: testlist=ost-pools
Signed-off-by: Alex Zhuravlev <bzzz@whamcloud.com>
Change-Id: I7f6dd4931ba64f3db8a7ae6a3b185f942a629ed7
Reviewed-on: https://review.whamcloud.com/44303
Tested-by: jenkins <devops@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Andreas Dilger <adilger@whamcloud.com>
lustre/lod/lod_internal.h
lustre/lod/lod_pool.c
lustre/lod/lod_qos.c
lustre/lod/lproc_lod.c
lustre/tests/ost-pools.sh