LU-16804 tests: rename 'complete' to 'complete_test' The test-framework.sh "complete" function conflicts with "complete" exported from bash_completion, and this causes lustre-initialization to fail in some configurations now that the lustre test config is loaded earlier during test-framework.sh init_test_env() setup. Rename "complete" to "complete_test" to avoid this conflict. Test-Parameters: trivial Fixes: fdbb2bc849 ("LU-16804 tests: load CONFIG at beginning of init_test_env") Signed-off-by: Andreas Dilger <adilger@whamcloud.com> Change-Id: Ic72d8d5cc4a65feec6bfb2a76ac5f9b9d78e3f75 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51383 Tested-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-15626 tests: Fix "error" reported by shellcheck This patch fixes "error" issues reported by shellcheck for *.sh files. These files had only single error reported by shellcheck. The change in these files are init_test_env $@ (->to->) init_test_env "$@" Test-Parameters: trivial Test-Parameters: testlist=dom-performance,scrub-performance Test-Parameters: testlist=replay-single,replay-ost-single,replay-vbr Test-Parameters: testlist=sanity-pcc,sanity-pfl,sanity-selinux Test-Parameters: testlist=sanity-benchmark,parallel-scale Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: I21fc2f25eb67d724b9e30c586568d2501648a80a Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/46811 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Sarah Liu <sarah@whamcloud.com>
LU-1538 tests: standardize test script init - dne-part-4 Standardize the initial Lustre test script initialization for clarity and consistency. The LUSTRE path is already normalized in init_test_env(), so this doesn't need to be done in the caller. Use $(...) subshells instead of `...` in the affected lines. Remove NAME, CHECKSTAT, TMP, SAVE_PWD,SRCDIR, PATH, MULTIOP, SETUP, CLEANUP variable initialization, since it is already done in init_test_env() or not needed in the test script. Remove all calls to get_lustre_env() in the test scripts since this is called in init_test_env(). Move all definitions of ALWAYS_EXCEPT and SLOW to after init_test_env() and init_logging() and call build_test_filter() immediately after the ALWAYS_EXCEPT and SLOW definitions. Test-Parameters: trivial Test-Parameters: testgroup=review-dne-part-4 Signed-off-by: James Nunez <jnunez@whamcloud.com> Change-Id: I9d2a7e6bedd2d66e5ee564405b86b6206226769f Reviewed-on: https://review.whamcloud.com/35255 Tested-by: Jenkins Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-11349 tests: remove insanity test 15 Test 15 of the insanity test suite has not been used in testing since 2003 and tries to run a script that no longer exists. Thus, this test needs to be removed. At the same time, clean up the script in converting spaces to tabs. Test-Parameters: trivial testlist=insanity Signed-off-by: James Nunez <jnunez@whamcloud.com> Change-Id: Ie3b2f88dde925d7a1c53f288215b3643d20fd5ff Reviewed-on: https://review.whamcloud.com/33121 Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Emoly Liu <emoly@whamcloud.com> Reviewed-by: Wei Liu <sarah@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-11010 tests: remove calls to return after skip() The skip() routine now contains a call to exit. All calls to skip() and skip_env() should be reviewed and calls to return that followed skip() should be removed. This is the second patch in a series that removes calls to return after skip() in the Lustre test suites. Calls to return after skip() are removed for: dne_sanity insanity obdfilter-survey sgpdd-survey Test-Parameters: trivial testlist=dne-sanity,insanity,obdfilter-survey,sgpdd-survey Signed-off-by: James Nunez <james.a.nunez@intel.com> Change-Id: I4b9aeaeddd673dcba371b8340dd635ddeed2b6be Reviewed-on: https://review.whamcloud.com/32731 Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Wei Liu <sarah@whamcloud.com> Reviewed-by: Emoly Liu <emoly@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-9494 test: Improve message for skipping tests Modify skip messages for consistency and clarity. Signed-off-by: Ruth Klundt <rklundt@sandia.gov> Change-Id: I44ced56e67aa63ed84da6a15c88282bc3ff19332 Test-Parameters: trivial testlist=sanity Reviewed-on: https://review.whamcloud.com/27350 Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Wei Liu <wei3.liu@intel.com> Reviewed-by: James Nunez <james.a.nunez@intel.com> Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-4121 tests: Enable zfs tests dependent on ost,mgs ordering This enables tests that were marked as skipped for bug LU-2059, now tracked as LU-4274. The skipped tests are ones failing due to mounting OSTs without MGS started causes OST mount to hang and wait for MGS. Test-Parameters: trivial osscount=2 mdscount=2 ostcount=2 mdtcount=1 mdtfilesystemtype=zfs ostfilesystemtype=zfs testlist=conf-sanity,insanity,sanity-quota Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com> Change-Id: I3e27a7583c857d416ef3a0bd2d5ee74814975def Reviewed-on: https://review.whamcloud.com/7113 Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Reviewed-by: Mike Pershin <mike.pershin@intel.com> Reviewed-by: Lai Siyao <lai.siyao@intel.com> Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-2059 mgs: don't fail on missing params log The mgc_process_cfg_log() fails if 'params' log is not accessinble and has no local copy. In fact that log is optional and may be just empty. Patch allows 'params' log to be empty and checks also for 'params' log in other places to avoid wrong error messages. There was also deprecated code in mgs_write_log_direct_all() which creates lustre-params log which is not used by anyone now. Third change is removal of exceptions in conf-sanity.sh and insanity.sh related to LU-2059 The only exception is insanity test_1 which is still failed due to other reason. Signed-off-by: Mikhail Pershin <mike.pershin@intel.com> Change-Id: I1ad024a87b0a10665f9669fa8ff7cca2d07a09fe Reviewed-on: http://review.whamcloud.com/10311 Tested-by: Jenkins Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Jian Yu <jian.yu@intel.com> Reviewed-by: Fan Yong <fan.yong@intel.com>
LU-4409 tests: disable insanity 10 for DNE Disable insanity 10 for DNE. Signed-off-by: wang di <di.wang@intel.com> Change-Id: I4b67cf745a18a09335e21e1e6e457134ac47f224 Reviewed-on: http://review.whamcloud.com/8650 Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Tested-by: Jenkins Reviewed-by: Jian Yu <jian.yu@intel.com> Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
LU-2059 tests: Skip insanity/10 on ZFS This test fails in the same as all the other LU-2059 skipped tests, trying to start OST with MDS down causes OST to hang. Test-Parameters: osscount=2 mdscount=2 mdsfilesystemtype=zfs mdtfilesystemtype=zfs ostfilesystemtype=zfs testlist=insanity Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com> Change-Id: I29cec88c0f3f5eb4ffef0117363b0862f44dd61a Reviewed-on: http://review.whamcloud.com/8316 Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com> Reviewed-by: Mike Pershin <mike.pershin@intel.com>
LU-3562 tests: EXCEPT insanity/1 on ZFS Because there's no local config on ZFS nodes, this test won't pass until LU-2059 is completed. Test-Parameters: testgroup=review-dne-zfs mdscount=4 osscount=2 clientcount=2 testlist=insanity Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com> Change-Id: Ic43159634a81f28c9d39fdf8207dcce2612fca93 Reviewed-on: http://review.whamcloud.com/6965 Tested-by: Hudson Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Reviewed-by: James Nunez <james.a.nunez@intel.com> Tested-by: Maloo <whamcloud.maloo@gmail.com>
LU-1187 test: add dne test to insanity.sh 1. Add test_10 (fail MDT0/OST/MDT1) and test_11(fail MDT0/client/MDT1), test_12(MDTs/OSTs/Clients), test_13(MDTs/Clients/OSTs) and test_14(OSTs/Clients/MDTs). 2. Replace fail SINGLEMDS with fail all MDTs to fully test DNE. Change-Id: Ic3cae011d6ede5b0b9616608cc840a0565777ecd Signed-off-by: Wang Di <di.wang@whamcloud.com> Reviewed-on: http://review.whamcloud.com/4319 Tested-by: Hudson Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Reviewed-by: Jian Yu <jian.yu@intel.com>
LU-1538 tests: use $TESTSUITE instead of $0 Use "$TESTSUITE" instead of "$0" in test script messages, since $0 is a full pathname and clutters up the test logs. Instead, $TESTSUITE is only the test suite name, and is more compact. Use it in all output. This makes the output from complete() redundant, in that it prints $TESTSUITE both as an argument and internally via the equals_msg() function (via banner()), so remove the $TESTSUITE argument from all callers of complete(). The equals_msg() function was only a thin wrapper around banner(), and was only used by complete(), remove it and call banner() directly. Signed-off-by: Andreas Dilger <adilger@whamcloud.com> Change-Id: I6b3f256000317a17fdd2a361a38d4dfdda500c1e Reviewed-on: http://review.whamcloud.com/4192 Tested-by: Hudson Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Yu Jian <yujian@whamcloud.com> Reviewed-by: Minh Diep <mdiep@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-2059 tests: skip local config tests only on ZFS Only skip conf-sanity.sh (5d, 19b, 21b, 27a) and insanity.sh (2, 4) when the backing OST filesystem type is ZFS, not for ldiskfs. The support for locally-cached config llogs is not implemented for ZFS yet, so ZFS OSTs cannot be started without the MGS yet. The ZFS local config support is in progress and these tests will be re-enabled as part of the landing. Signed-off-by: Andreas Dilger <adilger@whamcloud.com> Change-Id: I8c49483401a7132ce09b93aa5d93610c4d500c1e Reviewed-on: http://review.whamcloud.com/4234 Tested-by: Hudson Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com> Reviewed-by: Li Wei <liwei@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-1415 tests: Basic support for ZFS-based servers This patch extends Test Framework to support formatting and mounting ZFS-based servers. Current global FSTYPE is no longer flexible enough, as different facets can use different types of back ends. Such "mixed-fstype" configurations are firstly resulted from the incremental landing of Orion changes. For example, when we have OFD and ZFS OSD, although OSTs will be able to use ZFS, MGS and MDTs can still only use LDiskFS. Secondly, to reduce the test matrix, we may also want to have both OSTs using LDiskFS and OSTs using ZFS in the same test cluster. Hence, this patch makes back end file system type a per-facet attribute. The flexible configuration variables in local.sh are reserved for users; all other scripts shall use facet_fstype() instead. The major differences between using an LDiskFS-based target and a ZFS-based one are on the mkfs.lustre(8) command line: - ZFS-based targets shall have "--backfstype=zfs", while LDiskFS-based ones shall have "--backfstype=ldiskfs". - LDiskFS-specific "--mkfsoptions" arguments shall not be given to ZFS-based targets, and vice versa. - ZFS-based targets have different device specifications. See mkfs.lustre(8). In addition, we will make "--index" mandatory. Naturally, format options have to be generated for each facet dynamically, based on its back end type, index, etc. This patch changes mkfs_opts() to do exactly that. All test scripts shall use mkfs_opts() instead of reading related environment variables directly. Similarly, mount options should also be generated on a per-facet, or at least per-fstype, basis. Nevertheless, this patch takes a shortcut by keeping current per-facet-type {MGS,MDS,OST}_MOUNT_OPTSs and generating the "loop" mount option dynamically in mount_facet(). I believe this solution introduces fewer changes comparing to a pure per-facet one and is sufficient for current use cases. This patch is based on Brian Behlendorf's work under ORI-155. See http://review.whamcloud.com/1417. Change-Id: Ifcce9b10179dd1b4992a30d10df13ea10bc34548 Whamcloud-bug-id: ORI-155 Test-Parameters: testgroup=full Test-Parameters: testgroup=full envdefinitions=USE_OFD=yes,LOAD_MODULES_REMOTE=true Signed-off-by: Li Wei <liwei@whamcloud.com> Reviewed-on: http://review.whamcloud.com/2907 Tested-by: Hudson Reviewed-by: Yu Jian <yujian@whamcloud.com> Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
b=23051 improve summary of acc-sm to include test times i=Andreas.Dilger
b=20407 TF: "HARD" failovers with multiple targets per server i=Brian.Murrell i=Li.Wei
b=20057 Autovetting and test-framework enhancements Test-framework and script changes to support autovetting and buffalo V2 i=rread i=grev
b=15864 insanity test_6 : use stat -f instead of df for determining the recovery status i=Jian.Yu
*** empty log message ***