LU-16250 tests: remove metadata-updates.sh script The metadata-updates.sh test script doesn't really test anything particularly interesting, and appears never to fail unless all of the tests in that session fail, which indicates to me that anything of interest that it might have tested has already been caught by some earlier test. It has not been updated for anything except test-framework changes in many years. The only minor part of interest is write_disjoint, but that is also tested by parallel-scale (along with more MPI tests). Test-Parameters: trivial optional testgroup=review-dne-part-8 Signed-off-by: Andreas Dilger <adilger@whamcloud.com> Change-Id: I3891cf4cabdc777c2648a95fd821a376f7e6c87f Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/48913 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Alex Deiter <alex.deiter@gmail.com> Reviewed-by: Sarah Liu <sarah@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16262 tests: Remove sanity-gss.sh Purpose of sanity-gss is to test just the GSSAPI code itself. This is done by making use of the gssnull/null security flavor. Currently, this is exercised through non-regression tests with SSK and therefore sanity-gss.sh is not required. This patch removes sanity-gss.sh from repo due to above reasons. Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: Ief62e8111cafdc5bebca1f47a1b09fbafb152a76 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/48948 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Sebastien Buisson <sbuisson@ddn.com>
LU-12236 tests: add tests for LNET network namespace This patch adds tests for LNET for this feature. Test-Parameters: trivial testlist=sanity-lnet Signed-off-by: Aurelien Degremont <degremoa@amazon.com> Change-Id: I2320e5da1beef30be5dcca9529fa838fc9304876 Reviewed-on: https://review.whamcloud.com/35666 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Chris Horn <hornc@cray.com> Reviewed-by: James Simmons <jsimmons@infradead.org> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-10092 llite: Add persistent cache on client PCC is a new framework which provides a group of local cache on Lustre client side. No global namespace will be provided by PCC. Each client uses its own local storage as a cache for itself. Local file system is used to manage the data on local caches. Cached I/O is directed to local filesystem while normal I/O is directed to OSTs. PCC uses HSM for data synchronization. It uses HSM copytool to restore file from local caches to Lustre OSTs. Each PCC has a copytool instance running with unique archive number. Any remote access from another Lustre client would trigger the data synchronization. If a client with PCC goes offline, the cached data becomes inaccessible for other client temporarilly. And after the PCC client reboots and the copytool restarts, the data will be accessible again. ToDo: 1) Make PCC exclusive with HSM. 2) Strong size consistence for PCC cached file among clients. 3) Support to cache partial content of a file. Change-Id: I188ed36c48aae223380739f607cc6caf2f789298 Test-Parameters: clientcount=3 testlist=sanity-pcc,sanity-pcc,sanity-pcc Signed-off-by: Li Xi <lixi@ddn.com> Signed-off-by: Wang Shilong <wshilong@ddn.com> Signed-off-by: Qian Yingjin <qian@ddn.com> Reviewed-on: https://review.whamcloud.com/32963 Tested-by: Jenkins Reviewed-by: Patrick Farrell <pfarrell@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-8998 tests: test scripts for PFL Added test scripts sanity-pfl.sh for PFL. Reviewed-on: https://review.whamcloud.com/24872 Test-Parameters: testlist=sanity-pfl Signed-off-by: Niu Yawei <yawei.niu@intel.com> Signed-off-by: Bobi Jam <bobijam.xu@intel.com> Change-Id: I2a09282d7ce26fc2b683eba994cfc63cd1ce166d Reviewed-by: Andreas Dilger <andreas.dilger@intel.com> Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
LU-8900 snapshot: user space snapshot tools The user space snapshot tools are implemented as part of the lctl tools set. They use other user-space tools, such as lctl commands for write barrier on all MDTs, fork/erase Lustre configuration, zfs/zpool commands for backend zfs snapshot. 1. Create the snapshot lctl snapshot_create [-b | --barrier [on | off]] [-c | --comment comment] <-F | --fsname fsname> [-h | --help] <-n | --name ssname> [-r | --rsh remote_shell] [-t | --timeout timeout] 2. Destroy the snapshot lctl snapshot_destroy [-f | --force] <-F | --fsname fsname> [-h | --help] <-n | --name ssname> [-r | --rsh remote_shell] 3. Modify the snapshot lctl snapshot_modify [-c | --comment comment] <-F | --fsname fsname> [-h | --help] <-n | --name ssname> [-N | --new new_ssname] [-r | --rsh remote_shell] 4. Query the snapshot(s) lctl snapshot_list [-d | --detail] <-F | --fsname fsname> [-h | --help] [-n | --name ssname] [-r | --rsh remote_shell] 5. Mount the snapshot lctl snapshot_mount <-F | --fsname fsname> [-h | --help] <-n | --name ssname> [-r | --rsh remote_shell] 6. Umount the snapshot lctl snapshot_umount <-F | --fsname fsname> [-h | --help] <-n | --name ssname> [-r | --rsh remote_shell] The system config information, such as each target's hostname, pool name, local filesystem name, role, index, and so on, will be written in the snapshot config file "/etc/ldev.conf". To be compatible with old snapshot usage, it will firstly check whether the "/etc/ldev.conf" exists or not, it yes, it will load the configuration from such file preferentially, otherwise, the file "/etc/lsnapshot/${fsname}.conf" will be used. Test-Parameters: alwaysuploadlogs envdefinitions=SLOW=yes mdtfilesystemtype=zfs mdsfilesystemtype=zfs ostfilesystemtype=zfs mdscount=2 mdtcount=4 testlist=sanity-lsnapshot Signed-off-by: Fan Yong <fan.yong@intel.com> Change-Id: I1191c2ea35c355e8554bd2bd022c1b9d32741392 Reviewed-on: https://review.whamcloud.com/24269 Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Niu Yawei <yawei.niu@intel.com> Reviewed-by: Lai Siyao <lai.siyao@intel.com> Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-1538 tests: run sanity-lfsck instead of lfsck Run sanity-lfsck in the default acceptance-small test list instead of the old lfsck test, which will be deprecated and removed in the 2.6 release. Signed-off-by: Andreas Dilger <andreas.dilger@intel.com> Change-Id: I5903d854dc16d3ed8bca1139355a73230e500c1e Reviewed-on: http://review.whamcloud.com/7952 Tested-by: Jenkins Tested-by: Maloo <hpdd-maloo@intel.com> Reviewed-by: Fan Yong <fan.yong@intel.com> Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
LU-1338 hsm: HSM flags feature This extends lustre_hsm_attrs struct in MDD to store HSM per-file information. It adds infrastructure (function, RPCs, ...) to read and modify it, from MDT code or from user-space on clients through llapi and lfs command. This patch implements: - lfs hsm_state - lfs hsm_set - lfs hsm_clear matching llapi functions: - llapi_hsm_state_get() - llapi_hsm_state_set() matching mdt functions: - mdt_hsm_state_get() - mdt_hsm_state_set() and MDS RPC: - MDS_HSM_STATE_GET - MDS_HSM_STATE_SET Signed-off-by: Aurelien Degremont <aurelien.degremont@cea.fr> Signed-off-by: JC Lafoucriere <jacques-charles.lafoucriere@cea.fr> Change-Id: Ic8f82ddc9a56206307c2e5be2523fb7ce42b8638 Reviewed-on: http://review.whamcloud.com/3035 Tested-by: Hudson Reviewed-by: Johann Lombardi <johann.lombardi@intel.com> Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
LU-294 Fix typo in tests/test-groups/regression Signed-off-by: Li Wei <liwei@whamcloud.com> Change-Id: I91015ba4385853db08d9a79fa574e556e1fce48c Reviewed-on: http://review.whamcloud.com/513 Tested-by: Hudson Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: Maloo <whamcloud.maloo@gmail.com>
LU-1538 tests: cleanup test output, acc-small There are a number of issues observed when running test scripts on a single-node system. Several minor cleanups to the test scripts are also possible (coding style, more clear output, etc): - sanity.sh test_51ba() should clean up subdirectories even if test_51b() failed to create all of the files - sanity.sh test_61ic() shouldn't print all files to stdout - running fsx accepts $FSXOPT to allow adding extra test options - implement acceptance-small.sh via auster, so that we don't have to maintain two separate test wrappers, and it would be possible for users running acc-sm to upload results to Maloo if they wanted. Signed-off-by: Andreas Dilger <adilger@whamcloud.com> Change-Id: I8aae9c1af508d8173135f0938e0a26d9731253df Reviewed-on: http://review.whamcloud.com/3132 Tested-by: Hudson Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Li Wei <liwei@whamcloud.com> Reviewed-by: Keith Mannthey <keith@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-957 scrub: Proc interfaces and tests for OI scrub 1) Control/trace OI scrub running. 2) Verify whether the OI scrub basic functions works or not. 3) Test OI scrub performance. For autotest: Test-Parameters: testlist=sanity-scrub,scrub-performance Signed-off-by: Fan Yong <yong.fan@whamcloud.com> Change-Id: I5be3d1a521f5f7875f56e9455ff2010016e6a344 Reviewed-on: http://review.whamcloud.com/3168 Reviewed-by: Yu Jian <yujian@whamcloud.com> Tested-by: Hudson Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Tested-by: Maloo <whamcloud.maloo@gmail.com>
LU-357 racer test cleanup 1, increase the test time to 300s(900s for SLOW) 2, fixing the problem of recursively calling racer.sh Change-Id: I91ac7e5c42ed5bc98b3a647c30d7e37af0573f09 Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com> Reviewed-on: http://review.whamcloud.com/905 Reviewed-by: Yu Jian <yujian@whamcloud.com> Reviewed-by: Fan Yong <yong.fan@whamcloud.com> Tested-by: Hudson Tested-by: Maloo <whamcloud.maloo@gmail.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-103 Add support for test groups. Added an -g GROUP_FILE option to auster. The tests listed in the group file will be used instead of any passed on the command line. I also added a couple of test-groups to get things started, although I'm sure we'll want to refine these. Took care of a few cleanups in run_suite as well. Signed-off-by: Robert Read <rread@whamcloud.com> Change-Id: I5000c2b95a6eb1a49f5305637d4b55de5edc6d5c Reviewed-on: http://review.whamcloud.com/278 Tested-by: Hudson Reviewed-by: Chris Gearing <chris@whamcloud.com> Reviewed-by: Wei Liu <sarah@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>