LU-17638 util: remove newer lnetctl export handling On the current maloo VMs lnetctl export ends up segfaulting. For now go back to the original code until we figure out what is different on this setup and yet it works elsewhere. The reason for a partial reveret is other important works are ready to land that would be delayed by a full revert. Fixes: d3ef8f6993 ("LU-9680 lnet: add NLM_F_DUMP_FILTERED support") Test-Parameters: trivial testlist=sanity-lnet Signed-off-by: James Simmons <jsimmons@infradead.org> Change-Id: Ibd3437ee619cde9667d049455d641a602ea50174 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54436 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Frank Sehr <fsehr@whamcloud.com> Reviewed-by: Chris Horn <chris.horn@hpe.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
LU-17600 lnet: delete lbstats and lnetunload It's not likely that anyone still uses these scripts. Test-Parameters: trivial Signed-off-by: Timothy Day <timday@amazon.com> Change-Id: I418bdf2a1428905d598fdffdf27dff80831350d0 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54250 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16752 test: improve sanity 413a/b reliability Set qos_maxage to 1 early in test_qos_mkdir() to ensure statfs are updated in round-robin mkdir test, so that the subsequent QoS mkdir behave as expected. Test-Parameters: trivial Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Test-Parameters: mdscount=2 mdtcount=4 testlist=sanity Fixes: 233344d451 ("LU-13417 test: generate uneven MDTs early for sanity 413") Fixes: c1d0a355a6 ("LU-12624 lod: alloc dir stripes by QoS") Signed-off-by: Lai Siyao <lai.siyao@whamcloud.com> Change-Id: I08f94b5b4e355ffff0704bd0f661bb99a82a9234 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54168 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Hongchao Zhang <hongchao@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16695 llite: remove O_APPEND check for sync A check for O_APPEND in determining 'sync' or not was accidentally introduced. This forces O_APPEND writes to all be synchronous, which is of course wrong. Fixes: dad7079dfd ("LU-16695 llite: switch to ki_flags from f_flags") Signed-off-by: Patrick Farrell <pfarrell@whamcloud.com> Change-Id: Iafae63ebda527834bd45d6fcbfb0cebb0340f4e4 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54128 Reviewed-by: Alexander Boyko <alexander.boyko@hpe.com> Reviewed-by: Alexey Lyashkov <alexey.lyashkov@hpe.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Shaun Tancheff <shaun.tancheff@hpe.com> Reviewed-by: Andrew Perepechko <andrew.perepechko@hpe.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com>
LU-17566 mdt: remove duplicate call to mdt_init_ucred_reint() Remove duplicate call to mdt_init_ucred_reint() from mdt_reint_setxattr(). mdt_init_ucred_reint() is called in mdt_reint_internal() which is covering all actual reinters. However, SETXATTR was converted to reinters framework in fd908da and this call was not removed. So mdt_init_ucred_reint() is called first in mdt_reint_internal() then again in the specific mdt_reint_setxattr() handler, without anything special being done on the ucred between them. Also merge __mdt_init_ucred() and mdt_init_cred() which was called only once, and with the same prototype. Signed-off-by: Aurelien Degremont <adegremont@nvidia.com> Change-Id: I90fed1d2709edf7337a27dd9c3cb0f75f7625135 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54111 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Sebastien Buisson <sbuisson@ddn.com> Reviewed-by: Bruno Faccini <bfaccini@nvidia.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-17490 tests: verify fanotify works for lustre The fanotify API provides notification and interception of filesystem events. Here we prepare a small util to monitor open/read/write/close events of file in a filesystem. Verify it works for lustre filesystem. Signed-off-by: Lei Feng <flei@whamcloud.com> Test-Parameters: trivial Change-Id: Id57a59bca16133db645e6804024cba9f11d60f1d Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53869 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Alex Deiter Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-17434 lmv: add exclude list for remote dir Apache Spark creating a _temporary subdirectory for staging files, and it should be created on the same MDT as its parent directory. Add a tunable lmv.*.qos_exclude_prefixes, if directory prefix is in this list, lmv_create() should put it on its parent MDT. This prefix list follows the same rule of shell environment PATH: use ':' as separator for prefixes. And for convenience '+/-' can be used to add/remove prefixes. Add sanity 413k. Signed-off-by: Lai Siyao <lai.siyao@whamcloud.com> Change-Id: I4c8a118f0630c19054934a87bee3599bdb1fe7bb Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53780 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Sebastien Buisson <sbuisson@ddn.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-17175 gss: start lsvcgssd from l_getauth If l_getauth detects it cannot connect to the socket supposed to be opened by lsvcgssd, it tries to launch the daemon, with predefined default values. Test-Parameters: trivial Test-Parameters: kerberos=true testlist=sanity-krb5 Test-Parameters: testgroup=review-dne-selinux-ssk-part-2 Signed-off-by: Sebastien Buisson <sbuisson@ddn.com> Change-Id: I3961ce0f548fb6ea23458edcb01a03fb8b3a617f Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53142 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Aurelien Degremont <adegremont@nvidia.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-17179 tests: check the system is clean Main part of tests cannot work correctly if the system is not clean. So check this in the beginning of sanity-quota. Test-Parameters: trivial Signed-off-by: Sergey Cheremencev <scherementsev@ddn.com> Change-Id: Ibfbe4663dee8476486e96eb99ccbcea13216861b Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/52630 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Artem Blagodarenko <ablagodarenko@ddn.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-9859 lnet: move CPT handling to LNet The CPT work is used for LNet and ptlrpc which is the Lustre LNet interface. Move this work there and merge the lib-mem.c code as well since they both work closely together. Move cpt debugfs handling from libcfs to lnet. Now all remaining debugfs in libcfs is for debugging. Test-Parameters: trivial Change-Id: I016a90520bd7c6428b45bafff8618bc864e9112b Signed-off-by: James Simmons <jsimmons@infradead.org> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/52923 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-14361 statahead: add connect flag check for batch RPC The tests (sanity/test_123 test case series) are all failing for servers that do not have batch RPC support. In this patch we add the connect feature flag check in mdc.*.import for batch RPC support and skip the batch stat-ahead tests without this support. Test-Parameters: trivial Signed-off-by: Qian Yingjin <qian@ddn.com> Change-Id: I54c95722df803131727e5882156570c9da5293ee Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54275 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Lai Siyao <lai.siyao@whamcloud.com>
LU-8066 obdclass: fix module load locking. Safe module loading requires that we try_module_get() in a context where the module cannot be unloaded, typically protected by a spinlock that module-unload has to take. This doesn't currently happen in class_get_type(). As free_module() calls synchronize_rcu() between calling the exit function and freeing the module, we can use rcu_read_lock() to check if the exit function has been called, and try_module_get() if it hasn't. We must also check the return status of try_module_get(). Linux-commit: 71707c276e0acff160e7f2bd38d5b61eb1f61ab2 Change-Id: Ia551a951db8fd97db51140123d340b1649a159cd Signed-off-by: Mr. NeilBrown <neilb@suse.de> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/36043 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-6142 mdd: Fix style issues for mdd_dir.c This patch fixes issues reported by checkpatch for file lustre/mdd/mdd_dir.c Test-Parameters: trivial Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: I255a2cfe2dd7c09ce421cb7c5387cef0bba73611 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54217 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-6142 lfsck: Fix style issues for lfsck_striped_dir.c This patch fixes issues reported by checkpatch for file lustre/lfsck/lfsck_striped_dir.c Test-Parameters: trivial Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: I6469e5973a5ee33c408ced48bb9ab162307fdf07 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54214 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-6142 lfsck: Fix style issues for lfsck_namespace.c This patch fixes issues reported by checkpatch for file lustre/lfsck/lfsck_namespace.c Test-Parameters: trivial Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: Ie415d9ace24adaa845a4298499128b2766dc66aa Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54213 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-6142 lfsck: Fix style issues for lfsck_engine.c This patch fixes issues reported by checkpatch for file lustre/lfsck/lfsck_engine.c Test-Parameters: trivial Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: Icf9941210e7e403088ac9216de38f8c49f52e72e Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54212 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-6142 lfsck: Fix style issues under lustre/lfsck This patch fixes issues reported by checkpatch for all files under folder lustre/lfsck Test-Parameters: trivial testlist=sanity-lfsck Signed-off-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Change-Id: I7fed1e66f82c691d94198390ad89e91db9bfcdea Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54165 Reviewed-by: Timothy Day <timday@amazon.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com>
LU-17578 lnet: fix &the_lnet.ln_mt_peerNIRecovq race To avoid race &the_lnet.ln_mt_peerNIRecovq must always be accessed with lnet_net_lock(0) protection. Test-Parameters: trivial Fixes: da23037 ("LU-16563 lnet: use discovered ni status to set initial health") Change-Id: Ic5e0194020200afdecba4cbf5afed274b14da388 Signed-off-by: Bruno Faccini <bfaccini@nvidia.com> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/54163 Reviewed-by: Chris Horn <chris.horn@hpe.com> Reviewed-by: Frank Sehr <fsehr@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Tested-by: jenkins <devops@whamcloud.com>
LU-9680 lnet: add NLM_F_DUMP_FILTERED support In addition to different API levels for the netlink packets we can also filter the data sent back when user land sends the NLM_F_DUMP_FILTERED. Support this across the various netlink dumpit functions. This work is needed for the proper support for lnetctl export command. Update the export to work with the Netlink API. This results in proper IPv6 support for the export command. Test-Parameters: trivial testlist=sanity-lnet Change-Id: I0e8993b1f9a08199f282965601781aa6fd0e4844 Signed-off-by: James Simmons <jsimmons@infradead.org> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53004 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Frank Sehr <fsehr@whamcloud.com> Reviewed-by: Chris Horn <chris.horn@hpe.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-13814 osc: Remove oap_request oap_request isn't actually per-page, it's per requet, so move it up and associate it with the request async args. The goal is to shift away from page lists at the RPC level for DIO. The first step of this is to move everything that can be moved from osc_async_page to the osc_brw_async_args level. Signed-off-by: Patrick Farrell <pfarrell@whamcloud.com> Change-Id: I188039b0abd4b639755dbebfab02597da13d5ddf Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/52071 Reviewed-by: Sebastien Buisson <sbuisson@ddn.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com>