Whamcloud - gitweb
fs/lustre-release.git
6 years agoLU-4287 autoconf: Improve test for proc write and read functions 82/8482/6
James Simmons [Fri, 6 Dec 2013 16:18:46 +0000 (11:18 -0500)]
LU-4287 autoconf: Improve test for proc write and read functions

For newer kernels the proc api has changed to using only
seq_files. To detect this I tested the presence of PDE_DATA
to determine if it was a newer kernel. Now in RHEL6.5 this
macro has been backported but the rest of the changes have
not so it has broken the build. This patch moves from
testing PDE_DATA to testing if you can call write_proc_t
in struct proc_dir_entry. In newer kernels that function
is missing.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I96d21ae5f055d5077da69acdcc4948ec160dd63a
Reviewed-on: http://review.whamcloud.com/8482
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3319 procfs: move configuration layer proc handling over to seq_file 95/7295/15
James Simmons [Mon, 2 Dec 2013 16:36:10 +0000 (11:36 -0500)]
LU-3319 procfs: move configuration layer proc handling over to seq_file

Various Lustre layers have a configuration abstraction for logs
which implements a proc interface. For 3.10+ kernel support we
adapt this proc handling to using seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: Ie507fd88cdf5193624991f7ab32bdc213a44aebc
Reviewed-on: http://review.whamcloud.com/7295
Reviewed-by: Peng Tao <bergwolf@gmail.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4136 obdclass: use obd_get_info to report network status 08/8408/4
Bobi Jam [Wed, 27 Nov 2013 04:36:05 +0000 (12:36 +0800)]
LU-4136 obdclass: use obd_get_info to report network status

Use obd_get_info() to report MDT-OST connection status instead of
health_check(), so that /proc/fs/lustre/health_check does not
check MDT's connection status.

Signed-off-by: Bobi Jam <bobijam.xu@intel.com>
Change-Id: I8b4afcfdce3712fff893475b9c5cd44654f3762e
Reviewed-on: http://review.whamcloud.com/8408
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4383 osd: fid_is_on_ost should only return 1 or 0 66/8566/3
wang di [Thu, 12 Dec 2013 22:36:20 +0000 (14:36 -0800)]
LU-4383 osd: fid_is_on_ost should only return 1 or 0

fid_is_on_ost should only return 1 or 0 to check whether
the FID is on OST or not.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Ia9949bc12387d32c94cf993f674bbcca88c260bf
Reviewed-on: http://review.whamcloud.com/8566
Tested-by: Jenkins
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-3319 procfs: move FLD proc handling over to seq_file 40/7140/10
James Simmons [Fri, 6 Dec 2013 14:14:08 +0000 (09:14 -0500)]
LU-3319 procfs: move FLD proc handling over to seq_file

In order to support 3.10+ kernels for clients we adapt
the FLD proc handling to using seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I056d4dcc15b82263880949a0928fc04bd6b2f0b7
Reviewed-on: http://review.whamcloud.com/7140
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Yang Sheng <yang.sheng@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3319 procfs: move ptlrpc proc handling over to seq_file 96/7296/18
James Simmons [Fri, 6 Dec 2013 14:45:52 +0000 (09:45 -0500)]
LU-3319 procfs: move ptlrpc proc handling over to seq_file

In order to support 3.10+ kernels for clients we adapt
the ptlrpc proc handling to using seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: Ib0bf475d62fd632f6eaaad2d2efbcdedc49df3b8
Reviewed-on: http://review.whamcloud.com/7296
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Yang Sheng <yang.sheng@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4336 quota: improper assert in osc_quota_chkdq() 60/8460/2
Niu Yawei [Tue, 3 Dec 2013 01:57:40 +0000 (20:57 -0500)]
LU-4336 quota: improper assert in osc_quota_chkdq()

In osc_quota_chkdq(), we should never try to access oqi found
from hash, since it could have been freed by osc_quota_setdq().

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: Ia73cf89cb5bbd730fa6f0a00e44771f733b2baa6
Reviewed-on: http://review.whamcloud.com/8460
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
6 years agoLU-4307 kerberos: fix __exit usage and unknown symbol errors 81/8481/3
James Simmons [Wed, 4 Dec 2013 20:03:38 +0000 (15:03 -0500)]
LU-4307 kerberos: fix __exit usage and unknown symbol errors

For linux all functions marked with __exit should not be
called as a cleanup function in the module init functions.
This patch removes __exit from the gss module exit functions
that are being used as cleanup in the module init function.
The second issue addressed is the unknown symbols due to
gss_[init/exit]_keyring being called when HAVE_GSS_KEYRING
is not defined.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I2de7a3ade47f585f5ec1634ee55c1d2ce56f2921
Reviewed-on: http://review.whamcloud.com/8481
Tested-by: Jenkins
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Thomas Stibor <thomas@stibor.net>
Reviewed-by: Andrew Korty <ajk@iu.edu>
6 years agoLU-3862 misc: delete obsolete config script 03/8403/2
Andreas Dilger [Tue, 26 Nov 2013 19:55:51 +0000 (12:55 -0700)]
LU-3862 misc: delete obsolete config script

The "lustre" and "lnet" config scripts are currently in use for
Lustre/LNET startup/shutdown, but "lustrefs" hasn't been maintained
since it was first introduced.  Delete it.

Signed-off-by: Andreas Dilger <andreas.dilger@intel.com>
Change-Id: Idd77c4a60a1128ad95ec5c8af644feb8793ebbe5
Reviewed-on: http://review.whamcloud.com/8403
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Christopher J. Morrone <chris.morrone.llnl@gmail.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4278 libcfs: remove LWT 40/8340/3
Peng Tao [Wed, 20 Nov 2013 09:07:24 +0000 (17:07 +0800)]
LU-4278 libcfs: remove LWT

The LWT code has been disabled on all platforms since being merged.
Now that its functionality can be replaces by Systemtap etc, it is
on longer needed.

Signed-off-by: Peng Tao <bergwolf@gmail.com>
Change-Id: I21dc913bfdbbf1bfba5e0d7de3d43b183f0e5b23
Reviewed-on: http://review.whamcloud.com/8340
Reviewed-by: Dmitry Eremin <dmitry.eremin@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4218 tests: fix for facet_host() 94/8194/2
Vladimir Saveliev [Sun, 3 Nov 2013 03:07:55 +0000 (07:07 +0400)]
LU-4218 tests: fix for facet_host()

When ost_HOST is not set (ost1_HOST, ost2_HOST, etc are used),
facet_host() maps ostNfailover facet (when ostNfailover_HOST is not
set) to default value of ost_HOST, etc hostname.
With this change, facet_host() maps ostNfailover facet to value of
ostN_HOST if it is set, otherwise it resorts to $ost_HOST.

Xyratex-bug-id: MRP-1118
Signed-off-by: Vladimir Saveliev <vladimir_saveliev@xyratex.com>
Change-Id: I23dd7cb0d7de02740ab60f9f86442bc92a4a0300
Reviewed-on: http://review.whamcloud.com/8194
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Wei Liu <wei3.liu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3909 tests: sanity test 129 fix 43/8143/4
Vladimir Saveliev [Fri, 22 Nov 2013 13:46:08 +0000 (17:46 +0400)]
LU-3909 tests: sanity test 129 fix

Patch from LU-2479 changed max dir size limit behaviour. Before the
patch last block of a directory which reached its limit was mostly
empty so that creation of new file after limit cancelation caused no
dir size grow. With the patch last block of limited directory gets
full when limit is reached. Therefore dir size increases on file
creation after limit cancellation.
The patch makes sanity test_129 to distinguish these cases.

Xyratex-bug-id: MRP-1444
Signed-off-by: Vladmir Saveliev <vladimir_saveliev@xyratex.com>
Change-Id: I0ea9eee5a0d20f31d9f62e9e5f2af1ee550f3588
Reviewed-on: http://review.whamcloud.com/8143
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
6 years agoLU-3319 procfs: migrate quota proc handling to seq_files 31/7931/5
James Simmons [Thu, 14 Nov 2013 14:53:50 +0000 (09:53 -0500)]
LU-3319 procfs: migrate quota proc handling to seq_files

For proper 3.10+ kernel support we migrate the quota proc
file handling to use only seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I50b1e5372dfad4e06f7e4dec95cc3efa83a3f902
Reviewed-on: http://review.whamcloud.com/7931
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
6 years agoLU-3974 client: use standard dentry locking function 41/7741/3
James Simmons [Mon, 2 Dec 2013 16:44:19 +0000 (11:44 -0500)]
LU-3974 client: use standard dentry locking function

Over time the struct dentry reference count have change
its data structure. In the 3.11 kernel it was changed
to a struct lockref. To handle these cases in the past
Lustre implemented a d_refcount wrapper to handle all
these changes. At the same time for 3.11 a d_count()
wrapper was introduced. So this patch moved use to use
this d_count wrapper and if not present we emulate it.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I4c175e789298841f9d599e5195dbd94ccea6216a
Reviewed-on: http://review.whamcloud.com/7741
Reviewed-by: Peng Tao <bergwolf@gmail.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3319 procfs: move top level proc handling over to seq_file 94/7294/4
James Simmons [Wed, 4 Dec 2013 13:44:24 +0000 (08:44 -0500)]
LU-3319 procfs: move top level proc handling over to seq_file

In the proc tree lustre creates the top level is handled in
the linux module code. For 3.10+ kernel support we adapt
this proc handling to using seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I19f2b5d14cdbd97f2591ec8f1eaf174c8c6d4553
Reviewed-on: http://review.whamcloud.com/7294
Tested-by: Jenkins
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3319 procfs: move lov proc handling over to seq_file 92/7292/7
James Simmons [Thu, 14 Nov 2013 14:36:41 +0000 (09:36 -0500)]
LU-3319 procfs: move lov proc handling over to seq_file

In order to support 3.10+ kernels for clients we adapt
the lov proc handling to using seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: Icd19a7c75301e1351d1d116afbc1aa4f7168c2eb
Reviewed-on: http://review.whamcloud.com/7292
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3319 procfs: move FID proc handling over to seq_file 39/7139/11
James Simmons [Mon, 2 Dec 2013 16:20:00 +0000 (11:20 -0500)]
LU-3319 procfs: move FID proc handling over to seq_file

In order to support 3.10+ kernels for clients we adapt
the fid proc handling to using seq_files.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I3dbd102922060576cb57495da73e6d93c117c2e3
Reviewed-on: http://review.whamcloud.com/7139
Reviewed-by: Peng Tao <bergwolf@gmail.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3335 osd: use local transaction directly inside OSD 45/7145/13
Fan Yong [Sat, 2 Nov 2013 18:42:47 +0000 (02:42 +0800)]
LU-3335 osd: use local transaction directly inside OSD

For OSD internal function, it is unnecessay to call dt_trans_xxx for
transaction operations. Instead, call backend journal APIs directly.

Signed-off-by: Fan Yong <fan.yong@intel.com>
Change-Id: I111c52f76a894e4269ad8ac6aec3ea7747ba4f59
Reviewed-on: http://review.whamcloud.com/7145
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
6 years agoLU-4196 build: Build support for OFED-3.5 and SLES 11 40/8140/2
Chris Horn [Fri, 1 Nov 2013 18:50:21 +0000 (13:50 -0500)]
LU-4196 build: Build support for OFED-3.5 and SLES 11

CONFIG_COMPATE_SLES_11_SP* needed in EXTRA_LNET_INCLUDE to allow
building against OFED-3.5

Signed-off-by: Chris Horn <hornc@cray.com>
Test-Parameters: serverdistro=sles11sp3 serverarch=x86_64 serveribstack=ofa nettypes=o2ib
Change-Id: I0fcdba12167cd0dc1d7b0e323a46d85df1c96168
Reviewed-on: http://review.whamcloud.com/8140
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3700 tests: skip sanity-hsm/51b for ZFS 03/8503/2
Nathaniel Clark [Fri, 6 Dec 2013 21:26:59 +0000 (16:26 -0500)]
LU-3700 tests: skip sanity-hsm/51b for ZFS

EXCEPT sanity-hsm/51b until a full fix can be found for this issue so
that review-zfs can be enabled.

Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: If6b7fb0d6c5ed20c8fb7ce898311f2b3d53a2916
Reviewed-on: http://review.whamcloud.com/8503
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Faccini Bruno <bruno.faccini@intel.com>
6 years agoLU-3321 clio: remove stackable cl_page completely 95/7895/17
Jinshan Xiong [Wed, 6 Nov 2013 05:51:39 +0000 (21:51 -0800)]
LU-3321 clio: remove stackable cl_page completely

From now on, cl_page becomes one to one mapping of vmpage.

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: I13156d9f10ee43c614d1e43eed6743db1574069a
Reviewed-on: http://review.whamcloud.com/7895
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4329 tests: initialize $PREV_RESULT in wait_update() 49/8449/2
Emoly Liu [Wed, 27 Nov 2013 09:25:01 +0000 (17:25 +0800)]
LU-4329 tests: initialize $PREV_RESULT in wait_update()

Initialize variable PREV_RESULT in wait_update() to avoid useless
output like "Changed after 0s: from '' to '1'".

Signed-off-by: Emoly Liu <emoly.liu@intel.com>
Change-Id: I2aea8547892a36e92e8d0c54ac541397a102e76c
Reviewed-on: http://review.whamcloud.com/8449
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3726 tests: DNE specific tests for HSM. 71/7571/9
Thomas Leibovici [Wed, 7 Aug 2013 14:09:51 +0000 (16:09 +0200)]
LU-3726 tests: DNE specific tests for HSM.

Add tests in sanity-hsm.sh to check DNE specific
features in HSM code: copytool registration to
several MDTs, HSM request shunting to the right MDT,
and coumpound request splitting.

Test-Parameters: mdtcount=2 mdscount=2 testlist=sanity-hsm
Signed-off-by: Thomas Leibovici <thomas.leibovici@cea.fr>
Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I6706571c92e4c3e978b2143dd5bdef4b73d2c1e2
Reviewed-on: http://review.whamcloud.com/7571
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4362 libcfs: wrong parameter to cfs_hash_keycpy 09/8509/2
Liang Zhen [Mon, 9 Dec 2013 12:39:35 +0000 (20:39 +0800)]
LU-4362 libcfs: wrong parameter to cfs_hash_keycpy

cfs_hash_rehash_key() passed wrong parameter to cfs_hash_keycpy,
hnode should be the second parameter not the third one.

Signed-off-by: Liang Zhen <liang.zhen@intel.com>
Change-Id: I44f73e4d2ffdeab5b021d49642598e939ebacee5
Reviewed-on: http://review.whamcloud.com/8509
Tested-by: Jenkins
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-4223 utils: fixing loop leaking in utils 09/8409/9
wang di [Sat, 30 Nov 2013 15:40:22 +0000 (07:40 -0800)]
LU-4223 utils: fixing loop leaking in utils

1. If the file is being opened by popen, it should use
pclose instead of fclose to close the file, to make sure
the process created by popen is closed after pclose, then
to avoid loop device is being hold on release.

2. Give another try in loop_cleanup in case there are still
some process going on with the loop.

3. wait loop device to release before continue conf-sanity
32c.

4. Add losetup -a to list loop dev information when the
test(conf-sanity 32) fails.

Signed-off-by: John L. Hammond <john.hammond@intel.com>
Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I0051de9b5a39d487fe34554c79773de4635178cc
Reviewed-on: http://review.whamcloud.com/8409
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-2139 ofd: Do async commit if SOFT_SYNC is seen 35/5935/8
Prakash Surya [Mon, 22 Oct 2012 23:34:29 +0000 (16:34 -0700)]
LU-2139 ofd: Do async commit if SOFT_SYNC is seen

This change implements the server side portion of the OBD_BRW_SOFT_SYNC
agreement. When this flag is seen on an incoming BRW page, the server
will begin an asynchronous commit operation via dt_commit_async.

The intention is for this operation to commit pages belonging to a
client which has "too many" outstanding unstable pages in its cache.
Upon the commit operation completing, the last_commited value should
percolate out to the client of interest, allowing it to drop some of
its pinned unstable pages.

Unfortunately, there is currently no optimization to proactively send
the last_committed value to the client immediately after the commit
operation succeeds. It must be piggybacked on any future IO or
pings made by the client.

Added fed_soft_sync_count which is set to a limit of 16 SOFT_SYNC
RPCs, and it will be reset as soon as there is a non-SOFT_SYNC RPC.

Added ofd_soft_sync_limit as a tunable proc value for the limit of
fed_soft_sync_count.

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Signed-off-by: Lai Siyao <lai.siyao@intel.com>
Change-Id: I1bac4bc517ab023a5b298f34bb695c7ba8ece896
Reviewed-on: http://review.whamcloud.com/5935
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Jenkins
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3906 tests: use df instead of lfs_df in run_compilebench() 29/8429/2
Jian Yu [Thu, 28 Nov 2013 06:47:55 +0000 (14:47 +0800)]
LU-3906 tests: use df instead of lfs_df in run_compilebench()

Since run_compilebench() will be run on NFS client which has no
Lustre filesystem, we need change to use df instead of lfs_df to
get the space usage information.

Test-Parameters: envdefinitions=SLOW=yes,ONLY=compilebench \
testlist=parallel-scale,parallel-scale-nfsv3,parallel-scale-nfsv4

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: Ia1a9586586b888231952830180157a9e37f08843
Reviewed-on: http://review.whamcloud.com/8429
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4243 mgs: use proper uuid in mgs_write_log_failnids() 72/8372/3
Niu Yawei [Wed, 4 Dec 2013 04:20:18 +0000 (23:20 -0500)]
LU-4243 mgs: use proper uuid in mgs_write_log_failnids()

This patch revert the changes to mgs_write_log_failnids() in the
commit d9d27cad, which introduced a regression of that when multiple
'--servicenode' or '--failnode' option specified, the uuid from
first option will be wrongly used for all other connections.

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: Ibd989de67fe6851cc75569be3f64dadaec5e6f8c
Reviewed-on: http://review.whamcloud.com/8372
Tested-by: Jenkins
Reviewed-by: Erich Focht <efocht@gmail.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3700 tests: Strengthen and clarify sanity-hsm/test_21 67/8467/3
Bruno Faccini [Tue, 3 Dec 2013 14:45:00 +0000 (15:45 +0100)]
LU-3700 tests: Strengthen and clarify sanity-hsm/test_21

This patch is intended to add full debug and clarify some of
the controls in subtest test_21 of sanity-hsm.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I7546d95c7e90aa9dd213870f3af9d2e9e33c7632
Reviewed-on: http://review.whamcloud.com/8467
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-4076 fld: add local fldb to each target 84/7884/11
wang di [Tue, 8 Oct 2013 09:13:27 +0000 (02:13 -0700)]
LU-4076 fld: add local fldb to each target

1. Add local FLDB to each MDT, so OSD/OUT can check whether
FID is remote by looking up local FLDB, i.e. no need send RPC
to MDT0.

2. OSD will only do local lookup when checking remote FID.

3. During upgrade, MDTn(n != 0) needs to retrieve its fldb
entries from controller(MDT0) and insert into the local
FLDB.

4. MDT should also use LWP(instead of OSP) to communicate
with sequence controller (MDT0).

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I788a543aeb7305dfbad3cc41b586f9337f227119
Reviewed-on: http://review.whamcloud.com/7884
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-1757 brw: added OBDO short io flag 82/8182/4
Alexander.Boyko [Fri, 15 Nov 2013 06:05:01 +0000 (10:05 +0400)]
LU-1757 brw: added OBDO short io flag

To prevent collisions with any future flags needed in features written
against this branch.

Signed-off-by: Alexander Boyko <alexander_boyko@xyratex.com>
Xyratex-bug-id: MRP-1460
Change-Id: I7084c72fa0c8e2cc0eff1b5c93f1a560d3946a54
Reviewed-on: http://review.whamcloud.com/8182
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Vitaly Fertman <vitaly_fertman@xyratex.com>
6 years agoLU-3963 libcfs: cleanup list operations 80/4780/11
James Simmons [Wed, 27 Nov 2013 18:35:21 +0000 (13:35 -0500)]
LU-3963 libcfs: cleanup list operations

Cleanup list operations (libcfs/include/libcfs/list.h)
All typed list operations for the libcfs core are converted
to the kernel APIs.

Signed-off-by: Liu Xuezhao <xuezhao.liu@emc.com>
Signed-off-by: Peng Tao <tao.peng@emc.com>
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: Ibcb92e5133312e8db4fdf2f9fa1b68a8c68a2e74
Reviewed-on: http://review.whamcloud.com/4780
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Peng Tao <bergwolf@gmail.com>
6 years agoLU-4231 llite: proper support of NFS anonymous dentries 47/8347/3
Dmitry Eremin [Wed, 20 Nov 2013 18:35:11 +0000 (22:35 +0400)]
LU-4231 llite: proper support of NFS anonymous dentries

NFS can ask to encode dentries that are not connected to the root.
The fix check for parent is NULL and encode a file handle accordingly.

Signed-off-by: Dmitry Eremin <dmitry.eremin@intel.com>
Change-Id: Idba91fd4bca4f26a37fd9bc76a340d2fbf557c9e
Reviewed-on: http://review.whamcloud.com/8347
Reviewed-by: Fan Yong <fan.yong@intel.com>
Tested-by: Jenkins
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4283 test: auster "-s" flag does not run SLOW tests 51/8351/3
James Nunez [Wed, 20 Nov 2013 22:19:22 +0000 (15:19 -0700)]
LU-4283 test: auster "-s" flag does not run SLOW tests

Using the "-s" flag when calling auster is supposed to
run tests that are marked as "SLOW". The SLOW variable was
not exported and, thus, was not recognized as being set
in the test scripts. SLOW is now exported.

Signed-off-by: James Nunez <james.a.nunez@intel.com>
Change-Id: I52898d183163392144d1e809df35ab6278f06df2
Reviewed-on: http://review.whamcloud.com/8351
Tested-by: Jenkins
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4307 kerberos: compile errors with gss/kerberos support 93/8393/2
Thomas Stibor [Mon, 25 Nov 2013 15:41:21 +0000 (16:41 +0100)]
LU-4307 kerberos: compile errors with gss/kerberos support

Configure Lustre with parameters --with-krb5 --enable-gss
causes compile errors due to missing '*' and unused variable.
The errors are: taking address of expression of type ‘void’ [-Werror]
and variable ‘res’ set but not used [-Werror=unused-but-set-variable]

Signed-off-by: Thomas Stibor <thomas@stibor.net>
Change-Id: I20b0b0ffa3ea34ce0a954146ccc762b7c17c00de
Reviewed-on: http://review.whamcloud.com/8393
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andrew Korty <ajk@iu.edu>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-2675 echo: remove #if 0-ed out regions from echo_client.c 80/5580/2
John L. Hammond [Mon, 4 Mar 2013 16:54:24 +0000 (10:54 -0600)]
LU-2675 echo: remove #if 0-ed out regions from echo_client.c

The landing of clio #if 0-ed out some regions of echo_client.c
including what would be the last use of obd_cancel(). Just remove
these regions entirely.

Signed-off-by: John L. Hammond <john.hammond@intel.com>
Change-Id: I9c0bf09bd750bbca70ef30cddea25da7c03c6721
Reviewed-on: http://review.whamcloud.com/5580
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4285 kernel: fix uninitialized access of quota got[] array 18/8418/5
yangsheng [Wed, 27 Nov 2013 18:31:52 +0000 (02:31 +0800)]
LU-4285 kernel: fix uninitialized access of quota got[] array

The pointer maybe uninitialized when dqput be called.

Signed-off-by: yang sheng <yang.sheng@intel.com>
Change-Id: I94c138664c2f0a2404f2dafda25f3ee968a981fb
Reviewed-on: http://review.whamcloud.com/8418
Tested-by: Jenkins
Reviewed-by: Niu Yawei <yawei.niu@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-1538 tests: clarify conf-sanity test_49 failures 07/6207/3
Andreas Dilger [Tue, 9 Oct 2012 18:44:21 +0000 (12:44 -0600)]
LU-1538 tests: clarify conf-sanity test_49 failures

Clean up the code for conf-sanity.sh test_49 to allow easier debugging
of test failures, which were seen intermittently during development.

Also clean up the coding style to match current guidelines.

Signed-off-by: Andreas Dilger <andreas.dilger@intel.com>
Change-Id: Iac60fd89c5f193bfa11d9223e75ae947c8b6e186
Reviewed-on: http://review.whamcloud.com/6207
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-658 liblustre: free sbi too early 07/2107/2
Bobi Jam [Mon, 6 Feb 2012 18:29:07 +0000 (02:29 +0800)]
LU-658 liblustre: free sbi too early

llu_fsop_gone will do the job if llu_ffswop_mount runs ok.

Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: I1e3a103589fc5221cc481431c4477c4597cab738
Reviewed-on: http://review.whamcloud.com/2107
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alexey Lyashkov <alexey_lyashkov@xyratex.com>
6 years agoLU-4260 lod: free striping if striping initialization fails 24/8324/2
wang di [Mon, 18 Nov 2013 08:18:09 +0000 (00:18 -0800)]
LU-4260 lod: free striping if striping initialization fails

It should free striping if striping information initialization is
faild, otherwise the later object find will pick up this wrong lod
object, and hit LBUG

ASSERTION( lc->ldo_stripenr == 0 ) failed:

[<ffffffffa0349895>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[<ffffffffa0349e97>] lbug_with_loc+0x47/0xb0 [libcfs]
[<ffffffffa0e3f78f>] lod_ah_init+0x57f/0x5c0 [lod]
[<ffffffffa0b73a83>] mdd_object_make_hint+0x83/0xa0 [mdd]
[<ffffffffa0b7feb2>] mdd_create_data+0x332/0x7d0 [mdd]
[<ffffffffa0d9cc2c>] mdt_finish_open+0x125c/0x18a0 [mdt]
[<ffffffffa0d984f8>] ? mdt_object_open_lock+0x1c8/0x510 [mdt]
[<ffffffffa0d9ee8d>] mdt_reint_open+0x115d/0x20c0 [mdt]

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I67b2bd0e013b860767d19eda986fdcff7e16c486
Reviewed-on: http://review.whamcloud.com/8324
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4253 osc: Don't flush active extents. 78/8278/2
Ann Koehler [Thu, 14 Nov 2013 22:02:15 +0000 (16:02 -0600)]
LU-4253 osc: Don't flush active extents.

The extent is active so we need to abort and let the caller
re-dirty the page. If we continued on here, and we were the
one making the extent active, we could deadlock waiting for
the page writeback to clear but it won't because the extent
is active and won't be written out.

Signed-off-by: Ann Koehler <amk@cray.com>
Change-Id: Iba646d8185b12ab227fe0bbee1c6602ccdc32ad6
Reviewed-on: http://review.whamcloud.com/8278
Tested-by: Jenkins
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Alexey Lyashkov <alexey_lyashkov@xyratex.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-1408 debug: initialize debug_msg_data if needed 38/8338/2
Hongchao Zhang [Thu, 24 May 2012 06:23:06 +0000 (14:23 +0800)]
LU-1408 debug: initialize debug_msg_data if needed

initialize the libcfs_debug_msg_data only if needed

Change-Id: Ia6039e06e03f859441c878a93be2585770131fd6
Signed-off-by: Oleg Drokin <green@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/8338
Tested-by: Jenkins
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3373 llite: instantiate negative dentry 10/8110/4
yangsheng [Wed, 13 Nov 2013 13:30:35 +0000 (21:30 +0800)]
LU-3373 llite: instantiate negative dentry

In the atomic_open callback. We should instantiate
negative dentry. Else will got sanity:183 failed.

Signed-off-by: yang sheng <yang.sheng@intel.com>
Change-Id: I83bc4a8995dfb813a381e910cc94cef6fe3721c3
Reviewed-on: http://review.whamcloud.com/8110
Tested-by: Jenkins
Reviewed-by: Peng Tao <bergwolf@gmail.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3467 target: use osc_reply_portal for OUT services 90/8390/5
Mikhail Pershin [Mon, 25 Nov 2013 13:53:40 +0000 (17:53 +0400)]
LU-3467 target: use osc_reply_portal for OUT services

OUT service is used to server both MDS-MDS updates and MDS-OST
therefore services on MDT and OST are set to use the same request
and reply portals to be fully unified and able to serve any type
of requests.

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: Ifff20343d879552e7568399c021e2c8e8c3d6bf2
Reviewed-on: http://review.whamcloud.com/8390
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: wangdi <di.wang@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4313 osp: continue waiting for -ENOTCONN 15/8415/3
Hongchao Zhang [Wed, 7 Aug 2013 19:45:32 +0000 (03:45 +0800)]
LU-4313 osp: continue waiting for -ENOTCONN

in osp_precreate_reserve, -ENOTCONN should also be treated
as recoverable errors, such as -ENODEV, and continue waiting
the object to be created by OSP once it completes recovery.

Change-Id: I39b600eaacdb68f54c6ad7ecb417532bc0ad5e7b
Signed-off-by: Hongchao Zhang <hongchao.zhang@intel.com>
Reviewed-on: http://review.whamcloud.com/8415
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
6 years agoLU-4089 ptlrpc: remove unneeded semicolon 23/7923/2
Oleg Drokin [Fri, 11 Oct 2013 01:23:05 +0000 (21:23 -0400)]
LU-4089 ptlrpc: remove unneeded semicolon

From kernel upstream submission:
Author: Fengguang Wu <fengguang.wu@intel.com>
Date:   Sat Sep 14 19:56:25 2013 -0700

staging/lustre: fix coccinelle warnings

drivers/staging/lustre/lustre/ptlrpc/sec_bulk.c:217:2-3: Unneeded semicolon

Removes unneeded semicolon.

Generated by: coccinelle/misc/semicolon.cocci

Signed-off-by: Fengguang Wu <fengguang.wu@intel.com>
Change-Id: Iabe1d0cf041161948862e85ff114d8c4636bba90
Reviewed-on: http://review.whamcloud.com/7923
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Dmitry Eremin <dmitry.eremin@intel.com>
Reviewed-by: James Nunez <james.a.nunez@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4088 obdecho: Copy entire lsm, not just pointer size 22/7922/2
Oleg Drokin [Fri, 11 Oct 2013 01:17:03 +0000 (21:17 -0400)]
LU-4088 obdecho: Copy entire lsm, not just pointer size

From linux-kernel upstream:
Author: Thomas Meyer <thomas@m3y3r.de>
Date:   Thu Sep 19 23:45:46 2013 +0200

staging: lustre: Cocci spatch "noderef"

sizeof when applied to a pointer typed expression gives the size of the
pointer.
Found by coccinelle spatch "misc/noderef.cocci"

Signed-off-by: Thomas Meyer <thomas@m3y3r.de>
Change-Id: If5ce3597abe1d2a806c94e34a1b7dc4c27f19e02
Reviewed-on: http://review.whamcloud.com/7922
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Dmitry Eremin <dmitry.eremin@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoNew tag 2.5.52 2.5.52 v2_5_52 v2_5_52_0
Oleg Drokin [Mon, 2 Dec 2013 16:05:39 +0000 (01:05 +0900)]
New tag 2.5.52

Change-Id: I85b2dbed7267a8b12017734a36092b1fcaac85bc

6 years agoLU-3321 osc: add weight function for DLM lock 94/7894/16
Jinshan Xiong [Wed, 6 Nov 2013 04:42:40 +0000 (20:42 -0800)]
LU-3321 osc: add weight function for DLM lock

Use weigh_ast to decide if a lock covers any pages.
In recovery, weigh_ast will be used to decide if a DLM read lock
covers any locked pages, or it will be canceled instead being
recovered.

The problem with the original implementation is that it attached
each osc_page to an osc_lock also changed lock state to add every
pages for readahead.

Bugzilla-bug-Id: b=16774

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: I34efb0db52574c8cf5a7165d80ed527c80ba4031
Reviewed-on: http://review.whamcloud.com/7894
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3321 clio: add pages into writeback cache in batch 93/7893/19
Jinshan Xiong [Mon, 30 Sep 2013 23:11:11 +0000 (16:11 -0700)]
LU-3321 clio: add pages into writeback cache in batch

in ll_write_end(), instead of adding the page into writeback
cache directly, it will be held in a page list. After enough
pages have been collected, issue them all with cio_commit_async().

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: I7393e7ac7e44ab8d53f89cebd61dc9b34922f18c
Reviewed-on: http://review.whamcloud.com/7893
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4310 kernel: missed unlock in quota patch 38/8438/2
Andreas Dilger [Fri, 29 Nov 2013 06:00:54 +0000 (23:00 -0700)]
LU-4310 kernel: missed unlock in quota patch

The quota-replace-dqptr-sem.patch introduced a regression which
could miss unlock inode->i_lock in __dquot_alloc_space().

Change-Id: If0f240fe76d661909c13b11e3d384e77da3ebbe5
Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Signed-off-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-on: http://review.whamcloud.com/8438
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
6 years agoLU-2829 tests: decrease load on zfs for sanityn/33a-b 40/8440/2
Jian Yu [Fri, 29 Nov 2013 06:40:15 +0000 (14:40 +0800)]
LU-2829 tests: decrease load on zfs for sanityn/33a-b

This patch decreases the number of files again for sanityn
test 33a and 33b based on the following patch:

Lustre-commit: 4add39c3775a69c2b3daf212b8e3fc9976bd53e6
Lustre-change: http://review.whamcloud.com/8161

Test-Parameters: envdefinitions=SLOW=yes \
mdtfilesystemtype=zfs mdsfilesystemtype=zfs ostfilesystemtype=zfs \
ostcount=2 testlist=sanityn

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I2469c6a90b050b0712a3f6ca209069cf88a91e71
Reviewed-on: http://review.whamcloud.com/8440
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3373 misc: small changes for 3.10 server support 94/7794/8
yangsheng [Sat, 21 Sep 2013 17:24:35 +0000 (01:24 +0800)]
LU-3373 misc: small changes for 3.10 server support

--quota use struct kqid as parameter
--export ext4_dec/inc_count for nlink count
--ext4_find_entry & ext4_journal_start_sb changes
--iop->truncate removed
--other trival changes to calm compiler warning

Signed-off-by: yang sheng <yang.sheng@intel.com>
Change-Id: I77aedb624033debe37cb6928721c2550498ad72d
Reviewed-on: http://review.whamcloud.com/7794
Tested-by: Jenkins
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4175 tests: fix obdecho_test() to calculate write count 89/8089/3
Jian Yu [Tue, 29 Oct 2013 13:45:21 +0000 (21:45 +0800)]
LU-4175 tests: fix obdecho_test() to calculate write count

This patch fixes obdecho_test() in sanity.sh to calculate
write count so as to avoid out of space failure while the
page number is large but the obd target size is small.

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: Ibff44bf1f6a932e99c565eeda2f1edaf80962dbf
Reviewed-on: http://review.whamcloud.com/8089
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Emoly Liu <emoly.liu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4279 mdd: Fixed OBF of the FS .lustre 60/8360/3
Bruno Faccini [Tue, 26 Nov 2013 10:46:07 +0000 (11:46 +0100)]
LU-4279 mdd: Fixed OBF of the FS .lustre

Added a check to prevent fid access to the filesystem .lustre
directory from returning EINVAL.
Added a sanity check accordingly.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I3002e8dd1b834a0b6b87fe707e12573c2accb58c
Reviewed-on: http://review.whamcloud.com/8360
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Sebastien Buisson <sebastien.buisson@bull.net>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-1233 tests: clean up files in performance-sanity test 65/8265/3
Jian Yu [Mon, 18 Nov 2013 06:38:00 +0000 (14:38 +0800)]
LU-1233 tests: clean up files in performance-sanity test

This patch cleans up the files created in performance-sanity.sh
through mdsrate-{create,lookup,stat}-*.sh after create/lookup/stat
operation fails.

Test-Parameters: envdefinitions=SLOW=yes,ENABLE_QUOTA=yes \
testlist=performance-sanity

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: Ied70b273aa036389d28416c33d6f4e56ba5697a4
Reviewed-on: http://review.whamcloud.com/8265
Tested-by: Jenkins
Reviewed-by: Wei Liu <wei3.liu@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Minh Diep <minh.diep@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4277 lod: handle os_state as a flag, check READONLY 78/8378/2
Andreas Dilger [Sat, 23 Nov 2013 00:53:43 +0000 (17:53 -0700)]
LU-4277 lod: handle os_state as a flag, check READONLY

Handle the osfs->os_state values as flags instead of as values.
Otherwise, if an OSD has OS_STATE_DEGRADED and another flag set
it will not match to skip the OST during object allocation.

Similarly, there was no check for the OS_STATE_READONLY flag in
the create path, which should be used to always skip an OST for
object creation until it is cleared.

These flags are not yet set by osd-zfs, only by osd-ldiskfs so far.

Signed-off-by: Andreas Dilger <andreas.dilger@intel.com>
Change-Id: I0ef59a9fd631a6942d963e37cfce2bfe183ebbe5
Reviewed-on: http://review.whamcloud.com/8378
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3230 osp: unstick precreates on unmount 95/7995/13
Nathaniel Clark [Fri, 1 Nov 2013 12:52:14 +0000 (08:52 -0400)]
LU-3230 osp: unstick precreates on unmount

Allow osp_precreate_reserve to propagate error, Add debug code to
illuminate what the error code is if not EIO.

Test-Parameters: mdsfilesystemtype=zfs mdtfilesystemtype=zfs ostfilesystemtype=zfs
Test-Parameters: mdsfilesystemtype=zfs mdtfilesystemtype=zfs ostfilesystemtype=zfs mdscount=3
Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: I1c15375d5e50d5a47a72b6c3c8e27512f51c3f9c
Reviewed-on: http://review.whamcloud.com/7995
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
6 years agoLU-3489 osd-zfs: varsize index support 52/7152/13
Alex Zhuravlev [Sun, 28 Jul 2013 07:33:20 +0000 (11:33 +0400)]
LU-3489 osd-zfs: varsize index support

LFSCK needs indices with keys/values of different size.
add a support for this to osd-zfs. key/value size can't
vary within a single index object so far.

Signed-off-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Change-Id: I6faa730ce1f778563c1fcf43d3b50c5b62c899d9
Reviewed-on: http://review.whamcloud.com/7152
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-36 mdd: cache lu_attr to avoid duplicate fetch 97/6897/8
Lai Siyao [Thu, 4 Jul 2013 09:36:08 +0000 (17:36 +0800)]
LU-36 mdd: cache lu_attr to avoid duplicate fetch

- we called mdd_la_get for so many times in MDD, it's not good for
  performance of high contention pdir operations.
- mdd_attr_check is not strictly correct under pdir operations,
  there is still chance to decrease ctime because we don't have
  exclusive lock on parent while checking ctime
- mdd_attr_check_set_internal and mdd_attr_check_set_internal_locked
  can be merged into one function: mdd_update_time, because set
  cmtime is the only use-case of them.

Change-Id: I59500835473ae6d42aa9bd2dcf9be644b7b7ec16
Signed-off-by: Liang Zhen <liang.zhen@intel.com>
Signed-off-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-on: http://review.whamcloud.com/6897
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3726 tests: make sanity-hsm compatible with MDSCOUNT >= 2. 37/7437/10
Thomas Leibovici [Wed, 7 Aug 2013 10:07:47 +0000 (12:07 +0200)]
LU-3726 tests: make sanity-hsm compatible with MDSCOUNT >= 2.

Add generic functions to perform set_param and check_param
on all MDTs, and persistent set_param on the mgs.
CL_USER variable replaced by CL_USERS array (1 value per MDT).
MDT0 variable replaced by MDT array (1 value per MDT).

Test-Parameters: mdtcount=2 mdscount=2 testlist=sanity-hsm
Signed-off-by: Thomas Leibovici <thomas.leibovici@cea.fr>
Signed-off-by: Aurelien Degremont <aurelien.degremont@cea.fr>
Change-Id: I0d8610a74427423dda25a6defd85f5c52c535850
Reviewed-on: http://review.whamcloud.com/7437
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: jacques-Charles Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Reviewed-by: Faccini Bruno <bruno.faccini@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4083 mdt: Take lov_mutex in mdt_reint_unlink and _rename 19/7919/4
James Nunez [Thu, 10 Oct 2013 20:32:39 +0000 (14:32 -0600)]
LU-4083 mdt: Take lov_mutex in mdt_reint_unlink and _rename

Take the mot_lov_mutex lock around mdo_unlink and mdo_rename
to synchronize around striping.

Test-Parameters: testlist=racer
Signed-off-by: James Nunez <james.a.nunez@intel.com>
Change-Id: Iaa00b81fd7cfb25ce5f3dcea3c2d6289d133134f
Reviewed-on: http://review.whamcloud.com/7919
Tested-by: Jenkins
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4069 build: cleanup from GOTO(label, -ERRNO) 80/8080/5
Dmitry Eremin [Mon, 28 Oct 2013 18:38:58 +0000 (22:38 +0400)]
LU-4069 build: cleanup from GOTO(label, -ERRNO)

Cleanup the code from GOTO(label, -ERRNO) and other bad GOTOs.

Signed-off-by: Dmitry Eremin <dmitry.eremin@intel.com>
Change-Id: I58df89810c112a6856da83c56c9f29dc22ffdf99
Reviewed-on: http://review.whamcloud.com/8080
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Jenkins
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-2800 autoconf: block device release changed in newer kernels. 80/5380/9
James Simmons [Fri, 15 Nov 2013 17:40:42 +0000 (12:40 -0500)]
LU-2800 autoconf: block device release changed in newer kernels.

For kernels at 3.10 and above the release method for block
devices no longer return a integer. This impacts the lloop
block device we use on the lustre client side.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: Ib63e2897a48989f1cf5185a1c88a5ddbf989c0a9
Reviewed-on: http://review.whamcloud.com/5380
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3867 utils: llapi_create_volatile_idx uses 0 instead idx 13/7613/4
James Nunez [Fri, 1 Nov 2013 18:18:05 +0000 (12:18 -0600)]
LU-3867 utils: llapi_create_volatile_idx uses 0 instead idx

If llapi_create_volatile_idx() is passed an MDT index other than
-1, it always uses 0 as the MDT index rather than the one provided.

This patch removes the use of LUSTRE_VOLATILE_IDX and uses
LUSTRE_VOLATILE_HDR with the MDT index instead, uses the provided
MDT index in the volatile file name and uses base 16 when reading
the MDT index from the file name using strtoul.

Signed-off-by: James Nunez <james.a.nunez@intel.com>
Signed-off-by: Bobbie Lind <bobbie.j.lind@intel.com>
Change-Id: I27e2beb8524683aba07c48297614dd02d7957af4
Reviewed-on: http://review.whamcloud.com/7613
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-2800 autoconf: clean up sysctl table handling 02/8102/2
James Simmons [Wed, 30 Oct 2013 12:26:33 +0000 (08:26 -0400)]
LU-2800 autoconf: clean up sysctl table handling

Before linux kernel version 2.6.24 came out lustre
like other subsystems registering with sysctl had
to assign unquie numbers for ctl_name in struct
ctl_table. After 2.6.24 this requirement changed
and lustre started to use CTL_UNNUMBERED as the
default value. Since we no longer support 2.6.24
and earlier kernels we can remove this test and
simply the code. We also simplifed the handling
of the strategy field in struct ctl_table. The
final fix is that several LND drivers never handled
that case of 2.6.33 and above kernels which removed
the ctl_name and strategy fields altogether. This
patch addresses this so LND drivers can be handled
better on distros using newer kernels.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I0f5b64552e7d54abf4b73bfe285109573725edaf
Reviewed-on: http://review.whamcloud.com/8102
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4015 ldiskfs: access external journal using device path 77/7777/3
James Simmons [Tue, 5 Nov 2013 18:47:26 +0000 (13:47 -0500)]
LU-4015 ldiskfs: access external journal using device path

Currently ldiskfs when configured with an external journal
uses the device number to access it. The problem with this
approach is that the device number can change across
reboots. This patch adds a new mount option -o journal_path
to tell ldiskfs where the external journal is instead.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I43fff89c2bebeff4f0305cdc24cefa534fb9fe67
Reviewed-on: http://review.whamcloud.com/7777
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
6 years agoLU-4049 build: fix 'NULL pointer dereference' errors 27/7827/6
Sebastien Buisson [Wed, 2 Oct 2013 15:09:35 +0000 (17:09 +0200)]
LU-4049 build: fix 'NULL pointer dereference' errors

Fix 'NULL pointer dereference' defects found by Coverity version
6.6.1:
Dereference after null check (FORWARD_NULL)
For instance, Passing null pointer to a function which dereferences
it.
Dereference before null check (REVERSE_INULL)
Null-checking variable suggests that it may be null, but it has
already been dereferenced on all paths leading to the check.
Dereference null return value (NULL_RETURNS)

Signed-off-by: Sebastien Buisson <sebastien.buisson@bull.net>
Change-Id: I1db4e80fd2c048cc20459e8da4cb61a97b3171cb
Reviewed-on: http://review.whamcloud.com/7827
Reviewed-by: John L. Hammond <john.hammond@intel.com>
Tested-by: Jenkins
Reviewed-by: jacques-Charles Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-2880 ldiskfs: rename patches for consistency 11/6411/12
James Simmons [Wed, 13 Nov 2013 15:41:59 +0000 (10:41 -0500)]
LU-2880 ldiskfs: rename patches for consistency

Rename the ext4_data_in_dirent.patch, ext4_pdirop.patch, and
ext4_extra_isize.patch files to be ext4-data-in-dirent.patch,
ext4-extra-isize.patch and ext4-pdirop.patch respectively.
This is more consistent with all of the other patches in the
series, and avoids missing these files with tab completion.

Signed-off-by: Andreas Dilger <andreas.dilger@intel.com>
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I92125f09284e23ab08d5e9f8658e68416bde025f
Reviewed-on: http://review.whamcloud.com/6411
Tested-by: Jenkins
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3319 procfs: provide framework for seq_file handling 35/7135/25
James Simmons [Fri, 15 Nov 2013 13:16:01 +0000 (08:16 -0500)]
LU-3319 procfs: provide framework for seq_file handling

In linux 3.10 kernels and above the proc file system interface
changed. To handle this change we need to move from the current
method of using proc_read and proc_write function pointers to
using the seq_file. This patch provides the base to enable moving
all the lustre proc handling gradually over to this new method
of proc data handling.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I06d941398bf248bffab851f9f25bea6bbe438a30
Reviewed-on: http://review.whamcloud.com/7135
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Yang Sheng <yang.sheng@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4316 mdt: Do not grant Layout lock for remote file 06/8406/4
wang di [Tue, 26 Nov 2013 14:24:54 +0000 (06:24 -0800)]
LU-4316 mdt: Do not grant Layout lock for remote file

Do not grant layout lock for remote file, because only
the MDT, where the file/dir resides, should grant the
LAYOUT lock.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I174d54f3ce5b7c69cb35aa63f4322b743ea677e8
Reviewed-on: http://review.whamcloud.com/8406
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Faccini Bruno <bruno.faccini@intel.com>
6 years agoLU-4245 ldlm: do not fill empty lvbo buffer 85/8285/2
Bobi Jam [Fri, 15 Nov 2013 10:21:40 +0000 (18:21 +0800)]
LU-4245 ldlm: do not fill empty lvbo buffer

Don't fill empty lvbo buffer if server does not prepare it.

Signed-off-by: Bobi Jam <bobijam.xu@intel.com>
Change-Id: I22a2ddd016dcc43c00b2b3d6be5d18921bf26d67
Reviewed-on: http://review.whamcloud.com/8285
Tested-by: Jenkins
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4208 osd-zfs: hold pool config lock to register property 72/8172/3
Ned Bass [Mon, 4 Nov 2013 23:07:11 +0000 (15:07 -0800)]
LU-4208 osd-zfs: hold pool config lock to register property

- Hold the DSL pool configuration lock when calling
  dsl_prop_register().  Failure to do so will panic the node if
  assertions are enabled in ZFS.  This change requires a build of ZFS
  on Linux that exports symbols dsl_pool_config_enter and
  dsl_pool_config_exit, which was done in commit 40a806d [1], and will
  appear in ZFS release 0.6.3.

- Fix up variable declaration alignment in osd_mount().

- Add check for exported symbols in autoconf

[1] https://github.com/zfsonlinux/zfs/commit/40a806d

Signed-off-by: Ned Bass <bass6@llnl.gov>
Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: Ib2df05301ca73847d49ca2b183d72b9e2d957c10
Reviewed-on: http://review.whamcloud.com/8172
Tested-by: Jenkins
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Li Wei <wei.g.li@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4194 ldlm: Make OBD_[ALLOC|FREE]_LARGE use consistent 98/8298/2
Christopher J. Morrone [Fri, 15 Nov 2013 21:40:19 +0000 (13:40 -0800)]
LU-4194 ldlm: Make OBD_[ALLOC|FREE]_LARGE use consistent

struct ldlm_lock's l_lvb_data field is freed in ldlm_lock_put()
using OBD_FREE.  However, some other code paths can attach
a buffer to l_lvb_data that was allocated using OBD_ALLOC_LARGE.
This can lead to a kfree() of a vmalloc()ed buffer, which can
trigger a kernel Oops.

Change-Id: Ic75a67530862eeb4d065c14bbbac80939bff5731
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/8298
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Faccini Bruno <bruno.faccini@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-4194 ldlm: set l_lvb_type coherent when layout is returned 70/8270/2
Bruno Faccini [Thu, 14 Nov 2013 16:20:00 +0000 (17:20 +0100)]
LU-4194 ldlm: set l_lvb_type coherent when layout is returned

In case layout has been packed into server reply when not
requested, lock l_lvb_type must be set accordingly.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: Iaf54c9ba27785e529f4f2fb967d2fad4fc1dfbcb
Reviewed-on: http://review.whamcloud.com/8270
Tested-by: Jenkins
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
6 years agoLU-793 ptlrpc: allow client to reconnect with RPC in progress 60/4960/15
Mikhail Pershin [Mon, 11 Nov 2013 17:42:43 +0000 (21:42 +0400)]
LU-793 ptlrpc: allow client to reconnect with RPC in progress

Since not letting clients with pending RPCs to reconnect caused a lot
of problems, this patch allows such a reconnection and would only
refuse to process requests with the same xids that are already being
processed.

Bulk requests are aborted upon reconnection by comparing connection
count of request and export.

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: Ic4b23a71fd288df02d1040d98867373ae06b60f6
Reviewed-on: http://review.whamcloud.com/4960
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Reviewed-by: Alexander Boyko <alexander_boyko@xyratex.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4322 tests: disable sanity 101a in DNE 28/8428/2
wang di [Wed, 27 Nov 2013 19:03:51 +0000 (11:03 -0800)]
LU-4322 tests: disable sanity 101a in DNE

Disable sanity 101a in DNE test for now.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I67531bf9f1fb75b8cd6684d864793a612e1d1cf4
Reviewed-on: http://review.whamcloud.com/8428
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
6 years agoLU-14 tests: add version check code to conf-sanity test 69 11/8411/2
Jian Yu [Wed, 27 Nov 2013 12:34:34 +0000 (20:34 +0800)]
LU-14 tests: add version check code to conf-sanity test 69

This patch adds Lustre version check codes into conf-sanity
test 69 to make the test work with servers which do not have
the following patch:

Lustre-commit: db6613f5bed1606cc8f97b46d1b298746af03a75
Lustre-change: http://review.whamcloud.com/7443

Test-Parameters: envdefinitions=SLOW=yes,ENABLE_QUOTA=yes,ONLY=69 \
ossjob=lustre-b2_4 mdsjob=lustre-b2_4 ossbuildno=45 mdsbuildno=45 \
testlist=conf-sanity

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I4e736fd5d760872f88364f30a39430f961419c64
Reviewed-on: http://review.whamcloud.com/8411
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
6 years agoLU-4310 kernel: missed unlock in quota patch 00/8400/2
Niu Yawei [Tue, 26 Nov 2013 10:04:43 +0000 (05:04 -0500)]
LU-4310 kernel: missed unlock in quota patch

The quota-replace-dqptr-sem.patch introduced a regression which
could miss unlock inode->i_lock in __dquot_alloc_space().

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: If0f240fe76d661909c13b11e3d384e77da1662b1
Reviewed-on: http://review.whamcloud.com/8400
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Jenkins
Reviewed-by: Andrew Perepechko <andrew_perepechko@xyratex.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-3738 tests: improve posix.sh to support BASELINE_FS=zfs 80/8180/7
Jian Yu [Mon, 25 Nov 2013 03:55:58 +0000 (11:55 +0800)]
LU-3738 tests: improve posix.sh to support BASELINE_FS=zfs

This patch improves posix.sh to support BASELINE_FS=zfs. It also
adds create_zpool(), create_zfs() and destroy_zpool() common
functions into test-framework.sh.

Test-Parameters: envdefinitions=SLOW=yes \
mdtfilesystemtype=zfs mdsfilesystemtype=zfs ostfilesystemtype=zfs \
ostcount=2 testlist=posix

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I7e59181ef5f3926c6a8799ac4f6c775d04350a99
Reviewed-on: http://review.whamcloud.com/8180
Tested-by: Jenkins
Reviewed-by: Minh Diep <minh.diep@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3467 ptlrpc: initialize request session early 50/7350/27
Mikhail Pershin [Fri, 16 Aug 2013 05:10:33 +0000 (09:10 +0400)]
LU-3467 ptlrpc: initialize request session early

Initialize request session early to make it available in
high-priority handlers

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: Ic4f5967d3ba8e723bf90accf20742cb4c6bc801c
Reviewed-on: http://review.whamcloud.com/7350
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Tested-by: Jenkins
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-3467 target: unified transaction callbacks 30/7330/30
Mikhail Pershin [Wed, 14 Aug 2013 09:14:51 +0000 (13:14 +0400)]
LU-3467 target: unified transaction callbacks

Use common transaction callbacks to update last_rcvd
in target

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: Ib10d0b958fd9f09753246c85f272e1f917069d01
Reviewed-on: http://review.whamcloud.com/7330
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Jenkins
Reviewed-by: Fan Yong <fan.yong@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-3286 llog: local storage doesn't need vfsmount 86/8286/2
Lai Siyao [Fri, 15 Nov 2013 09:22:57 +0000 (17:22 +0800)]
LU-3286 llog: local storage doesn't need vfsmount

After introduction of local storage device vfsmount is redundant,
and servers don't need this struct to access local storage based
llog.
* remove lsi_srv_mnt from lustre_sb_info.
* remove lmi_mnt from lustre_mount_info.
* remove ddp_mnt from dt_device_param.

Signed-off-by: Lai Siyao <lai.siyao@intel.com>
Change-Id: I8cfdda8c871301ec9a332a01fd0a2523fe1a09c2
Reviewed-on: http://review.whamcloud.com/8286
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-1199 rpm: don't open-code %_smp_mflags 92/5492/6
James Simmons [Wed, 20 Nov 2013 12:51:21 +0000 (07:51 -0500)]
LU-1199 rpm: don't open-code %_smp_mflags

In some distant past, %_smp_mflags didn't exist on all
supported platforms.

We can use it now. The only difference is the lack of an
8-CPU limit, which can be overridden by explicitly defining
RPM_BUILD_NCPUS anyway.

Signed-off-by: Jeff Mahoney <jeffm@suse.com>
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I0b5c2f879da9ba6e8aa3103bfe59e6b43f8d72bc
Reviewed-on: http://review.whamcloud.com/5492
Tested-by: Jenkins
Reviewed-by: Christopher J. Morrone <chris.morrone.llnl@gmail.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4270 test: fix sanity test_209 26/8326/2
Niu Yawei [Tue, 19 Nov 2013 06:56:10 +0000 (01:56 -0500)]
LU-4270 test: fix sanity test_209

Fix the  connect_flags checking in test_209 of sanity.sh

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: I6c34b9dbe6d3b7475d85588e7adb3acb762fab32
Reviewed-on: http://review.whamcloud.com/8326
Tested-by: Jenkins
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4093 tests: fix typo and inverted test in original patch 29/8329/2
Bruno Faccini [Tue, 19 Nov 2013 11:00:51 +0000 (12:00 +0100)]
LU-4093 tests: fix typo and inverted test in original patch

1st/original patch for LU-4093 ticket, patch-set #3 of Change at
http://review.whamcloud.com/8157/ with Id
I3274e5864469251e6f2040377b84429e4f218f47, contains a typo and
an inverted test that prevent it to work as expected but rather
with reversed logic.

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I3f8031b85db116711312b8f7decf2c33761b89e6
Reviewed-on: http://review.whamcloud.com/8329
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-2800 compat: remove crypto shims 47/5347/9
James Simmons [Tue, 17 Sep 2013 17:50:59 +0000 (13:50 -0400)]
LU-2800 compat: remove crypto shims

Now that we've removed the tests for the crypto APIs, we can
remove all of the ll_* prefixed compatibility shims from the
rest of the code.

Change-Id: I9a10b57d48614f892dd61f31ee4bee8fbea93ea8
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Signed-off-by: Jeff Mahoney <jeffm@suse.com>
Signed-off-by: Thomas Stibor <thomas@stibor.net>
Reviewed-on: http://review.whamcloud.com/5347
Tested-by: Jenkins
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-4276 ldiskfs: enable read/write access by default 35/8335/2
Bob Glossman [Tue, 19 Nov 2013 22:51:09 +0000 (14:51 -0800)]
LU-4276 ldiskfs: enable read/write access by default

Add build time config option to allow read/write access by default.
While the new CONFIG_LDISKFS_FS_RW only matters in SLES11 builds,
it's easiest to just add the flag to all builds unconditionally.
It will be ignored in builds where it doesn't matter.

Signed-off-by: Bob Glossman <bob.glossman@intel.com>
Change-Id: Icaab7a4fd003dd29a49af9222852bded7ec344ff
Reviewed-on: http://review.whamcloud.com/8335
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
6 years agoLU-4305 tests: mkdir instead of test_mkdir in 39P 83/8383/2
wang di [Sun, 24 Nov 2013 21:05:21 +0000 (13:05 -0800)]
LU-4305 tests: mkdir instead of test_mkdir in 39P

In sanity 39p, it should use mkdir, instead of
test_mkdir to avoid creating remote directory before
the real "lfs mkdir -i".

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: If5a09bf4bdadd1f27d66e9d7b252ae0f4ee071fb
Reviewed-on: http://review.whamcloud.com/8383
Tested-by: Jenkins
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
6 years agoLU-4204 tests: fix test_69 in conf-sanity 58/8158/7
Bob Glossman [Mon, 4 Nov 2013 15:46:20 +0000 (07:46 -0800)]
LU-4204 tests: fix test_69 in conf-sanity

Recent commit added new test 69 to conf-sanity,
but calls test_68 by mistake. This patch fixes that typo.
In addition the test in its original form could never have worked.
There were several functional problems in it.
This patch fixes these up too.

Test-Parmeters: testlist=conf-sanity envdefinitions=SLOW=yes,ONLY=69

Signed-off-by: Bob Glossman <bob.glossman@intel.com>
Change-Id: I44d1e5f620a3e4cc14b59842abdd2f56ed409872
Reviewed-on: http://review.whamcloud.com/8158
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
6 years agoLU-3689 tests: Support ZFS in large-lun.sh and run_llverdev 95/7395/7
Nathaniel Clark [Wed, 7 Aug 2013 22:18:05 +0000 (18:18 -0400)]
LU-3689 tests: Support ZFS in large-lun.sh and run_llverdev

This adds support to "check" zfs and run llrevfs against zfs backed
nodes.  This fixes some regressions added by LU-3264, specifically
that the stop function also exports the zfs pool.

The zfs "check" is really a non-entity since there is no functional
zfs fsck at this time.

Test-Parameters: mdsfilesystemtype=zfs mdtfilesystemtype=zfs ostfilesystemtype=zfs testlist=large-lun ostcount=2 envdefinitions=SLOW=yes
Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: Idc35d35152f1cbdc4afe6a0f627a5c1ba40b3faf
Reviewed-on: http://review.whamcloud.com/7395
Tested-by: Jenkins
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Wei Liu <wei3.liu@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-2059 tests: Skip insanity/10 on ZFS 16/8316/2
Nathaniel Clark [Mon, 18 Nov 2013 13:48:14 +0000 (08:48 -0500)]
LU-2059 tests: Skip insanity/10 on ZFS

This test fails in the same as all the other LU-2059 skipped tests,
trying to start OST with MDS down causes OST to hang.

Test-Parameters: osscount=2 mdscount=2 mdsfilesystemtype=zfs mdtfilesystemtype=zfs ostfilesystemtype=zfs testlist=insanity
Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: I29cec88c0f3f5eb4ffef0117363b0862f44dd61a
Reviewed-on: http://review.whamcloud.com/8316
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
6 years agoLU-4165 tests: skip sanity-lfsck test_2c for 2.4 or older 86/8386/2
Fan Yong [Sat, 26 Oct 2013 20:56:28 +0000 (04:56 +0800)]
LU-4165 tests: skip sanity-lfsck test_2c for 2.4 or older

It makes no sense to run sanity-lfsck test_2c against 2.4 or older.

Test-Parameters: mdsjob=lustre-b2_4 ossjob=lustre-b2_4 mdsbuildno=58 ossbuildno=58 testlist=sanity-lfsck
Signed-off-by: Fan Yong <fan.yong@intel.com>
Change-Id: I96792b4325a69f880e326dc8963cf3e6bd09bf87
Reviewed-on: http://review.whamcloud.com/8386
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
6 years agoLU-4058 tests: skip sanity-scrub test_15 for 2.4.1 or older 68/7868/8
Fan Yong [Wed, 23 Oct 2013 06:19:03 +0000 (14:19 +0800)]
LU-4058 tests: skip sanity-scrub test_15 for 2.4.1 or older

Lustre-2.4.1 or older does not support dry-run mode OI scrub yet.

Test-Parameters: mdsjob=lustre-b2_4 ossjob=lustre-b2_4 \
mdsbuildno=54 ossbuildno=54 testlist=sanity-scrub
Signed-off-by: Fan Yong <fan.yong@intel.com>
Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I1a97f850ab39d7d42ef7ed6e191ce66b3b093415
Reviewed-on: http://review.whamcloud.com/7868
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-3879 test: Check for e2fsprogs on server 46/8346/2
James Nunez [Wed, 20 Nov 2013 17:49:17 +0000 (10:49 -0700)]
LU-3879 test: Check for e2fsprogs on server

sanity-quota checks if e2fsprogs is loaded on the client,
but should be checking for e2fsprogs on the server. This
patch changes checking for dumpe2fs from the client to the MDS.

Signed-off-by: James Nunez <james.a.nunez@intel.com>
Change-Id: I83b0b5b99deec376f4ee2d59e30810373e330174
Reviewed-on: http://review.whamcloud.com/8346
Tested-by: Jenkins
Reviewed-by: Niu Yawei <yawei.niu@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
6 years agoLU-3906 tests: fix space estimation codes in run_compilebench() 58/8258/4
Jian Yu [Wed, 13 Nov 2013 12:43:24 +0000 (20:43 +0800)]
LU-3906 tests: fix space estimation codes in run_compilebench()

While running compilebench test, the actual space required for each
kernel directory is about 1GB instead of 680MB. This patch fixes this
number in run_compilebench() so as to make the space estimation
more correct.

Test-Parameters: envdefinitions=SLOW=yes,ONLY=compilebench \
testlist=parallel-scale,parallel-scale-nfsv3,parallel-scale-nfsv4

Test-Parameters: envdefinitions=SLOW=yes,ONLY=compilebench \
mdtfilesystemtype=zfs mdsfilesystemtype=zfs ostfilesystemtype=zfs \
ostcount=2 mdtcount=1 \
testlist=parallel-scale,parallel-scale-nfsv3,parallel-scale-nfsv4

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I8aa14673b8df99f6b50980ee091acda76da7cd9a
Reviewed-on: http://review.whamcloud.com/8258
Reviewed-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Reviewed-by: Wei Liu <wei3.liu@intel.com>
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-3321 obdclass: Add a preallocated percpu cl_env 74/8174/5
Jinshan Xiong [Tue, 5 Nov 2013 03:39:58 +0000 (19:39 -0800)]
LU-3321 obdclass: Add a preallocated percpu cl_env

This change adds support for a single preallocated cl_env per CPU
which can be used in circumstances where reschedule is not possible.
Currently this interface is only used by the ll_releasepage function.

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: I14a06294f0c2caae8806d7da134a8076f75ddc81
Reviewed-on: http://review.whamcloud.com/8174
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-2469 tests: use MDS/OSTDEV and MDS/OSTDEVBASE with zfs 16/5016/21
Nathaniel Clark [Tue, 18 Dec 2012 19:05:55 +0000 (14:05 -0500)]
LU-2469 tests: use MDS/OSTDEV and MDS/OSTDEVBASE with zfs

Add support for using MDSDEVn, OSTDEVn, MDSDEVBASE and OSTDEVBASE
variables when testing with zfs.
Add *ZFSDEVn variable for specifying ZFS format devices.
Remove use of *DEVn use outside of test-framework.sh

MDSDEV et al. specify physical device formatted.

Formerly Change-Id I89115ce935294cdbbd6620fec3f9dc3eb76f8960

Test-Parameters: mdsfilesystemtype=zfs ostfilesystemtype=zfs  mdtfilesystemtype=zfs testlist=sanity
Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: If6506995d9d61f9c97827f45071f0d317c7a09f9
Reviewed-on: http://review.whamcloud.com/5016
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Li Wei <wei.g.li@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-1538 tests: run sanity-lfsck instead of lfsck 52/7952/2
Andreas Dilger [Tue, 15 Oct 2013 18:25:53 +0000 (12:25 -0600)]
LU-1538 tests: run sanity-lfsck instead of lfsck

Run sanity-lfsck in the default acceptance-small test list instead of
the old lfsck test, which will be deprecated and removed in the 2.6
release.

Signed-off-by: Andreas Dilger <andreas.dilger@intel.com>
Change-Id: I5903d854dc16d3ed8bca1139355a73230e500c1e
Reviewed-on: http://review.whamcloud.com/7952
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Oleg Drokin <oleg.drokin@intel.com>
6 years agoLU-4123 tests: use nodename in check_write_access 09/8009/4
Stephen Champion [Tue, 29 Oct 2013 04:13:49 +0000 (12:13 +0800)]
LU-4123 tests: use nodename in check_write_access

Check for a file create using the remote nodename.

When the node name of a host does not exactly match the host name
passed via xxx_HOST parameters, check_write_access can check for
creation of a filename different from what the remote node created.

By querying and using the nodename from the remote host, the node
initiating the tests can check for the same file name that the remote
node creates.

Test-Parameters: testlist=lfsck

Signed-off-by: Stephen Champion <schamp@sgi.com>
Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I57f081597395578c1a37e16531477e6fa4867c8d
Reviewed-on: http://review.whamcloud.com/8009
Tested-by: Jenkins
Tested-by: Maloo <hpdd-maloo@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>