LU-435 Add VM_FAULT_RETRY handling

2.6.32 kernel add VM_FAULT_RETRY option in handle page fault, we
need handle it as well.

Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: I71d1c51bc297d1e0e8cc38e11b8a724edf9d1ae7
Reviewed-on: http://review.whamcloud.com/997
Tested-by: Hudson
Reviewed-by: Jinshan Xiong <jay@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-442 assert failed in osc_set_lock_data_with_check()

In osc_enqueue_base(), the checking to l_ast_data of dlm lock isn't
protected by proper lock, which might cause assertion failure in
following osc_set_lock_data_with_check() when there are cocurrent
callers.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: Idb2312003e93f4ab0687ed5b7e932de77b23efb7
Reviewed-on: http://review.whamcloud.com/993
Tested-by: Hudson
Reviewed-by: Jinshan Xiong <jay@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-419 mkfs: fix default ext4 filesystem tuneables

Enable the "64bit" feature flag for filesystems over 16TB (2^32
blocks, really).  Otherwise, the user needs to specify "-t ext4"
explicitly for such filesystems, or otherwise specify all of the
mke2fs features explicitly to format huge filesystems.

Porting the LU-255 patch to b1_8, I also wanted to make sure that
the new default inode ratio for OSTs was not too aggressive.  While
Lustre filesystems generally have average file sizes over 1MB, in
some limited number of cases the user filesystem statistics sent to
lustre-discuss had filesystems with an ratio of 600kB/inode region.

While the average FILE size may be > 1MB/file, if the default LOV
striping is 2 or 4 stripes/file then there may be a large number of
zero-length inodes on the OST that will be allocated and need space.

Reduce the default inode ratio to previously changed in commit
eb012d4a10208b26c2d3e795a90f1bb07dde6d91 from 1MB/inode down to
512kB/inode for filesystems between 4TB and 16TB, and only go up to
1MB/inode for filesystems over 16TB.  Since there are no existing
filesystems that large, there is no firm expectation for how many
inodes should be created for such filesystems, so this is safer.

Change-Id: I92139755468c5f58830849ebd44171951f8460e4
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/996
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

Revert "LU-15 shrink the cache to alleviate OST memory pressure"

This introduced a significant performance problem on DDN hardware,
so reverting.

This reverts commit 491a448008d8f8a4dc61789c14bd96de205f856e.

Change-Id: Id19d9735ddc5daa852e4a388974f9a8f11208d05
Signed-off-by: Oleg Drokin <green@whamcloud.com>

LU-371 call OBD_ALLOC_LARGE to allocate epp_pools

enc_pools_alloc is using OBD_ALLOC to allocate memory, which can fail on
some systems and return ENOMEM, so we should replace it with
OBD_ALLOC_LARGE.

Change-Id: I90cfe8c03e6db013818553f34463ecd0edf566ab
Signed-off-by: Liang Zhen <liang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/869
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-432 multiop test needs $(PTHREAD_LIBS)

Added $(PTHREAD_LIBS) to multiop_LDADD for multiop test.

Signed-off-by: Christos Triantafyllidis <ctria@grid.auth.gr>
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Change-Id: Ibc41b2fdcc79ddadeaae8e4bde5c4cd4d1bb7b7d
Reviewed-on: http://review.whamcloud.com/994
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-409: only load llite_lloop module if kernel < 2.6.32 or LOAD_LLOOP

A bug was introduced with change: I63ebc7a8e0a8de6d34ffce5fd625df6db7216d32
This fixes it.

Change-Id: I001d348dd3233977a4e972ccf01ac51bc3bcbae9
Signed-off-by: Richard Henwood <rhenwood@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1002
Reviewed-by: wangdi <di.wang@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-434 Add comment for $SHARED_DIRECTORY variable

To try and avoid confusion, a comment was added to better explain how the
$SHARED_DIRECTORY variable is intended to be used. The explanation was taken
from the Lustre mailing list. Specifically, from this message by Andreas:
http://lists.lustre.org/pipermail/lustre-discuss/2011-June/015682.html

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: I594283a5963a0ac83bbe88ce8258e361408ec57a
Reviewed-on: http://review.whamcloud.com/940
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Hudson

LU-421 include lustre/BUIDING in dist tarball

lustre/BUILDING is not currently included in the dist tarball.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: Ief40fab4bb80d9fe9967e433f2602f73880871ab
Reviewed-on: http://review.whamcloud.com/982
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-409: only load llite_lloop module if kernel < 2.6.32 or LOAD_LLOOP

The change of block device interface in kernel 2.6.32-131 caused
the llite_lloop module to fail. llite_lloop module is currently
unsupported. This change introduces a test for kernel version
to prohibit loading a module with a kernel >= 2.6.32. A LOAD_LLOOP
flag (default false) is provided to ignore the kernel test and force
loading of llite_lloop if desired.

A related version of this change for b1_8 is:
http://review.whamcloud.com/954

Change-Id: I63ebc7a8e0a8de6d34ffce5fd625df6db7216d32
Signed-off-by: Richard Henwood <rhenwood@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/956
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

New tag 2.0.63

Change-Id: I0c70ee5096c9ccbb5e3518004a086c805f9fcf09
Signed-off-by: Oleg Drokin <green@whamcloud.com>

LU-388 modify kernel-ib spec file for openib RPM

The kernel-ib RPM from OFED 1.5.3.1 conflicts with RHEL5's
openib package.  Consider RHEL5's userspace as canonical and
Remove the conflicting portions from the kernel-ib RPM.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I9f6a768bc5ac30fdab589c1bdbc3154fa31c1405
Reviewed-on: http://review.whamcloud.com/981
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-387 mmp.sh test_9 failed

The mmp.sh test_9 often fail for the script killing the e2fsck process
on wrong timing, so we use some tricky way to make sure the MMP block
stay in 'e2fsck' state before mounting the device.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: Id8b13b67d6f0f1f0198b13bca55356ab95af1059
Reviewed-on: http://review.whamcloud.com/979
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-405 Don't assert on multiple disconnected dentries case

NFS has a valid case for multiple disconnected dentries on the same
inode so we must not assert there as a workaround.
The proper fix is to adopt using of d_splice_alias eventually.

Change-Id: I28f7385d95523adf949a4e3b8887d79cdc4f2e37
Signed-off-by: Oleg Drokin <green@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/923
Tested-by: Hudson
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>

LU-395: obd_zombie_barrier is not barrier actually

a hotfix for avoiding deadlock:
sys_umount -> class_detach -> obd_zombie_impexp_cull -> filter_cleanup
-> obd_zombie_barrier, but the zombies_count will only be decreased after
obd_zombie_impexp_cull, so this process is waiting for itself, this is a
deadlock.

Signed-off-by: Jinshan Xiong <jay@whamcloud.com>
Change-Id: Id29deab4c85a7570ec59b2a20f70ccfae9440f01
Reviewed-on: http://review.whamcloud.com/945
Reviewed-by: Mikhail Pershin <tappro@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-304 Remove Cray-specific LICENSE files.

This reverts commit cbb0d69e53c0f928c5f43eeb125ba87283fe561b.

Change-Id: I8aa6a03dc78eeaffad64d5509c3ddab1cb4e56ee
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/529
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Cory Spitz <spitzcor@cray.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-404 bind umount /sbin/mount.lustre only if necessary

On lustre release installed system, /sbin/mount.lustre will not
bind mount upon $LUSTRE/utils/mount.lustre, so don't need bind
umount it.

Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: I49e671f0acf991a54a01c4f2bb1e82c2db93aa3e
Reviewed-on: http://review.whamcloud.com/918
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>

LU-381 add in RHEL6 value for CONFIG_SECURITY_DMESG_RESTRICT

This silences interactive prompt during make oldconfig.

Change-Id: I9e555ece1d6acb7b793cf9eec5deb6d7fc2ab2af
Signed-off-by: Richard Henwood <rhenwood@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/876
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-163 update ChangeLog for LU-163 patches

For lustre re-export through NFSv4, should specify the mount option of
"-o 32bitapi" on lustre client.

Change-Id: Ie5bcd8373c22fd0e9eaec27e7e60c2f6f4080018
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/920
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-403 Add support for RHEL5 kernel 2.6.18-238.12.1.el5

Change-Id: I0fcf8f9158659bbb8a9c53d7b0f22bcabc84ed66
Signed-off-by: Oleg Drokin <green@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/931
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>

LU-397 Set 'lsr_flags' as 'LU_SEQ_RANGE_MDT' for old 2.0 client

Lustre 2.x introduces server identifier into lu_seq_range to distinguish
MDT and OST fids. But for old 2.0 client, it does not specify such
identifier/flags. So use 'OBD_CONNECT_SEQ_RANGE' to distinguish whether
it is old 2.0 client or not. For old 2.0 client, set the 'lsr_flags' as
'LU_SEQ_RANGE_MDT' by default.

Change-Id: I652caa637959268e1da499370a0efd356ff98bbe
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/902
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-395 Fix obd_zombie_barrier()

The obd_zombie_barrier() is waiting for obd_zombie_export list is empty
and exit, but export may be not yet destroyed. This produces race between export
destroying and other cleanups like lut_fini()

The patch introduces zombies_in_destroy variable which is counter, and
obd_zombie_barrier is checking it.

Change-Id: I0fd4a1023efade1cb40d4c36e59169a25a525ed1
Signed-off-by: Mikhail Pershin <tappro@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/899
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-313 re-enable lfsck test to run by default

Due to bug 13698, the lfsck part of the lfsck.sh test script was
disabled by default.   After the fixes in LU-113 were landed, lfsck
should work again.  Remove LFSCK_SKIP checks so lfsck.sh actually runs
lfsck instead of silently skipping it unless LFSCK_SKIP=no is set.

Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Change-Id: Idf7f0606c3937b0311db998032d58475076ab1a8
Reviewed-on: http://review.whamcloud.com/552
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-399 do not use mke2fs -E resize for large LUNs

The mo_device_size variable is in units of kB, so take this into
account correctly when computing the filesystem block count.
The "-E resize" option is being used to align metadata on 1MB IO
boundaries, but it does not work for devices larger than 2^32 blocks.

A better long-term solution is to fix mke2fs so that it does this
alignment itself based on the s_raid_stride value.

Change-Id: I2e4104b8ad490076bfaa6a49842124d79e3bf880
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/912
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Tested-by: Yu Jian <yujian@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-64 define LOV default layout as FID_SEQ value

For directories without any default striping information the MDS
sends a magic LOV_OBJECT_GROUP_DEFAULT value for the lmm_seq field.
Since this is really a magic FID_SEQ value, define it in the same
place as other FID_SEQ values as FID_SEQ_LOV_DEFAULT so that it is
visible.

Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Change-Id: I0ae9dc993d15aedb38ab79e40c67a687d956a6c4
Reviewed-on: http://review.whamcloud.com/910
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-329 fix missing ost_lock_put() calls

* The taken ost lock may be no put in some error cases.
* typo in ost_blocking_ost: oa --> oinfo.

Change-Id: I021494fcf901d2daeeb97f60e23562bcc88d990a
Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/554
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: wangdi <di.wang@whamcloud.com>

LU-275 I/O errors when lustre uses multipath devices

Change set_blockdev_tunables() routines to make it support multipath
device case.

Author: Gregoire Pichon <gregoire.pichon@bull.net>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: If7a7d4a1788bb5c5139d5a5b229272dc2f294713
Reviewed-on: http://review.whamcloud.com/504
Tested-by: Hudson
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-342 add test for lfs to check missing OST

add test_90 in replay-single.sh to check whether "lfs find --obd"
and "lfs getstripe -r --obd" can deal with the case of some OST missed

Change-Id: I17ff9197051a035b726fd6e817adc145ea116292
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/562
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-402 Update to rhel6.1 kernel 2.6.32-131.2.1.el6

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: I84a8536a46d1d7f28ac3eaef30ee8c3c7f0d0342
Reviewed-on: http://review.whamcloud.com/914
Tested-by: Hudson

LU-163 Input valid 'mnt' parameter for 'dentry_open()'

It is required by new kernel (rhel6) for 'get_name()'
when re-export lustre through NFS.

Change-Id: I732ba2a91b6e1420e8e46910fddca67d04cedcde
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/892
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>

LU-307 Send parent FID from client to MDS on NFS open for striping info

Which is useful for delay created cases. and it is mainly for Lustre re-export
through NFS. If client does not give such hint, MDS will try to find parent by
the first fid in the link EA. Another fixes are about the protection of delay
creating OSTs objects concurrently.

Change-Id: I5dd72e0452303ca5ab7bff035ff85f83b5862d66
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/557
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: wangdi <di.wang@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-376 Positive LL_DIR_END_OFF to indicate the tail of dir hash/offset

1) Keep 'MDS_DIR_END_OFF' unchanged (0xfffffffffffffffeULL) to simplify
   dir hash/offset related interoperability issues.
2) Introduce positive "LL_DIR_END_OFF" (0x7fffffffffffffffULL) on client
   to indicate the tail of dir hash/offset for up layer callers, like
   llseek(), readdir(), and so on.
3) Support new 2.x client to talk with old 2.0 server with 32bit hash.

Change-Id: I74c148482f91ed91dfffd608f98971566f1257ad
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/886
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

New version 2.0.62

Change-Id: Ib5cd2b133bae72d8c2d8a52c35b3a734cae3ff69
Signed-off-by: Oleg Drokin <green@whamcloud.com>

LU-64 Modify the behavior of ioctl on directories without EA set.

This patch introduces the following functionality:

1. If an ioctl is performed to obtain the stripe attributes for a
   directory, then the following 3 possibilities can occur:
   a. If the directory in question DOES have it's EA set, then these
      EA values are returned to userspace.
   b. If the directory in question DOES NOT have it's EA set, AND it
      IS the root directory of the filesystem, then the filesystem's
      default EA values are returned to userspace.
   c. If the directory in question DOES NOT have it's EA set, AND it
      IS NOT the root directory of the filesystem, then no EA values
      are returned to userspace. Rather, an error is returned from
      the ioctl and errno is set to ENODATA.
2. lfs getstripe was updated to reflect this change in the ioctl
   interface.
   a. If lfs getstipe --raw is called on a directory other than the
      root directory of the filesystem, and this directory does not
      have any EA set, the filesystem's default values will not be
      printed. Rather, the raw values which mean "use the default"
      will be printed (e.g. stripe count: 0, stripe size: 0, stripe
      offset: -1).

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: Ieaaeaf54cce88f406008af4a926fac561900afc9
Reviewed-on: http://review.whamcloud.com/576
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-64 Make "lfs getstripe" directory output consistent.

"lfs getstripe" should report the global default for any fields with
a value that means "use the default". This patch introduces the
following functionality:

1. If "lfs getstripe" is called on a directory and finds that striping
   EA is not set, the filesystem's defaults are looked up and printed.
2. If the striping EA is set, but the striping count and/or striping
   size has a value that means "use the default" (count = 0 and/or
   size = 0), the filesystem's default for that specific striping
   attribute is looked up and printed.
3. A new option to "lfs getstripe" is introduced; the "--raw" or
   "-R" option. If this option is specified, the previous two checks
   are skipped. In other words, if the striping EA is not set, 0, 0,
   -1, will be printed for the striping count, size, and offset
   respectively. Also, if the striping EA is set, the values will be
   printed without first converting them into their respective
   defaults.

This patch relies on the /proc filesystem to determine each
filesystem's default striping attributes, and a cache is maintained
which holds the default values for the last filesystem queried.

See Also:
Bugzilla #23802, https://bugzilla.lustre.org/show_bug.cgi?id=23802

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: I9bf033f91411d2a6a55c3d4becb971ba20bb3c4b
Reviewed-on: http://review.whamcloud.com/577
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-337 Fix alloc flags in alloc_qinfo()

CFS_ALLOC_STD allows a hang when the alloc_qinfo() results
in a cache_alloc_refill, and kicks off the ldlm shrinker.
The shrinker may hang in sync_page() on the same page on
which we already hold the lock.

Change-Id: I9d7ccfcd5258c537af4d4f1d0bf2a190f4fc89c7
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/880
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-165: Support privileged ports in the o2iblnd driver.

It is highly recommended that you have a version of the
IB verbs driver that provides the rdma_set_reuseaddr() function.
Otherwise you may run out of privileged ports.

In this version of the patch, one may separately decide whether
privileged ports will be required for passively accepted connections
(require_privileged_port) and whether privileged ports will be used
for activitely initiated connections (use_privileged_port).

Original patch by Ira Weiny.

Change-Id: Id3600094b08784be6e82b224cf510460f69d4dd6
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/366
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-245 too many default ACLs break directory access on new directories

The attached patch was a result of the discussion with Andreas Dilger
on lustre discuss starting here:
http://lists.lustre.org/pipermail/lustre-discuss/2010-May/013177.html

Change-Id: I0f66d3587d25f0c9c3862498326a2c26acc57b3e
Bugzilla: 22820
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/471
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-351 RHEL6 U1 support.

that patch adds support for 2.6.32-131 kernel.

Change-Id: I5c0f72a4a84d120b1820a038be82dedf806e2da1
Signed-off-by: Alexey Lyashkov <alexey_lyashkov@xyratex.com>
Reviewed-on: http://review.whamcloud.com/584
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-264 Integrate upstream ext4 MMP chnages

Integrate the changes made to the MMP patch when it was submitted upstream
for the 2.6.40 kernel.  Mostly cosmetic changes were done (improved comments, etc),
along with moving the MMP functionality into a separate mmp.c file in order to
avoid increasing the size of super.c too much.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I6909f3e44b077d65d653994ed1ac3ee11fcacb7f
Reviewed-on: http://review.whamcloud.com/865
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-118: clear_inode: BUG_ON(inode->i_data.nrpages)

This is a workaround patch to fix the problem. This patch should be gone
after there is a fix appearing in mainstream kernel.

Change-Id: I5a78ecae626e5d82cd9eac5dc2c2b849d4afd368
Signed-off-by: Jinshan Xiong <jay@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/879
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-64 Alphabetized lfs's sub-commands' options

Arranged lfs's sub-commands' options in alphabetical order by the
short option letter (lower-case followed by upper case, if both are
present).

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: I5c3865d06de11674e7e3b8d764307e5402aeaaa1
Reviewed-on: http://review.whamcloud.com/500
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-288 adjust PATH order in test framework

* Test scripts use lustre build tree binaries other than installed ones.
* Bind mount mount.lustre in the lustre build tree other than copying to /sbin/

Change-Id: I32468fa608b32a7ef097db531cdd45b68088af50
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/525
Tested-by: Hudson
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>

LU-336 Tighten matching criteria in module_loaded

The function module_loaded can easily produce false positives because
of it's lenient way of grep'ing the output of lsmod. Tightening up the
criteria upon which it uses to determine if a module is loaded, reduces
the risk of returning these false positives.

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: Id8a20bf568be275eeb3ef466cb3fd051f8389b44
Reviewed-on: http://review.whamcloud.com/558
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>

LU-328 unlock fo_llog_list_lock before allocating memory

in filter_find_create_olg in filter.c, the spinlock filter->fo_llog_list_lock
is held during allocating a new obd_llog_group, which cause system hang

Change-Id: I1b95387fbaf6f9a7080073b8ee7918e46263f1f0
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/556
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>

LU-8 dynamically grow/shrink socklnd connd threads

if multiple nodes are down, all socklnd connds could be blocked for a
long while, we can workaround this by increase default nconnds but it
always requires to have unnecessary number of threads.This patch can
support dynamically grow/shrink connd threads pool, it
can create new thread if there's pending active connecting, it will
kill some threads if there are too many idle connds.

Change-Id: Icbb52e8029d7c4c85d87be69e0a5b440832b01ba
Signed-off-by: Liang Zhen <liang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/390
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-246 Add a barrier for recovery completion for conf-sanity

* Make sure client connection finished before each conf-sanity test
* Put test_58 ahead of test_59
* Properly finalize some tests with 'writeconf'

Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: Ie2592954b54c3d5fbb275b38ad61c6986032fc5b
Bugzilla: 18779
Reviewed-on: http://review.whamcloud.com/476
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Niu Yawei <niu@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-57 Allow OSTs to be created with no primary node

Add a --servicenode parameter for mkfs.lustre to treat all service
nodes equally.

Bugzilla: 19064
Change-Id: I15fc50ec7b808fac03dab92b8c0702a0d054b559
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/378
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Mikhail Pershin <tappro@whamcloud.com>
Tested-by: Liang Zhen <liang@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

Revert "LU-147 avoid 8k obd device amount limit"

Uncovered multiple races on cleanup leading to use after free

This reverts commit 7d818af6449c9005b2dd7cb213d38d6ad61bf178.

Change-Id: If5c72f365f849ac888fe90ea732908fa447347d6
Signed-off-by: Oleg Drokin <green@whamcloud.com>

LU-216 Protect extent tree during fsfilt_ldiskfs_ext_walk_space()

Need guarantee the validity of the extent path passed in
ldiskfs_ext_new_extent_cb().

Change-Id: I2f583ce7cc663e600504a457d0c6fc3461afbad4
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/491
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-272 LBUG in replay-single test_74

Upon filter proc entry creation failure, return error instead
of continue silently.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: I0c5376b2dd8a88d5f950dd2165b3ab28c54e309b
Reviewed-on: http://review.whamcloud.com/497
Tested-by: Hudson
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-244 Cray portals compile fixes for Lustre 2.X

While moving the lustre client on cray sea star systems I ran it the
compile issues with the portals klnd driver. The reason being is the
lag of the driver to the api changes in the lnet layer. This patch
brings the lnet portals driver up to date.

Change-Id: I9e81cc11e25be7c5c548fdfd3cc7e596107fc0ef
Signed-off-by:James Simmons <uja.ornl@gmail.com>
Reviewed-on: http://review.whamcloud.com/469
Reviewed-by: Liang Zhen <liang@whamcloud.com>
Reviewed-by: Cory Spitz <spitzcor@cray.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Hudson

LU-356 adding verbose option in test-framework

in test-framework.sh, using the VERBOSE value if it's set by user,
in do_node and do_nodes, fixing the problem of only printing part of
the command during using "lctl mark" to print debug info.

Change-Id: If6444b322849d5f11a8c1f678de0eb7b80398480
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/862
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-326 make sure df send statfs request

in test_18c of recovery_small.sh, it uses df to send a statfs request
to OST to detect the disconnection stat, but it will fail to send
the request if there is a cache of statfs in client node.
the patch adds a "sleep 1" to make sure the cache of statfs expires
before df sends statfs request.

Change-Id: Ia1f56b8160e77827d5249656488734d7defd6c81
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/551
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>

LU-349 set LC_ALL explicitly in obdfilter-survey

in lustre-iokit/obdfilter-survey/obdfilter-survery, different locales will
cause the "awk" to fail, setting LC_ALL=POSIX explicitly to avoid the issue.

Change-Id: I9a84f9c93a9911f3a84c33429ba5cc9981913995
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/594
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-248 increase LOV reseed to mitigate OST allocation inconsitence

in lov_qos.c, increase the LOV_CREATE_RESEED_MULT and
LOV_CREATE_RESEED_MIN to increase the LOV reseed window
to mitigate the inconsistence issue of OST allocation

Change-Id: I7e44b9cf23e4ade1fb99a4f5f3537f3c26dece94
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/549
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-365 cleanup old irrelevant files

Remove some scripts related to CVS and old TSP inspection process.
Remove some ancient files related to UOSS on Solaris.

Change-Id: I4d462b7679cac1e4b0b14c0629623969bd745b99
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/860
Tested-by: Hudson
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-163 MDS returns 32/64-bit dir name hash according to client type

1) liblustre client, 1.8.5 or older client do not support 64-bit dir name hash.
2) register Lustre version 'get_name()' for NFS processing.
3) 'll_dir_seek()' processes name hash-based dir seek operation.
4) re-define "DIR_END_OFF" as "0x7fffffffffffffffULL" to always return positive
   dir name hash for successful seek.
5) small cleanup for 'll_dops_init()' to drop unnecessary statahead process.

Signed-off-by: nasf <yong.fan@whamcloud.com>
Change-Id: I0e3177c98c6e8814c39551ab54edfa3f861cbc8c
Reviewed-on: http://review.whamcloud.com/432
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-305 Temporarily block 'non-fatal' signals

In cl_lock_state_wait(), to avoid being interrupted by 'non-fatal'
signals (such as SIGCHLD), we'd block them temporarily.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I176530131a5983c19d64d311b100d1b81845164f
Reviewed-on: http://review.whamcloud.com/591
Reviewed-by: Jinshan Xiong <jay@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-309 Fix sanity test_27z to work if lustre is mounted from loop device

Unmount by block device does not work for loop devices, unmount by
mountpoint instead

Change-Id: I604cfafa3a38a98e04daed979781f2d6c052b760
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/536
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-339 use new aops for kernel >= RHEL5.4

Kernel in RHEL5 >= 5.4 supports both old and new aops interface,
and a flag MS_HAS_NEW_AOPS is used to mark whether a filesystem
supports new aops.
Lustre has implemented the new aops, but not enabled. And with
new aops a single thread I/O can gain 5% perf increase.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: I23bbfcd105c1ffd7f6c942342f9c1fb29a1cffe4
Reviewed-on: http://review.whamcloud.com/592
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-363 don't cache BUILD for reuse

Since future builds don't actually need the %_topdir/BUILD subdir,
and it's huge, don't bother caching it.

Increment the toplevel BUILD_GEN to force a rebuild of all of the
kernels.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: Ibd3e10c4052ca8012c8fd507be99a3b24e68d71e
Reviewed-on: http://review.whamcloud.com/533
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

TT-59 remove . and - from the node name

Replace . and - with _ in the node name, so it can be identified
as a variable in bash.

Change-Id: I0ae9c8225f9181a5b374fdb3c6316e47f2569ef1
Signed-off-by: sarah <sarah@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/376
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>

LU-160 Reduce OST size requirement for test 155

The OST size requirements for sanity test 155 is reduced by running with
only a single-striped file on a particular OST, and only checking the
RAM on that OST's OSS node. Because it is no longer trying to create a
file larger than multiple OSS nodes' RAM while only striped over a
single OST, these tests should run at times when they previously would
not have.

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: I4c1829240f4cd44366ad0de24ef6caa444f98801
Reviewed-on: http://review.whamcloud.com/534
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-274 Update LVB from disk when glimpse callback return error

There are various cases that glimpse callback return errors,
we should update the LVB from disk whenever the glimpse ast failed.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I120ebcb6254cee5b797c09545d29cc7dcc12a5d2
Reviewed-on: http://review.whamcloud.com/583
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-285 Minor fix for sanity test_180a

Call 'lctl add_uuid' to make sure we can find the loopback nid

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: Ib94e0478a9ec4ed93ae6dde59bbac89ce5466543
Reviewed-on: http://review.whamcloud.com/521
Tested-by: Hudson
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

New version 2.0.61

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: Ibe7200e9eb3629ca5d3008c4d973b44ec4709c36

LU-231 sanity test_170: FAIL: expected 248 bad lines, but got 249

Port b1_8 fix to master:
Short malformed line may not be counted into bad lines.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: Iebf8b48b775a9cb393caa854e51aaf9981e08d0f
Reviewed-on: http://review.whamcloud.com/537
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-228 kernel update [RHEL5 U6 2.6.18-238.9.1.el5]

Change-Id: I7f9dc92f97f675a6dac1ff222c055bf13ca3b2a0
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/514
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-249 Allow the user to set the upper limit to the thread count on the MDS

Currently the largest number of the threads that can exist on the MDS is 512.
For very large system is those threads can easily be exhausted and end up back
logging the system. This patch allows the user to define the upper limit of
how many threads are created on the MDS. If not selected the default behavior
of 512 is keep.

Change-Id: I1952bbb5a446dd5debf5f787489e1c456da7945a
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Reviewed-on: http://review.whamcloud.com/477
Tested-by: Hudson
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Mikhail Pershin <tappro@whamcloud.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-323 Not append index at the end of mdd_obd name

Remove the index from mdd_obd_xxx, since the dev_name already
includes that.

Change-Id: I20c61d45477ac0843aed3f0e9de23b0badf723ae
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/548
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-314 don't print warning when setting debug mask to 0

Change-Id: Ib54bc2fd42603065aa200475ff30e69bafa91e9d
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/544
Tested-by: Hudson
Reviewed-by: Niu Yawei <niu@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-15 shrink the cache to alleviate OST memory pressure

Shrink file_max_cache_size to alleviate the memory pressure of OST.

Change-Id: I34c920cce65cd91f4793383b6563d7a296ec5307
Signed-off-by: wangdi <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/523
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-224 Move fail_loc handling from lustre to libcfs

This patch goal is to move the fail_loc handling from lustre to libcfs. The
reason being is that currently you can only do fault testing in the lustre
core code. By moving this code to libcfs all sub systems will be able to
inject
faults into the system for testing purposes. This is in particular needed to
support the cray gemini klnd driver since one can inject faults for testing
failure conditions.

Change-Id: I438c30d0c7fe6987ad3fcfa5442366d4307a4d9f
Signed-off-by: James Simmons <uja.ornl@gmail.com>
Reviewed-on: http://review.whamcloud.com/450
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Liang Zhen <liang@whamcloud.com>

LU-316 Fix changelog deadlock when changelog client is killed

Make sure that all unused filedescriptors are closed to ensure that
when the reader is dead, ther are no holders of the read fd and
we do get EPIPE to our writes.

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: Id0a53361862124e6b4febdbb3f8cacce34799e68
Reviewed-on: http://review.whamcloud.com/555
Tested-by: Hudson
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Reviewed-by: Mikhail Pershin <tappro@whamcloud.com>

LU-273 Remove export-show_task patch

It is not used, dump_trace() is enough for the purpose.

Change-Id: Ic67ce634a8985835b00373024c88608fe0ef114f
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/493
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Hudson

LU-213 using direct io for quota test to avoid cache problem

in test_14a of sanity-qutota.sh, the data written was cached in client side,
which causes the test failed, using "mulitop ${TESTFILE} oO_DIRECT" (direct IO)
instead of "dd" to avoid such issue.

Change-Id: I0802c2ea200483c148e4e7f61e2c6d4b34500f01
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/435
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-278 only use the v* tag and limit the match

In order to allow people to create tags such as 2.0.59-1foobar,
only try to match on the v* type tags, and even then, tighten up
the match pattern (as best we can using globs) to try to limit the
number of false positives.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I2d6e422fc0c17df7eb4169efea8e3557e80b941d
Reviewed-on: http://review.whamcloud.com/517
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-298 Improve check for dpkg system.

Use lsb_release id (Ubuntu, Debian, RedHatEnterpriseServer, etc.)
to determine if the system uses dpkg, instead of just checking for
the existence of the dpkg binary.  For example, some people do
install dpkg on their RHEL systems for various reasons.

Change-Id: I74db5277cb2db00927b74b652e7945bd95bca093
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/519
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-303 fix ofed download for bugfix releases

On the OFED download server both w.x.y and w.x.y.z releases are
stored in the w.x.y dir, so handle that properly for the w.x.y.z case.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: Ic0ba6861ce000a9cc47c63219e357d2f6636b951
Reviewed-on: http://review.whamcloud.com/527
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-301 bump kernel version for sles11

We need to provide the same "self service" love in lbuild for sles11
(client only) building.

May as well bump the supported kernel to the latest while I'm at it.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I84617f429b0cef23a24fe161158580917ffe3041
Reviewed-on: http://review.whamcloud.com/482
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-160 Split small/big file parts of test_155_load

Separate the small file parts and the big file parts of test_155_load
into different tests. This has the benefit of always running the small
file portions of test 155, even if the big file tests are skipped.

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: Ic895fb8590f1d15fbd1889b64b0a6143ff1c6289
Reviewed-on: http://review.whamcloud.com/528
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-300: Oops in cl_page_put of page fault path

This problem is due to the unintialization of cl_io, so that an invalid page
address will be accessed in vvp_io_fault_fini().

Change-Id: Ic85a5d22e175cc74ada0e51831142d9f37798c08
Signed-off-by: Jinshan Xiong <jay@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/530
Tested-by: Hudson
Reviewed-by: wangdi <di.wang@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-255: enable ext4 features by default

Enable the flex_bg, huge_file, and dir_nlink features from ext4 by
default for ext4-based ldiskfs filesystems.  The flex_bg feature
can significantly reduce e2fsck time as well as time-to-first-write
on newly mounted OSTs.

Reduce the number of inodes created on larger OST filesystems, since
there are far too many inodes created by default, which wastes space
and slows down e2fsck.

Increase the number of inodes on MDT filesystems, subject to
constraints from the default number of stripes being stored for
each inode, which may increase the inode size being used.  Remove
changes to the statfs() results on the MDT to limit inode count to
the returned block count since increased MDT inodes will always
exceed free blocks, and it was confusing.

Skip zeroing the journal at format time.  It will be overwritten
at first use, and avoids writing 400MB of zeroes to the filesystem
needlessly.  We can't skip zering the inode table by default, but
newer mke2fs will check if the kernel handles this itself, and
request it internally.

Cleanups to remove support for 2.4 kernels and reiserfs filesystem.

Change-Id: I519bffaad5e97ee68c189efb00e07ebc0b1600f5
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/480
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-276 increase file count to mitigate affect of random condition

in test_18 of ost_pools, increase the count of created file to
mitigate the affect of various random condition which could
lead to false result

Change-Id: Ieca04b37ccc66698cd2159fa1a83f2f9fe07dc41
Signed-off-by: HongChao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/550
Tested-by: Hudson
Reviewed-by: Mikhail Pershin <tappro@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>

LU-299 Initialize struct shrinker variable in test

If the "tmp" struct in the test is uninitialized, the test
will fail for that reason, rather its intended functions.

Change-Id: I4b1e97e511c748155f742909d9424f228fc24545
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/522
Tested-by: Hudson
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Tested-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-279 Test failure on test suite sanity, subtest test_17k

rsync 3.0.x cares about exact xattr value size when passing 0 size
for determining the buffer size to hold the xattr value.

Change-Id: I05f8c062e64e22dd6982dc752d5869b457c7a2ef
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/524
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-260 Add open-unlinked dir regression test case.

Change-Id: Ic9efd3d89377bc34470cb3b7ab88f62b2a03b058
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/485
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-128 Avoid assertion on wire data in last_rcvd update

- checks that lower transno can't overwrite the bigger one in last_rcvd
  slot.
- evict client if bad transno was sent in replay, this is done by simulating
  VBR failure
- keep assertion for server-generated transno, this is logical error
- fix issue with resent-replay open which can cause unexpected
  transaction while closing the old mfd.

Change-Id: Ib523c25408b4d821f52d95c40a4fbd7d79d6cbe6
Signed-off-by: Mikhail Pershin <tappro@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/452
Tested-by: Hudson
Reviewed-by: Niu Yawei <niu@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-160 check the minimum available size of OST in test_155_load()

Fix test_155_load() in sanity.sh to check whether the minimum available
size of OST is bigger than the large file size. If not, then sanity test
155{a,b,c,d} would be skipped.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I0a587337ad188a96f2ada51726604029c666df07
Reviewed-on: http://review.whamcloud.com/368
Tested-by: Hudson
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-271 Skip permission check for NFS open after create

For open_create operation, NFS client will trigger separate open RPC after create RPC.
We only need to check create permission for such case.

Change-Id: I7f0e2edb1b14f1044790180345f2c8328d92d4e8
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/494
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>

New version 2.0.60

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: Id062aed81b8956d42a8c5487f53bb44e505b491e

LU-225 --with-ldiskfs-inkernel checks wrong file

Commit fd0bd149e66cbc06a17c372e159f9bfba024cc97 changed the file checked
when the --with-ldiskfs-inkernel configure option is used from
$LINUX/fs/ldiskfs/inode.c to $LINUX/include/linux/ldiskfs_fs.h.

It looks like the person fixing a similar case statement assumed the
same fix applied to the inkernel case.  However, this is wrong because
the purpose of --with-ldiskfs-inkernel is to allow us to build lustre
without having full kernel sources available, so inode.c won't exist.

Signed-off-by: Ned Bass <bass6@llnl.gov>
Change-Id: I6dc1db41fdee0016eab7d151c519e3359d78b44b
Reviewed-on: http://review.whamcloud.com/446
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-235 fix sanity test 36g to work with remote OSS

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Iccf7f109c69ac7dd34f9f5b7ee2d5ce4cb892053
Reviewed-on: http://review.whamcloud.com/488
Tested-by: Hudson
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-188 Reduce startup messages.

commit f257c3021c7470445673bc930c4884c5df9b9429
Date:   Mon Jan 24 15:17:35 2011 +0100

b=17275 make lustre client less verbose at startup time for Cray

i=johann

Signed-off-by: YangSheng <ys@whamcloud.com>
Change-Id: I78a5196f56ff147075676d2fdcdc6d9978437d72
Reviewed-on: http://review.whamcloud.com/406
Tested-by: Hudson
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-284 strip .$arch off of kern vers for requires

RHEL6 appends .arch to the end of the version in the utsrelease.h file.
The kernel RPM however provides that value with the .arch stripped off,
so do the same stripping in the lustre-modules RPM for it's Requires:.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: Ib6ff32c006f184edceb5d667b649bb106d503faf
Reviewed-on: http://review.whamcloud.com/502
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>

LU-240 test_171() races with background multiop

Change-Id: Ic05c8d79e82cfc632942b13ec3b46ee26da49555
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/466
Reviewed-by: Li Wei <liwei@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-178 prevent replays after recovery on server

- Drop requests with wrong flags during normal processing.
- remove race in target_handle_connect which can cause replays over
  new export
- test case for wrong replays handling

Change-Id: Icbfc0ae549ab63a510e0d62fcac1ed661b324fb9
Signed-off-by: Mikhail Pershin <tappro@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/391
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Niu Yawei <niu@whamcloud.com>

LU-239 Lustre Header (include/lprocfs_status.h) is not ISO C99 complaint

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: I40ce6ac0ecaaf19c01cd25603971ff1fb8ed10df
Reviewed-on: http://review.whamcloud.com/465
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>

LU-234 OOM killer causes node hang.

b=18213 Handle the signal to avoid process hang.

Change-Id: Ic730d98fb812bc9dbb5249847a6115a84d67758b
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/470
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Oleg Drokin <green@whamcloud.com>