Whamcloud - gitweb
fs/lustre-release.git
12 years agoLU-443 LNet: Only squawk when md->start is NULL on non-zero length 13/1413/2
Wally Wang [Thu, 22 Sep 2011 22:58:05 +0000 (15:58 -0700)]
LU-443 LNet: Only squawk when md->start is NULL on non-zero length

Only squawk when md->start is NULL on non-zero length.
The md->start == NULL check prevents anyone from creating a ME/MD
with no buffer. These are used as backstop buffers to generate events
when traffic has exceeded the local buffer space.
See Oracle bug 21103 attachment 32922.

Change-Id: Id4fdf26b047df56cdf034952fea15f9a4e0dba62
Signed-off-by: Wally Wang <wang@cray.com>
12 years agoLU-606 Add alternative servers start order
Bobi Jam [Tue, 23 Aug 2011 11:57:11 +0000 (19:57 +0800)]
LU-606 Add alternative servers start order

When newly created mdt registers itself, mgs erases all the logs for
that particular fs, which fails client mount.

Add alternative server start orders workaround to enable
MGS->MDT(s)>OST(s) as well as MGS>OST(s)->MDT(s) order.

Bugzilla: 24050,24464
Author: E.Gryaznova <elena.gryaznova@oracle.com>
Author: Wang Yibin <wang.yibin@oracle.com>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I3a342636efdb7efefe8377add0e4dc808f7733c1
Reviewed-on: http://review.whamcloud.com/1272
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
12 years agoLU-721 Parallel writes to same file results in a file of zeroes
Bobi Jam [Mon, 26 Sep 2011 03:18:02 +0000 (11:18 +0800)]
LU-721 Parallel writes to same file results in a file of zeroes

Canceling lock may contain data being sent to OSTs. Change
find_cbdata iterator to take that into account.

Change-Id: Ifdb21472780331cba452db68a52fd15bb6cbe35c
Author: Vladimir Saveliev <vladimir.saveliev@oracle.com>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1422
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
12 years agoLU-690 test: wait_osc_import_state() fixes
Yu Jian [Sun, 9 Oct 2011 05:21:04 +0000 (13:21 +0800)]
LU-690 test: wait_osc_import_state() fixes

b=24498 wait_osc_import_state() fixes

i=Vladimir.Saveliev

-- increase maxtime to wait the timeout of 1st request;
   take into account at_min value;
-- cleanup wait_osc_import_state() to use _wait_import_state();
-- ost-pools test_1 fix: use local var instead of global NAME

Signed-off-by: Elena Gryaznova <elena.gryaznova@oracle.com>
Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I580152df654c9ba5048ae54ff933611b832ef3d9
Reviewed-on: http://review.whamcloud.com/1498
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Minh Diep <mdiep@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agobump version to 1.8.6.81-wc1 v1_8_6_81
Johann Lombardi [Tue, 4 Oct 2011 14:33:37 +0000 (16:33 +0200)]
bump version to 1.8.6.81-wc1

Signed-off-by: Johann Lombardi <johann@whamcloud.com>
Change-Id: I3cdfe619963741cbe24ab6e929d562bca51569f1

12 years agoLU-624 Kernel update [RHEL6.1 2.6.32-131.12.1.el6] (client only)
yangsheng [Thu, 29 Sep 2011 02:08:24 +0000 (10:08 +0800)]
LU-624  Kernel update [RHEL6.1 2.6.32-131.12.1.el6] (client only)

Change-Id: Ia7473c717c0862fd4b2167ed61400f5493217ce4
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1438
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
12 years agoLU-146 mds_open() may deadlock
Lai Siyao [Wed, 17 Aug 2011 08:31:42 +0000 (01:31 -0700)]
LU-146 mds_open() may deadlock

* Get open lock inside mds_get_parent_child_locked() to avoid
  deadlock.
* Never get open lock if child is newly created to avoid deadlock.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: I1a1dadafef364f36ad3b892ba7a2d669f6027f10
Reviewed-on: http://review.whamcloud.com/1259
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-674 kernel update RHEL5.7 [2.6.18-274.3.1.el5].
yangsheng [Thu, 11 Aug 2011 13:13:44 +0000 (21:13 +0800)]
LU-674 kernel update RHEL5.7 [2.6.18-274.3.1.el5].

Test-Paramaters-Start:
serverdistro=el5
clientdistro=el5
testgroup=regression
Test-Paramaters-End:

Change-Id: I4d080a22395ce11c43ba52d6bb3089761180a08a
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1213
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-478 Set tunables on lvm device
Niu Yawei [Thu, 29 Sep 2011 10:25:02 +0000 (03:25 -0700)]
LU-478 Set tunables on lvm device

- The set_blockdev_tunables() shouldn't chop the tail digit on
  the /dev/mapper/xxx device.
- Sometimes, the /sys/block/dm-x doesn't have the max_[hw]_sectors_kb,
  such errors should be tolerated.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I3c3737be561302adc93ab699701649e71c0c1321
Reviewed-on: http://review.whamcloud.com/1439
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoRevert "LU-607 Avoid race between ldlm_pools_shrink and ldlm_namespace_free"
Johann Lombardi [Fri, 23 Sep 2011 08:50:32 +0000 (10:50 +0200)]
Revert "LU-607 Avoid race between ldlm_pools_shrink and ldlm_namespace_free"

This reverts commit ba79e90a7028e2637e64367535715c81729f4cb2.
This patch is causing conf-sanity subtest 23a to fail.

Change-Id: I35f27ba55bb12a3d231f34e4764aa48a71025b4b
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-448 add lst stat --count
Wally Wang [Wed, 31 Aug 2011 00:53:52 +0000 (17:53 -0700)]
LU-448 add lst stat --count

This adds lst stat --count, making it easier to script up data
collection for performance tests.

The patch is from Oracle bug 22638 attachment 33001

Change-Id: Ic60e6226ce85ebbc2d314e41c7e85ba5879ea64e
Signed-off-by: Wally Wang <wang@cray.com>
Reviewed-on: http://review.whamcloud.com/1312
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Liang Zhen <liang@whamcloud.com>
Reviewed-by: Lai Siyao <laisiyao@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-608 canonicalize the devices names
Wally Wang [Wed, 24 Aug 2011 19:00:37 +0000 (12:00 -0700)]
LU-608 canonicalize the devices names

Perform a readlink on the device name if path is /dev/disk/by-id...
See Oracle bug 24487.

Change-Id: I52bc670181606663bfbd746d34f3c2bc710ecc72
Signed-off-by: Wally Wang <wang@cray.com>
Reviewed-on: http://review.whamcloud.com/1284
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
12 years agoLU-261 Renamed auster.sh to be auster
Chris [Fri, 6 May 2011 15:35:40 +0000 (16:35 +0100)]
LU-261 Renamed auster.sh to be auster

This makes it like b2_1 and following the convention that human commands don't
have extensions and modified Makefile.am which references auster[.sh]
Also remove libcfs from REQUIRED_DIRS in autogen.sh since libcfs is still
under lnet in lustre 1.8.

Change-Id: I29247005a6b02b039cf4a861af4dc5de30082c23
Signed-off-by: Chris Gearing <chris@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/541
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-646 port bz23485 (clarification of lustre fsync behavior)
Lai Siyao [Tue, 30 Aug 2011 03:21:39 +0000 (20:21 -0700)]
LU-646 port bz23485 (clarification of lustre fsync behavior)

Add directory fsync operation.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: I6bad2cc1df840bbf827b9fcb352361877dd493d1
Reviewed-on: http://review.whamcloud.com/1308
Tested-by: Hudson
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-607 Avoid race between ldlm_pools_shrink and ldlm_namespace_free
Bobi Jam [Tue, 23 Aug 2011 13:23:10 +0000 (21:23 +0800)]
LU-607 Avoid race between ldlm_pools_shrink and ldlm_namespace_free

ldlm_namespace_free removes namespace from list and free memory
without checking namespace's refcount while ldlm_pools_shrink might
get namespace from the list and start ldlm_pool_shrink() for it.

Bugzila: 24419
Author: Vladimir Saveliev <vladimir.saveliev@oracle.com>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: I757204ad119927cacdb73db66f5e40ace50eeea8
Reviewed-on: http://review.whamcloud.com/1273
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-594 Make sure sanity 27v fallout clears
Bobi Jam [Sat, 20 Aug 2011 11:01:15 +0000 (19:01 +0800)]
LU-594 Make sure sanity 27v fallout clears

We need wait long enough for OST to wake up from
OBD_FAIL_TGT_DELAY_PRECREATE sleep.

Change-Id: Ie8b56e3f8bad79049946563353360dce58280ba4
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1263
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-544 speed up filesystem formatting time in conf-sanity.sh
Yu Jian [Fri, 12 Aug 2011 09:08:20 +0000 (17:08 +0800)]
LU-544 speed up filesystem formatting time in conf-sanity.sh

Pass "-E lazy_itable_init" to mke2fs to speed up Lustre
filesystem formatting time in conf-sanity.sh.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I2df0e47332b967deae668405786006c7ad7250bd
Reviewed-on: http://review.whamcloud.com/1223
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
12 years agoLU-541 Fix getstripe interop with 2.0 server
Bobi Jam [Thu, 28 Jul 2011 09:28:11 +0000 (17:28 +0800)]
LU-541 Fix getstripe interop with 2.0 server

* 2.0 server has changed dir getstripe rule as follows:
          If the directory in question DOES NOT have it's EA set, AND it
          IS NOT the root directory of the filesystem, then no EA values
          are returned to userspace. Rather, an error is returned from
          the ioctl and errno is set to ENODATA.
  1.8 client needs adapt to this rule
* fix liblustreapi.c usage of errno and rc, llapi_xxx() functions should
  return negative value on error.

Change-Id: If81a456209d5985aae7f20569eba1ac45ef576b1
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1154
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
12 years agoLU-565 Update llite_nfc.c to 2.x interop fid API 06/1206/3
Oleg Drokin [Wed, 10 Aug 2011 20:35:59 +0000 (16:35 -0400)]
LU-565 Update llite_nfc.c to 2.x interop fid API

It seems we forgot to update lustre NFS code when converting everything
to FID interop API. This lead to ESTALE errors trying to export NFS
from 1.8 client that ewas mounting 2.x MDT due to inode generation
and fid generation mismatch (inode generation always 0 for interop).

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: Ic88671826da73b19857a42ceb9ac8dd0fd35b244

12 years agoLU-544 reduce the journal size for conf-sanity test 56
Yu Jian [Mon, 1 Aug 2011 07:29:11 +0000 (15:29 +0800)]
LU-544 reduce the journal size for conf-sanity test 56

1) reduce the journal size from 16MB to 8MB for reformatting
   the MDT device which has a small size (40MB)
2) speed up filesystem initialization by passing
   "-E lazy_itable_init" to mke2fs

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I43eeaa1edf43420adeb101ae96b1d9faa36fcbbb
Reviewed-on: http://review.whamcloud.com/1171
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-550 incorrect quota hash function
Niu Yawei [Fri, 29 Jul 2011 04:19:41 +0000 (21:19 -0700)]
LU-550 incorrect quota hash function

Quota code uses 'uid' or '(1 << 32) + gid' as the hash key, however,
the quota hash function lqs_hash() always try to interpret such a
unsigned long long key as a 'quota_adjust_qunit' struct, then calculate
the hash value by quota_adjust_qunit->qaq_id.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I128f2835ff590d712b0a1641af7361146e8e3e81
Reviewed-on: http://review.whamcloud.com/1163
Tested-by: Hudson
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-471 fix mkfs.lustre to avoid creating duplicate options
Bobi Jam [Wed, 27 Jul 2011 01:32:15 +0000 (09:32 +0800)]
LU-471 fix mkfs.lustre to avoid creating duplicate options

Also make user specified options overwrite default internal default
options.

Change-Id: I27d55e7490566e07c310e52ba7319fefcd0528d9
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1103
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
12 years agoLU-530 group quotas not enforced
Niu Yawei [Mon, 25 Jul 2011 05:20:36 +0000 (22:20 -0700)]
LU-530 group quotas not enforced

In filter_quota_getflag(), we shouldn't break the loop when the file owner's
quota limit isn't set, otherwise, the check for the file group will be skipped
and the out of quota flag will not be returned to client at the end.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: Ibf6f1fe3a550ce1f4b3d627fe24ca4484e754a41
Reviewed-on: http://review.whamcloud.com/1153
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-278 build: Only warn for tag/version mismatch
Andreas Dilger [Fri, 15 Jul 2011 08:48:28 +0000 (02:48 -0600)]
LU-278 build: Only warn for tag/version mismatch

The configure process should NOT abort just because the most
recent tag is not of the form that upstream uses to tag Lustre.
Downstream developers may use their own tags, or just add
extensions to upsteam's version tags.

Change-Id: I43b63e8438cc37588d5a5b91677102ded22917fb
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1105
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-413 limit used inodes for performance tests
Andreas Dilger [Tue, 14 Jun 2011 21:33:35 +0000 (15:33 -0600)]
LU-413 limit used inodes for performance tests

If doing wide stripe mdsrate tests, don't try to consume all of
the inodes on the OSTs.  The MDS does not consume inodes on OSTs
completely uniformly, and this only introduces spurious failures
when the inodes run out unevenly.

Change-Id: I36243e0d3e990858d268d043012af40419936fe4
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/942
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Niu Yawei <yawei.niu@gmail.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-525 llapi_file_get_stripe() fails with ENAMETOOLONG
Johann Lombardi [Thu, 21 Jul 2011 14:50:09 +0000 (16:50 +0200)]
LU-525 llapi_file_get_stripe() fails with ENAMETOOLONG

Remove bogus check on fsname in llapi_file_get_stripe().

Change-Id: I6ea7c403ce3a1994e80bc039260fae1e881b892b
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/1131
Tested-by: Hudson
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
12 years agoLU-387 mmp.sh test_9 failed
Niu Yawei [Wed, 22 Jun 2011 02:00:52 +0000 (19:00 -0700)]
LU-387 mmp.sh test_9 failed

The mmp.sh test_9 often fail for the script killing the e2fsck process
on wrong timing, so we use some tricky way to make sure the MMP block
stay in 'e2fsck' state before mounting the device.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I35a2f9708fa7dd3ea0cad246b767578209feeee3
Reviewed-on: http://review.whamcloud.com/991
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-432 QUOTA_OK / NO_QUOTA definitions
Christos Triantafyllidis [Sat, 18 Jun 2011 21:25:24 +0000 (00:25 +0300)]
LU-432 QUOTA_OK / NO_QUOTA definitions

Starting from kernel 2.6.34 the definitions of QUOTA_OK and NO_QUOTA
have been removed from linux kernel (linux/quota.h). This adds the
needed definitions to the relevant files.

Change-Id: I9b67ea491a34777c2ea5ff86630788cec18ebcf6
Signed-off-by: Christos Triantafyllidis <ctria@grid.auth.gr>
Reviewed-on: http://review.whamcloud.com/973
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-456 Force commit to reuse the just-deleted blocks
Niu Yawei [Fri, 1 Jul 2011 04:49:04 +0000 (21:49 -0700)]
LU-456 Force commit to reuse the just-deleted blocks

In ext4 non-writeback journal mode, the just-deleted blocks are not
useable until the transaction committed, this could cause filter
return -ENOSPC mistakenly when the just-deleted blocks are not committed.

Whenever block allocation fails for -ENOSPC on filter, we should wait
for the previous deleted blocks committed, then retry the allocation.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I50878d4459377d68a9c67575f137a3a44cb3625e
Reviewed-on: http://review.whamcloud.com/1039
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-452 : Don't export static functions
Stephen Champion [Thu, 23 Jun 2011 02:40:16 +0000 (21:40 -0500)]
LU-452 : Don't export static functions

As with LU-102 in the master branch, recent versions of GCC on ia64
sensibly refuse to export static functions.  obd_device_alloc and
obd_device_free are not referenced externally, so resolve this error
by not exporting them.

Signed-off-by: Stephen Champion <schamp@sgi.com>
Change-Id: I784cfbe59f4685d0e975427c3095aa082de1a1c6
Reviewed-on: http://review.whamcloud.com/1007
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
12 years agoLU-419 increase default inode ratio for OST/MDT
Andreas Dilger [Fri, 17 Jun 2011 08:48:33 +0000 (02:48 -0600)]
LU-419 increase default inode ratio for OST/MDT

Increase the default inode ratio for large OSTs to avoid creating
far too many inodes, which can slow down e2fsck dramatically.

Decrease the default inode ratio for the MDT, since it never uses
the space that is allocated to it.  Also make this calculation take
the expected stripe EA into account, which wasn't done before.

Change-Id: Ic827d5f7a012fa07106e7e053abc0e646aba30ac
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/959
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-419 enable ext4 features by default
Andreas Dilger [Fri, 29 Apr 2011 21:59:52 +0000 (15:59 -0600)]
LU-419 enable ext4 features by default

Enable the flex_bg, huge_file, and dir_nlink features from ext4 by
default for ext4-based ldiskfs filesystems.  The flex_bg feature
can significantly reduce e2fsck time as well as time-to-first-write
on newly mounted OSTs.

Enable the 64bit feature for ext4 filesystems if the device size is
larger than 2^32 blocks.  This is required in order to format OSTs
larger than 16TB in size.

Reduce the number of inodes created on larger OST filesystems, since
there are far too many inodes created by default, which wastes space
and slows down e2fsck.

Skip zeroing the journal at format time.  It will be overwritten
at first use, and avoids writing 400MB of zeroes to the filesystem
needlessly.  We can't skip zering the inode table by default, but
newer mke2fs will check if the kernel handles this itself, and
request it internally.

Cleanups to remove support for 2.4 kernels and reiserfs filesystem.

Based on LU-255 commit eb012d4a10208b26c2d3e795a90f1bb07dde6d91.

Change-Id: I614003cc4d471f5fc33c379f66407e995fe856e2
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/958
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoBump version to 1.8.6.60-wc1 04/1104/1 v1_8_6_80
Johann Lombardi [Fri, 15 Jul 2011 05:56:09 +0000 (07:56 +0200)]
Bump version to 1.8.6.60-wc1

Change-Id: I8622e6a1235a7bcfb8298a632201342965016435
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-130 Add changelog entry 1.8.6 1.8.6-wc1 v1_8_6 v1_8_6_RC4 v1_8_6_WC1
Johann Lombardi [Tue, 28 Jun 2011 22:44:14 +0000 (00:44 +0200)]
LU-130 Add changelog entry

Page migration is now disabled, add changelog entry.

Change-Id: Ie417cac4a6b0a9c2a82cc217daa81e3d40eeff9a
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoRevert "LU-457 Enable slab debug for RHEL5/x86_64"
Johann Lombardi [Tue, 28 Jun 2011 22:07:13 +0000 (00:07 +0200)]
Revert "LU-457 Enable slab debug for RHEL5/x86_64"

This reverts commit 529529a3dfbb8849f479c15f75e8f875ba5427b4.

Change-Id: Ic1955242ca260d9669a7e2ad4ba4d78f512739ce
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-130 disable page migration 26/1026/1
Johann Lombardi [Tue, 28 Jun 2011 04:48:43 +0000 (06:48 +0200)]
LU-130 disable page migration

Disable page migration until we implement a proper ->migratepage handler.

Change-Id: I04eb78c0d04c828eabb3598a3e42ebf51daec3c2
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-457 Enable slab debug for RHEL5/x86_64 18/1018/3
Johann Lombardi [Fri, 24 Jun 2011 17:13:50 +0000 (19:13 +0200)]
LU-457 Enable slab debug for RHEL5/x86_64

Debug patch to turn on slab debugging in the RHEL5 kernel.

Change-Id: I6bcd6f6239b9f5b5953981bcb5fafec426b90005
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-410 Revert LU-15 slow IO with read intense application 1.8.6-wc v1_8_6_RC3 v1_8_6_WC
Johann Lombardi [Wed, 22 Jun 2011 16:25:20 +0000 (18:25 +0200)]
LU-410 Revert LU-15 slow IO with read intense application

This reverts commit 12aae18c0ec495f459a1026ad2e86bbf0232b0fe.
This patch indirectly causes a performance drop with SRP.

Change-Id: If1af51ac8c2d45bc4d5cc5502dc59501678baaec
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoUpdate e2fsprogs version in changelog
Johann Lombardi [Wed, 22 Jun 2011 16:22:21 +0000 (18:22 +0200)]
Update e2fsprogs version in changelog

Change-Id: Ib0c6cd31dfec23bf92548028d50655b2520b99d4
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-85 Fix missing bracket
Johann Lombardi [Tue, 21 Jun 2011 14:39:58 +0000 (16:39 +0200)]
LU-85 Fix missing bracket

Change-Id: I0c3d16320aab019ef0ef7994c34f6ea5f9ded2a2
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-384 Add space to default PATHS
Andreas Dilger [Thu, 16 Jun 2011 05:43:27 +0000 (23:43 -0600)]
LU-384 Add space to default PATHS

The update in c81b47a724dd4414b8bd79eb99b9737a70fd5855 broke
configure if --with-linux was not specified, causing build
failures because the .config file could not be found.  Fix this.

Update some ancient documentation that is referenced if the
.config file cannot be found to better describe what is needed
to build Lustre with modern kernel packages (for RHEL at least).

Change-Id: I5b373e3ee3ef42c68257c27a4b194c9e00cf023f
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/946
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-421 include lustre/BUIDING in dist tarball
Brian J. Murrell [Thu, 16 Jun 2011 11:25:38 +0000 (07:25 -0400)]
LU-421 include lustre/BUIDING in dist tarball

lustre/BUILDING is not currently included in the dist tarball.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I3c4eed5918aa08df0108aeff134bb9a904f15391
Reviewed-on: http://review.whamcloud.com/948
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-422 broken lines need continuations
Brian J. Murrell [Thu, 16 Jun 2011 12:32:47 +0000 (08:32 -0400)]
LU-422 broken lines need continuations

In commit fb7a499bf47530b9eee162990c8f1815b643d30e there was a sed
introduced that was broken across several lines with no line
continuations:

ver=$(echo $ver |
sed -e 's/^v(.*)/\1/'
-e 's/_RC[0-9].*$//'
-e 's/_/./g')

This is, of course, incorrect.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I7dab960da5ca5fbe7b1852873f72487fd753e415
Reviewed-on: http://review.whamcloud.com/949
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-85 build: update main bug report URL
Andreas Dilger [Sun, 19 Jun 2011 05:47:55 +0000 (23:47 -0600)]
LU-85 build: update main bug report URL

Update bug reporting URL in autoconf and other documentation
to reflect source of release.

Change-Id: I334aab903123cd0a071ee1b29de4bde5ebc59b0d
Signed-off-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/972
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
12 years agoLU-409 stop loading the llite_lloop module for >= 2.6.32 kernels
Yu Jian [Thu, 16 Jun 2011 15:27:44 +0000 (23:27 +0800)]
LU-409 stop loading the llite_lloop module for >= 2.6.32 kernels

The change of block device interface in kernel 2.6.32-131 caused
the llite_lloop module do not work. Since this is an unsupported
feature, let's stop loading this module from load_modules in
test-framework.sh.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Ic8513dbb02caa93f768a95b9f5798a91f7520ecd
Reviewed-on: http://review.whamcloud.com/954
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
13 years agoLU-408 escape [[ in autoconf macros v1_8_6_RC2
Brian J. Murrell [Fri, 10 Jun 2011 23:02:19 +0000 (19:02 -0400)]
LU-408 escape [[ in autoconf macros

autoconf files use m4 which means [ is meaningful to m4. In order
to escape them, one needs to use [[.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I7601226a0abb8a69e0924c6a8b47b4b0b9feb45a
Reviewed-on: http://review.whamcloud.com/936
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoSet version to 1.8.6-wc1 to get ready for RC1 v1_8_6_RC1
Johann Lombardi [Fri, 10 Jun 2011 19:52:24 +0000 (21:52 +0200)]
Set version to 1.8.6-wc1 to get ready for RC1

Change-Id: I7726fa228359fc67aefedc422d9fe8fbd6280b11
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-402 Update to rhel6.1 kernel 2.6.32-131.2.1.el6
Oleg Drokin [Fri, 10 Jun 2011 02:57:51 +0000 (22:57 -0400)]
LU-402 Update to rhel6.1 kernel 2.6.32-131.2.1.el6

Change-Id: Ib16f8db85b9188f7a9f5982e2914eb647d4b1f07
Signed-off-by: Oleg Drokin <green@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/933
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-403 Add support for RHEL5 kernel 2.6.18-238.12.1.el5
Oleg Drokin [Thu, 9 Jun 2011 22:54:03 +0000 (18:54 -0400)]
LU-403 Add support for RHEL5 kernel 2.6.18-238.12.1.el5

Change-Id: Idc6ba8b093d3f2a6e3a13016d7264d5f2937755c
Signed-off-by: Oleg Drokin <green@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/930
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-406 Fix compile breakage after adding ocd_max_bytes
Oleg Drokin [Fri, 10 Jun 2011 02:50:20 +0000 (22:50 -0400)]
LU-406 Fix compile breakage after adding ocd_max_bytes

Update pack_generic and two wiretest.c files to know about padding
and ocd_max_bytes fields in ocd_connect_data

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: I3405b88cf170efa94ee4233f3ccfb86db527ed7c
Reviewed-on: http://review.whamcloud.com/932
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Johann Lombardi <johann@whamcloud.com>
13 years agoRevert "Set version to 1.8.6-wc1 to get ready for RC1"
Oleg Drokin [Fri, 10 Jun 2011 01:42:51 +0000 (21:42 -0400)]
Revert "Set version to 1.8.6-wc1 to get ready for RC1"

The version was updated prematurely and breaks all builds

This reverts commit 6a93cc3b0ce9e5a76487151e5af4c208df5c5c01.

Signed-off-by: Oleg Drokin <green@whamcloud.com>
Change-Id: I6da04b65ba8a013599487e2945988f93d7cac4b1

13 years agoLU-16 reserve OBD_CONNECT_MAXBYTES connect flag
Andreas Dilger [Wed, 8 Jun 2011 23:10:18 +0000 (17:10 -0600)]
LU-16 reserve OBD_CONNECT_MAXBYTES connect flag

Reserve connect flag landed to master to prevent conflicts.

Change-Id: I9cc8ebfbfd82083085eea793eec9562d2bfb8bd8
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoSet version to 1.8.6-wc1 to get ready for RC1
Johann Lombardi [Wed, 8 Jun 2011 19:39:33 +0000 (21:39 +0200)]
Set version to 1.8.6-wc1 to get ready for RC1

Change-Id: Id2da3c16b5c3083b03583406fdd5094318a51229
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-384 land bz22281 on b1_8
Brian J. Murrell [Wed, 1 Jun 2011 16:53:06 +0000 (12:53 -0400)]
LU-384 land bz22281 on b1_8

To facilitate distinctive naming, we need the work in bugzilla
22281 landed on b1_8.
Add an lbuild option to set the downstream-release.  Normally
this should not be exposed to/through lbuild as this was orig-
inally intended for downstream packages to add their own stamp
to the release string.

Include e4189c54470deff4a98f0b2bb03ac6be7ed85ce9:
    b=24095 don't really need configure --with-linux

    Don't really need to have run configure --with-linux for
    version-tag.pl to work.

    i=wangyb
    i=cliff

Expand the list of debian/* files that should be included in the
dist tarball.
Don't try to [un]patch the local-env.sh.  It should never really
be included in a landed patch.

Include most of 086ff8c46009479bfdac9f570331a6c93b7d52ac:

    b=24094 add kver; update kdir, kobjdir

    Add a new macro to allow the caller to simply define which kernel
    he wants to build for.
    Refactor the kdir and kobjdir to function more properly.
    Remove krequires.  Nothing is using it anymore.

    i=wangyb
    i=cliff

Include c1a61e3e9129d0e2062eed617d922e6dfa9ede5a:

    LU-284 strip .$arch off of kern vers for requires

    RHEL6 appends .arch to the end of the version in the utsrelease.h file.
    The kernel RPM however provides that value with the .arch stripped off,
    so do the same stripping in the lustre-modules RPM for it's Requires:.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
    Change-Id: Ib6ff32c006f184edceb5d667b649bb106d503faf
    Reviewed-on: http://review.whamcloud.com/502
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I82f4f9a556fd1d1fc51ef8930e2017798ff88706
Reviewed-on: http://review.whamcloud.com/884
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoLU-400 don't unroll empty commits into patches
Brian J. Murrell [Tue, 7 Jun 2011 18:10:25 +0000 (14:10 -0400)]
LU-400 don't unroll empty commits into patches

The patch unrolling tool, build/extract_patches, currently will
create an empty dpatch if a commit is empty. This causes dpatch
some heartburn, so just skip empty commits.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: Ice0e5fad3c1dd01b507838a8b449536d016b8ffb
Reviewed-on: http://review.whamcloud.com/908
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoRemove changelog entry for LU-179
Johann Lombardi [Wed, 8 Jun 2011 13:43:57 +0000 (15:43 +0200)]
Remove changelog entry for LU-179

... this was already landed upstream (in Oracle's 1.8.6)

Change-Id: I29f23b9a330847f91ba0de3883396de67966896c
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoAdd missing changelog entries
Johann Lombardi [Wed, 8 Jun 2011 13:30:58 +0000 (15:30 +0200)]
Add missing changelog entries

Change-Id: I15dbcc4eef08e2afbfa223ae87cf31b7654a14e9
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoAdd OFED 1.5.3.1 to supported version and update recommended e2fsprogs version
Johann Lombardi [Wed, 8 Jun 2011 10:13:06 +0000 (12:13 +0200)]
Add OFED 1.5.3.1 to supported version and update recommended e2fsprogs version

Change-Id: Ie2b5daf4df98bbcd9bb84b558948269378b40df0
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-85 Update some URLs and text to reflect our releases.
Brian J. Murrell [Wed, 23 Feb 2011 21:38:40 +0000 (16:38 -0500)]
LU-85 Update some URLs and text to reflect our releases.

The text and URLs in the debian packaging metadata were old
(circa Sun Microsystems), so update them and take the opportunity
to inform about the source of the release being installed.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I23e87c0f093e4da208f4b66873ea9849fa62cc25
Reviewed-on: http://review.whamcloud.com/906
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Hudson
13 years agoLU-376 Cleanup wirecheck
nasf [Sat, 4 Jun 2011 15:21:04 +0000 (23:21 +0800)]
LU-376 Cleanup wirecheck

Drop unused ones and add 'MDS_DIR_END_OFF' check.

Change-Id: I813a2963d9ce858386f3cfff8581536a2e46d981
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/891
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-364 remove . - in node name
sarah [Thu, 2 Jun 2011 04:56:07 +0000 (21:56 -0700)]
LU-364 remove . - in node name

Replace . and - with _ in the node name, so it can be identified
as a variable in bash.

Change-Id: I7b5de328728c0b2433e2cea73d3520648eb9fdf2
Signed-off-by: sarah <sarah@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/885
Tested-by: Hudson
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-303 fix ofed download for bugfix releases
Brian J. Murrell [Tue, 3 May 2011 19:57:21 +0000 (15:57 -0400)]
LU-303 fix ofed download for bugfix releases

On the OFED download server both w.x.y and w.x.y.z releases are
stored in the w.x.y dir, so handle that properly for the w.x.y.z case.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I7e638571a31df215517d71e5997e7d0c6411bb90
Reviewed-on: http://review.whamcloud.com/864
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-372 add $TMP/mgsactive to indicate the active combined MGS/MDS node
Yu Jian [Fri, 27 May 2011 04:17:12 +0000 (12:17 +0800)]
LU-372 add $TMP/mgsactive to indicate the active combined MGS/MDS node

The current test-framework could not figure out the active MGS node
correctly while the MGS and MDS nodes are combined under a failover
configuration. We need add a $TMP/mgsactive file to indicate the
active MGS node like what we did for the MDS node.

In addition, "set_default_debug_nodes()" has a defect to check
whether "$nodes" contains the local node or not. The patch contains
a fix for that.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Iae49497601d09fef38968360d8543cc753009e85
Reviewed-on: http://review.whamcloud.com/871
Tested-by: Hudson
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-388 modify kernel-ib spec file for openib RPM
Brian J. Murrell [Fri, 3 Jun 2011 20:25:45 +0000 (16:25 -0400)]
LU-388 modify kernel-ib spec file for openib RPM

The kernel-ib RPM from OFED 1.5.3.1 conflicts with RHEL5's
openib package.  Consider RHEL5's userspace as canonical and
Remove the conflicting portions from the kernel-ib RPM.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I8791ffabef7fc498486ff5b5dda50f49377e8466
Reviewed-on: http://review.whamcloud.com/896
Tested-by: Hudson
Tested-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-303 fix OFED bugfix release download location
Brian J. Murrell [Tue, 3 May 2011 19:57:21 +0000 (15:57 -0400)]
LU-303 fix OFED bugfix release download location

On the OFED download server both w.x.y and w.x.y.z releases are
stored in the w.x.y dir, so handle that properly for the w.x.y.z case.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I28d63d8a64d50665e905b3f8971bccfe6bad0fe9
Reviewed-on: http://review.whamcloud.com/895
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-363 don't cache BUILD for reuse
Brian J. Murrell [Wed, 11 May 2011 13:19:56 +0000 (09:19 -0400)]
LU-363 don't cache BUILD for reuse

Since future builds don't actually need the %_topdir/BUILD subdir,
and it's huge, don't bother caching it.

Increment the toplevel BUILD_GEN to force a rebuild of all of the
kernels.

Signed-off-by: Brian J. Murrell <brian@whamcloud.com>
Change-Id: I6a7a523fdaed2073d719f44a24b556bc4595d4ec
Reviewed-on: http://review.whamcloud.com/863
Tested-by: Hudson
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-376 Positive LL_DIR_END_OFF to indicate the tail of dir hash/offset
nasf [Sat, 4 Jun 2011 14:43:36 +0000 (22:43 +0800)]
LU-376 Positive LL_DIR_END_OFF to indicate the tail of dir hash/offset

1) Keep 'MDS_DIR_END_OFF' unchanged (0xfffffffffffffffeULL) to simplify
   dir hash/offset related interoperability issues.
2) Introduce positive "LL_DIR_END_OFF" (0x7fffffffffffffffULL) on client
   to indicate the tail of dir hash/offset for up layer callers, like
   llseek(), readdir(), and so on.
3) Support 1.8 client to talk with old 2.0 server with 32bit hash.

Change-Id: I126ddb170b9ee24d1ae0610ac6343c9b0f5e4c70
Signed-off-by: nasf <yong.fan@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/887
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoBump version to 1.8.5.56 and add changelog section for 1.8.6-wc 1.8.5.56 v1_8_5_56
Johann Lombardi [Wed, 25 May 2011 21:07:21 +0000 (23:07 +0200)]
Bump version to 1.8.5.56 and add changelog section for 1.8.6-wc

Change-Id: I0f99f1abb0c7fb87f9fecc625639914075385f8a
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-196 set $PTLDEBUG, $SUBSYSTEM and $DEBUG_SIZE values on every node
Yu Jian [Tue, 24 May 2011 08:23:06 +0000 (16:23 +0800)]
LU-196 set $PTLDEBUG, $SUBSYSTEM and $DEBUG_SIZE values on every node

The current set_default_debug_nodes() could not pass the values of
$PTLDEBUG, $SUBSYSTEM and $DEBUG_SIZE to the remote nodes while they
are specified from the command line on the local node. This patch is
to fix this issue.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I85922c67e7c68a5ea3e9ba7fc1cbf6516907c285
Reviewed-on: http://review.whamcloud.com/593
Tested-by: Hudson
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-136 change "force_over_16tb" mount option to "force_over_24tb"
Yu Jian [Mon, 23 May 2011 09:41:40 +0000 (17:41 +0800)]
LU-136 change "force_over_16tb" mount option to "force_over_24tb"

Change the "force_over_16tb" mount option to "force_over_24tb" and
rename the ext4-force_over_16tb-*.patch to ext4-force_over_24tb-*.patch
after testing and validating the 24TB LUN.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Ia1731216a0c5fd2e0de4ec46c4cbd32bcd7c691d
Reviewed-on: http://review.whamcloud.com/589
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
13 years agoLU-228 Enabled ext4-based ldiskfs by default on RHEL5
yangsheng [Thu, 19 May 2011 14:35:28 +0000 (22:35 +0800)]
LU-228 Enabled ext4-based ldiskfs by default on RHEL5

Change-Id: Ic4f4a94d86091acab1a77a0cbf1d9a24c715e2c0
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/574
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
13 years agoLU-170 oscc_grow_count will never grow
Liang Zhen [Mon, 23 May 2011 04:57:03 +0000 (12:57 +0800)]
LU-170 oscc_grow_count will never grow

We are using req::rq_async_args.space[0] to store original value of
oscc_grow_count, and using req::rq_async_args.pointer_arg[0] to store
oscc, however, ptlrpc_async_args is a union, which means
req::rq_async_args.space[0] will always be overwritten by a ossc (pointer),
and osc_interpret_create will always get true on this condition
"if (diff < (int) req->rq_async_args.space[0])" and reset
oscc_grow_count to OST_MIN_PRECREATE and set OSCC_FLAG_LOW.

Because it's very unsafe to use raw scratchpad directly, I also cleaned
up all using of raw scratchpad in this patch.

Change-Id: I431a37521a41c5dfbe10ebca9efac157985add51
Signed-off-by: Liang Zhen <liang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/588
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-264 ext4 MMP update
Niu Yawei [Wed, 18 May 2011 09:44:09 +0000 (02:44 -0700)]
LU-264 ext4 MMP update

Integrate the ext4 MMP update into ldiskfs

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: Iec06c5d73c5ae426458c1141dcd38d96b1a2b7f4
Reviewed-on: http://review.whamcloud.com/561
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
13 years agoLU-337 Fix alloc flags in alloc_qinfo()
Christopher J. Morrone [Fri, 20 May 2011 02:51:29 +0000 (19:51 -0700)]
LU-337 Fix alloc flags in alloc_qinfo()

CFS_ALLOC_IO allows a hang when the alloc_qinfo() results
in a cache_alloc_refill, and kicks off the ldlm shrinker.
The shrinker may hang in sync_page() on the same page on
which we already hold the lock.

Change-Id: I3d9887ebc2909d38b4abb2e8d7715913c9c2cc40
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/582
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoLU-295 Remove 'lustre_rsync-test' from DEFAULT_SUITES
Yu Jian [Fri, 13 May 2011 04:41:26 +0000 (12:41 +0800)]
LU-295 Remove 'lustre_rsync-test' from DEFAULT_SUITES

The 'lustre_rsync-test' is not relevant (nor does it exist) to b1_8
so we should remove this test from the DEFAULT_SUITES list.

Signed-off-by: Chris Horn <hornc@cray.com>
Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I988d3124d6fae06afca013acfa94d32c6fee24d7
Reviewed-on: http://review.whamcloud.com/515
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoLU-234 OOM killer causes node hang.
yangsheng [Fri, 22 Apr 2011 21:28:44 +0000 (05:28 +0800)]
LU-234 OOM killer causes node hang.

b=18213 Handle the signal to avoid process hang.

Previous patch may cause a memleak. And also release the request when
ldlm_cli_enqueue() failed.

Signed-off-by: Yang Sheng <ys@whamcloud.com>
Change-Id: I1c22e2b2027f61af257ce031cfb7b6cbe08b8141
Reviewed-on: http://review.whamcloud.com/457
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Fan Yong <yong.fan@whamcloud.com>
13 years agoLU-216 Protect extent tree during fsfilt_ldiskfs_ext_walk_space()
Bobi Jam [Thu, 19 May 2011 12:20:53 +0000 (20:20 +0800)]
LU-216 Protect extent tree during fsfilt_ldiskfs_ext_walk_space()

Guarantee the validity of the extent path passed in
ldiskfs_ext_new_extent_cb().

Change-Id: I3f80e1e935d8ce02233cbdbf5d0ebb60dc50d8b9
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/573
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-339 use new aops for kernel >= RHEL5.4
Lai Siyao [Thu, 19 May 2011 03:25:20 +0000 (20:25 -0700)]
LU-339 use new aops for kernel >= RHEL5.4

for RHEL5 kernel, from >= 5.4 both old and new aops interface are
supported, and a flag MS_HAS_NEW_AOPS is used to mark wheather a
filesystem supports it. Enable it for lustre by default, and this
will increase single thread IO perf > 5% due to kernel
implementation.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: I8f0bfb1c4eea39275cb22c52e30310dcad41db14
Reviewed-on: http://review.whamcloud.com/570
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Yang Sheng <ys@whamcloud.com>
13 years agoLU-200 1.8.6 client supports 64-bit dir name hash under interoperability mode
nasf [Wed, 18 May 2011 06:35:02 +0000 (14:35 +0800)]
LU-200 1.8.6 client supports 64-bit dir name hash under interoperability mode

1.8.6 client supports 64-bit dir name hash under interoperability mode.

Signed-off-by: nasf <yong.fan@whamcloud.com>
Change-Id: If8130cfe809424502f40ff32dcb89deb8b82d720
Reviewed-on: http://review.whamcloud.com/410
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-216 Restore WALK_SPACE_HAS_DATA_SEM check.
Bobi Jam [Thu, 21 Apr 2011 03:16:25 +0000 (11:16 +0800)]
LU-216 Restore WALK_SPACE_HAS_DATA_SEM check.

Change-Id: Id0307a85890914a9d1695b0faa82fb89f278e1f4
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/447
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Niu Yawei <niu@whamcloud.com>
13 years agoLU-286 racer: general protection fault.
yangsheng [Fri, 6 May 2011 15:03:56 +0000 (23:03 +0800)]
LU-286 racer: general protection fault.

Fixed previous patch hasn't cleanup appropriate may cause
invalid reference.

Change-Id: Ib9b6375c9a7bc57ee5ad17da514848ce8ca87acd
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/506
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-265 Improve autogen
Bobi Jam [Wed, 4 May 2011 08:39:49 +0000 (16:39 +0800)]
LU-265 Improve autogen

Simplify autogen.sh and tell the user if an auto* command failed.

Change-Id: Ia764fedffe182dd431576eb1d047b97d6813ea7b
Signed-off-by: Bernd Schubert <bschubert@ddn.com>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/492
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoLU-296 Add missing code from auster/yaml port to b1_8
Yu Jian [Fri, 13 May 2011 04:50:54 +0000 (12:50 +0800)]
LU-296 Add missing code from auster/yaml port to b1_8

Code related to defining and creating the $TF_FAIL file was missed in
the port of auster and yaml to b1_8. This patch adds the missing
code. Namely:

- Define TF_FAIL in acceptance-small.sh
- add 'touch $TF_FAIL' to the test-framework.sh ERR signal trap

Additionally, the file test for $TF_FAIL variable should be quoted in
acceptance-small.sh and auster.sh. Otherwise, if this variable is not
defined, bash will spit out something like

acceptance-small.sh: line 123: [: too many arguments

Bash variables should generally be quoted whenever they are referenced.
(see http://tldp.org/LDP/abs/html/quotingvar.html).

Signed-off-by: Chris Horn <hornc@cray.com>
Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I2071c859d00b8cd8bd423bf9f626b44352456191
Reviewed-on: http://review.whamcloud.com/516
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Tested-by: Hudson
13 years agoLU-240 test_171() races with background multiop
Bobi Jam [Tue, 10 May 2011 02:19:07 +0000 (10:19 +0800)]
LU-240 test_171() races with background multiop

Change-Id: Ibdcc584218708bd29724f3f71804a3ebf5b1d454
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/520
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-228 kernel update to rhel5 2.6.18-238.9.1
yangsheng [Thu, 12 May 2011 06:26:57 +0000 (14:26 +0800)]
LU-228 kernel update to rhel5 2.6.18-238.9.1

Clear up the kernel support information.

Signed-off-by: Yang Sheng <ys@whamcloud.com>
Change-Id: I6b4364eb8d22629a1caee202e4b77c7f197b5b01
Reviewed-on: http://review.whamcloud.com/539
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-231 sanity_test_170: FAIL: expected 248 bad lines, but got 249
Lai Siyao [Tue, 10 May 2011 08:50:12 +0000 (01:50 -0700)]
LU-231 sanity_test_170: FAIL: expected 248 bad lines, but got 249

if the length of malformed line is less than sizeof(struct ptldebug_header),
it's not counted into bad lines if this line is at the end of log file.

Signed-off-by: Lai Siyao <laisiyao@whamcloud.com>
Change-Id: Ib2cb1a81f2b8d00c855f11d232f7643e66cebeb0
Reviewed-on: http://review.whamcloud.com/526
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-274 Update LVB from disk when glimpse callback return error
Niu Yawei [Fri, 6 May 2011 16:11:24 +0000 (09:11 -0700)]
LU-274 Update LVB from disk when glimpse callback return error

  Client ll_glimpse_callback() could fail to get inode if the inode is
  already been cleared, and this glimpse callback will fail for
  -ELDLM_NO_LOCK_DATA, so server should update LVB from disk
  (in filter_intent_policy()) when it received such error from client.

Issue:
Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I29b2fe4b35114359b0ad62106de48f5f2f696636
Reviewed-on: http://review.whamcloud.com/507
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-228 kernel update to rhel5.6.
yangsheng [Fri, 22 Apr 2011 10:35:31 +0000 (18:35 +0800)]
LU-228 kernel update to rhel5.6.

build ok on 2.6.18-238.9.1.el5.

Signed-off-by: Yang Sheng <ys@whamcloud.com>
Change-Id: Id66c5fc89b233ef59e851b78ca52f4ea2159c9d8
Reviewed-on: http://review.whamcloud.com/455
Tested-by: Hudson
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Michael MacDonald <mjmac@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-232 do not use bash variable to pass test setup state between sub-tests
Yu Jian [Tue, 26 Apr 2011 10:47:09 +0000 (18:47 +0800)]
LU-232 do not use bash variable to pass test setup state between sub-tests

Port the patch from bug 22842 attachment 30538 to b1_8 branch:
1) fix sanity tests 42, 101 and 102
2) fix PATH variable to search utilities from $LUSTRE/tests dir first

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Idb58789efc1a1a0a50b54db5cb1f6bad5b5f8daa
Reviewed-on: http://review.whamcloud.com/467
Tested-by: Hudson
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-118 Workaround for race causing assertion failure in clear_inode()
Johann Lombardi [Thu, 28 Apr 2011 18:44:59 +0000 (20:44 +0200)]
LU-118 Workaround for race causing assertion failure in clear_inode()

This patch is just a *workaround* to avoid a race found in recent
kernel causing the following assertion in clear_inode():
BUG_ON(inode->i_data.nrpages).
The race can still occur when truncate_inode_pages() & clear_inode()
are called directly by the VFS, but the problem should be harder to
reproduce.
A more complete fix is considered for 2.x.

Change-Id: If0df4b1cba00de7cf43f1b3510d54d35525c5e14
Signed-off-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/475
Tested-by: Hudson
Reviewed-by: Jinshan Xiong <jay@whamcloud.com>
Reviewed-by: Andrew Perepechko <andrew_perepechko@xyratex.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
13 years agoLU-262 port the changes of llverdev.c and llverfs.c from master to b1_8
Yu Jian [Tue, 3 May 2011 12:35:49 +0000 (20:35 +0800)]
LU-262 port the changes of llverdev.c and llverfs.c from master to b1_8

The main changes are:
bug 24017 make llverfs more robust against errors during testing
bug 20492 allow llverdev/llverfs to handle media errors better

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Ib7df0c98304d8fa56f3ad69127617147c2987b8d
Reviewed-on: http://review.whamcloud.com/487
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
13 years agoLU-235 fix sanity test 36g to work with remote OSS
Yu Jian [Thu, 28 Apr 2011 12:56:20 +0000 (20:56 +0800)]
LU-235 fix sanity test 36g to work with remote OSS

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Ia4e0b01d002783bc8d4f38e7c1e6b1ac753144d6
Reviewed-on: http://review.whamcloud.com/473
Tested-by: Hudson
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-15 slow IO with read-intense application
Wang Di [Tue, 19 Apr 2011 20:21:37 +0000 (13:21 -0700)]
LU-15 slow IO with read-intense application

Align the readahead extent by 1M after when it is trimed by ra_max_pages.

signed-off-by: Wang Di <di.wang@whamcloud.com>
Change-Id: I0359a39cef678b05e48617910081e9f27826ed22
Reviewed-on: http://review.whamcloud.com/437
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Jinshan Xiong <jay@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-202 fix the test_23 of sanity-quota.sh
Niu Yawei [Fri, 22 Apr 2011 03:20:29 +0000 (20:20 -0700)]
LU-202 fix the test_23 of sanity-quota.sh

test_23 uses a constant value(120000 = ~120M) to check if the system has
enough space to finish the test, so in the large OSTCOUNT testing
environment, the test will fail for short of disk space.

Changes of this patch are:
- Use a reasonable value to check free space instead of magic 120000;
- Specify the stripe index of test file for test_9/10 and test_23;
- Check free space over all OSTs, and select the ost which has enough
  space to do test. (test_9/10/23)

Issue:
Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I2d9059d23cf53fee0244a226622b0e9adb800599
Reviewed-on: http://review.whamcloud.com/454
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-230 fix yml_entities() to create MDS entity
Yu Jian [Thu, 28 Apr 2011 06:25:09 +0000 (14:25 +0800)]
LU-230 fix yml_entities() to create MDS entity

There is only one MDS on b1_8.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I4ab3f0ad27ab76dd77ef9cc153b932b315ea9c4d
Reviewed-on: http://review.whamcloud.com/464
Reviewed-by: Bobi Jam <bobijam@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Chris Gearing <chris@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-203 pass client mount options to zconf_mount_clients() correctly
Yu Jian [Mon, 25 Apr 2011 14:38:57 +0000 (22:38 +0800)]
LU-203 pass client mount options to zconf_mount_clients() correctly

Quote the third argument and pass it to zconf_mount_clients().

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: I86c2aea284178ca561c809f439faf9fd01d6e1c6
Reviewed-on: http://review.whamcloud.com/461
Tested-by: Hudson
Reviewed-by: Brian J. Murrell <brian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Chris Gearing <chris@whamcloud.com>
13 years agoLU-15 slow IO with read intense application
Wang Di [Wed, 20 Apr 2011 20:53:32 +0000 (13:53 -0700)]
LU-15 slow IO with read intense application

Shrink file_max_cache_size to alleviate the memory pressure of OST.

Change-Id: I6dc26ea88f8fc28bcbc94cf7d1e6f2bdfc866ea7
signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/445
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
13 years agoLU-15 Strange slow IO messages and bad performance
yangsheng [Wed, 20 Apr 2011 06:45:51 +0000 (14:45 +0800)]
LU-15 Strange slow IO messages and bad performance

b=24183 slow I/O on new files via mballoc.

upstream patch to avoid loading bitmaps from full groups

i=wangdi
i=johann

Change-Id: If44d996f8aa6268bf9e4afd2b1dbfdd8f4460a8c
Signed-off-by: Yang Sheng <ys@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/441
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-123 Port yaml and auster to b1_8
root [Tue, 21 Dec 2010 14:00:06 +0000 (14:00 +0000)]
LU-123 Port yaml and auster to b1_8

Changes to add the yaml data logging from the 2.0 branch in the 1.8 branch, this
patch was created by applying the 2.0 yml patch to 1.8 and then resolving the issues.

This is to say that the larger changes have been taken to be correct because of their
acceptance in the 2.0 master.

This patch also contains the addition of the auster.sh script which allows for the logging
of test results to the maloo database. The actual logging is carried out by the
maloo_upload.sh script.

For instructions on how to use auster use auster -?, for instructions on maloo refer to
the whamcloud wiki [where I will begin to place a resource of information!]

Change-Id: I602a3534f17544d857aa0a9f9f82d2873fb73a39
Signed-off-by: Chris Gearing <chris@whamcloud.com>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/421
Tested-by: Hudson
Reviewed-by: Yu Jian <yujian@whamcloud.com>
Reviewed-by: Johann Lombardi <johann@whamcloud.com>
13 years agoLU-179 Should let PF_MEMALLOC cover ptlrpc_register_bulk()
Bobi Jam [Wed, 20 Apr 2011 04:14:41 +0000 (12:14 +0800)]
LU-179 Should let PF_MEMALLOC cover ptlrpc_register_bulk()

Under memory pressure, the rpc memory allocation in bulk registration on the memory
release path also needs be covered.

Change-Id: Ie4986eb48d1e5b99b1756a0ddaa11fe0beb37462
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/439
Reviewed-by: Liang Zhen <liang@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann@whamcloud.com>