Whamcloud - gitweb
fs/lustre-release.git
7 years agoLU-2709 build: fix 'memory corruption' errors
Sebastien Buisson [Wed, 30 Jan 2013 14:55:47 +0000 (15:55 +0100)]
LU-2709 build: fix 'memory corruption' errors

Fix 'memory corruption' defects found by Coverity version 6.5.0:
Out-of-bounds access (OVERRUN_STATIC)
Overrunning static array by passing it to a
function which indexes it at a higher byte position.
Unbounded source buffer (STRING_SIZE)
Passing string of unknown size to a function that expects
a string of a particular size.

Signed-off-by: Sebastien Buisson <sebastien.buisson@bull.net>
Change-Id: Iabc9bd7609d285a3709737748f2100b90769d795
Reviewed-on: http://review.whamcloud.com/5210
Tested-by: Hudson
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1897 test: replay-single test_70b dbench not found
Keith Mannthey [Mon, 21 Jan 2013 18:02:07 +0000 (10:02 -0800)]
LU-1897 test: replay-single test_70b dbench not found

dbench is exiting before test_70b completes is work.

dbench is being used as a background load in this test.
In one observed case test was taking a little under 90s but
dbench was exiting at 62s. Duration was set at 90.

Presently dbench starts for 60s then the system sleeps
for 12s, then we start a new 60s timer in which we expect
dbench to be running.  There is a large window in which
this test will fail.

The main issue is the use of Duration for use as both the
timer of the real test and the timer of the background load.

I raised the real Duration and started the timer for the real
test before starting dbench such that the real test should
finish before dbench does or about the same time.

Signed-off-by: Keith Mannthey <keith.mannthey@intel.com>
Change-Id: Iba243fe3132a5fa677e5a7bcd09e491727ba092a
Reviewed-on: http://review.whamcloud.com/4973
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Hudson
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2101 clio: cl_sync_io_wait() need a barrier
Liang Zhen [Sun, 7 Oct 2012 17:05:44 +0000 (01:05 +0800)]
LU-2101 clio: cl_sync_io_wait() need a barrier

cl_sync_io_note() has a small window between cfs_atomic_dec_and_test
and cfs_waitq_broadcast, another thread might have destroyed anchor
between this window, then cl_sync_io_note() is calling wakeup on a
poisoned waitq and crash.

Signed-off-by: Liang Zhen <liang.zhen@intel.com>
Change-Id: I04bfc738c8c5bec3a1e8b51131fae4199ef5ec9a
Reviewed-on: http://review.whamcloud.com/5199
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Hudson
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2010 tests: replay-single/44a,b,45 find only tested mdc
Nathaniel Clark [Fri, 30 Nov 2012 16:50:55 +0000 (11:50 -0500)]
LU-2010 tests: replay-single/44a,b,45 find only tested mdc

If multiple filesystems are mounted, then test_45 would have found
mdcdevs for each filesystem.  This corrects that to only look for the
filesystem that is being tested against.

Also correctly delete old test files.

Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: I0297cf9b21e9c97ee468cd81d5d4ac409c59d1e0
Reviewed-on: http://review.whamcloud.com/4724
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2576 osc: various fix in osc_enter_cache()
Niu Yawei [Sun, 6 Jan 2013 08:21:03 +0000 (03:21 -0500)]
LU-2576 osc: various fix in osc_enter_cache()

- It should not go to sleep if there isn't any inflight write
  RPC, otherwise, it could not be waked up for a long time,
  until dirty flush triggered on other OSCs or other objects.

- If the page can't be granted due to too many dirty pages
  (> obd_max_dirty_pages), osc_enter_cache() should return
  -EDQUOT.

- It should pass NULL osc object to  osc_io_unplug(), otherwise
  dirty flush can't be triggered if the passed object is
  clean.

- It should not wait in a loop of "while (cli->cl_dirty > 0)",
  trigger the dirty flush once is enough. If there are too
  many threads that consumed grants immediately, then we
  should turn to sync write, but not trigger flush and wait
  for grant again (that'll block io process on grant).

- Refuse setting max_dirty_mb as 0 via proc file.

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: I449cba07bd427749ab023c249d9e200aba1b406a
Reviewed-on: http://review.whamcloud.com/4963
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2663 tests: don't remove objects by debugfs
Niu Yawei [Mon, 28 Jan 2013 09:19:57 +0000 (04:19 -0500)]
LU-2663 tests: don't remove objects by debugfs

In lfsck.sh, we shouldn't use debugfs to remove objects, that'll
cause quota usage inconsistence warning in e2fsck.

Fix improper LBUG() in mdd_create_data(), MDS_OPEN_HAS_OBJS is
still used by lfsck.

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: I93c6f5c40e359d0d8402868be548088d6e2ac5da
Reviewed-on: http://review.whamcloud.com/5186
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Emoly Liu <emoly.liu@intel.com>
Tested-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2640 osd: enhance transaction debug to trace rollback
Fan Yong [Thu, 10 Jan 2013 15:17:38 +0000 (23:17 +0800)]
LU-2640 osd: enhance transaction debug to trace rollback

Some modifications may need to rollback because of failures during
the transactions. The original transaction trace mechanism did not
consider rollback cases, so cannot correctly record sub-operations
and the rollback cases.

In this patch, not only the specified sub-operation will be traced,
but also its rollback operation (if may rollback) will be recorded
also. For example:

When declare for ref_add, it will record the ref_add sub-operation
by "osd_thandle::ot_declare_ops[OSD_OT_REF_ADD]"; when consume the
ref_add credit, the possible rollback will be recorded through the
"osd_thandle::ot_declare_ops_rb[OSD_OT_REF_ADD]"; and when need to
rollback the ref_add (by ref_del) in subsequent processing, it can
be traced by the "osd_thandle::ot_declare_ops_rb[OSD_OT_REF_ADD]";
and once rollback starts, only "osd_thandle::ot_declare_ops_rb[X]"
can be consumed.

Signed-off-by: Fan Yong <fan.yong@intel.com>
Change-Id: Iade214eff468c2298f84920b997040e06f1a204f
Reviewed-on: http://review.whamcloud.com/5138
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2061 hsm: send HSM resquest to CDT
jcl [Thu, 10 Jan 2013 17:42:12 +0000 (18:42 +0100)]
LU-2061 hsm: send HSM resquest to CDT

This patch implements the user interface to ask for hsm requests

It implements:
- lfs hsm_archive
- lfs hsm_restore
- lfs hsm_cancel
- lfs hsm_remove
- lfs hsm_release

The matching llapi call:
- llapi_hsm_user_request_alloc()
- llapi_hsm_request()

related MDS functions:
- mdt_hsm_request()

and the MDS RPC:
- MDS_HSM_REQUEST

Signed-off-by: JC Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Change-Id: I635f6e0518ec12c359dbb528c3a61216650d952d
Reviewed-on: http://review.whamcloud.com/5030
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2061 hsm: get list of HSM actions
Aurelien Degremont [Wed, 18 Apr 2012 15:05:59 +0000 (17:05 +0200)]
LU-2061 hsm: get list of HSM actions

This patch implements a MDS RPC to get
the list of registered and running hsm actions on files

It implements:
- lfs hsm_action

The matching llapi call:
- llapi_hsm_current_action()

The matching MDS function:
- mdt_hsm_action()

and MDS RPC:
- MDS_HSM_ACTION

Signed-off-by: JC Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Change-Id: If4b00949ca8c94c8572cc81a7f7b8db32914542c
Reviewed-on: http://review.whamcloud.com/5029
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-1338 hsm: HSM flags feature
Aurelien Degremont [Mon, 14 Jan 2013 22:43:54 +0000 (23:43 +0100)]
LU-1338 hsm: HSM flags feature

This extends lustre_hsm_attrs struct in MDD to store HSM per-file
information. It adds infrastructure (function, RPCs, ...) to read and
modify it, from MDT code or from user-space on clients through llapi
and lfs command.

This patch implements:
- lfs hsm_state
- lfs hsm_set
- lfs hsm_clear

matching llapi functions:
- llapi_hsm_state_get()
- llapi_hsm_state_set()

matching mdt functions:
- mdt_hsm_state_get()
- mdt_hsm_state_set()

and MDS RPC:
- MDS_HSM_STATE_GET
- MDS_HSM_STATE_SET

Signed-off-by: Aurelien Degremont <aurelien.degremont@cea.fr>
Signed-off-by: JC Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Change-Id: Ic8f82ddc9a56206307c2e5be2523fb7ce42b8638
Reviewed-on: http://review.whamcloud.com/3035
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2638 ldiskfs: update dotdot entry for rename
Fan Yong [Thu, 10 Jan 2013 13:32:57 +0000 (21:32 +0800)]
LU-2638 ldiskfs: update dotdot entry for rename

On master, when rename a directory, its old dotdot entry will
be removed firstly, then insert the new dotdot entry, and try
to append FID-in-dirent. But the space for dotdot entry maybe
not enough to hold the new dotdot with FID-in-dirent, such as
the MDT device restored from file-level backup, or the device
is upgraded from 1.8. If we do not move data in the directory
block, the FID-in-dirent will overwrite the dx_root and cause
the directory crashed. Currently, we do not want to introduce
complex logic to handle directory data moving, instead, under
such case, ignore the FID-in-dirent for the new dotdot entry,
and just insert the new dotdot entry.

Signed-off-by: Fan Yong <fan.yong@intel.com>
Change-Id: Id38f5136fb2bc607344c37ca10a32e63ab427e3d
Reviewed-on: http://review.whamcloud.com/5179
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-1187 lod: move seq client init from MDT to LOD
wangdi [Wed, 2 Oct 2013 11:40:56 +0000 (04:40 -0700)]
LU-1187 lod: move seq client init from MDT to LOD

Move seq client init from MDT to LOD, so to unify
config log for adding OSP and MD OSP.

Change-Id: I93f91c0dd6f3568196a99eecf422e0b409abda31
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/4337
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-1187 lod: Add remote object for DNE
wangdi [Tue, 1 Oct 2013 11:13:00 +0000 (04:13 -0700)]
LU-1187 lod: Add remote object for DNE

LOD will do FLD lookup to check whether the object
is for OST or remote MDT object.

Because there are remote object invlove, it might
return some error other than ENOMEM for object allocation.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Ie226b3c475524fc7e705665c6200e4c66d50acf0
Reviewed-on: http://review.whamcloud.com/4924
Tested-by: Hudson
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2062 hsm: llapi hsm calls for CopyTool
jcl [Mon, 3 Dec 2012 20:13:13 +0000 (21:13 +0100)]
LU-2062 hsm: llapi hsm calls for CopyTool

llapi hsm calls for CopyTool
- llapi_hsm_copytool_start()
- llapi_hsm_copytool_fini()
- llapi_hsm_copytool_recv()
- llapi_hsm_copytool_free()
- llapi_hsm_copy_start()
- llapi_hsm_copy_end()
- llapi_hsm_progress()
- llapi_hsm_import()

and related MDT functions
- mdt_hsm_ct_register()
- mdt_hsm_ct_unregister()
- mdt_hsm_progress()

The new RPC are:
- MDS_HSM_CT_REGISTER
- MDS_HSM_CT_UNREGISTER
- MDS_HSM_PROGRESS

Signed-off-by: JC Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Change-Id: I93617ac6e66a3324344b57f1a22d7c851d715262
Reviewed-on: http://review.whamcloud.com/4736
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoNew tag 2.3.60 2.3.60 v2_3_60 v2_3_60_0
Oleg Drokin [Wed, 30 Jan 2013 18:53:09 +0000 (13:53 -0500)]
New tag 2.3.60

Also another can kicking for LU-2449, hopefully last this time.

Change-Id: I1455e48f1b557bc8787ef234e1894b0f9d7f4843
Signed-off-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2183 osp: cleanup osp-on-ost
wangdi [Wed, 9 Oct 2013 02:56:07 +0000 (19:56 -0700)]
LU-2183 osp: cleanup osp-on-ost

With new quota design and FIDonOST introduced, a new connection
from OST/MDTn to MDT0 is required for sending quota and sequence
RPCs. This connection was implemented by adding a new special
osp device named osp-on-ost, which introduced complexity to osp
code, and many hacks of checking the osp device name in both
client and server side code.

In this patch, we removed the osp-on-ost, and introduced a new
device type lwp (Light Weight Proxy) to manage the light weight
connection established from OSTs/MDTs to MDT0.

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Change-Id: Ic1ba25f941a4f971a542dc4be8a81e28ee0f477b
Reviewed-on: http://review.whamcloud.com/4923
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-398 ptlrpc: Add the NRS framework and FIFO policy
Nikitas Angelinas [Wed, 20 Jun 2012 09:31:16 +0000 (10:31 +0100)]
LU-398 ptlrpc: Add the NRS framework and FIFO policy

The Network Request Scheduler (NRS) allows a user to control the way
in which RPCs are dispatched from PTLRPC services. This can be used to
various effects, most importantly improved fairness across the
cluster, better I/O performance under certain workloads, and allowing
for QoS semantics to be used at the filesystem level. Central to the
operation of NRS are NRS policies, each of which implements handling
of RPCs in a different way, aiming to achieve a particular goal.

This patch adds the core NRS framework and the NRS FIFO policy, which
is a logical wrapper around previous, non-NRS functionality, and is
used as the default policy for handling all types of RPCs.

Signed-off-by: Nikitas Angelinas <nikitas_angelinas@xyratex.com>
Co-authored-by: Liang Zhen <liang@whamcloud.com>
Change-Id: I7fcd7885cc89b653d9bc482da533aae2f129bdf9
Oracle-bug-id: b=13634
Xyratex-bug-id: MRP-73
Reviewed-on: http://review.whamcloud.com/4411
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Liang Zhen <liang.zhen@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2441 mdd: Implement volatile file
jcl [Mon, 17 Dec 2012 00:55:30 +0000 (01:55 +0100)]
LU-2441 mdd: Implement volatile file

Add a way to create files which are created unlinked, so
they are automatically removed at last close

User interface is:
- llapi_create_volatile_idx()
- llapi_create_volatile()

Signed-off-by: JC Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Change-Id: Ia33a6832d31b83191e4d364da4350cedbe6eef39
Reviewed-on: http://review.whamcloud.com/4836
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
7 years agoLU-1187 tests: chmod +x for dir_remote.sh
wangdi [Mon, 28 Oct 2013 08:30:12 +0000 (01:30 -0700)]
LU-1187 tests: chmod +x for dir_remote.sh

chmod +x for dir_remote.sh

Signed-off-by: wang di <di.wang@whamcloud.com>
Change-Id: I77d670594c128d4f18903bd247a49df7f8ead970
Reviewed-on: http://review.whamcloud.com/4997
Tested-by: Hudson
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1876 hsm: account for active IOs correctly
Jinshan Xiong [Wed, 23 Jan 2013 07:32:24 +0000 (23:32 -0800)]
LU-1876 hsm: account for active IOs correctly

We used to use refcount of lsm to account for active IOs but this
turns out wrong because empty layout files don't have a lsm.

In this patch, lov_object::lo_active_ios is invented to account for
active IOs for both raid0 and empty layout;

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: I1b7aa16367af1d0a54f6c70bb4155b20071af225
Reviewed-on: http://review.whamcloud.com/5157
Tested-by: Hudson
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1187 tests: add cleanup for sanity 24q.
wangdi [Mon, 12 Nov 2012 22:30:58 +0000 (14:30 -0800)]
LU-1187 tests: add cleanup for sanity 24q.

Add trap cleanup for sanity 24q.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Ie8b096cd9906d07812d743cdccdf619b977aaed6
Reviewed-on: http://review.whamcloud.com/4521
Tested-by: Hudson
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-1187 mdt: return lock to client for remote dir.
wangdi [Fri, 1 Nov 2013 12:20:10 +0000 (05:20 -0700)]
LU-1187 mdt: return lock to client for remote dir.

In mdt_reint_open, MDT should return LOOKUP inodebit lock for
remote directory.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Iaa7c6a13b71b627c5792f4b28bb3c5520b2132e5
Reviewed-on: http://review.whamcloud.com/5026
Tested-by: Hudson
Reviewed-by: Jinshan Xiong <jinshan.xiong@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1445 ost: enable fid on OST support on OST
wangdi [Thu, 26 Sep 2013 11:57:13 +0000 (04:57 -0700)]
LU-1445 ost: enable fid on OST support on OST

Enable fid on OST support on OST.

Signed-off-by: Wang Di <di.wang@intel.com>
Change-Id: I51c242e7630d52c578f4ddfe1149b43eb9d5f7c5
Reviewed-on: http://review.whamcloud.com/4791
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-1506 ldlm: correct lock res build for FID on OST
wangdi [Thu, 26 Sep 2013 13:16:26 +0000 (06:16 -0700)]
LU-1506 ldlm: correct lock res build for FID on OST

Because 1.8/2.1/2.2 client always put oid to res[0] and
oseq to res[1], OFD will do the same to avoid incompatible
problems.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Ic4cf66b1bc23631af42530787796510653f82a61
Reviewed-on: http://review.whamcloud.com/3081
Tested-by: Hudson
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-1445 mdt: allow lightweight connection even if no OST
wangdi [Sat, 5 Oct 2013 14:33:55 +0000 (07:33 -0700)]
LU-1445 mdt: allow lightweight connection even if no OST

MDT should allow lightweight connection from OST even if there
is no OST being activated, because OST might need do FLD lookup
during recovery phase.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Ica44aafdbcbf29f10d314bc65de8c1f5ff5d2940
Reviewed-on: http://review.whamcloud.com/4920
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
7 years agoLU-1445 fld: allow fld lookup during recovery
wangdi [Fri, 4 Oct 2013 11:47:25 +0000 (04:47 -0700)]
LU-1445 fld: allow fld lookup during recovery

Allow fld lookup during recovery process, so OST can send fld
lookup req to MDT0 during recovery phase, instead of waiting
the recovery is done.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I69990eb4225d98f20ce2dc197cd3c16b5c6f9617
Reviewed-on: http://review.whamcloud.com/4919
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-1445 osd: Add multiple sequence support for osd-zfs
wangdi [Tue, 1 Oct 2013 03:16:27 +0000 (20:16 -0700)]
LU-1445 osd: Add multiple sequence support for osd-zfs

Add osd_seq_list for osd-zfs, then it can allocate new sequence
after FID on OST is landed.

Test-Parameters: mdtfilesystemtype=zfs ostfilesystemtype=zfs
Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I66bae3987a1ae167aa48a3a1d4b6e50f300f1dd8
Reviewed-on: http://review.whamcloud.com/4837
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
7 years agoLU-1445 osd: add fld look up in osd.
wangdi [Thu, 26 Sep 2013 11:48:51 +0000 (04:48 -0700)]
LU-1445 osd: add fld look up in osd.

Lookup FLDB during oi_insert, so we know it is MDT or
OST objects. And it also needs to init FLD service
on OFD as well, so object on OST can lookup FLDB
as well.

Change fci_lock to read/write lock, since fld_cache_lookup
will become the hot path after FLD lookup is added in OSD
layer.

Change-Id: I79ef723de603214b7136a51c36f0cb63513b5640
Signed-off-by: Wang Di <di.wang@intel.com>
Reviewed-on: http://review.whamcloud.com/4330
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-1445 osp: rollover to the new seq synchronously
wangdi [Thu, 26 Sep 2013 09:57:55 +0000 (02:57 -0700)]
LU-1445 osp: rollover to the new seq synchronously

For simplicity, OSP will track only one sequence for precreation,
so it will need

1. Stop precreation when the current sequence is about to used up,
until all of the precreation objects has been used up.

2. ofd will precreate objects synchronously when the current sequence
is about to used up.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I4c0de8f2869c9a8e7a4b0d2abe06041e84885b2e
Reviewed-on: http://review.whamcloud.com/4790
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-1445 osp: Use FID to track precreate cache.
wangdi [Thu, 26 Sep 2013 02:24:17 +0000 (19:24 -0700)]
LU-1445 osp: Use FID to track precreate cache.

Change last_used/pre_used/pre_created_id to real fid, so
to track precreate cache with real fid.

For simplicity, precreate/orphan_cleanup between osp and
OFD must be within the same sequence.

Precreate process will be:

1. OSP will request one sequence from OST initially.

2. During precreation, osp will allocate a group of fids
for the precreation request within the current sequence,
then send the request to OST(OFD) with these fids.

3. When getting the precreate request, OST will precreate
the objects by those fids in the request.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: Ib7f1016321c064656158c54f4475922a199e19b3
Reviewed-on: http://review.whamcloud.com/4789
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-2674 osp: set proper connection flag
Niu Yawei [Fri, 25 Jan 2013 04:05:30 +0000 (23:05 -0500)]
LU-2674 osp: set proper connection flag

Set proper connection flag for the osp-on-ost.

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: Idf80df593f22309565c92630f5c04fc3781e3d34
Reviewed-on: http://review.whamcloud.com/5167
Reviewed-by: wangdi <di.wang@intel.com>
Reviewed-by: Doug Oucharek <doug.s.oucharek@intel.com>
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2561 mdd: create decares attr set with parent attr
Lai Siyao [Wed, 12 Dec 2012 05:20:33 +0000 (13:20 +0800)]
LU-2561 mdd: create decares attr set with parent attr

mdd_declare_create() mistakenly declares attr set for child with
parent attr, as will cause truncate operation.

Signed-off-by: Lai Siyao <lai.siyao@intel.com>
Change-Id: I79dbbb2b52e1d41aaa70c36ce6c197ab2cd684d8
Reviewed-on: http://review.whamcloud.com/4956
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Tested-by: Hudson
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2555 ldiskfs: fix ext4_mb_add_n_trim()
Niu Yawei [Sun, 6 Jan 2013 05:16:36 +0000 (00:16 -0500)]
LU-2555 ldiskfs: fix ext4_mb_add_n_trim()

In ext4_mb_add_n_trim(), lg_prealloc_lock should be taken
when changing the lg_prealloc_list.

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: Icc62d87a682b0ebf70ad12e148a52b864bf1fdb8
Reviewed-on: http://review.whamcloud.com/4961
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Tested-by: Hudson
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2550 osc: set resend count properly
Niu Yawei [Mon, 14 Jan 2013 04:01:30 +0000 (23:01 -0500)]
LU-2550 osc: set resend count properly

The resend count of new io request should be set properly
in osc_brw_redo_request().

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: Ifce58cf45ae3bfa3b73427f732e281b468cf982b
Reviewed-on: http://review.whamcloud.com/5012
Tested-by: Hudson
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2517 kernel: Kernel update [RHEL6.3 2.6.32-279.19.1.el6]
yangsheng [Wed, 9 Jan 2013 08:32:14 +0000 (16:32 +0800)]
LU-2517 kernel: Kernel update [RHEL6.3 2.6.32-279.19.1.el6]

Update RHEL6.3 kernel to 2.6.32-279.19.1.el6.

Signed-off-by: yang sheng <ys@whamcloud.com>
Change-Id: I1e89c76d4ec0cc736a0e479a465e59e2262522c0
Reviewed-on: http://review.whamcloud.com/4980
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1486 tests: fix sanityn test_45g() to add error check
Yu Jian [Thu, 30 Aug 2012 06:50:10 +0000 (14:50 +0800)]
LU-1486 tests: fix sanityn test_45g() to add error check

This patch fixes sanityn test_45g() to add error check for
"stat must fail".

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Iff65f2684244ab58e0d0cab68db0795f5604187e
Reviewed-on: http://review.whamcloud.com/3826
Tested-by: Hudson
Reviewed-by: Wei Liu <wei3.liu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Minh Diep <minh.diep@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-661 tests: don't check file-2 in replay-dual 0b
Mikhail Pershin [Tue, 22 Nov 2011 06:59:26 +0000 (10:59 +0400)]
LU-661 tests: don't check file-2 in replay-dual 0b

It is uncertain was it replayed on not yet, so it might exist
and test will fail. Remove wrong check from test

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: I724f389f0504f3c8c388b2b271b3a64cb61339ab
Reviewed-on: http://review.whamcloud.com/4999
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
7 years agoLU-2416 test: Some test using wrong lctl params
James Simmons [Mon, 7 Jan 2013 17:55:42 +0000 (12:55 -0500)]
LU-2416 test: Some test using wrong lctl params

With the move of obdfilter to ofd some of the lctl
parameters got moved around. For the test suite a function
{get,set}_obdfilter_param was written to handle this change so
this patch updates a few more test to use this api.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Change-Id: I05ca4711b198061de1378b79d2f7f35d5a1c75af
Reviewed-on: http://review.whamcloud.com/4726
Reviewed-by: Li Wei <wei.g.li@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2158 fsfilt: Remove bits from fsfilt_ext3.c/lustre_fsfilt.h
Prakash Surya [Tue, 18 Dec 2012 22:15:38 +0000 (14:15 -0800)]
LU-2158 fsfilt: Remove bits from fsfilt_ext3.c/lustre_fsfilt.h

The only remaining dependency needed from the fsfilt_ext3.c for use in
osd-ldiskfs is the fsfilt_ext3_map_inode_pages function. Thus much of
the fsfilt_ext3.c contents have been removed by this commit because
they are no longer used.

Also, since much of the fsfilt_operations structure is not used anymore,
that structure was trimmed to the bare essentials needed by the
osd-ldiskfs layer. The related inline helper functions were also removed.

Change-Id: Ie0f7d428d15862b1b17df140b7152cb0b56ce3be
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4863
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2158 lvfs: Remove cruft from lvfs_linux.h
Prakash Surya [Wed, 19 Oct 2011 19:01:08 +0000 (12:01 -0700)]
LU-2158 lvfs: Remove cruft from lvfs_linux.h

Various bits from the lvfs_linux.h file were removed as they are no
longer used. Specifically, the following was removed:

 * l_inode
 * lvfs_sbdev_sync
 * lvfs_set_rdonly
 * lvfs_clear_rdonly
 * lvfs_dentry_params

Change-Id: I993a1416bb548746ca717904a483c0cd6245768e
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4862
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
7 years agoLU-2158 lvfs: Remove ll_sleep from linux/lvfs.h
Prakash Surya [Wed, 19 Oct 2011 17:55:37 +0000 (10:55 -0700)]
LU-2158 lvfs: Remove ll_sleep from linux/lvfs.h

The ll_sleep function was removed because it is not used anywhere.

Change-Id: Ic22552c69635f3da5b2cdd3dd67b9930d63a48d1
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4861
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
7 years agoLU-2158 lvfs: Remove ll_fid2str from lvfs.h
Prakash Surya [Wed, 19 Oct 2011 17:47:41 +0000 (10:47 -0700)]
LU-2158 lvfs: Remove ll_fid2str from lvfs.h

The ll_fid2str function was removed because it is not used anywhere.

Change-Id: I7e16b3d5e2fa10af0d5763909a42871a8c86a3ff
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4860
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
7 years agoLU-2618 test: recovery-small test_24b dumps dmesg
Kyrylo Shatskyy [Tue, 15 Jan 2013 22:22:45 +0000 (00:22 +0200)]
LU-2618 test: recovery-small test_24b dumps dmesg

Redirected output of 'dmesg -c' to null device

Signed-off-by: Kyrylo Shatskyy <kyrylo_shatskyy@xyratex.com>
Change-Id: I6b06122e4c9600aac6da476f7083c1e051d92c98
Reviewed-on: http://review.whamcloud.com/5033
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2590 lod: magic changed after swab
Bobi Jam [Fri, 11 Jan 2013 04:08:30 +0000 (12:08 +0800)]
LU-2590 lod: magic changed after swab

In lod_qos_parse_config(), the stack magic variable should be changed
to native endianness as well.

Signed-off-by: Bobi Jam <bobijam.xu@intel.com>
Change-Id: I940c40f20f1ec55d7b55eeffe8d61404a1badfdb
Reviewed-on: http://review.whamcloud.com/4996
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
7 years agoLU-2558 test: recovery-small 19a FAIL no eviction
yangsheng [Thu, 10 Jan 2013 13:15:39 +0000 (21:15 +0800)]
LU-2558 test: recovery-small 19a FAIL no eviction

Use stat instead of mcreate since latter cannot
ensure enqueue a lock.

Signed-off-by: yang sheng <ys@whamcloud.com>
Change-Id: Ifb63f679305e707df64457c4de599ca1b5fb0f00
Reviewed-on: http://review.whamcloud.com/4987
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Hudson
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1270 utils: properly initialize traverse param
James Simmons [Wed, 12 Dec 2012 15:57:41 +0000 (10:57 -0500)]
LU-1270 utils: properly initialize traverse param

The find_param::mdtindex intialization was neglected.

Signed-off-by: James Simmons <uja.ornl@gmail.com>
Signed-off-by: Bobi Jam <bobijam@whamcloud.com>
Change-Id: I3018c346a4bbab0d7da7c7efdeeb201098ac1e53
Reviewed-on: http://review.whamcloud.com/2411
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2309 config: ignore unknown configuration param
Jian Yu [Wed, 16 Jan 2013 06:37:35 +0000 (14:37 +0800)]
LU-2309 config: ignore unknown configuration param

Client or server should not fail to mount if it hits
a configuration parameter that it doesn't understand.
This patch fixes class_process_config() to meet
the above requirement.

The patch also improves conf-sanity test 42 to verify
that invalid sys config param should not prevent client
or server from mounting.

Signed-off-by: Jian Yu <jian.yu@intel.com>
Change-Id: I33a6eb3c2beb3dd7425a097e8e7b5a2766852a96
Reviewed-on: http://review.whamcloud.com/5037
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Lai Siyao <lai.siyao@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2336 llog: hide the harmless log message
Hongchao Zhang [Sun, 13 Jan 2013 13:15:49 +0000 (21:15 +0800)]
LU-2336 llog: hide the harmless log message

in llog_cat_add_rec, the llog_write_rec could return -ENOSPC
if the current log is full, and it will move to the next log
file, then it should not be treated as an error.

Change-Id: Ie2e203dc01572e170e9a383c63dcc670db093355
Signed-off-by: Hongchao Zhang <hongchao.zhang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/5146
Tested-by: Hudson
Reviewed-by: Prakash Surya <surya1@llnl.gov>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2158 lvfs: Remove functions from lvfs_linux.c
Prakash Surya [Tue, 18 Dec 2012 21:19:02 +0000 (13:19 -0800)]
LU-2158 lvfs: Remove functions from lvfs_linux.c

The following functions were removed from the lvfs_linux.c file as they
are no longer used:

 * simple_mknod
 * lustre_fread
 * lustre_fwrite
 * lustre_fsync
 * l_filldir
 * l_readdir
 * l_notify_change
 * simple_truncate
 * lvfs_check_io_health

Change-Id: I6684815c85e87974277295e6906fd6d7c8dfe1be
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4859
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2644 build: fix 'resource leak' errors
Sebastien Buisson [Fri, 18 Jan 2013 15:00:40 +0000 (16:00 +0100)]
LU-2644 build: fix 'resource leak' errors

Fix 'resource leak' defects found by Coverity version 6.0.3:
Resource leak (RESOURCE_LEAK)
Variable going out of scope leaks the storage it points to.

Signed-off-by: Sebastien Buisson <sebastien.buisson@bull.net>
Change-Id: I9fae1905848a83393b7258449bfafd1fc0a342a7
Reviewed-on: http://review.whamcloud.com/5131
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-744 clio: save memory allocations for cl_page
Jinshan Xiong [Thu, 20 Dec 2012 02:07:45 +0000 (18:07 -0800)]
LU-744 clio: save memory allocations for cl_page

It used to allocate 6 piece of memory to create a page:
 - top cl_page, llite & lov page slice;
 - subpage, lovsub_page & osc_page.

This patch will allocate top cl_page, llite and lov page slice in
the same piece of memory, similar to sub pages, so that only 2
memory allocations will be needed for each page.

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: I1c4dd0541bda23e7d739131f73bcd895b8dd2c13
Reviewed-on: http://review.whamcloud.com/4943
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-1199 build: Assume that ldiskfs PDO is now standard
Christopher J. Morrone [Fri, 11 Jan 2013 23:35:00 +0000 (15:35 -0800)]
LU-1199 build: Assume that ldiskfs PDO is now standard

PDO (Parallel Directory Operations) is now a standard ldiskfs feature.
The old patch series files that lacked PDO support have been removed
from the tree, so now we can drop all of the places that conditionally
use PDO, and just assume that PDO is standard.

Also remove support for rhel5 series file in ldiskfs, since that
no longer exists in the tree.

Change-Id: I76b5b31a4614c1ade3b4b5890a111cdabc4afa63
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/5004
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Liang Zhen <liang.zhen@intel.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
7 years agoLU-1095 debug: Quiet/cleanup various common console messages
Brian Behlendorf [Fri, 19 Feb 2010 22:39:40 +0000 (14:39 -0800)]
LU-1095 debug: Quiet/cleanup various common console messages

Turn off several common message we always observe when restarting
servers assuming they are for the expected return code.  Simply
move others which are not helpful to an administrator to the
internal debug kernel log.  Less noise means you are more likely
to spot the important error messages.

Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: I523eacfe3c72480d62c915537427aa6c99428647
Reviewed-on: http://review.whamcloud.com/2201
Tested-by: Hudson
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1199 build: Remove autoMakefile.am.toplevel
Christopher J. Morrone [Tue, 18 Dec 2012 19:31:28 +0000 (11:31 -0800)]
LU-1199 build: Remove autoMakefile.am.toplevel

Now that ldiskfs no longer shares lustre's build system,
there is no need for the added complication of
the autoMakefile.am.toplevel file.  We move its contents
into the actual top level autoMakefile.am file.

Change-Id: Ie2787465f1b60146dd44c2e4564e236782de1afa
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4975
Tested-by: Hudson
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Minh Diep <minh.diep@intel.com>
7 years agoLU-2361 quota: quiet warning when acct isn't enabled
Johann Lombardi [Tue, 8 Jan 2013 09:34:32 +0000 (10:34 +0100)]
LU-2361 quota: quiet warning when acct isn't enabled

Don't print a warning to the console on every mount when space
accounting is disabled.

Signed-off-by: Johann Lombardi <johann.lombardi@intel.com>
Change-Id: I7e1855c21f509b755c0452824eefe1084a1c33f1
Reviewed-on: http://review.whamcloud.com/4968
Tested-by: Hudson
Reviewed-by: Niu Yawei <yawei.niu@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-1199 build: Simplify autotools version checks
Christopher J. Morrone [Wed, 28 Nov 2012 04:55:57 +0000 (20:55 -0800)]
LU-1199 build: Simplify autotools version checks

Simplify the check for minumum autoconf and automake
versions by using standard macros in configure.ac
rather than using shell functions in autogen.sh.

Note that I am bumping the minimum automake version
from 1.9 to 1.10.

Change-Id: I009c316a54d8d517abea0d1808dc244e2353b2aa
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4693
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Brian J. Murrell <brian.murrell@intel.com>
Reviewed-by: Minh Diep <minh.diep@intel.com>
7 years agoLU-2602 tests: add missing bug number to error_ignore call
Bob Glossman [Fri, 11 Jan 2013 01:07:40 +0000 (17:07 -0800)]
LU-2602 tests: add missing bug number to error_ignore call

error_ignore called with the wrong number of arguments
led to a corrupted and hard to interpret test log

Signed-off-by: Bob Glossman <bob.glossman@intel.com>
Change-Id: I6d2150eaa3c1b8cf044ddafd40d66cd64bb25314
Reviewed-on: http://review.whamcloud.com/4995
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Minh Diep <minh.diep@intel.com>
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
7 years agoLU-1812 mgs: assign PTR_ERR() to prevent warnings
chas williams - CONTRACTOR [Tue, 8 Jan 2013 15:06:18 +0000 (10:06 -0500)]
LU-1812 mgs: assign PTR_ERR() to prevent warnings

Some newer kernels fail with the "error: ignoring return value of
'PTR_ERR', declared with attribute warn_unused_result".

Signed-off-by: chas williams - CONTRACTOR <chas@cmf.nrl.navy.mil>
Change-Id: I94ff7d8371e2daf7440dd5fb295c209ed671bc74
Reviewed-on: http://review.whamcloud.com/4971
Reviewed-by: James Simmons <uja.ornl@gmail.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Peng Tao <bergwolf@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-2607 mdd: preserve input arguments in mdd_create()
Alex Zhuravlev [Thu, 17 Jan 2013 07:43:08 +0000 (11:43 +0400)]
LU-2607 mdd: preserve input arguments in mdd_create()

all input arguments are supposed to stay as is so that
the caller can re-use them again.

Signed-off-by: Alex Zhuravlev <alexey.zhuravlev@intel.com>
Change-Id: Ie2be78e702bfa9b7febafe7d106f09beccbf48d3
Reviewed-on: http://review.whamcloud.com/5048
Reviewed-by: wangdi <di.wang@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2563 tests: Print correct names in mgsdevname()
Li Wei [Fri, 4 Jan 2013 03:55:18 +0000 (11:55 +0800)]
LU-2563 tests: Print correct names in mgsdevname()

Current mgsdevname() prints names of block devices (or files for loop
devices) regardless of MGS back end types.  This is plainly a
violation of what the function is expected to do.  If an MGS is
ZFS-based, mgsdevname() should print the dataset name instead of the
VDev names.  This patch fixes the regression and makes sure that
mgsdevname() and mgsvdevname() work for both standalone and
MDT-combined MGSs.

Signed-off-by: Li Wei <wei.g.li@intel.com>
Change-Id: I5885af48e811fcd98aa00c5d901db30e5837b505
Signed-off-by: Li Wei <wei.g.li@intel.com>
Reviewed-on: http://review.whamcloud.com/4950
Tested-by: Hudson
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: wangdi <di.wang@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2587 quota: bump version after migration
Niu Yawei [Tue, 8 Jan 2013 10:39:56 +0000 (05:39 -0500)]
LU-2587 quota: bump version after migration

The global index version should be bumped to 2 if migration
happened, otherwise, the global index copy version on slave will
be same as the global index's (both equal to 1 after creation),
and the migrated limits will fail to be reintegrated.

Signed-off-by: Niu Yawei <yawei.niu@intel.com>
Change-Id: I2d596a33e2eb4495dfbb7bd63d37199297a9b214
Reviewed-on: http://review.whamcloud.com/4969
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Hudson
Reviewed-by: Fan Yong <fan.yong@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2072 ldiskfs: Leak of s_mb_prealloc_table in ldiskfs
Bruno Faccini [Thu, 10 Jan 2013 14:27:25 +0000 (15:27 +0100)]
LU-2072 ldiskfs: Leak of s_mb_prealloc_table in ldiskfs

ext4-prealloc-rhel[5,6] patches adds kmalloc'ed
sbi->s_mb_prealloc_table field which is never freed
in [ldiskfs,ext4]_mb_release()/ext4-vmalloc-rhel[5,6].patch

Signed-off-by: Bruno Faccini <bruno.faccini@intel.com>
Change-Id: I0ca3ff1e7ae8daa0260cd070c5ac52c843248a1b
Reviewed-on: http://review.whamcloud.com/4683
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2321 debug: Quiet uninitialized target connects
Prakash Surya [Tue, 20 Nov 2012 21:04:03 +0000 (13:04 -0800)]
LU-2321 debug: Quiet uninitialized target connects

When a target is not fully initialized and receives a connection
attempt, it will refuse the connection and print a message to the
console stating this fact. This is "normal operation", so rather
than using LCONSOLE_WARN to convey this information, this patch
modifies it to use CDEBUG.

Signed-off-by: Prakash Surya <surya1@llnl.gov>
Change-Id: Ia5d098fcfe2ad9ae2a1406166087db8181496a7d
Reviewed-on: http://review.whamcloud.com/4640
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1665 libcfs: alignment of hsb_head[0] can be suboptimal
chas williams - CONTRACTOR [Fri, 10 Aug 2012 19:21:10 +0000 (15:21 -0400)]
LU-1665 libcfs: alignment of hsb_head[0] can be suboptimal

On ia64, hsb_head[0] of struct cfs_hash_bucket could be aligned to a
4-byte boundary.  However, after allocating the hash bucket and
casting, the first member of the struct pointed to by hsb_head[0]
might prefer an 8-byte alignment.  This causes a constant stream
of unaligned access warnings from the kernel.

For other cpus this might waste some small amount of space, but
potentially produces more natural alignments (8 byte objects on 8
byte boundaries).

Signed-off-by: chas williams - CONTRACTOR <chas@cmf.nrl.navy.mil>
Change-Id: I4561ab3e6553b5dcef840b8e4e9aa3023b7c3586
Reviewed-on: http://review.whamcloud.com/4965
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-1961 build: fix 'dereference before null check' errors
Sebastien Buisson [Tue, 18 Sep 2012 07:13:41 +0000 (09:13 +0200)]
LU-1961 build: fix 'dereference before null check' errors

Fix 'dereference before null check' defects found by Coverity version
6.0.3:
Dereference before null check (REVERSE_INULL)
Null-checking variable suggests that it may be null, but it has
already been dereferenced on all paths leading to the check.

Signed-off-by: Sebastien Buisson <sebastien.buisson@bull.net>
Change-Id: I0c1be27ea443865fcb7640976839d95d0dc07b9a
Reviewed-on: http://review.whamcloud.com/4023
Tested-by: Hudson
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1187 lmv: allocate lmv tgts array by index
wangdi [Fri, 1 Nov 2013 12:50:24 +0000 (05:50 -0700)]
LU-1187 lmv: allocate lmv tgts array by index

Allocate lmv tgts array by MDT index, which is similar as lov
tgts arrary, so the index of tgts will be decided by MDT index,
instead of mount sequence in current implementation.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: If4903553251e1dba653aa79fb02bce581580629f
Reviewed-on: http://review.whamcloud.com/4936
Tested-by: Hudson
Reviewed-by: Fan Yong <fan.yong@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-1187 lod: Fix config log and setup process for DNE
wangdi [Fri, 8 Nov 2013 11:43:32 +0000 (03:43 -0800)]
LU-1187 lod: Fix config log and setup process for DNE

OSP will be used for local proxy client for remote MDT,
and LOD will be used to manage these OSPs.

1. Add DNE config log in mgs.
2. Lod_add_device will reorganize MD OSP and add them.
3. In osp_init0 and remove some unnecessary init stuff
for MD OSP.
4. Check whether osp is on OST or on MDT during client
setup.
5. Only stop MDT0--osp--MDT0 in lustre_disconnect_osp,
and other OSPs on MDT will be stoped in mdt stack
cleanup.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I1c8e24edbb95d638500dacd2f9a4e423f1007170
Reviewed-on: http://review.whamcloud.com/4922
Tested-by: Hudson
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-1187 lod: reorganize lod_ost
wangdi [Fri, 8 Nov 2013 11:42:23 +0000 (03:42 -0800)]
LU-1187 lod: reorganize lod_ost

Move lod_ost to lod_tgt_desc, so LOD can be used
to manage OSP for both MDT and OST.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I01c8033ba53e6729bfb62588306f48073f505b17
Reviewed-on: http://review.whamcloud.com/4921
Tested-by: Hudson
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2433 lnet: enable asymmetric router failure detection
Emoly Liu [Fri, 7 Dec 2012 01:56:34 +0000 (09:56 +0800)]
LU-2433 lnet: enable asymmetric router failure detection

Asynmmetric router failure detection is disabled by default,
it's helpful to enable it by default.
The original change is at https://github.com/chaos/lustre/
commit/872bfc41cc858a6c01cae3648e0ca329a414a436

Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Signed-off-by: Emoly Liu <emoly.liu@intel.com>
Change-Id: I259e00911cdf3d7caecb98c9832d40a91b571596
Reviewed-on: http://review.whamcloud.com/4753
Reviewed-by: Isaac Huang <he.huang@intel.com>
Reviewed-by: Liang Zhen <liang.zhen@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2555 fsfilt: fix race in ldiskfs_ext_new_extent_cb
Niu Yawei [Sat, 5 Jan 2013 09:00:27 +0000 (04:00 -0500)]
LU-2555 fsfilt: fix race in ldiskfs_ext_new_extent_cb

In ldiskfs_ext_calc_credits_for_insert(), we should use the 'depth'
stored in the 'path' instead from inode, because the extent tree
could have been changed when ldiskfs_ext_calc_credits_for_insert()
is called (by ldiskfs_ext_new_extent_cb()).

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I04dada849a71228980501ab7eb1cc9ab71ca3782
Reviewed-on: http://review.whamcloud.com/4957
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-709 build: remove old BGL support option
Christopher J. Morrone [Mon, 17 Dec 2012 19:39:21 +0000 (11:39 -0800)]
LU-709 build: remove old BGL support option

Remove the old and obsolete --enable-bgl configure option.
Lustre no longer supports the old kernel that BG/L systems
use, and we do not use this opton on the later BG/P and
BG/Q systems.

Change-Id: Iea0b893fd67fe5242fa65ebc8993c1f2b0863ae6
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4841
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Yang Sheng <yang.sheng@intel.com>
7 years agoLU-1018 tests: reduce runtime value for compilebench
Minh Diep [Thu, 17 Jan 2013 15:57:41 +0000 (07:57 -0800)]
LU-1018 tests: reduce runtime value for compilebench

We are reducing the cbench_IDIRS and cbench_RUNS to 2.
These variables can be adjusted to other runs beside
sanity check.

Test-Parameters: envdefinitions=SLOW=yes,ENABLE_QUOTA=yes testlist=parallel-scale
Signed-off-by: Minh Diep <minh.diep@intel.com>
Change-Id: If03f7b5a71eb8a4b4b380638af872a012f9cdac5
Reviewed-on: http://review.whamcloud.com/5052
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1722 llite: LTP fcntl14 test fails on a SMP host
Andriy Skulysh [Fri, 3 Aug 2012 08:51:44 +0000 (11:51 +0300)]
LU-1722 llite: LTP fcntl14 test fails on a SMP host

Release Lustre flock in case of local locking failure

Xyratex-bug-id: MRP-447
Reviewed-by: Vitaly Fertman <vitaly_fertman@xyratex.com>
Reviewed-by: Andrew Perepechko <andrew_perepechko@xyratex.com>
Signed-off-by: Andriy Skulysh <Andriy_Skulysh@xyratex.com>
Change-Id: I27e4627461756442713077344bcefeb3841d594a
Reviewed-on: http://review.whamcloud.com/3565
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Tested-by: Hudson
Reviewed-by: Fan Yong <fan.yong@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2511 procfs: Disallow secretly (un)writable proc entries
John L. Hammond [Wed, 19 Dec 2012 22:54:31 +0000 (16:54 -0600)]
LU-2511 procfs: Disallow secretly (un)writable proc entries

Add an assert to lprocfs_seq_create() to ensure that proc entries
implementing write have user writable modes.  Fix a few callers to
pass this assertion.

Signed-off-by: John L. Hammond <jhammond@tacc.utexas.edu>
Change-Id: I95d08106f7d9be478c29d7331cdf5ab607435889
Reviewed-on: http://review.whamcloud.com/4871
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1445 lod: Add FLD lookup to LOD
wangdi [Thu, 26 Sep 2013 01:35:37 +0000 (18:35 -0700)]
LU-1445 lod: Add FLD lookup to LOD

1. Adding FLD in LOD can make it getting the OST index
of the real FID when setting stripEA(l_ost_index) to
the file. Then the client can still use l_ost_index
in stripeEA to locate OST, by which the old client can
still access OST after FID_on_OST is landed.

2. Init sequence client for OSP.

Signed-off-by: Wang Di <di.wang@intel.com>
Change-Id: I559edfd02feb08f32156c7237ec75fe6dde681e3
Reviewed-on: http://review.whamcloud.com/5047
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoNew tag 2.3.59 2.3.59 v2_3_59 v2_3_59_0
Oleg Drokin [Sat, 19 Jan 2013 02:10:49 +0000 (21:10 -0500)]
New tag 2.3.59

Change-Id: I66aeac610981cafd226fe77386044f04d3b65b8c
Signed-off-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1187 tests: Add mntfmt/mntcount/mdtcount to mdsrate
wangdi [Mon, 19 Nov 2012 13:38:26 +0000 (05:38 -0800)]
LU-1187 tests: Add mntfmt/mntcount/mdtcount to mdsrate

Add mntfmt, mntcount and mdtcount to parameters of mdsrate, so
it can do multiple mount or DNE tests.

Signed-off-by: wang di <di.wang@whamcloud.com>
Change-Id: Ie3859ab13ef1ed680e645883611c5f8c9ea4e4a5
Reviewed-on: http://review.whamcloud.com/4614
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1187 dne: add remote dir check in replay-vbr.
wangdi [Sun, 18 Nov 2012 21:37:44 +0000 (13:37 -0800)]
LU-1187 dne: add remote dir check in replay-vbr.

Add remote dir check in replay-vbr.

Change-Id: Ia955703a45c1fe63439d0cbe893b73bb12a77305
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/4321
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
7 years agoLU-1187 lmv: Locate right MDT in lmv.
wangdi [Fri, 1 Nov 2013 12:27:11 +0000 (05:27 -0700)]
LU-1187 lmv: Locate right MDT in lmv.

1.Add fid in md_revalidate_lock for locate mdt in
do_statahead_interpret.
2.locate right mdc for FID2PATH.
3.Only validating MDT0 connection for statfsi during Mount,
so even some MDTs are not avaible, the system can still be
setup.

Signed-off-by: Wang Di <di.wang@intel.com>
Change-Id: I40a3dcbe1f87cd38386ea360547dd2b4528645d1
Reviewed-on: http://review.whamcloud.com/4356
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
7 years agoLU-2509 quota: various code cleanups
Johann Lombardi [Tue, 18 Dec 2012 21:54:54 +0000 (22:54 +0100)]
LU-2509 quota: various code cleanups

Address some cleanups that were mentioned during code inspection.

Signed-off-by: Johann Lombardi <johann.lombardi@intel.com>
Change-Id: I3cab9c0e6bfefef0d717e542f6620cc167075937
Reviewed-on: http://review.whamcloud.com/4855
Tested-by: Hudson
Reviewed-by: Niu Yawei <yawei.niu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2470 procfs: Remove unused lu_time code.
John L. Hammond [Tue, 11 Dec 2012 19:47:00 +0000 (13:47 -0600)]
LU-2470 procfs: Remove unused lu_time code.

Remove lu_time.{c,h}, the unused wrappers for the functions defined
therein, and the stats file /proc/fs/lustre/mdt/*/site_time.

Signed-off-by: John L. Hammond <jhammond@tacc.utexas.edu>
Change-Id: Id45b12efd06134048a96f4b0ba92eaa4fce0b55d
Reviewed-on: http://review.whamcloud.com/4802
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Keith Mannthey <keith.mannthey@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2349 osp: Move log ops init to module init.
wangdi [Fri, 16 Nov 2012 19:16:29 +0000 (11:16 -0800)]
LU-2349 osp: Move log ops init to module init.

Because osp_mds_ost_orig_logops and changelog_orig_logops
will be shared by all of the llog ctxt for all OSPs/MDDs
on one node, if we keep changing that during obd_setup
process, the loc_logops might be changed, i.e. lop_add
and lop_declare_add might become zero for a while. So if
other healthy device(like another osp) tried to delcare_add
or add record during the time, it will get ENOTSUPP.(especially
for DNE). So the ops initialization should move to module init.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I1e46d2163c2431c43c369adb7b3c16e664260a4e
Reviewed-on: http://review.whamcloud.com/4608
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1187 mdt: enqueue rename lock locally for phase I.
wangdi [Mon, 12 Nov 2012 14:39:25 +0000 (06:39 -0800)]
LU-1187 mdt: enqueue rename lock locally for phase I.

Because cross-rename is not permitted in phase I, it only
needs to enqueue rename lock locally for phase I.

Change-Id: I954a6c7c5ab914df4b756c6eae4fc0bfddad8e6b
Signed-off-by: wang di <di.wang@intel.com>
Reviewed-on: http://review.whamcloud.com/4355
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
7 years agoLU-2397 recovery: check queue_len > 0 in check_for_next_transno
Mikhail Pershin [Fri, 11 Jan 2013 07:21:10 +0000 (11:21 +0400)]
LU-2397 recovery: check queue_len > 0 in check_for_next_transno

The check_for_next_transno rely on obd_req_replay_clients is unable
to change during that function call, it is not true.

Patch makes sure that case with zero queue_len is excluded and
check for obd_req_replay_clients is 0 after comparing with queue_len

Signed-off-by: Mikhail Pershin <mike.pershin@intel.com>
Change-Id: I0b81e0f8e6a4f2cbfd51b6a049ee273cec4732a2
Reviewed-on: http://review.whamcloud.com/4998
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1716 test: Test holder for b2_1 only test.
Keith Mannthey [Wed, 28 Nov 2012 01:05:13 +0000 (17:05 -0800)]
LU-1716 test: Test holder for b2_1 only test.

A b2_1 only test is needed. Add it as a comment so as not to
reuse it in the future.

Signed-off-by: Keith Mannthey <keith.mannthey@intel.com>
Change-Id: I3caf15d1369e73b8104194561b73929561d2dfe9
Reviewed-on: http://review.whamcloud.com/4690
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Bob Glossman <bob.glossman@intel.com>
7 years agoLU-1756 kernel: cleanup lustre_compat25.h
Peng Tao [Thu, 16 Aug 2012 07:59:21 +0000 (15:59 +0800)]
LU-1756 kernel: cleanup lustre_compat25.h

1. unused functions:
   ll_bdi_wb_cnt()
2. call bdi_init/bdi_destroy directly
3. call add_to_page_cache_lru directly
4. fix a typo of ll_pagevec_init

Signed-off-by: Peng Tao <tao.peng@emc.com>
Change-Id: I0ce799bc5aad70279a652cf911b9880abcc74194
Reviewed-on: http://review.whamcloud.com/4656
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Yang Sheng <yang.sheng@intel.com>
7 years agoLU-2158 lvfs: Remove cruft from lvfs directory
Prakash Surya [Tue, 18 Dec 2012 19:44:39 +0000 (11:44 -0800)]
LU-2158 lvfs: Remove cruft from lvfs directory

Some of the unnecessary cruft from within the lvfs directory was
removed by this change. Specifically, the following changes were
made:

 * Removed files:
    * Info.plist
    * lvfs_darwin.c
    * lvfs_internal.h
    * lvfs_userfs.c
 * Cleaned up the autoMakefile.am and Makefile.in files to reflect the
   removed files.

Change-Id: Icc7189912415e96b81dde384491c1948fa4ef06a
Signed-off-by: Prakash Surya <surya1@llnl.gov>
Signed-off-by: Christopher J. Morrone <morrone2@llnl.gov>
Reviewed-on: http://review.whamcloud.com/4858
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: James Simmons <uja.ornl@gmail.com>
7 years agoLU-1434 utils: Add better handling for normal lustre packets
Nathaniel Clark [Tue, 18 Dec 2012 17:08:04 +0000 (12:08 -0500)]
LU-1434 utils: Add better handling for normal lustre packets

This fixes handling for Lustre packets (lustre 2.1) for more packet
types and fixes some packet types that were being mis-interpreted.

Signed-off-by: Nathaniel Clark <nathaniel.l.clark@intel.com>
Change-Id: Ib6fcf99a93efc41a0cad3457da8009522c68d248
Reviewed-on: http://review.whamcloud.com/4852
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Doug Oucharek <doug.s.oucharek@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-2183 quota: quota tests for DNE
Niu Yawei [Fri, 4 Jan 2013 10:16:47 +0000 (05:16 -0500)]
LU-2183 quota: quota tests for DNE

Added two quota tests for DNE:
- test_7e: inode limits reintegration;
- test_12b: inode quota rebalancing;

Signed-off-by: Niu Yawei <niu@whamcloud.com>
Change-Id: I1a262496bde318da062ef1f4558f4160737dd12b
Reviewed-on: http://review.whamcloud.com/4952
Tested-by: Hudson
Reviewed-by: Jian Yu <jian.yu@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Johann Lombardi <johann.lombardi@intel.com>
7 years agoLU-1445 fid: start ptlrpc service for OST FID
wangdi [Tue, 24 Sep 2013 19:32:05 +0000 (12:32 -0700)]
LU-1445 fid: start ptlrpc service for OST FID

Start FID service on OST for FID on OST.

Change-Id: I58b36e052a2f09fc6707107f805176dcdca7e86a
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/4328
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Tested-by: Hudson
Reviewed-by: Fan Yong <fan.yong@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
7 years agoLU-1430 mgs: "replace_nids" lctl command added
Artem Blagodarenko [Thu, 30 Aug 2012 12:35:57 +0000 (16:35 +0400)]
LU-1430 mgs: "replace_nids" lctl command added

Currently after device address is changed tunefs
should be started with "writeconf" options. This
erase configuration logs for the filesystem that
this server is part of, and regenerate them. This
is very dangerous. All clients must be unmounted
and servers  for  this filesystem should be stopped.
All targets (OSTs/MDTs) must then be restarted to
regenerate the logs.  No clients should be started
until all targets have restarted. The targets start
order is also important. Wrong order can be cause
of failure.

This patch adds "replace_nids" command to lctl
that should be executed when only MGS server
started. This command replace nids and uuid for
given device. Command can be used to change
OST or MDT nids.

Xyratex-bug-id: MRP-397
Reviewed-by: Alexey Lyashkov <alexey_lyashkov@xyratex.com>
Reviewed-by: Nathan Rutman <nathan.rutman@xyratex.com>
Signed-off-by: Artem Blagodarenko <artem_blagodarenko@xyratex.com>
Change-Id: I74b72281ce3b5e48188735035e58250596a16bf7
Reviewed-on: http://review.whamcloud.com/2896
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2531 osc: evict extents in trunc whatever happens
Jinshan Xiong [Thu, 27 Dec 2012 20:47:38 +0000 (12:47 -0800)]
LU-2531 osc: evict extents in trunc whatever happens

In osc_cache_truncate_start(), we should ignore the return code
of osc_extent_wait() because initiator will handle it and truncate
should continue in anyways.

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: Iaae1228d0f1c488c5deaf938761715ee3984ac3d
Reviewed-on: http://review.whamcloud.com/4896
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
Tested-by: Oleg Drokin <green@whamcloud.com>
Reviewed-by: Bobi Jam <bobijam@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
7 years agoLU-676 tests: machinefile option for mpirun via a variable
Jay J. Lan [Tue, 18 Oct 2011 19:04:07 +0000 (12:04 -0700)]
LU-676 tests: machinefile option for mpirun via a variable

Not all MPI implementations pass the host file to mpirun via the same
option. Common options are -machinefile and -hostfile.

This problem can be resolved by using a variable MACHINEFILE_OPTION
instead. A default value is assigned if the variable not defined.

Signed-off-by: Jay J Lan <jay.j.lan@nasa.gov>
Signed-off-by: Bobi Jam <bobijam.xu@intel.com>
Change-Id: I3362a6e62a27318cff733aea2f99b1356b3ff02e
Reviewed-on: http://review.whamcloud.com/3873
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1187 lmv: remove obsolete lmv object.
wangdi [Thu, 31 Oct 2013 06:33:38 +0000 (23:33 -0700)]
LU-1187 lmv: remove obsolete lmv object.

lmv object is intended to handle spliting directory, which
is obsolete for current DNE infrastructure.

Signed-off-by: wang di <di.wang@intel.com>
Change-Id: I5337d497451f6869bc67474b0cd7d74bde01a172
Reviewed-on: http://review.whamcloud.com/5011
Tested-by: Hudson
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-1445 fid: Add DATA fid type in fid_request.
wangdi [Thu, 26 Sep 2013 02:11:47 +0000 (19:11 -0700)]
LU-1445 fid: Add DATA fid type in fid_request.

1. Add data fid type in fid request on client side.
2. When MDT request fids to the OST, if it is not
ready for fid allocation yet. i.e. not being connected
to MDT0 yet, it will return -EINPROGRESS, and MDT will
try again.
3. Remove obsolete obd_fid_init/fini in llite.

Signed-off-by: wang di <di.wang@whamcloud.com>
Change-Id: I54d97d5c84a5b38ebeae77522bd8666206ef2701
Reviewed-on: http://review.whamcloud.com/4787
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
7 years agoLU-1876 hsm: layout lock implementation on server side
Jinshan Xiong [Thu, 6 Dec 2012 17:34:15 +0000 (09:34 -0800)]
LU-1876 hsm: layout lock implementation on server side

* enabled OBD_CONNECT_LAYOUTLOCK both on client and mdt
* mdt_object_lock_try() is implemented to try layout lock
* dlm flag LDLM_FL_BLOCK_NOWAIT is added to implement nonblock mode
  dlm lock enqueue
* try layout lock for IT_GETATTR and IT_OPEN
* make layout lock work
* add layout intent support.

Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com>
Change-Id: I84a6dfca83ded2344240fa5430c9922b7cfc7bcf
Reviewed-on: http://review.whamcloud.com/4417
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: wangdi <di.wang@intel.com>
Reviewed-by: jacques-Charles Lafoucriere <jacques-charles.lafoucriere@cea.fr>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
7 years agoLU-2263 ptlrpc: deadlock of obd_import::imp_lock
Liang Zhen [Fri, 21 Dec 2012 06:27:57 +0000 (14:27 +0800)]
LU-2263 ptlrpc: deadlock of obd_import::imp_lock

ptlrpc_at_recv_early_reply() calls ptlrpc_at_set_req_timeout() with
hold of ptlrpc_request::rq_lock, and
ptlrpc_at_set_req_timeout()->import_at_get_index() requires imp_lock,
it violates locking-order rule of Lustre, which assumes rq_lock can
nest in imp_lock.

Signed-off-by: Liang Zhen <liang@whamcloud.com>
Change-Id: I924839b59ca1fa1cdf01568872de867ce3985f8b
Reviewed-on: http://review.whamcloud.com/4880
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com>
7 years agoLU-1187 tests: Add parallel sanity tests to dne
wangdi [Fri, 7 Dec 2012 16:38:35 +0000 (08:38 -0800)]
LU-1187 tests: Add parallel sanity tests to dne

1. Add parallel sanity tests(dne_sanity) to run sanity
tests on different directories at the same time.

2. Add PARALLEL check line in sanity to skip some tests which
are unable to run parallel.

3. Do not check multiop in run_one when multiple sanity
is running.

4. In test_105, replace DIR with MOUNT to check flock option.

Test-Parameters: envdefinitions=SLOW=yes testlist=sanity,dne_sanity
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Change-Id: If2386e5465c2067059fb72c5fc95ac690ddd3fa4
Reviewed-on: http://review.whamcloud.com/4318
Tested-by: Hudson
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Jian Yu <jian.yu@intel.com>
7 years agoLU-1187 tests: Add dne specific tests to sanityN
wangdi [Sun, 18 Nov 2012 21:30:16 +0000 (13:30 -0800)]
LU-1187 tests: Add dne specific tests to sanityN

1. Change mkdir to test_mkdir for DNE.
2. 2f: Check attr and ownder update under remote dir.
3. 25b: Acl checking under remote dir.
4. 33b: commit on share under remote dir.
5. 4[0-7]: Check remote dir with pdir lock.
6. 70: cd dir and rm -rf dir.

Change-Id: I9b752d8663287db55bd07a5ce132c397749ade4d
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/4366
Tested-by: Hudson
Reviewed-by: Jian Yu <jian.yu@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
7 years agoLU-1445 ofd: Add fid support on OFD
wangdi [Tue, 24 Sep 2013 09:59:57 +0000 (02:59 -0700)]
LU-1445 ofd: Add fid support on OFD

1. Init fid server related structure in OFD, which will
become a sequence metaserver, i.e. MDT will request sequence
from OST(OFD), OFD will request super sequence from MDT0

2. OST FID sequence width will be 4 billion, which is different
with MDS FID.

Change-Id: If861cf5814ea77ce72464525a8de71ac182d742c
Signed-off-by: Wang Di <di.wang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/4326
Tested-by: Hudson
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Mike Pershin <mike.pershin@intel.com>
Reviewed-by: Andreas Dilger <andreas.dilger@intel.com>