Whamcloud - gitweb
shaver [Thu, 20 Feb 2003 08:59:38 +0000 (08:59 +0000)]
Reconstruct replies for open. Lightly tested (successful open case).
shaver [Thu, 20 Feb 2003 07:36:15 +0000 (07:36 +0000)]
- Store open-request XID in the MFD, so that we can find it during reply
reconstruction.
- Untested reply reconstruction for GETATTR_NAME (easy) and OPEN (not easy,
ahem).
- Don't leak dentry refs when reconstructing replies for reint_setattr or
reint_create.
- Don't double-dput dchild if dentry_open fails. (Not yet in test suite, bug
894 filed to trick someone into adding it.)
pschwan [Thu, 20 Feb 2003 07:09:40 +0000 (07:09 +0000)]
don't LBUG if we can't lookup the parent in mds_open and mds_reint_create; it's
entirely possible that we're racing with rmdir()
shaver [Wed, 19 Feb 2003 20:28:42 +0000 (20:28 +0000)]
Add tests for reply reconstruction and request retransmission for
reint_setattr.
adilger [Tue, 18 Feb 2003 23:06:05 +0000 (23:06 +0000)]
Minor fixup.
adilger [Tue, 18 Feb 2003 23:02:40 +0000 (23:02 +0000)]
Update HP PNNL kernel patch for new VFS changes.
Remove patch hunks which are calling user_path_walk_it(..., NULL)
pschwan [Tue, 18 Feb 2003 19:39:44 +0000 (19:39 +0000)]
merge b_setattr into b_devel. The highlights:
- proper LDLM_DEBUG macro fix, for gcc 3.2 (850)
- failed open()s could cause deadlock; fixed (867, 869)
- stop cancelling OST locks when files are closed (481)
- overlapping XID spaces caused network corruption (851, 853)
- fix unsafe fsfilt counter arithmetic; change to atomic_t
- setattr_raw added, to do single-RPC, server-side setattrs
- fix crashy race condition between ptlrpc_free_req and osc_close
pschwan [Mon, 17 Feb 2003 18:44:21 +0000 (18:44 +0000)]
merge b_devel into b_setattr. highlights:
- kernel 2.5 and liblustre build changes
- fixes to Makefile.am for 7.3-era versions of automake, which is quite possibly
the worst piece of software with which I come in contact on a daily basis
- small unlink fix
shorthair [Mon, 17 Feb 2003 16:20:58 +0000 (16:20 +0000)]
temporarily modification for compilation on uml2.5.59
(some struct has changed in 2.5, such as timespec, kdev_t)
braam [Mon, 17 Feb 2003 10:24:15 +0000 (10:24 +0000)]
- the bulk of the build fixes for liblustre. Note
that all user level programs now need to include
<liblustre.h> (as is done in the utils and test
directories.
shaver [Fri, 14 Feb 2003 20:50:06 +0000 (20:50 +0000)]
Don't be outsmarted by the dcache, mkay?
shaver [Thu, 13 Feb 2003 07:25:49 +0000 (07:25 +0000)]
New transno regimen:
- no more transno semaphore: the LDLM is the one true source of concurrency
control
- allocate transnos and log requests for failed requests too
- record request status and open-disposition in last_rcvd as well
- mds_finish_transno commits the handle, if there is one (and creates its own
for the last_rcvd update, if needed).
Much nicer (IMO) error-handling in mds_reint.c and such. At the least, 85%
fewer gotos.
Rename "last_rcvd" to "(last_)transno" in various places, because it's clearer
that way (again, IMO).
Warning (type mismatch) fixes in osc_request that were bugging me.
adilger [Thu, 13 Feb 2003 02:40:00 +0000 (02:40 +0000)]
Fixups to HP patch.
pschwan [Wed, 12 Feb 2003 17:15:12 +0000 (17:15 +0000)]
Oversight in mds_open, forgot to save locks for reply-ack; fixed.
adilger [Wed, 12 Feb 2003 16:52:26 +0000 (16:52 +0000)]
Remove use of old config stuff from acceptance-metadata-single.sh.
Don't use hard-coded paths.
adilger [Wed, 12 Feb 2003 03:25:26 +0000 (03:25 +0000)]
Remove unused IT_RENAME intent.
Revert revalidate2 reversion.
Update vfs_intent_hp.patch to include new exec changes.
cvs2svn [Fri, 7 Feb 2003 18:02:18 +0000 (18:02 +0000)]
This commit was manufactured by cvs2svn to create branch 'unlabeled-1.2.2'.
pschwan [Fri, 7 Feb 2003 18:01:04 +0000 (18:01 +0000)]
Merge b_md into HEAD
* bug fixes
- Fix ldlm_lock_match on the MDS to avoid matching remote locks (592)
- Fix fsfilt_extN_readpage() to read a full page of directory
entries, or fake the remainder if PAGE_SIZE != blocksize (500)
- Avoid extra mdc_getattr() in ll_intent_lock when possible (534, 604)
- Fix imbalanced LOV object allocation and out-of-bound access (469)
- Most intent operations were removed, in favour of a new RPC mode
that does a single RPC to the server and bypasses most of the VFS
- All LDLM resource ID arrays were removed in favour of ldlm_res_id
- Aggressively cancel local locks on DLM servers
- mds_reint_unlink sends EA to the client if it's the last nlink.
client uses that EA to unlink OST objects.
- mds_reint_{rename,unlink,link} were rewritten to take ordered locks
- recursive symlinks were fixed (440)
- fixed NULL deref in DEBUG_REQ
- filter_update_lastobjid no longer calls sync, which annoyed extN
- fixed multi-client small-writes to a single file problem (445)
- fixed mtime updates during file writes (607)
- fixed vector writes on obdfilter causing problems when ENOSPC (670)
- fixed bug in obd_brw_read/write() (under guise of testing 367)
- fixed Linux OST size reporting problem (444, 656)
- OST now updates object mtime with writes or setattr (607, 619)
- client verifies file size before zeroing page past EOF (445)
- OST now writes last allocated objid to disk with allocation (108)
- LOV on echo now works (409)
* protocol changes
- mds_reint_unlink sends a new buffer, with the EA included. this
buffer is only valid if body->valid & OBD_MD_FLEASIZE, which is only
set if a regular file was being unlinked, and it was the last link
- use PtlGet from the target for bulk writes (315)
- OST now updates object mtime with writes or setattr (607, 619)
- LDLM now has a grant-time callback to revalidate locked items, if
necessary (604)
- Many MDS operations were reorganized to combat race conditions
* other changes
- Merge b_intel branch (updated lprocfs code) - now at /proc/fs/lustre
- configure check to avoid gcc version 2.96
20000731-2.96-98 (606)
pschwan [Fri, 7 Feb 2003 17:06:27 +0000 (17:06 +0000)]
I think Peter forgot to commit the version change
eeb [Fri, 7 Feb 2003 15:59:13 +0000 (15:59 +0000)]
file obdiolib.h was initially added on branch b_md.
eeb [Fri, 7 Feb 2003 15:59:12 +0000 (15:59 +0000)]
file obdiolib.c was initially added on branch b_md.
eeb [Fri, 7 Feb 2003 15:59:11 +0000 (15:59 +0000)]
file obdbarrier.c was initially added on branch b_md.
zab [Thu, 6 Feb 2003 02:14:59 +0000 (02:14 +0000)]
- braindead first pass at a ptlbd backing store, it'll do for now
zab [Thu, 6 Feb 2003 00:26:29 +0000 (00:26 +0000)]
- move to single ptlrpc code paths on the ptlbd client and server which know
to switch between _put and _get for read and write. in the process, clean
up the ridiculous callback/refcounting mess that was the first attempt.
- also, pass through to blk_ioctl() when people ask us to flush.
adilger [Wed, 5 Feb 2003 21:45:40 +0000 (21:45 +0000)]
file createtest.c was initially added on branch b_md.
adilger [Mon, 3 Feb 2003 18:31:08 +0000 (18:31 +0000)]
file exports_hp.txt was initially added on branch b_md.
adilger [Mon, 3 Feb 2003 18:31:06 +0000 (18:31 +0000)]
file exports_hp.pc was initially added on branch b_md.
adilger [Mon, 3 Feb 2003 18:31:03 +0000 (18:31 +0000)]
file exports_hp.patch was initially added on branch b_md.
braam [Sat, 1 Feb 2003 21:58:01 +0000 (21:58 +0000)]
file busy.sh was initially added on branch b_md.
braam [Sat, 1 Feb 2003 21:58:00 +0000 (21:58 +0000)]
file extN-iget-debug.diff was initially added on branch b_md.
adilger [Sat, 1 Feb 2003 07:42:40 +0000 (07:42 +0000)]
file invalidate_show.txt was initially added on branch b_md.
adilger [Sat, 1 Feb 2003 07:42:37 +0000 (07:42 +0000)]
file invalidate_show.pc was initially added on branch b_md.
pschwan [Fri, 31 Jan 2003 21:37:19 +0000 (21:37 +0000)]
Merge b_intent into b_md:
- New kernel patch (version 9)
- DLM hooks to revalidate locked data, once the lock is granted (604)
- Further MDS reorganization, particularly of the open and o_creat paths
pschwan [Fri, 31 Jan 2003 21:15:07 +0000 (21:15 +0000)]
file invalidate_show.patch was initially added on branch b_intent.
rread [Thu, 30 Jan 2003 22:25:56 +0000 (22:25 +0000)]
- give echo_client a fighting chance
pschwan [Thu, 30 Jan 2003 21:09:07 +0000 (21:09 +0000)]
file open_delay.c was initially added on branch b_intent.
shaver [Thu, 30 Jan 2003 19:24:56 +0000 (19:24 +0000)]
file recovery-small.sh was initially added on branch b_md.
kedarsovani [Thu, 30 Jan 2003 15:40:48 +0000 (15:40 +0000)]
Added the NET variable during configuration.
adilger [Thu, 30 Jan 2003 09:58:25 +0000 (09:58 +0000)]
Silence ptlbd warning with (I hope) is the correct new function. Zab?
braam [Thu, 30 Jan 2003 05:16:59 +0000 (05:16 +0000)]
file iod-rmap-exports.pc was initially added on branch b_intent.
braam [Thu, 30 Jan 2003 05:16:58 +0000 (05:16 +0000)]
file iod-rmap-exports.patch was initially added on branch b_intent.
adilger [Wed, 29 Jan 2003 22:13:04 +0000 (22:13 +0000)]
file invalidate-show.diff was initially added on branch b_intent.
eeb [Wed, 29 Jan 2003 21:17:31 +0000 (21:17 +0000)]
file obdstat.c was initially added on branch b_md.
eeb [Wed, 29 Jan 2003 21:17:30 +0000 (21:17 +0000)]
file obdio.c was initially added on branch b_md.
shaver [Wed, 29 Jan 2003 20:38:01 +0000 (20:38 +0000)]
- preserve last-reply per client for matching up with a retransmitted request
- add ioctl to MDS to disable sending of committed-transno updates
- add OBD_FAIL_MDS_ALL_REPLY_NET to drop replies after they make it to the
reply-preservation code.
adilger [Wed, 29 Jan 2003 01:08:21 +0000 (01:08 +0000)]
file ext3-use-after-free.diff was initially added on branch b_intent.
adilger [Wed, 29 Jan 2003 01:08:20 +0000 (01:08 +0000)]
file ext3-unmount_sync.diff was initially added on branch b_intent.
rread [Mon, 27 Jan 2003 21:14:44 +0000 (21:14 +0000)]
Large diff to add support for last_rcvd file to OST.
- add obd_trans_info to the obd ops that modify data. Currently it only includes
the transo, but in future it will contain xid and other transaction specific data.
Only the server side is using this structure, and is largely ignored on the client
at this time.
- there is no support for actual recovery yet.
- Move the reconnection check from mds_connect() to target_handle_connect().
- marked code that needs to be removed for bug 550
- passes runtests on uml
zab [Thu, 23 Jan 2003 19:09:31 +0000 (19:09 +0000)]
- add fs_sink filter method which blocks until the backing filter is synced.
ext* uses ext*_force_commit, reiser is unimplemented
- add /proc/sys/lustre/filter_sync_on_commit tunable, disabled by default.
when enabled it calls the filter sync after each filter_commitrw for write
braam [Thu, 23 Jan 2003 18:39:18 +0000 (18:39 +0000)]
file mds_open.c was initially added on branch b_intent.
zab [Wed, 22 Jan 2003 19:46:49 +0000 (19:46 +0000)]
b=315/444: use PtlGet to implement osc->ost writes, again. This survived
torture on dev/mdev. BA osts won't work against this change until they
implement the ptlget writes.
adilger [Wed, 22 Jan 2003 13:47:15 +0000 (13:47 +0000)]
Fix one cause of bug 430 (hardlinks) that showed up with simul, but this was
a recently introduced bug and not the real source of problems. Back to the
drawing board in terms of finding a repeatable testcase. The only thing
learned from this and the previous extN orphan assertion (bug 670) is that
they were both caused by dentry refcount problems, and the files related
to that dentry refcount were unlinked.
coopcoopbware [Tue, 21 Jan 2003 22:44:47 +0000 (22:44 +0000)]
Adding kernel_patches to EXTRA_DIST
pschwan [Tue, 21 Jan 2003 18:01:56 +0000 (18:01 +0000)]
Merge b_intent into b_md:
** You will need to update your kernel, Lustre patch version 8 **
Highlights:
- the MDS now returns a block count for non-regular files (for which it has
the authoritative size information)
- we set a DCACHE_LUSTRE_INVALID flag on dentries when we alienate them; this
flag is now used in the VFS to help us avoid a race condition with
revalidate2 and dentry alienation
- remove the ldlm_lock_match CBPENDING flag, which severely violates a DLM
invariant
- fix enqueue_ordered_lock matching
- we reintroduced bug 72 by accident; fixed again, with a better comment.
- small fixes to create.pl/rename.pl
amrutjoshi [Tue, 21 Jan 2003 16:24:45 +0000 (16:24 +0000)]
A temporay solution to make tinderbox ltest for runtests.sh successful.
* Added mcreate in EXTRA_DIST for tests/Makefile.am
adilger [Tue, 21 Jan 2003 03:16:59 +0000 (03:16 +0000)]
file jbd-transno-cb.pc was initially added on branch b_md.
adilger [Mon, 20 Jan 2003 23:52:27 +0000 (23:52 +0000)]
Split out the jbd callback patches from vanilla-2.4.19 so that we can use
them with the hp-pnnl series also. I would have done the same for the
vanilla-2.4.18 patch, but it was already out of date w.r.t. the recent
Lustre l7 changes.
adilger [Mon, 20 Jan 2003 23:52:25 +0000 (23:52 +0000)]
file jbd-transno-cb.patch was initially added on branch b_md.
pschwan [Mon, 20 Jan 2003 23:23:06 +0000 (23:23 +0000)]
file acceptance-metadata-single.sh was initially added on branch b_intent.
adilger [Mon, 20 Jan 2003 21:24:10 +0000 (21:24 +0000)]
Add linefeed to kernel error.
braam [Mon, 20 Jan 2003 04:39:53 +0000 (04:39 +0000)]
- remove unsupported kernels from the "which patch" file
braam [Mon, 20 Jan 2003 04:21:03 +0000 (04:21 +0000)]
file vfs_intent_hp.pc was initially added on branch b_md.
braam [Mon, 20 Jan 2003 04:21:02 +0000 (04:21 +0000)]
file kmem_cache_validate_hp.pc was initially added on branch b_md.
braam [Mon, 20 Jan 2003 04:21:01 +0000 (04:21 +0000)]
file dev_read_only_hp.pc was initially added on branch b_md.
braam [Mon, 20 Jan 2003 04:21:00 +0000 (04:21 +0000)]
file vfs_intent_hp.patch was initially added on branch b_md.
braam [Mon, 20 Jan 2003 04:20:58 +0000 (04:20 +0000)]
- kernel patches for vanilla 2.4.19, 2.4.19-hp2-2 (not tested much)
- tiny fix to dcache.c
braam [Mon, 20 Jan 2003 04:20:57 +0000 (04:20 +0000)]
file kmem_cache_validate_hp.patch was initially added on branch b_md.
braam [Mon, 20 Jan 2003 04:20:55 +0000 (04:20 +0000)]
file dev_read_only_hp.patch was initially added on branch b_md.
pschwan [Mon, 20 Jan 2003 01:45:43 +0000 (01:45 +0000)]
merge b_intent into b_md
** You will need to upgrade to kernel version 7 **
Notes:
- Most intent operations were removed, in favour of a so-called "RPC mode"
that does a single RPC to the server and returns the rc immediately,
bypassing most of the VFS. IT_OPEN and IT_LOOKUP remain pretty much
unchanged.
- all LDLM resource ID arrays were removed in favour of struct ldlm_res_id
- aggressively cancel local locks on a lock server, such as those that the MDS
requests from its own DLM
- because unlink is now done with an RPC-mode call, there is no local inode
to call delete_inode on, so the OST objects would never get unlinked.
Instead, the MDS notifies the client that it was the last unlink, along
with the lsm, which it uses to free the OST objects
- mds_reint_rename, mds_reint_unlink, and mds_reint_link were rewritten to use
enqueue_ordered_locks and avoid lock-ordering deadlocks
- recursive symlinks were fixed
- fixed NULL deref in DEBUG_REQ
- filter_update_lastobjid no longer calls sync, which is unnecessary when
called inside a transaction (harmful, in fact) and was making extN very,
very sad
braam [Sat, 18 Jan 2003 19:13:41 +0000 (19:13 +0000)]
file rename.pl was initially added on branch b_intent.
coopcoopbware [Fri, 17 Jan 2003 22:39:50 +0000 (22:39 +0000)]
Added test 28 - IT_GETATTR regression
braam [Fri, 17 Jan 2003 20:08:56 +0000 (20:08 +0000)]
- patch kernel patches for "rm -i" problem
this was erroneous failure handling for open.
pschwan [Thu, 16 Jan 2003 05:55:49 +0000 (05:55 +0000)]
b=609
- Removed all Lustre version printks except for the build version
b=407
- Avoid sending a CANCEL for an aborted/failed lock enqueue
adilger [Wed, 15 Jan 2003 17:20:19 +0000 (17:20 +0000)]
Quiet compiler warnings if lprocfs is disabled.
adilger [Tue, 14 Jan 2003 21:19:56 +0000 (21:19 +0000)]
Minor fixups from struct obd_uuid change.
braam [Tue, 14 Jan 2003 00:16:05 +0000 (00:16 +0000)]
- a pretty big patch that replaces our handling of uuid's through
character strings, arrays and a uuid_t uniformly with one type
struct obd_uuid
- goal: fix the lov startup on ia64.
amrutjoshi [Mon, 13 Jan 2003 10:43:31 +0000 (10:43 +0000)]
Removed unused include path
radhikav [Mon, 13 Jan 2003 07:01:57 +0000 (07:01 +0000)]
Some formatting changes and minor additions to the man pages.
adilger [Sat, 11 Jan 2003 23:21:58 +0000 (23:21 +0000)]
Merge fixes from b_md to HEAD so tinderbox can run.
adilger [Sat, 11 Jan 2003 23:00:22 +0000 (23:00 +0000)]
Allow non-local config to be specified.
adilger [Sat, 11 Jan 2003 07:43:32 +0000 (07:43 +0000)]
Fix up the echo.sh config script so that you can use it with LOV configs,
like "LOV=1 NAME=echo sh llmount.sh". Note that LOV configs do not yet
work, but I know where the problem lies (we are not copying the full LOV
MD data to the user buffer primarily, although fixing this entails a bunch
of other changes I think).
adilger [Fri, 10 Jan 2003 18:41:29 +0000 (18:41 +0000)]
Merge lprocfs changes from b_intel to b_md.
This code is tagged as MD_INTEL_BASE in b_intel, so that we can do further
merges from b_intel before we land b_md on HEAD if needed.
amey_inamdar [Thu, 9 Jan 2003 10:21:36 +0000 (10:21 +0000)]
System Profiling Script.
Creates a tar-ball of :
1) OProfile (Global profiles, Per module profile, Profiled Source)
2) vmstat
3) iostat
4) /proc dumps (interrupts, meminfo, net/dev)
Other profiling tools can be easily incorporated.
adilger [Wed, 8 Jan 2003 18:23:23 +0000 (18:23 +0000)]
file lkcdmap was initially added on branch b_md.
rread [Tue, 7 Jan 2003 18:06:52 +0000 (18:06 +0000)]
* add mdsdev support to ldap
* install ldap files
thantry [Tue, 7 Jan 2003 01:36:02 +0000 (01:36 +0000)]
file unlink.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:36:01 +0000 (01:36 +0000)]
file umount.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:36:00 +0000 (01:36 +0000)]
file truncate.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:59 +0000 (01:35 +0000)]
file stat.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:58 +0000 (01:35 +0000)]
file openunlink.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:57 +0000 (01:35 +0000)]
file opennew.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:56 +0000 (01:35 +0000)]
file openexists.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:55 +0000 (01:35 +0000)]
file openclose-100-25t.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:54 +0000 (01:35 +0000)]
file openclose-100-10t.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:53 +0000 (01:35 +0000)]
file openclose-1.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:52 +0000 (01:35 +0000)]
file open-close-100.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:51 +0000 (01:35 +0000)]
file mount.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:50 +0000 (01:35 +0000)]
file mkdir.1.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:49 +0000 (01:35 +0000)]
file fstat.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:48 +0000 (01:35 +0000)]
file directio-2.log was initially added on branch b_intel.