Whamcloud - gitweb
adilger [Thu, 6 Feb 2003 23:25:55 +0000 (23:25 +0000)]
Update for l10 kernel version.
adilger [Wed, 5 Feb 2003 22:37:18 +0000 (22:37 +0000)]
Fixups to sanity.sh and createtest.c so it passes when run as a non-root
user (to keep Terry happy ;-).
We're not doing extensive permission testing here - leave that to POSIX.
adilger [Wed, 5 Feb 2003 21:55:30 +0000 (21:55 +0000)]
Fix for bug 695, and a regression test to go with it (get rid of hard-coded
pathnames in sanity.sh while I'm at it ;-).
These are only client-side checks (the MDS does it's own checking for
both mds_open() and mds_reint_create() so that we don't create a bogus
file type).
adilger [Wed, 5 Feb 2003 21:45:43 +0000 (21:45 +0000)]
Regression test for bug 695.
eeb [Wed, 5 Feb 2003 17:45:18 +0000 (17:45 +0000)]
* Added lock enqueue/cancel ioctl interface to echo_client, with proper
teardown on (possibly unexpected) client exit.
* added '-l' flag to utils/obdio, so that it locks the extent it writes,
then reads back.
* took 'filter' prefix off /proc stats interface in filter and copied it
into the echo OBD; obdstats takes obd type name parameter as well as
optional repeat interval.
adilger [Mon, 3 Feb 2003 19:21:17 +0000 (19:21 +0000)]
Fix typo for patch series.
adilger [Mon, 3 Feb 2003 18:31:10 +0000 (18:31 +0000)]
Update kernel patches for hp kernel.
shaver [Mon, 3 Feb 2003 18:25:50 +0000 (18:25 +0000)]
Fix recovery underpinnings:
- Store the client's UUID (from last_rcvd) in exp_client_uuid, so
target_handle_connect can match it up.
- Don't obd_connect if target_handle_reconnect matched us up with an existing
export.
- Don't invalidate everything so eagerly: only if we can't recover and it
wasn't a partition-reconnect.
- Clear the in-recovery flag before we send clients their delayed replies.
- Add "force" argument to lctl cleanup, and remove it from detach.
- Use new lmc API for recovery-small.sh (more test cleanup coming).
braam [Sat, 1 Feb 2003 21:58:03 +0000 (21:58 +0000)]
- temporary debugging stuff - this will slow you down.
adilger [Sat, 1 Feb 2003 07:42:42 +0000 (07:42 +0000)]
Add invalidate-show patch to kernel.
Move docs to a more noticable place.
pschwan [Fri, 31 Jan 2003 21:37:21 +0000 (21:37 +0000)]
Merge b_intent into b_md:
- New kernel patch (version 9)
- DLM hooks to revalidate locked data, once the lock is granted (604)
- Further MDS reorganization, particularly of the open and o_creat paths
pschwan [Fri, 31 Jan 2003 21:15:10 +0000 (21:15 +0000)]
- merge b_md into b_intent
- rename invalidate-show.diff, at andreas's request
shaver [Fri, 31 Jan 2003 19:06:33 +0000 (19:06 +0000)]
- Clean up, but don't error out if some parts fail.
- ONLY for easier controlled-reproduction.
- Error codes count.
braam [Thu, 30 Jan 2003 22:27:04 +0000 (22:27 +0000)]
- error handling fixes from Andreas
pschwan [Thu, 30 Jan 2003 21:09:09 +0000 (21:09 +0000)]
an open(O_LOV_CREATE_DELAY) test
pschwan [Thu, 30 Jan 2003 20:27:07 +0000 (20:27 +0000)]
- return 0, not ENOENT, from a failed lookup in mds_open
braam [Thu, 30 Jan 2003 19:40:16 +0000 (19:40 +0000)]
- fill inodes if files exist
shaver [Thu, 30 Jan 2003 19:24:58 +0000 (19:24 +0000)]
New recovery regression -- hard-coded node names, probably other badness,
but it's finding bugs now, so I'm checking it in.
braam [Thu, 30 Jan 2003 07:18:38 +0000 (07:18 +0000)]
- more error handling
braam [Thu, 30 Jan 2003 05:17:01 +0000 (05:17 +0000)]
- add iod rmap patches to b_intent
braam [Thu, 30 Jan 2003 05:07:54 +0000 (05:07 +0000)]
- fix typo
adilger [Wed, 29 Jan 2003 22:13:06 +0000 (22:13 +0000)]
Add patch to be more verbose about which inodes are busy at unmount time
(for "VFS: Busy inodes" message). Not added to any patchsets yet (I leave
it up to Peter to decide if he wants it applied to our kernels by default).
eeb [Wed, 29 Jan 2003 21:17:33 +0000 (21:17 +0000)]
* added /proc stats to obdfilter; should be general purpose and in lprocfs
* added utils/obdstat for monitoring stats
* added utils/obdio.c for exercising servers via echo_client.
* echo_client does auto close when user proc exits
braam [Wed, 29 Jan 2003 19:51:34 +0000 (19:51 +0000)]
- fix for O_EXCL case in mds_open
- updates to cray plan
- remove unnecessary error handling from
mdc_completion_callback
pschwan [Wed, 29 Jan 2003 15:47:52 +0000 (15:47 +0000)]
- don't call mds_pack_md for non-regular files in mds_validate_dentry (doh)
- add an mcreate/open test to sanity
b_intent gets back to sanity #27 again
braam [Wed, 29 Jan 2003 06:39:51 +0000 (06:39 +0000)]
- fill in ea in mds open when file exists.
adilger [Wed, 29 Jan 2003 01:08:24 +0000 (01:08 +0000)]
Add the sync-on-unmount fix, and another fix which avoids accessing freed
inodes upon ENOSPC or other errors (from AKPM).
The Makefile should be smart enough to detect if they need to be applied.
adilger [Tue, 28 Jan 2003 06:35:12 +0000 (06:35 +0000)]
Updates to vfs_intent_hp.patch for PNNL (bug 727).
This may or may not work, as I haven't had a chance to test, but it is 95%.
braam [Tue, 28 Jan 2003 05:26:51 +0000 (05:26 +0000)]
- don't clobber flags
braam [Tue, 28 Jan 2003 05:02:22 +0000 (05:02 +0000)]
- lib lustre planning document
- mds server document
- return detailed status in body->flags
pschwan [Tue, 28 Jan 2003 04:17:24 +0000 (04:17 +0000)]
don't dereference NULL or freed mfd in mds_open
pschwan [Tue, 28 Jan 2003 04:11:16 +0000 (04:11 +0000)]
- do an mntget() before dentry_open()
pschwan [Mon, 27 Jan 2003 22:50:29 +0000 (22:50 +0000)]
- remove unused mfd_clienthandle
- fix double semaphore up() in mds_open
pschwan [Mon, 27 Jan 2003 21:24:48 +0000 (21:24 +0000)]
- added ldlm_lock_decref_and_cancel, to eliminate _that_ particular race
- don't send an extra buffer to the MDS if the EA length is zero
- andreas's fix to initialize rc to 0 in mds_open
- removed some tabvs
- in mds_reint_setattr, don't set the MD if the client didn't send one
- in mds_reint_create, ericm's fix for the POSIX nametoolong bug
- fix mds_open prototype in mds_reint.c
braam [Fri, 24 Jan 2003 19:22:23 +0000 (19:22 +0000)]
- probable fix for mds refcount problem. touch /mnt/lustre/f cleans up now.
braam [Thu, 23 Jan 2003 22:04:25 +0000 (22:04 +0000)]
another bug fix.
braam [Thu, 23 Jan 2003 22:00:48 +0000 (22:00 +0000)]
- some bug fixes
braam [Thu, 23 Jan 2003 18:39:20 +0000 (18:39 +0000)]
- new file
adilger [Wed, 22 Jan 2003 13:47:16 +0000 (13:47 +0000)]
Fix one cause of bug 430 (hardlinks) that showed up with simul, but this was
a recently introduced bug and not the real source of problems. Back to the
drawing board in terms of finding a repeatable testcase. The only thing
learned from this and the previous extN orphan assertion (bug 670) is that
they were both caused by dentry refcount problems, and the files related
to that dentry refcount were unlinked.
adilger [Wed, 22 Jan 2003 10:10:25 +0000 (10:10 +0000)]
Fixes for several bugs:
- bug 670 (extN orphan inode assertion when fs is full - didn't dput enough)
- bug 445 (get file size before file write to avoid ll_prepare_write zero)
- we need to optimize ll_file_size() so we don't do getattr RPCs when we
don't really need to (i.e. if we are already holding the size lock)
- added testcases to sanityN.sh for this bug
- bug 607 (set/get mtime on OST instead of MDS)
- need to use osc_setattr and lov_setattr for the first time to allow mtime
setattrs into the past (for tar or touch-with-a-time), but not used under
normal usage because the OST updates the time locally for each write
pschwan [Tue, 21 Jan 2003 17:49:17 +0000 (17:49 +0000)]
- make acceptance-metadata-single a little cleaner
- remove spurious errors, deprecated filehandle names from rename/create.pl
adilger [Tue, 21 Jan 2003 03:17:02 +0000 (03:17 +0000)]
Move jbd callback changes to a separate .pc file from vanilla-2.4.19.pc
adilger [Mon, 20 Jan 2003 23:52:28 +0000 (23:52 +0000)]
Split out the jbd callback patches from vanilla-2.4.19 so that we can use
them with the hp-pnnl series also. I would have done the same for the
vanilla-2.4.18 patch, but it was already out of date w.r.t. the recent
Lustre l7 changes.
pschwan [Mon, 20 Jan 2003 23:23:08 +0000 (23:23 +0000)]
- add my little single-node metadata test
- small output changes to rename/create.pl
braam [Mon, 20 Jan 2003 04:21:05 +0000 (04:21 +0000)]
- kernel patches for vanilla 2.4.19, 2.4.19-hp2-2 (not tested much)
- tiny fix to dcache.c
pschwan [Sat, 18 Jan 2003 22:50:12 +0000 (22:50 +0000)]
- ldlm_lock_match now accepts two flags: LDLM_FL_CBPENDING to allow matching of
dying locks, and LDLM_FL_LOCAL_ONLY to only match locks with _FL_LOCAL set
- use enqueue_ordered_locks in mds_reint_unlink, too, to avoid deadlock.
untested.
- small fix to rename.pl
braam [Sat, 18 Jan 2003 19:13:44 +0000 (19:13 +0000)]
- a torture test for renames
adilger [Thu, 9 Jan 2003 23:49:23 +0000 (23:49 +0000)]
Merge of HEAD into b_intel.
Some fixes along the way - whitespace cleanup, etc.
Also made obd_statfs_self() _way_ more efficient, which is pretty crucial
given that it is called once for almost every entry in lprocfs.
cvs2svn [Thu, 9 Jan 2003 10:21:38 +0000 (10:21 +0000)]
This commit was manufactured by cvs2svn to create branch 'unlabeled-1.1.2'.
amey_inamdar [Thu, 9 Jan 2003 10:21:36 +0000 (10:21 +0000)]
System Profiling Script.
Creates a tar-ball of :
1) OProfile (Global profiles, Per module profile, Profiled Source)
2) vmstat
3) iostat
4) /proc dumps (interrupts, meminfo, net/dev)
Other profiling tools can be easily incorporated.
adilger [Wed, 8 Jan 2003 18:23:25 +0000 (18:23 +0000)]
Simple script to generate lkcd module symbols and commands for pasting
into lkcd (no "source" command it appears).
adilger [Wed, 8 Jan 2003 18:23:23 +0000 (18:23 +0000)]
file lkcdmap was initially added on branch b_md.
thantry [Tue, 7 Jan 2003 01:36:04 +0000 (01:36 +0000)]
Adding logs for various system calls on a single-node lustre stack.
These can be used as inputs to llvisualize to visualize call graphs.
thantry [Tue, 7 Jan 2003 01:36:02 +0000 (01:36 +0000)]
file unlink.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:36:01 +0000 (01:36 +0000)]
file umount.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:36:00 +0000 (01:36 +0000)]
file truncate.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:59 +0000 (01:35 +0000)]
file stat.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:58 +0000 (01:35 +0000)]
file openunlink.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:57 +0000 (01:35 +0000)]
file opennew.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:56 +0000 (01:35 +0000)]
file openexists.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:55 +0000 (01:35 +0000)]
file openclose-100-25t.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:54 +0000 (01:35 +0000)]
file openclose-100-10t.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:53 +0000 (01:35 +0000)]
file openclose-1.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:52 +0000 (01:35 +0000)]
file open-close-100.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:51 +0000 (01:35 +0000)]
file mount.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:50 +0000 (01:35 +0000)]
file mkdir.1.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:49 +0000 (01:35 +0000)]
file fstat.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:48 +0000 (01:35 +0000)]
file directio-2.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:47 +0000 (01:35 +0000)]
file directio-1024.log was initially added on branch b_intel.
thantry [Tue, 7 Jan 2003 01:35:46 +0000 (01:35 +0000)]
file chmod.log was initially added on branch b_intel.
adilger [Mon, 6 Jan 2003 22:22:15 +0000 (22:22 +0000)]
Merge b_md to HEAD for 0.5.19 release.
Fixes a _huge_ number of bugs:
- Fully reactivate OST imports after reconnection (512, others)
- Make sure client sees our -ENOTCONN from mds_handle (513 - partial)
- More graceful error handling for truncating on dead OST (515)
- Don't error out unless we're actually accessing dead stripes (474)
- Fix garbage sizes when stripes are missing (410)
- LRU counters were broken, causing constant lock purge (433, 432)
- garbage on read from stripes with failed OSTs (441)
- mark OSCs as active before reconnecting during recovery (438)
- lov_enqueue and lov_cancel need to handle inactive OSTs (403)
- lfind did not preserve OST order in output (443)
- symlinks cause hung clients, incorrect data (439)
- stop dereferencing request after dropping refcount (457)
- don't LASSERT(spin_is_locked) on non-SMP (455)
- fixes for many rename() bugs
- fstat didn't correctly synchronize attributes (399)
- server must handle lock cancellation during blocking AST prep (487)
- bulk descriptors were free()d too soon (511)
- fix paths in lconf, which would load incorrect modules (451, 507)
- fix confusing lconf 'host not found' error message (386)
- fix lock order deadlock on OST (O/R i_sem before journal ops, 478)
- fix race condition in mdc_blocking_ast() for inode access (526)
- fix lov_unpackmd() unpacking wrong number of stripes (537)
- fix lov_set_osc_active() marking wrong OSC inactive (440)
- fix bad lstripe lov_unpackmd() assertion (fix layering too) (527)
- fix multiple writes of stripe MD to MDS (358, maybe 519)
- fix lstripe in several ways (kernel side) (527)
- fix request leak in ldlm_cli_enqueue (262)
- incorrect OSC was marked inactive after OST failure
- call mds_fs_cleanup before unmounting filesystem (524)
- fix races between taking ns_lock and ldlm_lock_change_resource
- fix races updating LOV export open file list
- fix lov_enqueue error path, avoid decref-ing bad lock handle
- fix recovery NULL deref in ldlm_cli_cancel_unused
- fix some DLM races by using new hash table for lock handles (419)
- permit the client to specify desired inodes, at replay
- duplicate requests when we queue them for replay reintegration
- fix last_rcvd offset calculation
- sync after each recovered transaction, so we always make progress
- never, not always, ERESTART requests without transnos
- store the lov_desc in the MDS, so we don't depend on getlovinfo to set it
- skip replay if the MDS says that the client is already connected
- don't check for a recovery-enabled export to match lctl's UUID
- don't INC_USE_COUNT for phantom exports
- don't crash when cleaning up phantom exports (567)
- don't double-finish or set replay data for errored mdc_open requests
- abort requests when they time out, so we don't get old replies
- send/receive replies for AST messages again
- if the client says that it doesn't have the lock, cancel it on the server
- if we timeout during I/O, don't try to cancel an in-use lock; instead
mark it as destroyed, it will all work out when decref is called
- fix module use counts (22, 581)
* protocol changes
- ASTs now expect a reply (server cancels lock on error reply)
adilger [Mon, 6 Jan 2003 21:38:48 +0000 (21:38 +0000)]
Revert PtlGet changes because they broke IOR.
adilger [Mon, 6 Jan 2003 09:12:32 +0000 (09:12 +0000)]
- Fix module use counts (bug 581, 22). This makes it impossible to unload
a module while it is in use, and also removes a bunch of code (125 lines).
- Update 2.5 ll_clear_inode() to match 2.4 code (cancel locks). Currently
commented out, because I'm not sure why it is different (on purpose or
just omission?).
- Add types to obd_{un,}pack_ioo().
nfshp [Sat, 4 Jan 2003 14:39:45 +0000 (14:39 +0000)]
- fix a typo which could cause serious problem
- add code of bulk flushing in ll_writepage() (not tested)
shorthair [Sat, 4 Jan 2003 12:58:34 +0000 (12:58 +0000)]
This kernel patch can support some basic sys_call for lustre
adilger [Fri, 3 Jan 2003 23:50:29 +0000 (23:50 +0000)]
Remove RHisms from ptlbd.
adilger [Fri, 3 Jan 2003 23:49:21 +0000 (23:49 +0000)]
ia64 fixups
adilger [Fri, 3 Jan 2003 23:22:49 +0000 (23:22 +0000)]
Use PtlGet from the target instead of PtlPut from the client for writes.
adilger [Fri, 3 Jan 2003 23:05:11 +0000 (23:05 +0000)]
Quiet a few more ia64 type-size mismatches.
adilger [Fri, 3 Jan 2003 22:24:57 +0000 (22:24 +0000)]
Get rid of unused ichild, and casting of arg to int before assigning to ptr
(complaints on ia64).
adilger [Fri, 3 Jan 2003 18:41:22 +0000 (18:41 +0000)]
Remove ll_pack.c from being included into basically every module, and make
it an exported function from obdclass. This also solves the dependency
problem with fsfilt_extN and fsfilt_reiserfs for these functions (b=570).
adilger [Fri, 3 Jan 2003 18:41:19 +0000 (18:41 +0000)]
file statfs_pack.c was initially added on branch b_md.
thantry [Fri, 3 Jan 2003 00:53:19 +0000 (00:53 +0000)]
Adding patches necessary for intel kernels into sourceforge.
The rh-8.0-intel series captures, in addition to all the lustre
specific patches the remaining two patches necessary(or of interest)
to the Intel cluster.
thantry [Fri, 3 Jan 2003 00:53:17 +0000 (00:53 +0000)]
file tcp_zero.txt was initially added on branch b_intel.
thantry [Fri, 3 Jan 2003 00:53:16 +0000 (00:53 +0000)]
file e1000.txt was initially added on branch b_intel.
thantry [Fri, 3 Jan 2003 00:53:15 +0000 (00:53 +0000)]
file rh-8.0-intel was initially added on branch b_intel.
thantry [Fri, 3 Jan 2003 00:53:14 +0000 (00:53 +0000)]
file tcp_zero.pc was initially added on branch b_intel.
thantry [Fri, 3 Jan 2003 00:53:13 +0000 (00:53 +0000)]
file e1000.pc was initially added on branch b_intel.
thantry [Fri, 3 Jan 2003 00:53:12 +0000 (00:53 +0000)]
file tcp_zero.patch was initially added on branch b_intel.
thantry [Fri, 3 Jan 2003 00:53:11 +0000 (00:53 +0000)]
file e1000.patch was initially added on branch b_intel.
nfshp [Thu, 2 Jan 2003 13:10:40 +0000 (13:10 +0000)]
add a patch for extN, which is needed by b_san.
nfshp [Thu, 2 Jan 2003 13:10:38 +0000 (13:10 +0000)]
file extN-san.diff was initially added on branch b_san.
pschwan [Wed, 1 Jan 2003 17:20:38 +0000 (17:20 +0000)]
- reintroduce replies in LDLM AST packets
- if the client doesn't know about the lock, return -EINVAL
- if the server receives an error from the client, cancel it straight away
- if the server times out waiting for the reply, call expired_completion_wait
- initialize the import lists in target_handle_connect
- fix some ENOMEM MDS crash bugs just waiting to happen
- in the MDS_DISCONNECT handler, don't dereference just-freed mds_export_data
rread [Tue, 31 Dec 2002 00:53:21 +0000 (00:53 +0000)]
* support mutlitple mds with one uuid (539)
lmc --add mds --mds mds1 --node hostA ...
lmc --add mds --mds mds1 --node hostB ...
Creates two different mdsdev in the config, and one mds. The lovconfig
reference is now attached to the mds service instead of the node, so both
mdsdevs can configure the LOVs.
Needless to say, the xml format has changed yet again, so
regenerate those configs.
shaver [Mon, 30 Dec 2002 21:10:47 +0000 (21:10 +0000)]
- Add extN select-inum-for-allocation support, and use it to make recovery-time
inode creation more deterministic.
- Test program and ioctl for the aforementioned wantedi support.
- Don't send MSG_LAST_REPLAY with the last-replayed lock. Really. I mean it
this time.
- Some transno-reintegration CERROR removal, because the 9600bps conman on dev
cramps the style of 300-transaction replays something fierce.
- Sync after every integrated transaction, so that we make forward progress
in case of interrupted recovery. (This will be replaced by the handle->h_sync
fix foreshadowed in fsfilt_extN_commit.)
- Reuse reply_md.start instead of the likely-NULL rq_repmsg when resending reqs.
- Requests without transnos should be ERESTARTed _never_, not _always_.
shaver [Mon, 30 Dec 2002 21:10:45 +0000 (21:10 +0000)]
file wantedi.c was initially added on branch b_md.
shaver [Mon, 30 Dec 2002 21:10:07 +0000 (21:10 +0000)]
file extN-wantedi.diff was initially added on branch b_md.
shaver [Mon, 30 Dec 2002 21:10:02 +0000 (21:10 +0000)]
file .cvsignore was initially added on branch b_md.
hitao [Sun, 29 Dec 2002 06:51:33 +0000 (06:51 +0000)]
delete the temp patch files from the repository
adilger [Sat, 28 Dec 2002 01:32:06 +0000 (01:32 +0000)]
Remove hyphen that was added to basename in createmany and statmany, so we
can run them on an OST filesystem directly (either to test or create).