Whamcloud - gitweb
adilger [Mon, 23 Sep 2002 23:44:13 +0000 (23:44 +0000)]
Update htree patch to apply to the RH kernel. To keep it usable on
other kernels (since this change is not yet even in 2.4.20-pre7) we should
have a separate pre-patch which does only the RH fixes themselves to a
stock kernel.
rread [Mon, 23 Sep 2002 21:27:35 +0000 (21:27 +0000)]
* add ignore_error cmd to lctl
* use it in lconf during cleanup so errors are non-fatal
* return lctl exit status in lconf properly
pschwan [Sun, 22 Sep 2002 03:32:28 +0000 (03:32 +0000)]
b=612449
Fix two bugs related to file attributes:
1. We were accidentally clobbering the mode with the mode from the OST in
ll_file_size
2. We were not updating the file attributes in ll_find_inode
Both are fixed, and inode attributes are once again coherent.
pschwan [Sun, 22 Sep 2002 02:47:48 +0000 (02:47 +0000)]
b=605627
Fixes two bugs related to 605627 that have been present since we started
correctly reusing inodes.
- We were giving up locks at file close time, but not throwing away file data
pages. Fixed, by adding a flag to the blocking callback. It's now called
under two different circumstances: when a lock needs to be given up
(LDLM_CB_BLOCKING) and when a lock is about to be freed (LDLM_CB_DYING)
- We were not refreshing inode attributes (notably size) correctly. I brute
force this by always calling ll_file_size() in ll_inode_revalidate, but this
needs some obvious immediate refinement.
As an aside, I noticed that the DLM API documentation gives almost no mention
to the arguments or calling conventions of the callback functions.
eeb [Fri, 20 Sep 2002 21:05:50 +0000 (21:05 +0000)]
Modifications for "circulating" request buffers (sized in lustre_net.h)
gord-fig [Fri, 20 Sep 2002 19:43:07 +0000 (19:43 +0000)]
Use slightly more robust way of making configure depend on lustre.spec.in
rread [Fri, 20 Sep 2002 18:43:49 +0000 (18:43 +0000)]
* attempt to return proper exit codes when errors occur
* remove unnecessary --get <url> option
adilger [Fri, 20 Sep 2002 16:15:42 +0000 (16:15 +0000)]
Fix typo.
gord-fig [Fri, 20 Sep 2002 15:00:05 +0000 (15:00 +0000)]
Allow the user to specify lmc and config filenames.
adilger [Fri, 20 Sep 2002 09:25:15 +0000 (09:25 +0000)]
Add in IT_LINK2.
adilger [Fri, 20 Sep 2002 09:18:19 +0000 (09:18 +0000)]
Updates for v0_5_11
adilger [Fri, 20 Sep 2002 09:13:28 +0000 (09:13 +0000)]
Don't bug if we run out of space on the MDS when storing an EA.
adilger [Fri, 20 Sep 2002 09:10:47 +0000 (09:10 +0000)]
Don't just barf if we can't allocate memory.
adilger [Fri, 20 Sep 2002 09:09:34 +0000 (09:09 +0000)]
64-bit printout cleanups.
adilger [Fri, 20 Sep 2002 09:08:17 +0000 (09:08 +0000)]
Don't return an error code if we already have a reply buffer.
adilger [Fri, 20 Sep 2002 09:06:00 +0000 (09:06 +0000)]
Return the rename tests to runtests.
Check for allocation leaks between the start and end of the run (this will
probably complain on BA OSTs, because presumably they are consuming space
for their subdirectories.
Add "-v" verbose option.
adilger [Fri, 20 Sep 2002 08:05:06 +0000 (08:05 +0000)]
Re-add memset() of request struct, since we re-use the same struct many times.
shaver [Fri, 20 Sep 2002 00:38:00 +0000 (00:38 +0000)]
- Parallel recovery implementation, to match documented design.
- Handle failed client recovery by simply restarting recovery. Not perfect, but
surprisingly useful for testing.
adilger [Thu, 19 Sep 2002 23:19:55 +0000 (23:19 +0000)]
Add link support to vanilla kernel patch.
adilger [Thu, 19 Sep 2002 22:35:34 +0000 (22:35 +0000)]
Set the EASIZE valid flag in the MDS body, so the filesystem knows there
is EA data available.
adilger [Thu, 19 Sep 2002 22:33:19 +0000 (22:33 +0000)]
Add a comment on why we don't return a lock for some operations.
adilger [Thu, 19 Sep 2002 22:32:37 +0000 (22:32 +0000)]
Fix comments, add declaration for simple_mknod().
rread [Thu, 19 Sep 2002 22:27:27 +0000 (22:27 +0000)]
* add support for gmnal to ptlrpc
braam [Thu, 19 Sep 2002 20:53:53 +0000 (20:53 +0000)]
- add hardlink support
- update kernel patch
- simple create method for obdfilter instead of filp open
- add mcr-* config files
- add cobd document draft 1.
braam [Thu, 19 Sep 2002 20:50:26 +0000 (20:50 +0000)]
- add collaborative caching document. Radhika: one more pass and add
pictures before we distribute.
adilger [Thu, 19 Sep 2002 20:12:53 +0000 (20:12 +0000)]
Add --dump option to usage output.
pschwan [Thu, 19 Sep 2002 18:28:18 +0000 (18:28 +0000)]
- Added preventative locking in two areas, where we're walking shared lists
- Fixed a subtle race condition in ldlm_local_lock_enqueue: we checked to see if
a completion AST had been received and then acted, with no lock. This fixes
the assertion that I was seeing yesterday.
braam [Thu, 19 Sep 2002 17:50:26 +0000 (17:50 +0000)]
add a note for 0.5.9
adilger [Thu, 19 Sep 2002 08:15:23 +0000 (08:15 +0000)]
Don't allocate so much space on the stack!!!
pschwan [Thu, 19 Sep 2002 08:09:35 +0000 (08:09 +0000)]
Avoid allocating 'event' and 'request' on the stack (saving some 350 bytes),
because there is strong evidence that we are running out of space in some call
paths
adilger [Wed, 18 Sep 2002 23:27:17 +0000 (23:27 +0000)]
Update uml.xml as generated by a more recent lmc.
adilger [Wed, 18 Sep 2002 23:25:01 +0000 (23:25 +0000)]
Use $TMP variable, if set, for storing temp loopback files.
shaver [Wed, 18 Sep 2002 21:36:41 +0000 (21:36 +0000)]
Ignore PtlPut error, so that we will still timeout and trigger recovery.
(This case occurs when the MDS or OST drops off the elan network, for
example.)
adilger [Wed, 18 Sep 2002 20:07:30 +0000 (20:07 +0000)]
Change port numbers to 988, now that BA OSTs also use that port.
adilger [Wed, 18 Sep 2002 18:18:52 +0000 (18:18 +0000)]
Updates for 0.5.8 release.
eeb [Wed, 18 Sep 2002 18:17:26 +0000 (18:17 +0000)]
increased request buffering for the OST service
pschwan [Wed, 18 Sep 2002 17:47:05 +0000 (17:47 +0000)]
Probably memory corruption bug: the file lock bits weren't aware that
stripe_count==0 is legal, so they were allocating a 0-byte lock array that
would hold one 16-byte lock handle. Fixed.
adilger [Wed, 18 Sep 2002 16:51:42 +0000 (16:51 +0000)]
Fixup readme a bit to reflect reality.
Add object type to test_getattr obdo, so it works with obdfilter.
Fix up threading again, for "asked-for-threads-but-not-running-threads" case.
shaver [Wed, 18 Sep 2002 14:39:12 +0000 (14:39 +0000)]
Allow caller to specify autoconf program to use, in order to support systems
with both 2.13 and 2.53.
braam [Wed, 18 Sep 2002 05:44:26 +0000 (05:44 +0000)]
- add manual pages with configuration help.
- of particular importance is lustre-conf.
- this is included as a new chapter in the book.
braam [Wed, 18 Sep 2002 03:33:19 +0000 (03:33 +0000)]
- add templates for manpages.
adilger [Tue, 17 Sep 2002 22:38:27 +0000 (22:38 +0000)]
Fix "thread" parameters for test_brw and test_getattr for non-threaded tests.
adilger [Tue, 17 Sep 2002 22:30:26 +0000 (22:30 +0000)]
Fix problem with shell escaping of variables.
adilger [Tue, 17 Sep 2002 22:06:20 +0000 (22:06 +0000)]
Fix badness in test scripts.
gord-fig [Tue, 17 Sep 2002 21:11:18 +0000 (21:11 +0000)]
Clean up runtests for inclusion in ltest.
adilger [Tue, 17 Sep 2002 20:19:12 +0000 (20:19 +0000)]
Todo comment.
gord-fig [Tue, 17 Sep 2002 20:11:35 +0000 (20:11 +0000)]
Look for compat flag in GS_OPTIONS.
rread [Tue, 17 Sep 2002 19:19:39 +0000 (19:19 +0000)]
* now current with lmc and lconf
pschwan [Tue, 17 Sep 2002 19:00:13 +0000 (19:00 +0000)]
b=596503
b=608680
Reenable bits of dentry caching by doing lock matching for LOOKUP intents in
ll_revalidate2.
adilger [Tue, 17 Sep 2002 16:43:01 +0000 (16:43 +0000)]
Remove the locking warning added yesterday.
I now see that this was fixed by the "re-get file attributes after we
get the file lock" change, which seemed sort of overkill at the time...
gord-fig [Tue, 17 Sep 2002 16:23:44 +0000 (16:23 +0000)]
Use make distdir to generate a pristine source tree because we need to keep around some files that are clobbered by distclean.
gord-fig [Tue, 17 Sep 2002 15:24:57 +0000 (15:24 +0000)]
Appease tex2pdf.
adilger [Mon, 16 Sep 2002 23:17:29 +0000 (23:17 +0000)]
Should only happen with lctl, but just to be safe...
adilger [Mon, 16 Sep 2002 23:10:40 +0000 (23:10 +0000)]
Replace all of the "char[37]" uses with obd_uuid_t.
adilger [Mon, 16 Sep 2002 22:58:58 +0000 (22:58 +0000)]
Prevent false "leak" because of OBD memory accounting.
adilger [Mon, 16 Sep 2002 22:52:30 +0000 (22:52 +0000)]
Remove the extra magic from mds_extN.c for now (we will get it back soon).
adilger [Mon, 16 Sep 2002 22:46:35 +0000 (22:46 +0000)]
Put checks for LOV magic into LOV code, what a good idea.
adilger [Mon, 16 Sep 2002 22:42:09 +0000 (22:42 +0000)]
Don't look at the EA magic in the filesystem, but use the FLEASIZE flag.
adilger [Mon, 16 Sep 2002 22:40:50 +0000 (22:40 +0000)]
TODO message.
adilger [Mon, 16 Sep 2002 22:37:25 +0000 (22:37 +0000)]
Remove setup code from runregression-net.sh and runregression-brw.sh.
You need to set up lustre before running these scripts now.
braam [Mon, 16 Sep 2002 22:33:16 +0000 (22:33 +0000)]
- a fix for Gary's directory read-back bug. You can now create lots
of files and ls shows them. Fixes include updating the directory
size during readdir by passing back the size in the readdir call.
Every directory has at least one page, so this works.
braam [Mon, 16 Sep 2002 21:27:49 +0000 (21:27 +0000)]
- a fix for single node rm `pwd` problems. The distributed case is
more involved and we'll have to see about that.
rread [Mon, 16 Sep 2002 19:35:31 +0000 (19:35 +0000)]
* print a message when a duplicate mds or lov name is used
adilger [Mon, 16 Sep 2002 18:51:18 +0000 (18:51 +0000)]
Fix help message for --threads.
adilger [Mon, 16 Sep 2002 18:50:37 +0000 (18:50 +0000)]
Allow OBD UUID to be specified explicitly for BA OSTs.
pschwan [Mon, 16 Sep 2002 18:19:20 +0000 (18:19 +0000)]
b=609205
Reenable the throwing away of data locks on file close. This may or may not
be enough to fix 609205, depending on whether that bug is purely related to
running out of memory.
pschwan [Mon, 16 Sep 2002 18:13:03 +0000 (18:13 +0000)]
- add resource and lock counters to the namespace
- add them to the namespace proc directories (which are, tragically, in the
top level of the /proc tree until lprocfs gets sorted out)
- fix a dangling resource refcount bug in ldlm_cli_cancel_unused
rread [Mon, 16 Sep 2002 17:59:49 +0000 (17:59 +0000)]
* add --obduuid <uuid> option so the OBD UUID can be specified
when create an ost. For example:
lmc --node localhost --lov lov1 --obduuid 'REAL_UUID' --ost bluearc
braam [Mon, 16 Sep 2002 17:29:01 +0000 (17:29 +0000)]
minor edits to the patch to work with the Red Hat 2.4.18-12.5 kernel.
adilger [Mon, 16 Sep 2002 06:18:21 +0000 (06:18 +0000)]
Take a LOV default stripe count of "0" to mean striping across all OSTs.
braam [Sat, 14 Sep 2002 07:02:20 +0000 (07:02 +0000)]
- don't forget to pass data and data_len on to the local enqueue
functions.
- do directory truncations when the clients don't modify directory
data and change the dcache.
radhikav [Sat, 14 Sep 2002 05:53:57 +0000 (05:53 +0000)]
Made correction to mdc_statfs prototype and a change to mdc_open API.
rread [Fri, 13 Sep 2002 00:20:13 +0000 (00:20 +0000)]
* ensure mds name used for mtpt is really an mds
* standardize lookup error messages
adilger [Thu, 12 Sep 2002 22:33:05 +0000 (22:33 +0000)]
Minor fix for getting the EA size.
pschwan [Thu, 12 Sep 2002 17:47:29 +0000 (17:47 +0000)]
b=597333
Remove unused ELDLM_RESOURCE_FREED
adilger [Thu, 12 Sep 2002 15:39:20 +0000 (15:39 +0000)]
Allos statfs to return values larger than 16TB.
adilger [Thu, 12 Sep 2002 13:33:57 +0000 (13:33 +0000)]
This should fix the LOV problem. All is well.
adilger [Thu, 12 Sep 2002 12:13:59 +0000 (12:13 +0000)]
Fix lov stripe offset calculations.
adilger [Thu, 12 Sep 2002 09:48:07 +0000 (09:48 +0000)]
Set lsm_magic to LOV_MAGIC.
Fix stripe OST allocation policy slightly.
adilger [Thu, 12 Sep 2002 09:24:32 +0000 (09:24 +0000)]
Allow the default stripe_count to be specified in the XML config, and also
read this value instead of the "stripe_offset" for which we have no use.
Set an objid for lctl create, so we get one step closer to support of
test_brw for LOV devices.
adilger [Thu, 12 Sep 2002 09:02:10 +0000 (09:02 +0000)]
Make sure we remove extN_fs.h when building new.
adilger [Thu, 12 Sep 2002 09:01:27 +0000 (09:01 +0000)]
Fix minor printf breakage introduced today.
adilger [Thu, 12 Sep 2002 07:32:54 +0000 (07:32 +0000)]
Update the README to describe the usage of the XML configuration files.
Also update runtests to do setup and cleanup with an XML file as a parameter.
Allow the llecho.sh script to build a config that will run on two separate
hosts if desired.
adilger [Thu, 12 Sep 2002 06:54:45 +0000 (06:54 +0000)]
Make runtests take an XML config file as a parameter.
braam [Thu, 12 Sep 2002 06:03:46 +0000 (06:03 +0000)]
Put the HOWTO back in the book.
adilger [Thu, 12 Sep 2002 05:23:02 +0000 (05:23 +0000)]
Add a bit of debugging for LOV sub-object allocation, so we can track it
more easily.
adilger [Thu, 12 Sep 2002 05:08:40 +0000 (05:08 +0000)]
Fix minor braino.
adilger [Thu, 12 Sep 2002 04:24:17 +0000 (04:24 +0000)]
Add definition for O_DIRECT since it is not in the headers yet.
adilger [Thu, 12 Sep 2002 04:05:52 +0000 (04:05 +0000)]
Add O_LARGEFILE and O_DIRECT to openclose test so we can eventually stress
test the kernel for O_DIRECT again.
adilger [Thu, 12 Sep 2002 00:47:45 +0000 (00:47 +0000)]
Large commit which implements more "intelligent" offsets for stripe
creation in the LOV. Most of it is just variable renaming.
Needs some testing.
rread [Thu, 12 Sep 2002 00:42:13 +0000 (00:42 +0000)]
print message if a server is not found, instead of failing with stack trace.
adilger [Wed, 11 Sep 2002 22:47:20 +0000 (22:47 +0000)]
TODOs for proper LOV test_brw operations (not implemented yet).
adilger [Wed, 11 Sep 2002 22:21:14 +0000 (22:21 +0000)]
Allow the start offset for test_brw be based on the thread number. This
allows the threads to be writing to different parts of the file (instead
of all overwriting the same part of the file), to better simulate a real
client load.
Make thread "offsets" start at zero for objids and file offsets (we need
to keep the actual thread numbers > 0, because thread 0 is the master).
Make be_verbose 64-bit clean, and also handle very large counts.
Validate LOV default stripe count <= OST count.
adilger [Wed, 11 Sep 2002 22:08:40 +0000 (22:08 +0000)]
Use OBD_PUNCH_EOF constant instead of lots of f's.
adilger [Wed, 11 Sep 2002 22:06:51 +0000 (22:06 +0000)]
Move definition of LP[DUX]64 to lustre_lib.h so we can use it in obd.c
adilger [Wed, 11 Sep 2002 22:01:27 +0000 (22:01 +0000)]
Rework the code that Phil spent so much time fixing to be much simpler,
much easier to see correctness, and nano-faster also.
pschwan [Wed, 11 Sep 2002 18:22:57 +0000 (18:22 +0000)]
b=600245
Fixes this bug by remember that sizeof() returns the size in bytes, not bits.
adilger [Wed, 11 Sep 2002 17:41:01 +0000 (17:41 +0000)]
Use sizeof(var) instead of sizeof(type).
adilger [Wed, 11 Sep 2002 17:07:58 +0000 (17:07 +0000)]
Add a define for the "punch to EOF = truncate" constant.
pschwan [Wed, 11 Sep 2002 16:11:09 +0000 (16:11 +0000)]
b=600245
This probably won't fix 600245, but it is related, and would have bitten us
once we grew to more than 32 clients with an ia32 MDS.