Whamcloud - gitweb
nathan [Tue, 14 Mar 2006 19:24:59 +0000 (19:24 +0000)]
Branch b1_4_mountconf
b=9858
remove llrmount
nathan [Mon, 6 Mar 2006 19:10:01 +0000 (19:10 +0000)]
file tcp-rto_proc-2.6.9.patch was added on branch b1_4_mountconf on 2006-04-05 01:14:57 +0000
nathan [Fri, 3 Mar 2006 05:50:14 +0000 (05:50 +0000)]
file lustre_idl.h was added on branch b1_4_mountconf on 2006-04-26 18:45:46 +0000
nathan [Fri, 3 Mar 2006 00:28:12 +0000 (00:28 +0000)]
Branch b1_4_mountconf
b=4482
if there are no osc's, we don't know how big to make the page size
nathan [Thu, 2 Mar 2006 21:55:23 +0000 (21:55 +0000)]
Branch b1_4_mountconf
b=9861
add method to describe multiple failover nodes each with multiple nids to mkfs.lustre.
nathan [Thu, 2 Mar 2006 13:40:01 +0000 (13:40 +0000)]
file lustre_types.h was added on branch b1_4_mountconf on 2006-04-26 18:45:44 +0000
nathan [Thu, 2 Mar 2006 13:39:59 +0000 (13:39 +0000)]
file lustre_types.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 1 Mar 2006 20:49:35 +0000 (20:49 +0000)]
Branch b1_4_mountconf
b=8007
allow old clients to reconnect to a newly-restarted MGS
(plus some minor cleanups)
nathan [Tue, 28 Feb 2006 22:35:35 +0000 (22:35 +0000)]
Branch b1_4_mountconf
b=8007
Check early for double-mount
nathan [Tue, 28 Feb 2006 21:45:52 +0000 (21:45 +0000)]
Branch b1_4_mountconf
b=8007
use random uuid for MGC so that MGS doesn't deny reconnection after parition.
nathan [Tue, 28 Feb 2006 01:13:27 +0000 (01:13 +0000)]
Branch b1_4_mountconf
b=9861
plumb in "add new failover nids"
nathan [Mon, 27 Feb 2006 22:31:06 +0000 (22:31 +0000)]
file tcp-zero-copy-2.6.9-rhel4.patch was added on branch b1_4_mountconf on 2006-04-05 01:14:57 +0000
nathan [Mon, 27 Feb 2006 22:16:41 +0000 (22:16 +0000)]
Branch b1_4_mountconf
b=9846
add global lctl set_timeout
nathan [Mon, 27 Feb 2006 21:43:02 +0000 (21:43 +0000)]
file lustre_ver.h.in was added on branch b1_4_mountconf on 2006-04-26 18:45:41 +0000
nathan [Mon, 27 Feb 2006 19:07:04 +0000 (19:07 +0000)]
Branch b1_4_mountconf
b=8007
change sense of umount -f for servers:
umount = failover (next mount will go into recovery)
umount -f = force (non-failover, try to clean up)
nathan [Mon, 27 Feb 2006 16:50:52 +0000 (16:50 +0000)]
Branch b1_4_mountconf
b=8007
Use force/failover flags in mgc shutdown to prevent waiting around
nathan [Fri, 24 Feb 2006 23:17:51 +0000 (23:17 +0000)]
Branch b1_4_mountconf
b=8214
replay-single updates (and fixes for problems found thereby)
nathan [Fri, 24 Feb 2006 18:33:36 +0000 (18:33 +0000)]
Branch b1_4_mountconf
b=8007
Kick the mgs import a little harder. If an mgs/mdt was restarted on a node
with a live mgc, the mgc wouldn't reconnect to the newly restarted
mgs. Throwing the ptlrpc_invalidate_import in there gives it a little more
incentive to reconnect - the mgs mount still gets EIO the first time, but
if you try it again it works. I need help from somebody with more
knowledge of all these ptlrpc_ fns.
nathan [Thu, 23 Feb 2006 23:22:29 +0000 (23:22 +0000)]
Branch b1_4_mountconf
b=9858 regression test mods
b=8007 need refcount around config_llog_data for arbitrary cleanup
nathan [Thu, 23 Feb 2006 00:44:31 +0000 (00:44 +0000)]
Branch b1_4_mountconf
b=9858
-sanity test fixes
-brief nap before updating to new configs
nathan [Wed, 22 Feb 2006 18:58:37 +0000 (18:58 +0000)]
Branch b1_4_mountconf
b=8007
get rid of unneeded lustre_mgs.h
nathan [Wed, 22 Feb 2006 00:04:26 +0000 (00:04 +0000)]
Branch b1_4_mountconf
b=8007
Hunt down some memory leaks:
1. There are problems with the llog_finish/init pair in mds_lov_add_ost.
Firstly, they must be atomic as a pair.
Secondly, the setup sets up more than the cleanup cleans up (see
note in llog_setup), so we hackishly fix that.
2. Make sure we don't exit the umount until after we've dropped all our
references to the mount. Class_cleanup isn't synchronous, and we can't
exit the umount and risk our sb getting destroyed until we're really done.
So added a polling check. Also, move the MDS/OSS cleanup check until after
the poller, since I'm just looking at the class refcount.
nathan [Tue, 21 Feb 2006 23:43:54 +0000 (23:43 +0000)]
Branch b1_4_mountconf
b=8007
going after the memory leaks:
1. problems with the llog_finish / reinitialize in mds_lov_add_ost -
the pair must be atomic in case someone else is adding
the cleanup doesn't clean up as much as the setup sets up. This is
falloout
nathan [Mon, 20 Feb 2006 21:47:39 +0000 (21:47 +0000)]
Branch b1_4_mountconf
b=9863 - record timestamp in config log markers for future 9863 use
b=8192 - don't match existing locks in mgc_enqueue
b=9846 - fix client lov name for lctl conf_param
nathan [Mon, 20 Feb 2006 18:47:20 +0000 (18:47 +0000)]
Branch b1_4_mountconf
b=9846
Add lctl conf_param path via ioctl to MGS to set LCFG_PARAMs in logs.
Specifically, this allows things like:
./lctl conf_param lustre-mdtlov default_stripe_size=1055000
to be added to the MDT and client logs.
nathan [Fri, 17 Feb 2006 00:51:21 +0000 (00:51 +0000)]
Branch b1_4_mountconf
b=9860
upgrading from 1.4.6 - don't copy the old client log, just the old mdt log.
Regen client log as osts/mdt re-register after upgrade.
This means that new clients won't know about all the old osc's that the mdt
knows about, so don't start them until after all servers are upgraded.
But this also means no frankenstein hybrid old/new client log, and we don't
need to know the client name.
Use the old uuids parsed out of last_rcvd for the upgrading servers.
We can go back to 1.4.6 with no action required.
nathan [Thu, 16 Feb 2006 19:14:55 +0000 (19:14 +0000)]
Branch b1_4_mountconf
b=9860
namespace cleanup, new flags for upgrading from 146
nathan [Thu, 16 Feb 2006 01:04:40 +0000 (01:04 +0000)]
Branch b1_4_mountconf
b=9853
little cleanups
nathan [Thu, 16 Feb 2006 00:05:50 +0000 (00:05 +0000)]
Branch b1_4_mountconf
move mass_config scripts to subdir and rename
nathan [Wed, 15 Feb 2006 23:54:20 +0000 (23:54 +0000)]
Branch b1_4_mountconf
nathan [Wed, 15 Feb 2006 07:42:10 +0000 (07:42 +0000)]
file platform.h was added on branch b1_4_mountconf on 2006-04-26 18:46:11 +0000
nathan [Tue, 14 Feb 2006 22:46:11 +0000 (22:46 +0000)]
Branch b1_4_mountconf
b=9866, 9843
9866 mount ost exclusion list:
mount -o exclude=lustre-OST0000:lustre-OST0001 -t lustre
uml1:/lustre-client /mnt/lustre
will start a client with selected osc's in "inactive" state, allowing
nonblocking (degraded) filesystem usage.
Also adds foundation for 9843 skipping of so-marked config commands.
nathan [Tue, 14 Feb 2006 14:06:21 +0000 (14:06 +0000)]
file ext3-htree-path-ops.patch was added on branch b1_4_mountconf on 2006-04-05 01:14:57 +0000
nathan [Fri, 10 Feb 2006 23:04:29 +0000 (23:04 +0000)]
Branch b1_4_mountconf
b=10164
- reinterpret failover nid list as list of nids for the one failover
- get rid of mkfs inode size warning
target, not a list of different failover targets.
nathan [Fri, 10 Feb 2006 17:39:36 +0000 (17:39 +0000)]
Branch b1_4_mountconf
b=8007
- change screaming plethora of debug "error" messages to loudly-shouting
plethora of debug "warn" messages.
- stop a bare MGS more quickly
nathan [Thu, 9 Feb 2006 23:13:23 +0000 (23:13 +0000)]
Branch b1_4_mountconf
b=10161
writeconf - all servers re-send registration info whenever they're told to
update their config logs. MGS can then regenerate the logs for a live fs.
yujian [Thu, 9 Feb 2006 10:54:58 +0000 (10:54 +0000)]
b=9853
add some options, providing the following functionality:
- verifying network conectivity and hostnames in the cluster
- producing HA software configuration files
- using --reformat to format Lustre target
- verbose mode
yujian [Thu, 9 Feb 2006 10:45:20 +0000 (10:45 +0000)]
A script for generating the Heartbeat HA software's configuration files.
yujian [Thu, 9 Feb 2006 10:41:48 +0000 (10:41 +0000)]
A script for generating the Red Hat's Cluster Manager HA software's
configuration files.
nathan [Thu, 9 Feb 2006 00:15:03 +0000 (00:15 +0000)]
Branch b1_4_mountconf
b=8007
don't set default mount opts if user specifies their own
nathan [Thu, 9 Feb 2006 00:05:48 +0000 (00:05 +0000)]
Branch b1_4_mountconf
b=8007
- put a sem around log writing
- get a mgc ref during process log
- try harder to reactivate a failed-connect mgs import
- be smarter about when we try to copy the mgs logs locally
- make servers always register at startup, so mgs can do some sanity checking
- groundwork for "writeconf"-like regenerate logs
nathan [Wed, 8 Feb 2006 19:58:55 +0000 (19:58 +0000)]
file 2.6-rhel4-kgdb-ga.patch was added on branch b1_4_mountconf on 2006-04-05 01:14:57 +0000
yujian [Wed, 8 Feb 2006 10:30:46 +0000 (10:30 +0000)]
A script for verifying the service IP and the real interface IP
in a remote host are in the same subnet.
yujian [Wed, 8 Feb 2006 10:29:10 +0000 (10:29 +0000)]
A script for Lustre cluster network verification.
nathan [Tue, 7 Feb 2006 22:49:05 +0000 (22:49 +0000)]
Branch b1_4_mountconf
b=8007
misc cleanups
nathan [Tue, 7 Feb 2006 19:31:26 +0000 (19:31 +0000)]
Branch b1_4_mountconf
- b=9860 change COMMON_LR to an incompat flag
- add server name to config markers
- b=9861 add lov stripe info when MDT is added
- b=9861 add workaround for dealing with extents to mkfs.lustre
nathan [Tue, 7 Feb 2006 00:59:59 +0000 (00:59 +0000)]
Branch b1_4_mountconf
b=9861
mballoc/extents prevent plain-ext3 pre-mount. So if pre-mount ext3 fails,
try ldiskfs pre-mount.
nathan [Mon, 6 Feb 2006 22:44:33 +0000 (22:44 +0000)]
Branch b1_4_mountconf
b=9861
- update mkfs opts to reflect recent lconf changes
- fix get_device_size
nathan [Mon, 6 Feb 2006 19:16:18 +0000 (19:16 +0000)]
Branch b1_4_mountconf
b=8007
-fix potential lbug in target_handle_connect
-connect flags cleanup
-begin porting sanity.sh
nathan [Fri, 3 Feb 2006 19:08:47 +0000 (19:08 +0000)]
Branch b1_4_mountconf
b=9851
reactivate MGS import if we're trying to reconnect to the import after
it has previously failed, and we want to try another "one shot" connection.
nathan [Fri, 3 Feb 2006 18:18:29 +0000 (18:18 +0000)]
Branch b1_4_mountconf
b=9851
copy remote MGS llogs locally onto server disks, so that servers
can start up even if the MGS is no longer present.
(Note that this leads to the possibility of servers started using
out-of-date logs, and without taking an config lock.)
nathan [Thu, 2 Feb 2006 01:39:37 +0000 (01:39 +0000)]
Branch b1_4_mountconf
b=4482
Problem with the mds notify method of online ost addition - lov_notify
can't notify the mds until the mds is set up, due to a check of obd_set_up
in obd_notify. But obd_set_up isn't set until
mds_postrecov/mds_postsetup/mds_setup returns to class_setup.
(This can be seen by adding ost's before adding the mdt - the other
order doesn't have the problem because there are no osc's in the lov
during mds_postrecov at that point, so no notifies.)
So I hacked in an additional flag check to obd_notify that happens only to
be set for the mds at this point in it's life: obd_async_recov. Don't hurt
me.
nathan [Wed, 1 Feb 2006 22:09:21 +0000 (22:09 +0000)]
Branch b1_4_mountconf
b=9861
add local nids to mgsnid list at runtime (for MGS's), so that we don't need
to figure out the mgsnids at mkfs.lustre time. Now we don't need LNET at
all at mkfs time, and we always try the local MGS when running on backup
nodes as well, so this is a big win.
nathan [Wed, 1 Feb 2006 19:15:09 +0000 (19:15 +0000)]
Branch b1_4_mountconf
b=9861
- add failover NIDs
- some unused code cleanup
nathan [Tue, 31 Jan 2006 19:03:42 +0000 (19:03 +0000)]
Branch b1_4_mountconf
b=9860
interop with 1.4.6
- add "optional" lcfg command flag
- add ldd feature compat flags
- add old client connect hack
nathan [Tue, 31 Jan 2006 00:07:27 +0000 (00:07 +0000)]
Branch b1_4_mountconf
b=9860
interoperability with 1.4.6:
keep old uuids but new server names when ungrading old logs -
names are local, connects all happen through uuids.
(partially hardcoded for now)
- don't change config log magic, header size
- add uuid to disk data
- copy old client and mds log from LOGS to new names under CONFIGS, MGS
will then modify the logs.
- index number and uuid taken from last_rcvd (1.4.6)
- llog_filp_open must take directory path now (MDT will still serve old
logs to old client from old LOGS dir.)
nathan [Mon, 23 Jan 2006 18:20:34 +0000 (18:20 +0000)]
Branch b1_4_mountconf
b=8007
- check for already running target
- check for already registered mdt
- mdt index assignment prep for CMD
nathan [Fri, 20 Jan 2006 03:26:13 +0000 (03:26 +0000)]
Branch b1_4_mountconf
b=8007
update from b_rel_146
nathan [Thu, 12 Jan 2006 22:43:04 +0000 (22:43 +0000)]
Branch b1_4_mountconf
b=4482
During an ost_add, mds_lov_sync might be calling clearorphans on all osc's
before the mds has a chance to tell the osc what it's last transno is, in
which case clearorphans resets it to 0.
So change mds_lov_sync to only sync a single target at a time; then the
clearorphans call can only sync something the mds knows about.
This also allows syncing of all osc's in parallel, and removes all
requirements for an mds_lov_desc lock in the sync.
nathan [Thu, 12 Jan 2006 00:58:59 +0000 (00:58 +0000)]
Branch b1_4_mountconf
b=4482
move the mds_conn after the ost addition, like bz9926
identified but not fixed another ost_add problem: can't clearorphans
on any tgt that mds doesn't know about yet.
fixup mkfs verbiage
nathan [Wed, 11 Jan 2006 01:32:53 +0000 (01:32 +0000)]
Branch b1_4_mountconf
b=9861
- add lov info to mkfs.lustre
- add failover nids to registration
b=4482
- connect flags for online ost add
- better locking in mds_lov_sync
- adilger's dirty objids patch
- various fixme's
(warning: this is completely untested code, may not work)
nathan [Mon, 9 Jan 2006 20:16:43 +0000 (20:16 +0000)]
Branch b1_4_mountconf
b=9861
add tunefs.lustre
original patch by Yu Jian
r=nathan
nathan [Sat, 7 Jan 2006 00:58:36 +0000 (00:58 +0000)]
Branch b1_4_mountconf
b=4482
live ost add of an old ost
nathan [Thu, 5 Jan 2006 23:21:34 +0000 (23:21 +0000)]
Branch b1_4_mountconf
b=4482
live ost addition
adilger, can you look at the comment in mds_notify?
nathan [Wed, 4 Jan 2006 20:32:04 +0000 (20:32 +0000)]
Branch b1_4_mountconf
b=8192
config log updates working (continue parsing log from last step (per
instance) when server cancels config lock)
nathan [Wed, 4 Jan 2006 15:09:01 +0000 (15:09 +0000)]
file linux-module.c was added on branch b1_4_mountconf on 2006-04-26 18:46:02 +0000
nathan [Wed, 4 Jan 2006 15:08:57 +0000 (15:08 +0000)]
file darwin-module.c was added on branch b1_4_mountconf on 2006-04-26 18:46:02 +0000
nathan [Wed, 4 Jan 2006 15:08:10 +0000 (15:08 +0000)]
file obd_support.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:08:08 +0000 (15:08 +0000)]
file obd_class.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:08:06 +0000 (15:08 +0000)]
file obd.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:08:04 +0000 (15:08 +0000)]
file lvfs.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:08:02 +0000 (15:08 +0000)]
file lustre_user.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:08:00 +0000 (15:08 +0000)]
file lustre_quota.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:58 +0000 (15:07 +0000)]
file lustre_net.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:56 +0000 (15:07 +0000)]
file lustre_mds.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:54 +0000 (15:07 +0000)]
file lustre_log.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:52 +0000 (15:07 +0000)]
file lustre_lite.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:50 +0000 (15:07 +0000)]
file lustre_lib.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:48 +0000 (15:07 +0000)]
file lustre_handles.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:46 +0000 (15:07 +0000)]
file lustre_fsfilt.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:44 +0000 (15:07 +0000)]
file lustre_dlm.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:42 +0000 (15:07 +0000)]
file lustre_debug.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:40 +0000 (15:07 +0000)]
file lustre_compat.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:07:38 +0000 (15:07 +0000)]
file lprocfs_status.h was added on branch b1_4_mountconf on 2006-04-26 18:45:42 +0000
nathan [Wed, 4 Jan 2006 15:05:57 +0000 (15:05 +0000)]
file lustre_quota.h was added on branch b1_4_mountconf on 2006-04-26 18:45:41 +0000
nathan [Mon, 2 Jan 2006 22:31:00 +0000 (22:31 +0000)]
Branch b1_4_mountconf
b=9851
- moving towards live ost addition
- encode fsname in config log resource
- more robust error cleanup from server_fill_super
- D_TRACE entry/exits
nathan [Fri, 30 Dec 2005 00:23:41 +0000 (00:23 +0000)]
Branch b1_4_mountconf
b=9851
start of trying to allow ost addition after mds is setup
nathan [Thu, 29 Dec 2005 00:24:17 +0000 (00:24 +0000)]
Branch b1_4_mountconf
b=8192,9867
- move llog parsing into mgc
- track "used" logs to keep config generation info
- add statfs for df info on the server mounts - just report underlying disk
info (huanghua)
- more LCFG_MARKER processing
nathan [Tue, 27 Dec 2005 20:34:50 +0000 (20:34 +0000)]
Branch b1_4_mountconf
b=8192
- add config lock (finally!) (still need to do updates)
- keep old mds_last_rcvd file format if it already exists
- clean up mgs's filesystem db
- beginning of CFG_MARKERs
yujian [Fri, 16 Dec 2005 08:16:42 +0000 (08:16 +0000)]
Remove "device size" element, and add "mkfs options" element.
yujian [Thu, 15 Dec 2005 12:16:40 +0000 (12:16 +0000)]
A shell script to add lnet options line to modprobe.conf or modules.conf
yujian [Thu, 15 Dec 2005 12:15:21 +0000 (12:15 +0000)]
A shell script to parse csv file and format massive Lustre targets in parallel
nathan [Thu, 15 Dec 2005 00:08:38 +0000 (00:08 +0000)]
Branch b1_4_mountconf
b=8007
keep mgc-mgs connection open forever for locks.
nathan [Tue, 13 Dec 2005 20:21:56 +0000 (20:21 +0000)]
Branch b1_4_mountconf
b=9845
fixed memory leaks and double connect problem (target_destroy_export)
mgmt, ost, mdt, clients all start and stop cleanly
nathan [Tue, 13 Dec 2005 01:28:30 +0000 (01:28 +0000)]
Branch b1_4_mountconf
b=8007
can now mount mgmt, ost, and mdt (in that order)successfully. Haven't
tried client yet...
nathan [Mon, 12 Dec 2005 22:36:21 +0000 (22:36 +0000)]
Branch b1_4_mountconf
b=9889
fix bugs revealed by huanghua's inspection
nathan [Sat, 10 Dec 2005 01:08:04 +0000 (01:08 +0000)]
Branch b1_4_mountconf
b=9845
can start OSTs via target_add rpc now, fixed llog file leaks, better empty
log checks.
nathan [Thu, 8 Dec 2005 23:54:31 +0000 (23:54 +0000)]
Branch b1_4_mountconf
b=9845
MGS now creating and serving llogs - can start MDS
huanghua [Wed, 7 Dec 2005 09:09:53 +0000 (09:09 +0000)]
add nosvc to mount option
huanghua [Wed, 7 Dec 2005 04:55:06 +0000 (04:55 +0000)]
add mount option --nosvc: continue to call server_fill_super_common