From b801ebc6dae8f261fbd314b542e31638fc1f898a Mon Sep 17 00:00:00 2001 From: Richard Henwood Date: Fri, 27 Jul 2012 16:48:39 -0500 Subject: [PATCH] LUDOC-58: Clarify multiple file system issues. Manual is updated to emphasise Lustre is designed to only have one MGS. If there are multiple MGSs then best practice suggests fsname must be unique. Signed-off-by: Richard Henwood Change-Id: I82af8e6004fe1d7f70f4a8c93d60103271fcd298 --- ConfiguringLustre.xml | 3 ++- LustreOperations.xml | 8 +++----- 2 files changed, 5 insertions(+), 6 deletions(-) diff --git a/ConfiguringLustre.xml b/ConfiguringLustre.xml index 74421b1..0ea16f2 100644 --- a/ConfiguringLustre.xml +++ b/ConfiguringLustre.xml @@ -56,8 +56,9 @@ mkfs.lustre --fsname=<fsname> --mgs --mdt --index=0 <block device name> The default file system name (fsname) is lustre. - If you plan to generate multiple file systems, the MGS should be created separately on its own dedicated block device, by running: + If you plan to create multiple file systems, the MGS should be created separately on its own dedicated block device, by running: mkfs.lustre --fsname=<fsname> --mgs <block device name> + See for more details. diff --git a/LustreOperations.xml b/LustreOperations.xml index a0c6b03..f698286 100644 --- a/LustreOperations.xml +++ b/LustreOperations.xml @@ -145,7 +145,8 @@ LABEL=testfs-OST0000 /mnt/test/ost0 lustre defaults,_netdev,noauto 0 0
<indexterm><primary>operations</primary><secondary>multiple file systems</secondary></indexterm>Running Multiple Lustre File Systems - There may be situations in which you want to run multiple file systems. This is doable, as long as you follow specific naming conventions. + Lustre supports multiple file systems provided the combination of NID:fsname is unique. Each file system must be allocated a unique name during creation with the --fsname parameter. Unique names for file systems are enforced if a single MGS is present. If multiple MGSs are present (for example if you have an MGS on every MDS) the administrator is responsible for ensuring file system names are unique. A single MGS and unique file system names provides a single point of administration and allows commands to be issued against the file system even if it is not mounted. + Lustre supports multiple file systems on a single MGS. With a single MGS fsnames are guaranteed to be unique. Lustre also allows multiple MGSs to co-exist. For example, multiple MGSs will be necessary if multiple file systems on different Lustre software versions are to be concurrently available. With multiple MGSs additional care must be taken to ensure file system names are unique. Each file system should have a unique fsname among all systems that may interoperate in the future. By default, the mkfs.lustre command creates a file system named lustre. To specify a different file system name (limited to 8 characters) at format time, use the --fsname option: mkfs.lustre --fsname=<file system name> @@ -159,10 +160,7 @@ LABEL=testfs-OST0000 /mnt/test/ost0 lustre defaults,_netdev,noauto 0 0 If a client(s) will be mounted on several file systems, add the following line to /etc/xattr.conf file to avoid problems when files are moved between the file systems: lustre.* skip - The MGS is universal; there is only one MGS per Lustre installation, not per file system. - - - There is only one file system per MDT. Therefore, specify --mdt --mgs on one file system and --mdt --mgsnode=<MGS node NID> on the other file systems. + To ensure that a new MDT is added to an existing MGS create the MDT by specifying: --mdt --mgsnode=<MGS node NID>. A Lustre installation with two file systems (foo and bar) could look like this, where the MGS node is mgsnode@tcp0 and the mount points are /mnt/foo and /mnt/bar. mgsnode# mkfs.lustre --mgs /dev/sda -- 1.8.3.1