1 Here is an short explanation what to install on your Servers to set up lustre quickly.
2 Be aware that this doesn't replace the Documentation and Installation Howtos from Lustre.
5 #1. Building the kernel and the modules
6 You've to download the linux-source-2.6.18|21|22 package and the linux-patch-lustre package.
8 Then patch your kernel with the correct patch file. Build and install it. (Use make-kpkg)
9 To patch the kernel automatically use --added-patches=lustre as build option.
11 Here is the full line how I build my kernel (for those who are not familiar with make-kpkg)
12 make-kpkg --added-patches=lustre --initrd --append-to-version "-quota-enabled-lustre-1.6.4.1" --revision credativ.1 kernel_image
14 Now reboot into this new kernel and install the lustre modules with:
15 - m-a auto-install lustre
17 Then the kernel and the modules should be there.
19 #2. Preparing the system
20 In the next step install:
23 Then load the kernel modules with:
28 This have to be done on every server system.
30 #3. Creating partitions on the OST/MDT/MGS Servers
31 Now you'll have to differentiate between the OST and MDT and MGS Systems
32 We'll assume here that MDT and MGS are on the same system:
35 - MGS/MDT: mkfs.lustre --fsname spfs --mdt --mgs $device
36 - OST: mkfs.lustre --fsname spfs --ost --mgsnode=$mgsnode@tcp0 $device
38 Additional options are:
39 --reformat - this partition was previously formated with lustre, reformat it
40 --param="failover.mode=failout" - don't hang the complete fs if a ost isn't available.
42 - Now mount the partitons on the servers:
43 - first the MDT/MGS Server:
44 - mount -t lustre /dev/sda /srv/mdt
46 - mount -t lustre /dev/sda /srv/ost
49 #4. Using the filesystem
50 In order to use the FS, you'll have to mount it on a client. Please note that this client also
51 needs the lustre-modules to be installed. (You can install lustre-source and build the module
53 - mount -t lustre mgsnode@tcp0:/spfs /mnt
57 The binaries and drivers for lustre in debian are compiled with enabled-quota.
58 So if you like to use quota this is quite simple:
59 - lfs quotacheck -ug $path/to/mounted/lustre/fs
60 - lfs setquota -u $user 1000 2000 10000 20000 $path/to/mounted/lustre/fs
61 - lfs quota -u $user $path/to/mounted/lustre/fs
63 If you want to reset this quota informations for a given user, you'll have first to
64 set every value to zero, and then give the new informations:
65 - lfs setquota -u $user 0 0 0 0 $path/to/mounted/lustre/fs
66 - lfs setquota -u $user 2000 3000 3000 4000 $path/to/mounted/lustre/fs
68 This behaviour is reported as lustre bug: https://bugzilla.lustre.org/show_bug.cgi?id=14513
73 Please have also a look into the official documentation for lustre available at:
75 http://manual.lustre.org/index.php?title=Main_Page
77 -- Patrick Winnertz <winnie@debian.org> Thu, 28 Dec 2007 14:53:25 +0200