-<?xml version='1.0' encoding='UTF-8'?>
-<!-- This document was created with Syntext Serna Free. --><chapter xmlns="http://docbook.org/ns/docbook" xmlns:xl="http://www.w3.org/1999/xlink" version="5.0" xml:lang="en-US" xml:id="installinglustre">
+<?xml version='1.0' encoding='utf-8'?>
+<chapter xmlns="http://docbook.org/ns/docbook"
+xmlns:xl="http://www.w3.org/1999/xlink" version="5.0" xml:lang="en-US"
+xml:id="installinglustre">
<title xml:id="installinglustre.title">Installing the Lustre Software</title>
- <para>This chapter describes how to install the Lustre software. It includes:</para>
+ <para>This chapter describes how to install the Lustre software from RPM
+ packages. It includes:</para>
<itemizedlist>
<listitem>
<para>
- <xref linkend="dbdoclet.50438261_99193"/>
- </para>
+ <xref linkend="dbdoclet.50438261_99193" />
+ </para>
</listitem>
<listitem>
<para>
- <xref linkend="dbdoclet.50438261_41900"/>
- </para>
+ <xref linkend="dbdoclet.50438261_41900" />
+ </para>
</listitem>
</itemizedlist>
- <para>For hardware/system requirements, see <xref linkend="settinguplustresystem"/>.</para>
+ <para>For hardware and system requirements and hardware configuration
+ information, see
+ <xref linkend="settinguplustresystem" />.</para>
<section xml:id="dbdoclet.50438261_99193">
- <title>
- <indexterm><primary>installing</primary><secondary>preparation</secondary></indexterm>
- Preparing to Install the Lustre Software</title>
- <para>If you are using a supported Linux distribution and architecture, you can install Lustre from downloaded packages (RPMs). For a list of supported configurations, see the <link xl:href="http://wiki.whamcloud.com/">Lustre 2.0</link> topic on the Lustre wiki.</para>
- <para>A list of supported Lustre LNET drivers can be found in <xref linkend="understandinglustrenetworking"/>.</para>
- <para>If you are not using a supported configuration, you can install Lustre directly from the source code. For more information on this installation method, see <xref linkend="installinglustrefromsourcecode"/>.</para>
- <section xml:id="dbdoclet.50438261_37079">
- <title><indexterm><primary>installing</primary><secondary>requirements</secondary></indexterm>
-Required Software</title>
- <para>To install Lustre, the following are required:</para>
+ <title>
+ <indexterm>
+ <primary>installing</primary>
+ <secondary>preparation</secondary>
+ </indexterm>Preparing to Install the Lustre Software</title>
+ <para>You can install the Lustre software from downloaded packages (RPMs)
+ or directly from the source code. This chapter describes how to install the
+ Lustre RPM packages. Instructions to install from source code are beyond
+ the scope of this document, and can be found elsewhere online.</para>
+ <para>The Lustre RPM packages are tested on current versions of Linux
+ enterprise distributions at the time they are created. See the release
+ notes for each version for specific details.</para>
+ <section xml:id="section_rqs_tjw_3k">
+ <title>Software Requirements</title>
+ <para>To install the Lustre software from RPMs, the following are
+ required:
<itemizedlist>
<listitem>
- <para><emphasis>(On Linux servers only)</emphasis> Linux kernel patched with Lustre-specific patches for your platform and architecture. A Linux patched kernel can be installed on a client if it is desireable to use the same kernel on all nodes, but this is not required.</para>
- </listitem>
- <listitem>
- <para>Lustre modules compiled for the Linux kernel (see <xref linkend="installinglustre.tab.req"/> for which packages are required for servers and clients in your configuration).</para>
- </listitem>
- <listitem>
- <para>Lustre utilities required for configuring Lustre (see <xref linkend="installinglustre.tab.req"/> for which packages are required for servers and clients in your configuration).</para>
+ <para>
+ <emphasis role="bold">
+ <emphasis role="italic">Lustre server packages</emphasis>
+ </emphasis>. The required packages for Lustre 2.9 EL7 servers are
+ listed in the table below, where
+ <replaceable>ver</replaceable> refers to the Lustre release and
+ kernel version (e.g., 2.9.0-1.el7) and
+ <replaceable>arch</replaceable> refers to the processor architecture
+ (e.g., x86_64). These packages are available in the
+ <link xl:href="https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases">
+ Lustre Releases</link> repository, and may differ depending on
+ your distro and version.</para>
+ <para>
+ <table frame="all" xml:id="table_cnh_5m3_gk">
+ <title>Packages Installed on Lustre Servers</title>
+ <tgroup cols="2">
+ <colspec colname="c1" colnum="1" colwidth="1.18*" />
+ <colspec colname="c2" colnum="2" colwidth="1*" />
+ <thead>
+ <row>
+ <entry>Package Name</entry>
+ <entry>Description</entry>
+ </row>
+ </thead>
+ <tbody>
+ <row>
+ <entry>
+ <code>kernel-<replaceable>ver</replaceable>_lustre.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Linux kernel with Lustre software patches (often
+ referred to as "patched kernel")</entry>
+ </row>
+ <row>
+ <entry>
+ <code>lustre-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Lustre software command line tools</entry>
+ </row>
+ <row>
+ <entry>
+ <code>kmod-lustre-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Lustre-patched kernel modules</entry>
+ </row>
+ <row>
+ <entry>
+ <code>kmod-lustre-osd-ldiskfs-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Lustre back-end file system tools for ldiskfs-based
+ servers.
+ </entry>
+ </row>
+ <row>
+ <entry>
+ <code>lustre-osd-ldiskfs-mount-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Helper library for <literal>mount.lustre</literal>
+ and <literal>mkfs.lustre</literal> for ldiskfs-based servers.
+ </entry>
+ </row>
+ <row>
+ <entry>
+ <code>kmod-lustre-osd-zfs-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Lustre back-end file system tools for ZFS. This is
+ an alternative to
+ <literal>lustre-osd-ldiskfs</literal> (kmod-spl and
+ kmod-zfs available separately).</entry>
+ </row>
+ <row>
+ <entry>
+ <code>lustre-osd-zfs-mount-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Helper library for <literal>mount.lustre</literal>
+ and <literal>mkfs.lustre</literal> for ZFS-based servers
+ (zfs utilities available separately).
+ </entry>
+ </row>
+ <row>
+ <entry>
+ <code>e2fsprogs</code>
+ </entry>
+ <entry>Utilities to maintain Lustre ldiskfs back-end file
+ system(s)
+ </entry>
+ </row>
+ <row>
+ <entry>
+ <code>lustre-tests-<replaceable>ver</replaceable>_lustre.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Lustre I/O Kit benchmarking tools
+ <emphasis role="italic">(Included in Lustre software as of
+ release 2.2)</emphasis></entry>
+ </row>
+ </tbody>
+ </tgroup>
+ </table>
+ </para>
</listitem>
<listitem>
- <para><emphasis>(On Linux servers only) </emphasis><literal>e2fsprogs</literal> package containing Lustre-specific tools (<literal>e2fsck</literal> and <literal>lfsck</literal>) used to repair a backing file system. This replaces the existing <literal>e2fsprogs</literal> package but provides complete <literal>e2fsprogs</literal> functionality</para>
+ <para>
+ <emphasis role="bold">
+ <emphasis role="italic">Lustre client packages</emphasis>
+ </emphasis>. The required packages for Lustre 2.9 EL7 clients are
+ listed in the table below, where
+ <replaceable>ver</replaceable> refers to the Linux distribution (e.g.,
+ 3.6.18-348.1.1.el5). These packages are available in the
+ <link xl:href="https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases">
+ Lustre Releases</link> repository.</para>
+ <para>
+ <table frame="all" xml:id="table_j3r_ym3_gk">
+ <title>Packages Installed on Lustre Clients</title>
+ <tgroup cols="2">
+ <colspec colname="c1" colnum="1" colwidth="1*" />
+ <colspec colname="c2" colnum="2" colwidth="1.02*" />
+ <thead>
+ <row>
+ <entry>Package Name</entry>
+ <entry>Description</entry>
+ </row>
+ </thead>
+ <tbody>
+ <row>
+ <entry>
+ <code>kmod-lustre-client-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Patchless kernel modules for client</entry>
+ </row>
+ <row>
+ <entry>
+ <code>lustre-client-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Client command line tools</entry>
+ </row>
+ <row>
+ <entry>
+ <code>lustre-client-dkms-<replaceable>ver</replaceable>.<replaceable>arch</replaceable></code>
+ </entry>
+ <entry>Alternate client RPM to kmod-lustre-client with
+ Dynamic Kernel Module Support (DKMS) installation. This
+ avoids the need to install a new RPM for each kernel update,
+ but requires a full build environment on the client.</entry>
+ </row>
+ </tbody>
+ </tgroup>
+ </table>
+ </para>
+ <note>
+ <para>The version of the kernel running on a Lustre client must be
+ the same as the version of the
+ <code>kmod-lustre-client-<replaceable>ver</replaceable></code>
+ package being installed, unless the DKMS package is installed.
+ If the kernel running on the client is not compatible, a kernel
+ that is compatible must be installed on the client before the
+ Lustre file system software is used.</para>
+ </note>
</listitem>
<listitem>
- <para><emphasis>(Optional)</emphasis> Network-specific kernel modules and libraries such as the Lustre-specific OFED package required for an InfiniBand network interconnect.</para>
+ <para>
+ <emphasis role="bold">
+ <emphasis role="italic">Lustre LNet network driver (LND)</emphasis>
+ </emphasis>. The Lustre LNDs provided with the Lustre software are
+ listed in the table below. For more information about Lustre LNet,
+ see
+ <xref xmlns:xlink="http://www.w3.org/1999/xlink"
+ linkend="understandinglustrenetworking" />.</para>
+ <table frame="all" xml:id="table_bkx_dn3_gk">
+ <title>Network Types Supported by Lustre LNDs</title>
+ <tgroup cols="2">
+ <colspec colname="c1" colnum="1" colwidth="1*" />
+ <colspec colname="newCol2" colnum="2" colwidth="1.95*" />
+ <thead>
+ <row>
+ <entry>Supported Network Types</entry>
+ <entry>Notes</entry>
+ </row>
+ </thead>
+ <tbody>
+ <row>
+ <entry>TCP</entry>
+ <entry>Any network carrying TCP traffic, including GigE,
+ 10GigE, and IPoIB</entry>
+ </row>
+ <row>
+ <entry>InfiniBand network</entry>
+ <entry>OpenFabrics OFED (o2ib)</entry>
+ </row>
+ <row>
+ <entry>gni</entry>
+ <entry>Gemini (Cray)</entry>
+ </row>
+ </tbody>
+ </tgroup>
+ </table>
</listitem>
- </itemizedlist>
- <para>At least one Lustre RPM must be installed on each server and on each client in a Lustre file system. <xref linkend="installinglustre.tab.req"/> lists required Lustre packages and indicates where they are to be installed. Some Lustre packages are installed on Lustre servers (MGS, MDS, and OSSs), some are installed on Lustre clients, and some are installed on all Lustre nodes.</para>
- <para>.</para>
- <table xml:id="installinglustre.tab.req" frame="all">
- <title>Lustre required packages, descriptions and installation guidance</title>
- <tgroup cols="5">
- <colspec colname="c1" colwidth="2*"/>
- <colspec colname="c2" colwidth="12*"/>
- <colspec colname="c3" colwidth="20*"/>
- <colspec colname="c4" colwidth="6*"/>
- <colspec colname="c5" colwidth="6*"/>
- <thead>
- <row>
- <entry nameend="c2" namest="c1">
- <para><emphasis role="bold">Lustre Package</emphasis></para>
- </entry>
- <entry>
- <para><emphasis role="bold">Description</emphasis></para>
- </entry>
- <entry>
- <para><emphasis role="bold">Install on servers</emphasis>
- <footnote>
- <para>Installing a patched kernel on a client node is not required. However, if a client node will be used as both a client and a server, or if you want to install the same kernel on all nodes for any reason, install the server packages designated with an asterisk (*) on the client node.</para>
- </footnote></para>
- </entry>
- <entry>
- <para><emphasis role="bold">Install on clients</emphasis></para>
- </entry>
- </row>
- </thead>
- <tbody>
- <row>
- <entry nameend="c3" namest="c1">
- <para> <emphasis role="bold"> Lustre patched kernel RPMs:</emphasis></para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> kernel-<ver>_lustre.<ver></para>
- </entry>
- <entry>
- <para> For OEL 5 or RHEL 5 server platform</para>
- </entry>
- <entry>
- <para> X*</para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> kernel-ib-<ver></para>
- </entry>
- <entry>
- <para> Lustre OFED package. Required only if the network interconnect is InfiniBand.</para>
- </entry>
- <entry>
- <para> X*</para>
- </entry>
- <entry>
- <para> X</para>
- </entry>
- </row>
- <row>
- <entry nameend="c2" namest="c1">
- <para> <emphasis> Lustre module RPMs:</emphasis></para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> lustre-modules-<ver></para>
- </entry>
- <entry>
- <para> For Lustre-patched kernel.</para>
- </entry>
- <entry>
- <para> X*</para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> lustre-client-modules-<ver></para>
- </entry>
- <entry>
- <para> For clients.</para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> X</para>
- </entry>
- </row>
- <row>
- <entry nameend="c2" namest="c1">
- <para> <emphasis> Lustre utilities:</emphasis></para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> lustre-<ver></para>
- </entry>
- <entry>
- <para> Lustre utilities package. This includes userspace utilities to configure and run Lustre.</para>
- </entry>
- <entry>
- <para>  </para>
- <para> </para>
- <para>X*</para>
- </entry>
- <entry>
- <para>  </para>
- <para> </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> lustre-client-<ver></para>
- </entry>
- <entry>
- <para> Lustre utilities for clients.</para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> X</para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> lustre-ldiskfs-<ver></para>
- </entry>
- <entry>
- <para> Lustre-patched backing file system kernel module package for the ldiskfs file system.</para>
- </entry>
- <entry>
- <para>  </para>
- <para>X</para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- <row>
- <entry>
- <para>  </para>
- </entry>
- <entry>
- <para> e2fsprogs-<ver></para>
- </entry>
- <entry>
- <para> Utilities package used to maintain the ldiskfs backing file system.</para>
- </entry>
- <entry>
- <para>  </para>
- <para>X</para>
- </entry>
- <entry>
- <para>  </para>
- </entry>
- </row>
- </tbody>
- </tgroup>
- </table>
- <para>In all supported Lustre installations, a patched kernel must be run on each server, including the the MGS, the MDS, and all OSSs. Running a patched kernel on a Lustre client is only required if the client will be used for multiple purposes, such as running as both a client and an OST or if you want to use the same kernel on all nodes.</para>
- <para>Lustre RPM packages are available on the <link xl:href="http://build.whamcloud.com">Whamcloud download site</link>. They must be installed in the order described in the <xref linkend="dbdoclet.50438261_41900"/>.</para>
- <section remap="h4">
- <title><indexterm><primary>installing</primary><secondary>network</secondary></indexterm>
-Network-specific Kernel Modules and Libraries</title>
- <para>Network-specific kernel modules and libraries may be needed such as the Lustre-specific OFED package required for an InfiniBand network interconnect.</para>
- </section>
- <section remap="h4">
- <title><indexterm><primary>installing</primary><secondary>tools and utilities</secondary></indexterm>
-Lustre-Specific Tools and Utilities</title>
- <para>Several third-party utilities are must be installed on servers:</para>
+ </itemizedlist></para>
+ <para>
+ <note>
+ <para>The InfiniBand and TCP Lustre LNDs are routinely tested during
+ release cycles. The other LNDs are maintained by their respective
+ owners</para>
+ </note>
<itemizedlist>
<listitem>
- <para><emphasis role="bold">e2fsprogs</emphasis> : Lustre requires a recent version of e2fsprogs that understands extents and large xattr. Use <literal>e2fsprogs-1.41.90.wc4</literal> or later, available at:</para>
- <para><link xl:href="http://build.whamcloud.com/">http://build.whamcloud.com/</link></para>
- <para>A quilt patchset of all changes to the vanilla e2fsprogs is available in <literal>e2fsprogs-{version}-patches.tgz</literal>.</para>
- <note>
- <para>The Lustre-patched <literal>e2fsprogs</literal> utility is only required on machines that mount backend (<literal>ldiskfs</literal>) file systems, such as the OSS, MDS and MGS nodes. It does not need to be loaded on clients.</para>
- </note>
+ <para>
+ <emphasis role="bold">
+ <emphasis role="italic">High availability software</emphasis>
+ </emphasis>. If needed, install third party high-availability
+ software. For more information, see
+ <xref linkend="dbdoclet.50438188_92688" />.</para>
</listitem>
<listitem>
- <para><emphasis role="bold">Perl</emphasis> - Various userspace utilities are written in Perl. Any recent version of Perl will work with Lustre.</para>
+ <para>
+ <emphasis role="bold">
+ <emphasis role="italic">Optional packages.</emphasis>
+ </emphasis>Optional packages provided in the
+ <link xl:href="https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases">
+ Lustre Releases</link>repository may include the following
+ (depending on the operating system and platform):
+ <itemizedlist>
+ <listitem>
+ <para>
+ <code>kernel-debuginfo</code>,
+ <code>kernel-debuginfo-common</code>,
+ <code>lustre-debuginfo</code>,
+ <code>lustre-osd-ldiskfs-debuginfo</code>- Versions of required
+ packages with debugging symbols and other debugging options
+ enabled for use in troubleshooting.</para>
+ </listitem>
+ <listitem>
+ <para>
+ <code>kernel-devel</code>, - Portions of the kernel tree needed
+ to compile third party modules, such as network drivers.</para>
+ </listitem>
+ <listitem>
+ <para>
+ <code>kernel-firmware</code>- Standard Red Hat Enterprise Linux
+ distribution that has been recompiled to work with the Lustre
+ kernel.</para>
+ </listitem>
+ <listitem>
+ <para>
+ <code>kernel-headers</code>- Header files installed under
+ /user/include and used when compiling user-space,
+ kernel-related code.</para>
+ </listitem>
+ <listitem>
+ <para>
+ <code>lustre-source</code>- Lustre software source code.</para>
+ </listitem>
+ <listitem>
+ <para>
+ <emphasis role="italic">(Recommended)</emphasis>
+ <code>perf</code>,
+ <code>perf-debuginfo</code>,
+ <code>python-perf</code>,
+ <code>python-perf-debuginfo</code>- Linux performance analysis
+ tools that have been compiled to match the Lustre kernel
+ version.</para>
+ </listitem>
+ </itemizedlist></para>
</listitem>
</itemizedlist>
- </section>
- <section remap="h4">
- <title><indexterm><primary>installing</primary><secondary>high-availability</secondary></indexterm>
-(Optional) High-Availability Software</title>
- <para>If you plan to enable failover server functionality with Lustre (either on an OSS or the MDS), you must add high-availability (HA) software to your cluster software. For more information, see <xref linkend="dbdoclet.50438188_92688"/>.</para>
- </section>
- <section remap="h4">
- <title>(Optional) Debugging Tools and Other Optional Packages</title>
- <para>A variety of optional packages are provided on the <emphasis>
- <link xl:href="http://downloads.whamcloud.com">Whamcloud download site</link>
- </emphasis>. These include debugging tools, test programs and scripts, Linux kernel and Lustre source code, and other packages.</para>
- <para>For more information about debugging tools, see the topic <emphasis>
- <link xl:href="http://wiki.lustre.org/index.php/Debugging_Lustre">Debugging Lustre</link>
- </emphasis> on the Lustre wiki.</para>
- </section>
+ </para>
</section>
- <section xml:id="dbdoclet.50438261_19503">
- <title><indexterm><primary>installing</primary><secondary>environment</secondary></indexterm>
-Environmental Requirements</title>
- <para>Make sure the following environmental requirements are met before installing Lustre:</para>
+ <section xml:id="section_rh2_d4w_gk">
+ <title>Environmental Requirements</title>
+ <para>Before installing the Lustre software, make sure the following
+ environmental requirements are met.
<itemizedlist>
<listitem>
- <para><emphasis role="bold">
- <emphasis role="italic">
- <emphasis>(Required)</emphasis>
- </emphasis>
- </emphasis><emphasis role="bold"> Disable Security-Enhanced Linux (SELinux) on servers and clients</emphasis> . Lustre does not support SELinux. Therefore, disable the SELinux system extension on all Lustre nodes and make sure other security extensions, like Novell AppArmorand network packet filtering tools (such as iptables) do not interfere with Lustre. See <xref linkend="dbdoclet.50438261_88296"/> in <xref linkend="dbdoclet.50438261_41900"/> below.</para>
+ <para>
+ <emphasis role="italic">(Required)</emphasis>
+ <emphasis role="italic">
+ <emphasis role="bold">Disable Security-Enhanced Linux
+ <superscript>*</superscript>(SELinux) on all Lustre servers
+ </emphasis>
+ </emphasis>The Lustre software does not support SELinux. Therefore,
+ the SELinux system extension must be disabled on all Lustre nodes.
+ Also, make sure other security extensions (such as the Novell
+ AppArmor
+ <superscript>*</superscript>security system) and network packet
+ filtering tools (such as iptables) do not interfere with the Lustre
+ software.</para>
</listitem>
<listitem>
- <para><emphasis role="bold">
- <emphasis role="italic">
- <emphasis>(Required)</emphasis>
- </emphasis>
- </emphasis><emphasis role="bold"> Maintain uniform user and group databases on all cluster nodes</emphasis> . Use the same user IDs (UID) and group IDs (GID) on all clients. If use of supplemental groups is required, verify that the group_upcall requirements have been met. See <xref linkend="dbdoclet.50438291_32926"/>.</para>
+ <para>
+ <emphasis role="italic">(Required)</emphasis>
+ <emphasis role="italic">
+ <emphasis role="bold">Use the same user IDs (UID) and group IDs
+ (GID) on all clients.</emphasis>
+ </emphasis>If use of supplemental groups is required, see
+ <xref linkend="dbdoclet.50438291_32926" />for information about
+ supplementary user and group cache upcall (
+ <code>identity_upcall</code>).</para>
</listitem>
<listitem>
- <para><emphasis role="bold">
- <emphasis role="italic">
- <emphasis>(Recommended)</emphasis>
- </emphasis>
- </emphasis><emphasis role="bold"> Provide remote shell access to clients</emphasis> . Although not strictly required to run Lustre, we recommend that all cluster nodes have remote shell client access to facilitate the use of Lustre configuration and monitoring scripts. Parallel Distributed SHell (pdsh) is preferable, although Secure SHell (SSH) is acceptable.</para>
+ <para>
+ <emphasis role="italic">(Recommended)</emphasis>
+ <emphasis role="italic">
+ <emphasis role="bold">Provide remote shell access to
+ clients.</emphasis>
+ </emphasis>It is recommended that all cluster nodes have remote shell
+ client access to facilitate the use of Lustre configuration and
+ monitoring scripts. Parallel Distributed SHell (pdsh) is preferable,
+ although Secure SHell (SSH) is acceptable.</para>
</listitem>
<listitem>
- <para><emphasis role="bold">
- <emphasis role="italic">
- <emphasis>(Recommended)</emphasis>
- </emphasis>
- </emphasis><emphasis role="bold"> Ensure client clocks are synchronized</emphasis> . Lustre uses client clocks for timestamps. If clocks are out of sync between clients, files will appear with different time stamps when accessed by different clients. Drifting clocks can also cause problems, for example, by making it difficult to debug multi-node issues or correlate logs, which depend on timestamps. We recommend that you use Network Time Protocol (NTP) to keep client and server clocks in sync with each other. For more information about NTP, see: <link xl:href="http://www.ntp.org/">http://www.ntp.org</link>.</para>
+ <para>
+ <emphasis role="italic">(Recommended)</emphasis>
+ <emphasis role="italic">
+ <emphasis role="bold">Ensure client clocks are
+ synchronized.</emphasis>
+ </emphasis>The Lustre file system uses client clocks for timestamps.
+ If clocks are out of sync between clients, files will appear with
+ different time stamps when accessed by different clients. Drifting
+ clocks can also cause problems by, for example, making it difficult
+ to debug multi-node issues or correlate logs, which depend on
+ timestamps. We recommend that you use Network Time Protocol (NTP) to
+ keep client and server clocks in sync with each other. For more
+ information about NTP, see:
+ <link xl:href="http://www.ntp.org/">http://www.ntp.org</link>.</para>
</listitem>
- </itemizedlist>
+ </itemizedlist></para>
</section>
</section>
<section xml:id="dbdoclet.50438261_41900">
- <title>Lustre Installation Procedure</title>
+ <title>Lustre Software Installation Procedure</title>
<caution>
- <para>Before installing Lustre, back up ALL data. Lustre contains kernel modifications which interact with storage devices and may introduce security issues and data loss if not installed, configured or administered properly.</para>
+ <para>Before installing the Lustre software, back up ALL data. The Lustre
+ software contains kernel modifications that interact with storage devices
+ and may introduce security issues and data loss if not installed,
+ configured, or administered properly.</para>
</caution>
- <para>Use this procedure to install Lustre from RPMs.</para>
+ <para>To install the Lustre software from RPMs, complete the steps
+ below.</para>
<orderedlist>
<listitem>
- <para>Verify that all Lustre installation requirements have been met.</para>
- <para>For more information on these prerequisites, see:</para>
+ <para>Verify that all Lustre installation requirements have been
+ met.</para>
<itemizedlist>
<listitem>
- <para> Hardware requirements in <xref linkend="settinguplustresystem"/></para>
+ <para>For hardware requirements, see
+ <xref linkend="settinguplustresystem" />.</para>
</listitem>
<listitem>
- <para>Software and environmental requirements in <xref linkend="installinglustre"/></para>
+ <para>For software and environmental requirements, see the section
+ <xref xmlns:xlink="http://www.w3.org/1999/xlink"
+ linkend="dbdoclet.50438261_99193" />above.</para>
</listitem>
</itemizedlist>
</listitem>
<listitem>
- <para>Download the Lustre RPMs.</para>
- <orderedlist>
- <listitem>
- <para>On the <link xl:href="http://build.whamcloud.com/">Lustre download site</link>, select your platform.</para>
- <para>The files required to install Lustre (kernels, modules and utilities RPMs) are listed for the selected platform.</para>
- </listitem>
- <listitem>
- <para>Download the required files.</para>
- </listitem>
- </orderedlist>
+ <para>Download the
+ <literal>e2fsprogs</literal> RPMs for your platform from the
+ <link xl:href="https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases">
+ Lustre Releases</link>repository.</para>
+ </listitem>
+ <listitem>
+ <para>Download the Lustre server RPMs for your platform from the
+ <link xl:href="https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases">
+ Lustre Releases</link>repository. See
+ <xref xmlns:xlink="http://www.w3.org/1999/xlink"
+ linkend="table_cnh_5m3_gk" />for a list of required packages.</para>
</listitem>
<listitem xml:id="dbdoclet.50438261_88296">
- <para>Install the Lustre packages on the servers.</para>
- <orderedlist>
+ <para>Install the Lustre server and
+ <literal>e2fsprogs</literal> packages on all Lustre servers (MGS, MDSs,
+ and OSSs).
+ <orderedlist numeration="loweralpha">
<listitem>
- <para>Refer to <xref linkend="installinglustre.tab.req"/> to determine which Lustre packages are to be installed on servers for your platform and architecture.</para>
- <para>Some Lustre packages are installed on the Lustre servers (MGS, MDS, and OSSs). Others are installed on Lustre clients.</para>
- <para>Lustre packages must be installed in the order specified in the following steps.</para>
+ <para>Log onto a Lustre server as the
+ <literal>root</literal> user</para>
</listitem>
<listitem>
- <para>Install the kernel, modules and <literal>ldiskfs</literal> packages.</para>
- <para>Use the <literal>rpm -ivh</literal> command to install the kernel, module and ldiskfs packages.</para>
- <note>
- <para>It is not recommended that you use the <literal>rpm -Uvh</literal> command to install a kernel, because this may leave you with an unbootable system if the new kernel doesn't work for some reason.</para>
- </note>
- <para>For example, the command in the following example would install required packages on a server with Infiniband networking</para>
- <screen>$ rpm -ivh kernel-<ver>_lustre-<ver> kernel-ib-<ver> \
-lustre-modules-<ver> lustre-ldiskfs-<ver>
+ <para>Use the
+ <literal>yum</literal> command to install the packages:</para>
+ <para>
+ <screen>
+# yum --nogpgcheck install pkg1.rpm pkg2.rpm ...
</screen>
+ </para>
</listitem>
<listitem>
- <para>Update the bootloader (<literal>grub.conf</literal> or <literal>lilo.conf</literal>) configuration file as needed.</para>
- <orderedlist>
- <listitem>
- <para>Verify that the bootloader configuration file has been updated with an entry for the patched kernel.</para>
- <para>Before you can boot to a new distribution or kernel, there must be an entry for it in the bootloader configuration file. Often this is added automatically when the kernel RPM is installed.</para>
- </listitem>
- <listitem>
- <para>Disable security-enhanced (SE) Linux on servers and clients by including an entry in the bootloader configuration file as shown below:</para>
- <screen>selinux=0
+ <para>Verify the packages are installed correctly:</para>
+ <para>
+ <screen>
+rpm -qa|egrep "lustre|wc"|sort
</screen>
- </listitem>
- </orderedlist>
+ </para>
</listitem>
<listitem>
- <para>Install the utilities/userspace packages.</para>
- <para>Use the <literal>rpm -ivh</literal> command to install the utilities packages. For example:</para>
- <screen>$ rpm -ivh lustre-<ver>
-</screen>
- </listitem>
- <listitem>
- <para>Install the <literal>e2fsprogs</literal> package.</para>
- <para>Use the <literal>rpm -ivh</literal> command to install the <literal>e2fsprogs</literal> package. For example:</para>
- <screen>$ rpm -ivh e2fsprogs-<ver>
-
-</screen>
- <para>If <literal>e2fsprogs</literal> is already installed on your Linux system, install the Lustre-specific <literal>e2fsprogs</literal> version by using <literal>rpm -Uvh</literal> to upgrade the existing <literal>e2fsprogs</literal> package. For example:</para>
- <screen>$ rpm -Uvh e2fsprogs-<ver> </screen>
- <note>
- <para>The <literal>rpm</literal> command options <literal>--force</literal> or <literal>--nodeps</literal> should not be used to install or update the Lustre-specific <literal>e2fsprogs</literal> package. If errors are reported, file a bug (for instructions see the topic <emphasis>
- <link xl:href="http://wiki.lustre.org/index.php/Reporting_Bugs">Reporting Bugs</link>
- </emphasis> on the Lustre wiki).</para>
- </note>
+ <para>Reboot the server.</para>
</listitem>
<listitem>
- <para><emphasis role="italic">
- <emphasis role="italic">(Optional)</emphasis>
- </emphasis> To add optional packages to your Lustre file system, install them now.</para>
- <para>Optional packages include file system creation and repair tools, debugging tools, test programs and scripts, Linux kernel and Lustre source code, and other packages. A complete list of optional packages for your platform is provided on the <link xl:href="http://wiki.whamcloud.com">Whamcloud wiki</link>.</para>
+ <para>Repeat these steps on each Lustre server.</para>
</listitem>
- </orderedlist>
+ </orderedlist></para>
</listitem>
<listitem>
- <para>Install the Lustre packages on the clients.</para>
- <orderedlist>
- <listitem>
- <para>Refer to <xref linkend="installinglustre.tab.req"/> to determine which Lustre packages are to be installed on clients for your platform and architecture.</para>
- </listitem>
+ <para>Download the Lustre client RPMs for your platform from the
+ <link xl:href="https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases">
+ Lustre Releases</link>repository. See
+ <xref xmlns:xlink="http://www.w3.org/1999/xlink"
+ linkend="table_j3r_ym3_gk" />for a list of required packages.</para>
+ </listitem>
+ <listitem>
+ <para>Install the Lustre client packages on all Lustre clients.
+ <note>
+ <para>The version of the kernel running on a Lustre client must be
+ the same as the version of the
+ <literal>lustre-client-modules-</literal>
+ <replaceable>ver</replaceable> package being installed. If not, a
+ compatible kernel must be installed on the client before the Lustre
+ client packages are installed.</para>
+ </note></para>
+ <orderedlist numeration="loweralpha">
<listitem>
- <para>Install the module packages for clients.</para>
- <para>Use the <literal>rpm -ivh</literal> command to install the lustre-client and <literal>lustre-client-modules-<ver></literal> packages. For example:</para>
- <screen>$ rpm -ivh lustre-client-modules-<ver> kernel-ib-<ver></screen>
+ <para>Log onto a Lustre client as the root user.</para>
</listitem>
<listitem>
- <para>Install the utilities/userspace packages for clients.</para>
- <para>Use the <literal>rpm -ivh</literal> command to install the utilities packages. For example:</para>
- <screen>$ rpm -ivh lustre-client</screen>
+ <para>Use the
+ <literal>yum</literal> command to install the packages:</para>
+ <para>
+ <screen>
+# yum --nogpgcheck install pkg1.rpm pkg2.rpm ...
+</screen>
+ </para>
</listitem>
<listitem>
- <para>Update the bootloader (grub.conf or lilo.conf) configuration file as needed.</para>
- <orderedlist>
- <listitem>
- <para>Verify that the bootloader configuration file has been updated with an entry for the patched kernel.</para>
- <para>Before you can boot to a new distribution or kernel, there must be an entry for it in the bootloader configuration file. Often this is added automatically when the kernel RPM is installed.</para>
- </listitem>
- <listitem>
- <para>Disable security-enhanced (SE) Linux on servers and clients by including an entry in the bootloader configuration file as shown below:</para>
- <screen>selinux=0 </screen>
- </listitem>
- </orderedlist>
+ <para>Verify the packages were installed correctly:</para>
+ <para>
+ <screen>
+# rpm -qa|egrep "lustre|kernel"|sort
+</screen>
+ </para>
</listitem>
- </orderedlist>
- </listitem>
- <listitem>
- <para>Reboot the patched clients and the servers.</para>
- <orderedlist>
<listitem>
- <para>If you applied the patched kernel to any clients, reboot them.</para>
- <para>Unpatched clients do not need to be rebooted.</para>
+ <para>Reboot the client.</para>
</listitem>
<listitem>
- <para>Reboot the servers.</para>
+ <para>Repeat these steps on each Lustre client.</para>
</listitem>
</orderedlist>
- <para>To configure LNET, go next to <xref linkend="configuringlnet"/>. If default settings will be used for LNET, go to <xref linkend="configuringlustre"/>.</para>
</listitem>
</orderedlist>
+ <para>To configure LNet, go to
+ <xref linkend="configuringlnet" />. If default settings will be used for
+ LNet, go to
+ <xref linkend="configuringlustre" />.</para>
</section>
</chapter>
git://git.whamcloud.com / doc / manual.git / blobdiff