From bda9d624b241ed373b0909d99a0361324ba5aaab Mon Sep 17 00:00:00 2001 From: Richard Henwood Date: Fri, 4 Dec 2015 16:23:15 -0600 Subject: [PATCH] LUDOC-263 wrap: wrap lines for review convenience. As subject. Change-Id: Idd2196effb2f90c5d2ba7ac7de3e4cca6bf13b71 Signed-off-by: Richard Henwood Reviewed-on: http://review.whamcloud.com/17485 Tested-by: Jenkins Reviewed-by: Andreas Dilger --- InstallingLustre.xml | 696 ++++++++++++++++++++++++++++++--------------------- 1 file changed, 411 insertions(+), 285 deletions(-) diff --git a/InstallingLustre.xml b/InstallingLustre.xml index 7d7b5bd..b26454f 100644 --- a/InstallingLustre.xml +++ b/InstallingLustre.xml @@ -1,46 +1,50 @@ - - + + Installing the Lustre Software - This chapter describes how to install the Lustre software from RPM packages. It - includes: + This chapter describes how to install the Lustre software from RPM + packages. It includes: - + - + - For hardware and system requirements and hardware configuration information, see . + For hardware and system requirements and hardware configuration + information, see + .
- <indexterm> - <primary>installing</primary> - <secondary>preparation</secondary> - </indexterm> Preparing to Install the Lustre Software - You can install the Lustre software from downloaded packages (RPMs) or directly from the - source code. This chapter describes how to install the Lustre RPM packages. For information - about installing from source code, see . - The Lustre RPM packages have been tested on the Linux distributions listed in the table - below. + + installing + preparation + Preparing to Install the Lustre Software + You can install the Lustre software from downloaded packages (RPMs) + or directly from the source code. This chapter describes how to install the + Lustre RPM packages. For information about installing from source code, see + + . + The Lustre RPM packages have been tested on the Linux distributions + listed in the table below. Lustre Test Matrix - - - + + + Lustre Release - Servers Tested1 + Servers Tested + 1 Clients Tested @@ -86,7 +90,8 @@ RHEL 6.3, CentOS 6.3 - RHEL 6.3, CentOS 6.3, RHEL 5.8, CentOS 5.8, SLES 11 SP1 + RHEL 6.3, CentOS 6.3, RHEL 5.8, CentOS 5.8, SLES 11 + SP1 @@ -102,338 +107,457 @@
- 1Red Hat Enterprise Edition (RHEL), CentOS Enterprise Linux - Distribution (CentOS), SUSE Linux Enterprise Server (SLES), Fedora* - F18 Linux kernel (FC18). + + 1Red Hat Enterprise Edition (RHEL), CentOS + Enterprise Linux Distribution (CentOS), SUSE Linux Enterprise Server + (SLES), Fedora + *F18 Linux kernel (FC18).
Software Requirements - To install the Lustre software from RPMs, the following are required: - - Lustre server - packages. The required packages for Lustre servers are listed - in the table below, where ver refers to the Linux kernel - distribution (e.g., 2.6.32-358.6.2.el6) and arch refers to - the processor architecture (e.g., x86_64). These packages are available in the Lustre - Releases repository. - - - Packages Installed on Lustre Servers - - - - - - Package Name - Description - - - - - kernel-ver_lustre.arch - Linux kernel with Lustre software patches (often referred to as - "patched kernel") - - - lustre-ver_lustre.arch - Lustre software command line tools - - - lustre-modules-ver_lustre.arch - Lustre-patched kernel modules - - - lustre-ldiskfs-ver_lustre.arch - Lustre back-end file system tools - - - e2fsprogs - Utility to maintain Lustre back-end file system - - - lustre-tests-ver_lustre.arch - Lustre I/O Kit benchmarking tools (Included in - Lustre software as of release 2.2) - - - -
- - - - Lustre client - packages. The required packages for Lustre clients are listed - in the table below, where ver refers to the Linux - distribution (e.g., 2.6.18-348.1.1.el5). These packages are available in the Lustre - Releases repository. - - - Packages Installed on Lustre Clients - - - - - - Package Name - Description - - - - - lustre-client-modules-ver - Patchless kernel modules for client - - - lustre-client-ver_lustre - Client command line tools - - - lustre-client-tests-ver - Lustre I/O Kit (Included in Lustre software as - of release 2.2) - - - - -
- - - The version of the kernel running on a Lustre client must be the same as the - version of the lustre-client-modules-ver - package being installed. If the kernel running on the client is not compatible, a - kernel that is compatible must be installed on the client before the Lustre file - system software is installed. - - - - Lustre LNET network driver - (LND). The Lustre LNDs provided with the Lustre software are - listed in the table below. For more information about Lustre LNET, see . - - Network Types Supported by Lustre LNDs + To install the Lustre software from RPMs, the following are + required: + + + + + Lustre server packages + . The required packages for Lustre servers are listed in + the table below, where + verrefers to the Linux kernel distribution + (e.g., 2.6.32-358.6.2.el6) and + archrefers to the processor architecture + (e.g., x86_64). These packages are available in the + + Lustre Releasesrepository. + +
+ Packages Installed on Lustre Servers - - + + - Supported Network Types - Notes + Package Name + Description - TCP - Any network carrying TCP traffic, including GigE, 10GigE, and - IPoIB + + kernel- + ver + _lustre. + arch + + Linux kernel with Lustre software patches (often + referred to as "patched kernel") - InfiniBand network - OpenFabrics OFED (o2ib) + + lustre- + ver + _lustre. + arch + + Lustre software command line tools - gni - Gemini (Cray) + + lustre-modules- + ver + _lustre. + arch + + Lustre-patched kernel modules - Seastar - Cray + + lustre-ldiskfs- + ver + _lustre. + arch + + Lustre back-end file system tools - MX - Myrinet network + + e2fsprogs + + Utility to maintain Lustre back-end file + system - ra - RapidArray* interconnect + + lustre-tests- + ver + _lustre. + arch + + Lustre I/O Kit benchmarking tools + (Included in Lustre software as of + release 2.2) + + +
+ + + + + + Lustre client packages + . The required packages for Lustre clients are listed in + the table below, where + verrefers to the Linux distribution (e.g., + 2.6.18-348.1.1.el5). These packages are available in the + + Lustre Releasesrepository. + + + Packages Installed on Lustre Clients + + + + + + Package Name + Description + + + - Elan - Quadrics + + lustre-client-modules- + ver + + Patchless kernel modules for client + + + + lustre-client- + ver + _lustre + + Client command line tools + + + + lustre-client-tests- + ver + + Lustre I/O Kit + (Included in Lustre software as of + release 2.2)
- - + + + The version of the kernel running on a Lustre client must be + the same as the version of the + lustre-client-modules- + verpackage being installed. If the + kernel running on the client is not compatible, a kernel that is + compatible must be installed on the client before the Lustre file + system software is installed. + + + + + + Lustre LNET network driver (LND) + . The Lustre LNDs provided with the Lustre software are + listed in the table below. For more information about Lustre LNET, + see + . + + Network Types Supported by Lustre LNDs + + + + + + Supported Network Types + Notes + + + + + TCP + Any network carrying TCP traffic, including GigE, + 10GigE, and IPoIB + + + InfiniBand network + OpenFabrics OFED (o2ib) + + + gni + Gemini (Cray) + + + Seastar + Cray + + + MX + Myrinet network + + + ra + RapidArray + *interconnect + + + Elan + Quadrics + + + +
+ + - The InfiniBand and TCP Lustre LNDs are routinely tested during release cycles. The - other LNDs are maintained by their respective owners + The InfiniBand and TCP Lustre LNDs are routinely tested during + release cycles. The other LNDs are maintained by their respective + owners - High availability - software. If needed, install third party high-availability - software. For more information, see . + + + High availability software + . If needed, install third party high-availability + software. For more information, see + . - Optional - packages. Optional packages provided in the Lustre - Releases repository may include the following (depending on the operating - system and platform): - - kernel-debuginfo, kernel-debuginfo-common, - lustre-debuginfo, lustre-ldiskfs-debuginfo - - Versions of required packages with debugging symbols and other debugging options - enabled for use in troubleshooting. - - - kernel-devel, - Portions of the kernel tree needed to compile - third party modules, such as network drivers. - - - kernel-firmware - Standard Red Hat Enterprise Linux - distribution that has been recompiled to work with the Lustre kernel. - - - kernel-headers - Header files installed under /user/include and - used when compiling user-space, kernel-related code. - - - lustre-source - Lustre software source code. - - - (Recommended) perf, - perf-debuginfo, python-perf, - python-perf-debuginfo - Linux performance analysis tools that - have been compiled to match the Lustre kernel version. - - + + + Optional packages. + Optional packages provided in the + + Lustre Releasesrepository may include the following + (depending on the operating system and platform): + + + + kernel-debuginfo, + kernel-debuginfo-common, + lustre-debuginfo, + lustre-ldiskfs-debuginfo- Versions of required + packages with debugging symbols and other debugging options + enabled for use in troubleshooting. + + + + kernel-devel, - Portions of the kernel tree needed + to compile third party modules, such as network drivers. + + + + kernel-firmware- Standard Red Hat Enterprise Linux + distribution that has been recompiled to work with the Lustre + kernel. + + + + kernel-headers- Header files installed under + /user/include and used when compiling user-space, + kernel-related code. + + + + lustre-source- Lustre software source code. + + + + (Recommended) + perf, + perf-debuginfo, + python-perf, + python-perf-debuginfo- Linux performance analysis + tools that have been compiled to match the Lustre kernel + version. + +
Environmental Requirements - Before installing the Lustre software, make sure the following environmental - requirements are met. - - (Required) - Disable Security-Enhanced - Linux* (SELinux) on all Lustre servers and - clients. The Lustre software does not support SELinux. - Therefore, the SELinux system extension must be disabled on all Lustre nodes. Also, - make sure other security extensions (such as the Novell - AppArmor* security system) and network packet filtering - tools (such as iptables) do not interfere with the Lustre software. - - - (Required) Use the same user IDs (UID) and group IDs (GID) on all - clients. If use of supplemental groups is required, see - for information about supplementary user - and group cache upcall (identity_upcall). - - - (Recommended) Provide remote shell access to clients. It is - recommended that all cluster nodes have remote shell client access to facilitate the - use of Lustre configuration and monitoring scripts. Parallel Distributed SHell (pdsh) - is preferable, although Secure SHell (SSH) is acceptable. - - - (Recommended) Ensure client clocks are synchronized. The - Lustre file system uses client clocks for timestamps. If clocks are out of sync - between clients, files will appear with different time stamps when accessed by - different clients. Drifting clocks can also cause problems by, for example, making it - difficult to debug multi-node issues or correlate logs, which depend on timestamps. We - recommend that you use Network Time Protocol (NTP) to keep client and server clocks in - sync with each other. For more information about NTP, see: http://www.ntp.org. - - + Before installing the Lustre software, make sure the following + environmental requirements are met. + + + + (Required) + + Disable Security-Enhanced Linux + *(SELinux) on all Lustre servers and + clients. + The Lustre software does not support SELinux. Therefore, + the SELinux system extension must be disabled on all Lustre nodes. + Also, make sure other security extensions (such as the Novell + AppArmor + *security system) and network packet + filtering tools (such as iptables) do not interfere with the Lustre + software. + + + + (Required) + + Use the same user IDs (UID) and group IDs + (GID) on all clients. + If use of supplemental groups is required, see + for information about + supplementary user and group cache upcall ( + identity_upcall). + + + + (Recommended) + + Provide remote shell access to + clients. + It is recommended that all cluster nodes have remote shell + client access to facilitate the use of Lustre configuration and + monitoring scripts. Parallel Distributed SHell (pdsh) is preferable, + although Secure SHell (SSH) is acceptable. + + + + (Recommended) + + Ensure client clocks are + synchronized. + The Lustre file system uses client clocks for timestamps. + If clocks are out of sync between clients, files will appear with + different time stamps when accessed by different clients. Drifting + clocks can also cause problems by, for example, making it difficult + to debug multi-node issues or correlate logs, which depend on + timestamps. We recommend that you use Network Time Protocol (NTP) to + keep client and server clocks in sync with each other. For more + information about NTP, see: + http://www.ntp.org. + +
Lustre Software Installation Procedure - Before installing the Lustre software, back up ALL data. The Lustre software contains - kernel modifications that interact with storage devices and may introduce security issues - and data loss if not installed, configured, or administered properly. + Before installing the Lustre software, back up ALL data. The Lustre + software contains kernel modifications that interact with storage devices + and may introduce security issues and data loss if not installed, + configured, or administered properly. - To install the Lustre software from RPMs, complete the steps below. + To install the Lustre software from RPMs, complete the steps + below. - Verify that all Lustre installation requirements have been met. + Verify that all Lustre installation requirements have been + met. - For hardware requirements, see . + For hardware requirements, see + . - For software and environmental requirements, see the section above. + For software and environmental requirements, see the section + above. - Download the e2fsprogs RPMs for your platform from the Lustre Releases - repository. + Download the + e2fsprogs RPMs for your platform from the + + Lustre Releasesrepository. - Download the Lustre server RPMs for your platform from the Lustre Releases - repository. See for a list of required packages. + Download the Lustre server RPMs for your platform from the + + Lustre Releasesrepository. See + for a list of required packages. - Install the Lustre server and e2fsprogs packages on all Lustre servers (MGS, MDSs, and - OSSs). - - Log onto a Lustre server as the root user - - - Use the yum command to install the packages: - - # yum --nogpgcheck install pkg1.rpm pkg2.rpm ... - - - - Verify the packages are installed correctly: - - rpm -qa|egrep "lustre|wc"|sort - - - - Reboot the server. - - - Repeat these steps on each Lustre server. - - + Install the Lustre server and + e2fsprogs packages on all Lustre servers (MGS, MDSs, + and OSSs). + + + Log onto a Lustre server as the + root user + + + Use the + yum command to install the packages: + + +# yum --nogpgcheck install pkg1.rpm pkg2.rpm ... + + + + + Verify the packages are installed correctly: + + +rpm -qa|egrep "lustre|wc"|sort + + + + + Reboot the server. + + + Repeat these steps on each Lustre server. + + - Download the Lustre client RPMs for your platform from the Lustre Releases - repository. See for a list of required packages. + Download the Lustre client RPMs for your platform from the + + Lustre Releasesrepository. See + for a list of required packages. - Install the Lustre client packages on all Lustre clients. - The version of the kernel running on a Lustre client must be the same as the - version of the lustre-client-modules-ver - package being installed. If not, a compatible kernel must be installed on the client - before the Lustre client packages are installed. - + Install the Lustre client packages on all Lustre clients. + + The version of the kernel running on a Lustre client must be + the same as the version of the + lustre-client-modules- + verpackage being installed. If not, a + compatible kernel must be installed on the client before the Lustre + client packages are installed. + Log onto a Lustre client as the root user. - Use the yum command to install the packages: + Use the + yum command to install the packages: - # yum --nogpgcheck install pkg1.rpm pkg2.rpm ... + +# yum --nogpgcheck install pkg1.rpm pkg2.rpm ... + Verify the packages were installed correctly: - # rpm -qa|egrep "lustre|kernel"|sort + +# rpm -qa|egrep "lustre|kernel"|sort + @@ -445,7 +569,9 @@ - To configure LNET, go to . If default settings will be - used for LNET, go to . + To configure LNET, go to + . If default settings will be used for + LNET, go to + .
-- 1.8.3.1