backing up an MDT. In order to have <literal>--sparse</literal>
behave correctly, and complete the backup of and MDT in finite
time, the version of tar must be specified. Correctly functioning
- versions of tar include: Whamcloud
+ versions of tar include the Lustre-enhanced tar
<link xl:href='http://build.whamcloud.com/job/lustre-tar-master/'>http://build.whamcloud.com/job/lustre-tar-master/</link>,
Red Hat tar from RHEL 6.3 onwards and GNU tar version 1.25 or
more recent.</para>
</note>
<warning>
<para>The tar <literal>--xattrs</literal> option is only available
- in GNU tar distributions from Red Hat or Whamcloud. Whamcloud tar
- is available at <link xl:href='http://build.whamcloud.com/job/lustre-tar-master/'>http://build.whamcloud.com/job/lustre-tar-master/</link>.</para>
+ in GNU tar distributions from Red Hat or Intel.</para>
</warning>
</listitem>
<listitem>
<title>
<indexterm><primary>installing</primary><secondary>preparation</secondary></indexterm>
Preparing to Install the Lustre Software</title>
- <para>If you are using a supported Linux distribution and architecture, you can install Lustre from downloaded packages (RPMs). For a list of supported configurations, see the <link xl:href="http://wiki.whamcloud.com/">Lustre 2.0</link> topic on the Lustre wiki.</para>
- <para>A list of supported Lustre LNET drivers can be found in <xref linkend="understandinglustrenetworking"/>.</para>
- <para>If you are not using a supported configuration, you can install Lustre directly from the source code. For more information on this installation method, see <xref linkend="installinglustrefromsourcecode"/>.</para>
+ <para>If you are using a supported Linux distribution and architecture, you can install Lustre from downloaded packages (RPMs). For a list of available packages, see the <link xl:href="http://wiki.whamcloud.com/display/PUB/Lustre+Releases">Lustre Downloads</link> page.</para>
+ <para>A list of available Lustre LNET drivers can be found in <xref linkend="understandinglustrenetworking"/>.</para>
+ <para>If you are not using a configuration with pre-built packages, you can install Lustre directly from the source code. For more information on this installation method, see <xref linkend="installinglustrefromsourcecode"/>.</para>
<section xml:id="dbdoclet.50438261_37079">
<title><indexterm><primary>installing</primary><secondary>requirements</secondary></indexterm>
Required Software</title>
</tgroup>
</table>
<para>In all supported Lustre installations, a patched kernel must be run on each server, including the the MGS, the MDS, and all OSSs. Running a patched kernel on a Lustre client is only required if the client will be used for multiple purposes, such as running as both a client and an OST or if you want to use the same kernel on all nodes.</para>
- <para>Lustre RPM packages are available on the <link xl:href="http://build.whamcloud.com">Whamcloud download site</link>. They must be installed in the order described in the <xref linkend="dbdoclet.50438261_41900"/>.</para>
+ <para>Lustre RPM packages are available on the <link xl:href="http://downloads.whamcloud.com">Intel download site</link>. They must be installed in the order described in the <xref linkend="dbdoclet.50438261_41900"/>.</para>
<section remap="h4">
<title><indexterm><primary>installing</primary><secondary>network</secondary></indexterm>
Network-specific Kernel Modules and Libraries</title>
<itemizedlist>
<listitem>
<para><emphasis role="bold">e2fsprogs</emphasis> : Lustre requires a recent version of e2fsprogs that understands extents and large xattr. Use <literal>e2fsprogs-1.41.90.wc4</literal> or later, available at:</para>
- <para><link xl:href="http://build.whamcloud.com/">http://build.whamcloud.com/</link></para>
+ <para><link xl:href="http://downloads.whamcloud.com/">http://downloads.whamcloud.com/</link></para>
<para>A quilt patchset of all changes to the vanilla e2fsprogs is available in <literal>e2fsprogs-{version}-patches.tgz</literal>.</para>
<note>
<para>The Lustre-patched <literal>e2fsprogs</literal> utility is only required on machines that mount backend (<literal>ldiskfs</literal>) file systems, such as the OSS, MDS and MGS nodes. It does not need to be loaded on clients.</para>
</section>
<section remap="h4">
<title>(Optional) Debugging Tools and Other Optional Packages</title>
- <para>A variety of optional packages are provided on the <emphasis>
- <link xl:href="http://downloads.whamcloud.com">Whamcloud download site</link>
- </emphasis>. These include debugging tools, test programs and scripts, Linux kernel and Lustre source code, and other packages.</para>
- <para>For more information about debugging tools, see the topic <emphasis>
+ <para>A variety of optional packages are provided on the
+ <link xl:href="http://downloads.whamcloud.com">Intel download site</link>.
+ These include debugging tools, test programs and scripts, Linux kernel and Lustre source code, and other packages.</para>
+ <para>For more information about debugging tools, see the topic
<link xl:href="http://wiki.lustre.org/index.php/Debugging_Lustre">Debugging Lustre</link>
- </emphasis> on the Lustre wiki.</para>
+ on the Lustre wiki.</para>
</section>
</section>
<section xml:id="dbdoclet.50438261_19503">
<para>Download the Lustre RPMs.</para>
<orderedlist>
<listitem>
- <para>On the <link xl:href="http://build.whamcloud.com/">Lustre download site</link>, select your platform.</para>
+ <para>On the <link xl:href="http://downloads.whamcloud.com/">Lustre download site</link>, select your platform.</para>
<para>The files required to install Lustre (kernels, modules and utilities RPMs) are listed for the selected platform.</para>
</listitem>
<listitem>
<para>If <literal>e2fsprogs</literal> is already installed on your Linux system, install the Lustre-specific <literal>e2fsprogs</literal> version by using <literal>rpm -Uvh</literal> to upgrade the existing <literal>e2fsprogs</literal> package. For example:</para>
<screen>$ rpm -Uvh e2fsprogs-<ver> </screen>
<note>
- <para>The <literal>rpm</literal> command options <literal>--force</literal> or <literal>--nodeps</literal> should not be used to install or update the Lustre-specific <literal>e2fsprogs</literal> package. If errors are reported, file a bug (for instructions see the topic <emphasis>
+ <para>The <literal>rpm</literal> command options <literal>--force</literal> or <literal>--nodeps</literal> should not be used to install or update the Lustre-specific <literal>e2fsprogs</literal> package. If errors are reported, file a bug (for instructions see the topic
<link xl:href="http://wiki.lustre.org/index.php/Reporting_Bugs">Reporting Bugs</link>
- </emphasis> on the Lustre wiki).</para>
+ on the Lustre wiki).</para>
</note>
</listitem>
<listitem>
<para><emphasis role="italic">
<emphasis role="italic">(Optional)</emphasis>
</emphasis> To add optional packages to your Lustre file system, install them now.</para>
- <para>Optional packages include file system creation and repair tools, debugging tools, test programs and scripts, Linux kernel and Lustre source code, and other packages. A complete list of optional packages for your platform is provided on the <link xl:href="http://wiki.whamcloud.com">Whamcloud wiki</link>.</para>
+ <para>Optional packages include file system creation and repair tools, debugging tools, test programs and scripts, Linux kernel and Lustre source code, and other packages. A complete list of optional packages for your platform is provided on the <link xl:href="http://downloads.whamcloud.com/">Lustre Downloads</link> page.</para>
</listitem>
</orderedlist>
</listitem>
</listitem>
<listitem>
<para>Download the Lustre source code.</para>
- <para>On the <link xl:href="http://git.whamcloud.com/">Lustre download site</link>, select a version of Lustre to download and then select 'Source' as the platform.</para>
+ <para>On the <link xl:href="http://downloads.whamcloud.com/">Lustre download site</link>, select a version of Lustre to download and then select 'Source' as the platform.</para>
</listitem>
<listitem>
<para>Download the unpatched kernel.</para>
</listitem>
<listitem>
<para>Install the patched Lustre source code.</para>
- <para>This RPM is available at the <link xl:href="http://build.whamcloud.com">Lustre download site</link>.</para>
+ <para>This RPM is available at the <link xl:href="http://downloads.whamcloud.com">Lustre download site</link>.</para>
<screen>$ rpm -ivh \
kernel-lustre-source-2.6.18-92.1.10.el5_lustre.1.6.6.x86_64.rpm</screen>
</listitem>
<para>Compile and install the Lustre source code.</para>
<orderedlist>
<listitem>
- <para>Install the Lustre source (this can be done via RPM or tarball). The source file is available at the <link xl:href="http://git.whamcloud.com/">Lustre download site</link>. This example shows installation via the tarball.</para>
+ <para>Install the Lustre source (this can be done via RPM or tarball). The source file is available at the <link xl:href="http://git.whamcloud.com/">Lustre Git site</link>. This example shows installation via the tarball.</para>
<screen>$ cd /usr/src/
$ gunzip lustre-1.6.6.tar.gz
$ tar -xvf lustre-1.6.6.tar
<para><literal>Debugfs</literal>' ''ncheck'' is a brute-force search that may take a long time to complete.</para>
</note>
<note>
- <para>To find the Lustre file from a disk LBA, follow the steps listed in the document at this URL: <emphasis><link xl:href="http://smartmontools.sourceforge.net/badblockhowto.html">http://smartmontools.sourceforge.net/badblockhowto.html</link>. </emphasis> Then, follow the steps above to resolve the Lustre filename.</para>
+ <para>To find the Lustre file from a disk LBA, follow the steps listed in the document at this URL: <link xl:href="http://smartmontools.sourceforge.net/badblockhowto.html">http://smartmontools.sourceforge.net/badblockhowto.html</link>. Then, follow the steps above to resolve the Lustre filename.</para>
</note>
</section>
</chapter>
<para>This operations manual provides detailed information and procedures to install, configure and tune the Lustre file system. The manual covers topics such as failover, quotas, striping and bonding. The Lustre manual also contains troubleshooting information and tips to improve Lustre operation and performance.</para>
<section remap="h2">
<title>About this Document</title>
- <para>This document is maintained by Whamcloud, Inc in Docbook format. The canonical version is available at <link xl:href="http://wiki.whamcloud.com">http://wiki.whamcloud.com/</link>. </para>
+ <para>This document is maintained by Intel in Docbook format. The canonical version is available at <link xl:href="http://wiki.whamcloud.com/display/PUB/Documentation">http://wiki.whamcloud.com/display/PUB/Documentation</link>. </para>
<section remap="h2">
<title>UNIX Commands</title>
<section xmlns="http://docbook.org/ns/docbook" xmlns:xl="http://www.w3.org/1999/xlink" version="5.0" xml:lang="en-US">
<title>Revisions</title>
<para>
+ Note that the Lustre 2.x manual is intended to be relevant for all 2.x
+ releases of Lustre. Most of the manual content is relevant to all of
+ the releases. However, any features and content that are added for new
+ versions of Lustre should be clearly marked with the version in which
+ this functionality is added. Similarly, features that are no longer
+ available in Lustre 2.x should be marked with the version in which they
+ are deprecated or removed.
<revhistory>
<revision>
- <revnumber>1.0</revnumber>
+ <revnumber>2.3</revnumber>
+ <date>November 2012</date>
+ <author><orgname>Intel Corporation</orgname></author>
+ <revremark>Release of Lustre 2.3 manual</revremark>
+ </revision>
+ <revision>
+ <revnumber>2.1</revnumber>
<date>June 2011</date>
<author><orgname>Whamcloud, Inc</orgname></author>
- <revremark>First release of Lustre 2.x manual</revremark>
+ <revremark>First release of Lustre 2.1 manual</revremark>
</revision>
-</revhistory>
-</para>
+ </revhistory>
+ </para>
</section>
<para>Lustre is currently not particularly well suited for "peer-to-peer" usage models where there are clients and servers running on the same node, each sharing a small amount of storage, due to the lack of Lustre-level data replication. In such uses, if one client/server fails, then the data stored on that node will not be accessible until the node is restarted.</para>
<section remap="h3">
<title><indexterm><primary>Lustre</primary><secondary>features</secondary></indexterm>Lustre Features</title>
- <para>Lustre runs on a variety of vendor's kernels. For more details, see <link xl:href="http://wiki.whamcloud.com/">Lustre Release Information</link> on the Whamcloud wiki.</para>
+ <para>Lustre runs on a variety of vendor's kernels. For more details, see <link xl:href="http://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix">Lustre Support Matrix</link> on the Intel Lustre wiki.</para>
<para>A Lustre installation can be scaled up or down with respect to the number of client nodes, disk storage and bandwidth. Scalability and performance are dependent on available disk and network bandwidth and the processing power of the servers in the system. Lustre can be deployed in a wide variety of configurations that can be scaled well beyond the size and performance observed in production systems to date.</para>
<para><xref linkend="understandinglustre.tab1"/> shows the practical range of scalability and performance characteristics of the Lustre file system and some test results in production systems.</para>
<table frame="all">
</orderedlist>
</listitem>
</orderedlist>
- <para>If you have a problem upgrading Lustre, use the <link xl:href="https://groups.google.com/a/whamcloud.com/group/wc-discuss/">wc-discuss</link> mailing list, or file a ticket at the <link xl:href="https://jira.whamcloud.com">Whamcloud Jira</link> bug tracker.</para>
+ <para>If you have a problem upgrading Lustre, use the <link xl:href="https://groups.google.com/a/whamcloud.com/group/wc-discuss/">wc-discuss</link> mailing list, or file a ticket at the <link xl:href="https://bugs.whamcloud.com">Intel Lustre</link> bug tracker.</para>
</section>
</section>
</chapter>
<copyright>
<year>2010</year>
<year>2011</year>
- <holder>Oracle and/or its affiliates. (The original version of this Operations Manual without the Whamcloud modifications.)</holder>
+ <holder>Oracle and/or its affiliates. (The original version of this Operations Manual without the Intel modifications.)</holder>
</copyright>
<copyright>
<year>2011</year>
- <holder>Whamcloud, Inc. (Whamcloud modifications to the original version of this Operations Manual.)</holder>
+ <year>2012</year>
+ <holder>Intel Corporation. (Intel modifications to the original version of this Operations Manual.)</holder>
</copyright>
<legalnotice>
- <para>Notwithstanding Whamcloud’s ownership of the copyright in the modifications to the original version of this Operations Manual, as between Whamcloud and Oracle, Oracle and/or its affiliates retain sole ownership of the copyright in the unmodified portions of this Operations Manual.</para>
+ <para>Notwithstanding Intel’s ownership of the copyright in the modifications to the original version of this Operations Manual, as between Intel and Oracle, Oracle and/or its affiliates retain sole ownership of the copyright in the unmodified portions of this Operations Manual.</para>
</legalnotice>
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="legalnoticeWhamcloud.xml"/>
+ <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="legalnoticeIntel.xml"/>
<xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="legalnoticeOracle.xml"/>
</info>
<xi:include href="Preface.xml"/>
--- /dev/null
+<?xml version="1.0" encoding="UTF-8"?>
+<legalnotice xmlns="http://docbook.org/ns/docbook" xmlns:xl="http://www.w3.org/1999/xlink" version="5.0" xml:lang="en-US">
+ <title>Important Notice from Intel</title>
+
+ <para>INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.</para>
+
+ <para>A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS.</para>
+
+ <para>Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.</para>
+
+ <para>The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request.</para>
+
+ <para>Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.</para>
+
+ <para>Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to: http://www.intel.com/design/literature.htm</para>
+
+ <para>Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries. Lustre is a registered trademark of Oracle Corporation.</para>
+
+ <para>* Other names and brands may be claimed as the property of others.</para>
+
+ <para>THE ORIGINAL LUSTRE 2.x FILESYSTEM: OPERATIONS MANUAL HAS BEEN MODIFIED: THIS OPERATIONS MANUAL IS A MODIFIED VERSION OF, AND IS DERIVED FROM, THE LUSTRE 2.0 FILESYSTEM: OPERATIONS MANUAL PUBLISHED BY ORACLE AND AVAILABLE AT [http://www.lustre.org/]. MODIFICATIONS (collectively, the “Modifications”) HAVE BEEN MADE BY INTEL CORPORATION (“Intel”). ORACLE AND ITS AFFILIATES HAVE NOT REVIEWED, APPROVED, SPONSORED, OR ENDORSED THIS MODIFIED OPERATIONS MANUAL, OR ENDORSED INTEL, AND ORACLE AND ITS AFFILIATES ARE NOT RESPONSIBLE OR LIABLE FOR ANY MODIFICATIONS THAT INTEL HAS MADE TO THE ORIGINAL OPERATIONS MANUAL.</para>
+
+ <para>NOTHING IN THIS MODIFIED OPERATIONS MANUAL IS INTENDED TO AFFECT THE NOTICE PROVIDED BY ORACLE BELOW IN RESPECT OF THE ORIGINAL OPERATIONS MANUAL AND SUCH ORACLE NOTICE CONTINUES TO APPLY TO THIS MODIFIED OPERATIONS MANUAL EXCEPT FOR THE MODIFICATIONS; THIS INTEL NOTICE SHALL APPLY ONLY TO MODIFICATIONS MADE BY INTEL. AS BETWEEN YOU AND ORACLE: (I) NOTHING IN THIS INTEL NOTICE IS INTENDED TO AFFECT THE TERMS OF THE ORACLE NOTICE BELOW; AND (II) IN THE EVENT OF ANY CONFLICT BETWEEN THE TERMS OF THIS INTEL NOTICE AND THE TERMS OF THE ORACLE NOTICE, THE ORACLE NOTICE SHALL PREVAIL.
+ </para>
+
+ <para>Your use of any Intel software shall be governed by separate license terms containing restrictions on use and disclosure and are protected by intellectual property laws.</para>
+
+ <para>The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.</para>
+
+ <para>This work is licensed under a Creative Commons Attribution-Share Alike 3.0 United States License. To view a copy of this license and obtain more information about Creative Commons licensing, visit Creative Commons Attribution-Share Alike 3.0 United States [http://creativecommons.org/licenses/by-sa/3.0/us] or send a letter to Creative Commons, 171 2nd Street, Suite 300, San Francisco, California 94105, USA.</para>
+
+</legalnotice>
+++ /dev/null
-<?xml version="1.0" encoding="UTF-8"?>
-<legalnotice xmlns="http://docbook.org/ns/docbook" xmlns:xl="http://www.w3.org/1999/xlink" version="5.0" xml:lang="en-US">
- <title>Important Notice from Whamcloud </title>
-
- <para>THE ORIGINAL LUSTRE 2.x FILESYSTEM: ORACLE OPERATIONS MANUAL HAS BEEN MODIFIED: THIS OPERATIONS MANUAL IS A MODIFIED VERSION OF, AND IS DERIVED FROM, THE LUSTRE 2.0 FILESYSTEM: OPERATIONS MANUAL PUBLISHED BY ORACLE AND AVAILABLE AT [WWW.LUSTRE.ORG]. THE MODIFICATIONS (collectively, the “Modifications”) HAVE BEEN MADE BY WHAMCLOUD, INC. (“Whamcloud”). ORACLE AND ITS AFFILIATES HAVE NOT REVIEWED, APPROVED, SPONSORED, OR ENDORSED THIS MODIFIED OPERATIONS MANUAL, OR ENDORSED WHAMCLOUD, AND ORACLE AND ITS AFFILIATES ARE NOT RESPONSIBLE OR LIABLE FOR ANY MODIFICATIONS THAT WHAMCLOUD HAS MADE TO THE ORIGINAL OPERATIONS MANUAL.</para>
-
- <para>NOTHING IN THIS MODIFIED OPERATIONS MANUAL IS INTENDED TO AFFECT THE NOTICE PROVIDED BY ORACLE BELOW IN RESPECT OF THE ORIGINAL OPERATIONS MANUAL AND SUCH ORACLE NOTICE CONTINUES TO APPLY TO THIS MODIFIED OPERATIONS MANUAL EXCEPT FOR THE MODIFICATIONS; THIS WHAMCLOUD NOTICE SHALL APPLY TO THE MODIFICATIONS. AS BETWEEN YOU AND ORACLE: (I) NOTHING IN THIS WHAMCLOUD NOTICE IS INTENDED TO AFFECT THE TERMS OF THE ORACLE NOTICE BELOW; AND (II) IN THE EVENT OF ANY CONFLICT BETWEEN THE TERMS OF THIS WHAMCLOUD NOTICE AND THE TERMS OF THE ORACLE NOTICE, THE ORACLE NOTICE SHALL PREVAIL.
- </para>
-
- <para>Your use of any Whamcloud software shall be governed by separate license terms containing restrictions on use and disclosure and are protected by intellectual property laws.</para>
-
- <para>The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.</para>
-
- <para>Whamcloud is a trademark of Whamcloud. Other names may be trademarks of their respective owners.</para>
-
- <para>This work is licensed under a Creative Commons Attribution-Share Alike 3.0 United States License. To view a copy of this license and obtain more information about Creative Commons licensing, visit Creative Commons Attribution-Share Alike 3.0 United States [http://creativecommons.org/licenses/by-sa/3.0/us] or send a letter to Creative Commons, 171 2nd Street, Suite 300, San Francisco, California 94105, USA.</para>
-
-</legalnotice>
git://git.whamcloud.com / doc / manual.git / commitdiff