From 65294406a683a7adde056c5b597701a2a8f8bcd1 Mon Sep 17 00:00:00 2001 From: Andreas Dilger Date: Wed, 6 Jul 2011 12:28:24 -0600 Subject: [PATCH] LUDOC-11 cleanups to Lustre limits table The Lustre limits table was outdated in a few places, and not organized in a logical manner. Consolidate the table and update to latest values, and remove unknown characters in table. Clarify some of the Lustre feature descriptions in this section. Change-Id: I4ee903ccc8446f1c32e456bc6535e1af09e39379 Signed-off-by: Andreas Dilger --- UnderstandingLustre.xml | 36 +++++++++++++++++++----------------- 1 file changed, 19 insertions(+), 17 deletions(-) diff --git a/UnderstandingLustre.xml b/UnderstandingLustre.xml index a806956..6005ffa 100644 --- a/UnderstandingLustre.xml +++ b/UnderstandingLustre.xml @@ -57,16 +57,15 @@ Client Scalability - 100-100,000 + 100-100000 - 50,000+ clients - Many installations in 10,000 to 20,000 range + 50000+ clients, many in the 10000 to 20000 range - Client Performance + Client Performance Single client: @@ -87,13 +86,16 @@ Single OSS: - 1-8 OSTs per OSS, 128TB per OST + 1-32 OSTs per OSS, + 128TB per OST OSS count: - 500 OSSes, with up to 4000 OSTs, + 500 OSSs, with up to 4000 OSTs + Single OSS: - 8 OSTs per OSS, 16TB per OST + 8 OSTs per OSS, + 16TB per OST OSS count: 450 OSSs with 1000 4TB OSTs 192 OSSs with 1344 8TB OSTs @@ -124,13 +126,13 @@ Single MDS: 4 billion files MDS count: - 1 + 1 (primary with one backup) + 1 primary + 1 backup Single MDS: 750 million files MDS count: - 1 + 1 (primary with one backup) + 1 primary + 1 backup @@ -138,10 +140,12 @@ MDS Performance - 35000/s create, 100000/s stat metadata operations + 35000/s create operations, + 100000/s metadata stat operations - 15000/s create, 35000/s stat metadata operations + 15000/s create operations, + 35000/s metadata stat operations @@ -167,12 +171,10 @@ Other Lustre features are: - Performance-enhanced ext4 file system: Lustre uses an improved version of the ext4 journaling file system to store data and metadata. This version, called - ldiskfs - , has been enhanced to improve performance and provide additional functionality needed by Lustre. + Performance-enhanced ext4 file system: Lustre uses an improved version of the ext4 journaling file system to store data and metadata. This version, called ldiskfs, has been enhanced to improve performance and provide additional functionality needed by Lustre. - POSIX compliance : The full POSIX test suite passes in an identical manner to a local ext4 filesystem, with limited exceptions on Lustre clients. In a cluster, most operations are atomic so that clients never see stale data or metadata. Lustre supports mmap() file I/O. + POSIX compliance: The full POSIX test suite passes in an identical manner to a local ext4 filesystem, with limited exceptions on Lustre clients. In a cluster, most operations are atomic so that clients never see stale data or metadata. Lustre supports mmap() file I/O. High-performance heterogeneous networking: Lustre supports a variety of high performance, low latency networks and permits Remote Direct Memory Access (RDMA) for Infiniband (OFED) and other advanced networks for fast and efficient network transport. Multiple RDMA networks can be bridged using Lustre routing for maximum performance. Lustre also provides integrated network diagnostics. @@ -181,7 +183,7 @@ High-availability: Lustre offers active/active failover using shared storage partitions for OSS targets (OSTs) and active/passive failover using a shared storage partition for the MDS target (MDT). This allows application transparent recovery. Lustre can work with a variety of high availability (HA) managers to allow automated failover and has no single point of failure (NSPF). Multiple mount protection (MMP) provides integrated protection from errors in highly-available systems that would otherwise cause file system corruption. - Security: By default TCP connections are only allowed from privileged ports. Unix group membership is verified is done on the MDS. + Security: By default TCP connections are only allowed from privileged ports. Unix group membership is verified on the MDS. Access control list (ACL), exended attributes: the Lustre security model follows that of a UNIX file system, enhanced with POSIX ACLs. Noteworthy additional features include root squash. @@ -193,7 +195,7 @@ Object-based architecture: Clients are isolated from the on-disk file structure enabling upgrading of the storage architecture without affecting the client. - Byte-granular file and fine-grained metadata locking: Many clients can read and modify the same file or directory concurrently. The Lustre distributed lock manager (LDLM) ensures that files are coherent between all clients and servers in the filesystem. The MDT DLM manages locks on inode permissions and pathnames. Each OST has its own DLM for locks on file stripes stored theron, which scales the locking performance as the filesystem grows. + Byte-granular file and fine-grained metadata locking: Many clients can read and modify the same file or directory concurrently. The Lustre distributed lock manager (LDLM) ensures that files are coherent between all clients and servers in the filesystem. The MDT LDLM manages locks on inode permissions and pathnames. Each OST has its own LDLM for locks on file stripes stored thereon, which scales the locking performance as the filesystem grows. Quotas: User and group quotas are available for Lustre. -- 1.8.3.1