Whamcloud - gitweb
LU-50 ldiskfs: pdirops patch for ldiskfs
authorLiang Zhen <liang@whamcloud.com>
Fri, 8 Jul 2011 17:43:08 +0000 (13:43 -0400)
committerOleg Drokin <green@whamcloud.com>
Wed, 21 Dec 2011 15:18:24 +0000 (10:18 -0500)
commit8e858671be59ed53fad2d340cf841b026943cc8a
tree7a3a0922823148fbc332012bd130877eac24b17b
parentd7e86afb0c64b5107a5aff8c45b962ec0104d255
LU-50 ldiskfs: pdirops patch for ldiskfs

Single directory performance is a critical for HPC workloads. In a
typical use case an application creates a separate output file for
each node and task in a job. As nodes and tasks increase, hundreds
of thousands of files may be created in a single directory within
a short window of time.
Today, both filename lookup and file system modifying operations
(such as create and unlink) are protected with a single lock for
an entire ldiskfs directory. PDO project will remove this
bottleneck by introducing a parallel locking mechanism for entire
ldiskfs directories. This work will enable multiple application
threads to simultaneously lookup, create and unlink in parallel.

This patch contains:
  - pdirops support for ldiskfs
  - N-level htree directory
  - integrate with osd-ldiskfs

Change-Id: I269c0e3112e68f3acd79e860dab052a68c7d7aaa
Signed-off-by: Liang Zhen <liang@whamcloud.com>
Reviewed-on: http://review.whamcloud.com/375
Tested-by: Hudson
Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
Tested-by: Maloo <whamcloud.maloo@gmail.com>
Reviewed-by: Oleg Drokin <green@whamcloud.com>
build/autoconf/lustre-build-ldiskfs.m4
ldiskfs/configure.ac
ldiskfs/kernel_patches/patches/ext4_pdirop-rhel6.patch [new file with mode: 0644]
ldiskfs/kernel_patches/series/ldiskfs-2.6-rhel6.series
ldiskfs/ldiskfs/Makefile.in
ldiskfs/ldiskfs/autoMakefile.am
lustre/osd-ldiskfs/osd_handler.c
lustre/osd-ldiskfs/osd_internal.h
lustre/osd-ldiskfs/osd_lproc.c