Whamcloud - gitweb
ext2fs: parallel bitmap loading
authorWang Shilong <wshilong@ddn.com>
Thu, 14 Jan 2021 00:27:22 +0000 (16:27 -0800)
committerTheodore Ts'o <tytso@mit.edu>
Thu, 21 Jan 2021 15:50:40 +0000 (10:50 -0500)
commite2e58d3128042f0b1aa9783d1e1c28816fa284a2
tree7a9f6880052340445fe3dbba07a14a73bdf3f8cc
parent2caad64629af6705159785d2d82353407a335050
ext2fs: parallel bitmap loading

In our benchmarking for PiB size filesystem, pass5 takes
10446s to finish and 99.5% of time takes on reading bitmaps.

It makes sense to reading bitmaps using multiple threads,
a quickly benchmark show 10446s to 626s with 64 threads.

[ This has all of many bug fixes for rw_bitmaps.c from the original
  luster patch set collapsed into a single commit.   In addition it has
  the new ext2fs_rw_bitmaps() api proposed by Ted. ]

Signed-off-by: Wang Shilong <wshilong@ddn.com>
Signed-off-by: Saranya Muruganandam <saranyamohan@google.com>
Signed-off-by: Theodore Ts'o <tytso@mit.edu>
lib/ext2fs/ext2fs.h
lib/ext2fs/rw_bitmaps.c