LU-17131 ldiskfs: Add Ubuntu 20.04.5 release 5.15 kernel Add support for Ubuntu 20.04.5 5.15 kernel similar to el9.2 with updated patches: ext4-corrupted-inode-block-bitmaps-handling-patches.patch ext4-data-in-dirent.patch ext4-dont-check-before-replay.patch ext4-inode-version.patch ext4-mballoc-extra-checks.patch ext4-prealloc.patch ext4-filename-encode.patch Tested with tag Ubuntu-hwe-5.15-5.15.0-91.101_20.04.1 Test-Parameters: trivial Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: Ic1b4b0f25a9ac984186cf4f37b5a73d93af93ebd Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/52414 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Tested-by: James Simmons <jsimmons@infradead.org> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Artem Blagodarenko <ablagodarenko@ddn.com> Reviewed-by: James Simmons <jsimmons@infradead.org> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-17351 ldiskfs: RHEL 9.3 ldiskfs server Updated patch series for el9.3 needs an updated ext4-data-in-dirent Test-Parameters: trivial env=SANITY_EXCEPT="906" \ mdtcount=4 mdscount=2 \ clientdistro=el9.3 serverdistro=el9.2 testlist=sanity Test-Parameters: trivial mdtcount=4 mdscount=2 \ clientdistro=el9.2 serverdistro=el9.3 testlist=sanity Test-Parameters: optional clientdistro=el9.3 serverdistro=el9.3 \ testgroup=full-part-1 Test-Parameters: optional clientdistro=el9.3 serverdistro=el9.3 \ testgroup=full-part-2 Test-Parameters: optional clientdistro=el9.3 serverdistro=el9.3 \ testgroup=full-part-3 HPE-bug-id: LUS-12050 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Signed-off-by: Jian Yu <yujian@whamcloud.com> Change-Id: Iac9731570422c57ef494602b1a40ac0b3d87d991 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53394 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Yang Sheng <ys@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: xinliang <xinliang.liu@linaro.org> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-17275 kernel: RHEL 8.9 client and server support This patch makes changes to support RHEL 8.9 release with kernel 4.18.0-513.5.1.el8_9 for Lustre client and server. Test-Parameters: trivial fstype=ldiskfs mdtcount=4 mdscount=2 \ clientdistro=el8.9 serverdistro=el8.8 testlist=sanity Test-Parameters: trivial fstype=zfs mdtcount=4 mdscount=2 \ clientdistro=el8.9 serverdistro=el8.8 testlist=sanity Test-Parameters: trivial fstype=ldiskfs mdtcount=4 mdscount=2 \ clientdistro=el8.8 serverdistro=el8.9 testlist=sanity Test-Parameters: trivial fstype=zfs mdtcount=4 mdscount=2 \ clientdistro=el8.8 serverdistro=el8.9 testlist=sanity Test-Parameters: optional clientdistro=el8.9 serverdistro=el8.9 \ testgroup=full-part-1 Test-Parameters: optional clientdistro=el8.9 serverdistro=el8.9 \ testgroup=full-part-2 Test-Parameters: optional clientdistro=el8.9 serverdistro=el8.9 \ testgroup=full-part-3 Change-Id: Ia3672d134534b877bb6aaffb4cea0339bc55974f Signed-off-by: Jian Yu <yujian@whamcloud.com> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/53071 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Yang Sheng <ys@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16962 build: cleanup configure messages Take advantage of LB2_MSG_LINUX_TEST_RESULT to cleanup the remaining configure checks. Re-order checking of OpenSSL support so checking message and result are not split. Test-Parameters: trivial HPE-bug-id: LUS-11709 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: I2880e2b50f4cc79106201c241fe7c078e5d8c37e Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51857 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Chris Horn <chris.horn@hpe.com> Reviewed-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Reviewed-by: Petros Koutoupis <petros.koutoupis@hpe.com> Reviewed-by: xinliang <xinliang.liu@linaro.org> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16976 ldiskfs: add support for openEuler 22.03 SP2 Add ldiskfs server support for oe2203sp2. Sync with ldiskfs-5.14-rhel9.2.series adding missing patches. Also refine openEuler lbuild scripts. Change-Id: I91841a7140a9f8f3182a4a329b9f04639a85e94d Test-Parameters: trivial Signed-off-by: Xinliang Liu <xinliang.liu@linaro.org> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51753 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-6142 misc: update headers in config, debian, rpm Update the file header to have the SPDX license and use the standard format. Fix minor style issues with comments in a few files. Remove `dnl` from m4 files. Files that are uncertain are left as NOASSERTION for the license identifier. This makes no claim about the file. It is used to track files so they can be addressed later. https://spdx.github.io/spdx-spec/v2-draft/package-information/#75-package-supplier-field Test-Parameters: trivial Signed-off-by: Timothy Day <timday@amazon.com> Change-Id: I212ce05a4292bbb0d71372d9d75880ce45a219f3 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/52106 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Arshad Hussain <arshad.hussain@aeoncomputing.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16906 build: Server for newer SUSE 15 SP3 kernels Update the SUSE 15 SP3 server support for newer kernels including LTSS series kernels. Add a new ldiskfs patch series for updated SUSE 15 SP3 kernels with a updated ext4-pdirop.patch Test-Parameters: trivial HPE-bug-id: LUS-11676 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: I0acf81abfcc71a64dc09a344a9231d86a44f193e Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51338 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Neil Brown <neilb@suse.de> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16957 build: Improve parallel --config-cache The parallel build should consider the configure cache before adding tests to the parallel build pass. Track the number of compile tests needed, skip the make when no build tests are needed. Also unify libcfs, core, and ldiskfs build passes to a single step. Configure timings vs master master master w/cache | patch patch w/cache -------------- --------------- | --------------- ---------------- real 1m3.493s real 0m34.024s | real 1m3.903s real 0m8.404s user 1m34.587s user 1m16.547s | user 1m37.191s user 0m4.292s sys 0m35.119s sys 0m22.687s | sys 0m35.297s sys 0m5.514s Test-Parameters: trivial HPE-bug-id: LUS-11706 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: I6696b350e8315190a67c1463435b18a87d45813e Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/51637 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: James Simmons <jsimmons@infradead.org> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Chris Horn <chris.horn@hpe.com>
LU-16405 osd: lookup cache MDT may need to re-lookup just checked names (after locking). introduce a trivial tiny per-thread cache in OSD in order to make such a repeating lookup cheap. the original issue is that ext4_add_entry() doesn't really check for possible duplicate (that would be expensive as a whole 4K block must be scanned). important: the cache is reset upon request processing completion as we don't update iversion on a disk (due to conflict with VBR). Fixes: 79acb9a9e7 ("LU-10235 mdt: mdt_create: check EEXIST without lock") Signed-off-by: Alex Zhuravlev <bzzz@whamcloud.com> Change-Id: I40c3ee702f7895c3bda00b380f904cd587e0a1c4 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/50521 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Lai Siyao <lai.siyao@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16824 ldiskfs: add support for openEuler 22.03 LTS SP1 Add openEuler 22.03 LTS SP1 config target file. Fix tiny conflicts for patch ext4-delayed-iput.patch and ext4-data-in-dirent.patch. Add missing patch ext4-encdata.patch. Add build required pkg kernel-debugsource for ldiskfs build. Change-Id: I68314c9df17ce991a5e46f2ed4746ce1703b1587 Test-Parameters: trivial Signed-off-by: Xinliang Liu <xinliang.liu@linaro.org> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/50978 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16756 kernel: RHEL 9.2 server support This patch makes changes to support RHEL 9.2 release with kernel 5.14.0-284.11.1.el9_2 for Lustre server. Test-Parameters: trivial env=SANITY_EXCEPT=27J fstype=ldiskfs \ clientdistro=el9.2 serverdistro=el9.2 testlist=sanity Test-Parameters: trivial env=SANITY_EXCEPT=27J fstype=zfs \ clientdistro=el9.2 serverdistro=el9.2 testlist=sanity Change-Id: I8fbffa2d9e48dabe62b6affadd11e7b03ae1aee7 Signed-off-by: Jian Yu <yujian@whamcloud.com> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/50852 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Yang Sheng <ys@whamcloud.com> Reviewed-by: Li Dongyang <dongyangli@ddn.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16755 kernel: RHEL 8.8 client and server support This patch makes changes to support RHEL 8.8 release with kernel 4.18.0-477.el8 for Lustre client and server. Test-Parameters: trivial fstype=ldiskfs \ clientdistro=el8.8 serverdistro=el8.8 testlist=sanity Test-Parameters: trivial fstype=zfs \ clientdistro=el8.8 serverdistro=el8.8 testlist=sanity Change-Id: Ie47f131e0340a601c8a5d748ecf9b1b73d4baa1f Signed-off-by: Jian Yu <yujian@whamcloud.com> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/50708 Reviewed-by: Yang Sheng <ys@whamcloud.com> Reviewed-by: Minh Diep <mdiep@whamcloud.com> Reviewed-by: Alex Zhuravlev <bzzz@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com>
LU-16664 build: Debian server fails building crypto.c When building deb files against a server built without CONFIG_FS_ENCRYPTION it still attempts to build crypto.c when it should not. Test-Parameters: trivial Fixes: 068e5f13fb ("LU-13743 build: Explicitly require encryption support") Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: Id1e67daa7b021fdfee49be4eb0beb2b86ca62c39 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/50406 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Sebastien Buisson <sbuisson@ddn.com> Reviewed-by: xinliang <xinliang.liu@linaro.org> Reviewed-by: jsimmons <jsimmons@infradead.org> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-15162 osd: improve OI lookup concurrency replace inode->i_mutex with i_rwsem in osd_obj_map_lookup() Signed-off-by: Alex Zhuravlev <bzzz@whamcloud.com> Change-Id: Id8df20e00ae254ea4dcf4b10415e1927fac6bd44 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/45353 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Artem Blagodarenko <ablagodarenko@ddn.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com>
LU-16535 ldiskfs: Add SUSE 15 SP5 server support SUSE 15 SP5 server support needs an updated ext4-mballoc-pa-free-mismatch.patch for Linux v5.18 and later, as linux/genhd.h was removed Test-Parameters: trivial HPE-bug-id: LUS-11471 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: I4c54edda99e9871389d560de58c415fc8c0ff0a2 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/49923 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: jsimmons <jsimmons@infradead.org> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16481 build: add server support for openEuler openEuer uses dnf as rpm pkg manager, it is somewhat like RHEL/Fedora. The current openEuler LTS 22.03 kernel is based on Linux 5.10.0. Ldiskfs patches based on ldiskfs-5.10.0-ml.series, different patches compared with ldiskfs-5.10.0-ml.series are: oe2203/ext4-misc.patch oe2203/ext4-pdirop.patch use due to openEuler kernel backport new bugfixes and based on ldiskfs-5.14.21-sles15sp4.series linux-5.16/ext4-inode-version.patch ubuntu20.04.3/ext4-simple-blockalloc.patch linux-5.14/ext4-xattr-disable-credits-check.patch use due to openEuler kernel backport new bugfixes. This patch also fixes lbuild that no need a kernel config file for patchless-server build. And add patched-server build needs an series patches checking. Test notes ---------- This patch is tested with below lbuild cmd: ../lustre-release/contrib/lbuild/lbuild --ccache --kerneldir=/home/openeuler/kernel-src-rpm/ --kernelrpm=/home/openeuler/kernel-src-rpm/ --lustre=/home/openeuler/lustre-release/lustre-2.15.54_1_xxx.tar.gz --patchless-server --disable-zfs Note that, due to zfs openEuler build support patches[1] haven't been backported to the stable release branch zfs-2.1-release and tag 2.1.5, current lbuild doesn't support zfs rpms build for openEuler you need to build zfs rpms in the zfs source code individually with cmd 'make rpms'. And until the openEuler gcc issue[2] is fixed, or you need to apply Lustre rpm spec patch[3]. Until the openEuler kernel symbols providing issue[4] is fixed, or you need to install kmod rpms with cmd 'sudo rpm -ivh --nodeps ./*.aarch64.rpm ' [1] https://github.com/openzfs/zfs/pulls?q=is%3Apr+is%3Aclosed+openeuler [2] https://gitee.com/openeuler/gcc/issues/I5XMD0 [3] diff lustre.spec.in ... -%define optflags -g -O2 -Werror +%define optflags -g -O2 -Werror -Wno-stringop-overflow [4] https://gitee.com/src-openeuler/kernel/issues/I6DQDX Test-Parameters: trivial Change-Id: Ie00e7d37ba3965e409b924109085a675bf3f7f4f Signed-off-by: Xinliang Liu <xinliang.liu@linaro.org> Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/49652 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Shaun Tancheff <shaun.tancheff@hpe.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-16354 ldiskfs: RHEL9.1 server support ldiskfs patch series for RHEL9.1 Test-Parameters: trivial HPE-bug-id: LUS-11332 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: Ia0757995ac7200eb50fadf5e106fe1d7b3dc0443 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/49283 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Yang Sheng <ys@whamcloud.com>
LU-13485 ldiskfs: Parallel configure tests for ldiskfs Transform the compile tests in ldiskfs to run in parallel Test-Parameters: trivial Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: I3a097ab5cd18b57e9311980d9aa708ed25f58464 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/38351 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Petros Koutoupis <petros.koutoupis@hpe.com> Reviewed-by: Jian Yu <yujian@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com>
LU-14409 ldiskfs: remove stray tracing code These lines should never have landed :-( Test-Parameters: trivial Signed-off-by: Mr NeilBrown <neilb@suse.de> Fixes: 3a83078628a4 ("LU-14409 ldiskfs: Add support for SUSE 5.3.18-24.46.1") Change-Id: I7720158605cce81721738a5f6640ccb4e0440b09 Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/49383 Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: James Simmons <jsimmons@infradead.org> Reviewed-by: Shaun Tancheff <shaun.tancheff@hpe.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Tested-by: jenkins <devops@whamcloud.com>
LU-15801 ldiskfs: Server support for RHEL9 RHEL9 server patches update from SUSE 15 SP 4 series Test-Parameters: trivial HPE-bug-id: LUS-10920 Signed-off-by: Shaun Tancheff <shaun.tancheff@hpe.com> Change-Id: I221f946d09892bf90406da70aa16432e5753d18a Reviewed-on: https://review.whamcloud.com/c/fs/lustre-release/+/47169 Tested-by: jenkins <devops@whamcloud.com> Tested-by: Maloo <maloo@whamcloud.com> Reviewed-by: Oleg Drokin <green@whamcloud.com> Reviewed-by: Andreas Dilger <adilger@whamcloud.com> Reviewed-by: Jian Yu <yujian@whamcloud.com>