3 * See http://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix
4 for currently supported client and server kernel versions.
5 * Server known to build on patched kernels:
6 2.6.32-431.17.1.el6 (RHEL6.5)
7 3.0.101-0.31 (SLES11 SP3)
8 * Client known to build on unpatched kernels:
9 2.6.32-431.17.1.el6 (RHEL6.5)
10 3.0.101-0.31 (SLES11 SP3)
13 * Recommended e2fsprogs version: 1.42.9.wc1 or newer
14 * NFS export disabled when stack size < 8192 (32-bit Lustre clients),
15 since the NFSv4 export of Lustre filesystem with 4K stack may cause a
16 stack overflow. For more information, please refer to bugzilla 17630.
17 * NFSv4 reexport to 32-bit NFS client nodes requires Lustre client on
18 the re-exporting nodes to be mounted with "32bitapi" mount option
20 --------------------------------------------------------------------------------
22 10-31-2013 Intel Corporation
24 * See http://wiki.hpdd.intel.com/display/PUB/Lustre+Support+Matrix
25 * Server builds for kernels:
26 2.6.32-358.18.1.el6 (RHEL6.4)
27 * Client builds for unpatched kernels:
28 2.6.32-358.18.1.el6 (RHEL6.4)
29 3.0.92-0.8 (SLES11 SP3)
31 * Recommended e2fsprogs version: 1.42.7.wc2 or newer
32 * NFS export disabled when stack size < 8192 (32-bit Lustre clients),
33 since the NFSv4 export of Lustre filesystem with 4K stack may cause a
34 stack overflow. For more information, please refer to bugzilla 17630.
35 * NFSv4 reexport to 32-bit NFS client nodes requires Lustre client on
36 the re-exporting nodes to be mounted with "32bitapi" mount option
38 --------------------------------------------------------------------------------
40 05-30-2013 Intel Corporation
42 * See http://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix
43 * Server builds for kernels:
44 2.6.32-358.6.2.el6 (RHEL6.4)
45 * Client builds for unpatched kernels:
46 2.6.32-358.6.2.el6 (RHEL6.4)
47 3.0.74-0.6.6 (SLES11 SP2)
49 * Recommended e2fsprogs version: 1.42.7.wc1 or newer
50 * NFS export disabled when stack size < 8192 (32-bit Lustre clients),
51 since the NFSv4 export of Lustre filesystem with 4K stack may cause a
52 stack overflow. For more information, please refer to bugzilla 17630.
53 * NFSv4 reexport to 32-bit NFS client nodes requires Lustre client on
54 the re-exporting nodes to be mounted with "32bitapi" mount option
56 --------------------------------------------------------------------------------
58 9-30-2012 Whamcloud, Inc.
60 * See http://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix
61 * Server support for kernels:
62 2.6.32-279.5.1.el6 (RHEL6)
63 * Client support for unpatched kernels:
64 2.6.32-279.5.1.el6 (RHEL6)
66 2.6.18-238.19.1.el5 (RHEL5)
67 2.6.16.60-0.69.1 (SLES10)
68 * Recommended e2fsprogs version: 1.41.90.wc4
69 * NFS export disabled when stack size < 8192 (32-bit Lustre clients),
70 since the NFSv4 export of Lustre filesystem with 4K stack may cause a
71 stack overflow. For more information, please refer to bugzilla 17630.
72 * NFSv4 reexport to 32-bit NFS client nodes requires Lustre client on
73 the re-exporting nodes to be mounted with "32bitapi" mount option
75 Severity : enhancement
77 Description: Update RHEL6.3 kernel to 2.6.32-279.5.1.el6.
79 Severity : enhancement
81 Description: Update RHEL6.3 kernel to 2.6.32-279.2.1.el6.
83 Severity : enhancement
85 Description: Update RHEL6.2 kernel to 2.6.32-220.17.1.el6
87 Severity : enhancement
89 Description: Update RHEL6.2 kernel to 2.6.32-220.13.1.el6
91 Severity : enhancement
93 Description: Update RHEL6.2 kernel to 2.6.32-220.7.1.el6
95 --------------------------------------------------------------------------------
97 04-30-2012 Whamcloud, Inc.
99 * See http://wiki.whamcloud.com/display/PUB/Lustre+Support+Matrix
100 * Server support for kernels:
101 2.6.32-220.4.2.el6 (RHEL6)
102 * Client support for unpatched kernels:
103 2.6.32-220.4.2.el6 (RHEL6)
105 2.6.18-238.19.1.el5 (RHEL5)
106 2.6.16.60-0.69.1 (SLES10)
107 * Recommended e2fsprogs version: 1.41.90.wc4
108 * NFS export disabled when stack size < 8192 (32-bit Lustre clients),
109 since the NFSv4 export of Lustre filesystem with 4K stack may cause a
110 stack overflow. For more information, please refer to bugzilla 17630.
111 * NFSv4 reexport to 32-bit NFS client nodes requires Lustre client on
112 the re-exporting nodes to be mounted with "32bitapi" mount option
114 Severity : enhancement
116 Description: Update RHEL6.2 kernel to 2.6.32-220.4.2.el6
118 Severity : enhancement
120 Description: Update RHEL6.2 kernel to 2.6.32-220.4.1.el6
122 Severity : enhancement
124 Description: Update RHEL6.2 kernel to 2.6.32-220.el6
126 Severity : enhancement
128 Description: Update RHEL6.1 kernel to 2.6.32-131.17.1.el6
130 --------------------------------------------------------------------------------
132 09-30-2011 Whamcloud, Inc.
134 * Server support for kernels:
135 2.6.18-238.19.1.el5 (RHEL5)
136 2.6.32-131.6.1.el6 (RHEL6)
137 * Client support for unpatched kernels:
138 (see http://wiki.lustre.org/index.php?title=Patchless_Client)
139 2.6.18-238.19.1.el5 (RHEL5)
140 2.6.32-131.6.1.el6 (RHEL6)
141 2.6.29.4-167.fc11 (FC11)
142 2.6.16.60-0.69.1 (SLES10)
144 * Recommended e2fsprogs version: 1.41.90.wc3
145 * NFS export disabled when stack size < 8192. Since the NFSv4 export of
146 Lustre filesystem with 4K stack may cause a stack overflow. For more
147 information, please refer to bugzilla 17630.
148 * NFSv4 reexport requires Lustre client on the re-exporting nodes to be
149 mounted with "32bitapi" mount option
151 Severity : enhancement
152 Description: Update RHEL6.1 kernel to 2.6.32-131.6.1.el6
154 Severity : enhancement
155 Description: Update RHEL5.6 kernel to 2.6.18-238.19.1.el5
157 Severity : enhancement
158 Description: Update RHEL5.6 kernel to 2.6.18-238.9.1.el5
161 Frequency : only with SLES10
163 Description: Use OFED "KMP" provided by Novell
164 Details : SLES10 SP3 ships with OFED in a separate "KMP" package.
165 Lustre is now built against this package. That means you need to
166 install the ofed-kmp package from Novell for the patchless client.
167 Note that the ofed-kmp that Novell ships may not exactly match the
168 kernel version but should still be compatible.
170 Severity : enhancement
172 Description: Update RHEL5.5 kernel to 2.6.18-194.17.1.el5
173 Update OEL5.5 kernel to 2.6.18-194.17.1.0.1.el5.
175 --------------------------------------------------------------------------------
177 2010-07-15 Oracle, Inc.
179 * Server support for kernels:
180 2.6.18-164.11.1.el5 (RHEL 5)
181 2.6.18-164.11.1.0.1.el5 (OEL 5)
182 * Client support for unpatched kernels:
183 (see http://wiki.lustre.org/index.php?title=Patchless_Client)
184 2.6.18-164.11.1.el5 (RHEL 5),
185 2.6.18-164.11.1.0.1.el5 (OEL 5)
186 2.6.16.60-0.42.8 (SLES 10),
188 2.6.29.4-167.fc11 (FC11)
189 * Recommended e2fsprogs version: 1.41.10-sun2
191 Severity : enhancement
193 Description: Distribute lfs_migrate script with lustre
194 Details : The lfs_migrate mentioned in the manual is now included in the
195 lustre tree in lustre/scripts and will distributed in lustre RPMs.
197 Severity : enhancement
199 Description: Failover nid list added to import proc file.
201 Severity : enhancement
203 Description: "som_preview" mount option required to use SOM
204 Details : The clients will need to use som_preview mount option
208 Description: Lustre does not do 1MB IOs to HW RAID
209 Details : Bump MAX_PHYS/HW_SEGMENTS and SG_ALL to 256 in the RHEL5 kernel.
211 Severity : enhancement
213 Description: lfs quota output is not very convenient for awk/sed-parsing
214 Details : Some positions in lfs quota output table could be empty or
215 non-empty which made it hard to parse it with scripts, now
216 a dash is put instead of space where there is not supposed
221 Description: Update to OFED 1.5.1
222 Details : OFED 1.5.1 will be used in environments that don't use
223 vendor supplied OFED.
227 Description: Remove lnet. prefix from lctl params display
228 Details : Also renamed lnet.memused to lnet_memused to
233 Description: Use conf_param -d to remove permanant settings.
237 Description: Add list_param -R
238 Details : lctl list_param now supports recursive mode.
241 Bugzilla : 21829, 22312
242 Description: Fix llobdstat.
243 Details : 1. Now updating the write_bytes counter
244 2. Port script fixes from 1.8.
248 Description: decrease the usage of memory on clients.
249 Details : 1. On clients, recycle dentries and inodes unused.
250 2. Delete the code related to ll_deathrow(att 6215 in bug 1443). It
255 Description: llobdstat fix and enhancement
256 Details : add a counter to set a limit to how many samples will be returned
257 fix a wildcard in the path to limit to obdfilter stats only
261 Description: lfs check only allowed for root
262 Details : Code cleanups and added a regresion test of non-root use of
267 Description: MDS Oopses in ptlrpc_dispatch_difficult_reply()/__list_add()
268 Details : Fix hr->hr_index overload.
272 Description: Fix FIEMAP functionality.
276 Description: FC11 patchless client support added
280 Description: Update RHEL5.4 kernel to 2.6.18-164.11.1.el5 and
281 OEL5.4 kernel to 2.6.18-164.11.1.0.1.el5.
285 Description: New acc-sm script and various test-framework enhancments.
289 Description: Previously landed patch was reverted.
293 Description: Update SLES10 kernel to 2.6.16.60-0.42.8 (patchless)
297 Description: Add ldiskfs maxdirsize mount option.
301 Description: Fix mkfs.lustre support for 16TB LUNs.
305 Description: Print mmp_check_interval
306 Details : print mmp_check_interval and make it possible to abort
307 mount operation in case it takes too long.
311 Description: Add cascading_rw to lustre mpi tests.
315 Description: Store SOM data in EA.
316 Details : Also several SOM related cleanups.
320 Description: Add refcount to md_open_data
324 Description: Use refcount on lov_request_set to prevent memory corruption.
328 Description: Statahead: use parent dir's i_mutex for synchronization.
332 Description: loadgen improvements.
336 Description: Enable peer health detection in ksocklnd and ko2iblnd.
340 Description: Control DCACHE_LUSTRE_INVALID flag with MDS_INODE_LOOKCUP lock
344 Description: Fix race on obd_devcie:md_stats
348 Description: Fix SLES 11 client builds.
349 Details : Resolved uninitalized pointer gcc warnings.
353 Description: Allow non-root access for "lfs check".
354 Details : Added a check in obd_class_ioctl() for OBD_IOC_PING_TARGET.
358 Description: Clear imp_force_reconnect correctly in ptlrpc_connect_interpret()
360 Severity : enhancement
362 Description: Update kernel to RHEL5.4 2.6.18-164.6.1.el5 and
363 OEL5 2.6.18-164.6.1.0.1.el5(Both in-kernel OFED enabled).
367 Description: Sanity test_27p fails.
368 Details : OBD_FAIL_OST_ENOSPC has been moved to filter_statfs().
369 Sanity tests 27 were cleaned up and improved.
373 Description: Unify req format on client/servers
374 Details : Use new req_capsule API [almost] everywhere instead of old PTLRPC
375 buffers and swabbers approach..
380 Description: drop join file stuff.
382 Severity : enhancement
384 Description: Add 2.6.27 and SLES11 (patchless client) support
388 Description: Fix in ptlrpc_expire_one_request() to print the signed time
391 Severity : enhancement
393 Description: Build kernels (RHEL5, OEL5 and SLES10/11) using the vendor's own
396 Severity : enhancement
398 Description: Remove set_info(KEY_UNLINKED) from MDS/OSC
400 Severity : enhancement
402 Description: correctly handle big reply message.
403 Details : send LNet event if reply is bigger then buffer and adjust this buffer
408 Description: Drop unnecessary __GFP_NOMEMALLOC flag from filter_get_page()
410 Severity : enhancement
412 Description: Add support for OEL5.
416 Description: Conf-sanity.sh 50g test - deactivated OST should not cause a panic.
418 Severity : enhancement
420 Description: "weak-modules" support
421 Details : Implement "weak-modules" support which enables kernel modules
422 to be used with any kernel that implements the same kABI. In
423 order to achieve this modules are now installed in
424 /lib/modules/$(uname -r)/updates/kernel on all distributions.
428 Description: client could not reconnect to OST because of an active request.
429 Details : The client now retries to reconnect to the same server, if a
430 connect request failed with EBUSY or -EAGAIN. Test case 35b
431 conf-sanity.sh has been created.
435 Description: Don't allow make backward step on assignin osc next id.
436 Details : race between allocation next id and ll_sync thread can be cause
437 of set wrong osc next id and can be kill valid ost objects.
441 Description: Changes in raid5-large-io-rhel5.patch to calculate sectors properly
445 Description: Increase the default BLK_DEF_MAX_SECTORS value for RHEL5 and SLES11
449 Description: Error handling in osc_statfs_interpret() has been improved.
450 Details : Check in osc_statfs_interpret() for EBADR.
454 Description: Do not send statfs() requests to OSTs disabled by administrator.
455 Details : Check in lov_prep_statfs_set() for non-NULL ltd_exp.
457 Severity : enhancement
459 Description: Added sanity-quota test to for lfs(1) to work with numeric uid/gid.
461 Severity : enhancement
463 Description: Update kernel to RHEL5 2.6.18-128.7.1.el5.
465 Severity : enhancement
467 Description: Enhancement for lfs(1) command to use numeric uid/gid.
471 Description: Improved cleanup procedure for conf-sanity test_46a.
475 Description: Do not start bulk transfer, if client tried to reconnect.
476 Details : Do not start bulk transfer, if client tried to reconnect,
477 but failed due to active rpcs. Check for exp_abort_active_req
478 has been implemented.
482 Description: Prevent inconsistences between linux and lustre mount structures.
483 Details : Wait indefinitely in server_wait_finished() until mnt_count drops.
484 Make the sleep interruptible.
486 Severity : enhancement
488 Description: provide server to client comms path
489 Details : server to client communications path via new LDLM_SET_INFO rpc
493 Description: truncate starts GFP_FS allocation under transaction causing deadlock
494 Details : ldiskfs_truncate calls grab_cache_page which may start page
495 allocation under an open transaction. This may lead to
496 calling prune_icache with consequent lustre reentrance.
500 Description: send correctly lsm on open replay
501 Details : MDS is trust to LSM size on replay open, but client can set wrong size
506 Description: enable client interface failover
507 Details : When a child reconnects from another NID, properly update export
508 nid hash position and ldlm reverse import.
510 Severity : enhancement
512 Description: Communicate OST degraded/readonly state via statfs to MDS
513 Details : Flags in the statfs returned from OSTs indicate whether the
514 OST is in a degraded RAID state, or if the filesystem has
515 turned read-only after a filesystem error is detected.
520 Description: don't panic if EPROTO was hit when reading symlink
521 Details : correctly handling request reference in error cases.
523 Severity : enhancement
525 Description: Add LustreNetLink, a kernel-userspace communcation path.
527 Severity : enhancement
529 Description: Update kernel to SLES10 SP2 2.6.16.60-0.39.3.
534 Description: access to llog context before init.
535 Details : move handling CATALOGS file at osc layer and forbid access to llog
539 Frequency : rare, only when client is writing to OST on local node
541 Description: Avoid deadlock for local client writes
542 Details : Use new OBD_BRW_MEMALLOC flag to notify OST about writes in the
543 memory freeing context. This allows OST threads to set the
544 PF_MEMALLOC flag on task structures in order to allocate memory
545 from reserved pools and complete IO.
546 Use GFP_HIGHUSER for OST allocations for non-local client writes,
547 so that the OST threads generate memory pressure and allow
548 inactive pages to be reclaimed.
550 Severity : enhancement
552 Description: Update kernel to RHEL5.3 2.6.18-128.1.14.el5.
557 Description: lock ordering violation between &cli->cl_sem and _lprocfs_lock
558 Details : move ldlm namespace creation in setup phase to avoid grab
559 _lprocfs_lock with cli_sem held.
563 Description: Temporarily disable grant shrink.
564 Details : Disable the feature for debugging.
567 Frequency : only when formatting test filesystems
569 Description: Unable to run several mkfs.lustre on loop devices at the same time
570 Details : mkfs.lustre returns error 256 on the concurrent loop devices
571 formatting. The solution is to proper handle the error.
573 Severity : enhancement
575 Description: Update kernel to RHEL5.3 2.6.18-128.1.6.el5.
577 Severity : enhancement
579 Description: Update kernel to SLES10 SP2 2.6.16.60-0.37.
584 Description: resolve race between obd_disconnect and class_disconnect_exports
585 Details : if obd_disconnect will be called to already disconnected export he
586 forget release one reference and osc module can't unloaded.
588 Severity : enhancement
590 Description: Allow tuning service thread via /proc
591 Details : For each service a new
592 /proc/fs/lustre/{service}/*/thread_{min,max,started} entry is
593 created that can be used to set min/max thread counts, and get the
594 current number of running threads.
599 Descriptoin: don't return error if have partially created objects for file.
600 Details : lov_update_create_set uses set->set_success as index for created
601 objects, so if some requests will be failed, they will have hole
602 at end of array and qos_shrink_lsm for allocate correct lsm.
604 Severity : enhancement
606 Description: Update OFED support to 1.4.1
611 Description: Reduce small size read RPC
612 Details : Set read-ahead limit for every file and only do read-ahead when
613 available read-ahead pages are bigger than 1M to avoid small size
616 Severity : enhancement
618 Description: move AT tunable parameters for more consistent usage
619 Details : add AT tunables under /proc/sys/lustre, add to conf_param parsing
621 Severity : enhancement
623 Description: add lazystatfs mount option to allow statfs(2) to skip down OSTs
624 Details : allow skip disconnected ost for send statfs request and hide error
630 Description: fix racy locking of mballoc block bitmaps causing BUG
631 Details : The locking of the mballoc buddy bitmap and the in-memory
632 block bitmap was using two different spin locks in some
633 cases. This made it possible to incorrectly access the
634 mballoc bitmap while another process was modifying it,
635 causing a sanity assertion to fail. While no on-disk corruption
636 was reported, there was some risk of this happening.
639 Frequency : rare, on llog test 6
641 Descriptoin: don't allow connect to already connected import
642 Details : allowing connect to already connected import is hide connecting problem.
647 Descriptoin: allow kill process which wait statahead result
648 Details : for some reasons 'ls' can stick in waiting result from statahead,
649 in this case need way for kill this process.
651 Severity : enhancement
653 Description: Add state history info file, enhance import info file
654 Details : Track import connection state changes in a new osc/mdc proc file;
655 add overview-type data to the osc/mdc import proc file.
657 Severity : enhancement
659 Description: MDS create should not wait for statfs RPC while holding DLM lock.
661 Severity : enhancement
663 Description: Update to RHEL5U3 kernel-2.6.18-128.1.1.el5.
668 Descriptoin: OST grant too much space to client even there are not enough space.
669 Details : Client will shrink its grant cache to OST if there are no write
670 activity over 6 mins (GRANT_SHRINK_INTERVAL), and OST will retrieve
671 this grant cache if there are already not enough avaible space
672 (left_space < total_clients * 32M).
675 Frequency : start MDS on uncleanly shutdowned MDS device
677 Descriptoin: ll_sync thread stay in waiting mds<>ost recovery finished
678 Details : stay in waiting mds<>ost recovery finished produce random bugs
679 due race between two ll_sync thread for one lov target. send
680 ACTIVATE event only if connect realy finished and import have
684 Frequency : rare, connect and disconnect target at same time
686 Descriptoin: ASSERTION(atomic_read(&imp->imp_inflight) == 0
687 Details : don't call obd_disconnect under lov_lock. this long time
688 operation and can block ptlrpcd which answer to connect request.
693 Descriptoin: don't lose wakeup for imp_recovery_waitq
694 Details : recover_import_no_retry or invalidate_import and import_close can
695 both sleep on imp_recovery_waitq, but we was send only one wakeup
699 Frequency : always with long access acl
701 Descriptoin: mds can't pack reply with long acl.
702 Details : mds don't control size of acl but they limited by reint/getattr
705 Severity : enhancement
707 Description: Update to SLES10 kernel-2.6.16.60-0.33.
709 Severity : enhancement
711 Description: Update to RHEL5 kernel-2.6.18-92.1.22.el5.
714 Frequency : start MDS on uncleanly shutdowned MDS device
716 Descriptoin: aborting recovery hang on MDS
717 Details : don't throttle destroy RPCs for the MDT.
720 Frequency : on remount
722 Description: external journal device not working after the remount
723 Details : clear dev_rdonly flag for external journal devices in
729 Description: shutdown vs evict race
730 Details : client_disconnect_export vs connect request race.
731 if client will evicted at this time - we start invalidate
732 thread without referece to import and import can be freed
736 Frequency : rare, need acl's on inode.
738 Description: client can't handle ost additional correctly
739 Details : if ost was added after client connected to mds client can have
740 hit lnet_try_match_md ... to big messages to wide striped files.
741 in this case need teach client to handle config events about add
742 lov target and update client max ea size at that event.
744 Severity : enhancement
746 Description: Changelogs
747 Details : Changelogs are a lightweight mechanism to track filesystem
748 metadata and namespace changes. The changelog is recorded
749 permanently on the MDTs, and is periodically "consumed" / purged
750 when records are no longer needed.
752 Severity : enhancement
754 Description: compact fld format with extents
755 Details : Store range of seq rather than every seq in FLD. Seq
756 controller update FLD rather than clients. In Case of CMD, mdt0
757 has FLD, all other metadata server act as non persistent proxy
758 for FLD queries and cache fld entries in fld cache.
763 Description: don't skip ost target if they assigned to file
764 Details : Drop slow OSCs if we can, but not for requested start idx.
765 This means "if OSC is slow and it is not the requested
766 start OST, then it can be skipped, otherwise skip it only
767 if it is inactive/recovering/out-of-space.
771 Description: more cleanup in mds_lov
772 Details : not send LOV EA under replay, we can't know about they size at this
773 time. Don't allow client connect to mds before any ost connected,
774 for avoid problems with LOV EA size and returning EIO to client.
776 Severity : enhancement
778 Description: Interoperability at server side (Disk interoperability)
780 Severity : enhancement
782 Description: Update to RHEL5 kernel-2.6.18-92.1.17.el5.
784 Severity : enhancement
786 Description: Update to SLES10 SP2 kernel-2.6.16.60-0.31.
788 Severity : enhancement
790 Description: New client IO stack (CLIO).
792 Severity : enhancement
794 Description: Commit on sharing. Eliminate inter-client dependencies between
795 uncommitted transactions by doing transaction commits.
796 Thereby clients may recovery independently.
799 Frequency : Create a symlink file with a very long name
801 Description: ldlm_cancel_pack()) ASSERTION(max >= dlm->lock_count + count)
802 Details : If there is no extra space in the request for early cancels,
803 ldlm_req_handles_avail() returns 0 instead of a negative value.
805 Severity : enhancement
807 Description: Add /proc entry for import status
808 Details : The mdc, osc, and mgc import directories now have
809 an import directory that contains useful import data for debugging
812 Severity : enhancement
814 Description: Re-disable certain /proc logging
815 Details : Enable and disable client's offset_stats, extents_stats and
816 extents_stats_per_process stats logging on the fly.
819 Frequency : Only on FC kernels 2.6.22+
821 Description: oops in statahead
822 Details : Do not drop reference count for the dentry from VFS when lookup,
823 VFS will do that by itself.
825 Severity : enhancement
827 Description: Generic /proc file permissions
828 Details : Set /Proc file permissions in a more generic way to enable non-
829 root users operate on some /proc files.
833 Description: Hitting mdc_commit_close() ASSERTION
834 Details : Properly handle request reference release in
835 ll_release_openhandle().
839 Description: quota recovery deadlock during mds failover
840 Details : This patch includes att18982, att18236, att18237 in bz14840.
842 1. fix osts hang when mds does failover with quotaon
843 2. prevent watchdog storm when osts threads wait for the
848 Frequency : only patchless client
849 Description: add workaround for race between add/remove dentry from hash
851 Severity : enhancement
853 Description: Allow OST glimpses to return PW locks
857 Description: LBUG when llog conf file is full
858 Details : When llog bitmap is full, ENOSPC should be returned for plain log.
862 Description: Prevent import from entering FULL state when server in recovery
866 Description: service mount cannot take device name with ":"
867 Details : Only when device name contains ":/" will mount treat it as
873 Description: replace ptlrpcd with the statahead thread to interpret the async
874 statahead RPC callback
878 Frequency : on recovery
879 Description: I/O failures after umount during fail back
880 Details : if client reconnected to restarted server we need join to recovery
881 instead of find server handler is changed and process self
882 eviction with cancel all locks.
884 Severity : enhancement
886 Description: Update to RHEL5 kernel-2.6.18-92.1.10.el5.
888 Severity : enhancement
890 Description: Update to SLES10 SP2 kernel-2.6.16.60-0.27.
892 Severity : enhancement
894 Description: Upcall on Lustre log has been dumped
895 Details : Allow for a user mode script to be called once a Lustre log has
896 been dumped. It passes the filename of the dumped log to the
897 script, the location of the script can be specified via
898 /proc/sys/lnet/debug_log_upcall.
903 Description: avoid idr_remove called for id which is not allocated.
904 Details : Move assigment s_dev for clustered nfs to end of initialization,
905 to avoid problem with error handling.
910 Description: avoid Already found the key in hash [CONN_UNUSED_HASH] messages
911 Details : When connection is reused this not moved from CONN_UNUSED_HASH
912 into CONN_USED_HASH and this prodice warning when put connection
913 again in unused hash.
916 Severity : enhancement
918 Description: File striping can now be set to use an arbitrary pool of OSTs.
920 Severity : enhancement
922 Description: Export bytes_read/bytes_write count on OSC/OST.
926 Description: Early reply size mismatch, MGC loses connection
927 Details : Apply the MGS_CONNECT_SUPPORTED mask at reconnect time so
928 the connect flags are properly negotiated.
933 Description: quotas are not honored with O_DIRECT
934 Details : all writes with the flag O_DIRECT will use grants which leads to
935 this problem. Now using OBD_BRW_SYNC to guard this.
939 Description: add quota statistics
940 Details : 1. sort out quota proc entries and proc code.
941 2. add quota statistics
943 Severity : enhancement
945 Description: enable quota support for HEAD.
949 Description: Properly propagate oinfo flags from lov to osc for statfs
950 Details : restore missing copy oi_flags to lov requests.
952 Severity : enhancement
954 Description: Add man pages for llobdstat(8), llstat(8), plot-llstat(8),
955 : l_getgroups(8), lst(8), routerstat(8)
956 Details : included man pages for llobdstat(8), llstat(8),
957 : plot-llstat(8), l_getgroups(8), lst(8), routerstat(8)
959 Severity : enhancement
961 Description: configure's --enable-quota should check the
962 : kernel .config for CONFIG_QUOTA
963 Details : configure is terminated if --enable-quota is passed but
964 : no quota support is in kernel
968 Description: Remove portals compatibility
969 Details : Remove portals compatibility, not interoperable with releases
974 Description: Resolve device initialization race
975 Details : Prevent proc handler from accessing devices added to the
976 obd_devs array but yet be intialized.
978 Severity : enhancement
980 Description: Update to SLES10 SP2 kernel-2.6.16.60-0.23.
982 Severity : enhancement
984 Description: Update to RHEL5 kernel-2.6.18-92.1.6.el5.
989 Description: Using wrong pointer in osc_brw_prep_request
990 Details : Access to array[-1] can produce panic if kernel compiled with
991 CONFIG_PAGE_ALLOC enabled
995 Description: Client runs out of low memory
996 Details : Consider only lowmem when counting initial number of llap pages
1000 Description: *optional* service tags registration
1001 Details : if the "service tags" package is installed on a Lustre node
1002 When the filesystem is mounted, a local-node service tag will
1003 be created. See http://inventory.sun.com/ for more information
1004 about the Service Tags asset management system.
1008 Description: Kernel BUG tries to release flock
1009 Details : Lustre does not destroy flock lock before last reference goes
1010 away. So always drop flock locks when client is evicted and
1011 perform unlock regardless of successfulness of speaking to MDS.
1015 Description: add refcount protection for osc callbacks, avoid panic on shutdown
1019 Description: sanity test 65a fails if stripecount of -1 is set
1020 Details : handle -1 striping on filesystem in ll_dirstripe_verify
1025 Description: ASSERTION(CheckWriteback(page,cmd)) failed
1026 Details : badly clear PG_Writeback bit in ll_ap_completion can produce false
1029 Severity : enhancement
1031 Description: Update to RHEL5 kernel-2.6.18-53.1.21.el5.
1035 Description: do not process already freed flock
1036 Details : flock can possibly be freed by another thread before it reaches
1037 to ldlm_flock_completion_ast.
1041 Description: LBUG during stress test
1042 Details : Need properly lock accesses the flock deadlock detection list.
1046 Description: oops in page fault handler
1047 Details : kernel page fault handler can return two special 'pages' in error
1048 case, don't try dereference NOPAGE_SIGBUS and NOPAGE_OMM.
1052 Description: timeout with invalidate import.
1053 Details : ptlrpcd_check call obd_zombie_impexp_cull and wait request which
1054 should be handled by ptlrpcd. This produce long age waiting and
1055 -ETIMEOUT ptlrpc_invalidate_import and as result LASSERT.
1057 Severity : enhancement
1059 Description: Update to RHEL5 kernel-2.6.18-53.1.19.el5.
1063 Description: enable MGS and MDT services start separately
1064 Details : add a 'nomgs' option in mount.lustre to enable start a MDT with
1065 a co-located MGS without starting the MGS, which is a complement
1066 to 'nosvc' mount option.
1070 Frequency : after recovery
1071 Description: precreate to many object's after del orphan.
1072 Details : del orphan st in oscc last_id == next_id and this triger growing
1073 count of precreated objects. Set flag LOW to skip increase count
1074 of precreated objects.
1078 Frequency : rare, on clear nid stats
1079 Description: ASSERTION(client_stat->nid_exp_ref_count == 0)
1080 Details : when clean nid stats sometimes try destroy live entry,
1081 and this produce panic in free.
1085 Description: Stack overflow during MDS log replay
1086 ease stack pressure by using a thread dealing llog_process.
1090 Description: wait until IO finished before start new when do lock cancel.
1091 Details : VM protocol want old IO finished before start new, in this case
1092 need wait until PG_writeback is cleared until check dirty flag and
1093 call writepages in lock cancel callback.
1095 Severity : enhancement
1097 Description: using special macro for print time and cleanup in includes.
1101 Description: mds_mfd_close() ASSERTION(rc == 0)
1102 Details : In mds_mfd_close(), we need protect inode's writecount change
1103 within its orphan write semaphore to prevent possible races.
1107 Description: Obsolete CURRENT_SECONDS and use cfs_time_current_sec() instead.
1111 Frequency : rare, on shutdown ost
1112 Description: don't hit live lock with umount ost.
1113 Details : shrink_dcache_parent can be in long loop with destroy dentries,
1114 use shrink_dcache_sb instead.
1118 Description: don't panic with use echo client
1119 Details : echo client pass NULL as client nid pointer and this produce null
1120 pointer dereference.
1124 Description: fix build on ppc32
1125 Details : compile code with -m64 flag produce wrong object file for ppc32.
1129 Description: add message levels for liblustreapi
1133 Description: fix for occasional failure case of -ENOSPC in recovery-small tests
1134 Details : Move the 'good_osts' check before the 'total_bavail' check. This
1135 will result in an -EAGAIN and in the exit call path we call
1136 alloc_rr() which will with increasing aggressiveness attempt to
1137 aquire precreated objects on the minimum number of required OSCs.
1141 Description: Use old size assignment to avoid deadlock
1142 Details : Reverts the changes in bugs 2369 and bug 14138 that introduced
1143 the scheduling while holding a spinlock. We do not need locking
1144 for size in ll_update_inode() because size is only updated from
1145 the MDS for directories or files without objects, so there is no
1146 other place to do the update, and concurrent access to such inodes
1147 are protected by the inode lock.
1151 Description: resolve "_IOWR redefined" build error on SLES10
1155 Description: dump the memory debugging after all modules are unloaded to
1156 suppress false negative in conf_sanity test 39
1158 Severity : enhancement
1160 Description: build kernel-ib packages for OFED 1.3 in our release cycle
1165 Description: fix SLES kernel versioning
1166 Details : the kernel version for our SLES 10 kernel did not include a "-"
1167 before the "smp" at the end. while this was not a problem in
1168 general, it did mean that software trying to use the kernel
1169 version to try to detect a vendor specific kernel would fail.
1170 this was most evident by the OFED build scripts.
1174 Description: Don't update lov_desc members until making sure they are valid
1175 Details : When updating lov_desc members via proc fs, need fix their
1176 validities before doing the real update.
1180 Description: don't put request into delay list while invalidate in flight.
1181 Details : ptlrpc_delay_request sometimes put in delay list while invalidate
1182 import in flight. this produce timeout for invalidate and sometimes
1183 can cause stale data.
1187 Frequency : on ppc only
1188 Description: not convert ost objects for directory because it's not exist.
1189 Details : ll_dir_getstripe assume dirrectory has ost objects but this wrong.
1193 Description: Add FMODE_EXEC file flag for SLES10 SP1 kernel.
1195 Severity : enhancement
1197 Description: Update to support 2.6.22.14 vanilla kernel.
1201 Frequency : rare, on recovery
1202 Description: read procfs can produce deadlock in some situation
1203 Details : Holding lprocfs lock which send rpc can produce block for destroy
1204 obd objects and this also block reconnect with -EALREADY. This
1205 isn't fix all lprocfs bugs - but make it rare.
1207 Severity : enhancement
1209 Description: Update kernel to RHEL5 2.6.18-53.1.14.el5.
1212 Frequency : frequent on X2 node
1214 Description: mdc_set_open_replay_data LBUG
1215 Details : Set replay data for requests that are eligible for replay.
1219 Description: lustre_mgs: operation 101 on unconnected MGS
1220 Details : When MGC is disconnected from MGS long enough, MGS will evict the
1221 MGC, and late on MGC cannot successfully connect to MGS and a lot
1222 of the error messages complaining that MGS is not connected.
1226 Frequency : on network error
1227 Description: panic with double free request if network error
1228 Details : mdc_finish_enqueue is finish request if any network error ocuring,
1229 but it's true only for synchronus enqueue, for async enqueue
1230 (via ptlrpcd) this incorrect and ptlrpcd want finish request
1233 Severity : enhancement
1235 Description: client-side metadata stat-ahead during readdir(directory readahead)
1236 Details : perform client-side metadata stat-ahead when the client detects
1237 readdir and sequential stat of dir entries therein
1240 Frequency : on start mds
1242 Description: Implement get_info(last_id) in obdfilter.
1245 Frequency : occasional
1247 Description: Correctly check stale fid, not start epoch if ost not support SOM
1248 Details : open with flag O_CREATE need set old fid in op_fid3 because
1249 op_fid2 was overwritten with new generated fid, but mds can answer
1250 with one of these two fids and both is not stale. Setattr
1251 incorrectly started an epoch and assume will be called
1252 done_writing, but without SOM done_writing ever being called.
1255 Frequency : rare, depends on device drivers and load
1257 Description: MDS or OSS nodes crash due to stack overflow
1258 Details : Code changes in 1.8.0 increased the stack usage of some functions.
1259 In some cases, in conjunction with device drivers that use a lot
1260 of stack the MDS (or possibly OSS) service threads could overflow
1261 the stack. One change which was identified to consume additional
1262 stack has been reworked to avoid the extra stack usage.
1265 Frequency : occasional
1267 Description: Do not fail import if osc_interpret_create gets -EAGAIN
1268 Details : If osc_interpret_create got -EAGAIN it immediately exits and
1269 wakeup oscc_waitq. After wakeup oscc_wait_for_objects call
1270 oscc_has_objects and see OSC has no objests and call
1271 oscc_internal_create to resend create request.
1273 Severity : enhancement
1275 Description: Update to SLES10 SP1 latest kernel-2.6.16.54-0.2.5.
1277 Severity : enhancement
1279 Description: Update to RHEL5 latest kernel-2.6.18-53.1.13.el5.
1282 Frequency : very rare
1284 Description: Fix replay if there is an un-replied request and open
1285 Details : In some cases, older replay request will revert the
1286 mcd->mcd_last_xid on MDS which is used to record the client's
1287 latest sent request.
1289 Severity : enhancement
1291 Description: Update to RHEL5 latest kernel-2.6.18-53.1.6.el5.
1293 Severity : enhancement
1295 Description: Add rhel5 support to HEAD.
1297 Serverity : enhancement
1299 Description: Update RHEL4 kernel to 2.6.9-67.0.4.
1304 Description: Don't allow skipping OSTs if index has been specified.
1305 Details : Don't allow skipping OSTs if index has been specified, make
1306 locking in internal create lots better.
1310 Description: LBUG in ptlrpc_check_set() bad phase ebc0de00
1311 Details : access to bitfield in structure is always rounded to long
1312 and this produce problem with not atomic change any bit.
1316 Description: Lustre make rpms failed.
1317 Details : Remove ldiskfs spec file to avoids rpmbuild be confused when
1318 builds Lustre rpms from tarball.
1321 Frequency : rare on shutdown ost
1323 Description: If llog cancel was not send before clean_exports phase, this can
1324 produce deadlock in llog code.
1325 Details : If llog thread has last reference to obd and call class_import_put
1326 this produce deadlock because llog_cleanup_commit_master wait when
1327 last llog_commit_thread exited, but this never success because was
1328 called from llog_commit_thread.
1332 Description: allow userland application know is lost one of stripes.
1333 Details : fill lvb_blocks with error code on ost and return it to
1334 application if error flag found.
1338 Description: NULL lov_tgts causing MDS oops
1339 Details : more safe checks for NULL lov_tgts for avoid oops.
1341 Severity : enhancement
1343 Description: Update to RHEL4 latest kernel-2.6.9-67.0.1.EL.
1347 Descriptoin: make lov_create() will not stuck in obd_statfs_rqset()
1348 Details : If an OST is down the MDS will hang indefinitely in
1349 obd_statfs_rqset() waiting for the statfs data. While for
1350 MDS QOS usage of statfs, it should not stuck in waiting.
1352 Severity : enhancement
1354 Description: remote_acl support
1355 Details : Support ACL-based permission check for remote user.
1356 Support setfacl/getfacl for remote user with the utils
1357 "lfs {l,r}{s,g}etfacl" which follow the same parameter format as
1358 the system "{s,g}etfacl" utils.
1360 Severity : enhancement
1362 Description: Update to RHEL4 U6 kernel-2.6.9-67.EL.
1364 Severity : enhancement
1366 Description: Update to RHEL5 latest kernel-2.6.18-53.1.4.el5.
1370 Description: make mgs_setparam() handle fsname containing dash
1371 Details : fsname containing a dash does not work with lctl conf_param
1373 Severity : enhancement
1375 Description: Update to SLES10 SP1 latest kernel-2.6.16.54-0.2.3.
1377 Severity : enhancement
1379 Description: Update to RHEL5 Update-1 kernel 2.6.18-53.el5.
1383 Frequency : rare, at shutdown
1384 Description: access already free / zero obd_namespace.
1385 Details : if client_disconnect_export was called without force flag set,
1386 and exist connect request in flight, this can produce access to
1387 NULL pointer (or already free pointer) when connect_interpret
1388 store ocd flags in obd_namespace.
1392 Frequency : only at startup
1393 Description: not alloc memory with spinlock held.
1394 Details : allocation memory with GFP_KERNEL can produce sleep deadlock,
1395 if any spinlock held.
1397 Severity : enhancement
1399 Description: make lustre randomly fail allocating memory
1400 Details : Make lustre randomly failed allocating memory for testing purpose.
1402 Severity : enhancement
1404 Description: lost problems with lov objid file
1405 Details : Fixes some scability and access to not inited memory problems
1406 in work with lov objdid file.
1411 Description: lfs find does not continue on file error
1412 Details : Continue other files processing when a file/dir is absent.
1416 Description: Inconsistent usage of lustre_pack_reply()
1417 Details : Standardize the usage of lustre_pack_reply() such that it
1418 always generate a CERROR on failure.
1421 Frequency : occasional
1423 Description: MDS hang or stay in waiting lock
1424 Details : If client receive lock with CBPENDING flag ldlm need send lock
1425 cancel as separate rpc, to avoid situation when cancel request
1426 can't processed due all i/o threads stay in wait lock.
1430 Description: Update to RHEL5 kernel 2.6.18-8.1.15.el5.
1434 Description: Update to SLES10 SP1 kernel 2.6.16.53-0.16
1438 Description: Update to SLES9 kernel-2.6.5-7.287.3.
1442 Description: Update to RHEL4 latest kernel.
1444 Severity : enhancement
1446 Description: Build SLES10 patchless client fails
1447 Details : The configure was broken by run ./configure with
1448 --with-linux-obj=.... argument for patchless client. When the
1449 configure use --with-linux-obj, the LINUXINCLUDE= -Iinclude
1450 can't search header adequately. Use absolute path such as
1451 -I($LINUX)/include instead.
1455 Description: interrupt oig_wait produce painc on resend.
1456 Details : brw_redo_request can be used for resend requests from ptlrpcd and
1457 private set, and this produce situation when rq_ptlrpcd_data not
1458 copyed to new allocated request and triggered LBUG on assert
1459 req->rq_ptlrpcd_data != NULL. But this member used only for wakeup
1460 ptlrpcd set if request is changed and can be safety changed to use
1465 Description: LASSERT_{REQ,REP}SWAB macros are buggy
1466 Details : If SWAB_PARANOIA is disabled, the LASSERT_REQSWAB and
1467 LASSERT_REPSWAB macros become no-ops, which is incorrect. Drop
1468 these macros and replace them with their difinitions instead.
1472 Description: Update kernel patches for SLES10 2.6.16.53-0.8.
1473 Details : Update which_patch & target file for SLES10 latest kernel.
1476 Description: Remove client patches from SLES 10 kernel.
1477 Details : This causes SLES 10 clients to behave as patchless clients
1478 even on a Lustre-patched (server) kernel.
1480 Severity : enhancement
1482 Description: self-adjustable client's lru lists
1483 Details : use adaptive algorithm for managing client cached locks lru
1484 lists according to current server load, other client's work
1485 pattern, memory activities, etc. Both, server and client
1486 side namespaces provide number of proc tunables for controlling
1489 Severity : enhancement
1491 Description: light-weight GSS support
1492 Details : Support krb5n and krb5a mode, which keep Kerberos 5 authentication
1493 and reduce performance overhead.
1495 Severity : enhancement
1497 Description: Linux keyring support
1498 Details : Support using service of Linux keyring for Lustre GSS internal
1499 context refresh/cache mechanism.
1503 Description: Fix errors in lfs documentation
1504 Details : Fixes man pages
1508 Description: don't use GFP_* in generic Lustre code.
1509 Details : Use cfs_alloc_* functions and CFS_* flags for code portability.
1513 Description: obdclass is limited by single OBD_ALLOC(idarray)
1514 Details : replace OBD_ALLOC/OBD_FREE with OBD_VMALLOC/OBD_VFREE
1518 Description: warnings with build patchless client with vanila 2.6.19 and up
1519 Details : change old ctl_table style and replace ctl_table/ctl_table_header
1520 with cfs_sysctl_table_t/cfs_sysctl_table_header_t
1524 Frequency : Only for SLES
1525 Description: sanity_quota fail test_1
1526 Details : There are multiple occurences of $TSTUSR in SLES's /etc/group
1527 file, which makes TSTID[2] inunique.
1531 Frequency : Only for SLES9
1532 Description: Kernel patches for SLES9 2.6.5-7.286 kernel
1533 Details : Update target/ChangeLog/which_patch .
1537 Frequency : Only for test_10 in sanity-quota.sh
1538 Description: a bug in quota test code
1539 Details : checking a test flag in a wrong place
1543 Frequency : Only for test_13 in sanity-quota.sh
1544 Description: a bug in quota test script
1545 Details : shouldn't check overfull allocated quota
1549 Description: jbd statistics
1550 Details : Port older jbd statistics patch for sles10
1552 Severity : enhancement
1554 Description: Add printing inode info into message about error in writepage.
1559 Description: reply_lock_interpret crash due to race with it and lock cancel.
1560 Details : Do not replay locks that are being cancelled. Do not reference
1561 locks by their address during replay, just by their handle.
1565 Frequency : When flocks are used.
1566 Description: assertion failure in ldlm_cli_enquque_fini for non NULL lock.
1567 Details : Flock locks might destroy just granted lock if it could be merged
1568 with another existing flock, this is done in completion handler,
1569 so teach ldlm_cli_enquque_fini that this is a valid case for
1575 Description: Oops in read and write path when failing to allocate lock.
1576 Details : Check if lock allocation failed and return error back.
1580 Description: lstripe command fails for valid OST index
1581 Details : The stripe offset is compared to lov->desc.ld_tgt_count
1582 instead of lov->desc.ld_active_tgt_count.
1586 Description: sanity.sh failed test 103
1587 Details : RHEL mis-interpret setfacl "-X" param, so we won't test setfacl
1592 Description: df doesn't work properly if diskfs blocksize != 4K
1593 Details : Choose biggest blocksize of OST's as the LOV's blocksize.
1597 Description: lfs find on -1 stripe looping in lsm_lmm_verify_common()
1598 Details : Avoid lov_verify_lmm_common() on directory with -1 stripe count.
1600 Severity : enhancement
1602 Description: Adaptive timeouts
1603 Details : RPC timeouts adapt to changing server load and network
1604 conditions to reduce resend attempts and improve recovery time.
1608 Description: llapi_file_create() does not allow some changes
1609 Details : add llapi_file_open() that allows specifying the mode and
1610 open flags, and also returns an open file handle.
1614 Description: merge and cleanup kernel patches.
1615 Details : Remove mnt_lustre_list in vfs_intent-2.6-rhel4.patch.
1619 Description: Add journal checksum support.(Kernel part)
1620 Details : The journal checksum feature adds two new flags i.e
1621 JBD2_FEATURE_INCOMPAT_ASYNC_COMMIT and
1622 JBD2_FEATURE_COMPAT_CHECKSUM. JBD2_FEATURE_CHECKSUM flag
1623 indicates that the commit block contains the checksum for
1624 the blocks described by the descriptor blocks. Now commit
1625 record can be sent to disk without waiting for descriptor
1626 blocks to be written to disk. This behavior is controlled
1627 using JBD2_FEATURE_ASYNC_COMMIT flag.
1631 Description: OSS needs mutliple precreate threads
1632 Details : Add ability to start more than one create thread per OSS.
1636 Description: Sanity.sh test_65k failed: setstripe should have succeeded
1637 Details : execute lfs setstripe on client
1641 Description: mds_obd_create error creating tmp object
1642 Details : When the user sets quota on root, llog will be affected and can't
1643 create files and write files.
1646 Frequency : Always on ia64 patchless client, and possibly others.
1648 Description: Add EXPORT_SYMBOL check for node_to_cpumask symbol.
1649 Details : This allows the patchless client to be loaded on architectures
1650 without this export.
1654 Description: RedHat Update kernel for RHEL5
1655 Details : Add the kernel config file for RHEL5.
1659 Description: RedHat Update kernel for RHEL5
1660 Details : Modify the kernel config file more closer RHEL5.
1664 Description: Build failure against Centos5 (RHEL5)
1665 Details : Define PAGE_SIZE when it isn't present.
1669 Description: test_7 on sanity-quota.sh can't be used on separate machines
1670 Details : add facet to handle it
1674 Description: "ll_intent_file_open()) lock enqueue: err: -13" with nfs
1675 Details : with NFS, the anon dentry's parent was set to itself in
1676 d_alloc_anon(), so in MDS, we use rec->ur_fid1 to find the
1677 corresponding dentry other than use rec->ur_name.
1679 Severity : enhancement
1681 Description: lfs setstripe enhancement
1682 Details : Make lfs setstripe understand 'k', 'm' and 'g' for stripe size.
1686 Description: enable data checksumming by default
1687 Details : enable checksum by default, allow --disable-checksum
1688 configure option and "-o nochecksum" mount option. Checksums
1689 can also be disabled at runtime via $LPROC/osc/*/checksum_pages.
1693 Description: lustre support for RHEL5
1694 Details : Add support for RHEL5.
1698 Description: Client eviction due to failover config
1699 Details : after a connection loss, the lustre client should attempt to
1700 reconnect to the last active server first before trying the
1701 other potential connections.
1705 Description: when mds and osts use different quota unit(32bit and 64bit),
1706 quota will be released repeatly.
1707 Details : void sending multiple quota reqs to mds, which will keep the
1708 status between the reqs.
1712 Description: osts not allocated evenly to files
1713 Details : change the condition to increase offset_idx
1716 Frequency : Always for filesystems larger than 2TB on 32-bit systems.
1718 Description: Data corruption for OSTs that are formatted larger than 2TB
1720 Details : When generating the bio request for lustre file writes the
1721 sector number would overflow a temporary variable before being
1722 used for the IO. The data reads correctly from Lustre (which
1723 will overflow in a similar manner) but other file data or
1724 filesystem metadata may be corrupted in some cases.
1728 Description: Tune the kernel for good SCSI performance.
1729 Details : Set the value of /sys/block/{dev}/queue/max_sectors_kb
1730 to the value of /sys/block/{dev}/queue/max_hw_sectors_kb
1735 Description: rewrite ext2-derived code in obdclass/uuid.c
1736 Details : rewrite inherited code (uuid parsing code from ext2 utils)
1737 from scratch preserving functionality.
1741 Description: "lfs find -obd UUID" prints directories
1742 Details : "lfs find -obd UUID" will return all directory names instead
1743 of just file names. It is incorrect because the directories
1744 do not reside on the OSTs.
1748 Description: use i_size_read and i_size_write in 2.6 port
1749 Details : replace inode->i_size access with i_size_read/write()
1752 Frequency : when removing large files
1754 Description: scheduling issue during removal of large Lustre files
1755 Details : Don't take the BKL in fsfilt_ext3_setattr() for 2.6 kernels.
1756 It causes scheduling issues when removing large files (17TB in the
1760 Frequency : only with liblustre clients on XT3
1762 Description: evictions taking too long
1763 Details : allow llrd to evict clients directly on OSTs
1766 Frequency : only on ppc
1768 Description: /proc/fs/lustre/devices broken on ppc
1769 Details : The patch as applied to 1.6.2 doesn't look correct for all arches.
1770 We should make sure the type of 'index' is loff_t and then cast
1771 explicitly as needed below. Do not assign an explicitly cast
1775 Frequency : only for rhel5
1777 Description: Kernel patches update for RHEL5 2.6.18-8.1.10.el5.
1778 Details : Modify the target file & which_kernel.
1780 Severity : enhancement
1782 Description: omit set fsid for export NFS
1783 Details : fix set/restore device id for avoid EMFILE error and mark lustre
1784 fs as FS_REQUIRES_DEV for avoid problems with generate fsid.
1788 Frequency : Always, for kernels after 2.6.16
1789 Description: Fix warning idr_remove called for id=.. which is not allocated.
1790 Details : Last kernels save old s_dev before kill super and not allow
1791 to restore from callback - restore it before call kill_anon_super.
1795 Description: buffer overruns could theoretically occur
1796 Details : llapi_semantic_traverse() modifies the "path" argument by
1797 appending values to the end of the origin string, and a
1798 overrun may occur. Adding buffer overrun check in liblustreapi.
1802 Description: Fix error on 'ls .' at the top of the Lustre mount.
1803 Details : Don't revalidate dentry if it is a root dentry.
1807 Description: Kernel patches update for RHEL4 2.6.9-55.0.6.
1808 Details : Modify vm-tunables-rhel4.patch.
1812 Description: Kernel config for 2.6.18-vanilla.
1813 Details : Modify targets/2.6-vanilla.target.in.
1814 Add config file kernel-2.6.18-2.6-vanilla-i686.config.
1815 Add config file kernel-2.6.18-2.6-vanilla-i686-smp.config.
1816 Add config file kernel-2.6.18-2.6-vanilla-x86_64.config.
1817 Add config file kernel-2.6.18-2.6-vanilla-x86_64-smp.config.
1821 Description: improve handling recoverable errors
1822 Details : if request processig with error which can be recoverable on server
1823 request should be resend, otherwise page released from cache and
1828 Description: Kernel patches update for RHEL5 2.6.18-8.1.14.el5.
1829 Details : Modify target file & which_patch.
1830 A flaw was found in the IA32 system call emulation provided
1831 on AMD64 and Intel 64 platforms. An improperly validated 64-bit
1832 value could be stored in the %RAX register, which could trigger an
1833 out-of-bounds system call table access. An untrusted local user
1834 could exploit this flaw to run code in the kernel
1835 (ie a root privilege escalation). (CVE-2007-4573).
1839 Description: O_DIRECT bypasses client statistics.
1840 Details : When running with O_DIRECT I/O, neither the client rpc_stats nor
1841 read_ahead_stats were updated. copied the stats section from
1842 osc_send_oap_rpc() into async_internal().
1846 Description: Add jbd statistics patch for RHEL5 and 2.6.18-vanilla
1850 Description: change order of libsysio includes
1851 Details : '#include sysio.h' should always come before '#include xtio.h'
1855 Description: handle "serious error: objid * already exists" more gracefully
1856 Details : If LAST_ID value on disk is smaller than the objects existing in
1857 the O/0/d* directories, it indicates disk corruption and causes an
1858 LBUG(). If the object is 0-length, then we should use the existing
1859 object. This will help to avoid a full fsck in most cases.
1861 Severity : enhancement
1863 Description: adapt the lustre_config script to support the upgrade case
1864 Details : Add "-u" option for lustre_config script to support upgrading 1.4
1865 server targets to 1.6 in parallel.
1869 Description: To avoid grant space > avaible space when the disk is almost
1870 full. Without this patch you might see the error "grant XXXX >
1871 available" or some LBUG about grant, when the disk is almost
1873 Details : In filter_check_grant, for non_grant cache write, we should
1874 check the left space by if (*left > ungranted + bytes), instead
1875 of (*left > ungranted), because only we are sure the left space
1876 is enough for another "bytes", then the ungrant space should be
1877 increase. In client, we should update cl_avail_grant only there
1878 is OBD_MD_FLGRANT in the reply.
1882 Description: Update RHEL 4 kernel to fix local root privilege escalation.
1883 Details : Update to the latest RHEL 4 kernel to fix the vulnerability
1884 described in CVE-2007-4573. This problem could allow untrusted
1885 local users to gain root access.
1888 Frequency : when using O_DIRECT and quotas
1890 Description: Incorrect file ownership on O_DIRECT output files
1891 Details : block usage reported by 'lfs quota' does not take into account
1892 files that have been written with O_DIRECT.
1897 Description: touch file failed when fs is not full
1898 Details : OST in recovery should not be discarded by MDS in alloc_qos(),
1899 otherwise we can get ENOSP while fs is not full.
1903 Description: parallel lock callbacks
1904 Details : Instead of sending blocking and completion callbacks as separated
1905 requests, adding them to a set and sending in parallel.
1908 Frequency : only for Cray XT3
1909 Bugzilla : 12829/13455
1910 Description: Changing primary group doesn't change the group lustre assigns to
1912 Details : When CRAY_XT3 is defined, the fsgid supplied by the client is
1913 overridden with the primary group provided by the group upcall,
1914 whereas the supplied fsgid can be trusted if it is in the list of
1915 supplementary groups returned by the group upcall.
1917 Severity : enhancement
1919 Description: Allow masking D_WARNING, D_ERROR messages from console
1920 Details : Console messages can now be disabled via lnet.printk.
1924 Description: User code with malformed file open parameter crashes client node
1925 Details : Before packing join_file req, all the related reference should be
1926 checked carefully in case some malformed flags cause fake
1927 join_file req on client.
1931 Description: LDLM_ENQUEUE races with LDLM_CP_CALLBACK
1932 Details : ldlm_completion_ast() assumes that a lock is granted when the req
1933 mode is equal to the granted mode. However, it should also check
1934 that LDLM_FL_CP_REQD is not set.
1938 Description: Heavy nfs access might result in deadlocks
1939 Details : After ELC code landed, it is now improper to enqueue any mds
1940 locks under och_sem, because enqueue might want to decide to
1941 cancel open locks for same inode we are holding och_sem for.
1945 Description: Client eviction while running blogbench
1946 Details : A lot of unlink operations with concurrent I/O can lead to a
1947 deadlock causing evictions. To address the problem, the number of
1948 oustanding OST_DESTROY requests is now throttled to
1949 max_rpcs_in_flight per OSC and LDLM_FL_DISCARD_DATA blocking
1950 callbacks are processed in priority.
1954 Description: enable ACLs on MDS by default
1955 Details : ACLs must be enabled on MDS by default.
1958 Frequency : PPC/PPC64 only
1960 Description: conflicts between asm-ppc64/types.h and lustre_types.h
1961 Details : fix duplicated definitions between asm-ppc64/types.h and
1962 lustre_types.h on PPC.
1965 Frequency : PPC/PPC64 only
1967 Description: asm-ppc/segment.h does not exist
1968 Details : fix compile issue on PPC.
1972 Description: better handle error messages in extents code
1975 Frequency : RHEL4 only
1977 Description: mkfs is very slow on IA64/RHEL4
1978 Details : A performance regression has been discovered in the MPT Fusion
1979 driver between versions 3.02.73rh and 3.02.99.00rh. As a
1980 consequence, we have downgraded the MPT Fusion driver in the RHEL4
1981 kernel from 3.02.99.00 to 3.02.73 until this problem is fixed.
1983 Severity : enhancement
1985 Description: SNMP support enhancement
1986 Details : Adding total number of sampled request for an MDS node in snmp
1989 Severity : enhancement
1991 Description: Optimize ldlm waiting list processing for PR extent locks
1992 Details : When processing waiting list for read extent lock and meeting read
1993 lock that is same or wider to it that is not contended, skip
1994 processing rest of the list and immediatelly return current
1995 status of conflictness, since we are guaranteed there are no
1996 conflicting locks in the rest of the list.
2000 Description: Time out and refuse to reconnect
2001 Details : When the failover node is the primary node, it is possible
2002 to have two identical connections in imp_conn_list. We must
2003 compare not conn's pointers but NIDs, otherwise we can defeat
2004 connection throttling.
2008 Description: port llog fixes from b1_6 into HEAD
2009 Details : Port llog reference couting and some llog cleanups from b1_6
2010 (bug 10800) into HEAD, for protect from panic and access to already
2011 free llog structures.
2015 Description: Detect stride IO mode in read-ahead
2016 Details : When a client does stride read, read-ahead should detect that and
2017 read-ahead pages according to the detected stride pattern.
2021 Description: data checksumming impacts single node performance
2022 Details : add support for several checksum algorithm. Currently, only CRC32
2023 and Adler-32 are supported. The checksum type can be changed on
2024 the fly via /proc/fs/lustre/osc/*/checksum_type.
2028 Description: use adler32 for page checksums
2029 Details : when available, use the Adler-32 algorithm instead of CRC32 for
2034 Description: build for x2 fails
2035 Details : fix compile issue on Cray systems.
2039 Description: Properly match for duplicate locks
2040 Details : Due to different lock order from skiplists code, we need to
2041 traverse entire list for now
2044 Frequency : only on PPC/SLES10
2046 Description: "BITS_PER_LONG is not 32 or 64" in linux/idr.h
2047 Details : On SLES10/PPC, fs.h includes idr.h which requires BITS_PER_LONG to
2048 be defined. Add a hack in mkfs_lustre.c to work around this compile
2053 Description: LASSERT on MDS when client holding flock lock dies
2054 Details : ldlm pool logic depends on number of granted locks equal to
2055 number of released locks which is not true for flock locks, so
2056 just exclude such locks from consideration.
2060 Description: MDS deadlock with many ll_sync_lov threads and I/O stalled
2061 Details : Use fsfilt_sync() for both the whole filesystem sync and
2062 individual file sync to eliminate dangerous inode locking
2063 with I_LOCK that can lead to a deadlock.
2067 Description: performance in 1.6.3
2068 Details : Force q->max_phys_segments to MAX_PHYS_SEGMENTS on SLES10 to be
2069 sure that 1MB requests are not fragmented by the block layer.
2071 Severity : enhancement
2073 Description: organize the server-side client stats on per-nid basis
2074 Details : Change the structure of stats under obdfilter and mds to
2082 The "uuid"s file would list the uuids of _active_ exports.
2083 And the clear entry is to clear all stats and stale nids.
2085 Severity : enhancement
2087 Description: eliminate client locks in face of contention
2088 Details : file contention detection and lockless i/o implementation
2089 for contended files.
2093 Description: Reinitialize optind to 0 so that interactive lfs works in all cases
2096 Frequency : very rare, if additional xattrs are used on kernels >= 2.6.12
2098 Description: MDS may lose file striping (and hence file data) in some cases
2099 Details : If there are additional extended attributes stored on the MDS,
2100 in particular ACLs, SELinux, or user attributes (if user_xattr
2101 is specified for the client mount options) then there is a risk
2102 of attribute loss. Additionally, the Lustre file striping
2103 needs to be larger than default (e.g. striped over all OSTs),
2104 and an additional attribute must be stored initially in the
2105 inode and then increase in size enough to be moved to the
2106 external attribute block (e.g. ACL growing in size) for file
2111 Description: skiplist implementation simplification
2112 Details : skiplists are used to group compatible locks on granted list
2113 that was implemented as tracking first and last lock of each
2114 lock group the patch changes that to using doubly linked lists
2118 Description: MDS LBUG: ASSERTION(!IS_ERR(dchild))
2119 Details : Change LASSERTs to client eviction (i.e. abort client's recovery)
2120 because LASSERT on both the data supplied by a client, and the
2121 data on disk is dangerous and incorrect.
2123 Severity : enhancement
2125 Description: Slow truncate/writes to huge files at high offsets.
2126 Details : Directly associate cached pages to lock that protect those pages,
2127 this allows us to quickly find what pages to write and remove
2128 once lock callback is received.
2132 Description: more ldlm soft lockups
2133 Details : In ldlm_resource_add_lock(), call to ldlm_resource_dump()
2134 starve other threads from the resource lock for a long time in
2135 case of long waiting queue, so change the debug level from
2136 D_OTHER to the less frequently used D_INFO.
2138 Severity : enhancement
2140 Description: add -gid, -group, -uid, -user options to lfs find
2144 Description: Hung threads in invalidate_inode_pages2_range
2145 Details : The direct IO path doesn't call check_rpcs to submit a new RPC
2146 once one is completed. As a result, some RPCs are stuck in the
2147 queue and are never sent.
2151 Description: filter threads hungs on waiting journal commit
2152 Details : Cleanup filter group llog code, then only filter group llog will
2153 be only created in the MDS/OST syncing process.
2157 Description: Procfs and llog threads access destoryed import sometimes.
2158 Details : Sync the import destoryed process with procfs and llog threads by
2159 the import refcount and semaphore.
2161 Severity : enhancement
2163 Description: openlock cache of b1_6 port to HEAD
2168 Description: kernel BUG at ldiskfs2_ext_new_extent_cb
2169 Details : If insertion of an extent fails, then discard the inode
2170 preallocation and free data blocks else it can lead to duplicate
2175 Description: don't always update ctime in ext3_xattr_set_handle()
2176 Details : Current xattr code updates inode ctime in ext3_xattr_set_handle.
2177 In some cases the ctime should not be updated, for example for
2178 2.0->1.8 compatibility it is necessary to delete an xattr and it
2179 should not update the ctime.
2183 Bugzilla : 15713/16362
2184 Description: Assertion in iopen_connect_dentry in 1.6.3
2185 Details : looking up an inode via iopen with the wrong generation number can
2186 populate the dcache with a disconneced dentry while the inode
2187 number is in the process of being reallocated. This causes an
2188 assertion failure in iopen since the inode's dentry list contains
2189 both a connected and disconnected dentry.
2193 Description: assertion failure in ldlm_handle2lock()
2194 Details : fix a race between class_handle_unhash() and class_handle2object()
2195 introduced in lustre 1.6.5 by bug 13622.
2200 Description: Kernel BUG: sd_iostats_bump: unexpected disk index
2201 Details : remove the limit of 256 scsi disks in the sd_iostat patch
2206 Description: oops in sd_iostats_seq_show()
2207 Details : unloading/reloading the scsi low level driver triggers a kernel
2208 bug when trying to access the sd iostat file.
2213 Description: Kernel panics during QLogic driver reload
2214 Details : REQ_BLOCK_PC requests are not handled properly in the sd iostat
2215 patch, causing memory corruption.
2220 Description: journal_dev option does not work in b1_6
2221 Details : pass mount option during pre-mount.
2223 Severity : enhancement
2225 Description: Add a FIEMAP(FIle Extent MAP) ioctl
2226 Details : FIEMAP ioctl will allow an application to efficiently fetch the
2227 extent information of a file. It can be used to map logical blocks
2228 in a file to physical blocks in the block device.
2232 Description: LDLM soft lockups - improvement
2233 Details : It is be possible to send the lock handle along with each read
2234 or write request because the client is already doing a lock match
2235 itself so there isn't any reason the OST should have to re-do that
2239 Frequency : only on Cray X2
2241 Description: X2 build failures
2242 Details : fix build failures on Cray X2.
2246 Description: xid & resent requests
2247 Details : Initialize RPC XID from clock at startup (randomly if clock is
2250 Severity : enhancement
2252 Description: Add lustre_start utility to start or stop multiple Lustre servers
2257 Description: Lustre GPF in {:ptlrpc:ptlrpc_server_free_request+373}
2258 Details : In case of memory pressure, list_del() can be called twice on
2259 req->rq_history_list, causing a kernel oops.
2263 Description: kptllnd_peer_check_sends()) ASSERTION(!in_interrupt()) failed
2264 Details : fix stack overflow in the distributed lock manager by defering
2265 export eviction after a failed AST to the elt thread instead of
2266 handling it in the dlm interpret routine.
2270 Description: Convert some comments to new format.
2271 Details : Update documenting comments to match doxygen conventions.
2275 Description: Grammar fixes.
2276 Details : A couple of trivial spelling fixes.
2280 Description: OSD_COUNTERS-mandatory
2281 Details : Make previously optional ->oti_{w,r}_locks sanity checks mandatory
2282 to simplify the code.
2286 Description: simplify cmm_device freeing logic.
2287 Details : Call cmm_device_free() in the failure path of cmm_device_alloc().
2291 Description: Add lockdep support to dt_object_operations locking interface.
2292 Details : Augment ->do_{read,write}_lock() prototypes with a `role'
2293 parameter indicating lock ordering. Update mdd code to use new
2298 Description: Introduce failloc constants for lockless IO tests.
2299 Details : Add two new failloc constants to test lockless IO. Only one of
2300 them in implemented---another is checked in yet to be landed
2305 Description: Add lockdep support for inode mutex.
2306 Details : Introduce and use new LOCK_INODE_MUTEX_PARENT() macro to be used
2307 in the situations where Lustre has to lock more than one inode
2312 Description: Add optional invariants checking support.
2313 Details : Add new LINVRNT() macro, optional on new --enable-invariants
2314 configure switch. This macro is to be used for consistency and
2315 sanity checks that are too expensive to be left in `production'
2320 Description: Zap lock->l_granted_mode with explicit LCK_MINMODE.
2321 Details : Use LCK_MINMODE rather than 0 to reset lock->l_granted_mode to
2326 Description: Add lockdep support for ldlm_lock and ldlm_resource.
2327 Details : Use spin_lock_nested() in (the only) situation where more than
2328 one ldlm_lock is locked simultaneously. Also, fix possible
2329 dead-lock in ldlm_lock_change_resource() by enforcing particular
2334 Description: Use struct ldlm_callback_suite in ldlm_lock_create().
2335 Details : Instead of specifying each ldlm_lock call-back through separate
2336 parameter, wrap them into struct ldlm_callback_suite.
2340 Description: Kill join_lru obd method and its callers.
2341 Details : CLIO uses lock weighting policy to keep locks over mmapped regions
2342 in memory---a requirement implemented through ->o_join_lru() obd
2343 method in HEAD. Remove this method and its users.
2347 Description: Add asynchronous ldlm ENQUEUE completion handler.
2348 Details : CLIO posts ENQUEUE requests asynchronously through ptlrpcd---a
2349 case that stock ldlm_completion_ast() cannot handle as it waits
2350 until lock is granted. Introduce new ldlm_completion_ast_async()
2351 for this. Also comment ldlm_completion_ast().
2355 Description: ldlm_error <-> errno conversion.
2356 Details : Add functions to map (rather arbitrary) between LDLM error codes
2357 and standard errno values. CLIO needs this to prevent LDLM specific
2358 constants from escaping ldlm and osc.
2362 Description: Kill unused ldlm_handle2lock_ns() function.
2363 Details : Kill unused ldlm_handle2lock_ns() function.
2367 Description: Add lu_ref support to ldlm_lock
2368 Details : lu_ref support for ldlm_lock and ldlm_resource. See lu_ref patch.
2369 lu_ref fields ->l_reference and ->lr_reference are added to ldlm_lock
2370 and ldlm_resource. LDLM interface has to be changed, because code that
2371 releases a reference on a lock, has to "know" what reference this is.
2372 In the most frequent case
2374 lock = ldlm_handle2lock(handle);
2376 LDLM_LOCK_PUT(lock);
2378 no changes are required. When any other reference (received _not_ from
2379 ldlm_handle2lock()) is released, LDLM_LOCK_RELEASE() has to be called
2380 instead of LDLM_LOCK_PUT().
2382 Arguably, changes are pervasive, and interface requires some discipline
2383 for proper use. On the other hand, it was very instrumental in finding
2384 a few leaked lock references.
2388 Description: Add ldlm_lock_addref_try().
2389 Details : Introduce ldlm_lock_addref_try() function (used by CLIO) that
2390 attempts to addref a lock that might be being canceled
2395 Description: Add ldlm_weigh_callback().
2396 Details : Add new ->l_weigh_ast() call-back to ldlm_lock. It is called
2397 by ldlm_cancel_shrink_policy() to estimate lock "value", instead of
2398 hard-coded `number of pages' logic.
2402 Description: Add lockdep annotations to llog code.
2403 Details : Use appropriately tagged _nested() locking calls in the places
2404 where llog takes more than one ->lgh_lock lock.
2408 Description: Add loi_kms_set().
2409 Details : Wrap kms updates into a helper function.
2413 Description: Constify instances of struct lsm_operations.
2414 Details : Constify instances of struct lsm_operations.
2418 Description: lu_conf support.
2419 Details : On a server, a file system object is uniquely identified
2420 by a fid, which is sufficient to locate and load all object
2421 state (inode). On a client, on the other hand, more data are
2422 necessary instantiate an object. Change lu_object_find() and
2423 friends to take additional `lu_conf' argument describing object.
2424 Typically this includes layout information.
2428 Description: lu_context fixes.
2429 Details : Introduce new lu_context functions that are needed on the client
2430 side, where some system threads (ptlrpcd) are shared by multiple
2431 modules, and so cannot be stopped during module shutdown.
2435 Description: Add start and stop methods to lu_device_type_operations.
2436 Details : Introduce two new methods in lu_device_type_operations, that are
2437 invoked when first instance of a given type is created and last one
2438 is destroyed respectively. This is need by CLIO.
2442 Description: Add lu_ref support to struct lu_device.
2443 Details : Add lu_ref support to lu_object and lu_device. lu_ref is used to
2444 track leaked references.
2448 Description: Introduce lu_kmem_descr.
2449 Details : lu_kmem_descr and its companion interface allow to create
2450 and destroy a number of kmem caches at once.
2454 Description: Fix lu_object finalization race.
2455 Details : Fix a race between lu_object_find() finding an object and its
2456 concurrent finalization. This race is (most likely) not possible
2457 on the server, but might happen on the client.
2461 Description: Introduce lu_ref interface.
2462 Details : lu_ref is a debugging module allowing to track references to
2463 a given object. It is quite cpu expensive, and has to be
2464 explicitly enabled with --enable-lu_ref. See usage description
2469 Description: Factor lu_site procfs stats into a separate function.
2470 Details : Separate lu_site stats printing code into a separate function
2471 that can be reused on a client.
2475 Description: Constify instances of struct {lu,dt,md}_device_operations.
2476 Details : Constify instances of struct {lu,dt,md}_device_operations.
2480 Description: Introduce struct md_site and move meta-data specific parts of
2481 struct lu_site here.
2482 Details : Move md-specific fields out of struct lu_site into special struct
2483 md_site, so that lu_site can be used on a client.
2487 Description: Kill mdd_lov_destroy().
2488 Details : Remove unused mdd code.
2492 Description: Add st_block checking to multistat.c.
2493 Details : Add st_block checking to multistat.c.
2497 Description: Add lu_ref support to struct obd_device.
2498 Details : Add lu_ref tracking to obd_device.
2502 Description: Kill obd_set_fail_loc().
2503 Details : Remove unused code.
2507 Description: Add special type for ptlrpc_request interpret functions.
2508 Details : Add lu_env parameter to ->rq_interpreter call-back. NULL is passed
2509 there. Actual usage will be in CLIO.
2513 Description: Replace RW_LOCK_UNLOCKED() macro with rwlock_init().
2514 Details : Replace RW_LOCK_UNLOCKED() with rwlock_init() as the former
2515 doesn't work with lockdep.
2519 Description: Add rwv.c test program.
2520 Details : New testing program exercising readv(2) and writev(2) (Qian).
2524 Description: Add sendfile.c test program.
2525 Details : New testing program exercising sendfile(2) (Jay).
2529 Description: Ratelimit a message that can be very frequent.
2530 Details : Ratelimit a memory allocation failure message that can
2535 Description: Use cdebug_show() in CDEBUG-style macros defined outside of libcfs.
2536 Details : Use cdebug_show() in CDEBUG-style macros defined outside of libcfs.
2540 Description: Liblustre build fixes.
2541 Details : Liblustre build fixes.
2545 Description: libcfs: add cfs_{need,cond}_resched() interface.
2546 Details : libcfs: add cfs_{need,cond}_resched() definition and
2547 implementations for Linux, NT, and liblustre.
2549 Severity : enhancement
2551 Description: More exported tunables for mballoc
2552 Details : Add support for tunable preallocation window and new tunables for
2553 large/small requests
2557 Description: Detect corruption of block bitmap and checking for preallocations
2558 Details : Checks validity of on-disk block bitmap. Also it does better
2559 checking of number of applied preallocations. When corruption is
2560 found, it turns filesystem readonly to prevent further corruptions.
2564 Description: (rw.c:1323:ll_read_ahead_pages()) ASSERTION(page_idx > ria->ria_stoff) failed
2565 Details : Once the unmatched stride IO mode is detected, shrink the stride-ahead
2566 window to 0. If it does hit cache miss, and read-pattern is still
2567 stride-io mode, does not reset the stride window, but also does not
2568 increase the stride window length in this case.
2572 Frequency : only for big-endian servers
2573 Description: Check if system is big-endian while mounting fs with extents feature
2574 Details : Mounting a filesystem with extents feature will fail on big-endian
2575 systems since ext3-based ldiskfs is not supported on big-endian
2576 systems. This can be over-riden with "bigendian_extents" mount option.
2578 Severity : enhancement
2580 Description: The root squash functionality
2581 Details : A security feature, which is to prevent users from being able
2582 to mount lustre on their desktop, run as root, and delete
2583 all of the files in the filesystem. The goal is accomplished by
2584 remapping user id (UID) and group id (GID) of the root user to
2585 a UID and GID specified by the system administartor via Lustre
2586 configuration management server (MGS). The functionality also
2587 allows to specify sets of clients for which the remapping does
2592 Description: Excessive recovery window
2593 Details : With AT enabled, the recovery window can be excessively long (6000+
2594 seconds). To address this problem, we no longer use
2595 OBD_RECOVERY_FACTOR when extending the recovery window (the connect
2596 timeout no longer depends on the service time, it is set to
2597 INITIAL_CONNECT_TIMEOUT now) and clients report the old service
2598 time via pb_service_time.
2602 Description: Watchdog triggered on MDS failover
2603 Details : enable OBD_CONNECT_MDT flag when connecting from the MDS so that
2604 the OSTs know that the MDS "UUID" can be reused for the same export
2605 from a different NID, so we do not need to wait for the export to be
2609 Frequency : rare, only if using MMP with Linux RAID
2611 Description: MMP doesn't work with Linux RAID
2612 Details : While using HA for Lustre servers with Linux RAID, it is possible
2613 that MMP will not detect multiple mounts. To make this work we
2614 need to unplug the device queue in RAID when the MMP block is being
2615 written. Also while reading the MMP block, we should read it from
2616 disk and not the cached one.
2618 Severity : enhancement
2620 Description: open file using fid
2621 Details : A file can be opened using just its fid, like
2622 <mntpt>/.lustre/fid/SEQ:OID:VER - this is needed for HSM and replication
2625 Frequency : Only in RHEL5 when mounting multiple ext3 filesystems
2628 Description: "kmem_cache_create: duplicate cache jbd_4k" error message
2629 Details : add proper locking for creation of jbd_4k slab cache
2633 Description: MMP check in ext3_remount() fails without displaying any error
2634 Details : When multiple mount protection fails during remount, proper error
2637 Severity : enhancement
2639 Description: Allow stripe size to be up to 4G-64k
2640 Details : Fix math logic to allow large stripe sizes.
2644 Description: add check for >8TB ldiskfs filesystems
2645 Details : ext3-based ldiskfs does not support greater than 8TB LUNs.
2646 Don't allow >8TB ldiskfs filesystems to be mounted without
2647 force_over_8tb mount option
2652 Descriptoin: OSS complains "too many blocks" and crashes
2653 Details : In filter_commitrw_write():
2654 1. lquota_chkquota();
2655 2. obdo_from_inode();
2656 3. lquota_pending_commit();
2657 "2." has changed uid and gid in this case, then caused
2658 lquota_chkquota() and lquota_pending_commit() to use
2659 different uid and gid. That is the root of the bug.
2663 Descriptoin: getstripe doesn't report stripe count = -1 sanely
2664 Details : Detect and print out the 'stripe count = -1' case properly.
2668 Description: Out or order replies might be lost on replay
2669 Details : In ptlrpc_retain_replayable_request if we cannot find retained
2670 request with tid smaller then one currently being added, add it
2671 to the start, not end of the list.
2673 --------------------------------------------------------------------------------
2675 2007-08-10 Cluster File Systems, Inc. <info@clusterfs.com>
2677 * Support for kernels:
2678 2.6.5-7.283 (SLES 9),
2679 2.6.9-55.EL (RHEL 4),
2680 2.6.16.46-0.14 (SLES 10),
2681 2.6.18.8 vanilla (kernel.org)
2682 * Client support for unpatched kernels:
2683 (see http://wiki.lustre.org/index.php?title=Patchless_Client)
2684 2.6.16 - 2.6.22 vanilla (kernel.org)
2685 * Due to recently discovered recovery problems, we do not recommend
2686 using patchless RHEL 4 clients with this or any earlier release.
2687 * Recommended e2fsprogs version: 1.39.cfs8
2688 * Note that reiserfs quotas are disabled on SLES 10 in this kernel.
2689 * Starting with this release, the ldiskfs backing filesystem required
2690 by Lustre is now in its own package, lustre-ldiskfs. This package
2691 should be installed. It is versioned separately from Lustre and
2692 may be released separately in future.
2696 Description: block reactivating mgc import until all deactivates complete
2697 Details : Fix race when failing back MDT/MGS to itself (testing)
2700 Frequency : at statup only
2702 Description: mds_lov_synchronize race leads to various problems
2703 Details : simultaneous MDT->OST connections at startup can cause the
2704 sync to abort, leaving the OSC in a bad state.
2706 Severity : enhancement
2708 Description: add optional extra BUILD_VERSION info
2709 Details : add a new environment variable (namely LUSTRE_VERS) which allows
2710 to override the lustre version.
2713 Frequency : 2.6.18 servers only
2715 Description: ll_kern_mount() doesn't release the module reference
2716 Details : The ldiskfs module reference count never drops down to 0
2717 because ll_kern_mount() doesn't release the module reference.
2722 Description: server LBUG when using old ost_num_threads parameter
2723 Details : Accept the old ost_num_threads parameter but warn that it
2724 is deprecated, and fix an off-by-one error that caused an LBUG.
2729 Description: Transient SCSI error results in persistent IO issue
2730 Details : iobuf->dr_error is not reinitialized to 0 between two
2734 Frequency : sometimes when underlying device returns I/O errors
2736 Description: OSTs not going read-only during write failures
2737 Details : OSTs are not remounted read-only when the journal commit threads
2738 get I/O errors because fsfilt_ext3 calls journal_start/stop()
2739 instead of the ext3 wrappers.
2743 Description: poor connect scaling with increasing client count
2744 Details : Don't run filter_grant_sanity_check for more than 100 exports
2745 to improve scaling for large numbers of clients.
2748 Frequency : SLES10 only
2750 Description: sanity-quota.sh quotacheck failed: rc = -22
2751 Details : Quotas cannot be enabled on SLES10.
2754 Frequency : liblustre clients only
2756 Description: getdirentries does not give error when run on compute nodes
2757 Details : getdirentries does not fail when the size specified as an argument
2758 is too small to contain at least one entry
2760 Severity : enhancement
2762 Description: Add LNET router traceability for debug purposes
2763 Details : If a checksum failure occurs with a router as part of the
2764 IO path, the NID of the last router that forwarded the bulk data
2765 is printed so it can be identified.
2770 Description: OST "spontaneously" evicts client; client has imp_pingable == 0
2771 Details : Due to a race condition, liblustre clients were occasionally
2772 evicted incorrectly.
2774 Severity : enhancement
2776 Description: lfs setstripe use optional parameters instead of postional
2779 Severity : enhancement
2781 Description: Nanosecond timestamp support for ldiskfs
2782 Details : The on-disk ldiskfs filesystem has added support for nanosecond
2783 resolution timestamps. There is not yet support for this at
2784 the Lustre filesystem level.
2787 Frequency : during server recovery
2789 Description: MDS failing to send precreate requests due to OSCC_FLAG_RECOVERING
2790 Details : request with rq_no_resend flag not awake l_wait_event if they get
2794 Frequency : nfs export on patchless client
2796 Description: connectathon hang when test nfs export over patchless client
2797 Details : Disconnected dentry cannot be found with lookup, so we do not need
2798 to unhash it or make it invalid
2801 Description: fix llapi_lov_get_uuids() to allow many OSTs to be returned
2802 Details: : Change llapi_lov_get_uuids() to read the UUIDs from /proc instead
2803 of using an ioctl. This allows lfsck for > 160 OSTs to succeed.
2808 Description: open req refcounting wrong on reconnect
2809 Details : If reconnect happened between getting open reply from server and
2810 call to mdc_set_replay_data in ll_file_open, we will schedule
2811 replay for unreferenced request that we are about to free.
2812 Subsequent close will crash in variety of ways.
2813 Check that request is still eligible for replay in
2814 mdc_set_replay_data().
2819 Description: disable writes to filesystem when reading health_check file
2820 Details : the default for reading the health_check proc file has changed
2821 to NOT do a journal transaction and write to disk, because this
2822 can cause reads of the /proc file to hang and block HA state
2823 checking on a healthy but otherwise heavily loaded system. It
2824 is possible to return to the previous behaviour during configure
2825 with --enable-health-write.
2827 Severity : enhancement
2829 Description: 64-bit inode version
2830 Details: : Add a on-disk 64-bit inode version for ext3 to track changes made
2831 to the inode. This will be required for version-based recovery.
2836 Description: MDS fails to start if a duplicate client export is detected
2837 Details : in some rare cases it was possible for a client to connect to
2838 an MDS multiple times. Upon recovery the MDS would detect this
2839 and fail during startup. Handle this more gracefully.
2841 Severity : enhancement
2843 Description: Add -o localflock option to simulate old noflock
2845 Details : This will achieve local-only flock/fcntl locks
2851 Description: log_commit_thread vs filter_destroy race leads to crash
2852 Details : Take import reference before releasing llog record semaphore
2857 Description: Wrong request locking in request set processing
2858 Details : ptlrpc_check_set wrongly uses req->rq_lock for proctect add to
2859 imp_delayed_list, in this place should be used imp_lock.
2862 Frequency : when reconnection
2864 Description: Grant Leak when osc reconnect to OST
2865 Details : When osc reconnect ost, OST(filter) should check whether it
2866 should grant more space to client by comparing fed_grant and
2867 cl_avail_grant, and return the granted space to client instead
2868 of "new granted" space, because client will call osc_init_grant
2869 to update the client grant space info.
2872 Frequency : when client reconnect to OST
2874 Description: Grant Leak when osc do resend and replay bulk write
2875 Details : When osc reconnect to OST, OST(filter)should clear grant info of
2876 bulk write request, because the grant info while be sync between
2877 OSC and OST when reconnect, and we should ignore the grant info
2878 these of resend/replay write req.
2883 Description: Grant space more than avaiable left space sometimes.
2884 Details : When then OST is about to be full, if two bulk writing from
2885 different clients came to OST. Accord the avaliable space of the
2886 OST, the first req should be permitted, and the second one
2887 should be denied by ENOSPC. But if the seconde arrived before
2888 the first one is commited. The OST might wrongly permit second
2889 writing, which will cause grant space > avaiable space.
2892 Frequency : when client is evicted
2894 Description: Grant might be wrongly erased when osc is evicted by OST
2895 Details : when the import is evicted by server, it will fork another
2896 thread ptlrpc_invalidate_import_thread to invalidate the
2897 import, where the grant will be set to 0. While the original
2898 thread will update the grant it got when connecting. So if
2899 the former happened latter, the grant will be wrongly errased
2900 because of this race.
2905 Description: Checking Stale with correct fid
2906 Details : ll_revalidate_it should uses de_inode instead of op_data.fid2
2907 to check whether it is stale, because sometimes, we want the
2908 enqueue happened anyway, and op_data.fid2 will not be initialized.
2910 Severity : enhancement
2912 Description: update patchless client
2913 Details : Add support for patchless client with 2.6.20, 2.6.21 and RHEL 5
2916 Frequency : only with 2.4 kernel
2918 Description: random memory corruption
2919 Details : size of struct ll_inode_info is to big for union inode.u and this
2920 can be cause of random memory corruption.
2925 Description: Memory leak in recovery
2926 Details : Lov_mds_md was not free in an error handler in mds_create_object.
2927 It should also check obd_fail before fsfilt_start, otherwise if
2928 fsfilt_start return -EROFS,(failover mds during mds recovery).
2929 then the req will return with repmsg->transno = 0 and rc = EROFS.
2930 and we met hit the assert LASSERT(req->rq_reqmsg->transno ==
2931 req->rq_repmsg->transno) in ptlrpc_replay_interpret. Fcc should
2932 be freed no matter whether fsfilt_commit success or not.
2935 Frequency : only with huge count clients
2937 Description: Prevents from taking the superblock lock in llap_from_page for
2939 Details : using LL_ORIGIN_REMOVEPAGE origin flag instead of LL_ORIGIN_UNKNOW
2940 for llap_from_page call in ll_removepage prevents from taking the
2941 superblock lock for a soon died page.
2946 Description: Not check open intent error before release open handle
2947 Details : in some rare cases, the open intent error is not checked before
2948 release open handle, which may cause
2949 ASSERTION(open_req->rq_transno != 0), because it tries to release
2950 the failed open handle.
2955 Description: Set cat log bitmap only after create log success.
2956 Details : in some rare cases, the cat log bitmap is set too early. and it
2957 should be set only after create log success.
2961 Description: Accessing a block bevice can re-enable I/O when Lustre is
2962 tearing down a device.
2963 Details : dev_clear_rdonly(bdev) must be called in kill_bdev() instead of
2968 Description: service threads may hog cpus when there are a lot of requests
2969 Details : Insert cond_resched to give other threads a chance to use some CPU
2974 Description: the cat log was not initialized in recovery
2975 Details : When mds(mgs) do recovery, the tgt_count might be zero, so the
2976 unlink log on mds will not be initialized until mds post
2977 recovery. And also in mds post recovery, the unlink log will
2978 initialization will be done asynchronausly, so there will be race
2979 between add unlink log and unlink log initialization.
2983 Description: brw_stats were being printed incorrectly
2984 Details : brw_stats were being printed as log2 but all of them were not
2985 recorded as log2. Also remove some code duplication arising from
2986 filter_tally_{read,write}.
2990 Frequency : rare, only in recovery.
2991 Description: ASSERTION(req->rq_type != LI_POISON) failed
2992 Details : imp_lock should be held while iterating over imp_sending_list for
2993 prevent destroy request after get timeout in ptlrpc_queue_wait.
2997 Description: replay-single.sh test 52 fails
2998 Details : A lock's skiplist need to be cleanup when it being unlinked
2999 from its resource list.
3003 Description: Short directio read returns full requested size rather than
3005 Details : Direct I/O operations should return actual amount of bytes
3006 transferred rather than requested size.
3008 Severity : enhancement
3010 Description: metadata RPC reduction (e.g. for rm performance)
3011 Details : decrease the amount of synchronous RPC between clients and servers
3012 by canceling conflicing lock before the operation on the client
3013 and packing thier handles into the main operation RPC to server.
3015 Severity : enhancement
3017 Description: Async OSC create to avoid the blocking unnecessarily.
3018 Details : If a OST has no remain object, system will block on the creating
3019 when need to create a new object on this OST. Now, ways use
3020 pre-created objects when available, instead of blocking on an
3021 empty osc while others are not empty. If we must block, we block
3022 for the shortest possible period of time.
3026 Description: improve handling recoverable errors
3027 Details : if request processig with error which can be recoverable on server
3028 request should be resend, otherwise page released from cache and
3031 Severity : enhancement
3033 Description: refine locking for avoid write wrong info into lov_objid file
3034 Details : fix possible races with add new target and write/update data in
3037 --------------------------------------------------------------------------------
3039 2007-05-03 Cluster File Systems, Inc. <info@clusterfs.com>
3044 Frequency : on some architectures
3046 Description: 1.6 client sometimes fails to mount from a 1.4 MDT
3047 Details : Uninitialized flags sometimes cause configuration commands to
3051 Frequency : patchless clients only
3053 Description: missing __iget() symbol export
3054 Details : The __iget() symbol export is missing. To avoid the need for
3055 this on patchless clients the deathrow inode reaper is turned
3056 off, and we depend on the VM to clean up old inodes. This
3057 dependency was during via the fix for bug 12181.
3059 --------------------------------------------------------------------------------
3061 2007-04-19 Cluster File Systems, Inc. <info@clusterfs.com>
3063 * CONFIGURATION CHANGE. This version of Lustre WILL NOT
3064 INTEROPERATE with older versions automatically. In many cases a
3065 special upgrade step is needed. Please read the
3066 user documentation before upgrading any part of a live system.
3067 * WIRE PROTOCOL CHANGE from previous 1.6 beta versions. This
3068 version will not interoperate with 1.6 betas before beta5 (1.5.95).
3069 * WARNING: Lustre configuration and startup changes are required with
3070 this release. See https://mail.clusterfs.com/wikis/lustre/MountConf
3074 Severity : enhancement
3076 Description: MountConf
3077 Details : Lustre configuration is now managed via mkfs and mount
3078 commands instead of lmc and lconf. New obd types (MGS, MGC)
3079 are added for dynamic configuration management. See
3080 https://mail.clusterfs.com/wikis/lustre/MountConf for
3083 Severity : enhancement
3085 Description: dynamic OST addition
3086 Details : OSTs can now be added to a live filesystem
3088 Severity : enhancement
3090 Description: startup order invariance
3091 Details : MDTs and OSTs can be started in any order. Clients only
3092 require the MDT to complete startup.
3094 Severity : enhancement
3096 Description: parallel, asynchronous orphan cleanup
3097 Details : orphan cleanup is now performed in separate threads for each
3098 OST, allowing parallel non-blocking operation.
3100 Severity : enhancement
3102 Description: optimized stripe assignment
3103 Details : stripe assignments are now made based on ost space available,
3104 ost previous usage, and OSS previous usage, in order to try
3105 to optimize storage space and networking resources.
3107 Severity : enhancement
3109 Description: Permanently set tunables
3110 Details : All writable /proc/fs/lustre tunables can now be permanently
3111 set on a per-server basis, at mkfs time or on a live system.
3113 Severity : enhancement
3115 Description: Lustre message v2
3116 Details : Add lustre message format v2.
3118 Severity : enhancement
3120 Description: client OST exclusion list
3121 Details : Clients can be started with a list of OSTs that should be
3122 declared "inactive" for known non-responsive OSTs.
3126 Description: SPEC SFS validation failure on NFS v2 over lustre.
3127 Details : Changes the blocksize for regular files to be 2x RPC size,
3128 and not depend on stripe size.
3130 Severity : enhancement
3132 Description: Multiple MD RPCs in flight.
3133 Details : Further unserialise some read-only MDS RPCs - learn about intents.
3134 To avoid overly-overloading MDS, introduce a limit on number of
3135 MDS RPCs in flight for a single client and add /proc controls
3136 to adjust this limit.
3138 Severity : enhancement
3140 Description: client read/write statistics
3141 Details : Add client read/write call usage stats for performance
3142 analysis of user processes.
3143 /proc/fs/lustre/llite/*/offset_stats shows non-sequential
3144 file access. extents_stats shows chunk size distribution.
3145 extents_stats_per_process show chunk size distribution per
3148 Severity : enhancement
3150 Description: mds statistics
3151 Details : Add detailed mds operations statistics in
3152 /proc/fs/lustre/mds/*/stats.
3156 Description: Failure of copying files with lustre special EAs.
3157 Details : Client side always return success for setxattr call for lustre
3158 special xattr (currently only "trusted.lov").
3163 Description: Refcount LNET uuids
3164 Details : The global LNET uuid list grew linearly with every startup;
3165 refcount repeated list entries instead of always adding to
3168 Severity : enhancement
3170 Description: Dynamic service threads
3171 Details : Within a small range, start extra service threads
3172 automatically when the request queue builds up.
3175 Frequency : mixed-endian client/server environments
3177 Description: mixed-endian crashes
3178 Details : The new msg_v2 system had some failures in mixed-endian
3181 Severity : enhancement
3183 Description: Easy OST removal
3184 Details : OSTs can be permanently deactivated with e.g. 'lctl
3185 conf_param lustre-OST0001.osc.active=0'
3187 Severity : enhancement
3189 Description: MGS proc entries
3190 Details : Added basic proc entries for the MGS showing what filesystems
3193 Severity : enhancement
3195 Description: provide MGS failover
3196 Details : Added config lock reacquisition after MGS server failover.
3198 Severity : enhancement
3200 Description: add Linux 2.4 support
3201 Details : Added support for RHEL 2.4.21 kernel for 1.6 servers and clients
3205 Description: a large application tries to do I/O to the same resource and dies
3206 in the middle of it.
3207 Details : Check the req->rq_arrival time after the call to
3208 ost_brw_lock_get(), but before we do anything about
3209 processing it & sending the BULK transfer request. This
3210 should help move old stale pending locks off the queue as
3211 quickly as obd_timeout.
3214 Frequency : when an incorrect nid is specified during startup
3216 Description: ptlrpc connect to non-existant node causes kernel crash
3217 Details : LNET can't be re-entered from an event callback, which
3218 happened when we expire a message after the export has been
3219 cleaned up. Instead, hand the zombie cleanup off to another
3222 Severity : enhancement
3224 Description: plain/inodebits lock performance improvement
3225 Details : Grouping plain/inodebits in granted list by their request modes
3226 and bits policy, thus improving the performance of search through
3230 Frequency : only if OST filesystem is corrupted
3232 Description: client incorrectly hits assertion in ptlrpc_replay_req()
3233 Details : for a short time RPCs with bulk IO are in the replay list,
3234 but replay of bulk IOs is unimplemented. If the OST filesystem
3235 is corrupted due to disk cache incoherency and then replay is
3236 started it is possible to trip an assertion. Avoid putting
3237 committed RPCs into the replay list at all to avoid this issue.
3240 Frequency : liblustre (e.g. catamount) on a large cluster with >= 8 OSTs/OSS
3242 Description: System hang on startup
3243 Details : This bug allowed the liblustre (e.g. catamount) client to
3244 return to the app before handling all startup RPCs. This
3245 could leave the node unresponsive to lustre network traffic
3246 and manifested as a server ptllnd timeout.
3248 Severity : enhancement
3250 Description: Add "/proc/sys/lustre/debug_peer_on_timeout"
3251 Details : liblustre envirable: LIBLUSTRE_DEBUG_PEER_ON_TIMEOUT
3252 boolean to control whether to print peer debug info when a
3253 client's RPC times out.
3256 Frequency : only for kernels with patches from Lustre below 1.4.3
3258 Description: Remove old rdonly API
3259 Details : Remove old rdonly API which unused from at least lustre 1.4.3
3262 Frequency : only for devices with external journals
3264 Description: Set external device read-only also
3265 Details : During a commanded failover stop, we set the disk device
3266 read-only while the server shuts down. We now also set any
3267 external journal device read-only at the same time.
3270 Frequency : when upgrading from 1.4 while trying to change parameters
3272 Description: The wrong (new) MDC name was used when setting parameters for
3273 upgraded MDT's. Also allows changing of OSC (and MDC)
3274 parameters if --writeconf is specified at tunefs upgrade time.
3277 Frequency : when setting specific ost indicies
3279 Description: QOS code breaks on skipped indicies
3280 Details : Add checks for missing OST indicies in the QOS code, so OSTs
3281 created with --index need not be sequential.
3283 Severity : enhancement
3285 Description: Add uninit_groups feature to ldiskfs2 to speed up e2fsck
3286 Details : The uninit_groups feature works in conjunction with the kernel
3287 filesystem code (ldiskfs2 only) and e2fsprogs-1.39-cfs6 to speed
3288 up the pass1 processing of e2fsck. This is a read-only feature
3289 in ldiskfs2 only, so older kernels and current ldiskfs cannot
3290 mount filesystems that have had this feature enabled.
3292 Severity : enhancement
3294 Description: Improve multi-block allocation algorithm to avoid fragmentation
3295 Details : The mballoc3 code (ldiskfs2 only) adds new mechanisms to improve
3296 allocation locality and avoid filesystem fragmentation.
3298 ------------------------------------------------------------------------------
3300 2007-04-01 Cluster File Systems, Inc. <info@clusterfs.com>
3302 * Support for kernels:
3303 2.4.21-47.0.1.EL (RHEL 3)
3304 2.6.5-7.283 (SLES 9)
3305 2.6.9-42.0.10.EL (RHEL 4)
3306 2.6.12.6 vanilla (kernel.org)
3307 2.6.16.27-0.9 (SLES 10)
3308 * Recommended e2fsprogs version: 1.39.cfs5
3310 * Note that reiserfs quotas are disabled on SLES 10 in this kernel
3314 Frequency : occasional, depends on client load and configuration
3315 Bugzilla : 12181, 12203
3316 Description: data loss for recently-modified files
3318 Details : In some cases it is possible that recently written or created
3319 files may not be written to disk in a timely manner (this should
3320 normally be within 30s unless client IO load is very high).
3321 The problem appears as zero-length files or files that are a
3322 multiple of 1MB in size after a client crash or client eviction
3323 that are missing data at the end of the file.
3325 This problem is more likely to be hit on clients where files are
3326 repeatedly created and unlinked in the same directory, clients
3327 have a large amount of RAM, have many CPUs, the filesystem has
3328 many OSTs, the clients are rebooted frequently, and/or the files
3329 are not accessed by other nodes after being written.
3331 The presence of the problem can be detected by looking at
3332 /proc/sys/fs/inode-state. If the first number (nr_inodes) is
3333 smaller than the second (nr_unused) then dirty files will not
3334 be flushed automatically to disk. "sync; sleep 10" should be
3335 run several times on the node before unmounting it to update
3336 Lustre (this is also safe to run on nodes without this problem).
3338 There is also a related kernel bug in the RHEL4 4 2.6.9 kernel
3339 that can cause this same problem, so customers using that kernel
3340 also need to update the kernel in addition to Lustre. In order
3341 to properly fix this bug, the RHEL3 2.4.21 kernel is also updated.
3343 It is normal that files written just before a client crash (less
3344 than 30s) may not yet have been flushed to disk, even for local
3348 Frequency : frequent on thin XT3 nodes
3350 Description: UUID collision on thin XT3 Linux nodes
3351 Details : UUIDs on Compute Node Linux XT3 nodes were not generated
3352 randomly, since we relied on an insufficiently-seeded PRNG.
3357 Description: OSS hangs after "All ost request buffers busy"
3358 Details : A deadlock between quota and journal operations caused OSS
3359 hangs after printing "All ost request buffers busy."
3362 Frequency : always on liblustre builds
3364 Description: Cleanup compiler warnings on liblustre
3367 Frequency : always on liblustre builds on XT3
3369 Description: LC_CONFIG_CDEBUG don't run while build liblustre on XT3.
3373 Description: Addition of EXT3_FEATURE_RO_COMPAT_DIR_NLINKS flag for
3374 > 32000 subdirectories
3375 Details : Add EXT3_FEATURE_RO_COMPAT_DIR_NLINK flag to
3376 EXT3_FEATURE_RO_COMPAT_SUPP. This flag will be set whenever
3377 subdirectory count crosses 32000. This will aid e2fsck to
3378 correctly handle more than 32000 subdirectories.
3381 Frequency : liblustre (e.g. catamount) on a large cluster with >= 8 OSTs/OSS
3383 Description: System hang on startup
3384 Details : This bug allowed the liblustre (e.g. catamount) client to
3385 return to the app before handling all startup RPCs. This
3386 could leave the node unresponsive to lustre network traffic
3387 and manifested as a server ptllnd timeout.
3389 Severity : enhancement
3391 Description: Add "/proc/sys/lustre/debug_peer_on_timeout"
3392 (liblustre envirable: LIBLUSTRE_DEBUG_PEER_ON_TIMEOUT)
3393 boolean to control whether to print peer debug info when a
3394 client's RPC times out.
3399 Description: make O_SYNC working on 2.6 kernels
3400 Details : 2.6 kernels use different method for mark pages for write,
3401 so need add a code to lustre for O_SYNC work.
3406 Description: Failure to close file and release space on NFS
3407 Details : Put inode details into lock acquired in ll_intent_file_open.
3408 Use mdc_intent_lock in ll_intent_open to properly
3409 detect all kind of errors unhandled by mdc_enqueue.
3414 Description: proc file read during shutdown sometimes raced obd removal,
3416 Details : Add lock to prevent obd access after proc file removal.
3419 Frequency : Only for files larger than 4GB on 32-bit clients.
3421 Description: improperly doing page alignment of locks
3422 Details : Modify lustre core code to use CFS_PAGE_* defines instead of
3423 PAGE_*. Make CFS_PAGE_MASK a 64-bit mask.
3428 Description: RPCs being resent when they shouldn't be
3429 Details : Some RPCs that should not be resent are being resent. This
3430 can cause inconsistencies in the RPC state machine. Do not
3431 resend such requests.
3434 Frequency : rare, only with NFS export
3436 Description: Crash on NFS re-export node
3437 Details : under very unusual load conditions an assertion is hit in
3438 ll_intent_file_open()
3441 Frequency : only if OST filesystem is corrupted
3443 Description: client incorrectly hits assertion in ptlrpc_replay_req()
3444 Details : for a short time RPCs with bulk IO are in the replay list,
3445 but replay of bulk IOs is unimplemented. If the OST filesystem
3446 is corrupted due to disk cache incoherency and then replay is
3447 started it is possible to trip an assertion. Avoid putting
3448 committed RPCs into the replay list at all to avoid this issue.
3453 Description: large O_DIRECT requests fail under memory pressure/fragmentation
3454 Details : Large single O_DIRECT read and write calls can fail to allocate
3455 a sufficiently large buffer to process the request. In case of
3456 allocation failure the allocation is retried with a smaller
3457 buffer and broken into smaller requests.
3459 Severity : enhancement
3461 Description: Add -o localflock option to simulate old noflock behaviour.
3462 Details : This will achieve local-only flock/fcntl locks coherentness.
3467 Description: versioning check is incomplete
3468 Details : Checking the version difference of client vs. server, report
3469 error if the gap is too big.
3474 Description: add support PG_writeback bit
3475 Details : add support for PG_writeback bit for Lustre, for more carefull
3476 work with page cache in 2.6 kernel. This also fix some deadlocks
3477 and remove hack for work O_SYNC with 2.6 kernel.
3479 Severity : enhancement
3481 Description: Add uninit_groups feature to ldiskfs2 to speed up e2fsck
3482 Details : The uninit_groups feature works in conjunction with the kernel
3483 filesystem code (ldiskfs2 only) and e2fsprogs-1.39-cfs6 to speed
3484 up the pass1 processing of e2fsck. This is a read-only feature
3485 in ldiskfs2 only, so older kernels and current ldiskfs cannot
3486 mount filesystems that have had this feature enabled.
3488 Severity : enhancement
3490 Description: Improve multi-block allocation algorithm to avoid fragmentation
3491 Details : The mballoc3 code (ldiskfs2 only) adds new mechanisms to improve
3492 allocation locality and avoid filesystem fragmentation.
3494 ------------------------------------------------------------------------------
3496 2007-02-09 Cluster File Systems, Inc. <info@clusterfs.com>
3498 * Support for kernels:
3499 2.6.9-42.0.3.EL (RHEL 4)
3500 2.6.5-7.276 (SLES 9)
3501 2.4.21-47.0.1.EL (RHEL 3)
3502 2.6.12.6 vanilla (kernel.org)
3503 2.6.16.21-0.8 (SLES10)
3504 * Recommended e2fsprogs version: 1.39.cfs2-0
3506 * The backwards-compatible /proc/sys/portals symlink has been removed
3507 in this release. Before upgrading, please ensure that you change
3508 any configuration scripts or /etc/sysctl.conf files that access
3509 /proc/sys/portals/* or sysctl portals.* to use the corresponding
3510 entry in /proc/sys/lnet or sysctl lnet.*. This change can be made
3511 in advance of the upgrade on any system running Lustre 1.4.6 or
3512 newer, since /proc/sys/lnet was added in that version.
3513 * Note that reiserfs quotas are disabled on SLES 10 in this kernel
3517 Frequency : only when quota is used
3519 Description: avoid scanning export list for quota master
3520 Details : Change the algorithms to avoid scanning export list in order
3521 to improve the efficiency.
3524 Frequency : MDS failover only, very rarely
3526 Description: "went back in time" messages on mds failover
3527 Details : The greatest transno may be lost when the current operation
3528 finishes with an error (transno==0) and the client's last_rcvd
3529 record is over-written. Save the greatest transno in the
3530 mds_last_transno for this case.
3533 Frequency : always for specific kernels and striping counts
3535 Description: client may get "Matching packet too big" without ACL support
3536 Details : Clients compiled without CONFIG_FS_POSIX_ACL get an error message
3537 when trying to access files in certain configurations. The
3538 clients should in fact be denied when mounting because they do
3539 not understand ACLs.
3542 Frequency : Cray XT3 with more than 4000 clients and multiple jobs
3544 Description: many clients connecting with IO in progress causes connect timeouts
3545 Details : Avoid synchronous journal commits to avoid delays caused by many
3546 clients connecting/disconnecting when bulk IO is in progress.
3547 Queue liblustre connect requests on OST_REQUEST_PORTAL instead of
3548 OST_IO_PORTAL to avoid delays behind potentially many pending
3552 Frequency : occasionally with multiple writers to a single file
3554 Description: shared writes to file may result in wrong size reported by stat()
3555 Details : Allow growing of kms when extent lock is cancelled
3558 Frequency : always with random mmap IO to multi-striped file
3560 Description: mmap write might be lost if we are writing to a 'hole' in stripe