1 tbd Cluster File Systems, Inc. <info@clusterfs.com>
4 - fix obvious semaphore misuse in as-yet-unused setattr path (2348)
5 - remove the most blatant lies from BUILDING file (2371)
6 - change default debug level to reasonable production setting
7 - reduce client side cache size to reduce cache flush time
8 - reduce max RPCs in flight to avoid unnecessary file fragmentation
9 - make TCP zerocopy and pinger support enabled by default (2476)
10 - sync writes completed after process exits caused crashes (2319)
11 - maintain correct mount count on the MDS (2356)
12 - backout 1557, because 2316 wasn't really fixed
13 - better file I/O statistics gathering in /proc
14 - don't take unnecessary, deadlock-inducing bug in readpage (2383)
15 - another kernel patch to fix zero-copy TCP function export
16 - don't take duplicate lock when processing re-sent getattr (2420)
17 - lctl uses obd_self_export instead of creating new conn (2353)
18 - MDS/OST recovery case which requires object creation asserted (2425)
19 - move lfs from /usr/sbin to /usr/bin in packages
20 - fix race between mds_client_add and mds_client_free (2417)
21 - use kmalloc instead of slabs in portals (2430)
22 - don't create duplicate records when a failover MDS is present (2442)
23 - remove unnecessary mount age check (2332)
24 - don't remove directory inodes from locks prematurely (2451)
25 - fix races in client write RPC generation when cache full (2482)
27 2003-12-13 Cluster File Systems, Inc. <info@clusterfs.com>
30 - remove now-unused request->rq_obd (278)
31 - if an allocation fails, print out how much memory we've used (1933)
32 - use PORTAL_SLAB_ALLOC for structures, to get GFP_MEMALLOC (1933)
33 - add the "configurable stack size" patch to most series files (1256)
34 - ability to write large log records, for 100+ OST configs (2306)
35 - fix NULL deref when filter_prep fails (2314)
36 - fix operator precedence error in filter_sync
37 - dynamic allocation of socknal TX descriptors (2315)
38 - fix a missed case in the GFP_MEMALLOC patch, can cause deadlock (2310)
39 - fix gcc 2.96 compilation problem in xattr kernel patch (2294)
40 - ensure that CWARN messages in Portals always get to the syslog
41 - __init/__exit are not for prototype decls (ldlm_init/exit)
42 - x86-64 compile warning fixes
43 - fix gateway LMC keyword conflict (2318)
44 - fix MDS lock inversions in getattr/reint paths (1844)
45 - fix a rare lock re-ordering bug, which caused deadlock (2322)
46 - fix i_sem/journal inversion in fsfilt_ext3_write_record (2306)
47 - protect MDS inode fsdata with stronger locking (2313)
48 - better error messages when a client is rejected during recovery (1505)
49 - avoid cancelling locks which were never granted, after failure (2330)
50 - fix i_sem/journal inversion in mds_client_add (2333)
51 - fix truncate/getattr lock cycle deadlock (2334)
53 - allow configurable automake binary, for testing new versions
54 - small update to the lfs documentation
56 2003-12-03 Cluster File Systems, Inc. <info@clusterfs.com>
58 * fix negative export reference count in fsfilt_sync (2312)
60 2003-12-01 Cluster File Systems, Inc. <info@clusterfs.com>
61 * release candidate 0.9.1
63 - orphans are moved into the PENDING directory for possible recovery
64 - replayed opens now open by fid for orphan/rename safety (1042)
65 - last close of an orphan inode generates a transno (683)
66 - chdir() and mount() now pin the directory entry (1020)
67 - avoid CERROR in normal ll_setattr_raw() error case (1500)
68 - discard very old requests without processing them (1502)
69 - remove some common, well-understood CERRORs (1505)
70 - require O_DIRECT I/O to be page-sized to workaround IA64 crash (1609)
71 - clear "grant" flags in OST replies until OST grant code lands (1644)
72 - fix read performance by not clobbering i_blksize on client (1598)
73 - fix __ldlm_handle2lock oops by not dereferencing lock after PUT (1625)
74 - make LRU size a /proc tunable, clears locks when reduced (707)
75 - fix some lprocfs rot that prevented ptlbd from loading (1732)
76 - server locks take references on exports now (1558)
77 - build fixes for 2.4.20-rh trees (1663)
78 - return an error from lov_create if all OSCs are inactive (1751)
79 - fix import levels when a reconnect happens without a timeout (1597)
80 - exit early from mds_open if we get a lookup error (1749)
81 - partial page read at EOF wouldn't wait for disk before sending (1642)
82 - avoid NULL deref in obdfilter when reading page past EOF (1592)
83 - avoid LASSERT in ll_intent_lock if server failed very early (1090)
84 - fix LBUG in ll_it_open_error with rc = -2 (1861)
85 - write/truncate lock inversion (1639)
86 - Don't auto-load obdclass, portals modules during cleanup (1495)
87 - fix timestamps from jumping to "now" (1763)
88 - extra journal assertions (1648)
89 - add an extra multiunlink test (1771)
90 - fix read_record/write_record API (1776)
91 - fix leak of offset_extent, possible incorrect i_size later (1772)
92 - fix lasserts in mis-matched transnos during open-unlink testing (1541)
93 - Debugging for the kqswnal_get_idle_tx problems (1820)
94 - Allow recovery to be attempted multiple times (1536)
95 - Write out MDS last_rcvd file after it is first created (1600)
96 - Fix tx_descriptor leak in failed transmit situations (1827)
97 - ext3 journaling fixes for assertion failure after IO error (1871)
98 - class_export_put() on freed export after completion AST error (1896)
99 - Fix revalidate looping in VFS (1322)
100 - Don't access a freed export during MDS_REINT timeout (1521)
101 - Add open-unlink recovery support on the MDS (1673,1764)
102 - Return an error if no MDS data was read from last_rcvd (1946)
103 - Fix for lookup "." or ".." crash on error (1932,1931,1935)
104 - Don't setup a disk device that doesn't match exported UUID (317)
105 - Reduce bulk RPC timeout to avoid cascading client/OST failures (1845)
106 - avoid committing NULL handle in force close
107 - local.sh is now a one-stripe LOV configuration
108 - POSIX utime.4 -EPERM on FIFO not owned by user (56)
109 - fix ext3 htree duplicate directory entry corruption (1516)
110 - POSIX creat.13, fstat.1, open.18, stat.3 new file atime/mtime (2020)
111 - update to new LOV EA format (2097)
112 - interoperability for different PAGE_SIZE/wordsize (686,1821,1343,2042)
114 2003-06-15 Phil Schwan <phil@clusterfs.com>
117 - imports and exports cleanup too early, need refcounts (349, 879, 1045)
118 - per-import/export recovery handling (958, 931, 959)
119 - multiple last-rcvd slots, for serving multiple FSes (949)
120 - connections are again shared between multiple imp/exports (963, 964)
121 - "umount -f" would hang if any requests needed to be sent (393, 978)
122 - avoid pinning large req buffer by copying for queued messages (989)
123 - add "uuid" to "lctl device" command to help upcalls (991)
124 - "open" RPCs with transnos would confuse recovery counters (1037)
125 - do proper endian conversion of all wire messages (288, 340, 891)
126 - remove OST bulk get LBUGs, fix ost_brw_write cleanup (1126)
127 - call waiting locks callback from LDLM recovery thread (1127, 1151)
128 - fix ptlrpc_connection leak in target_handle_connect (1174)
129 - fix import refcounting bug in OST and MDS cleanup (1134)
130 - if an invalid-at-open-time OSC returned before close(), LBUG (1150)
131 - fix very unlikely obd_types race condition (501)
132 - remove osc_open hack for echo_client (1187)
133 - we leaked exports/dlmimps for forcibly disconnected clients (1143)
134 - a failure in read_inode2 leads to deadlock (1139)
135 - cancel ack-locks as soon as transaction is committed (1072)
136 - fix major leaks and crashes in the bulk I/O path (937, 1057)
137 - make sure to commitrw after any preprw to avoid deadlock (1162)
138 - failing to execute a file in a lustre FS would lock inode (1203)
139 - small DEBUG_REQ fix to avoid dereferencing a NULL (1227)
140 - don't ASSERT while cleaning up an incompletely-setup obd (1248)
141 - obd_uuid2tgt would walk off the end of the list (1255)
142 - on IA64 the osc would give portals incorrect bulk size (1258)
143 - fix debug daemon ioctl interface; allows daemon on ia64 (1274)
144 - fix lock inversion caused by new llite matching code (1282)
145 - limit the number of dirty pages on a client to 10MB (1286)
146 - timed out locks were not being corrected cancelled (1289)
147 - fix O_DIRECT above 4GB on IA-32 (1292)
148 * major user-visible changes
149 - fail out/fail over policy now controlled by the upcall (993)
151 - add OBD_PING to check server availability and failure (954)
152 - lustre messages are now sent in sending host order (288, 340, 891)
153 - add eadatalen to MDS getattr reply (340)
154 - OST read replies may contain second buffer, with per-page status (593)
156 2003-03-11 Phil Schwan <phil@clusterfs.com>
159 - LDLM_DEBUG macro fix, for gcc 3.2 (850)
160 - failed open()s could cause deadlock; fixed (867, 869)
161 - stop cancelling OST locks when files are closed (481)
162 - overlapping XID spaces caused network corruption (851, 853)
163 - fix unsafe fsfilt counter arithmetic; change to atomic_t
164 - setattr_raw added, to do single-RPC, server-side setattrs
165 - lmc/lconf syntax change for OST UUIDs
166 - fix crashy race condition between ptlrpc_free_req and osc_close
167 - don't use request in mdc_enqueue if we hit a timeout (889)
168 - don't set the inode i_size for regular files from the MDS (896)
169 - handle out of order completion AST (842)
170 - don't LBUG if a lock request times out after receiving AST (913)
171 - avoid d_rehash race in ll_find_alias by rehashing inside dcache_lock
172 - if a bad lock AST arrives, send an error instead of dropping entirely
173 - return 0 from revalidate2 if ll_intent_lock returns -EINTR (912)
174 - fix leak in bulk IO when only partially completed (899, 900, 926)
175 - fix O_DIRECT for ia64 (55)
176 - (almost) eliminate Lustre-kernel-thread effects on load average (722)
177 - C-z after timeout could hang a process forever; fixed (977)
179 - client-side I/O cache (678, 924, 929, 941, 970)
181 - READPAGE and SETATTRs which don't take server-side locks get
184 2003-02-11 Phil Schwan <phil@clusterfs.com>
187 - Fix ldlm_lock_match on the MDS to avoid matching remote locks (592)
188 - Fix fsfilt_extN_readpage() to read a full page of directory
189 entries, or fake the remainder if PAGE_SIZE != blocksize (500)
190 - Avoid extra mdc_getattr() in ll_intent_lock when possible (534, 604)
191 - Fix imbalanced LOV object allocation and out-of-bound access (469)
192 - Most intent operations were removed, in favour of a new RPC mode
193 that does a single RPC to the server and bypasses most of the VFS
194 - All LDLM resource ID arrays were removed in favour of ldlm_res_id
195 - Aggressively cancel local locks on DLM servers
196 - mds_reint_unlink sends EA to the client if it's the last nlink.
197 client uses that EA to unlink OST objects.
198 - mds_reint_{rename,unlink,link} were rewritten to take ordered locks
199 - recursive symlinks were fixed (439)
200 - fixed NULL deref in DEBUG_REQ
201 - filter_update_lastobjid no longer calls sync, which annoyed extN
202 - fixed multi-client small-writes to a single file problem (445)
203 - fixed mtime updates during file writes (607)
204 - fixed vector writes on obdfilter causing problems when ENOSPC (670)
205 - fixed bug in obd_brw_read/write() (under guise of testing 367)
206 - fixed Linux OST size reporting problem (444, 656)
207 - OST now updates object mtime with writes or setattr (607, 619)
208 - client verifies file size before zeroing page past EOF (445)
209 - OST now writes last allocated objid to disk with allocation (108)
210 - LOV on echo now works (409)
212 - mds_reint_unlink sends a new buffer, with the EA included. this
213 buffer is only valid if body->valid & OBD_MD_FLEASIZE, which is only
214 set if a regular file was being unlinked, and it was the last link
215 - use PtlGet from the target for bulk writes (315)
216 - OST now updates object mtime with writes or setattr (607, 619)
217 - LDLM now has a grant-time callback to revalidate locked items, if
219 - Many MDS operations were reorganized to combat race conditions
221 - Merge b_intel branch (updated lprocfs code) - now at /proc/fs/lustre
222 - configure check to avoid gcc version 2.96 20000731-2.96-98) (606)
224 2003-01-06 Andreas Dilger <adilger@clusterfs.com>
227 - Fully reactivate OST imports after reconnection (512, others)
228 - Make sure client sees our -ENOTCONN from mds_handle (513 - partial)
229 - More graceful error handling for truncating on dead OST (515)
230 - Don't error out unless we're actually accessing dead stripes (474)
231 - Fix garbage sizes when stripes are missing (410)
232 - LRU counters were broken, causing constant lock purge (433, 432)
233 - garbage on read from stripes with failed OSTs (441)
234 - mark OSCs as active before reconnecting during recovery (438)
235 - lov_enqueue and lov_cancel need to handle inactive OSTs (403)
236 - lfind did not preserve OST order in output (443)
237 - symlinks cause hung clients, incorrect data (439)
238 - stop dereferencing request after dropping refcount (457)
239 - don't LASSERT(spin_is_locked) on non-SMP (455)
240 - fixes for many rename() bugs
241 - fstat didn't correctly synchronize attributes (399)
242 - server must handle lock cancellation during blocking AST prep (487)
243 - bulk descriptors were free()d too soon (511)
244 - fix paths in lconf, which would load incorrect modules (451, 507)
245 - fix confusing lconf 'host not found' error message (386)
246 - fix lock order deadlock on OST (O/R i_sem before journal ops, 478)
247 - fix race condition in mdc_blocking_ast() for inode access (526)
248 - fix lov_unpackmd() unpacking wrong number of stripes (537)
249 - fix lov_set_osc_active() marking wrong OSC inactive (440)
250 - fix bad lstripe lov_unpackmd() assertion (fix layering too) (527)
251 - fix multiple writes of stripe MD to MDS (358, maybe 519)
252 - fix lstripe in several ways (kernel side) (527)
253 - fix request leak in ldlm_cli_enqueue (262)
254 - incorrect OSC was marked inactive after OST failure
255 - call mds_fs_cleanup before unmounting filesystem (524)
256 - fix races between taking ns_lock and ldlm_lock_change_resource
257 - fix races updating LOV export open file list
258 - fix lov_enqueue error path, avoid decref-ing bad lock handle
259 - fix recovery NULL deref in ldlm_cli_cancel_unused
260 - fix some DLM races by using new hash table for lock handles (419)
261 - permit the client to specify desired inodes, at replay
262 - duplicate requests when we queue them for replay reintegration
263 - fix last_rcvd offset calculation
264 - sync after each recovered transaction, so we always make progress
265 - never, not always, ERESTART requests without transnos
266 - store the lov_desc in the MDS, so we don't depend on getlovinfo to
268 - skip replay if the MDS says that the client is already connected
269 - don't check for a recovery-enabled export to match lctl's UUID
270 - don't INC_USE_COUNT for phantom exports
271 - don't crash when cleaning up phantom exports (567)
272 - don't double-finish or set replay data for errored mdc_open requests
273 - abort requests when they time out, so we don't get old replies
274 - send/receive replies for AST messages again
275 - if the client says that it doesn't have the lock, cancel it on the
277 - if we timeout during I/O, don't try to cancel an in-use lock; instead
278 mark it as destroyed, it will all work out when decref is called
279 - fix module use counts (22, 581)
281 - ASTs now expect a reply (server cancels lock on error reply)
283 2002-12-02 Andreas Dilger <adilger@clusterfs.com>
286 - fix many simultaneous client startup (392)
287 - fix dentry->d_it clobbering
288 - credentials weren't being shipped for readdir/getattr operations
289 - remove invalid assertions triggered during some concurrent MD
291 - proper Lustre versions added (336, 389)
292 - fix memory leak for create error case (398)
293 - fix LOV locking bug that would get cli/srv out of sync
294 - fix echo client over LOV (409)
295 - fix dbench 2, extN refcount problem (170, 258, 356, 418)
296 - fix double-O_EXCL intent crash (424)
297 - avoid sending multiple lock CANCELs (352)
299 - MDS can do multi-client recovery (modulo bugs in new code)
301 - many updates, edits, cleanups
303 2002-11-18 Phil Schwan <phil@clusterfs.com>
306 - fix null d_it dereference (346)
307 - fix full OST/dbench hang (333)
308 - fix permission problem with file removal (286)
309 - fix removal of OSCs from LOV when they fail
310 - fix NULL deref during bulk timeout (214)
311 - fix problems related to multiple filesystems on one MDS (241)
312 - fixed serious subtle metadata locking bugs
313 - free locks on clients when inodes are removed due to memory
315 - fix inode pointer in lock data (285)
316 - partial support for multiple MDS on a single host (241)
317 - data locks weren't cancelled at clear_inode time (290, 311)
318 - intent locks could lead to unbounded lock growth (205)
319 - added a maximum lock count, an LRU list, and a flusher
320 - fix multiple rename (365)
321 - properly abstracted the echo client
322 - OSC locked 1 byte too many; fixed
323 - rewrote brw callback code:
324 - fixed recovery bugs related to LOVs (306)
325 - fixed too-many-pages-in-one-write crash (191)
326 - fixed (again) crash in sync_io_timeout (214)
327 - probably fixed callback-related race (385)
329 - Add capability to MDS protocol
330 - LDLM cancellations and callbacks on different portals
332 2002-10-28 Andreas Dilger <adilger@clusterfs.com>
335 - limit client IOV size to PTL_MD_MAX_IOV (611336, 191)
336 - defer open object destruction to close time (601981, 138)
337 - open/close OST file handle in obdo (OBD_MD_FLHANDLE) (601981, 138)
338 - move LDLM_ENQUEUE/CONVERT back to MDS portal (625069)
339 - abstract ll_lookup2, fix ll_revalidate2 to use abstraction (256)
340 - don't call obd_setattr in ll_file_release for destroyed objects
341 * protocol change to lustre_msg: move |version| and add |flags|
342 * protocol change to osc_punch: "start" in "o_size", "end" in "o_blocks"
343 * lock replay: for LDLM_FL_REPLAY trust client to do right thing
344 * added replay of create, unlink, link and rename operations during
345 MDS failover; recovery should be much more robust now
346 * remove failed OSCs from LOVs (only lov_create uses this so far)
347 * the lustre-HOWTO was brought (more) up to date (582544)
349 2002-10-23 Phil Schwan <phil@clusterfs.com>
352 - in-use dentries weren't being reused properly (617851)
353 - prevent multiple LDLM setup (599178)
354 - fix LOV size calculations for truncate (617853)
355 - fix client handling of MDS intent errors (POSIX)
356 - fix permission bug in lovstripe.c test (624321)
357 - fix MDS thread deadlock - move LDLM handler to DLM portal (625069)
358 - truncate past end of file could corrupt data
359 - proper cleanup after timeouts, crashes, etc (592524, 550815)
360 - a race in recovery could return ETIMEDOUT to apps (623947)
361 - building outside the source directory was fixed
362 * the lustre-HOWTO was brought (more) up to date (582544)
363 * major progress was made on recovery functionality
365 2002-10-10 Phil Schwan <phil@clusterfs.com>
368 - recovery deadlock fix
369 - rm -rf causes LBUG fix (617817)
370 - file open by multiple tasks fix (618962)
371 - directory permissions bugs (602707 and 620007)
372 - journal_stop fixed with locking (611313)
373 - O_APPEND failures resolved (618273, perhaps 614459)
374 - lconf PATH fix (619770)
375 - IA64 build fix (621450)
376 - RPC buffer sizes scale with amount of memory
378 2002-10-01 Phil Schwan <phil@clusterfs.com>
381 - locks would be cancelled without throwing away data pages,
382 resulting in inconsistent data (605627)
383 - inode attributes were not always being refreshed (605627, 612449)
384 - lconf now continues to cleanup after lctl reports an error
385 - MDS now enforces user permissions (602707)
386 - lprocfs cleanup fixed, but not yet enabled (614157)
387 - fixed infinite server hang, should a client not respond to an AST
388 - avoid going into recovery if user calls readlink() with a buffer
389 that's too small (613941)
390 - AST RPCs no longer require replies (614867) -- this may be changed
391 - don't crash server if client sends an IOV that's too big (611336)
392 - fixed lock conversion deadlock (611892)
393 - fixed the following of symlinks (614622)
394 * recovery: the server can remove locks from a client that dies, other
395 clients can make progress
396 * more extN patch fixes
397 * compile-time configurable ptlrpc buffer allocations
399 - collaborative read cache document
400 - Lustre Lite Performance CDR document-in-progress
402 2002-09-20 Andreas Dilger <adilger@clusterfs.com>
405 - fix typo in patch-2.4.18
407 2002-09-20 Andreas Dilger <adilger@clusterfs.com>
410 - clear ptlrpc request each time in handle_incoming_request()
411 - unlink of files now destroys the object on the OST
413 2002-09-19 Peter Braam <braam@clusterfs.com>
415 * add hard link support
416 * change obdfile creation method
417 * kernel patch changed
419 2002-09-19 Peter Braam <braam@clusterfs.com>
422 - stack overflow bug in extN fixed
424 2002-09-18 Andreas Dilger <adilger@clusterfs.com>
426 * documentation updates
427 - add man pages for config tools
428 - update tests/README to describe testing with new config tools
429 - finish metadata API descriptions
430 * bug fixes and cleanups
431 - statfs workaround for 16TB limit
432 - LOV stripe allocation improved, can stripe on subset of OSTs
433 - LOV file size/IO offset was wrong for files > 4GB in size
434 - object EA data was being dropped, caused files to be unreadable
435 - memory overflow with non-LOV OST caused memory corruption
436 - fixed regression tests to work with new config tools, obdfilter
437 - fixed bug when directory size became larger than 1 block
438 - fixed bug (for single client case) when PWD was deleted
439 - invalidate local directory pages when doing intent-based ops
440 - avoid LDLM oops when lock callback contained bad data
442 2002-09-09 Andreas Dilger <adilger@clusterfs.com>
444 * documentation updates
445 * bug fixes and cleanups
446 - configuration tools
449 - 64-bit compile warnings
450 - 64-bit internal statfs data
452 * test_brw on persistent OST devices
456 2002-09-04 Andreas Dilger <adilger@clusterfs.com>
458 * documentation updates
459 * bug fixes and cleanups
460 * configuration tools
462 2002-08-30 Peter J. Braam <braam@clusterfs.com>
465 * many small fixes to 0_5_4
466 * io/network handling
467 * thinkos in MDS operations
469 2002-08-24 Peter J. Braam <braam@clusterfs.com>
472 * crucial basic fixes to 0.5.3
473 * IOR, Iozone work over Elan
476 2002-08-07 Phil Schwan <phil@clusterfs.com>
477 * version 0_5_3, our first alpha
478 * we use the new Portals iovs
479 * documentation updates
480 * bug fixes and cleanups
481 * small changes in the DLM wire protocol
483 2002-07-25 Peter J. Braam <braam@clusterfs.com>
484 * version 0_5_1 with some initial stability,
485 * locking on MD and file I/O.
486 * documentation updates
487 * several bug fixes since 0.5.0
488 * small changes in wire protocol
490 2002-07-18 Phil Schwan <phil@clusterfs.com>
492 * delivered as Lustre Light Alpha
493 * fixed a crash after handling invalid MDS requests
494 * fixed directory pages for architectures with non-4k pages sizes
496 2002-07-11 Andreas Dilger <adilger@clusterfs.com>
497 * release version v0_4_4
498 * Moves TCP acceptor to be on port 2432 (unused Coda port) instead
500 * Fixes a number of interruption problems with OST operations.
501 * Update documentation for portals header changes
502 * Move all wire protocol structs/defines to lustre_idl.h
503 * Fixes symlink length bug.
504 * Add tcpdump to repository.
506 2002-07-05 Andreas Dilger <adilger@clusterfs.com>
507 * release version v0_4_3
508 * Fixes statfs for inodes on extN.
509 * Fixes bug in runtests which would delete /etc/hosts.
510 * Use 64-bit object IDs wherever possible (not into VFS though)
511 Remove ost_get_info, which is unused by lustre, and out of date.
513 2002-07-03 Peter Braam <braam@clusterfs.com>
514 * release version v0_4_2 Fixes a lookup error (type not passed)
515 * move forward to head of Portals
516 * move forward to latest Lustre kernel
518 2002-06-25 Peter Braam <braam@clusterfs.com>
519 * release version v0_4_1. Hopefully stable on single node use.