[lkml]   [2005]   [Apr]   [3]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    Patch in this message
    SubjectRe: OOM problems on 2.6.12-rc1 with many fsx tests
    Mingming Cao <> wrote:
    > I run into OOM problem again on 2.6.12-rc1. I run some(20) fsx tests on
    > 2.6.12-rc1 kernel(and 2.6.11-mm4) on ext3 filesystem, after about 10
    > hours the system hit OOM, and OOM keep killing processes one by one. I
    > could reproduce this problem very constantly on a 2 way PIII 700MHZ with
    > 512MB RAM. Also the problem could be reproduced on running the same test
    > on reiser fs.
    > The fsx command is:
    > ./fsx -c 10 -n -r 4096 -w 4096 /mnt/test/foo1 &

    This ext3 bug goes all the way back to 2.6.6.

    I don't know yet why you saw problems with reiser3 and I'm pretty sure I
    saw problems with ext2. More testing is needed there.

    Without the below patch it's possible to make ext3 leak at around a
    megabyte per minute by arranging for the fs to run a commit every 50
    milliseconds, btw.

    (Stephen, please review...)

    This fixes the lots-of-fsx-linux-instances-cause-a-slow-leak bug.

    It's been there since 2.6.6, caused by:

    That patch moves under-writeout ordered-data buffers onto a separate journal
    list during commit. It took out the old code which was based on a single

    The old code (necessarily) had logic which would restart I/O against buffers
    which had been redirtied while they were on the committing transaction's
    t_sync_datalist list. The new code only writes buffers once, ignoring
    redirtyings by a later transaction, which is good.

    But over on the truncate side of things, in journal_unmap_buffer(), we're
    treating buffers on the t_locked_list as inviolable things which belong to the
    committing transaction, and we just leave them alone during concurrent

    The net effect is that when truncate tries to invalidate a page whose buffers
    are on t_locked_list and have been redirtied, journal_unmap_buffer() just
    leaves those buffers alone. truncate will remove the page from its mapping
    and we end up with an anonymous clean page with dirty buffers, which is an
    illegal state for a page. The JBD commit will not clean those buffers as they
    are removed from t_locked_list. The VM (try_to_free_buffers) cannot reclaim
    these pages.

    The patch teaches journal_unmap_buffer() about buffers which are on the
    committing transaction's t_locked_list. These buffers have been written and
    I/O has completed. We can take them off the transaction and undirty them
    within the context of journal_invalidatepage()->journal_unmap_buffer().

    Signed-off-by: Andrew Morton <>

    25-akpm/fs/jbd/transaction.c | 13 +++++++++++--
    1 files changed, 11 insertions(+), 2 deletions(-)

    diff -puN fs/jbd/transaction.c~jbd-dirty-buffer-leak-fix fs/jbd/transaction.c
    --- 25/fs/jbd/transaction.c~jbd-dirty-buffer-leak-fix 2005-04-03 15:12:12.000000000 -0700
    +++ 25-akpm/fs/jbd/transaction.c 2005-04-03 15:14:40.000000000 -0700
    @@ -1812,7 +1812,17 @@ static int journal_unmap_buffer(journal_
    } else if (transaction == journal->j_committing_transaction) {
    - /* If it is committing, we simply cannot touch it. We
    + if (jh->b_jlist == BJ_Locked) {
    + /*
    + * The buffer is on the committing transaction's locked
    + * list. We have the buffer locked, so I/O has
    + * completed. So we can nail the buffer now.
    + */
    + may_free = __dispose_buffer(jh, transaction);
    + goto zap_buffer;
    + }
    + /*
    + * If it is committing, we simply cannot touch it. We
    * can remove it's next_transaction pointer from the
    * running transaction if that is set, but nothing
    * else. */
    @@ -1887,7 +1897,6 @@ int journal_invalidatepage(journal_t *jo
    unsigned int next_off = curr_off + bh->b_size;
    next = bh->b_this_page;

    - /* AKPM: doing lock_buffer here may be overly paranoid */
    if (offset <= curr_off) {
    /* This block is wholly outside the truncation point */
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to
    More majordomo info at
    Please read the FAQ at

     \ /
      Last update: 2005-04-06 13:31    [W:0.025 / U:4.316 seconds]
    ©2003-2017 Jasper Spaans. hosted at Digital OceanAdvertise on this site