This message generated a parse failure. Raw output follows here. Please use 'back' to navigate. From devnull@lkml.org Fri Apr 19 23:51:05 2024 Received: from spaans.ds9a.nl (adsl-xs4all.ds9a.nl [213.84.159.51]) by kylie.puddingonline.com (8.11.6/8.11.6) with SMTP id g8IEd6X02476 for ; Wed, 18 Sep 2002 16:39:07 +0200 Received: (qmail 29781 invoked from network); 18 Sep 2002 06:53:05 -0000 Received: from unknown (HELO spaans.ds9a.nl) (3ffe:8280:10:360:202:44ff:fe2a:a1dd) by mayo.ipv6.ds9a.nl with SMTP; 18 Sep 2002 06:53:05 -0000 Received: (qmail 6830 invoked by uid 1000); 17 Sep 2002 20:28:00 -0000 Received: (maildatabase); juh Received: (qmail 28959 invoked by alias); 16 Sep 2001 18:37:21 -0000 Received: (qmail 28956 invoked from network); 16 Sep 2001 18:37:20 -0000 Received: from vvtp.tn.tudelft.nl (HELO vvtp.nl) (qmailr@130.161.252.29) by spaans-smp.ds9a.tudelft.nl with SMTP; 16 Sep 2001 18:37:20 -0000 Received: (qmail 29518 invoked by uid 2547); 16 Sep 2001 18:36:05 -0000 Received: (qmail 29433 invoked from network); 16 Sep 2001 18:36:04 -0000 Received: from vger.kernel.org (199.183.24.194) by vvtp.tn.tudelft.nl with SMTP; 16 Sep 2001 18:36:04 -0000 Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id ; Sun, 16 Sep 2001 14:34:28 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id ; Sun, 16 Sep 2001 14:34:19 -0400 Received: from penguin.e-mind.com ([195.223.140.120]:25360 "EHLO penguin.e-mind.com") by vger.kernel.org with ESMTP id convert rfc822-to-8bit; Sun, 16 Sep 2001 14:34:08 -0400 Received: from black.random ([195.223.140.107]) by penguin.e-mind.com (8.9.1a/8.9.1/Debian/GNU) with ESMTP id UAA21217; Sun, 16 Sep 2001 20:41:59 +0200 Received: from athlon.random (athlon.random [192.168.1.7]) by black.random (8.11.0/8.10.2/SuSE Linux 8.10.0-0.3) with ESMTP id f8GIZ6R17176; Sun, 16 Sep 2001 20:35:06 +0200 Received: (from andrea@localhost) by athlon.random (8.11.2/8.10.2/SuSE Linux 8.10.0-0.3) id f8GIYEh04682; Sun, 16 Sep 2001 20:34:14 +0200 Date: Sun, 16 Sep 2001 20:34:14 +0200 From: Andrea Arcangeli To: Tonu Samuel Cc: Linus Torvalds , linux-kernel@vger.kernel.org Subject: vm rewrite ready [Re: broken VM in 2.4.10-pre9] Message-Id: <20010916203414.B1315@athlon.random> References: <9o1dev$23l$1@penguin.transmeta.com> <1000722338.14005.0.camel@x153.internalnet> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: 8BIT In-Reply-To: <1000722338.14005.0.camel@x153.internalnet>; from tonu@please.do.not.remove.this.spam.ee on Mon, Sep 17, 2001 at 06:25:38PM +0800 X-GnuPG-Key-URL: http://e-mind.com/~andrea/aa.gnupg.asc X-PGP-Key-URL: http://e-mind.com/~andrea/aa.asc Content-Transfer-Encoding: quoted-printable Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org X-AntiVirus: scanned for viruses by AMaViS 0.2.1 (http://amavis.org/) X-AntiVirus: scanned for viruses by AMaViS 0.2.1 (http://amavis.org/) On Mon, Sep 17, 2001 at 06:25:38PM +0800, Tonu Samuel wrote: > On 16 Sep 2001 05:31:11 +0000, Linus Torvalds wrote: > > > Also note that the amount of "swap used" is totally meaningless in > > 2.4.x. The 2.4.x kernel will _allocate_ the swap backing store much > > earlier than 2.2.x, but that doesn't actuall ymean that it does any of > > the IO. Indeed, allocating the swap backing store just means that the > > swap pages are then kept track of, so that they can be aged along with > > other stores. > > Problem still exists and persists. Not long time ago man from Yahoo > described well case when change from 2.2.19 to 2.4.x caused performance > problems. On 2.2.19 everything ran fine. They have MySQL running+did After a few days of developement I think I'm ready to release the VM rewrite I did. The alternate vm will be included in 2.4.10pre9aa1 (or anwways the very next -aa release) and I'll maintain it in the -aa tree. It is supposed to provide: 1) stable kswapd, avoid the kswapd 100% load of the cpu problem (this is provided by the classzone design, btw I improved the implementation a little bit compared to the 2.3/2.4.0-test patches, now I try to do things as lazily as possible without the bookkeeping in the pagealloc/pagefreeing) 2) optimal performance, avoid slowdowns after multiple runs of workloads and avoid swapout storms (for databases not using O_DIRECT) 3) you will get swap+ram of available virtual memory At the moment it's of course still a bit experimental and subject to changes but I'm writing this email on top of it and it's perfectly usable. This isn't an hack/band-aid or a small set of changes, it's a complete rewrite from scratch of the whole memory balancing including garbage collections lru lists, kswapd etc... (only the swap_out() path is almost unchanged) The only benchmark I did so far is been `dbench`. Without the vm patch applied dbench says: andrea@laser:/mnt > dbench 40 40 clients started ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................+..........................................................................................................................+..................+.....................................+...........................................................................................+...........................................+..+.......................................++............................................+................+............+..................++++++++++++++++++++++++++++**************************************** Throughput 9.40112 MB/sec (NB.7514 MB/sec 94.0112 MBit/sec) andrea@laser:/mnt > dbench 40 40 clients started .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................+.....................................+...................................................+...............................................................................+...+...............................................................................+.........................+.....................................+...............+................................................................................+.++++++++++++++++++++++++++++++**************************************** Throughput 9.56469 MB/sec (NB.9559 MB/sec 95.6469 MBit/sec) andrea@laser:/mnt > After I apply my vm patch dbench constantly says: andrea@laser:/mnt > for i in 1 2 3 4 ; do dbench 40; done 40 clients started .......................................................................................................................................................................................................................................................................................................++.+..+...+...............................+..+..............................................................................................................................................................+.........................+.................................................................................+..........................................+.......................................................................................+...............+.+..+..........................................................................................................+.................+.................+.......................+...........................+..........................+...................................+....+.+.+........................................+................................+.+...................................................................................................................................+........................................................................+...........................+................................................................+.......................+...........................+.............................................................++++++**************************************** Throughput 20.353 MB/sec (NB%.4412 MB/sec 203.53 MBit/sec) 40 clients started ................................................................................................................+.................................................+..............+............................................+.....................................................................................................................................................+........................................+....+................+.+..........................................++.......................................+...............................+...................................................+............................................................................+.........+.....................................................................+..............................................................................................................................................................................+............+................................+..............................................................+...............+.......................................................+...+++...................................+.................................+............+..............................+...................................................++...................................................+...............................................................................................................+.......+...+....................................+......+...+...+**************************************** Throughput 20.9269 MB/sec (NB&.1586 MB/sec 209.269 MBit/sec) 40 clients started ..........................................................................................................................................+.............................+..........+..............................................................................+............+...............................................+...................................................................+.......................+.........................................................................................................................++......+.........................................................................+.........+....+.......+...................................................+....+.............................................+....................................................+..........................................................+................+.......................................................................................................................................................+.........+...............................................................+........................+.........................................................................+.....................................................................................................................................................................+.......+..+..........................+............................+................+................+.....+......+..........+...............+........+.....+.+**************************************** Throughput 21.0787 MB/sec (NB&.3483 MB/sec 210.787 MBit/sec) 40 clients started .................................................................................................................................................................+......................+.+...................................+.......................................+...............................+........................................................................................+.........................................................+................................+...................................................................................................................++................+.................................+........................+........................+....................+.......................++..........................................................+......+.........................................+......................................................+...............................+...............................................................................+...................................................+......................................................................................................................................................................................................+.....................+......+...............................+................................................+..........................................+.......+......................................+..............................+...+.+.+............+.++**************************************** Throughput 21.6167 MB/sec (NB'.0208 MB/sec 216.167 MBit/sec) andrea@laser:/mnt > Andrea - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/