Messages in this thread | | | Date | Thu, 10 Oct 2002 09:21:55 -0400 (EDT) | From | Bill Davidsen <> | Subject | Re: LMbench results for 2.5.40 |
| |
On Tue, 8 Oct 2002, Larry McVoy wrote:
> On Tue, Oct 08, 2002 at 02:55:01PM -0400, Bill Davidsen wrote:
> > > FYI. I don't like it either. > > > > Thank you, that explains some things I've seen in my context switching > > benchmark as well, which uses a bunch of different services to transfer > > tiny data from on process to another. > > > > Time for some statistical jiggery-pokery, dust off deviant mean or some > > such. > > I personally think that you should try a scatter plot and you should > get something sort of like http://www.bitmover.com/disks/sek.gif which > is read latency times scatter plotted nicely showing the effect of seeks > and the effects of rotational delay. The height of the band is what I'd > expect to see in the context switch results - there should be an even > distribution between the min and the max assuming that you can vary the > pages which get allocated when you run the tests. > > The average is a misleading number, you really want a min/max style number. > I'd be quite interested if someone were to go off and do this.
Well, I have high and low, I currently report both avg and median values, and both average and "deviant mean average" compared to the noload case. The test is almost ready for public release, I just have to finish the docs. I know, if it was hard to write it should be hard to understand...
*deviant mean average - the average of all data points within one S.D. of the mean. Average of "the stuff in the middle of the performance range."
-- bill davidsen <davidsen@tmr.com> CTO, TMR Associates, Inc Doing interesting things with little computers since 1979.
- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
| |