Re: LMbench results for 2.5.40

From: Bill Davidsen (davidsen@tmr.com)
Date: Thu Oct 10 2002 - 08:21:55 EST


On Tue, 8 Oct 2002, Larry McVoy wrote:

> On Tue, Oct 08, 2002 at 02:55:01PM -0400, Bill Davidsen wrote:

> > > FYI. I don't like it either.
> >
> > Thank you, that explains some things I've seen in my context switching
> > benchmark as well, which uses a bunch of different services to transfer
> > tiny data from on process to another.
> >
> > Time for some statistical jiggery-pokery, dust off deviant mean or some
> > such.
>
> I personally think that you should try a scatter plot and you should
> get something sort of like http://www.bitmover.com/disks/sek.gif which
> is read latency times scatter plotted nicely showing the effect of seeks
> and the effects of rotational delay. The height of the band is what I'd
> expect to see in the context switch results - there should be an even
> distribution between the min and the max assuming that you can vary the
> pages which get allocated when you run the tests.
>
> The average is a misleading number, you really want a min/max style number.
> I'd be quite interested if someone were to go off and do this.

Well, I have high and low, I currently report both avg and median values,
and both average and "deviant mean average" compared to the noload case.
The test is almost ready for public release, I just have to finish the
docs. I know, if it was hard to write it should be hard to understand...

*deviant mean average - the average of all data points within one S.D. of
the mean. Average of "the stuff in the middle of the performance range."

-- 
bill davidsen <davidsen@tmr.com>
  CTO, TMR Associates, Inc
Doing interesting things with little computers since 1979.

- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Tue Oct 15 2002 - 22:00:37 EST