Re: [BENCHMARK] Corrected gcc3.2 v gcc2.95.3 contest results

From: Con Kolivas (
Date: Mon Sep 23 2002 - 16:47:45 EST

Quoting Oliver Xymoron <>:

> On Tue, Sep 24, 2002 at 12:24:49AM +1000, Con Kolivas wrote:
> >
> > That is the system I was considering. I just need to run enough
> > benchmarks to make this worthwhile though. That means about 5 for
> > each it seems - which may take me a while. A basic mean will suffice
> > for a measure of central tendency. I also need to quote some measure
> > of variability. Standard deviation?
> No, standard deviation is inappropriate here. We have no reason to
> expect the distribution of problem cases to be normal or even smooth.
> What we'd really like is range and mean. Don't throw out the outliers
> either, the pathological cases are of critical interest.

Yes. Definitely the outliers appear to make the difference to the results. The
mean and range appear to be the most important on examining this data. The only
purpose to quoting other figures would be for inferential statistics to
determine if there is a statistically significant difference to the groups. My
overnight benchmarking has generated a few results and I will publish something


To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to
More majordomo info at
Please read the FAQ at

This archive was generated by hypermail 2b29 : Mon Sep 23 2002 - 22:00:40 EST