![]() | ||||||||||
Messages in this thread |
On 5/19/07, Michael Gerdau <mgd@technosis.de> wrote: > > > I don't want to say the values aren't useful. I simply think there is > > > a high noiselevel. > > > > The noise is reflected in the standard deviation he has on those rows. > > The average +- stdev of one overlaps the average +- stdev of the > > other, > > For the fairness test on cfs13 this simply is wrong. Ah, you are correct. I was looking at the glxgears test and mostly ignoring the fairness one as I'm not sure what the test is doing. As the deviations seem erratic, the fairness test looks like it needs more passes to converge, but that's just a guess. I honestly don't know what's going on with that one. > And for the > test to be stable would require that avg of one is within avg+-stddev > of the other (simple overlap does not suffice). Er, I think you took a different statistics class than I did :-). In general, the 'true' value we're trying to find/measure has a certain percentage chance of lying within the average +- n*deviation, with the percentage going up as n increases, right? (68% for n=1, 95% for n=2, etc.) Both distributions have that property, and so to consider one of the averages as the 'true' value and the other a mere distribution that has to overlap it is... somewhat inaccurate. In general, if they both overlap within one standard deviation of each other, you can say that the data has pretty good agreement with itself. Which for the glxgears case, it does. The fairness test isn't so cut and dried, but it's not horrifically out of whack, either. So I'll reserve judgment on that one :-). - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ | |||||||||
| Last update: 2007-05-20 07:23 [from the cache] ©2003-2008 | ||||||||||