Re: Performance of low-cpu utilisation benchmark regressed severely since 4.6

From: Mel Gorman
Date: Tue Apr 11 2017 - 12:42:22 EST


On Tue, Apr 11, 2017 at 08:41:09AM -0700, Doug Smythies wrote:
> On 2017.04.11 03:03 Mel Gorman wrote:
> >On Mon, Apr 10, 2017 at 10:51:38PM +0200, Rafael J. Wysocki wrote:
> >> On Mon, Apr 10, 2017 at 10:41 AM, Mel Gorman wrote:
> >>>
> >>> It's far more obvious when looking at the git test suite and the length
> >>> of time it takes to run. This is a shellscript and git intensive workload
> >>> whose CPU utilisatiion is very low but is less sensitive to multiple
> >>> factors than netperf and sockperf.
> >>
>
> I would like to repeat your tests on my test computer (i7-2600K).
> I am not familiar with, and have not been able to find,
> "the git test suite" shellscript. Could you point me to it?
>

If you want to use git source directly do a checkout from
https://github.com/git/git and build it. The core "benchmark" is make
test and timing it.

The way I'm doing it is via mmtests so

git clone https://github.com/gormanm/mmtests
cd mmtests
./run-mmtests --no-monitor --config configs/config-global-dhp__workload_shellscripts test-run-1
cd work/log
../../compare-kernels.sh | less

and it'll generate a similar report to what I posted in this email
thread. If you do multiple tests with different kernels then change the
name of "test-run-1" to preserve the old data. compare-kernel.sh will
compare whatever results you have.

Thanks for taking a look.

--
Mel Gorman
SUSE Labs