Yesterday I moved my work machine from 2.1.55 to VGER-971103, and
thought I'd see if page colouring would help stabilize the somewhat
erratic Spec marks on the machine.
For those that are not familiar, Spec95 is primarily targeted at
measuring CPU and memory subsystem performance and require little in
the way of other system services. IMO, it is a perfect test of page
colouring, since little else is likely to have significant impact.
Further, between 126.gcc, 134.perl, and 145.fpppp provide a not-
unreasonable case for real-world work loads and access patterns.
It does quite well. With two exceptions, not only are the run times
more stable, they are fractionally faster -- INT95 is up 9%.
Attached is the raw elapsed time data for two runs. In the far right
column is the difference in seconds of the max and min run times; with
a sample size of three, that's just about as good as a real variance
and a lot easier to do in the head.
The two regressions, 102.swim and 125.turb3d, need attention though.
In the case of swim, runtime is 190% longer, and is the primary reason
why CFP95 isn't higher as well. Both are Fortran programs, so they
have no dynamic allocation,
text data bss dec hex filename
58644 4376 14749436 14812456 e20528 swim.base
86055 7128 25975236 26068419 18dc5c3 turb3d.base
just a stunningly large bss. I can provide more info on request.
r~
--azLHFNyN32YCQGCU
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename=spec-variance
Running '099.go'
Elapsed: 458, 514649, 00:07:38.514649
Elapsed: 548, 668946, 00:09:08.668946
Elapsed: 418, 467774, 00:06:58.467774 130
Running '101.tomcatv'
Elapsed: 367, 053711, 00:06:07.053711
Elapsed: 380, 952148, 00:06:20.952148
Elapsed: 397, 596679, 00:06:37.596679 30
Running '102.swim'
Elapsed: 679, 715821, 00:11:19.715821
Elapsed: 690, 150390, 00:11:30.150390
Elapsed: 666, 668946, 00:11:06.668946 24
Running '103.su2cor'
Elapsed: 273, 357422, 00:04:33.357422
Elapsed: 261, 674805, 00:04:21.674805
Elapsed: 267, 770508, 00:04:27.770508 12
Running '104.hydro2d'
Elapsed: 500, 902344, 00:08:20.902344
Elapsed: 498, 540039, 00:08:18.540039
Elapsed: 500, 572266, 00:08:20.572266 2
Running '107.mgrid'
Elapsed: 361, 242187, 00:06:01.242187
Elapsed: 362, 246094, 00:06:02.246094
Elapsed: 361, 763672, 00:06:01.763672 1
Running '110.applu'
Elapsed: 362, 689453, 00:06:02.689453
Elapsed: 362, 475586, 00:06:02.475586
Elapsed: 362, 375976, 00:06:02.375976 0
Running '124.m88ksim'
Elapsed: 280, 832031, 00:04:40.832031
Elapsed: 294, 063477, 00:04:54.063477
Elapsed: 253, 077149, 00:04:13.077149 41
Running '125.turb3d'
Elapsed: 404, 455078, 00:06:44.455078
Elapsed: 399, 850586, 00:06:39.850586
Elapsed: 403, 654296, 00:06:43.654296 5
Running '126.gcc'
Elapsed: 215, 438477, 00:03:35.438477
Elapsed: 214, 675781, 00:03:34.675781
Elapsed: 213, 585937, 00:03:33.585937 2
Running '129.compress'
Elapsed: 298, 198242, 00:04:58.198242
Elapsed: 311, 790039, 00:05:11.790039
Elapsed: 298, 859375, 00:04:58.859375 13
Running '130.li'
Elapsed: 287, 190430, 00:04:47.190430
Elapsed: 275, 754883, 00:04:35.754883
Elapsed: 321, 074219, 00:05:21.074219 46
Running '132.ijpeg'
Elapsed: 252, 522461, 00:04:12.522461
Elapsed: 253, 210938, 00:04:13.210938
Elapsed: 260, 089843, 00:04:20.089843 8
Running '134.perl'
Elapsed: 191, 949218, 00:03:11.949218
Elapsed: 188, 642578, 00:03:08.642578
Elapsed: 209, 879882, 00:03:29.879882 21
Running '141.apsi'
Elapsed: 214, 248047, 00:03:34.248047
Elapsed: 214, 047852, 00:03:34.047852
Elapsed: 218, 519531, 00:03:38.519531 4
Running '145.fpppp'
Elapsed: 792, 739258, 00:13:12.739258
Elapsed: 599, 729492, 00:09:59.729492
Elapsed: 578, 613282, 00:09:38.613282 214
Running '146.wave5'
Elapsed: 249, 443359, 00:04:09.443359
Elapsed: 235, 889648, 00:03:55.889648
Elapsed: 238, 479492, 00:03:58.479492 14
Running '147.vortex'
Elapsed: 395, 744141, 00:06:35.744141
Elapsed: 397, 937500, 00:06:37.937500
Elapsed: 461, 291993, 00:07:41.291993 66
Running '099.go'
Elapsed: 409, 634483, 00:06:49.634483
Elapsed: 420, 249252, 00:07:00.249252
Elapsed: 415, 667064, 00:06:55.667064 1
Running '101.tomcatv'
Elapsed: 353, 506436, 00:05:53.506436
Elapsed: 352, 023704, 00:05:52.023704
Elapsed: 351, 739270, 00:05:51.739270 2
Running '102.swim'
Elapsed: 2188, 994319, 00:36:28.994319
Elapsed: 2002, 654012, 00:33:22.654012
Elapsed: 2166, 563289, 00:36:06.563289 186
Running '103.su2cor'
Elapsed: 238, 189741, 00:03:58.189741
Elapsed: 237, 733026, 00:03:57.733026
Elapsed: 232, 574491, 00:03:52.574491 6
Running '104.hydro2d'
Elapsed: 502, 238702, 00:08:22.238702
Elapsed: 502, 406758, 00:08:22.406758
Elapsed: 501, 211684, 00:08:21.211684 1
Running '107.mgrid'
Elapsed: 351, 042474, 00:05:51.042474
Elapsed: 350, 909232, 00:05:50.909232
Elapsed: 351, 327750, 00:05:51.327750 1
Running '110.applu'
Elapsed: 361, 300754, 00:06:01.300754
Elapsed: 360, 968646, 00:06:00.968646
Elapsed: 360, 993312, 00:06:00.993312 1
Running '124.m88ksim'
Elapsed: 230, 148949, 00:03:50.148949
Elapsed: 228, 383692, 00:03:48.383692
Elapsed: 232, 544490, 00:03:52.544490 4
Running '125.turb3d'
Elapsed: 489, 510728, 00:08:09.510728
Elapsed: 490, 729052, 00:08:10.729052
Elapsed: 489, 865248, 00:08:09.865248 1
Running '126.gcc'
Elapsed: 210, 238235, 00:03:30.238235
Elapsed: 207, 945590, 00:03:27.945590
Elapsed: 207, 460586, 00:03:27.460586 3
Running '129.compress'
Elapsed: 243, 493453, 00:04:03.493453
Elapsed: 242, 772785, 00:04:02.772785
Elapsed: 242, 991173, 00:04:02.991173 1
Running '130.li'
Elapsed: 247, 718449, 00:04:07.718449
Elapsed: 251, 359999, 00:04:11.359999
Elapsed: 244, 328245, 00:04:04.328245 7
Running '132.ijpeg'
Elapsed: 249, 538216, 00:04:09.538216
Elapsed: 248, 905266, 00:04:08.905266
Elapsed: 248, 992701, 00:04:08.992701 1
Running '134.perl'
Elapsed: 176, 789469, 00:02:56.789469
Elapsed: 207, 578329, 00:03:27.578329
Elapsed: 180, 079996, 00:03:00.079996 31
Running '141.apsi'
Elapsed: 200, 007399, 00:03:20.007399
Elapsed: 200, 976034, 00:03:20.976034
Elapsed: 196, 125355, 00:03:16.125355 4
Running '145.fpppp'
Elapsed: 489, 650517, 00:08:09.650517
Elapsed: 479, 282022, 00:07:59.282022
Elapsed: 524, 945865, 00:08:44.945865 45
Running '146.wave5'
Elapsed: 240, 264690, 00:04:00.264690
Elapsed: 231, 229835, 00:03:51.229835
Elapsed: 234, 608789, 00:03:54.608789 9
Running '147.vortex'
Elapsed: 425, 381359, 00:07:05.381359
Elapsed: 405, 128235, 00:06:45.128235
Elapsed: 455, 710362, 00:07:35.710362 50
9% improvement in Spec INT95
8% degradation in Spec FP95
--azLHFNyN32YCQGCU--