Re: [PATCH v6 0/7] tlb flush optimization on x86

From: Alex Shi
Date: Thu May 17 2012 - 04:51:29 EST


Added a little more info.
the machine is 2P * 4core* HT NHM EP with 12GB memory, and THP set 'always'.

>

> Here is the macro benchmark to measure munmap change:
>
> tlb_flushall_shift = -1
> [alexs@lkp-ne04 tlb]$
> [alexs@lkp-ne04 tlb]$ for t in `echo 4 8 16 `; do echo "=============== t = $t ===================="; for i in `echo 8 16 32 `; do sudo ./munmap -t $t -n $i; done done
> =============== t = 4 ====================
> munmap use 164ms 5032ns/time, memory access uses 81605 times/thread/ms, cost 12ns/time
> munmap use 86ms 5251ns/time, memory access uses 83378 times/thread/ms, cost 11ns/time
> munmap use 46ms 5642ns/time, memory access uses 87212 times/thread/ms, cost 11ns/time
> =============== t = 8 ====================
> munmap use 197ms 6036ns/time, memory access uses 69295 times/thread/ms, cost 14ns/time
> munmap use 96ms 5896ns/time, memory access uses 71895 times/thread/ms, cost 13ns/time
> munmap use 62ms 7608ns/time, memory access uses 83895 times/thread/ms, cost 11ns/time
> =============== t = 16 ====================
> munmap use 274ms 8367ns/time, memory access uses 37860 times/thread/ms, cost 26ns/time
> munmap use 139ms 8543ns/time, memory access uses 38137 times/thread/ms, cost 26ns/time
> munmap use 74ms 9033ns/time, memory access uses 38349 times/thread/ms, cost 26ns/time
> [alexs@lkp-ne04 tlb]$
> [alexs@lkp-ne04 tlb]$
> tlb_flushall_shift = 5
> [alexs@lkp-ne04 tlb]$ for t in `echo 4 8 16 `; do echo "=============== t = $t ===================="; for i in `echo 8 16 32 `; do sudo ./munmap -t $t -n $i; done done
> =============== t = 4 ====================
> munmap use 212ms 6485ns/time, memory access uses 114003 times/thread/ms, cost 8ns/time
> munmap use 130ms 7972ns/time, memory access uses 110725 times/thread/ms, cost 9ns/time
> munmap use 45ms 5581ns/time, memory access uses 87866 times/thread/ms, cost 11ns/time
> =============== t = 8 ====================
> munmap use 253ms 7734ns/time, memory access uses 94578 times/thread/ms, cost 10ns/time
> munmap use 147ms 9012ns/time, memory access uses 83851 times/thread/ms, cost 11ns/time
> munmap use 63ms 7713ns/time, memory access uses 87473 times/thread/ms, cost 11ns/time
> =============== t = 16 ====================
> munmap use 369ms 11284ns/time, memory access uses 38854 times/thread/ms, cost 25ns/time
> munmap use 264ms 16131ns/time, memory access uses 37870 times/thread/ms, cost 26ns/time
> munmap use 73ms 8981ns/time, memory access uses 38309 times/thread/ms, cost 26ns/time


--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/