RE: Extermeley large PageTables over 500G on kernel 2.6.32.49(SLES11 SP1)

From: Borzenkov, Andrey
Date: Wed Jan 11 2012 - 06:23:40 EST


> -----Original Message-----
> From: Eric Dumazet [mailto:eric.dumazet@xxxxxxxxx]
> Sent: Wednesday, January 11, 2012 3:20 PM
> To: Borzenkov, Andrey
> Cc: linux-kernel@xxxxxxxxxxxxxxx
> Subject: RE: Extermeley large PageTables over 500G on kernel 2.6.32.49
> (SLES11 SP1)
>
> Le mercredi 11 janvier 2012 Ã 11:52 +0100, Borzenkov, Andrey a Ãcrit :
>
> > Colleagues responsible for Oracle are reconfiguring it now.
> >
>
> OK. Since your hardware supports 1GB hugepages, you might try to use
> them as well. Not sure if your kernel is recent enough...
>
> cat /proc/cmdline
> ro root=LABEL=/ hugepagesz=1GB hugepages=512
>

It says 2M so it probably is the limit.

> > > If not, its normal to eat so much memory for page tables
> > >
> > > grep VmPTE /proc/*/status
> > >
> > >
> >
> > Forgive my ignorance. I thought that
> >
> > 1. PTE is 8 bytes per page, which is 4K which gives 2K per 1M of memory
> > 2. All processes sharing the same shared memory share the same page
> table
>
> It depends how oracle maps its SGA.
>
> It probably uses a method disallowing page table sharing.

Do you have any reference to description of these methods so we can check?

Thank you!

>
> Anyway, hugetables for this kind of workload is a must.
>


¢éì®&Þ~º&¶¬–+-±éÝ¥Šw®žË±Êâmébžìdz¹Þ)í…æèw*jg¬±¨¶‰šŽŠÝj/êäz¹ÞŠà2ŠÞ¨è­Ú&¢)ß«a¶Úþø®G«éh®æj:+v‰¨Šwè†Ù>Wš±êÞiÛaxPjØm¶Ÿÿà -»+ƒùdš_