Re: Found the commit that causes the OOMs
From: David Woodhouse
Date: Mon Jun 29 2009 - 11:57:26 EST
On Mon, 2009-06-29 at 16:54 +0100, David Howells wrote:
> Wu Fengguang <fengguang.wu@xxxxxxxxx> wrote:
>
> > Yes this time the OOM order/flags are much different from all previous OOMs.
> >
> > btw, I found that msgctl11 is pretty good at making a lot of SUnreclaim and
> > PageTables pages:
>
> I got David Woodhouse to run this on one of this boxes, but he doesn't see the
> problem, I think because he's got 4GB of RAM, and never comes close to running
> out.
>
> I've asked him to reboot with mem=1G to see if that helps reproduce it.
msgctl11 invoked oom-killer: gfp_mask=0xd0, order=1, oom_adj=0
Pid: 5795, comm: msgctl11 Not tainted 2.6.31-rc1 #147
Call Trace:
[<ffffffff81092c77>] oom_kill_process.clone.0+0xac/0x254
[<ffffffff81092b5c>] ? badness+0x24d/0x2bc
[<ffffffff81092f5f>] __out_of_memory+0x140/0x157
[<ffffffff8109308f>] out_of_memory+0x119/0x150
[<ffffffff81095c65>] ? drain_local_pages+0x16/0x18
[<ffffffff810967ab>] __alloc_pages_nodemask+0x45a/0x55b
[<ffffffff810a32b0>] ? __inc_zone_page_state+0x2e/0x30
[<ffffffff810bb6b9>] alloc_pages_current+0xae/0xb6
[<ffffffff810a604a>] ? do_wp_page+0x621/0x6c3
[<ffffffff81094d7e>] __get_free_pages+0xe/0x4b
[<ffffffff810403a7>] copy_process+0xab/0x11a5
[<ffffffff810327c8>] ? check_preempt_wakeup+0x11a/0x142
[<ffffffff810a7a06>] ? handle_mm_fault+0x678/0x6e9
[<ffffffff810415ec>] do_fork+0x14b/0x338
[<ffffffff8105b50a>] ? up_read+0xe/0x10
[<ffffffff814ee655>] ? do_page_fault+0x2da/0x307
[<ffffffff8100a55c>] sys_clone+0x28/0x2a
[<ffffffff8100bfc3>] stub_clone+0x13/0x20
[<ffffffff8100bcdb>] ? system_call_fastpath+0x16/0x1b
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
CPU 4: hi: 0, btch: 1 usd: 0
CPU 5: hi: 0, btch: 1 usd: 0
CPU 6: hi: 0, btch: 1 usd: 0
CPU 7: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 0
CPU 1: hi: 186, btch: 31 usd: 20
CPU 2: hi: 186, btch: 31 usd: 19
CPU 3: hi: 186, btch: 31 usd: 20
CPU 4: hi: 186, btch: 31 usd: 19
CPU 5: hi: 186, btch: 31 usd: 24
CPU 6: hi: 186, btch: 31 usd: 41
CPU 7: hi: 186, btch: 31 usd: 25
Active_anon:72835 active_file:89 inactive_anon:575
inactive_file:103 unevictable:0 dirty:36 writeback:0 unstable:0
free:2467 slab:38211 mapped:229 pagetables:66918 bounce:0
Node 0 DMA free:4036kB min:60kB low:72kB high:88kB active_anon:3228kB inactive_a
non:256kB active_file:0kB inactive_file:0kB unevictable:0kB present:15356kB page
s_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 994 994 994
Node 0 DMA32 free:5832kB min:4000kB low:5000kB high:6000kB active_anon:288112kB
inactive_anon:2044kB active_file:356kB inactive_file:412kB unevictable:0kB prese
nt:1018080kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 1*4kB 2*8kB 1*16kB 0*32kB 1*64kB 2*128kB 0*256kB 1*512kB 1*1024kB 1*
2048kB 0*4096kB = 3940kB
Node 0 DMA32: 852*4kB 1*8kB 0*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024k
B 0*2048kB 0*4096kB = 5304kB
437 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
262144 pages RAM
6503 pages reserved
205864 pages shared
226536 pages non-shared
Out of memory: kill process 3855 (msgctl11) score 179248 or a child
Killed process 4222 (msgctl11)
--
David Woodhouse Open Source Technology Centre
David.Woodhouse@xxxxxxxxx Intel Corporation
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/