Re: kernel oops on mmotm-2015-10-15-15-20

From: Minchan Kim
Date: Wed Oct 21 2015 - 20:07:01 EST

Next message: Minchan Kim: "Re: [PATCH -next] mm: Fix build on non-MMU systems"
Previous message: Frank Rowand: "Re: Alternative approach to solve the deferred probe"
In reply to: Kirill A. Shutemov: "Re: kernel oops on mmotm-2015-10-15-15-20"
Next in thread: Hugh Dickins: "Re: kernel oops on mmotm-2015-10-15-15-20"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

On Wed, Oct 21, 2015 at 02:07:23PM +0300, Kirill A. Shutemov wrote:
> On Wed, Oct 21, 2015 at 02:28:36PM +0900, Minchan Kim wrote:
> > I detach this report from my patchset thread because I see below
> > problem with removing MADV_FREE related code and I can reproduce
> > same oops with MADV_FREE + recent patches(both my SetPageDirty
> > and Kirill's pte_mkdirty) within 7 hours.
>
> Could you share code for your workload?

It's part of test suite so I need time to factor it out.
I will do/test and send it.

>
> > I can not be sure it's THP refcount redesign's problem but it was
> > one of big change in MM between mmotm-2015-10-15-15-20 and
> > mmotm-2015-10-06-16-30 so it could be a culprit.
> >
> > In page_lock_anon_vma_read, anon_vma_root was NULL.
> > I added VM_BUG_ON_PAGE(!root_anon_vma, page) in there and got the result.
>
> Hm. That's tricky.. :-/
>
> Could you please dump anon_vma->refcount too?

I added the code to check it and queued it again but I had another oops
in this time but symptom is related to anon_vma, too.
(kernel is based on recent mmotm + unconditional mkdirty for bug fix)
It seems page_get_anon_vma returns NULL since the page was not page_mapped
at that time but second check of page_mapped right before try_to_unmap seems
to be true.

Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
page:ffffea0001cfbfc0 count:3 mapcount:1 mapping:ffff88007f1b5f51 index:0x600000aff
flags: 0x4000000000048019(locked|uptodate|dirty|swapcache|swapbacked)
page dumped because: VM_BUG_ON_PAGE(PageAnon(page) && !PageKsm(page) && !anon_vma)
page->mem_cgroup:ffff88007f3dcc00
------------[ cut here ]------------
kernel BUG at mm/migrate.c:889!
invalid opcode: 0000 [#1] SMP
Dumping ftrace buffer:
(ftrace buffer empty)
Modules linked in:
CPU: 11 PID: 59 Comm: khugepaged Not tainted 4.3.0-rc6-next-20151021-THP-ref-madv_free+ #1557
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
task: ffff8800b9851a40 ti: ffff8800b985c000 task.ti: ffff8800b985c000
RIP: 0010:[<ffffffff81145c06>] [<ffffffff81145c06>] migrate_pages+0x8e6/0x950
RSP: 0018:ffff8800b985fa00 EFLAGS: 00010286
RAX: 0000000000000021 RBX: ffffea0002dd7fc0 RCX: ffffffff81830db8
RDX: 0000000000000001 RSI: 0000000000000246 RDI: ffffffff821df4d8
RBP: ffff8800b985fa80 R08: 0000000000000000 R09: ffff8800000bb160
R10: ffffffff8163e000 R11: 00000000000001e0 R12: 0000000000000000
R13: ffffea0001cfbf80 R14: ffffea0001cfbfc0 R15: ffffffff8189de80
FS: 0000000000000000(0000) GS:ffff8800bfb60000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00005594f9d7e578 CR3: 0000000001808000 CR4: 00000000000006a0
Stack:
ffff8800b9851a40 0000000000000000 0000000000000000 0000000000000000
ffffffff811144b0 0000000000000000 ffffffff81115fb0 ffffea0001cfbfe0
ffff8800b985fb30 ffff8800b985fb20 0000000000000000 ffff8800b985fb20
Call Trace:
[<ffffffff811144b0>] ? trace_raw_output_mm_compaction_defer_template+0xc0/0xc0
[<ffffffff81115fb0>] ? isolate_freepages_block+0x3d0/0x3d0
[<ffffffff8111696b>] compact_zone+0x2bb/0x720
[<ffffffff8142888d>] ? retint_kernel+0x10/0x10
[<ffffffff81286b7d>] ? list_del+0xd/0x30
[<ffffffff81116e3d>] compact_zone_order+0x6d/0xa0
[<ffffffff8111708d>] try_to_compact_pages+0xed/0x200
[<ffffffff81155243>] __alloc_pages_direct_compact+0x3b/0xd4
[<ffffffff810f8f5b>] __alloc_pages_nodemask+0x3fb/0x920
[<ffffffff81147b88>] khugepaged+0x158/0x1b90
[<ffffffff81068e01>] ? hrtick_update+0x51/0x70
[<ffffffff810744e0>] ? prepare_to_wait_event+0xf0/0xf0
[<ffffffff81147a30>] ? unfreeze_page+0x320/0x320
[<ffffffff81058929>] kthread+0xc9/0xe0
[<ffffffff81058860>] ? kthread_park+0x60/0x60
[<ffffffff814280ef>] ret_from_fork+0x3f/0x70
[<ffffffff81058860>] ? kthread_park+0x60/0x60
Code: 44 c6 48 8b 40 08 83 e0 03 48 83 f8 03 0f 84 fd fa ff ff 4d 85 e4 0f 85 f4 fa ff ff 48 c7 c6 58 e9 77 81 4c 89 f7 e8 fa 2a fd ff <0f> 0b 48 83 e8 01 e9 d0 fa ff ff f6 40 07 01 0f 84 5b fd ff ff
RIP [<ffffffff81145c06>] migrate_pages+0x8e6/0x950
RSP <ffff8800b985fa00>
---[ end trace 59eb35cc15af8a53 ]---
Kernel panic - not syncing: Fatal exception
Dumping ftrace buffer:
(ftrace buffer empty)
Kernel Offset: disabled

>
> I have vage suspicion that I'm screwing up anon_vma refcounting during
> split_huge_page.
>
> It would be great to see if the page was part of THP before.
>
> >
> > ..
> > ..
> > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > page:ffffea0001b81140 count:3 mapcount:1 mapping:ffff88007e806461 index:0x600001445
> > page:ffffea0001b87bc0 count:3 mapcount:1 mapping:ffff88007e806461 index:0x6000015ef
> > flags: 0x4000000000048019(locked|uptodate|dirty|swapcache|swapbacked)
> > page dumped because: VM_BUG_ON_PAGE(1)
> > page->mem_cgroup:ffff88007f2de000
> > ------------[ cut here ]------------
> > kernel BUG at mm/rmap.c:517!
> > invalid opcode: 0000 [#1] SMP
> > Dumping ftrace buffer:
> > (ftrace buffer empty)
> > Modules linked in:
> > CPU: 0 PID: 24935 Comm: madvise_test Not tainted 4.3.0-rc5-mm1-THP-ref-madv_free+ #1555
> > Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > task: ffff880000ce8000 ti: ffff8800ada28000 task.ti: ffff8800ada28000
> > RIP: 0010:[<ffffffff81128f6e>] [<ffffffff81128f6e>] page_lock_anon_vma_read+0x18e/0x190
> > RSP: 0000:ffff8800ada2b868 EFLAGS: 00010296
> > RAX: 0000000000000021 RBX: ffffea0001b87bc0 RCX: 0000000000000000
> > RDX: 0000000000000001 RSI: 0000000000000282 RDI: ffffffff81830db0
> > RBP: ffff8800ada2b888 R08: 0000000000000021 R09: ffff8800ba40eb75
> > R10: 0000000001ff14bc R11: 0000000000000000 R12: ffff88007e806461
> > R13: ffff88007e806460 R14: 0000000000000000 R15: ffffffff818464c0
> > FS: 00007f6d93212740(0000) GS:ffff8800bfa00000(0000) knlGS:0000000000000000
> > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > CR2: 0000600003c14000 CR3: 00000000a674b000 CR4: 00000000000006b0
> > Stack:
> > ffffea0001b87bc0 ffff8800ada2b8f8 ffff88007f2de000 0000000000000000
> > ffff8800ada2b8d0 ffffffff81129593 ffff880000000000 ffffffff8105f8c0
> > ffffea0001b87bc0 ffff8800ada2b9f8 ffff88007f2de000 0000000000000000
> > Call Trace:
> > [<ffffffff81129593>] rmap_walk+0x1b3/0x3f0
> > [<ffffffff8105f8c0>] ? finish_task_switch+0x70/0x260
> > [<ffffffff81129973>] page_referenced+0x1a3/0x220
> > [<ffffffff81127c10>] ? __page_check_address+0x1d0/0x1d0
> > [<ffffffff81128de0>] ? page_get_anon_vma+0xd0/0xd0
> > [<ffffffff81127580>] ? anon_vma_ctor+0x40/0x40
> > [<ffffffff81103e9e>] shrink_page_list+0x5ce/0xdc0
> > [<ffffffff81104d4c>] shrink_inactive_list+0x18c/0x4b0
> > [<ffffffff811059af>] shrink_lruvec+0x58f/0x730
> > [<ffffffff81105c24>] shrink_zone+0xd4/0x280
> > [<ffffffff81105efd>] do_try_to_free_pages+0x12d/0x3b0
> > [<ffffffff8110635d>] try_to_free_mem_cgroup_pages+0x9d/0x120
> > [<ffffffff8114e235>] try_charge+0x175/0x720
> > [<ffffffff810fdf80>] ? __activate_page+0x230/0x230
> > [<ffffffff81152005>] mem_cgroup_try_charge+0x85/0x1d0
> > [<ffffffff8111e69a>] handle_mm_fault+0xc9a/0x1000
> > [<ffffffff8106215b>] ? __set_cpus_allowed_ptr+0x9b/0x1a0
> > [<ffffffff81033629>] __do_page_fault+0x189/0x400
> > [<ffffffff810338ac>] do_page_fault+0xc/0x10
> > [<ffffffff81428782>] page_fault+0x22/0x30
> > Code: c9 0f 84 b9 fe ff ff 8d 51 01 89 c8 f0 0f b1 16 39 c1 0f 84 11 ff ff ff 89 c1 eb e3 48 c7 c6 88 02 78 81 48 89 df e8 02 f3 fe ff <0f> 0b 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 45 31 f6
> > 41 55 4c
> > RIP [<ffffffff81128f6e>] page_lock_anon_vma_read+0x18e/0x190
> > RSP <ffff8800ada2b868>
> > ---[ end trace cfbb87f54f12290e ]---
> > Kernel panic - not syncing: Fatal exception
> > Dumping ftrace buffer:
> > (ftrace buffer empty)
> > Kernel Offset: disabled
> >
> > On Tue, Oct 20, 2015 at 10:38:54AM +0900, Minchan Kim wrote:
> > > On Mon, Oct 19, 2015 at 07:01:50PM +0900, Minchan Kim wrote:
> > > > On Mon, Oct 19, 2015 at 03:31:42PM +0900, Minchan Kim wrote:
> > > > > Hello, it's too late since I sent previos patch.
> > > > > https://lkml.org/lkml/2015/6/3/37
> > > > >
> > > > > This patch is alomost new compared to previos approach.
> > > > > I think this is more simple, clear and easy to review.
> > > > >
> > > > > One thing I should notice is that I have tested this patch
> > > > > and couldn't find any critical problem so I rebased patchset
> > > > > onto recent mmotm(ie, mmotm-2015-10-15-15-20) to send formal
> > > > > patchset. Unfortunately, I start to see sudden discarding of
> > > > > the page we shouldn't do. IOW, application's valid anonymous page
> > > > > was disappeared suddenly.
> > > > >
> > > > > When I look through THP changes, I think we could lose
> > > > > dirty bit of pte between freeze_page and unfreeze_page
> > > > > when we mark it as migration entry and restore it.
> > > > > So, I added below simple code without enough considering
> > > > > and cannot see the problem any more.
> > > > > I hope it's good hint to find right fix this problem.
> > > > >
> > > > > diff --git a/mm/huge_memory.c b/mm/huge_memory.c
> > > > > index d5ea516ffb54..e881c04f5950 100644
> > > > > --- a/mm/huge_memory.c
> > > > > +++ b/mm/huge_memory.c
> > > > > @@ -3138,6 +3138,9 @@ static void unfreeze_page_vma(struct vm_area_struct *vma, struct page *page,
> > > > > if (is_write_migration_entry(swp_entry))
> > > > > entry = maybe_mkwrite(entry, vma);
> > > > >
> > > > > + if (PageDirty(page))
> > > > > + SetPageDirty(page);
> > > >
> > > > The condition of PageDirty was typo. I didn't add the condition.
> > > > Just added.
> > > >
> > > > SetPageDirty(page);
> > >
> > > For the first step to find this bug, I removed all MADV_FREE related
> > > code in mmotm-2015-10-15-15-20. IOW, git checkout 54bad5da4834
> > > (arm64: add pmd_[dirty|mkclean] for THP) so the tree doesn't have
> > > any core code of MADV_FREE.
> > >
> > > I tested following workloads in my KVM machine.
> > >
> > > 0. make memcg
> > > 1. limit memcg
> > > 2. fork several processes
> > > 3. each process allocates THP page and fill
> > > 4. increase limit of the memcg to swapoff successfully
> > > 5. swapoff
> > > 6. kill all of processes
> > > 7. goto 1
> > >
> > > Within a few hours, I encounter following bug.
> > > Attached detailed boot log and dmesg result.
> > >
> > >
> > > Initializing cgroup subsys cpu
> > > Command line: hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic console=ttyS0,115200 console=tty0 earlyprintk=ttyS0 ignore_loglevel ftrace_dump_on_oops vga=normal root=/dev/vda1 rw
> > > KERNEL supported cpus:
> > > Intel GenuineIntel
> > > x86/fpu: Legacy x87 FPU detected.
> > > x86/fpu: Using 'lazy' FPU context switches.
> > > e820: BIOS-provided physical RAM map:
> > > BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
> > > BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
> > > BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
> > > BIOS-e820: [mem 0x0000000000100000-0x00000000bfffbfff] usable
> > > BIOS-e820: [mem 0x00000000bfffc000-0x00000000bfffffff] reserved
> > > BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
> > > BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
> > >
> > > <snip>
> > >
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
> > > IP: [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > PGD 0
> > > Oops: 0000 [#1] SMP
> > > Dumping ftrace buffer:
> > > (ftrace buffer empty)
> > > Modules linked in:
> > > CPU: 1 PID: 26445 Comm: sh Not tainted 4.3.0-rc5-mm1-diet-meta+ #1545
> > > Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > > task: ffff8800b9af3480 ti: ffff88007fea0000 task.ti: ffff88007fea0000
> > > RIP: 0010:[<ffffffff810782a9>] [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP: 0018:ffff88007fea3648 EFLAGS: 00010202
> > > RAX: 0000000000000001 RBX: ffffea0002324900 RCX: ffff88007fea37e8
> > > RDX: 0000000000000000 RSI: ffff88007fea36e8 RDI: 0000000000000008
> > > RBP: ffff88007fea3648 R08: ffffffff818446a0 R09: ffff8800b9af4c80
> > > R10: 0000000000000216 R11: 0000000000000001 R12: ffff88007f58d6e1
> > > R13: ffff88007f58d6e0 R14: 0000000000000008 R15: 0000000000000001
> > > FS: 00007f0993e78740(0000) GS:ffff8800bfa20000(0000) knlGS:0000000000000000
> > > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > > CR2: 0000000000000008 CR3: 000000007edee000 CR4: 00000000000006a0
> > > Stack:
> > > ffff88007fea3678 ffffffff81124ff0 ffffea0002324900 ffff88007fea36e8
> > > ffff88009ffe8400 0000000000000000 ffff88007fea36c0 ffffffff81125733
> > > ffff8800bfa34540 ffffffff8105dc9d ffffea0002324900 ffff88007fea37e8
> > > Call Trace:
> > > [<ffffffff81124ff0>] page_lock_anon_vma_read+0x60/0x180
> > > [<ffffffff81125733>] rmap_walk+0x1b3/0x3f0
> > > [<ffffffff8105dc9d>] ? finish_task_switch+0x5d/0x1f0
> > > [<ffffffff81125b13>] page_referenced+0x1a3/0x220
> > > [<ffffffff81123e30>] ? __page_check_address+0x1a0/0x1a0
> > > [<ffffffff81124f90>] ? page_get_anon_vma+0xd0/0xd0
> > > [<ffffffff81123820>] ? anon_vma_ctor+0x40/0x40
> > > [<ffffffff8110087b>] shrink_page_list+0x5ab/0xde0
> > > [<ffffffff8110174c>] shrink_inactive_list+0x18c/0x4b0
> > > [<ffffffff811023bd>] shrink_lruvec+0x59d/0x740
> > > [<ffffffff811025f0>] shrink_zone+0x90/0x250
> > > [<ffffffff811028dd>] do_try_to_free_pages+0x12d/0x3b0
> > > [<ffffffff81102d3d>] try_to_free_mem_cgroup_pages+0x9d/0x120
> > > [<ffffffff811496c3>] try_charge+0x163/0x700
> > > [<ffffffff81149cb4>] mem_cgroup_do_precharge+0x54/0x70
> > > [<ffffffff81149e45>] mem_cgroup_can_attach+0x175/0x1b0
> > > [<ffffffff811b2c57>] ? kernfs_iattrs.isra.6+0x37/0xd0
> > > [<ffffffff81148e70>] ? get_mctgt_type+0x320/0x320
> > > [<ffffffff810a9d29>] cgroup_migrate+0x149/0x440
> > > [<ffffffff810aa60c>] cgroup_attach_task+0x7c/0xe0
> > > [<ffffffff810aa904>] __cgroup_procs_write.isra.33+0x1d4/0x2b0
> > > [<ffffffff810aaa10>] cgroup_tasks_write+0x10/0x20
> > > [<ffffffff810a6238>] cgroup_file_write+0x38/0xf0
> > > [<ffffffff811b54ad>] kernfs_fop_write+0x11d/0x170
> > > [<ffffffff81153918>] __vfs_write+0x28/0xe0
> > > [<ffffffff8116e614>] ? __fd_install+0x24/0xc0
> > > [<ffffffff810784a1>] ? percpu_down_read+0x21/0x50
> > > [<ffffffff81153e91>] vfs_write+0xa1/0x170
> > > [<ffffffff81154716>] SyS_write+0x46/0xa0
> > > [<ffffffff81420a17>] entry_SYSCALL_64_fastpath+0x12/0x6a
> > > Code: 5e 82 3a 00 48 83 c4 08 5b 5d c3 48 89 45 f0 e8 9b 6a 3a 00 48 8b 45 f0 eb df 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 <48> 8b 07 48 89 c2 48 83 c2 01 7e 07 f0 48 0f b1 17 75 f0 48 f7
> > > RIP [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP <ffff88007fea3648>
> > > CR2: 0000000000000008
> > > BUG: unable to handle kernel ---[ end trace e81a82c8122b447d ]---
> > > Kernel panic - not syncing: Fatal exception
> > >
> > > NULL pointer dereference at 0000000000000008
> > > IP: [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > PGD 0
> > > Oops: 0000 [#2] SMP
> > > Dumping ftrace buffer:
> > > (ftrace buffer empty)
> > > Modules linked in:
> > > CPU: 10 PID: 59 Comm: khugepaged Tainted: G D 4.3.0-rc5-mm1-diet-meta+ #1545
> > > Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > > task: ffff8800b9851a40 ti: ffff8800b985c000 task.ti: ffff8800b985c000
> > > RIP: 0010:[<ffffffff810782a9>] [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP: 0018:ffff8800b985f778 EFLAGS: 00010202
> > > RAX: 0000000000000001 RBX: ffffea0002321800 RCX: ffff8800b985f918
> > > RDX: 0000000000000000 RSI: ffff8800b985f818 RDI: 0000000000000008
> > > RBP: ffff8800b985f778 R08: ffffffff818446a0 R09: ffff8800b9853240
> > > R10: 000000000000ba03 R11: 0000000000000001 R12: ffff88007f58d6e1
> > > R13: ffff88007f58d6e0 R14: 0000000000000008 R15: 0000000000000001
> > > FS: 0000000000000000(0000) GS:ffff8800bfb40000(0000) knlGS:0000000000000000
> > > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > > CR2: 0000000000000008 CR3: 0000000001808000 CR4: 00000000000006a0
> > > Stack:
> > > ffff8800b985f7a8 ffffffff81124ff0 ffffea0002321800 ffff8800b985f818
> > > ffff88009ffe8400 0000000000000000 ffff8800b985f7f0 ffffffff81125733
> > > ffff8800bfb54540 ffffffff8105dc9d ffffea0002321800 ffff8800b985f918
> > > Call Trace:
> > > [<ffffffff81124ff0>] page_lock_anon_vma_read+0x60/0x180
> > > [<ffffffff81125733>] rmap_walk+0x1b3/0x3f0
> > > [<ffffffff8105dc9d>] ? finish_task_switch+0x5d/0x1f0
> > > [<ffffffff81125b13>] page_referenced+0x1a3/0x220
> > > [<ffffffff81123e30>] ? __page_check_address+0x1a0/0x1a0
> > > [<ffffffff81124f90>] ? page_get_anon_vma+0xd0/0xd0
> > > [<ffffffff81123820>] ? anon_vma_ctor+0x40/0x40
> > > [<ffffffff8110087b>] shrink_page_list+0x5ab/0xde0
> > > [<ffffffff8110174c>] shrink_inactive_list+0x18c/0x4b0
> > > [<ffffffff811023bd>] shrink_lruvec+0x59d/0x740
> > > [<ffffffff811025f0>] shrink_zone+0x90/0x250
> > > [<ffffffff811028dd>] do_try_to_free_pages+0x12d/0x3b0
> > > [<ffffffff81102d3d>] try_to_free_mem_cgroup_pages+0x9d/0x120
> > > [<ffffffff811496c3>] try_charge+0x163/0x700
> > > [<ffffffff8141d1f3>] ? schedule+0x33/0x80
> > > [<ffffffff8114d45f>] mem_cgroup_try_charge+0x9f/0x1d0
> > > [<ffffffff811434bc>] khugepaged+0x7cc/0x1ac0
> > > [<ffffffff81066e01>] ? hrtick_update+0x1/0x70
> > > [<ffffffff81072430>] ? prepare_to_wait_event+0xf0/0xf0
> > > [<ffffffff81142cf0>] ? total_mapcount+0x70/0x70
> > > [<ffffffff81056cd9>] kthread+0xc9/0xe0
> > > [<ffffffff81056c10>] ? kthread_park+0x60/0x60
> > > [<ffffffff81420d6f>] ret_from_fork+0x3f/0x70
> > > [<ffffffff81056c10>] ? kthread_park+0x60/0x60
> > > Code: 5e 82 3a 00 48 83 c4 08 5b 5d c3 48 89 45 f0 e8 9b 6a 3a 00 48 8b 45 f0 eb df 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 <48> 8b 07 48 89 c2 48 83 c2 01 7e 07 f0 48 0f b1 17 75 f0 48 f7
> > > RIP [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP <ffff8800b985f778>
> > > CR2: 0000000000000008
> > > ---[ end trace e81a82c8122b447e ]---
> > > Shutting down cpus with NMI
> > > Dumping ftrace buffer:
> > > (ftrace buffer empty)
> > > Kernel Offset: disabled
> > >
> >
> > > QEMU 2.0.0 monitor - type 'help' for more information
> > > (qemu) s[Kearly console in setup code
> > > Initializing cgroup subsys cpu
> > > Linux version 4.3.0-rc5-mm1-diet-meta+ (barrios@bbox) (gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04) ) #1545 SMP Tue Oct 20 08:55:45 KST 2015
> > > Command line: hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic console=ttyS0,115200 console=tty0 earlyprintk=ttyS0 ignore_loglevel ftrace_dump_on_oops vga=normal root=/dev/vda1 rw
> > > KERNEL supported cpus:
> > > Intel GenuineIntel
> > > x86/fpu: Legacy x87 FPU detected.
> > > x86/fpu: Using 'lazy' FPU context switches.
> > > e820: BIOS-provided physical RAM map:
> > > BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
> > > BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
> > > BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
> > > BIOS-e820: [mem 0x0000000000100000-0x00000000bfffbfff] usable
> > > BIOS-e820: [mem 0x00000000bfffc000-0x00000000bfffffff] reserved
> > > BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
> > > BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
> > > bootconsole [earlyser0] enabled
> > > debug: ignoring loglevel setting.
> > > NX (Execute Disable) protection: active
> > > SMBIOS 2.4 present.
> > > DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > > e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
> > > e820: remove [mem 0x000a0000-0x000fffff] usable
> > > e820: last_pfn = 0xbfffc max_arch_pfn = 0x400000000
> > > MTRR default type: write-back
> > > MTRR fixed ranges enabled:
> > > 00000-9FFFF write-back
> > > A0000-BFFFF uncachable
> > > C0000-FFFFF write-protect
> > > MTRR variable ranges enabled:
> > > 0 base 00C0000000 mask FFC0000000 uncachable
> > > 1 disabled
> > > 2 disabled
> > > 3 disabled
> > > 4 disabled
> > > 5 disabled
> > > 6 disabled
> > > 7 disabled
> > > x86/PAT: PAT not supported by CPU.
> > > Scan for SMP in [mem 0x00000000-0x000003ff]
> > > Scan for SMP in [mem 0x0009fc00-0x0009ffff]
> > > Scan for SMP in [mem 0x000f0000-0x000fffff]
> > > found SMP MP-table at [mem 0x000f0a70-0x000f0a7f] mapped at [ffff8800000f0a70]
> > > mpc: f0a80-f0c44
> > > Scanning 1 areas for low memory corruption
> > > Base memory trampoline at [ffff880000099000] 99000 size 24576
> > > init_memory_mapping: [mem 0x00000000-0x000fffff]
> > > [mem 0x00000000-0x000fffff] page 4k
> > > BRK [0x0220e000, 0x0220efff] PGTABLE
> > > BRK [0x0220f000, 0x0220ffff] PGTABLE
> > > BRK [0x02210000, 0x02210fff] PGTABLE
> > > init_memory_mapping: [mem 0xbfc00000-0xbfdfffff]
> > > [mem 0xbfc00000-0xbfdfffff] page 2M
> > > BRK [0x02211000, 0x02211fff] PGTABLE
> > > init_memory_mapping: [mem 0xa0000000-0xbfbfffff]
> > > [mem 0xa0000000-0xbfbfffff] page 2M
> > > init_memory_mapping: [mem 0x80000000-0x9fffffff]
> > > [mem 0x80000000-0x9fffffff] page 2M
> > > init_memory_mapping: [mem 0x00100000-0x7fffffff]
> > > [mem 0x00100000-0x001fffff] page 4k
> > > [mem 0x00200000-0x7fffffff] page 2M
> > > init_memory_mapping: [mem 0xbfe00000-0xbfffbfff]
> > > [mem 0xbfe00000-0xbfffbfff] page 4k
> > > BRK [0x02212000, 0x02212fff] PGTABLE
> > > RAMDISK: [mem 0x7851a000-0x7fffffff]
> > > [ffffea0000000000-ffffea0002ffffff] PMD -> [ffff8800bc400000-ffff8800bf3fffff] on node 0
> > > Zone ranges:
> > > DMA [mem 0x0000000000001000-0x0000000000ffffff]
> > > DMA32 [mem 0x0000000001000000-0x00000000bfffbfff]
> > > Normal empty
> > > Movable zone start for each node
> > > Early memory node ranges
> > > node 0: [mem 0x0000000000001000-0x000000000009efff]
> > > node 0: [mem 0x0000000000100000-0x00000000bfffbfff]
> > > Initmem setup node 0 [mem 0x0000000000001000-0x00000000bfffbfff]
> > > On node 0 totalpages: 786330
> > > DMA zone: 64 pages used for memmap
> > > DMA zone: 21 pages reserved
> > > DMA zone: 3998 pages, LIFO batch:0
> > > DMA32 zone: 12224 pages used for memmap
> > > DMA32 zone: 782332 pages, LIFO batch:31
> > > Intel MultiProcessor Specification v1.4
> > > mpc: f0a80-f0c44
> > > MPTABLE: OEM ID: BOCHSCPU
> > > MPTABLE: Product ID: 0.1
> > > MPTABLE: APIC at: 0xFEE00000
> > > mapped APIC to ffffffffff5fd000 ( fee00000)
> > > Processor #0 (Bootup-CPU)
> > > Processor #1
> > > Processor #2
> > > Processor #3
> > > Processor #4
> > > Processor #5
> > > Processor #6
> > > Processor #7
> > > Processor #8
> > > Processor #9
> > > Processor #10
> > > Processor #11
> > > Bus #0 is PCI
> > > Bus #1 is ISA
> > > IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 04, APIC ID 0, APIC INT 09
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 0c, APIC ID 0, APIC INT 0b
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 10, APIC ID 0, APIC INT 0b
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 14, APIC ID 0, APIC INT 0a
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 18, APIC ID 0, APIC INT 0a
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 00, APIC ID 0, APIC INT 02
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 01, APIC ID 0, APIC INT 01
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 03, APIC ID 0, APIC INT 03
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 04, APIC ID 0, APIC INT 04
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 06, APIC ID 0, APIC INT 06
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 07, APIC ID 0, APIC INT 07
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 08, APIC ID 0, APIC INT 08
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0c, APIC ID 0, APIC INT 0c
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0d, APIC ID 0, APIC INT 0d
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0e, APIC ID 0, APIC INT 0e
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0f, APIC ID 0, APIC INT 0f
> > > Lint: type 3, pol 0, trig 0, bus 01, IRQ 00, APIC ID 0, APIC LINT 00
> > > Lint: type 1, pol 0, trig 0, bus 01, IRQ 00, APIC ID ff, APIC LINT 01
> > > Processors: 12
> > > smpboot: Allowing 12 CPUs, 0 hotplug CPUs
> > > mapped IOAPIC to ffffffffff5fc000 (fec00000)
> > > e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
> > > clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
> > > setup_percpu: NR_CPUS:16 nr_cpumask_bits:16 nr_cpu_ids:12 nr_node_ids:1
> > > PERCPU: Embedded 31 pages/cpu @ffff8800bfa00000 s87640 r8192 d31144 u131072
> > > pcpu-alloc: s87640 r8192 d31144 u131072 alloc=1*2097152
> > > pcpu-alloc: [0] 00 01 02 03 04 05 06 07 08 09 10 11 -- -- -- --
> > > Built 1 zonelists in Zone order, mobility grouping on. Total pages: 774021
> > > Kernel command line: hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic console=ttyS0,115200 console=tty0 earlyprintk=ttyS0 ignore_loglevel ftrace_dump_on_oops vga=normal root=/dev/vda1 rw
> > > sysrq: sysrq always enabled.
> > > log_buf_len individual max cpu contribution: 2097152 bytes
> > > log_buf_len total cpu_extra contributions: 23068672 bytes
> > > log_buf_len min size: 8388608 bytes
> > > log_buf_len: 33554432 bytes
> > > early log buf free: 8380096(99%)
> > > PID hash table entries: 4096 (order: 3, 32768 bytes)
> > > Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> > > Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> > > Memory: 2911172K/3145320K available (4237K kernel code, 721K rwdata, 1988K rodata, 936K init, 8608K bss, 234148K reserved, 0K cma-reserved)
> > > SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=12, Nodes=1
> > > Hierarchical RCU implementation.
> > > Build-time adjustment of leaf fanout to 64.
> > > RCU restricting CPUs from NR_CPUS=16 to nr_cpu_ids=12.
> > > RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=12
> > > NR_IRQS:4352 nr_irqs:136 16
> > > Console: colour VGA+ 80x25
> > > console [tty0] enabled
> > > bootconsole [earlyser0] disabled
> > > Initializing cgroup subsys cpu
> > > Linux version 4.3.0-rc5-mm1-diet-meta+ (barrios@bbox) (gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04) ) #1545 SMP Tue Oct 20 08:55:45 KST 2015
> > > Command line: hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic console=ttyS0,115200 console=tty0 earlyprintk=ttyS0 ignore_loglevel ftrace_dump_on_oops vga=normal root=/dev/vda1 rw
> > > KERNEL supported cpus:
> > > Intel GenuineIntel
> > > x86/fpu: Legacy x87 FPU detected.
> > > x86/fpu: Using 'lazy' FPU context switches.
> > > e820: BIOS-provided physical RAM map:
> > > BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
> > > BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
> > > BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
> > > BIOS-e820: [mem 0x0000000000100000-0x00000000bfffbfff] usable
> > > BIOS-e820: [mem 0x00000000bfffc000-0x00000000bfffffff] reserved
> > > BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
> > > BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
> > > bootconsole [earlyser0] enabled
> > > debug: ignoring loglevel setting.
> > > NX (Execute Disable) protection: active
> > > SMBIOS 2.4 present.
> > > DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > > e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
> > > e820: remove [mem 0x000a0000-0x000fffff] usable
> > > e820: last_pfn = 0xbfffc max_arch_pfn = 0x400000000
> > > MTRR default type: write-back
> > > MTRR fixed ranges enabled:
> > > 00000-9FFFF write-back
> > > A0000-BFFFF uncachable
> > > C0000-FFFFF write-protect
> > > MTRR variable ranges enabled:
> > > 0 base 00C0000000 mask FFC0000000 uncachable
> > > 1 disabled
> > > 2 disabled
> > > 3 disabled
> > > 4 disabled
> > > 5 disabled
> > > 6 disabled
> > > 7 disabled
> > > x86/PAT: PAT not supported by CPU.
> > > Scan for SMP in [mem 0x00000000-0x000003ff]
> > > Scan for SMP in [mem 0x0009fc00-0x0009ffff]
> > > Scan for SMP in [mem 0x000f0000-0x000fffff]
> > > found SMP MP-table at [mem 0x000f0a70-0x000f0a7f] mapped at [ffff8800000f0a70]
> > > mpc: f0a80-f0c44
> > > Scanning 1 areas for low memory corruption
> > > Base memory trampoline at [ffff880000099000] 99000 size 24576
> > > init_memory_mapping: [mem 0x00000000-0x000fffff]
> > > [mem 0x00000000-0x000fffff] page 4k
> > > BRK [0x0220e000, 0x0220efff] PGTABLE
> > > BRK [0x0220f000, 0x0220ffff] PGTABLE
> > > BRK [0x02210000, 0x02210fff] PGTABLE
> > > init_memory_mapping: [mem 0xbfc00000-0xbfdfffff]
> > > [mem 0xbfc00000-0xbfdfffff] page 2M
> > > BRK [0x02211000, 0x02211fff] PGTABLE
> > > init_memory_mapping: [mem 0xa0000000-0xbfbfffff]
> > > [mem 0xa0000000-0xbfbfffff] page 2M
> > > init_memory_mapping: [mem 0x80000000-0x9fffffff]
> > > [mem 0x80000000-0x9fffffff] page 2M
> > > init_memory_mapping: [mem 0x00100000-0x7fffffff]
> > > [mem 0x00100000-0x001fffff] page 4k
> > > [mem 0x00200000-0x7fffffff] page 2M
> > > init_memory_mapping: [mem 0xbfe00000-0xbfffbfff]
> > > [mem 0xbfe00000-0xbfffbfff] page 4k
> > > BRK [0x02212000, 0x02212fff] PGTABLE
> > > RAMDISK: [mem 0x7851a000-0x7fffffff]
> > > [ffffea0000000000-ffffea0002ffffff] PMD -> [ffff8800bc400000-ffff8800bf3fffff] on node 0
> > > Zone ranges:
> > > DMA [mem 0x0000000000001000-0x0000000000ffffff]
> > > DMA32 [mem 0x0000000001000000-0x00000000bfffbfff]
> > > Normal empty
> > > Movable zone start for each node
> > > Early memory node ranges
> > > node 0: [mem 0x0000000000001000-0x000000000009efff]
> > > node 0: [mem 0x0000000000100000-0x00000000bfffbfff]
> > > Initmem setup node 0 [mem 0x0000000000001000-0x00000000bfffbfff]
> > > On node 0 totalpages: 786330
> > > DMA zone: 64 pages used for memmap
> > > DMA zone: 21 pages reserved
> > > DMA zone: 3998 pages, LIFO batch:0
> > > DMA32 zone: 12224 pages used for memmap
> > > DMA32 zone: 782332 pages, LIFO batch:31
> > > Intel MultiProcessor Specification v1.4
> > > mpc: f0a80-f0c44
> > > MPTABLE: OEM ID: BOCHSCPU
> > > MPTABLE: Product ID: 0.1
> > > MPTABLE: APIC at: 0xFEE00000
> > > mapped APIC to ffffffffff5fd000 ( fee00000)
> > > Processor #0 (Bootup-CPU)
> > > Processor #1
> > > Processor #2
> > > Processor #3
> > > Processor #4
> > > Processor #5
> > > Processor #6
> > > Processor #7
> > > Processor #8
> > > Processor #9
> > > Processor #10
> > > Processor #11
> > > Bus #0 is PCI
> > > Bus #1 is ISA
> > > IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 04, APIC ID 0, APIC INT 09
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 0c, APIC ID 0, APIC INT 0b
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 10, APIC ID 0, APIC INT 0b
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 14, APIC ID 0, APIC INT 0a
> > > Int: type 0, pol 1, trig 0, bus 00, IRQ 18, APIC ID 0, APIC INT 0a
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 00, APIC ID 0, APIC INT 02
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 01, APIC ID 0, APIC INT 01
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 03, APIC ID 0, APIC INT 03
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 04, APIC ID 0, APIC INT 04
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 06, APIC ID 0, APIC INT 06
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 07, APIC ID 0, APIC INT 07
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 08, APIC ID 0, APIC INT 08
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0c, APIC ID 0, APIC INT 0c
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0d, APIC ID 0, APIC INT 0d
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0e, APIC ID 0, APIC INT 0e
> > > Int: type 0, pol 0, trig 0, bus 01, IRQ 0f, APIC ID 0, APIC INT 0f
> > > Lint: type 3, pol 0, trig 0, bus 01, IRQ 00, APIC ID 0, APIC LINT 00
> > > Lint: type 1, pol 0, trig 0, bus 01, IRQ 00, APIC ID ff, APIC LINT 01
> > > Processors: 12
> > > smpboot: Allowing 12 CPUs, 0 hotplug CPUs
> > > mapped IOAPIC to ffffffffff5fc000 (fec00000)
> > > e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
> > > clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
> > > setup_percpu: NR_CPUS:16 nr_cpumask_bits:16 nr_cpu_ids:12 nr_node_ids:1
> > > PERCPU: Embedded 31 pages/cpu @ffff8800bfa00000 s87640 r8192 d31144 u131072
> > > pcpu-alloc: s87640 r8192 d31144 u131072 alloc=1*2097152
> > > pcpu-alloc: [0] 00 01 02 03 04 05 06 07 08 09 10 11 -- -- -- --
> > > Built 1 zonelists in Zone order, mobility grouping on. Total pages: 774021
> > > Kernel command line: hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic console=ttyS0,115200 console=tty0 earlyprintk=ttyS0 ignore_loglevel ftrace_dump_on_oops vga=normal root=/dev/vda1 rw
> > > sysrq: sysrq always enabled.
> > > log_buf_len individual max cpu contribution: 2097152 bytes
> > > log_buf_len total cpu_extra contributions: 23068672 bytes
> > > log_buf_len min size: 8388608 bytes
> > > log_buf_len: 33554432 bytes
> > > early log buf free: 8380096(99%)
> > > PID hash table entries: 4096 (order: 3, 32768 bytes)
> > > Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> > > Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> > > Memory: 2911172K/3145320K available (4237K kernel code, 721K rwdata, 1988K rodata, 936K init, 8608K bss, 234148K reserved, 0K cma-reserved)
> > > SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=12, Nodes=1
> > > Hierarchical RCU implementation.
> > > Build-time adjustment of leaf fanout to 64.
> > > RCU restricting CPUs from NR_CPUS=16 to nr_cpu_ids=12.
> > > RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=12
> > > NR_IRQS:4352 nr_irqs:136 16
> > > Console: colour VGA+ 80x25
> > > console [tty0] enabled
> > > bootconsole [earlyser0] disabled
> > > console [ttyS0] enabled
> > > tsc: Fast TSC calibration using PIT
> > > tsc: Detected 3199.926 MHz processor
> > > Calibrating delay loop (skipped), value calculated using timer frequency.. 6399.85 BogoMIPS (lpj=12799704)
> > > pid_max: default: 32768 minimum: 301
> > > Mount-cache hash table entries: 8192 (order: 4, 65536 bytes)
> > > Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes)
> > > Initializing cgroup subsys memory
> > > Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
> > > Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
> > > Freeing SMP alternatives memory: 20K (ffffffff819a0000 - ffffffff819a5000)
> > > ftrace: allocating 16664 entries in 66 pages
> > > Switched APIC routing to physical flat.
> > > enabled ExtINT on CPU#0
> > > ENABLING IO-APIC IRQs
> > > init IO_APIC IRQs
> > > apic 0 pin 0 not connected
> > > IOAPIC[0]: Set routing entry (0-1 -> 0x31 -> IRQ 1 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-2 -> 0x30 -> IRQ 0 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-3 -> 0x33 -> IRQ 3 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-4 -> 0x34 -> IRQ 4 Mode:0 Active:0 Dest:0)
> > > apic 0 pin 5 not connected
> > > IOAPIC[0]: Set routing entry (0-6 -> 0x36 -> IRQ 6 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-7 -> 0x37 -> IRQ 7 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-8 -> 0x38 -> IRQ 8 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-9 -> 0x39 -> IRQ 9 Mode:1 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-10 -> 0x3a -> IRQ 10 Mode:1 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-11 -> 0x3b -> IRQ 11 Mode:1 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-12 -> 0x3c -> IRQ 12 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-13 -> 0x3d -> IRQ 13 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-14 -> 0x3e -> IRQ 14 Mode:0 Active:0 Dest:0)
> > > IOAPIC[0]: Set routing entry (0-15 -> 0x3f -> IRQ 15 Mode:0 Active:0 Dest:0)
> > > apic 0 pin 16 not connected
> > > apic 0 pin 17 not connected
> > > apic 0 pin 18 not connected
> > > apic 0 pin 19 not connected
> > > apic 0 pin 20 not connected
> > > apic 0 pin 21 not connected
> > > apic 0 pin 22 not connected
> > > apic 0 pin 23 not connected
> > > ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
> > > Using local APIC timer interrupts.
> > > calibrating APIC timer ...
> > > ... lapic delta = 6251755
> > > ..... delta 6251755
> > > ..... mult: 268510832
> > > ..... calibration result: 4001123
> > > ..... CPU clock speed is 3200.3592 MHz.
> > > ..... host bus clock speed is 1000.1123 MHz.
> > > ... verify APIC timer
> > > ... jiffies delta = 25
> > > ... jiffies result ok
> > > smpboot: CPU0: Intel QEMU Virtual CPU version 2.0.0 (family: 0x6, model: 0x6, stepping: 0x3)
> > > Performance Events: Broken PMU hardware detected, using software events only.
> > > Failed to access perfctr msr (MSR c2 is 0)
> > > x86: Booting SMP configuration:
> > > .... node #0, CPUs: #1
> > > masked ExtINT on CPU#1
> > > #2
> > > masked ExtINT on CPU#2
> > > #3
> > > masked ExtINT on CPU#3
> > > #4
> > > masked ExtINT on CPU#4
> > > #5
> > > masked ExtINT on CPU#5
> > > #6
> > > masked ExtINT on CPU#6
> > > #7
> > > masked ExtINT on CPU#7
> > > #8
> > > masked ExtINT on CPU#8
> > > #9
> > > masked ExtINT on CPU#9
> > > #10
> > > masked ExtINT on CPU#10
> > > #11
> > > masked ExtINT on CPU#11
> > > x86: Booted up 1 node, 12 CPUs
> > > smpboot: Total of 12 processors activated (76818.13 BogoMIPS)
> > > devtmpfs: initialized
> > > clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
> > > NET: Registered protocol family 16
> > > PCI: Using configuration type 1 for base access
> > > vgaarb: loaded
> > > SCSI subsystem initialized
> > > libata version 3.00 loaded.
> > > PCI: Probing PCI hardware
> > > PCI: root bus 00: using default resources
> > > PCI: Probing PCI hardware (bus 00)
> > > PCI host bridge to bus 0000:00
> > > pci_bus 0000:00: root bus resource [io 0x0000-0xffff]
> > > pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffffff]
> > > pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
> > > pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
> > > pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
> > > pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
> > > pci 0000:00:01.1: reg 0x20: [io 0xc0c0-0xc0cf]
> > > pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
> > > pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
> > > pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
> > > pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
> > > pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
> > > pci 0000:00:02.0: [1013:00b8] type 00 class 0x030000
> > > pci 0000:00:02.0: reg 0x10: [mem 0xfc000000-0xfdffffff pref]
> > > pci 0000:00:02.0: reg 0x14: [mem 0xfebd0000-0xfebd0fff]
> > > pci 0000:00:02.0: reg 0x30: [mem 0xfebc0000-0xfebcffff pref]
> > > vgaarb: setting as boot device: PCI:0000:00:02.0
> > > vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
> > > pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000
> > > pci 0000:00:03.0: reg 0x10: [io 0xc080-0xc09f]
> > > pci 0000:00:03.0: reg 0x14: [mem 0xfebd1000-0xfebd1fff]
> > > pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
> > > pci 0000:00:04.0: [1af4:1002] type 00 class 0x00ff00
> > > pci 0000:00:04.0: reg 0x10: [io 0xc0a0-0xc0bf]
> > > pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000
> > > pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc03f]
> > > pci 0000:00:05.0: reg 0x14: [mem 0xfebd2000-0xfebd2fff]
> > > pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000
> > > pci 0000:00:06.0: reg 0x10: [io 0xc040-0xc07f]
> > > pci 0000:00:06.0: reg 0x14: [mem 0xfebd3000-0xfebd3fff]
> > > pci 0000:00:07.0: [8086:25ab] type 00 class 0x088000
> > > pci 0000:00:07.0: reg 0x10: [mem 0xfebd4000-0xfebd400f]
> > > pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 00
> > > pci 0000:00:01.0: PIIX/ICH IRQ router [8086:7000]
> > > PCI: pci_cache_line_size set to 64 bytes
> > > e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
> > > e820: reserve RAM buffer [mem 0xbfffc000-0xbfffffff]
> > > clocksource: Switched to clocksource refined-jiffies
> > > pci_bus 0000:00: resource 4 [io 0x0000-0xffff]
> > > pci_bus 0000:00: resource 5 [mem 0x00000000-0xffffffffff]
> > > NET: Registered protocol family 2
> > > TCP established hash table entries: 32768 (order: 6, 262144 bytes)
> > > TCP bind hash table entries: 32768 (order: 7, 524288 bytes)
> > > TCP: Hash tables configured (established 32768 bind 32768)
> > > UDP hash table entries: 2048 (order: 4, 65536 bytes)
> > > UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)
> > > NET: Registered protocol family 1
> > > Trying to unpack rootfs image as initramfs...
> > > Freeing initrd memory: 125848K (ffff88007851a000 - ffff880080000000)
> > > platform rtc_cmos: registered platform RTC device (no PNP device found)
> > > Scanning for low memory corruption every 60 seconds
> > > futex hash table entries: 4096 (order: 6, 262144 bytes)
> > > HugeTLB registered 2 MB page size, pre-allocated 0 pages
> > > fuse init (API version 7.23)
> > > 9p: Installing v9fs 9p2000 file system support
> > > cryptomgr_test (74) used greatest stack depth: 15352 bytes left
> > > cryptomgr_test (82) used greatest stack depth: 15136 bytes left
> > > Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
> > > io scheduler noop registered
> > > io scheduler deadline registered
> > > io scheduler cfq registered (default)
> > > querying PCI -> IRQ mapping bus:0, slot:3, pin:0.
> > > virtio-pci 0000:00:03.0: PCI->APIC IRQ transform: INT A -> IRQ 11
> > > virtio-pci 0000:00:03.0: virtio_pci: leaving for legacy driver
> > > querying PCI -> IRQ mapping bus:0, slot:4, pin:0.
> > > virtio-pci 0000:00:04.0: PCI->APIC IRQ transform: INT A -> IRQ 11
> > > virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driver
> > > querying PCI -> IRQ mapping bus:0, slot:5, pin:0.
> > > virtio-pci 0000:00:05.0: PCI->APIC IRQ transform: INT A -> IRQ 10
> > > virtio-pci 0000:00:05.0: virtio_pci: leaving for legacy driver
> > > querying PCI -> IRQ mapping bus:0, slot:6, pin:0.
> > > virtio-pci 0000:00:06.0: PCI->APIC IRQ transform: INT A -> IRQ 10
> > > virtio-pci 0000:00:06.0: virtio_pci: leaving for legacy driver
> > > Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
> > > serial8250: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
> > > Linux agpgart interface v0.103
> > > brd: module loaded
> > > loop: module loaded
> > > vda: vda1 vda2 < vda5 >
> > > zram: Added device: zram0
> > > libphy: Fixed MDIO Bus: probed
> > > tun: Universal TUN/TAP device driver, 1.6
> > > tun: (C) 1999-2004 Max Krasnyansky <maxk@xxxxxxxxxxxx>
> > > serio: i8042 KBD port at 0x60,0x64 irq 1
> > > serio: i8042 AUX port at 0x60,0x64 irq 12
> > > mousedev: PS/2 mouse device common for all mice
> > > rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
> > > rtc_cmos rtc_cmos: alarms up to one day, 114 bytes nvram
> > > device-mapper: ioctl: 4.33.0-ioctl (2015-8-18) initialised: dm-devel@xxxxxxxxxx
> > > device-mapper: cache cleaner: version 1.0.0 loaded
> > > NET: Registered protocol family 17
> > > 9pnet: Installing 9P2000 support
> > > ... APIC ID: 00000000 (0)
> > > ... APIC VERSION: 01050014
> > > 0000000000000000000000000000000000000000000000000000000000000000
> > > 000000000e000000000000000000000000000000000000000000000000000000
> > > 0000000000020000000000000000000000000000000000000000000000008000
> > >
> > > number of MP IRQ sources: 16.
> > > number of IO-APIC #0 registers: 24.
> > > testing the IO APIC.......................
> > > IO APIC #0......
> > > .... register #00: 00000000
> > > ....... : physical APIC id: 00
> > > ....... : Delivery Type: 0
> > > ....... : LTS : 0
> > > .... register #01: 00170011
> > > ....... : max redirection entries: 17
> > > ....... : PRQ implemented: 0
> > > ....... : IO APIC version: 11
> > > .... register #02: 00000000
> > > ....... : arbitration: 00
> > > .... IRQ redirection table:
> > > IOAPIC 0:
> > > pin00, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin01, enabled , edge , high, V(31), IRR(0), S(0), physical, D(00), M(0)
> > > pin02, enabled , edge , high, V(30), IRR(0), S(0), physical, D(00), M(0)
> > > pin03, enabled , edge , high, V(33), IRR(0), S(0), physical, D(00), M(0)
> > > pin04, disabled, edge , high, V(34), IRR(0), S(0), physical, D(00), M(0)
> > > pin05, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin06, enabled , edge , high, V(36), IRR(0), S(0), physical, D(00), M(0)
> > > pin07, enabled , edge , high, V(37), IRR(0), S(0), physical, D(00), M(0)
> > > pin08, enabled , edge , high, V(38), IRR(0), S(0), physical, D(00), M(0)
> > > pin09, disabled, level, high, V(39), IRR(0), S(0), physical, D(00), M(0)
> > > pin0a, enabled , level, high, V(3A), IRR(0), S(0), physical, D(00), M(0)
> > > pin0b, enabled , level, high, V(3B), IRR(0), S(0), physical, D(00), M(0)
> > > pin0c, enabled , edge , high, V(3C), IRR(0), S(0), physical, D(00), M(0)
> > > pin0d, enabled , edge , high, V(3D), IRR(0), S(0), physical, D(00), M(0)
> > > pin0e, enabled , edge , high, V(3E), IRR(0), S(0), physical, D(00), M(0)
> > > pin0f, enabled , edge , high, V(3F), IRR(0), S(0), physical, D(00), M(0)
> > > pin10, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin11, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin12, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin13, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin14, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin15, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin16, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > pin17, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
> > > IRQ to pin mappings:
> > > IRQ0 -> 0:2
> > > IRQ1 -> 0:1
> > > IRQ3 -> 0:3
> > > IRQ4 -> 0:4
> > > IRQ6 -> 0:6
> > > IRQ7 -> 0:7
> > > IRQ8 -> 0:8
> > > IRQ9 -> 0:9
> > > IRQ10 -> 0:10
> > > IRQ11 -> 0:11
> > > IRQ12 -> 0:12
> > > IRQ13 -> 0:13
> > > IRQ14 -> 0:14
> > > IRQ15 -> 0:15
> > > .................................... done.
> > > rtc_cmos rtc_cmos: setting system clock to 2015-10-20 08:57:55 UTC (1445331475)
> > > input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
> > > Freeing unused kernel memory: 936K (ffffffff818b6000 - ffffffff819a0000)
> > > Write protecting the kernel read-only data: 8192k
> > > Freeing unused kernel memory: 1900K (ffff880001425000 - ffff880001600000)
> > > Freeing unused kernel memory: 60K (ffff8800017f1000 - ffff880001800000)
> > > busybox (117) used greatest stack depth: 14480 bytes left
> > > exe (124) used greatest stack depth: 14024 bytes left
> > > udevd[140]: starting version 175
> > > blkid (151) used greatest stack depth: 13920 bytes left
> > > modprobe (242) used greatest stack depth: 13784 bytes left
> > > clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2e200418439, max_idle_ns: 440795220848 ns
> > > clocksource: Switched to clocksource tsc
> > > EXT4-fs (vda1): recovery complete
> > > EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null)
> > > exe (262) used greatest stack depth: 13032 bytes left
> > > random: init urandom read with 9 bits of entropy available
> > > init: plymouth-upstart-bridge main process (279) terminated with status 1
> > > init: plymouth-upstart-bridge main process ended, respawning
> > > init: plymouth-upstart-bridge main process (289) terminated with status 1
> > > init: plymouth-upstart-bridge main process ended, respawning
> > > init: plymouth-upstart-bridge main process (293) terminated with status 1
> > > init: plymouth-upstart-bridge main process ended, respawning
> > > init: ureadahead main process (282) terminated with status 5
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > systemd-udevd[423]: starting version 204
> > > EXT4-fs (vdb): mounted filesystem with ordered data mode. Opts: errors=remount-ro
> > > * Stopping Send an event to indicate plymouth is up[74G[ OK ]
> > > * Starting Mount filesystems on boot[74G[ OK ]
> > > * Starting Signal sysvinit that the rootfs is mounted[74G[ OK ]
> > > * Starting Populate /dev filesystem[74G[ OK ]
> > > * Starting Populate and link to /run filesystem[74G[ OK ]
> > > * Stopping Populate /dev filesystem[74G[ OK ]
> > > * Stopping Populate and link to /run filesystem[74G[ OK ]
> > > * Starting Clean /tmp directory[74G[ OK ]
> > > * Stopping Track if upstart is running in a container[74G[ OK ]
> > > * Stopping Clean /tmp directory[74G[ OK ]
> > > * Starting Initialize or finalize resolvconf[74G[ OK ]
> > > * Starting set console keymap[74G[ OK ]
> > > * Starting Signal sysvinit that virtual filesystems are mounted[74G[ OK ]
> > > * Starting Signal sysvinit that virtual filesystems are mounted[74G[ OK ]
> > > * Starting Bridge udev events into upstart[74G[ OK ]
> > > * Starting Signal sysvinit that remote filesystems are mounted[74G[ OK ]
> > > * Stopping set console keymap[74G[ OK ]
> > > * Starting device node and kernel event manager[74G[ OK ]
> > > * Starting load modules from /etc/modules[74G[ OK ]
> > > * Starting cold plug devices[74G[ OK ]
> > > * Starting log initial device creation[74G[ OK ]
> > > * Stopping Read required files in advance (for other mountpoints)[74G[ OK ]
> > > * Stopping load modules from /etc/modules[74G[ OK ]
> > > * Starting Signal sysvinit that local filesystems are mounted[74G[ OK ]
> > > * Starting flush early job output to logs[74G[ OK ]
> > > * Stopping Mount filesystems on boot[74G[ OK ]
> > > * Stopping flush early job output to logs[74G[ OK ]
> > > * Starting D-Bus system message bus[74G[ OK ]
> > > * Starting SystemD login management service[74G[ OK ]
> > > * Starting system logging daemon[74G[ OK ]
> > > * Stopping cold plug devices[74G[ OK ]
> > > * Starting Uncomplicated firewall[74G[ OK ]
> > > * Starting configure network device security[74G[ OK ]
> > > * Stopping log initial device creation[74G[ OK ]
> > > * Starting configure network device security[74G[ OK ]
> > > * Starting save udev log and update rules[74G[ OK ]
> > > * Starting set console font[74G[ OK ]
> > > * Stopping save udev log and update rules[74G[ OK ]
> > > * Starting Mount network filesystems[74G[ OK ]
> > > * Starting Failsafe Boot Delay[74G[ OK ]
> > > * Starting configure network device security[74G[ OK ]
> > > * Stopping Mount network filesystems[74G[ OK ]
> > > * Starting configure network device[74G[ OK ]
> > > * Starting configure network device[74G[ OK ]
> > > * Starting Bridge file events into upstart[74G[ OK ]
> > > * Starting Bridge socket events into upstart[74G[ OK ]
> > > * Stopping set console font[74G[ OK ]
> > > * Starting userspace bootsplash[74G[ OK ]
> > > * Starting Send an event to indicate plymouth is up[74G[ OK ]
> > > * Stopping userspace bootsplash[74G[ OK ]
> > > * Stopping Send an event to indicate plymouth is up[74G[ OK ]
> > > * Starting Mount network filesystems[74G[ OK ]
> > > init: failsafe main process (591) killed by TERM signal
> > > * Stopping Failsafe Boot Delay[74G[ OK ]
> > > * Starting System V initialisation compatibility[74G[ OK ]
> > > * Stopping Mount network filesystems[74G[ OK ]
> > > * Starting configure virtual network devices[74G[ OK ]
> > > * Stopping System V initialisation compatibility[74G[ OK ]
> > > * Starting System V runlevel compatibility[74G[ OK ]
> > > * Starting deferred execution scheduler[74G[ OK ]
> > > * Starting regular background program processing daemon[74G[ OK ]
> > > * Starting ACPI daemon[74G[ OK ]
> > > * Starting save kernel messages[74G[ OK ]
> > > * Starting CPU interrupts balancing daemon[74G[ OK ]
> > > * Stopping save kernel messages[74G[ OK ]
> > > * Starting OpenSSH server[74G[ OK ]
> > > * Starting automatic crash report generation[74G[ OK ]
> > > * Restoring resolver state... [80G
[74G[ OK ]
> > > eth0 Link encap:Ethernet HWaddr 52:54:79:12:34:57 inet addr:192.168.0.21 Bcast:192.168.0.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:34 errors:0 dropped:24 overruns:0 frame:0 TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:5780 (5.7 KB) TX bytes:800 (800.0 B) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
> > > * Stopping System V runlevel compatibility[74G[ OK ]
> > > init: plymouth-upstart-bridge main process ended, respawning
> > > sh (1429) used greatest stack depth: 11752 bytes left
> > > sh (1454) used greatest stack depth: 11528 bytes left
> > > random: nonblocking pool is initialized
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > sh (2785) used greatest stack depth: 11480 bytes left
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > Adding 4191228k swap on /dev/vda5. Priority:-1 extents:1 across:4191228k FS
> > > BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
> > > IP: [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > PGD 0
> > > Oops: 0000 [#1] SMP
> > > Dumping ftrace buffer:
> > > (ftrace buffer empty)
> > > Modules linked in:
> > > CPU: 1 PID: 26445 Comm: sh Not tainted 4.3.0-rc5-mm1-diet-meta+ #1545
> > > Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > > task: ffff8800b9af3480 ti: ffff88007fea0000 task.ti: ffff88007fea0000
> > > RIP: 0010:[<ffffffff810782a9>] [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP: 0018:ffff88007fea3648 EFLAGS: 00010202
> > > RAX: 0000000000000001 RBX: ffffea0002324900 RCX: ffff88007fea37e8
> > > RDX: 0000000000000000 RSI: ffff88007fea36e8 RDI: 0000000000000008
> > > RBP: ffff88007fea3648 R08: ffffffff818446a0 R09: ffff8800b9af4c80
> > > R10: 0000000000000216 R11: 0000000000000001 R12: ffff88007f58d6e1
> > > R13: ffff88007f58d6e0 R14: 0000000000000008 R15: 0000000000000001
> > > FS: 00007f0993e78740(0000) GS:ffff8800bfa20000(0000) knlGS:0000000000000000
> > > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > > CR2: 0000000000000008 CR3: 000000007edee000 CR4: 00000000000006a0
> > > Stack:
> > > ffff88007fea3678 ffffffff81124ff0 ffffea0002324900 ffff88007fea36e8
> > > ffff88009ffe8400 0000000000000000 ffff88007fea36c0 ffffffff81125733
> > > ffff8800bfa34540 ffffffff8105dc9d ffffea0002324900 ffff88007fea37e8
> > > Call Trace:
> > > [<ffffffff81124ff0>] page_lock_anon_vma_read+0x60/0x180
> > > [<ffffffff81125733>] rmap_walk+0x1b3/0x3f0
> > > [<ffffffff8105dc9d>] ? finish_task_switch+0x5d/0x1f0
> > > [<ffffffff81125b13>] page_referenced+0x1a3/0x220
> > > [<ffffffff81123e30>] ? __page_check_address+0x1a0/0x1a0
> > > [<ffffffff81124f90>] ? page_get_anon_vma+0xd0/0xd0
> > > [<ffffffff81123820>] ? anon_vma_ctor+0x40/0x40
> > > [<ffffffff8110087b>] shrink_page_list+0x5ab/0xde0
> > > [<ffffffff8110174c>] shrink_inactive_list+0x18c/0x4b0
> > > [<ffffffff811023bd>] shrink_lruvec+0x59d/0x740
> > > [<ffffffff811025f0>] shrink_zone+0x90/0x250
> > > [<ffffffff811028dd>] do_try_to_free_pages+0x12d/0x3b0
> > > [<ffffffff81102d3d>] try_to_free_mem_cgroup_pages+0x9d/0x120
> > > [<ffffffff811496c3>] try_charge+0x163/0x700
> > > [<ffffffff81149cb4>] mem_cgroup_do_precharge+0x54/0x70
> > > [<ffffffff81149e45>] mem_cgroup_can_attach+0x175/0x1b0
> > > [<ffffffff811b2c57>] ? kernfs_iattrs.isra.6+0x37/0xd0
> > > [<ffffffff81148e70>] ? get_mctgt_type+0x320/0x320
> > > [<ffffffff810a9d29>] cgroup_migrate+0x149/0x440
> > > [<ffffffff810aa60c>] cgroup_attach_task+0x7c/0xe0
> > > [<ffffffff810aa904>] __cgroup_procs_write.isra.33+0x1d4/0x2b0
> > > [<ffffffff810aaa10>] cgroup_tasks_write+0x10/0x20
> > > [<ffffffff810a6238>] cgroup_file_write+0x38/0xf0
> > > [<ffffffff811b54ad>] kernfs_fop_write+0x11d/0x170
> > > [<ffffffff81153918>] __vfs_write+0x28/0xe0
> > > [<ffffffff8116e614>] ? __fd_install+0x24/0xc0
> > > [<ffffffff810784a1>] ? percpu_down_read+0x21/0x50
> > > [<ffffffff81153e91>] vfs_write+0xa1/0x170
> > > [<ffffffff81154716>] SyS_write+0x46/0xa0
> > > [<ffffffff81420a17>] entry_SYSCALL_64_fastpath+0x12/0x6a
> > > Code: 5e 82 3a 00 48 83 c4 08 5b 5d c3 48 89 45 f0 e8 9b 6a 3a 00 48 8b 45 f0 eb df 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 <48> 8b 07 48 89 c2 48 83 c2 01 7e 07 f0 48 0f b1 17 75 f0 48 f7
> > > RIP [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP <ffff88007fea3648>
> > > CR2: 0000000000000008
> > > BUG: unable to handle kernel ---[ end trace e81a82c8122b447d ]---
> > > Kernel panic - not syncing: Fatal exception
> > >
> > > NULL pointer dereference at 0000000000000008
> > > IP: [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > PGD 0
> > > Oops: 0000 [#2] SMP
> > > Dumping ftrace buffer:
> > > (ftrace buffer empty)
> > > Modules linked in:
> > > CPU: 10 PID: 59 Comm: khugepaged Tainted: G D 4.3.0-rc5-mm1-diet-meta+ #1545
> > > Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
> > > task: ffff8800b9851a40 ti: ffff8800b985c000 task.ti: ffff8800b985c000
> > > RIP: 0010:[<ffffffff810782a9>] [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP: 0018:ffff8800b985f778 EFLAGS: 00010202
> > > RAX: 0000000000000001 RBX: ffffea0002321800 RCX: ffff8800b985f918
> > > RDX: 0000000000000000 RSI: ffff8800b985f818 RDI: 0000000000000008
> > > RBP: ffff8800b985f778 R08: ffffffff818446a0 R09: ffff8800b9853240
> > > R10: 000000000000ba03 R11: 0000000000000001 R12: ffff88007f58d6e1
> > > R13: ffff88007f58d6e0 R14: 0000000000000008 R15: 0000000000000001
> > > FS: 0000000000000000(0000) GS:ffff8800bfb40000(0000) knlGS:0000000000000000
> > > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > > CR2: 0000000000000008 CR3: 0000000001808000 CR4: 00000000000006a0
> > > Stack:
> > > ffff8800b985f7a8 ffffffff81124ff0 ffffea0002321800 ffff8800b985f818
> > > ffff88009ffe8400 0000000000000000 ffff8800b985f7f0 ffffffff81125733
> > > ffff8800bfb54540 ffffffff8105dc9d ffffea0002321800 ffff8800b985f918
> > > Call Trace:
> > > [<ffffffff81124ff0>] page_lock_anon_vma_read+0x60/0x180
> > > [<ffffffff81125733>] rmap_walk+0x1b3/0x3f0
> > > [<ffffffff8105dc9d>] ? finish_task_switch+0x5d/0x1f0
> > > [<ffffffff81125b13>] page_referenced+0x1a3/0x220
> > > [<ffffffff81123e30>] ? __page_check_address+0x1a0/0x1a0
> > > [<ffffffff81124f90>] ? page_get_anon_vma+0xd0/0xd0
> > > [<ffffffff81123820>] ? anon_vma_ctor+0x40/0x40
> > > [<ffffffff8110087b>] shrink_page_list+0x5ab/0xde0
> > > [<ffffffff8110174c>] shrink_inactive_list+0x18c/0x4b0
> > > [<ffffffff811023bd>] shrink_lruvec+0x59d/0x740
> > > [<ffffffff811025f0>] shrink_zone+0x90/0x250
> > > [<ffffffff811028dd>] do_try_to_free_pages+0x12d/0x3b0
> > > [<ffffffff81102d3d>] try_to_free_mem_cgroup_pages+0x9d/0x120
> > > [<ffffffff811496c3>] try_charge+0x163/0x700
> > > [<ffffffff8141d1f3>] ? schedule+0x33/0x80
> > > [<ffffffff8114d45f>] mem_cgroup_try_charge+0x9f/0x1d0
> > > [<ffffffff811434bc>] khugepaged+0x7cc/0x1ac0
> > > [<ffffffff81066e01>] ? hrtick_update+0x1/0x70
> > > [<ffffffff81072430>] ? prepare_to_wait_event+0xf0/0xf0
> > > [<ffffffff81142cf0>] ? total_mapcount+0x70/0x70
> > > [<ffffffff81056cd9>] kthread+0xc9/0xe0
> > > [<ffffffff81056c10>] ? kthread_park+0x60/0x60
> > > [<ffffffff81420d6f>] ret_from_fork+0x3f/0x70
> > > [<ffffffff81056c10>] ? kthread_park+0x60/0x60
> > > Code: 5e 82 3a 00 48 83 c4 08 5b 5d c3 48 89 45 f0 e8 9b 6a 3a 00 48 8b 45 f0 eb df 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 <48> 8b 07 48 89 c2 48 83 c2 01 7e 07 f0 48 0f b1 17 75 f0 48 f7
> > > RIP [<ffffffff810782a9>] down_read_trylock+0x9/0x30
> > > RSP <ffff8800b985f778>
> > > CR2: 0000000000000008
> > > ---[ end trace e81a82c8122b447e ]---
> > > Shutting down cpus with NMI
> > > Dumping ftrace buffer:
> > > (ftrace buffer empty)
> > > Kernel Offset: disabled
> >
>
> --
> Kirill A. Shutemov
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Next message: Minchan Kim: "Re: [PATCH -next] mm: Fix build on non-MMU systems"
Previous message: Frank Rowand: "Re: Alternative approach to solve the deferred probe"
In reply to: Kirill A. Shutemov: "Re: kernel oops on mmotm-2015-10-15-15-20"
Next in thread: Hugh Dickins: "Re: kernel oops on mmotm-2015-10-15-15-20"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]