Re: bug in xfs: can't recovery metadata log

From: Drunkard Zhang
Date: Tue Jun 07 2011 - 08:16:05 EST

Next message: Daniel Lezcano: "Re: [Patch] doc: remove ns_cgroup from feature-removal-schedule.txt"
Previous message: Sedat Dilek: "[v3.0-rc2] Creating an archive-tarball from linux-2.6 GIT repository"
In reply to: Christoph Hellwig: "Re: bug in xfs: can't recovery metadata log"
Next in thread: Michael Monnerie: "Re: bug in xfs: can't recovery metadata log"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

2011/6/7 Drunkard Zhang <gongfan193@xxxxxxxxx>:
> The log recovery failure happened after a hard reboot, I did "mount
> /dev/lg/log /mnt/temp/" twice, but the similar dmesg error.
>
> The xfs lives on LVM, with 4x2TB SATA II disk.
>
> The first time:
> [ 1479.130446] XFS mounting filesystem dm-0
> [ 1479.226525] Starting XFS recovery on filesystem: dm-0 (logdev: internal)
> [ 1506.217842] BUG: unable to handle kernel NULL pointer dereference
> at 00000000000000f8
> [ 1506.218468] IP: [<ffffffff81235f9c>] xfs_cmn_err+0x6b/0x92
> [ 1506.218680] PGD 2175c4067 PUD 22f4ff067 PMD 0
> [ 1506.218887] Oops: 0000 [#1] PREEMPT SMP
> [ 1506.219138] last sysfs file: /sys/devices/virtual/block/dm-0/dev
> [ 1506.219345] CPU 1
> [ 1506.219353] Modules linked in:
> [ 1506.219732]
> [ 1506.219923] Pid: 21233, comm: mount Not tainted 2.6.38.5 #2 System
> manufacturer SÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃ/Z8NA-D6(C)
> [ 1506.220989] RIP: 0010:[<ffffffff81235f9c>] Â[<ffffffff81235f9c>]
> xfs_cmn_err+0x6b/0x92
> [ 1506.221424] RSP: 0018:ffff88021752da08 ÂEFLAGS: 00010246
> [ 1506.221627] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff816be16c
> [ 1506.221837] RDX: ffff88021752da28 RSI: ffffffff816bdced RDI: 0000000000000008
> [ 1506.222079] RBP: ffff88021752da88 R08: ffffffff816bdb79 R09: 00000000000005f6
> [ 1506.222289] R10: ffff8802177c32c0 R11: 00000530e8002000 R12: 0000000000000000
> [ 1506.222572] R13: ffffffff816be16c R14: ffff88021752db04 R15: 00000000000008e2
> [ 1506.222830] FS: Â00007fa0c93d2740(0000) GS:ffff8800bf440000(0000)
> knlGS:0000000000000000
> [ 1506.223265] CS: Â0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 1506.223471] CR2: 00000000000000f8 CR3: 000000021754e000 CR4: 00000000000006e0
> [ 1506.223728] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 1506.223938] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 1506.224190] Process mount (pid: 21233, threadinfo ffff88021752c000,
> task ffff88022e239440)
> [ 1506.224585] Stack:
> [ 1506.224776] Â0000000000000020 ffff88021752da98 ffff88021752da38
> ffff88021752da48
> [ 1506.225216] Âffffffff816be16c ffff88021752da08 2d0100008de51400
> ffffffff8122922b
> [ 1506.225616] Âffff880202000000 ffff8802176e8af0 ffffffff816bdb79
> 00000000000005f6
> [ 1506.226058] Call Trace:
> [ 1506.226301] Â[<ffffffff8122922b>] ? kmem_zone_zalloc+0x1f/0x30
> [ 1506.226549] Â[<ffffffff812098b5>] xfs_error_report+0x39/0x40
> [ 1506.226805] Â[<ffffffff811e8340>] ? xfs_free_extent+0x8e/0xae
> [ 1506.227056] Â[<ffffffff811e75cf>] xfs_free_ag_extent+0x3e7/0x70b
> [ 1506.227306] Â[<ffffffff811e8340>] xfs_free_extent+0x8e/0xae
> [ 1506.227514] Â[<ffffffff81219fa2>] xlog_recover_process_efi+0x113/0x16c
> [ 1506.227724] Â[<ffffffff81223c6e>] ? xfs_trans_ail_cursor_set+0x15/0x1c
> [ 1506.227934] Â[<ffffffff8121a0ef>] xlog_recover_process_efis+0x64/0xad
> [ 1506.228182] Â[<ffffffff8121a6a7>] xlog_recover_finish+0x15/0xb6
> [ 1506.228390] Â[<ffffffff8121784b>] xfs_log_mount_finish+0x1b/0x1d
> [ 1506.228597] Â[<ffffffff81220d3f>] xfs_mountfs+0x4ec/0x615
> [ 1506.228803] Â[<ffffffff8123439a>] xfs_fs_fill_super+0x1e5/0x2e8
> [ 1506.229055] Â[<ffffffff810fc149>] mount_bdev+0x13b/0x19e
> [ 1506.229259] Â[<ffffffff812341b5>] ? xfs_fs_fill_super+0x0/0x2e8
> [ 1506.229467] Â[<ffffffff812328e9>] xfs_fs_mount+0x10/0x12
> [ 1506.229672] Â[<ffffffff810fb860>] vfs_kern_mount+0xb8/0x1f3
> [ 1506.229877] Â[<ffffffff810fb9f9>] do_kern_mount+0x48/0xd8
> [ 1506.230127] Â[<ffffffff811137d6>] do_mount+0x729/0x791
> [ 1506.230375] Â[<ffffffff810c2588>] ? memdup_user+0x43/0x63
> [ 1506.230629] Â[<ffffffff810c25e1>] ? strndup_user+0x39/0x4f
> [ 1506.230834] Â[<ffffffff811138c1>] sys_mount+0x83/0xbe
> [ 1506.231080] Â[<ffffffff810028fb>] system_call_fastpath+0x16/0x1b
> [ 1506.231285] Code: 31 e4 48 8d 45 80 48 8d 55 10 48 89 45 a8 48 89
> 55 88 31 c0 48 8d 55 b0 c7 45 80 20 00 00 00 48 89 55 90 4c 89 6d a0
> 48 8d 55 a0 <48> 8b b3 f8 00 00 00 48 c7 c7 78 14 6c 81 e8 1f ff 2b 00
> 45 85
> [ 1506.232093] RIP Â[<ffffffff81235f9c>] xfs_cmn_err+0x6b/0x92
> [ 1506.232300] ÂRSP <ffff88021752da08>
> [ 1506.232498] CR2: 00000000000000f8
> [ 1506.233086] ---[ end trace 6ff9d0214348600a ]---
>
> The second time:
> [ Â725.637712] BUG: unable to handle kernel NULL pointer dereference
> at 00000000000000f8
> [ Â725.638302] IP: [<ffffffff81235f9c>] xfs_cmn_err+0x6b/0x92
> [ Â725.638579] PGD 22b1d3067 PUD 22b21f067 PMD 0
> [ Â725.638787] Oops: 0000 [#1] PREEMPT SMP
> [ Â725.638993] last sysfs file: /sys/devices/virtual/block/dm-0/dev
> [ Â725.639202] CPU 0
> [ Â725.639210] Modules linked in:
> [ Â725.639664]
> [ Â725.639857] Pid: 2537, comm: mount Not tainted 2.6.38.5 #2 System
> manufacturer SÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃÃ/Z8NA-D6(C)
> [ Â725.640841] RIP: 0010:[<ffffffff81235f9c>] Â[<ffffffff81235f9c>]
> xfs_cmn_err+0x6b/0x92
> [ Â725.641241] RSP: 0018:ffff88022b28ba08 ÂEFLAGS: 00010246
> [ Â725.641512] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff816be16c
> [ Â725.641723] RDX: ffff88022b28ba28 RSI: ffffffff816bdced RDI: 0000000000000008
> [ Â725.641936] RBP: ffff88022b28ba88 R08: ffffffff816bdb79 R09: 00000000000005f6
> [ Â725.642148] R10: ffff8802217c9680 R11: 00000530e8002000 R12: 0000000000000000
> [ Â725.642428] R13: ffffffff816be16c R14: ffff88022b28bb04 R15: 00000000000008e2
> [ Â725.642641] FS: Â00007f857cd34740(0000) GS:ffff8800bf400000(0000)
> knlGS:0000000000000000
> [ Â725.643041] CS: Â0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ Â725.643248] CR2: 00000000000000f8 CR3: 000000022b24a000 CR4: 00000000000006f0
> [ Â725.643565] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ Â725.643778] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ Â725.643990] Process mount (pid: 2537, threadinfo ffff88022b28a000,
> task ffff88022e4f2f40)
> [ Â725.644478] Stack:
> [ Â725.644671] Â0000000000000020 ffff88022b28ba98 ffff88022b28ba38
> ffff88022b28ba48
> [ Â725.645072] Âffffffff816be16c ffff88022b28ba08 2d0100008de51400
> ffffffff8122922b
> [ Â725.645607] Âffff880202000000 ffff88022b2d28c0 ffffffff816bdb79
> 00000000000005f6
> [ Â725.646010] Call Trace:
> [ Â725.646211] Â[<ffffffff8122922b>] ? kmem_zone_zalloc+0x1f/0x30
> [ Â725.646491] Â[<ffffffff812098b5>] xfs_error_report+0x39/0x40
> [ Â725.646700] Â[<ffffffff811e8340>] ? xfs_free_extent+0x8e/0xae
> [ Â725.646909] Â[<ffffffff811e75cf>] xfs_free_ag_extent+0x3e7/0x70b
> [ Â725.647119] Â[<ffffffff811e8340>] xfs_free_extent+0x8e/0xae
> [ Â725.647329] Â[<ffffffff81219fa2>] xlog_recover_process_efi+0x113/0x16c
> [ Â725.647632] Â[<ffffffff81223c6e>] ? xfs_trans_ail_cursor_set+0x15/0x1c
> [ Â725.647844] Â[<ffffffff8121a0ef>] xlog_recover_process_efis+0x64/0xad
> [ Â725.648056] Â[<ffffffff8121a6a7>] xlog_recover_finish+0x15/0xb6
> [ Â725.648266] Â[<ffffffff8121784b>] xfs_log_mount_finish+0x1b/0x1d
> [ Â725.648539] Â[<ffffffff81220d3f>] xfs_mountfs+0x4ec/0x615
> [ Â725.648747] Â[<ffffffff8123439a>] xfs_fs_fill_super+0x1e5/0x2e8
> [ Â725.648958] Â[<ffffffff810fc149>] mount_bdev+0x13b/0x19e
> [ Â725.649164] Â[<ffffffff812341b5>] ? xfs_fs_fill_super+0x0/0x2e8
> [ Â725.649438] Â[<ffffffff812328e9>] xfs_fs_mount+0x10/0x12
> [ Â725.649646] Â[<ffffffff810fb860>] vfs_kern_mount+0xb8/0x1f3
> [ Â725.649854] Â[<ffffffff810fb9f9>] do_kern_mount+0x48/0xd8
> [ Â725.650063] Â[<ffffffff811137d6>] do_mount+0x729/0x791
> [ Â725.650271] Â[<ffffffff810c2588>] ? memdup_user+0x43/0x63
> [ Â725.650545] Â[<ffffffff810c25e1>] ? strndup_user+0x39/0x4f
> [ Â725.650753] Â[<ffffffff811138c1>] sys_mount+0x83/0xbe
> [ Â725.650961] Â[<ffffffff810028fb>] system_call_fastpath+0x16/0x1b
> [ Â725.651169] Code: 31 e4 48 8d 45 80 48 8d 55 10 48 89 45 a8 48 89
> 55 88 31 c0 48 8d 55 b0 c7 45 80 20 00 00 00 48 89 55 90 4c 89 6d a0
> 48 8d 55 a0 <48> 8b b3 f8 00 00 00 48 c7 c7 78 14 6c 81 e8 1f ff 2b 00
> 45 85
> [ Â725.652012] RIP Â[<ffffffff81235f9c>] xfs_cmn_err+0x6b/0x92
> [ Â725.652221] ÂRSP <ffff88022b28ba08>
> [ Â725.652484] CR2: 00000000000000f8
> [ Â725.653295] ---[ end trace 1dadc2ff14d7c60f ]---
>

With 2.6.39.1 too, output not the same thing. Here's console output:
log1 ~ # mount /dev/lg/log /mnt/temp/ &
[1] 3911
log1 ~ # mount: Structure needs cleaning
[1]+ Exit 32 mount /dev/lg/log /mnt/temp/

Here's related dmesg:
[ 123.634533] XFS (dm-0): Mounting Filesystem
[ 123.640180] XFS (dm-0): Starting recovery (logdev: internal)
[ 138.583463] XFS: Internal error XFS_WANT_CORRUPTED_GOTO at line
1540 of file fs/xfs/xfs_alloc.c. Caller 0xffffffff811eca7b
[ 138.583465]
[ 138.583470] Pid: 3911, comm: mount Not tainted 2.6.39.1 #1
[ 138.583472] Call Trace:
[ 138.583484] [<ffffffff8120dfe8>] xfs_error_report+0x38/0x3a
[ 138.583489] [<ffffffff811eca7b>] ? xfs_free_extent+0xb8/0xdd
[ 138.583493] [<ffffffff811e999c>] ? xfs_alloc_lookup_eq+0x14/0x16
[ 138.583497] [<ffffffff811ebd2d>] xfs_free_ag_extent+0x3dc/0x6b3
[ 138.583501] [<ffffffff811eca7b>] xfs_free_extent+0xb8/0xdd
[ 138.583506] [<ffffffff8121e689>] xlog_recover_process_efi+0x113/0x16c
[ 138.583511] [<ffffffff8121e7d6>] xlog_recover_process_efis+0x64/0xad
[ 138.583516] [<ffffffff8121edb5>] xlog_recover_finish+0x15/0x8c
[ 138.583520] [<ffffffff8121bf6f>] xfs_log_mount_finish+0x1b/0x1d
[ 138.583525] [<ffffffff81225330>] xfs_mountfs+0x487/0x5ab
[ 138.583531] [<ffffffff812386f3>] xfs_fs_fill_super+0x1b3/0x2b6
[ 138.583536] [<ffffffff810fd37e>] mount_bdev+0x138/0x19b
[ 138.583540] [<ffffffff81238540>] ? xfs_mountfs_check_barriers+0x63/0x63
[ 138.583546] [<ffffffff811127e1>] ? alloc_vfsmnt+0xa6/0x18c
[ 138.583550] [<ffffffff81236d5d>] xfs_fs_mount+0x10/0x12
[ 138.583553] [<ffffffff810fcc3f>] mount_fs+0x6b/0x14f
[ 138.583558] [<ffffffff810c7800>] ? __alloc_percpu+0xb/0xd
[ 138.583563] [<ffffffff81112fe5>] vfs_kern_mount+0x60/0x98
[ 138.583567] [<ffffffff81113800>] do_kern_mount+0x48/0xd8
[ 138.583571] [<ffffffff81114de3>] do_mount+0x6e1/0x744
[ 138.583575] [<ffffffff810c3498>] ? memdup_user+0x43/0x63
[ 138.583578] [<ffffffff810c34f1>] ? strndup_user+0x39/0x4f
[ 138.583582] [<ffffffff81114ec9>] sys_mount+0x83/0xbd
[ 138.583589] [<ffffffff814e8d7b>] system_call_fastpath+0x16/0x1b
[ 138.583669] XFS (dm-0): Failed to recover EFIs
[ 138.583672] XFS (dm-0): log mount finish failed
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Next message: Daniel Lezcano: "Re: [Patch] doc: remove ns_cgroup from feature-removal-schedule.txt"
Previous message: Sedat Dilek: "[v3.0-rc2] Creating an archive-tarball from linux-2.6 GIT repository"
In reply to: Christoph Hellwig: "Re: bug in xfs: can't recovery metadata log"
Next in thread: Michael Monnerie: "Re: bug in xfs: can't recovery metadata log"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]