2.6.37 vlans on bnx2 not functional, panic with tcpdump

From: Iain Paton
Date: Thu Jan 06 2011 - 16:32:28 EST


Hi,

vlans don't appear to be functional on my HP DL380G6 with onboard bnx2 adapter using vanilla 2.6.37 kernel. No tagged vlan traffic is arriving at the vlan interface.

To reproduce, use vanilla 2.6.37 built with the attached config

ip link add link eth0 name v406 type vlan id 406
ip link set up dev eth0
ip link set up dev v406
ip addr add 10.251.0.3/16 dev v406

from another machine on the same vlan run a ping to 10.251.0.3, ping returns destination host unreachable.

tcpdump -n -e -i v406 shows no traffic.

If I then run

tcpdump -n -e -i eth0

while the ping is still running I get

[ 112.190114] BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
[ 112.198912] IP: [<ffffffff813f5a34>] __skb_recv_datagram+0x124/0x2a0
[ 112.214203] PGD 31fa05067 PUD 31fb51067 PMD 0
[ 112.220207] Oops: 0002 [#1] SMP
[ 112.228949] last sysfs file: /sys/devices/pci0000:00/0000:00:1e.0/0000:01:04.6/class
[ 112.248201] CPU 0
[ 112.251342] Modules linked in: 8021q garp stp llc
[ 112.269199]
[ 112.269692] Pid: 1370, comm: rpc.statd Not tainted 2.6.37-64 #1 /ProLiant DL380 G6
[ 112.275164] RIP: 0010:[<ffffffff813f5a34>] [<ffffffff813f5a34>] __skb_recv_datagram+0x124/0x2a0
[ 112.293143] RSP: 0018:ffff88031fbd5a88 EFLAGS: 00010046
[ 112.300238] RAX: 0000000000000246 RBX: 0000000000000000 RCX: ffff88019f91a8c0
[ 112.319307] RDX: ffff88019f94b500 RSI: ffff88031fbd5b44 RDI: ffff88019f91a8d4
[ 112.329271] RBP: ffff88031fbd5b28 R08: 0000000000000000 R09: 0000000000001000
[ 112.339123] R10: 0000000000000000 R11: 0000000000000246 R12: ffff88031fbd5ac8
[ 112.360207] R13: ffff88019f91a8c0 R14: ffff88031fbd5ae0 R15: ffff88019f91a8d4
[ 112.363278] FS: 00007ff90cd77700(0000) GS:ffff8800d7200000(0000) knlGS:0000000000000000
[ 112.366216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 112.368311] CR2: 0000000000000008 CR3: 000000031fb1a000 CR4: 00000000000006f0
[ 112.375050] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 112.379300] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 112.381913] Process rpc.statd (pid: 1370, threadinfo ffff88031fbd4000, task ffff88031fe00000)
[ 112.387746] Stack:
[ 112.388474] ffff88031fbd5ae8 ffffffff8141eb50 7fffffffffffffff ffff88031fe00000
[ 112.404676] ffff88031fbd5bc4 ffff88031fbd5b44 000000001fbd5b88 ffff88031fe00000
[ 112.411531] ffff88019f91a800 ffff88019f8be600 000000000000055a ffffffff81b8d780
[ 112.415367] Call Trace:
[ 112.416223] [<ffffffff8141eb50>] ? netlink_dump+0x1a0/0x200
[ 112.418289] [<ffffffff8141fa4d>] ? netlink_dump_start+0x18d/0x1b0
[ 112.420439] [<ffffffff813f5bcf>] skb_recv_datagram+0x1f/0x30
[ 112.422686] [<ffffffff8141eeec>] netlink_recvmsg+0x7c/0x440
[ 112.424846] [<ffffffff813f1ea2>] ? __kfree_skb+0x42/0xa0
[ 112.444125] [<ffffffff813e9cf8>] sock_recvmsg+0xf8/0x130
[ 112.449889] [<ffffffff814600bf>] ? inet_sendmsg+0x5f/0xb0
[ 112.451876] [<ffffffff813e9e7e>] ? sock_sendmsg+0xee/0x130
[ 112.454213] [<ffffffff810b6869>] ? __do_fault+0x3b9/0x4a0
[ 112.456961] [<ffffffff810a7b48>] ? lru_cache_add_lru+0x28/0x50
[ 112.481554] [<ffffffff813e8769>] ? might_fault+0x9/0x10
[ 112.483393] [<ffffffff813e9964>] ? move_addr_to_user+0x84/0xa0
[ 112.485667] [<ffffffff813ea04d>] __sys_recvmsg+0x13d/0x2b0
[ 112.492094] [<ffffffff8141ff2e>] ? netlink_table_ungrab+0x2e/0x30
[ 112.512132] [<ffffffff8141ffb9>] ? netlink_insert+0x89/0x160
[ 112.514165] [<ffffffff813eae40>] ? move_addr_to_kernel+0x50/0x60
[ 112.531071] [<ffffffff813eb6b4>] ? sys_sendto+0x104/0x140
[ 112.541470] [<ffffffff813e9964>] ? move_addr_to_user+0x84/0xa0
[ 112.549085] [<ffffffff813eb4c2>] ? sys_getsockname+0xa2/0xc0
[ 112.569417] [<ffffffff813ebe14>] sys_recvmsg+0x44/0x90
[ 112.571711] [<ffffffff81002552>] system_call_fastpath+0x16/0x1b
[ 112.573894] Code: 00 00 00 e9 4f ff ff ff 0f 1f 80 00 00 00 00 ff 8b d0 00 00 00 48 8b 1a 48 8b 4a 08 48 c7 02 00 00 00 00 48 c7 42 08 00 00 00 00 <48> 89 4b 08 48 89 19 e9 7c ff ff ff 31 c0 87 87 64 01 00 00 f7
[ 112.592492] RIP [<ffffffff813f5a34>] __skb_recv_datagram+0x124/0x2a0
[ 112.603649] RSP <ffff88031fbd5a88>
[ 112.607123] CR2: 0000000000000008
[ 112.609064] ---[ end trace f6cbe3b43db03698 ]---

The stack dump isn't always the same, sometimes I'll see

[ 236.078335] general protection fault: 0000 [#1] SMP

and the dump shows scsi/blk or xfs or cpu_idle etc. so I don't know how relevant this particular dump is.

What's consistent is that running tcpdump against eth0 while there's tagged traffic arriving on eth0 will kill the kernel.

If I don't run tcpdump, the machine will stay up, but it's not much use if it can't use the network.

On 2.6.36 I needed the patch from http://patchwork.ozlabs.org/patch/69516/ to prevent a similar looking immediate crash on boot. I don't have logs from that to compare with and I know the vlan code has changed quite a bit since then.

The same issue has been duplicated on two physically different servers, so hopefully not hardware related. The full boot log from this latest attempt is attached.

Iain

Attachment: 2.6.37-64-config.gz
Description: application/gzip

Decompressing Linux... Parsing ELF... done.
Booting the kernel.
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.37-64 (root@dl380g6-64bit) (gcc version 4.5.0 (GCC) ) #1 SMP Thu Jan 6 08:00:48 GMT 2011
[ 0.000000] Command line: BOOT_IMAGE=2637 root=6802 ro root=/dev/sda2 console=uart,io,0x2f8,115200
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
[ 0.000000] BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
[ 0.000000] BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[ 0.000000] BIOS-e820: 0000000000100000 - 00000000d762f000 (usable)
[ 0.000000] BIOS-e820: 00000000d762f000 - 00000000d763c000 (ACPI data)
[ 0.000000] BIOS-e820: 00000000d763c000 - 00000000d763d000 (usable)
[ 0.000000] BIOS-e820: 00000000d763d000 - 00000000dc000000 (reserved)
[ 0.000000] BIOS-e820: 00000000fec00000 - 00000000fee10000 (reserved)
[ 0.000000] BIOS-e820: 00000000ff800000 - 0000000100000000 (reserved)
[ 0.000000] BIOS-e820: 0000000100000000 - 0000000327fff000 (usable)
[ 0.000000] Early serial console at I/O port 0x2f8 (options '115200')
[ 0.000000] bootconsole [uart0] enabled
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI 2.7 present.
[ 0.000000] No AGP bridge found
[ 0.000000] last_pfn = 0x327fff max_arch_pfn = 0x400000000
[ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[ 0.000000] last_pfn = 0xd763d max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [ffff8800000f4f80] f4f80
[ 0.000000] init_memory_mapping: 0000000000000000-00000000d763d000
[ 0.000000] init_memory_mapping: 0000000100000000-0000000327fff000
[ 0.000000] ACPI: RSDP 00000000000f4f00 00024 (v02 HP )
[ 0.000000] ACPI: XSDT 00000000d7630040 000AC (v01 HP ProLiant 00000002 � 0000162E)
[ 0.000000] ACPI: FACP 00000000d7630140 000F4 (v03 HP ProLiant 00000002 � 0000162E)
[ 0.000000] ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20101013/tbfadt-607)
[ 0.000000] ACPI Warning: Invalid length for Pm2ControlBlock: 32, using default 8 (20101013/tbfadt-607)
[ 0.000000] ACPI: DSDT 00000000d7630240 02005 (v01 HP DSDT 00000001 INTL 20030228)
[ 0.000000] ACPI: FACS 00000000d762f100 00040
[ 0.000000] ACPI: SPCR 00000000d762f140 00050 (v01 HP SPCRRBSU 00000001 � 0000162E)
[ 0.000000] ACPI: MCFG 00000000d762f1c0 0003C (v01 HP ProLiant 00000001 00000000)
[ 0.000000] ACPI: HPET 00000000d762f200 00038 (v01 HP ProLiant 00000002 � 0000162E)
[ 0.000000] ACPI: FFFF 00000000d762f240 00064 (v02 HP ProLiant 00000002 � 0000162E)
[ 0.000000] ACPI: SPMI 00000000d762f2c0 00040 (v05 HP ProLiant 00000001 � 0000162E)
[ 0.000000] ACPI: ERST 00000000d762f300 001D0 (v01 HP ProLiant 00000001 � 0000162E)
[ 0.000000] ACPI: APIC 00000000d762f500 0015E (v01 HP ProLiant 00000002 00000000)
[ 0.000000] ACPI: SRAT 00000000d762f680 00570 (v01 HP Proliant 00000001 � 0000162E)
[ 0.000000] ACPI: FFFF 00000000d762fc00 00176 (v01 HP ProLiant 00000001 � 0000162E)
[ 0.000000] ACPI: BERT 00000000d762fd80 00030 (v01 HP ProLiant 00000001 � 0000162E)
[ 0.000000] ACPI: HEST 00000000d762fdc0 000BC (v01 HP ProLiant 00000001 � 0000162E)
[ 0.000000] ACPI: FFFF 00000000d762fe80 00194 (v01 HP ProLiant 00000001 � 0000162E)
[ 0.000000] ACPI: SSDT 00000000d7632280 00125 (v03 HP CRSPCI0 00000002 HP 00000001)
[ 0.000000] ACPI: SSDT 00000000d76323c0 00255 (v03 HP riser1a 00000002 INTL 20061109)
[ 0.000000] ACPI: SSDT 00000000d7632640 00377 (v01 HP pmab 00000001 INTL 20090625)
[ 0.000000] ACPI: SSDT 00000000d76329c0 04CA4 (v01 INTEL PPM RCM 00000001 INTL 20061109)
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x10 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x11 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x12 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x13 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x14 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x15 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x16 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x17 -> Node 1
[ 0.000000] ACPI: [SRAT:0x00] ignored 32 entries of 64 found
[ 0.000000] SRAT: Node 0 PXM 0 0-d8000000
[ 0.000000] SRAT: Node 0 PXM 0 100000000-1a8000000
[ 0.000000] SRAT: Node 1 PXM 1 1a8000000-328000000
[ 0.000000] SRAT: Node 0 [0,d8000000) + [100000000,1a8000000) -> [0,1a8000000)
[ 0.000000] Initmem setup node 0 0000000000000000-00000001a8000000
[ 0.000000] NODE_DATA [00000001a7ffb000 - 00000001a7ffffff]
[ 0.000000] Initmem setup node 1 00000001a8000000-0000000327fff000
[ 0.000000] NODE_DATA [0000000327ff9f00 - 0000000327ffeeff]
[ 0.000000] [ffffea0005cc0000-ffffea0005dfffff] potential offnode page_structs
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000010 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00327fff
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[5] active PFN ranges
[ 0.000000] 0: 0x00000010 -> 0x0000009f
[ 0.000000] 0: 0x00000100 -> 0x000d762f
[ 0.000000] 0: 0x000d763c -> 0x000d763d
[ 0.000000] 0: 0x00100000 -> 0x001a8000
[ 0.000000] 1: 0x001a8000 -> 0x00327fff
[ 0.000000] ACPI: PM-Timer IO Port: 0x908
[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x20] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x10] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x30] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x24] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x14] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x34] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x22] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x12] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x32] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x26] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x16] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x36] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x21] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x11] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x31] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x25] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x15] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x35] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x23] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x13] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x33] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x27] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x17] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x37] disabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec80000] gsi_base[24])
[ 0.000000] IOAPIC[1]: apic_id 0, version 32, address 0xfec80000, GSI 24-47
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] SMP: Allowing 32 CPUs, 16 hotplug CPUs
[ 0.000000] Allocating PCI resources starting at dc000000 (gap: dc000000:22c00000)
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:32 nr_node_ids:2
[ 0.000000] PERCPU: Embedded 26 pages/cpu @ffff8800d7200000 s76736 r8192 d21568 u131072
[ 0.000000] Built 2 zonelists in Zone order, mobility grouping on. Total pages: 3097852
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=2637 root=6802 ro root=/dev/sda2 console=uart,io,0x2f8,115200
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 12316744k/13238268k available (5289k kernel code, 665860k absent, 255664k reserved, 5361k data, 548k init)
[ 0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] CONFIG_RCU_FANOUT set to non-default value of 32
[ 0.000000] RCU-based detection of stalled CPUs is disabled.
[ 0.000000] NR_IRQS:4352 nr_irqs:1344 16
[ 0.000000] Extended CMOS year: 2000
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [ttyS1] enabled, bootconsole disabled
[ 0.000000] console [ttyS1] enabled, bootconsole disabled
[ 0.000000] Fast TSC calibration using PIT
[ 0.001000] Detected 2933.889 MHz processor.
[ 0.000008] Calibrating delay loop (skipped), value calculated using timer frequency.. 5867.77 BogoMIPS (lpj=2933889)
[ 0.041987] pid_max: default: 32768 minimum: 301
[ 0.059118] Security Framework initialized
[ 0.076022] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 0.118019] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.159178] Mount-cache hash table entries: 256
[ 0.182061] Initializing cgroup subsys ns
[ 0.201940] ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup.
[ 0.251920] Initializing cgroup subsys cpuacct
[ 0.276921] Initializing cgroup subsys devices
[ 0.300918] Initializing cgroup subsys freezer
[ 0.323905] CPU: Physical Processor ID: 0
[ 0.342923] CPU: Processor Core ID: 0
[ 0.357904] mce: CPU supports 9 MCE banks
[ 0.378892] CPU0: Thermal monitoring enabled (TM1)
[ 0.401917] using mwait in idle threads.
[ 0.418899] Performance Events: PEBS fmt1+, Nehalem events, Intel PMU driver.
[ 0.453884] ... version: 3
[ 0.473900] ... bit width: 48
[ 0.497868] ... generic registers: 4
[ 0.513874] ... value mask: 0000ffffffffffff
[ 0.539903] ... max period: 000000007fffffff
[ 0.564847] ... fixed-purpose events: 3
[ 0.587872] ... event mask: 000000070000000f
[ 0.618460] ACPI: Core revision 20101013
[ 0.641959] Setting APIC routing to physical flat
[ 0.657430] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.669821] CPU0: Intel(R) Xeon(R) CPU X5570 @ 2.93GHz stepping 05
[ 0.780022] Booting Node 1, Processors #1 Ok.
[ 0.876763] Booting Node 0, Processors #2 Ok.
[ 0.981770] Booting Node 1, Processors #3 Ok.
[ 1.076721] Booting Node 0, Processors #4 Ok.
[ 1.183701] Booting Node 1, Processors #5 Ok.
[ 1.281670] Booting Node 0, Processors #6 Ok.
[ 1.396655] Booting Node 1, Processors #7 Ok.
[ 1.505625] Booting Node 0, Processors #8 Ok.
[ 1.614585] Booting Node 1, Processors #9 Ok.
[ 1.726567] Booting Node 0, Processors #10 Ok.
[ 1.829548] Booting Node 1, Processors #11 Ok.
[ 1.934508] Booting Node 0, Processors #12 Ok.
[ 2.034508] Booting Node 1, Processors #13 Ok.
[ 2.133470] Booting Node 0, Processors #14 Ok.
[ 2.248443] Booting Node 1, Processors #15
[ 2.350335] Brought up 16 CPUs
[ 2.365568] Total of 16 processors activated (93854.92 BogoMIPS).
[ 2.393626] devtmpfs: initialized
[ 2.403409] NET: Registered protocol family 16
[ 2.409234] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 2.430708] ACPI: bus type pci registered
[ 2.440537] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xd8000000-0xdbffffff] (base 0xd8000000)
[ 2.476391] PCI: MMCONFIG at [mem 0xd8000000-0xdbffffff] reserved in E820
[ 2.499279] PCI: Using configuration type 1 for base access
[ 2.516390] PCI: HP ProLiant DL380 detected, enabling pci=bfsort.
[ 2.533432] bio: create slab <bio-0> at 0
[ 2.553171] ACPI Error: Field [CDW3] at 96 exceeds Buffer [NULL] size 64 (bits) (20101013/dsopcode-597)
[ 2.568549] ACPI Error: Method parse/execution failed [\_SB_._OSC] (Node ffff880321415f28), AE_AML_BUFFER_LIMIT (20101013/psparse-537)
[ 2.622959] ACPI: Interpreter enabled
[ 2.632488] ACPI: (supports S0 S5)
[ 2.634090] ACPI: Using IOAPIC for interrupt routing
[ 2.657052] ACPI Exception: AE_NOT_FOUND, Evaluating _PRW (20101013/scan-723)
[ 2.671916] ACPI: No dock devices found.
[ 2.683414] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 2.706863] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-19])
[ 2.709074] pci_root PNP0A08:00: host bridge window [mem 0xdf000000-0xfbffffff]
[ 2.730321] pci_root PNP0A08:00: host bridge window [io 0x1000-0x4fff]
[ 2.752323] pci_root PNP0A08:00: host bridge window [io 0x0000-0x03af]
[ 2.784635] pci_root PNP0A08:00: host bridge window [io 0x03e0-0x0cf7]
[ 2.802345] pci_root PNP0A08:00: host bridge window [io 0x0d00-0x0fff]
[ 2.818305] pci_root PNP0A08:00: host bridge window [mem 0xfed00000-0xfed03fff]
[ 2.821835] pci_root PNP0A08:00: host bridge window [mem 0xfed00000-0xfed44fff]
[ 2.824986] pci_root PNP0A08:00: host bridge window [io 0x03b0-0x03bb]
[ 2.835820] pci_root PNP0A08:00: host bridge window [io 0x03c0-0x03df]
[ 2.858293] pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
[ 2.879101] pci_root PNP0A08:00: host bridge window expanded to [mem 0xfed00000-0xfed44fff]; [mem 0xfed00000-0xfed44fff] ignored
[ 2.938486] pci 0000:00:01.0: PCI bridge to [bus 04-04]
[ 2.945265] pci 0000:00:02.0: PCI bridge to [bus 05-05]
[ 2.965363] pci 0000:00:03.0: PCI bridge to [bus 10-12]
[ 2.976374] pci 0000:00:04.0: PCI bridge to [bus 13-13]
[ 2.980267] pci 0000:00:05.0: PCI bridge to [bus 14-16]
[ 3.003397] pci 0000:00:06.0: PCI bridge to [bus 17-19]
[ 3.024278] pci 0000:00:07.0: PCI bridge to [bus 0d-0f]
[ 3.037987] pci 0000:0a:00.0: disabling ASPM on pre-1.1 PCIe device. You can enable it with 'pcie_aspm=force'
[ 3.069292] pci 0000:00:08.0: PCI bridge to [bus 0a-0c]
[ 3.091504] pci 0000:0a:00.0: PCI bridge to [bus 0b-0b]
[ 3.096838] pci 0000:00:09.0: PCI bridge to [bus 07-09]
[ 3.123248] pci 0000:00:0a.0: PCI bridge to [bus 06-06]
[ 3.129145] pci 0000:00:1c.0: PCI bridge to [bus 02-02]
[ 3.142200] pci 0000:00:1c.2: PCI bridge to [bus 03-03]
[ 3.154810] pci 0000:00:1e.0: PCI bridge to [bus 01-01] (subtractive decode)
[ 3.180641] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *7 10 11)
[ 3.193422] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 7 10 *11)
[ 3.209344] ACPI: PCI Interrupt Link [LNKC] (IRQs *5 7 10 11)
[ 3.231640] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 7 *10 11)
[ 3.246789] ACPI: PCI Interrupt Link [LNKE] (IRQs *5 7 10 11)
[ 3.264462] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 7 *10 11)
[ 3.270575] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 7 *10 11)
[ 3.272563] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 *7 10 11)
[ 3.285631] HEST: HEST table parsing is initialized.
[ 3.298343] vgaarb: device added: PCI:0000:01:03.0,decodes=io+mem,owns=io+mem,locks=none
[ 3.335204] vgaarb: loaded
[ 3.347425] SCSI subsystem initialized
[ 3.357224] usbcore: registered new interface driver usbfs
[ 3.359208] usbcore: registered new interface driver hub
[ 3.389205] usbcore: registered new device driver usb
[ 3.391740] PCI: Using ACPI for IRQ routing
[ 3.404551] cfg80211: Calling CRDA to update world regulatory domain
[ 3.423297] NetLabel: Initializing
[ 3.429032] NetLabel: domain hash size = 128
[ 3.440684] NetLabel: protocols = UNLABELED CIPSOv4
[ 3.458150] NetLabel: unlabeled traffic allowed by default
[ 3.471568] HPET: 4 timers in total, 0 timers will be used for per-cpu timer
[ 3.486887] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0
[ 3.499446] hpet0: 4 comparators, 64-bit 14.318180 MHz counter
[ 3.529269] Switching to clocksource tsc
[ 3.538691] pnp: PnP ACPI init
[ 3.540194] ACPI: bus type pnp registered
[ 3.556644] pnp: PnP ACPI: found 11 devices
[ 3.573120] ACPI: ACPI bus type pnp unregistered
[ 3.584127] system 00:01: [io 0x0408-0x040f] has been reserved
[ 3.587713] system 00:01: [io 0x04d0-0x04d1] has been reserved
[ 3.602560] system 00:01: [io 0x0700-0x071f] has been reserved
[ 3.622102] system 00:01: [io 0x0880-0x08ff] has been reserved
[ 3.642337] system 00:01: [io 0x0900-0x097f] has been reserved
[ 3.663109] system 00:01: [io 0x0c80-0x0c83] has been reserved
[ 3.681545] system 00:01: [io 0x0cd4-0x0cd7] has been reserved
[ 3.701489] system 00:01: [io 0x0f50-0x0f58] has been reserved
[ 3.704557] system 00:01: [io 0x0ca0-0x0ca1] has been reserved
[ 3.714042] system 00:01: [io 0x0ca4-0x0ca5] has been reserved
[ 3.728417] system 00:01: [io 0x02f8-0x02ff] has been reserved
[ 3.746945] system 00:01: [mem 0xd8000000-0xdbffffff] has been reserved
[ 3.774242] system 00:01: [mem 0xfe000000-0xfebfffff] has been reserved
[ 3.816604] pci 0000:00:01.0: BAR 15: assigned [mem 0xdf000000-0xdf0fffff pref]
[ 3.846065] pci 0000:00:08.0: BAR 15: assigned [mem 0xdf100000-0xdf1fffff pref]
[ 3.871046] pci 0000:00:09.0: BAR 15: assigned [mem 0xdf200000-0xdf2fffff pref]
[ 3.893042] pci 0000:00:1c.0: BAR 15: assigned [mem 0xdf300000-0xdf3fffff pref]
[ 3.916990] pci 0000:00:1c.2: BAR 15: assigned [mem 0xdf400000-0xdf4fffff pref]
[ 3.934045] pci 0000:04:00.0: BAR 6: assigned [mem 0xdf000000-0xdf07ffff pref]
[ 3.967037] pci 0000:00:01.0: PCI bridge to [bus 04-04]
[ 3.972666] pci 0000:00:01.0: bridge window [io 0x4000-0x4fff]
[ 3.992583] pci 0000:00:01.0: bridge window [mem 0xf5b00000-0xf5ffffff]
[ 4.013025] pci 0000:00:01.0: bridge window [mem 0xdf000000-0xdf0fffff pref]
[ 4.038033] pci 0000:00:02.0: PCI bridge to [bus 05-05]
[ 4.066006] pci 0000:00:02.0: bridge window [io disabled]
[ 4.074985] pci 0000:00:02.0: bridge window [mem disabled]
[ 4.091549] pci 0000:00:02.0: bridge window [mem pref disabled]
[ 4.100375] pci 0000:00:03.0: PCI bridge to [bus 10-12]
[ 4.113564] pci 0000:00:03.0: bridge window [io disabled]
[ 4.117955] pci 0000:00:03.0: bridge window [mem disabled]
[ 4.144011] pci 0000:00:03.0: bridge window [mem pref disabled]
[ 4.160216] pci 0000:00:04.0: PCI bridge to [bus 13-13]
[ 4.163063] pci 0000:00:04.0: bridge window [io disabled]
[ 4.165057] pci 0000:00:04.0: bridge window [mem disabled]
[ 4.191080] pci 0000:00:04.0: bridge window [mem pref disabled]
[ 4.217334] pci 0000:00:05.0: PCI bridge to [bus 14-16]
[ 4.225985] pci 0000:00:05.0: bridge window [io disabled]
[ 4.251947] pci 0000:00:05.0: bridge window [mem disabled]
[ 4.262473] pci 0000:00:05.0: bridge window [mem pref disabled]
[ 4.278976] pci 0000:00:06.0: PCI bridge to [bus 17-19]
[ 4.292960] pci 0000:00:06.0: bridge window [io disabled]
[ 4.298899] pci 0000:00:06.0: bridge window [mem disabled]
[ 4.310947] pci 0000:00:06.0: bridge window [mem pref disabled]
[ 4.340145] pci 0000:00:07.0: PCI bridge to [bus 0d-0f]
[ 4.363084] pci 0000:00:07.0: bridge window [io disabled]
[ 4.365151] pci 0000:00:07.0: bridge window [mem disabled]
[ 4.370635] pci 0000:00:07.0: bridge window [mem pref disabled]
[ 4.398062] pci 0000:0a:00.0: BAR 15: assigned [mem 0xdf100000-0xdf1fffff pref]
[ 4.413960] pci 0000:0b:00.0: BAR 6: assigned [mem 0xdf100000-0xdf10ffff pref]
[ 4.444938] pci 0000:0a:00.0: PCI bridge to [bus 0b-0b]
[ 4.468968] pci 0000:0a:00.0: bridge window [io disabled]
[ 4.477431] pci 0000:0a:00.0: bridge window [mem 0xfa000000-0xfbffffff]
[ 4.487505] pci 0000:0a:00.0: bridge window [mem 0xdf100000-0xdf1fffff pref]
[ 4.512909] pci 0000:00:08.0: PCI bridge to [bus 0a-0c]
[ 4.515152] pci 0000:00:08.0: bridge window [io disabled]
[ 4.537876] pci 0000:00:08.0: bridge window [mem 0xfa000000-0xfbffffff]
[ 4.557992] pci 0000:00:08.0: bridge window [mem 0xdf100000-0xdf1fffff pref]
[ 4.571877] pci 0000:07:00.0: BAR 6: assigned [mem 0xdf200000-0xdf21ffff pref]
[ 4.595875] pci 0000:07:00.1: BAR 6: assigned [mem 0xdf220000-0xdf23ffff pref]
[ 4.619139] pci 0000:00:09.0: PCI bridge to [bus 07-09]
[ 4.630888] pci 0000:00:09.0: bridge window [io disabled]
[ 4.647148] pci 0000:00:09.0: bridge window [mem 0xf6000000-0xf9ffffff]
[ 4.675976] pci 0000:00:09.0: bridge window [mem 0xdf200000-0xdf2fffff pref]
[ 4.695278] pci 0000:00:0a.0: PCI bridge to [bus 06-06]
[ 4.716856] pci 0000:00:0a.0: bridge window [io disabled]
[ 4.731777] pci 0000:00:0a.0: bridge window [mem disabled]
[ 4.747857] pci 0000:00:0a.0: bridge window [mem pref disabled]
[ 4.764148] pci 0000:02:00.0: BAR 6: assigned [mem 0xdf300000-0xdf30ffff pref]
[ 4.780860] pci 0000:02:00.1: BAR 6: assigned [mem 0xdf310000-0xdf31ffff pref]
[ 4.806842] pci 0000:00:1c.0: PCI bridge to [bus 02-02]
[ 4.817256] pci 0000:00:1c.0: bridge window [io disabled]
[ 4.832839] pci 0000:00:1c.0: bridge window [mem 0xec000000-0xefffffff]
[ 4.843784] pci 0000:00:1c.0: bridge window [mem 0xdf300000-0xdf3fffff pref]
[ 4.861016] pci 0000:03:00.0: BAR 6: assigned [mem 0xdf400000-0xdf40ffff pref]
[ 4.877805] pci 0000:03:00.1: BAR 6: assigned [mem 0xdf410000-0xdf41ffff pref]
[ 4.890767] pci 0000:00:1c.2: PCI bridge to [bus 03-03]
[ 4.911823] pci 0000:00:1c.2: bridge window [io disabled]
[ 4.921337] pci 0000:00:1c.2: bridge window [mem 0xf0000000-0xf3ffffff]
[ 4.935973] pci 0000:00:1c.2: bridge window [mem 0xdf400000-0xdf4fffff pref]
[ 4.960996] pci 0000:01:03.0: BAR 6: assigned [mem 0xebe00000-0xebe1ffff pref]
[ 4.973812] pci 0000:01:04.2: BAR 6: assigned [mem 0xebe20000-0xebe2ffff pref]
[ 5.013776] pci 0000:00:1e.0: PCI bridge to [bus 01-01]
[ 5.029758] pci 0000:00:1e.0: bridge window [io 0x2000-0x3fff]
[ 5.049953] pci 0000:00:1e.0: bridge window [mem 0xebe00000-0xebffffff]
[ 5.061721] pci 0000:00:1e.0: bridge window [mem 0xe0000000-0xe7ffffff 64bit pref]
[ 5.090839] pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[ 5.099716] pci 0000:00:1c.2: PCI INT C -> GSI 16 (level, low) -> IRQ 16
[ 5.132857] NET: Registered protocol family 2
[ 5.158065] IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 5.185770] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[ 5.219046] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 5.231232] TCP: Hash tables configured (established 524288 bind 65536)
[ 5.243823] TCP reno registered
[ 5.257747] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[ 5.271762] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[ 5.286878] NET: Registered protocol family 1
[ 5.307195] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 5.312684] Placing 64MB software IO TLB between ffff8800d3200000 - ffff8800d7200000
[ 5.347877] software IO TLB at phys 0xd3200000 - 0xd7200000
[ 5.367363] microcode: CPU0 sig=0x106a5, pf=0x1, revision=0x15
[ 5.381920] microcode: CPU1 sig=0x106a5, pf=0x1, revision=0x15
[ 5.392162] microcode: CPU2 sig=0x106a5, pf=0x1, revision=0x15
[ 5.407678] microcode: CPU3 sig=0x106a5, pf=0x1, revision=0x15
[ 5.418729] microcode: CPU4 sig=0x106a5, pf=0x1, revision=0x15
[ 5.439973] microcode: CPU5 sig=0x106a5, pf=0x1, revision=0x15
[ 5.464664] microcode: CPU6 sig=0x106a5, pf=0x1, revision=0x15
[ 5.477675] microcode: CPU7 sig=0x106a5, pf=0x1, revision=0x15
[ 5.480221] microcode: CPU8 sig=0x106a5, pf=0x1, revision=0x15
[ 5.505670] microcode: CPU9 sig=0x106a5, pf=0x1, revision=0x15
[ 5.516683] microcode: CPU10 sig=0x106a5, pf=0x1, revision=0x15
[ 5.534609] microcode: CPU11 sig=0x106a5, pf=0x1, revision=0x15
[ 5.561644] microcode: CPU12 sig=0x106a5, pf=0x1, revision=0x15
[ 5.586677] microcode: CPU13 sig=0x106a5, pf=0x1, revision=0x15
[ 5.605648] microcode: CPU14 sig=0x106a5, pf=0x1, revision=0x15
[ 5.622629] microcode: CPU15 sig=0x106a5, pf=0x1, revision=0x15
[ 5.635679] microcode: Microcode Update Driver: v2.00 <tigran@xxxxxxxxxxxxxxxxxxxx>, Peter Oruba
[ 5.664519] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 5.693659] VFS: Disk quotas dquot_6.5.2
[ 5.709682] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 5.733811] JFS: nTxBlock = 8192, nTxLock = 65536
[ 5.746010] SGI XFS with ACLs, security attributes, large block/inode numbers, no debug enabled
[ 5.777175] Btrfs loaded
[ 5.789610] msgmni has been set to 24056
[ 5.799979] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[ 5.829583] io scheduler noop registered
[ 5.839558] io scheduler deadline registered
[ 5.859681] io scheduler cfq registered (default)
[ 5.879611] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 5.899607] ACPI: Power Button [PWRF]
[ 5.921852] thermal LNXTHERM:00: registered as thermal_zone0
[ 5.941649] ACPI: Thermal Zone [THM0] (8 C)
[ 5.956820] ERST: Can not request iomem region <0xffffffff81a28060-0xffffffff034500c0> for ERST.
[ 6.001773] Non-volatile memory driver v1.3
[ 6.014622] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 6.303539] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
789:;<=>?@ABCDUVWXYZ[\]^_`abcdtuvwxyz{|}~�����������������������������������������������������[ 6.593513] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 6.635213] 00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[ 6.649907] HP CISS Driver (v 3.6.26)
[ 6.659574] HP HPSA Driver (v 2.0.2-1)
[ 6.668402] hpsa 0000:04:00.0: PCI INT A -> GSI 28 (level, low) -> IRQ 28
[ 6.692396] hpsa 0000:04:00.0: MSIX
[ 6.718402] hpsa 0000:04:00.0: hpsa0: <0x323a> at IRQ 64 using DAC
[ 6.749649] scsi0 : hpsa
[ 6.764070] hpsa 0000:04:00.0: Direct-Access device c0b0t0l0 added.
[ 6.780375] hpsa 0000:04:00.0: RAID device c0b3t0l0 added.
[ 6.803964] scsi 0:0:0:0: Direct-Access HP LOGICAL VOLUME 3.00 PQ: 0 ANSI: 5
[ 6.828892] scsi 0:3:0:0: RAID HP P410i 3.00 PQ: 0 ANSI: 0
[ 6.844873] sd 0:0:0:0: [sda] 585871964 512-byte logical blocks: (299 GB/279 GiB)
[ 6.844888] ata_piix 0000:00:1f.2: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[ 6.844891] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[ 6.898659] sd 0:0:0:0: [sda] Write Protect is off
[ 6.921557] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[ 6.945376] sda: sda1 sda2
[ 6.949079] sd 0:0:0:0: [sda] Attached SCSI disk
[ 6.995839] scsi1 : ata_piix
[ 7.002431] scsi2 : ata_piix
[ 7.013396] ata1: SATA max UDMA/133 cmd 0x1080 ctl 0x1088 bmdma 0x10a0 irq 17
[ 7.040316] ata2: SATA max UDMA/133 cmd 0x1090 ctl 0x1098 bmdma 0x10a8 irq 17
[ 7.067551] bnx2: Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.18 (Oct 7, 2010)
[ 7.105286] bnx2 0000:02:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[ 7.129998] bnx2 0000:02:00.0: eth0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem ee000000, IRQ 16, node addr 18:a9:05:5f:fc:00
[ 7.161545] bnx2 0000:02:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[ 7.190013] bnx2 0000:02:00.1: eth1: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem ec000000, IRQ 17, node addr 18:a9:05:5f:fc:02
[ 7.230271] bnx2 0000:03:00.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
[ 7.243072] bnx2 0000:03:00.0: eth2: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f2000000, IRQ 18, node addr 18:a9:05:5f:fc:04
[ 7.306457] bnx2 0000:03:00.1: PCI INT B -> GSI 19 (level, low) -> IRQ 19
[ 7.326963] bnx2 0000:03:00.1: eth3: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f0000000, IRQ 19, node addr 18:a9:05:5f:fc:06
[ 7.346323] bnx2 0000:07:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
[ 7.368912] bnx2 0000:07:00.0: eth4: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f8000000, IRQ 32, node addr d8:d3:85:bc:68:90
[ 7.428246] bnx2 0000:07:00.1: PCI INT B -> GSI 42 (level, low) -> IRQ 42
[ 7.450305] bnx2 0000:07:00.1: eth5: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f6000000, IRQ 42, node addr d8:d3:85:bc:68:92
[ 7.505291] bnx2 0000:0b:00.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
[ 7.527875] bnx2 0000:0b:00.0: eth6: Broadcom NetXtreme II BCM5708 1000Base-SX (B2) PCI-X 64-bit 133MHz found at mem fa000000, IRQ 31, node addr 00:24:81:e5:ed:60
[ 7.569208] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 7.592194] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 20 (level, low) -> IRQ 20
[ 7.618123] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[ 7.641177] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
[ 7.659248] ehci_hcd 0000:00:1d.7: debug port 1
[ 7.685005] ehci_hcd 0000:00:1d.7: irq 20, io mem 0xebdf0000
[ 7.688177] ata2.00: SATA link down (SStatus 4 SControl 300)
[ 7.688192] ata2.01: SATA link down (SStatus 4 SControl 300)
[ 7.761318] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[ 7.784124] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 7.816101] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 7.828382] ata1.00: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 7.828400] ata1.01: SATA link down (SStatus 4 SControl 300)
[ 7.847463] ata1.00: ATAPI: TEAC DV-W28S-VS, G.V0, max UDMA/100
[ 7.869459] ata1.00: configured for UDMA/100
[ 7.908467] usb usb1: Product: EHCI Host Controller
[ 7.909534] usb usb1: Manufacturer: Linux 2.6.37-64 ehci_hcd
[ 7.932096] usb usb1: SerialNumber: 0000:00:1d.7
[ 7.957307] hub 1-0:1.0: USB hub found
[ 7.959201] scsi 1:0:0:0: CD-ROM TEAC DV-W28S-VS G.V0 PQ: 0 ANSI: 5
[ 7.968535] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[ 7.968537] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 8.032038] hub 1-0:1.0: 8 ports detected
[ 8.038748] uhci_hcd: USB Universal Host Controller Interface driver
[ 8.060710] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
[ 8.072501] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[ 8.080505] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 8.098025] uhci_hcd 0000:00:1d.0: irq 20, io base 0x00001000
[ 8.116093] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[ 8.150032] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 8.175662] usb usb2: Product: UHCI Host Controller
[ 8.193021] usb usb2: Manufacturer: Linux 2.6.37-64 uhci_hcd
[ 8.217995] usb usb2: SerialNumber: 0000:00:1d.0
[ 8.235145] hub 2-0:1.0: USB hub found
[ 8.249318] hub 2-0:1.0: 2 ports detected
[ 8.262032] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 23 (level, low) -> IRQ 23
[ 8.284071] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[ 8.293023] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
[ 8.313423] uhci_hcd 0000:00:1d.1: irq 23, io base 0x00001020
[ 8.332022] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
[ 8.362128] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 8.391104] usb usb3: Product: UHCI Host Controller
[ 8.392989] usb usb3: Manufacturer: Linux 2.6.37-64 uhci_hcd
[ 8.409974] usb usb3: SerialNumber: 0000:00:1d.1
[ 8.429076] hub 3-0:1.0: USB hub found
[ 8.441956] hub 3-0:1.0: 2 ports detected
[ 8.447349] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
[ 8.457377] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[ 8.466960] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
[ 8.485973] uhci_hcd 0000:00:1d.2: irq 22, io base 0x00001040
[ 8.506973] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[ 8.517691] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 8.531889] usb usb4: Product: UHCI Host Controller
[ 8.544944] usb usb4: Manufacturer: Linux 2.6.37-64 uhci_hcd
[ 8.568030] usb usb4: SerialNumber: 0000:00:1d.2
[ 8.581053] hub 4-0:1.0: USB hub found
[ 8.595921] hub 4-0:1.0: 2 ports detected
[ 8.618967] uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 23 (level, low) -> IRQ 23
[ 8.627906] uhci_hcd 0000:00:1d.3: UHCI Host Controller
[ 8.649105] uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
[ 8.672331] uhci_hcd 0000:00:1d.3: irq 23, io base 0x00001060
[ 8.698108] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[ 8.722903] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 8.753888] usb usb5: Product: UHCI Host Controller
[ 8.767279] usb usb5: Manufacturer: Linux 2.6.37-64 uhci_hcd
[ 8.785163] usb usb5: SerialNumber: 0000:00:1d.3
[ 8.801008] hub 5-0:1.0: USB hub found
[ 8.802240] hub 5-0:1.0: 2 ports detected
[ 8.818047] uhci_hcd 0000:01:04.4: PCI INT B -> GSI 22 (level, low) -> IRQ 22
[ 8.834414] uhci_hcd 0000:01:04.4: UHCI Host Controller
[ 8.845856] uhci_hcd 0000:01:04.4: new USB bus registered, assigned bus number 6
[ 8.873900] uhci_hcd 0000:01:04.4: port count misdetected? forcing to 2 ports
[ 8.901462] uhci_hcd 0000:01:04.4: irq 22, io base 0x00003800
[ 8.922913] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
[ 8.948856] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 8.965278] usb usb6: Product: UHCI Host Controller
[ 8.979857] usb usb6: Manufacturer: Linux 2.6.37-64 uhci_hcd
[ 9.004116] usb usb6: SerialNumber: 0000:01:04.4
[ 9.008913] hub 6-0:1.0: USB hub found
[ 9.026837] hub 6-0:1.0: 2 ports detected
[ 9.043927] Initializing USB Mass Storage driver...
[ 9.060252] usbcore: registered new interface driver usb-storage
[ 9.067785] USB Mass Storage support registered.
[ 9.079488] usbcore: registered new interface driver libusual
[ 9.098923] PNP: PS/2 Controller [PNP0303:KBD,PNP0f0e:PS2M] at 0x60,0x64 irq 1,12
[ 9.138462] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 9.151836] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 9.156035] mice: PS/2 mouse device common for all mice
[ 9.170899] rtc_cmos 00:0a: RTC can wake from S4
[ 9.183569] rtc_cmos 00:0a: rtc core: registered rtc_cmos as rtc0
[ 9.200778] rtc0: alarms up to one year, y3k, 114 bytes nvram, hpet irqs
[ 9.236078] device-mapper: uevent: version 1.0.3
[ 9.252867] device-mapper: ioctl: 4.18.0-ioctl (2010-06-29) initialised: dm-devel@xxxxxxxxxx
[ 9.268722] cpuidle: using governor ladder
[ 9.287063] cpuidle: using governor menu
[ 9.294189] No iBFT detected.
[ 9.294310] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 9.330100] usbcore: registered new interface driver usbhid
[ 9.344743] usbhid: USB HID core driver
[ 9.364574] usb 6-1: new full speed USB device using uhci_hcd and address 2
[ 9.393053] Netfilter messages via NETLINK v0.30.
[ 9.406105] TCP cubic registered
[ 9.408816] Initializing XFRM netlink socket
[ 9.423269] NET: Registered protocol family 10
[ 9.432121] lo: Disabled Privacy Extensions
[ 9.445475] NET: Registered protocol family 17
[ 9.448834] NET: Registered protocol family 15
[ 9.472939] Registering the dns_resolver key type
[ 9.486124] registered taskstats version 1
[ 9.505005] rtc_cmos 00:0a: setting system clock to 2011-01-06 20:52:23 UTC (1294347143)
[ 9.541801] usb 6-1: New USB device found, idVendor=03f0, idProduct=1027
[ 9.556689] usb 6-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 9.583762] usb 6-1: Product: Virtual Keyboard
[ 9.595825] usb 6-1: Manufacturer: HP
[ 9.624524] input: HP Virtual Keyboard as /devices/pci0000:00/0000:00:1e.0/0000:01:04.4/usb6/6-1/6-1:1.0/input/input2
[ 9.657683] generic-usb 0003:03F0:1027.0001: input,hidraw0: USB HID v1.01 Keyboard [HP Virtual Keyboard] on usb-0000:01:04.4-1/input0
[ 9.702263] input: HP Virtual Keyboard as /devices/pci0000:00/0000:00:1e.0/0000:01:04.4/usb6/6-1/6-1:1.1/input/input3
[ 9.739453] generic-usb 0003:03F0:1027.0002: input,hidraw1: USB HID v1.01 Mouse [HP Virtual Keyboard] on usb-0000:01:04.4-1/input1
[ 9.906433] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[ 9.944835] XFS mounting filesystem sda2
[ 10.153937] Starting XFS recovery on filesystem: sda2 (logdev: internal)
[ 10.308406] Ending XFS recovery on filesystem: sda2 (logdev: internal)
[ 10.326708] VFS: Mounted root (xfs filesystem) readonly on device 8:2.
[ 10.334360] Freeing unused kernel memory: 548k freed
[ 10.345572] Write protecting the kernel read-only data: 10240k
[ 10.357015] Freeing unused kernel memory: 836k freed
[ 10.371486] Freeing unused kernel memory: 1956k freed
INIT: version 2.86 booting
sysfs on /sys type sysfs (rw)
INIT: Entering runlevel: 3
+ ip link add link eth0 name v406 type vlan id 406
[ 11.500681] 802.1Q VLAN Support v1.8 Ben Greear <greearb@xxxxxxxxxxxxxxx>
[ 11.523254] All bugs added by David S. Miller <davem@xxxxxxxxxx>
+ ip link set up dev eth0
[ 11.584691] bnx2 0000:02:00.0: eth0: using MSIX
[ 11.590173] ADDRCONF(NETDEV_UP): eth0: link is not ready
+ ip link set up dev v406
+ ip addr add 10.251.0.3/16 dev v406
+ exit


Welcome to Hell..

64bit login: [ 112.190114] BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
[ 112.198912] IP: [<ffffffff813f5a34>] __skb_recv_datagram+0x124/0x2a0
[ 112.214203] PGD 31fa05067 PUD 31fb51067 PMD 0
[ 112.220207] Oops: 0002 [#1] SMP
[ 112.228949] last sysfs file: /sys/devices/pci0000:00/0000:00:1e.0/0000:01:04.6/class
[ 112.248201] CPU 0
[ 112.251342] Modules linked in: 8021q garp stp llc
[ 112.269199]
[ 112.269692] Pid: 1370, comm: rpc.statd Not tainted 2.6.37-64 #1 /ProLiant DL380 G6
[ 112.275164] RIP: 0010:[<ffffffff813f5a34>] [<ffffffff813f5a34>] __skb_recv_datagram+0x124/0x2a0
[ 112.293143] RSP: 0018:ffff88031fbd5a88 EFLAGS: 00010046
[ 112.300238] RAX: 0000000000000246 RBX: 0000000000000000 RCX: ffff88019f91a8c0
[ 112.319307] RDX: ffff88019f94b500 RSI: ffff88031fbd5b44 RDI: ffff88019f91a8d4
[ 112.329271] RBP: ffff88031fbd5b28 R08: 0000000000000000 R09: 0000000000001000
[ 112.339123] R10: 0000000000000000 R11: 0000000000000246 R12: ffff88031fbd5ac8
[ 112.360207] R13: ffff88019f91a8c0 R14: ffff88031fbd5ae0 R15: ffff88019f91a8d4
[ 112.363278] FS: 00007ff90cd77700(0000) GS:ffff8800d7200000(0000) knlGS:0000000000000000
[ 112.366216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 112.368311] CR2: 0000000000000008 CR3: 000000031fb1a000 CR4: 00000000000006f0
[ 112.375050] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 112.379300] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 112.381913] Process rpc.statd (pid: 1370, threadinfo ffff88031fbd4000, task ffff88031fe00000)
[ 112.387746] Stack:
[ 112.388474] ffff88031fbd5ae8 ffffffff8141eb50 7fffffffffffffff ffff88031fe00000
[ 112.404676] ffff88031fbd5bc4 ffff88031fbd5b44 000000001fbd5b88 ffff88031fe00000
[ 112.411531] ffff88019f91a800 ffff88019f8be600 000000000000055a ffffffff81b8d780
[ 112.415367] Call Trace:
[ 112.416223] [<ffffffff8141eb50>] ? netlink_dump+0x1a0/0x200
[ 112.418289] [<ffffffff8141fa4d>] ? netlink_dump_start+0x18d/0x1b0
[ 112.420439] [<ffffffff813f5bcf>] skb_recv_datagram+0x1f/0x30
[ 112.422686] [<ffffffff8141eeec>] netlink_recvmsg+0x7c/0x440
[ 112.424846] [<ffffffff813f1ea2>] ? __kfree_skb+0x42/0xa0
[ 112.444125] [<ffffffff813e9cf8>] sock_recvmsg+0xf8/0x130
[ 112.449889] [<ffffffff814600bf>] ? inet_sendmsg+0x5f/0xb0
[ 112.451876] [<ffffffff813e9e7e>] ? sock_sendmsg+0xee/0x130
[ 112.454213] [<ffffffff810b6869>] ? __do_fault+0x3b9/0x4a0
[ 112.456961] [<ffffffff810a7b48>] ? lru_cache_add_lru+0x28/0x50
[ 112.481554] [<ffffffff813e8769>] ? might_fault+0x9/0x10
[ 112.483393] [<ffffffff813e9964>] ? move_addr_to_user+0x84/0xa0
[ 112.485667] [<ffffffff813ea04d>] __sys_recvmsg+0x13d/0x2b0
[ 112.492094] [<ffffffff8141ff2e>] ? netlink_table_ungrab+0x2e/0x30
[ 112.512132] [<ffffffff8141ffb9>] ? netlink_insert+0x89/0x160
[ 112.514165] [<ffffffff813eae40>] ? move_addr_to_kernel+0x50/0x60
[ 112.531071] [<ffffffff813eb6b4>] ? sys_sendto+0x104/0x140
[ 112.541470] [<ffffffff813e9964>] ? move_addr_to_user+0x84/0xa0
[ 112.549085] [<ffffffff813eb4c2>] ? sys_getsockname+0xa2/0xc0
[ 112.569417] [<ffffffff813ebe14>] sys_recvmsg+0x44/0x90
[ 112.571711] [<ffffffff81002552>] system_call_fastpath+0x16/0x1b
[ 112.573894] Code: 00 00 00 e9 4f ff ff ff 0f 1f 80 00 00 00 00 ff 8b d0 00 00 00 48 8b 1a 48 8b 4a 08 48 c7 02 00 00 00 00 48 c7 42 08 00 00 00 00 <48> 89 4b 08 48 89 19 e9 7c ff ff ff 31 c0 87 87 64 01 00 00 f7
[ 112.592492] RIP [<ffffffff813f5a34>] __skb_recv_datagram+0x124/0x2a0
[ 112.603649] RSP <ffff88031fbd5a88>
[ 112.607123] CR2: 0000000000000008
[ 112.609064] ---[ end trace f6cbe3b43db03698 ]---