Re: [RFC/GIT PULL] Linux KVM tool for v3.2

From: richard -rw- weinberger
Date: Tue Nov 08 2011 - 11:01:01 EST


Hi Pekka,

On Tue, Nov 8, 2011 at 4:36 PM, Pekka Enberg <penberg@xxxxxxxxxx> wrote:
> Can you please run "kvm debug -a" on a host terminal when the guest
> hangs? Please copy the guest output and debug information from the
> host terminal. Also, please share your .config with us.

There you go!

---8<---
$ ./kvm run -d /scratch/rw/fc14_64_image.qcow2 -p "root=/dev/vda1
nolapic init=/bin/sh"
Warning: Forcing read-only support for QCOW
# kvm run -k ../../arch/x86/boot/bzImage -m 320 -c 2 --name guest-13045

Decompressing Linux... Parsing ELF... done.
Booting the kernel.
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 3.1.0+ (rw@inhelltoy) (gcc version 4.5.1
20100924 (Red Hat 4.5.1-4) (GCC) ) #2 SMP Tue Nov 8 16:06:18 CET 2011
[ 0.000000] Command line: notsc noapic noacpi pci=conf1 reboot=k
panic=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 console=ttyS0
earlyprintk=serial i8042.noaux=1 root=/dev/vda1 nolapic init=/bin/sh
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
[ 0.000000] BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
[ 0.000000] BIOS-e820: 00000000000f0000 - 00000000000fffff (reserved)
[ 0.000000] BIOS-e820: 0000000000100000 - 0000000014000000 (usable)
[ 0.000000] bootconsole [earlyser0] enabled
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] DMI not present or invalid.
[ 0.000000] No AGP bridge found
[ 0.000000] last_pfn = 0x14000 max_arch_pfn = 0x400000000
[ 0.000000] x86 PAT enabled: cpu 0, old 0x0, new 0x7010600070106
[ 0.000000] CPU MTRRs all blank - virtualized system.
[ 0.000000] found SMP MP-table at [ffff8800000f0370] f0370
[ 0.000000] init_memory_mapping: 0000000000000000-0000000014000000
[ 0.000000] ACPI Error: A valid RSDP was not found (20110623/tbxfroot-219)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at 0000000000000000-0000000014000000
[ 0.000000] Initmem setup node 0 0000000000000000-0000000014000000
[ 0.000000] NODE_DATA [0000000013ffb000 - 0000000013ffffff]
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000010 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal empty
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[2] active PFN ranges
[ 0.000000] 0: 0x00000010 -> 0x0000009f
[ 0.000000] 0: 0x00000100 -> 0x00014000
[ 0.000000] Intel MultiProcessor Specification v1.4
[ 0.000000] MPTABLE: OEM ID: KVMCPU00
[ 0.000000] MPTABLE: Product ID: 0.1
[ 0.000000] MPTABLE: APIC at: 0xFEE00000
[ 0.000000] Processor #0 (Bootup-CPU)
[ 0.000000] Processor #1
[ 0.000000] IOAPIC[0]: apic_id 3, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] Processors: 2
[ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
[ 0.000000] PM: Registered nosave memory: 00000000000f0000 - 00000000000ff000
[ 0.000000] PM: Registered nosave memory: 00000000000ff000 - 0000000000100000
[ 0.000000] Allocating PCI resources starting at 14000000 (gap:
14000000:ec000000)
[ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64
nr_cpu_ids:2 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 26 pages/cpu @ffff880013c00000 s74624
r8192 d23680 u1048576
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on.
Total pages: 80522
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: notsc noapic noacpi pci=conf1
reboot=k panic=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1
console=ttyS0 earlyprintk=serial i8042.noaux=1 root=/dev/vda1 nolapic
init=/bin/sh
[ 0.000000] notsc: Kernel compiled with CONFIG_X86_TSC, cannot
disable TSC completely.
[ 0.000000] PID hash table entries: 2048 (order: 2, 16384 bytes)
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 306192k/327680k available (7420k kernel code,
452k absent, 21036k reserved, 5488k data, 648k init)
[ 0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0,
CPUs=2, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] NR_IRQS:4352 nr_irqs:512 16
[ 0.000000] Console: colour *CGA 80x25
[ 0.000000] console [ttyS0] enabled, bootconsole disabled
[ 0.000000] console [ttyS0] enabled, bootconsole disabled
[ 0.000000] Fast TSC calibration failed
[ 0.000000] TSC: Unable to calibrate against PIT
[ 0.000000] TSC: No reference (HPET/PMTIMER) available
[ 0.000000] Marking TSC unstable due to could not calculate TSC khz
[ 0.008999] Calibrating delay loop... 5480.44 BogoMIPS (lpj=2740224)
[ 0.020998] pid_max: default: 32768 minimum: 301
[ 0.022998] Security Framework initialized
[ 0.024998] SELinux: Initializing.
[ 0.026998] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.030997] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.033997] Mount-cache hash table entries: 256
[ 0.036997] Initializing cgroup subsys cpuacct
[ 0.038997] Initializing cgroup subsys freezer
[ 0.040997] mce: CPU supports 32 MCE banks
[ 0.043996] SMP disabled
[ 0.045996] Performance Events: unsupported p6 CPU model 15 no PMU
driver, software events only.
[ 0.049996] Brought up 1 CPUs
[ 0.051995] Total of 1 processors activated (5480.44 BogoMIPS).
[ 0.054995] kworker/u:0 used greatest stack depth: 6288 bytes left
[ 0.056995] RTC time: 15:08:28, date: 11/08/11
[ 0.059994] NET: Registered protocol family 16
[ 0.061994] kworker/u:0 used greatest stack depth: 5968 bytes left
[ 0.064994] PCI: Using configuration type 1 for base access
[ 0.068993] kworker/u:0 used greatest stack depth: 5552 bytes left
[ 0.078993] bio: create slab <bio-0> at 0
[ 0.080992] ACPI: Interpreter disabled.
[ 0.082992] vgaarb: loaded
[ 0.083992] SCSI subsystem initialized
[ 0.086992] usbcore: registered new interface driver usbfs
[ 0.088992] usbcore: registered new interface driver hub
[ 0.090992] usbcore: registered new device driver usb
[ 0.093991] Advanced Linux Sound Architecture Driver Version 1.0.24.
[ 0.095991] PCI: Probing PCI hardware
[ 0.100991] cfg80211: Calling CRDA to update world regulatory domain
[ 0.102990] NetLabel: Initializing
[ 0.103990] NetLabel: domain hash size = 128
[ 0.105990] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.107990] NetLabel: unlabeled traffic allowed by default
[ 0.116989] pnp: PnP ACPI: disabled
[ 0.122988] NET: Registered protocol family 2
[ 0.124988] IP route cache hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.126988] TCP established hash table entries: 16384 (order: 6,
262144 bytes)
[ 0.129987] TCP bind hash table entries: 16384 (order: 6, 262144 bytes)
[ 0.131987] TCP: Hash tables configured (established 16384 bind 16384)
[ 0.133987] TCP reno registered
[ 0.134987] UDP hash table entries: 256 (order: 1, 8192 bytes)
[ 0.136986] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[ 0.138986] NET: Registered protocol family 1
[ 0.141986] RPC: Registered named UNIX socket transport module.
[ 0.143986] RPC: Registered udp transport module.
[ 0.144985] RPC: Registered tcp transport module.
[ 0.146985] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.148985] platform rtc_cmos: registered platform RTC device (no
PNP device found)
[ 0.151985] microcode: CPU0 sig=0x6f5, pf=0x1, revision=0x0
[ 0.154984] microcode: Microcode Update Driver: v2.00
<tigran@xxxxxxxxxxxxxxxxxxxx>, Peter Oruba
[ 0.157984] audit: initializing netlink socket (disabled)
[ 0.159984] type=2000 audit(4476438508.159:1): initialized
[ 0.176981] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.182980] VFS: Disk quotas dquot_6.5.2
[ 0.184980] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.187980] Installing v9fs 9p2000 file system support
[ 0.190979] msgmni has been set to 598
[ 0.192979] Block layer SCSI generic (bsg) driver version 0.4
loaded (major 253)
[ 0.195979] io scheduler noop registered
[ 0.196978] io scheduler deadline registered
[ 0.198978] io scheduler cfq registered (default)
[ 0.201978] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.204977] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)
[ 0.207977] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)
[ 0.209977] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
ï[ 0.458939] serial8250: ttyS0 at I/O 0x3f8 (irq = 0) is a 16550A
ï[ 0.706901] serial8250: ttyS1 at I/O 0x2f8 (irq = 0) is a 16550A
ï[ 0.954863] serial8250: ttyS2 at I/O 0x3e8 (irq = 0) is a 16550A
[ 0.956863] Non-volatile memory driver v1.3
[ 0.958862] Linux agpgart interface v0.103
[ 0.960862] [drm] Initialized drm 1.1.0 20060810
[ 0.962862] [drm:i915_init] *ERROR* drm/i915 can't work without
intel_agp module!
[ 0.967861] brd: module loaded
[ 0.970861] loop: module loaded
0x00008000: 00 00 00 00 00 00 00 00
0x00008008: 00 00 00 00 00 00 00 00
0x00008010: 00 00 00 00 00 00 00 00
0x00008018: 00 00 00 00 00 00 00 00
--->8---
$ ./kvm debug -a

#
# vCPU #0's dump:
#

Registers:
----------
rip: ffffffff8100a015 rsp: ffffffff81c01f08 flags: 0000000000000246
rax: 0000000000000000 rbx: ffffffff81c00000 rcx: 00000000ffffffff
rdx: 0000000000000000 rsi: 0000000000000001 rdi: 0000000000000000
rbp: ffffffff81c01f18 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000001 r11: 0000000000000000 r12: 0000000000000000
r13: ffffffff81c00000 r14: ffffffffffffffff r15: 0000000000000000
cr0: 000000008005003b cr2: 0000000000000000 cr3: 0000000001c05000
cr4: 00000000000006f0 cr8: 0000000000000000

Segment registers:
------------------
register selector base limit type p dpl db s l g avl
cs 0010 0000000000000000 ffffffff 0b 1 0 0 1 1 1 0
ss 0018 0000000000000000 ffffffff 03 1 0 1 1 0 1 0
ds 0000 0000000000000000 ffffffff 00 0 0 0 0 0 0 0
es 0000 0000000000000000 ffffffff 00 0 0 0 0 0 0 0
fs 0000 0000000000000000 ffffffff 00 0 0 0 0 0 0 0
gs 0000 ffff880013c00000 ffffffff 00 0 0 0 0 0 0 0
tr 0040 ffff880013c0f340 00002087 0b 1 0 0 0 0 0 0
ldt 0000 0000000000000000 ffffffff 00 0 0 0 0 0 0 0
gdt ffff880013c04000 0000007f
idt ffffffff81d48000 00000fff

APIC:
-----
efer: 0000000000000d01 apic base: 00000000fee00900 nmi: enabled

Interrupt bitmap:
-----------------
0000000000000000 0000000000000000 0000000000000000 0000000000000000

Code:
-----
rip: [<ffffffff8100a015>] <unknown>



Stack:
------

#
# vCPU #1's dump:
#

Registers:
----------
rip: 0000000000000200 rsp: 0000000000008000 flags: 0000000000000002
rax: 0000000000000000 rbx: 0000000000000000 rcx: 0000000000000000
rdx: 0000000000000000 rsi: 0000000000000000 rdi: 0000000000000000
rbp: 0000000000008000 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000000 r12: 0000000000000000
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cr0: 0000000060000010 cr2: 0000000000000000 cr3: 0000000000000000
cr4: 0000000000000000 cr8: 0000000000000000

Segment registers:
------------------
register selector base limit type p dpl db s l g avl
cs 1000 0000000000010000 0000ffff 03 1 3 0 1 0 0 0
ss 1000 0000000000010000 0000ffff 03 1 3 0 1 0 0 0
ds 1000 0000000000010000 0000ffff 03 1 3 0 1 0 0 0
es 1000 0000000000010000 0000ffff 03 1 3 0 1 0 0 0
fs 1000 0000000000010000 0000ffff 03 1 3 0 1 0 0 0
gs 1000 0000000000010000 0000ffff 03 1 3 0 1 0 0 0
tr 0000 0000000000000000 0000ffff 0b 1 0 0 0 0 0 0
ldt 0000 0000000000000000 0000ffff 02 1 0 0 0 0 0 0
gdt 0000000000000000 0000ffff
idt 0000000000000000 0000ffff

APIC:
-----
efer: 0000000000000000 apic base: 00000000fee00800 nmi: enabled

Interrupt bitmap:
-----------------
0000000000000000 0000000000000000 0000000000000000 0000000000000000

Code:
-----
rip: [<0000000000000200>] <unknown>

00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 19 01 00 14 db 04 00 00 00 00 00 00 00 55 aa <eb> 62 48
64 72 53 0a 02 00 00 00 00 00 10 44 2f ff 81 00 80 00

Stack:
------
---8<---

.config is attached.
Basically it's x86_64 defconfig+kvmconfig+ext2,3,4

--
Thanks,
//richard

Attachment: config.kvm
Description: Binary data