Re: [PATCH 3/3] x86: fix node_possible_map logic -v2
From: Yinghai Lu
Date: Tue May 12 2009 - 17:31:53 EST
On Tue, May 12, 2009 at 11:03 AM, Jack Steiner <steiner@xxxxxxx> wrote:
> On Tue, May 12, 2009 at 09:40:52AM -0700, Yinghai Lu wrote:
>> On Tue, May 12, 2009 at 9:16 AM, Jack Steiner <steiner@xxxxxxx> wrote:
>> > On Tue, May 12, 2009 at 08:10:18AM -0700, Yinghai Lu wrote:
>> >> jack,
>> >>
>> >> can you confirm:
>> >> 1. without this patch, your system still have problem?
>> >> 2. does current tip/master work for you?
>> >
>> > The current tip/master fails with or without the patch. AFAICT, the
>> > failure is identical in both cases.
>>
>> ok, can you try attach patch to check cpu_to_node mapping?
>
> The boot messages are somewhat inconsistent:
>
> Earlier in boot:
>
> <6>Setting APIC routing to cluster x2apic.
> <6>SRAT: PXM 0 -> APIC 0 -> Node 0
> <6>SRAT: PXM 1 -> APIC 128 -> Node 1
> <6>SRAT: Node 1 PXM 1 0-fff6c000
>
>
> but at the point of your debug messages:
>
> <6>cpu 0 -> apicid 0x0 -> node 1
> <6>cpu 1 -> apicid 0x80 -> node 1
that mean cpu0 is mapping to node1, because node0 doesn't memory installed.
>
>
>
>
>
> BIOS log:
>
> PROM>> Build ACPI tables
> PROM>> RSDP at 0x00000000000e0200
> PROM>> XSDT at 0x00000000000e0240
> PROM>> DSDT at 0x00000000000e02a0
> PROM>> MADT at 0x00000000000e02e0 (0xa0)
> PROM>> sapic: cpu 0, socket 0, lcpu 0, proc_id 0x0, id 0x00, eid 0x00, apicid 0x0000,
> PROM>> sapic: cpu 1, socket 1, lcpu 0, proc_id 0x1, id 0x00, eid 0x80, apicid 0x0080,
> PROM>> io_apic: id 8, base 0, entries 24, prq 0, arb 0
> PROM>> io_apic: id 9, base 24, entries 24, prq 1, arb 9
> PROM>> lapic_nmi: acpi_id 0, flags 0x5, lint 1
> PROM>> lapic_nmi: acpi_id 1, flags 0x5, lint 1
> PROM>> int_src_ovr: bus 0, bus_irq 0, global_irq 2, flags 5
> PROM>> int_src_ovr: bus 0, bus_irq 9, global_irq 9, flags 13
> PROM>> SRAT at 0x00000000000e0380
> PROM>> Memory:
> PROM>> blade 1, soc 1: paddr 0x0 - 0xfff6c000 (3GB + 1023MB + 442368), pxm 1
> PROM>> Processor at 00000000000e03d8:
> PROM>> soc 0, lcpu 0: sapicid 0x0000, pxm 0
> PROM>> soc 1, lcpu 0: sapicid 0x0080, pxm 1
> PROM>> SLIT at 0x00000000000e05e0, dim 2
> PROM>> 10 21
> PROM>> 21 10
> PROM>> FADT at 0x00000000000e06a0
> PROM>> FACS at 0x00000000000e07a0
> PROM>> DMAR at 0x00000000000e0860
>
> Kernel log:
> <6>Initializing cgroup subsys cpuset
> <6>Initializing cgroup subsys cpu
> <5>Linux version 2.6.30-rc5-next-20090512-medusa (steiner@xxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.2.4) #4 SMP Tue May 12 12:55:26 CDT 2009
> <6>Command line: root=/dev/hda2 init=/bin/bash console=ttyS0,38400n8 fprom lpj=10000 nohpet loglevel=8 iommu=off dma32_size=4096
> <6>KERNEL supported cpus:
> <6> Intel GenuineIntel
> <6> AMD AuthenticAMD
> <6> Centaur CentaurHauls
> <6>BIOS-provided physical RAM map:
> <6> BIOS-e820: 0000000000000000 - 0000000000006000 (usable)
> <6> BIOS-e820: 0000000000006000 - 0000000000200000 (reserved)
> <6> BIOS-e820: 0000000000200000 - 0000000010000000 (usable)
> <6> BIOS-e820: 0000000080000000 - 0000000090000000 (reserved)
> <6> BIOS-e820: 00000000f0000000 - 00000000fc000000 (reserved)
> <6> BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
> <6> BIOS-e820: 00000000fff60000 - 00000000fff6c000 (reserved)
> <6> BIOS-e820: 00000fe000000000 - 00000fe018000000 (reserved)
> <6>EFI v1.00 by SGI
> <6> ACPI 2.0=0xe0200 UVsystab=0xe08c0
> <6>EFI: mem00: type=7, attr=0x8, range=[0x0000000000000000-0x0000000000006000) (0MB)
> <6>EFI: mem01: type=5, attr=0x8000000000001000, range=[0x0000000000006000-0x00000000000b0000) (0MB)
> <6>EFI: mem02: type=6, attr=0x8000000000000008, range=[0x00000000000b0000-0x0000000000200000) (1MB)
> <6>EFI: mem03: type=7, attr=0x8, range=[0x0000000000200000-0x0000000010000000) (254MB)
> <6>EFI: mem04: type=6, attr=0x8000000000000001, range=[0x0000000080000000-0x0000000090000000) (256MB)
> <6>EFI: mem05: type=6, attr=0x8000000000000001, range=[0x00000000f0000000-0x00000000fc000000) (192MB)
> <6>EFI: mem06: type=6, attr=0x8000000000000001, range=[0x00000000fed1c000-0x00000000fed20000) (0MB)
> <6>EFI: mem07: type=6, attr=0x8000000000000001, range=[0x00000000fff60000-0x00000000fff6c000) (0MB)
> <6>EFI: mem08: type=11, attr=0x8000000000000001, range=[0x00000fe000000000-0x00000fe018000000) (384MB)
> <6>DMI not present or invalid.
> <6>last_pfn = 0x10000 max_arch_pfn = 0x100000000
> <7>MTRR default type: write-back
> <7>MTRR fixed ranges enabled:
> <7> 00000-FFFFF write-back
> <7>MTRR variable ranges enabled:
> <7> 0 base 0 F0000000 mask FFF F0000000 uncachable
> <7> 1 base E0 00000000 mask FF0 00000000 uncachable
> <7> 2 base F0 00000000 mask FF0 00000000 uncachable
> <7> 3 base F00 00000000 mask FF0000000000 uncachable
> <7> 4 disabled
> <7> 5 disabled
> <7> 6 disabled
> <7> 7 disabled
> <6>x86 PAT enabled: cpu 0, old 0x606060606060606, new 0x7010600070106
> <6>x2apic enabled by BIOS, switching to x2apic ops
> <6>init_memory_mapping: 0000000000000000-0000000010000000
> <7> 0000000000 - 0010000000 page 2M
> <7>kernel direct mapping tables up to 10000000 @ 93a000-93c000
> <4>ACPI: RSDP 00000000000e0200 00024 (v02 )
> <4>ACPI: XSDT 00000000000e0240 00054 (v01 SGI UVX 00010001 FPRM 00000001)
> <4>ACPI: APIC 00000000000e02e0 00086 (v01 SGI UVX 00010001 FPRM 00000001)
> <4>ACPI: SRAT 00000000000e0380 00078 (v01 SGI UVX 00010001 FPRM 00000001)
> <4>ACPI: SLIT 00000000000e05e0 00030 (v01 SGI UVX 00010001 FPRM 00000001)
> <4>ACPI: MCFG 00000000000e0640 0004C (v01 SGI UVX 00010001 FPRM 00000001)
> <4>ACPI: FACP 00000000000e06a0 000F4 (v03 SGI UVX 00030001 FPRM 00000001)
> <4>ACPI: DSDT 00000000000e02a0 00030 (v01 SGI UVX 00010001 FPRM 00000001)
> <4>ACPI: FACS 00000000000e07a0 00040
> <4>ACPI: DMAR 00000000000e0860 0004C (v01 SGI UVX 00010001 FPRM 00000001)
> <7>ACPI: Local APIC address 0xfee00000
> <6>Setting APIC routing to cluster x2apic.
> <6>SRAT: PXM 0 -> APIC 0 -> Node 0
> <6>SRAT: PXM 1 -> APIC 128 -> Node 1
> <6>SRAT: Node 1 PXM 1 0-fff6c000
> <7>NUMA: Using 63 for the hash shift.
> <6>Bootmem setup node 1 0000000000000000-0000000010000000
> <6> NODE_DATA [0000000000939a80 - 000000000096da7f]
> <6> bootmap [000000000096e000 - 000000000096ffff] pages 2
> <6>(7 early reservations) ==> bootmem [0000000000 - 0010000000]
> <6> #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
> <6> #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
> <6> #2 [0000200000 - 0000939a5c] TEXT DATA BSS ==> [0000200000 - 0000939a5c]
> <6> #3 [000009f000 - 00000e0900] BIOS reserved ==> [000009f000 - 00000e0900]
> <6> #4 [00000e0a68 - 0000100000] BIOS reserved ==> [00000e0a68 - 0000100000]
> <6> #5 [00000e0900 - 00000e0a68] EFI memmap ==> [00000e0900 - 00000e0a68]
> <6> #6 [0000001000 - 0000001030] ACPI SLIT ==> [0000001000 - 0000001030]
> <7> [ffffe20000000000-ffffe200003fffff] PMD -> [ffff880001200000-ffff8800015fffff] on node 1
> <4>Zone PFN ranges:
> <4> DMA 0x00000000 -> 0x00001000
> <4> DMA32 0x00001000 -> 0x00100000
> <4> Normal 0x00100000 -> 0x00100000
> <4>Movable zone start PFN for each node
> <4>early_node_map[2] active PFN ranges
> <4> 1: 0x00000000 -> 0x00000006
> <4> 1: 0x00000200 -> 0x00010000
> <7>On node 1 totalpages: 65030
> <7> DMA zone: 56 pages used for memmap
> <7> DMA zone: 1948 pages reserved
> <7> DMA zone: 1586 pages, LIFO batch:0
> <7> DMA32 zone: 840 pages used for memmap
> <7> DMA32 zone: 60600 pages, LIFO batch:15
> <6>ACPI: PM-Timer IO Port: 0x1008
> <7>ACPI: Local APIC address 0xfee00000
> <6>Setting APIC routing to cluster x2apic.
x2apic related?
can you disable x2apic in kernel?
YH
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/