Re: [PATCH] avoid race condition in pick_next_task_fair inkernel/sched_fair.c

From: Miklos Vajna
Date: Wed Dec 22 2010 - 18:40:10 EST

On Wed, Dec 22, 2010 at 10:11:51PM +0100, Miklos Vajna <vmiklos@xxxxxxxxxxxxxx> wrote:
> I reported the issue as I tested 2.6.36 and 2.6.37-rc6 and both failed.
> Now I tried current -git and indeed I can't reproduce the issue there.
>
> I'm now bisecting between master and rc6 to see which commit fixes the
> problem - just to make sure it's not something irrelevant and the bug is
> still hidden somewhere.

I spoke too early. After some trying, it seems I can reproduce with
current -git as well. (But as Peter points out it's harder to
reproduce.)

Just in case it's interesting, I attached the -git dmesg. From a quick
look the trace is the same as with v2.6.36, which is easy to reproduce.
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.37-rc6-00186-ge5fcdb7 (vmiklos@helicon) (gcc version 4.5.2 (Frugalware Linux) ) #2 SMP PREEMPT Wed Dec 22 21:22:52 CET 2010
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 000000003fffd000 (usable)
BIOS-e820: 000000003fffd000 - 0000000040000000 (reserved)
BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved)
debug: ignoring loglevel setting.
Notice: NX (Execute Disable) protection missing in CPU or disabled in BIOS!
DMI 2.4 present.
DMI: /Bochs, BIOS Bochs 01/01/2007
e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
last_pfn = 0x3fffd max_arch_pfn = 0x100000
found SMP MP-table at [c00fdc00] fdc00
Scanning 0 areas for low memory corruption
initial memory mapped : 0 - 01c00000
init_memory_mapping: 0000000000000000-00000000377fe000
0000000000 - 0000400000 page 4k
0000400000 - 0037400000 page 2M
0037400000 - 00377fe000 page 4k
kernel direct mapping tables up to 377fe000 @ 1bfb000-1c00000
ACPI: RSDP 000fdbb0 00014 (v00 BOCHS )
ACPI: RSDT 3fffde30 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
ACPI: FACP 3ffffe70 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
ACPI: DSDT 3fffdfd0 01E22 (v01 BXPC BXDSDT 00000001 INTL 20090123)
ACPI: FACS 3ffffe00 00040
ACPI: SSDT 3fffdf90 00037 (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
ACPI: APIC 3fffdeb0 00072 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
ACPI: HPET 3fffde70 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
ACPI: Local APIC address 0xfee00000
135MB HIGHMEM available.
887MB LOWMEM available.
mapped low ram: 0 - 377fe000
low ram: 0 - 377fe000
kvm-clock: Using msrs 12 and 11
kvm-clock: cpu 0, msr 0:17be331, boot clock
Zone PFN ranges:
DMA 0x00000010 -> 0x00001000
Normal 0x00001000 -> 0x000377fe
HighMem 0x000377fe -> 0x0003fffd
Movable zone start PFN for each node
early_node_map[2] active PFN ranges
0: 0x00000010 -> 0x0000009f
0: 0x00000100 -> 0x0003fffd
On node 0 totalpages: 262028
free_area_init_node: node 0, pgdat c172ee20, node_mem_map f6ffd200
DMA zone: 32 pages used for memmap
DMA zone: 0 pages reserved
DMA zone: 3951 pages, LIFO batch:0
Normal zone: 1744 pages used for memmap
Normal zone: 221486 pages, LIFO batch:31
HighMem zone: 272 pages used for memmap
HighMem zone: 34543 pages, LIFO batch:7
Using APIC driver default
ACPI: PM-Timer IO Port: 0xb008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ5 used by override.
ACPI: IRQ9 used by override.
ACPI: IRQ10 used by override.
ACPI: IRQ11 used by override.
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a201 base: 0xfed00000
SMP: Allowing 1 CPUs, 0 hotplug CPUs
nr_irqs_gsi: 40
PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
Allocating PCI resources starting at 40000000 (gap: 40000000:bffbc000)
Booting paravirtualized kernel on KVM
setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1
PERCPU: Embedded 12 pages/cpu @f6800000 s27056 r0 d22096 u4194304
pcpu-alloc: s27056 r0 d22096 u4194304 alloc=1*4194304
pcpu-alloc: [0] 0
kvm-clock: cpu 0, msr 0:36806331, primary cpu clock
Built 1 zonelists in Zone order, mobility grouping on. Total pages: 259980
Kernel command line: root=/dev/sda1 debug sched_debug ignore_loglevel sysrq_always_enabled console=ttyS0 init=/bin/systemd
PID hash table entries: 4096 (order: 2, 16384 bytes)
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Initializing CPU#0
allocated 5242500 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
Initializing HighMem for node 0 (000377fe:0003fffd)
Memory: 1025412k/1048564k available (5451k kernel code, 22700k reserved, 1972k data, 504k init, 139260k highmem)
virtual kernel memory layout:
fixmap : 0xfff17000 - 0xfffff000 ( 928 kB)
pkmap : 0xff800000 - 0xffc00000 (4096 kB)
vmalloc : 0xf7ffe000 - 0xff7fe000 ( 120 MB)
lowmem : 0xc0000000 - 0xf77fe000 ( 887 MB)
.init : 0xc1741000 - 0xc17bf000 ( 504 kB)
.data : 0xc1552f3d - 0xc174022c (1972 kB)
.text : 0xc1000000 - 0xc1552f3d (5451 kB)
Checking if this processor honours the WP bit even in supervisor mode...Ok.
SLUB: Genslabs=15, HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
Preemptable hierarchical RCU implementation.
RCU-based detection of stalled CPUs is disabled.
Verbose stalled-CPUs detection is disabled.
NR_IRQS:2304 nr_irqs:256 16
CPU 0 irqstacks, hard=f6408000 soft=f640a000
Console: colour VGA+ 80x25
console [ttyS0] enabled
hpet clockevent registered
Detected 2665.754 MHz processor.
Calibrating delay loop (skipped) preset value.. 5331.50 BogoMIPS (lpj=2665754)
pid_max: default: 32768 minimum: 301
Security Framework initialized
AppArmor: AppArmor disabled by boot time parameter
Mount-cache hash table entries: 512
Initializing cgroup subsys ns
ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup.
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Performance Events: Broken PMU hardware detected, software events only.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 24k freed
ACPI: Core revision 20101013
Enabling APIC mode: Flat. Using 1 I/O APICs
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel QEMU Virtual CPU version 0.13.0 stepping 03
Brought up 1 CPUs
Total of 1 processors activated (5331.50 BogoMIPS).
devtmpfs: initialized
xor: automatically using best checksumming function: pIII_sse
pIII_sse : 7960.000 MB/sec
xor: using function: pIII_sse (7960.000 MB/sec)
regulator: core version 0.5
regulator: dummy:
NET: Registered protocol family 16
EISA bus registered
ACPI: bus type pci registered
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
raid6: int32x1 968 MB/s
raid6: int32x2 929 MB/s
raid6: int32x4 785 MB/s
raid6: int32x8 664 MB/s
raid6: mmxx1 3222 MB/s
raid6: mmxx2 3613 MB/s
raid6: sse1x1 2218 MB/s
raid6: sse1x2 2804 MB/s
raid6: sse2x1 4093 MB/s
raid6: sse2x2 4855 MB/s
raid6: using algorithm sse2x2 (4855 MB/s)
ACPI: EC: Look up EC in DSDT
ACPI: Interpreter enabled
ACPI: (supports S0 S3 S4 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
pci_root PNP0A03:00: host bridge window [io 0x0000-0x0cf7] (ignored)
pci_root PNP0A03:00: host bridge window [io 0x0d00-0xffff] (ignored)
pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff] (ignored)
pci_root PNP0A03:00: host bridge window [mem 0xe0000000-0xfebfffff] (ignored)
pci 0000:00:00.0: [8086:1237] type 0 class 0x000600
pci 0000:00:01.0: [8086:7000] type 0 class 0x000601
pci 0000:00:01.1: [8086:7010] type 0 class 0x000101
pci 0000:00:01.1: reg 20: [io 0xc000-0xc00f]
pci 0000:00:01.3: [8086:7113] type 0 class 0x000680
pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB
pci 0000:00:02.0: [1013:00b8] type 0 class 0x000300
pci 0000:00:02.0: reg 10: [mem 0xf0000000-0xf1ffffff pref]
pci 0000:00:02.0: reg 14: [mem 0xf2000000-0xf2000fff]
pci 0000:00:02.0: reg 30: [mem 0xf2010000-0xf201ffff pref]
pci 0000:00:03.0: [8086:100e] type 0 class 0x000200
pci 0000:00:03.0: reg 10: [mem 0xf2020000-0xf203ffff]
pci 0000:00:03.0: reg 14: [io 0xc040-0xc07f]
pci 0000:00:03.0: reg 30: [mem 0xf2040000-0xf205ffff pref]
pci_bus 0000:00: on NUMA node 0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
SCSI subsystem initialized
libata version 3.00 loaded.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
PCI: pci_cache_line_size set to 32 bytes
reserve RAM buffer: 000000000009f400 - 000000000009ffff
reserve RAM buffer: 000000003fffd000 - 000000003fffffff
NetLabel: Initializing
NetLabel: domain hash size = 128
NetLabel: protocols = UNLABELED CIPSOv4
NetLabel: unlabeled traffic allowed by default
HPET: 3 timers in total, 0 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 comparators, 64-bit 100.000000 MHz counter
Switching to clocksource kvm-clock
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp 00:00: [bus 00-ff]
pnp 00:00: [io 0x0cf8-0x0cff]
pnp 00:00: [io 0x0000-0x0cf7 window]
pnp 00:00: [io 0x0d00-0xffff window]
pnp 00:00: [mem 0x000a0000-0x000bffff window]
pnp 00:00: [mem 0xe0000000-0xfebfffff window]
pnp 00:00: Plug and Play ACPI device, IDs PNP0a03 (active)
pnp 00:01: [io 0x0070-0x0071]
pnp 00:01: [irq 8]
pnp 00:01: [io 0x0072-0x0077]
pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
pnp 00:02: [io 0x0060]
pnp 00:02: [io 0x0064]
pnp 00:02: [irq 1]
pnp 00:02: Plug and Play ACPI device, IDs PNP0303 (active)
pnp 00:03: [irq 12]
pnp 00:03: Plug and Play ACPI device, IDs PNP0f13 (active)
pnp 00:04: [io 0x03f2-0x03f5]
pnp 00:04: [io 0x03f7]
pnp 00:04: [irq 6]
pnp 00:04: [dma 2]
pnp 00:04: Plug and Play ACPI device, IDs PNP0700 (active)
pnp 00:05: [io 0x0378-0x037f]
pnp 00:05: [irq 7]
pnp 00:05: Plug and Play ACPI device, IDs PNP0400 (active)
pnp 00:06: [io 0x03f8-0x03ff]
pnp 00:06: [irq 4]
pnp 00:06: Plug and Play ACPI device, IDs PNP0501 (active)
pnp 00:07: [mem 0xfed00000-0xfed003ff]
pnp 00:07: Plug and Play ACPI device, IDs PNP0103 (active)
pnp: PnP ACPI: found 8 devices
ACPI: ACPI bus type pnp unregistered
PnPBIOS: Disabled
pci_bus 0000:00: resource 0 [io 0x0000-0xffff]
pci_bus 0000:00: resource 1 [mem 0x00000000-0xffffffff]
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
UDP hash table entries: 512 (order: 2, 16384 bytes)
UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
NET: Registered protocol family 1
pci 0000:00:00.0: Limiting direct PCI/PCI transfers
pci 0000:00:01.0: PIIX3: Enabling Passive Release
pci 0000:00:01.0: Activating ISA DMA hang workarounds
pci 0000:00:02.0: Boot video device
PCI: CLS 0 bytes, default 32
Scanning for low memory corruption every 60 seconds
audit: initializing netlink socket (disabled)
type=2000 audit(1293058318.479:1): initialized
highmem bounce pool size: 64 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, no debug enabled
SGI XFS Quota Management subsystem
msgmni has been set to 1730
async_tx: api initialized (async)
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
Clocksource tsc unstable (delta = -74324425 ns)
˙serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
FDC 0 is a S82078B
brd: module loaded
Compaq SMART2 Driver (v 2.6.0)
HP CISS Driver (v 3.6.26)
Uniform Multi-Platform E-IDE driver
ide-gd driver 1.18
ide-cd driver 5.00
stex: Promise SuperTrak EX Driver version: 4.6.0000.4
ata_piix 0000:00:01.1: version 2.13
ata_piix 0000:00:01.1: setting latency timer to 64
scsi0 : ata_piix
scsi1 : ata_piix
ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc000 irq 14
ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc008 irq 15
Fusion MPT base driver 3.04.17
Copyright (c) 1999-2008 LSI Corporation
Fusion MPT SPI Host driver 3.04.17
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
usbcore: registered new interface driver ums-alauda
usbcore: registered new interface driver ums-cypress
usbcore: registered new interface driver ums-datafab
usbcore: registered new interface driver ums-freecom
usbcore: registered new interface driver ums-isd200
usbcore: registered new interface driver ums-jumpshot
usbcore: registered new interface driver ums-karma
usbcore: registered new interface driver ums-onetouch
usbcore: registered new interface driver ums-sddr09
usbcore: registered new interface driver ums-sddr55
usbcore: registered new interface driver ums-usbat
PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
md: linear personality registered for level -1
md: raid0 personality registered for level 0
md: raid1 personality registered for level 1
md: raid10 personality registered for level 10
md: raid6 personality registered for level 6
md: raid5 personality registered for level 5
md: raid4 personality registered for level 4
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
EISA: Probing bus 0 at eisa.0
EISA: Detected 0 cards.
cpuidle: using governor ladder
cpuidle: using governor menu
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
TCP bic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
Registering the dns_resolver key type
Using IPI No-Shortcut mode
registered taskstats version 1
drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
ata2.01: NODEV after polling detection
ata1.01: NODEV after polling detection
ata1.00: ATA-7: QEMU HARDDISK, 0.13.0, max UDMA/100
ata1.00: 16777216 sectors, multi 16: LBA48
ata2.00: ATAPI: QEMU DVD-ROM, 0.13.0, max UDMA/100
ata2.00: configured for MWDMA2
ata1.00: configured for MWDMA2
scsi 0:0:0:0: Direct-Access ATA QEMU HARDDISK 0.13 PQ: 0 ANSI: 5
sd 0:0:0:0: [sda] 16777216 512-byte logical blocks: (8.58 GB/8.00 GiB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
sda: sda1
scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 0.13 PQ: 0 ANSI: 5
sd 0:0:0:0: [sda] Attached SCSI disk
sr0: scsi3-mmc drive: 4x/4x xa/form2 tray
cdrom: Uniform CD-ROM driver Revision: 3.20
sr 1:0:0:0: Attached scsi CD-ROM sr0
md: Waiting for all devices to be available before autodetect
md: If you don't use raid, use raid=noautodetect
md: Autodetecting RAID arrays.
md: Scanned 0 and added 0 devices.
md: autorun ...
md: ... autorun DONE.
EXT3-fs (sda1): error: couldn't mount because of unsupported optional features (240)
EXT2-fs (sda1): error: couldn't mount because of unsupported optional features (244)
EXT4-fs (sda1): INFO: recovery required on readonly filesystem
EXT4-fs (sda1): write access will be enabled during recovery
EXT4-fs (sda1): recovery complete
EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
VFS: Mounted root (ext4 filesystem) readonly on device 8:1.
devtmpfs: mounted
Freeing unused kernel memory: 504k freed
systemd[1]: systemd 15 running in system mode. (+PAM -LIBWRAP -AUDIT -SELINUX +SYSVINIT -LIBCRYPTSETUP; frugalware)
Welcome to Frugalware 1.4pre2 (Nexon)!
systemd[1]: /sbin/modprobe failed with error code 1.
systemd[1]: Set hostname to <frugalware>.
systemd[1]: /etc/mtab is not a symlink or not pointing to /proc/self/mounts. This is not supported anymore. Please make sure to replace this file by a symlink to avoid incorrect or misleading mount(8) output.
Starting LSB: Clean /tmp, /var/run and /var/lock....
Starting Apply Kernel Variables...
Starting Load Kernel Modules...
systemd[1]: Failed to open /dev/autofs: No such file or directory
systemd[1]: Failed to initialize automounter: No such file or directory
systemd[1]: Unit sys-kernel-debug.automount entered failed state.
systemd[1]: Failed to open /dev/autofs: No such file or directory
systemd[1]: Failed to initialize automounter: No such file or directory
systemd[1]: Unit proc-sys-fs-binfmt_misc.automount entered failed state.
systemd[1]: Failed to open /dev/autofs: No such file or directory
systemd[1]: Failed to initialize automounter: No such file or directory
systemd[1]: Unit sys-kernel-security.automount entered failed state.
systemd[1]: Failed to open /dev/autofs: No such file or directory
systemd[1]: Failed to initialize automounter: No such file or directory
systemd[1]: Unit dev-mqueue.automount entered failed state.
Starting Setup Virtual Console...
Starting Apply System Clock UTC Offset...
Starting Remount API VFS...
Starting File System Check on Root Device...
Starting Logging Daemon...
Starting systemd Syslog Kernel Log Buffer Bridge...
systemd[1]: systemd-modules-load.service: main process exited, code=exited, status=1
Starting Load Kernel Modules failed.
systemd[1]: Unit systemd-modules-load.service entered failed state.
modprobe[1229]: FATAL: Could not load /lib/modules/2.6.37-rc6-00186-ge5fcdb7/modules.dep: No such file or directoryStarting udev Kernel Device Manager...

systemd-fsck[1235]: /dev/sda1: Superblock last mount time is in the future.
systemd-fsck[1235]: (by less than a day, probably due to the hardware clock being incorrectly set) FIXED.
systemd-fsck[1235]: /dev/sda1: clean, 45976/524288 files, 265431/2096474 blocks (check in 3 mounts)
udev[1244]: starting version 165
Starting Remount Root FS...
EXT4-fs (sda1): re-mounted. Opts: (null)
Starting Load Random Seed...
Starting Recreate Volatile Files and Directories...
BUG: unable to handle kernel NULL pointer dereference at 00000001
IP: [<c129e938>] __rb_rotate_right+0x18/0x70
*pde = 00000000
Oops: 0000 [#1] PREEMPT SMP
last sysfs file: /sys/bus/pnp/drivers/i8042 kbd/uevent
Modules linked in:

Pid: 1380, comm: systemd-cgroups Not tainted 2.6.37-rc6-00186-ge5fcdb7 #2 /Bochs
EIP: 0060:[<c129e938>] EFLAGS: 00010002 CPU: 0
EIP is at __rb_rotate_right+0x18/0x70
EAX: f5ca2e48 EBX: f5ca2e4c ECX: f5ca2e48 EDX: f5ca27fc
ESI: 00000001 EDI: 00000001 EBP: f6806360 ESP: f5d6fe88
DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
Process systemd-cgroups (pid: 1380, ti=f5d6e000 task=f67c4000 task.ti=f5d6e000)
Stack:
f5ca27fc 00000001 f5ca2e48 c129ed02 00000001 f5ca27e0 f5ca2a20 f5ca2a28
f6806360 c1032438 f67c41bc f6806360 00000000 f67c4000 c154f5ff f5d6ff24
c155a7e0 00000564 c110480a f5d6ff17 c17be360 c17be360 f67c41c0 c17be360
Call Trace:
[<c129ed02>] ? rb_erase+0x262/0x2b0
[<c1032438>] ? pick_next_task_fair+0x88/0x120
[<c154f5ff>] ? schedule+0x49f/0x960
[<c110480a>] ? d_lookup+0x2a/0x40
[<c10e6e96>] ? __slab_free+0xd6/0x180
[<c103ea89>] ? release_task+0x2b9/0x420
[<c1040410>] ? do_exit+0x520/0x790
[<c104088e>] ? do_group_exit+0x2e/0x90
[<c1040901>] ? sys_exit_group+0x11/0x20
[<c100361c>] ? sysenter_do_call+0x12/0x28
Code: 5f c3 90 89 4b 08 8b 10 83 e2 03 09 ca 89 10 5b 5e 5f c3 57 56 53 8b 48 08 8b 18 83 e3 fc 8b 71 04 89 70 08 85 f6 74 0c 8b 79 04 <8b> 37 83 e6 03 09 c6 89 37 89 41 04 8b 31 83 e6 03 09 de 89 31
EIP: [<c129e938>] __rb_rotate_right+0x18/0x70 SS:ESP 0068:f5d6fe88
CR2: 0000000000000001
---[ end trace 0f6a879251f67ee0 ]---
Fixing recursive fault but reboot is needed!

Attachment: pgp00000.pgp
Description: PGP signature