iMX6 5.2-rc3 boot failure due to "PCI: imx6: Allow asynchronous probing"

[Robert Hancock]

I am seeing a boot failure on our iMX6D-based embedded platform running
v5.2-rc3. It seems to stall for about 20 seconds after "random: crng
init done" and then panic with a bunch of RCU stall and soft-lockup
errors. It seems like something is hanging up in the iMX6 PCIe driver.
Boot log is below.

Suspecting the following patch, I reverted it locally and it seems to
resolve the issue. (Well it gets into userspace at least; it later
oopses in the ksz switch driver, appears unrelated..)

commit 1b8df7aa78748ddafc6f3b16a6328a3c500087b3
Author: Lucas Stach <l.stach@xxxxxxxxxxxxxx>
Date:   Thu Apr 4 18:45:17 2019 +0200

    PCI: imx6: Allow asynchronous probing

    Establishing a PCIe link can take a while; allow asynchronous probing so
    that link establishment can happen in the background while other devices
    are being probed.

    Signed-off-by: Lucas Stach <l.stach@xxxxxxxxxxxxxx>
    Signed-off-by: Lorenzo Pieralisi <lorenzo.pieralisi@xxxxxxx>
    Signed-off-by: Bjorn Helgaas <bhelgaas@xxxxxxxxxx>
    Reviewed-by: Fabio Estevam <festevam@xxxxxxxxx>

I would say either that patch needs a fix or it should be reverted for now.

[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 5.2.0-rc3
(hancock@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 8.3.0
(Buildroot 2019.02.1-00510-gcc60ea2)) #1 SMP PREEMPT Fri Jun 7 17:44:38
CST 2019
[    0.000000] CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7),
cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing
instruction cache
[    0.000000] OF: fdt: Machine model: SED Systems xxx
[    0.000000] printk: bootconsole [earlycon0] enabled
[    0.000000] Memory policy: Data cache writealloc
[    0.000000] cma: Reserved 64 MiB at 0x3c000000
[    0.000000] percpu: Embedded 16 pages/cpu s36364 r8192 d20980 u65536
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 260608
[    0.000000] Kernel command line: console=ttymxc0,115200 earlyprintk
[    0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288
bytes)
[    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144
bytes)
[    0.000000] Memory: 940708K/1048576K available (6144K kernel code,
304K rwdata, 2036K rodata, 1024K init, 377K bss, 42332K reserved, 65536K
cma-reserved, 262144K highmem)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=4 to nr_cpu_ids=2.
[    0.000000]  Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay
is 100 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] L2C-310 errata 752271 769419 enabled
[    0.000000] L2C-310 enabling early BRESP for Cortex-A9
[    0.000000] L2C-310 full line of zeros enabled for Cortex-A9
[    0.000000] L2C-310 ID prefetch enabled, offset 16 lines
[    0.000000] L2C-310 dynamic clock gating enabled, standby mode enabled
[    0.000000] L2C-310 cache controller enabled, 16 ways, 1024 kB
[    0.000000] L2C-310: CACHE_ID 0x410000c7, AUX_CTRL 0x76470001
[    0.000000] random: get_random_bytes called from
start_kernel+0x2ac/0x434 with crng_init=0
[    0.000000] Switching to timer-based delay loop, resolution 333ns
[    0.000007] sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps
every 715827882841ns
[    0.008211] clocksource: mxc_timer1: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 637086815595 ns
[    0.019178] Console: colour dummy device 80x30
[    0.023670] Calibrating delay loop (skipped), value calculated using
timer frequency.. 6.00 BogoMIPS (lpj=3000)
[    0.033799] pid_max: default: 32768 minimum: 301
[    0.038557] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes)
[    0.045211] Mountpoint-cache hash table entries: 2048 (order: 1, 8192
bytes)
[    0.052846] *** VALIDATE proc ***
[    0.056285] *** VALIDATE cgroup1 ***
[    0.059886] *** VALIDATE cgroup2 ***
[    0.063483] CPU: Testing write buffer coherency: ok
[    0.068401] CPU0: Spectre v2: using BPIALL workaround
[    0.073698] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.085424] Setting up static identity map for 0x10100000 - 0x10100060
[    0.093365] rcu: Hierarchical SRCU implementation.
[    0.103365] smp: Bringing up secondary CPUs ...
[    0.115623] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
[    0.115630] CPU1: Spectre v2: using BPIALL workaround
[    0.126488] smp: Brought up 1 node, 2 CPUs
[    0.130636] SMP: Total of 2 processors activated (12.00 BogoMIPS).
[    0.136846] CPU: All CPU(s) started in SVC mode.
[    0.142366] devtmpfs: initialized
[    0.153902] VFP support v0.3: implementor 41 architecture 3 part 30
variant 9 rev 4
[    0.161920] clocksource: jiffies: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.171715] futex hash table entries: 512 (order: 3, 32768 bytes)
[    0.181088] pinctrl core: initialized pinctrl subsystem
[    0.187300] NET: Registered protocol family 16
[    0.200572] DMA: preallocated 256 KiB pool for atomic coherent
allocations
[    0.208274] cpuidle: using governor menu
[    0.212276] CPU identified as i.MX6Q, silicon rev 1.5
[    0.224679] vdd1p1: supplied by regulator-dummy
[    0.229707] vdd3p0: supplied by regulator-dummy
[    0.234698] vdd2p5: supplied by regulator-dummy
[    0.251174] No ATAGs?
[    0.251273] hw-breakpoint: found 5 (+1 reserved) breakpoint and 1
watchpoint registers.
[    0.261602] hw-breakpoint: maximum watchpoint size is 4 bytes.
[    0.268154] imx6q-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver
[    0.305898] mxs-dma 110000.dma-apbh: initialized
[    0.311919] SCSI subsystem initialized
[    0.315876] usbcore: registered new interface driver usbfs
[    0.321440] usbcore: registered new interface driver hub
[    0.326854] usbcore: registered new device driver usb
[    0.333218] i2c i2c-0: IMX I2C adapter registered
[    0.338665] i2c i2c-1: IMX I2C adapter registered
[    0.344097] i2c i2c-2: IMX I2C adapter registered
[    0.348996] pps_core: LinuxPPS API ver. 1 registered
[    0.353989] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
Rodolfo Giometti <giometti@xxxxxxxx>
[    0.363170] PTP clock support registered
[    0.367981] clocksource: Switched to clocksource mxc_timer1
[    0.373841] VFS: Disk quotas dquot_6.6.0
[    0.377902] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096
bytes)
[    0.394255] NET: Registered protocol family 2
[    0.399197] tcp_listen_portaddr_hash hash table entries: 512 (order:
0, 6144 bytes)
[    0.406932] TCP established hash table entries: 8192 (order: 3, 32768
bytes)
[    0.414093] TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
[    0.420715] TCP: Hash tables configured (established 8192 bind 8192)
[    0.427291] UDP hash table entries: 512 (order: 2, 16384 bytes)
[    0.433288] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[    0.439846] NET: Registered protocol family 1
[    0.444268] PCI: CLS 0 bytes, default 64
[    0.448405] Trying to unpack rootfs image as initramfs...
[   13.138778] Freeing initrd memory: 21968K
[   13.143193] hw perfevents: no interrupt-affinity property for /pmu,
guessing.
[   13.150628] hw perfevents: enabled with armv7_cortex_a9 PMU driver, 7
counters available
[   13.160714] workingset: timestamp_bits=30 max_order=18 bucket_order=0
[   13.171611] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[   13.177956] bounce: pool size: 64 pages
[   13.181837] io scheduler mq-deadline registered
[   13.186401] io scheduler kyber registered
[   13.193578] imx6q-pcie 1ffc000.pcie: host bridge /soc/pcie@1ffc000
ranges:
[   13.200635] imx6q-pcie 1ffc000.pcie:    IO 0x01f80000..0x01f8ffff ->
0x00000000
[   13.201454] imx-sdma 20ec000.sdma: loaded firmware 3.3
[   13.208445] random: fast init done
[   13.216275] imx-pgc-pd imx-pgc-power-domain.0: DMA mask not set
[   13.222661] imx-pgc-pd imx-pgc-power-domain.1: DMA mask not set
[   13.239568] random: crng init done
[   34.207973] rcu: INFO: rcu_preempt self-detected stall on CPU
[   34.213742] rcu:     0-...!: (20992 ticks this GP)
idle=94a/1/0x40000004 softirq=72/72 fqs=5
[   34.222025]  (t=21000 jiffies g=2937 q=7)
[   34.226048] rcu: rcu_preempt kthread starved for 20964 jiffies! g2937
f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[   34.236331] rcu: RCU grace-period kthread stack dump:
[   34.241392] rcu_preempt     R  running task        0    10      2
0x00000000
[   34.248489] [<c06b77e0>] (__schedule) from [<c06b7a50>]
(schedule+0x58/0x104)
[   34.255652] [<c06b7a50>] (schedule) from [<c06bb51c>]
(schedule_timeout+0x15c/0x270)
[   34.263427] [<c06bb51c>] (schedule_timeout) from [<c017f104>]
(rcu_gp_kthread+0x548/0xab8)
[   34.271721] [<c017f104>] (rcu_gp_kthread) from [<c013e78c>]
(kthread+0x144/0x14c)
[   34.279230] [<c013e78c>] (kthread) from [<c01010e8>]
(ret_from_fork+0x14/0x2c)
[   34.286469] Exception stack(0xe808bfb0 to 0xe808bff8)
[   34.291534] bfa0:                                     00000000
00000000 00000000 00000000
[   34.299731] bfc0: 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   34.307928] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[   34.314559] NMI backtrace for cpu 0
[   34.318061] CPU: 0 PID: 7 Comm: kworker/u4:0 Not tainted 5.2.0-rc3 #1
[   34.324515] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
[   34.331064] Workqueue: events_unbound async_run_entry_fn
[   34.336404] [<c0110be4>] (unwind_backtrace) from [<c010bac0>]
(show_stack+0x10/0x14)
[   34.344174] [<c010bac0>] (show_stack) from [<c069f790>]
(dump_stack+0x88/0x9c)
[   34.351420] [<c069f790>] (dump_stack) from [<c06a5e88>]
(nmi_cpu_backtrace+0x90/0xc4)
[   34.359275] [<c06a5e88>] (nmi_cpu_backtrace) from [<c06a6020>]
(nmi_trigger_cpumask_backtrace+0x164/0x1a4)
[   34.368958] [<c06a6020>] (nmi_trigger_cpumask_backtrace) from
[<c01810a4>] (rcu_dump_cpu_stacks+0xa4/0xcc)
[   34.378640] [<c01810a4>] (rcu_dump_cpu_stacks) from [<c0180224>]
(rcu_sched_clock_irq+0x7c4/0xa40)
[   34.387630] [<c0180224>] (rcu_sched_clock_irq) from [<c01864b4>]
(update_process_times+0x34/0x6c)
[   34.396536] [<c01864b4>] (update_process_times) from [<c0197234>]
(tick_sched_timer+0x4c/0xa8)
[   34.405177] [<c0197234>] (tick_sched_timer) from [<c01876a8>]
(__hrtimer_run_queues+0x154/0x1fc)
[   34.413987] [<c01876a8>] (__hrtimer_run_queues) from [<c0187a84>]
(hrtimer_interrupt+0x11c/0x2b0)
[   34.422885] [<c0187a84>] (hrtimer_interrupt) from [<c010fa48>]
(twd_handler+0x30/0x38)
[   34.430829] [<c010fa48>] (twd_handler) from [<c0172e7c>]
(handle_percpu_devid_irq+0x78/0x138)
[   34.439379] [<c0172e7c>] (handle_percpu_devid_irq) from [<c016d424>]
(generic_handle_irq+0x24/0x34)
[   34.448449] [<c016d424>] (generic_handle_irq) from [<c016d9e0>]
(__handle_domain_irq+0x5c/0xb4)
[   34.457178] [<c016d9e0>] (__handle_domain_irq) from [<c0398cd0>]
(gic_handle_irq+0x3c/0x78)
[   34.465555] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>]
(__irq_svc+0x6c/0xa8)
[   34.473052] Exception stack(0xe8081a88 to 0xe8081ad0)
[   34.478117] 1a80:                   2ad3e000 00000000 2ad3e000
c0a60f00 00000002 00000000
[   34.486317] 1aa0: 00000001 ffffe000 e800c000 c0b03080 c0b4eb88
c0b4e688 04208060 e8081ad8
[   34.494513] 1ac0: 04208060 c0102258 60000113 ffffffff
[   34.499583] [<c0101a8c>] (__irq_svc) from [<c0102258>]
(__do_softirq+0xb0/0x2ac)
[   34.507004] [<c0102258>] (__do_softirq) from [<c01259c0>]
(irq_exit+0xb0/0xd4)
[   34.514250] [<c01259c0>] (irq_exit) from [<c016d9e4>]
(__handle_domain_irq+0x60/0xb4)
[   34.522103] [<c016d9e4>] (__handle_domain_irq) from [<c0398cd0>]
(gic_handle_irq+0x3c/0x78)
[   34.530477] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>]
(__irq_svc+0x6c/0xa8)
[   34.537974] Exception stack(0xe8081b68 to 0xe8081bb0)
[   34.543039] 1b60:                   20000193 2ad3e000 00000000
20000113 00000001 00000000
[   34.551238] 1b80: 00000053 00000000 e8080000 c01149e4 c0b4eb88
c0b4e688 0000000a e8081bb8
[   34.559433] 1ba0: c016ace4 c016acec 20000113 ffffffff
[   34.564508] [<c0101a8c>] (__irq_svc) from [<c016acec>]
(console_unlock+0x290/0x410)
[   34.572190] [<c016acec>] (console_unlock) from [<c016c4f8>]
(vprintk_emit+0x170/0x228)
[   34.580134] [<c016c4f8>] (vprintk_emit) from [<c0429c48>]
(dev_vprintk_emit+0x1d4/0x1f4)
[   34.588247] [<c0429c48>] (dev_vprintk_emit) from [<c0429c94>]
(dev_printk_emit+0x2c/0x50)
[   34.596446] [<c0429c94>] (dev_printk_emit) from [<c0429d34>]
(__dev_printk+0x7c/0x90)
[   34.604297] [<c0429d34>] (__dev_printk) from [<c042a058>]
(_dev_info+0x44/0x68)
[   34.611636] [<c042a058>] (_dev_info) from [<c03c4154>]
(devm_of_pci_get_host_bridge_resources+0x198/0x298)
[   34.621322] [<c03c4154>] (devm_of_pci_get_host_bridge_resources) from
[<c03d0a2c>] (dw_pcie_host_init+0xb4/0x544)
[   34.631611] [<c03d0a2c>] (dw_pcie_host_init) from [<c03d261c>]
(imx6_pcie_probe+0x3a0/0x6b8)
[   34.640077] [<c03d261c>] (imx6_pcie_probe) from [<c042dd20>]
(platform_drv_probe+0x48/0x98)
[   34.648454] [<c042dd20>] (platform_drv_probe) from [<c042bfac>]
(really_probe+0xf0/0x2c8)
[   34.656656] [<c042bfac>] (really_probe) from [<c042c2e4>]
(driver_probe_device+0x60/0x16c)
[   34.664943] [<c042c2e4>] (driver_probe_device) from [<c042c440>]
(__driver_attach_async_helper+0x50/0x54)
[   34.674536] [<c042c440>] (__driver_attach_async_helper) from
[<c014188c>] (async_run_entry_fn+0x44/0x118)
[   34.684136] [<c014188c>] (async_run_entry_fn) from [<c013865c>]
(process_one_work+0x17c/0x390)
[   34.692775] [<c013865c>] (process_one_work) from [<c01393a0>]
(worker_thread+0x44/0x518)
[   34.700890] [<c01393a0>] (worker_thread) from [<c013e78c>]
(kthread+0x144/0x14c)
[   34.708307] [<c013e78c>] (kthread) from [<c01010e8>]
(ret_from_fork+0x14/0x2c)
[   34.715545] Exception stack(0xe8081fb0 to 0xe8081ff8)
[   34.720607] 1fa0:                                     00000000
00000000 00000000 00000000
[   34.728804] 1fc0: 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   34.737000] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[   40.259973] watchdog: BUG: soft lockup - CPU#1 stuck for 22s!
[migration/1:15]
[   40.267211] Modules linked in:
[   40.270279] CPU: 1 PID: 15 Comm: migration/1 Not tainted 5.2.0-rc3 #1
[   40.276732] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
[   40.283284] PC is at multi_cpu_stop+0xe0/0x124
[   40.287738] LR is at multi_cpu_stop+0x114/0x124
[   40.292279] pc : [<c01ae4d8>]    lr : [<c01ae50c>]    psr: 60000013
[   40.298558] sp : e809df10  ip : 00000000  fp : 00000000
[   40.303794] r10: 00000000  r9 : a0000013  r8 : 00000000
[   40.309030] r7 : 00000001  r6 : e81cbea4  r5 : 00000001  r4 : e81cbeb8
[   40.315571] r3 : 00000001  r2 : 00000000  r1 : 00000004  r0 : 00000000
[   40.322114] Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM
Segment none
[   40.329266] Control: 10c5387d  Table: 1000404a  DAC: 00000051
[   40.335025] CPU: 1 PID: 15 Comm: migration/1 Not tainted 5.2.0-rc3 #1
[   40.341477] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
[   40.348031] [<c0110be4>] (unwind_backtrace) from [<c010bac0>]
(show_stack+0x10/0x14)
[   40.355799] [<c010bac0>] (show_stack) from [<c069f790>]
(dump_stack+0x88/0x9c)
[   40.363047] [<c069f790>] (dump_stack) from [<c01af5c0>]
(watchdog_timer_fn+0x244/0x2bc)
[   40.371080] [<c01af5c0>] (watchdog_timer_fn) from [<c01876a8>]
(__hrtimer_run_queues+0x154/0x1fc)
[   40.379978] [<c01876a8>] (__hrtimer_run_queues) from [<c0187a84>]
(hrtimer_interrupt+0x11c/0x2b0)
[   40.388875] [<c0187a84>] (hrtimer_interrupt) from [<c010fa48>]
(twd_handler+0x30/0x38)
[   40.396818] [<c010fa48>] (twd_handler) from [<c0172e7c>]
(handle_percpu_devid_irq+0x78/0x138)
[   40.405367] [<c0172e7c>] (handle_percpu_devid_irq) from [<c016d424>]
(generic_handle_irq+0x24/0x34)
[   40.414434] [<c016d424>] (generic_handle_irq) from [<c016d9e0>]
(__handle_domain_irq+0x5c/0xb4)
[   40.423159] [<c016d9e0>] (__handle_domain_irq) from [<c0398cd0>]
(gic_handle_irq+0x3c/0x78)
[   40.431534] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>]
(__irq_svc+0x6c/0xa8)
[   40.439032] Exception stack(0xe809dec0 to 0xe809df08)
[   40.444098] dec0: 00000000 00000004 00000000 00000001 e81cbeb8
00000001 e81cbea4 00000001
[   40.452296] dee0: 00000000 a0000013 00000000 00000000 00000000
e809df10 c01ae50c c01ae4d8
[   40.460490] df00: 60000013 ffffffff
[   40.463993] [<c0101a8c>] (__irq_svc) from [<c01ae4d8>]
(multi_cpu_stop+0xe0/0x124)
[   40.471586] [<c01ae4d8>] (multi_cpu_stop) from [<c01ae748>]
(cpu_stopper_thread+0x8c/0x128)
[   40.479963] [<c01ae748>] (cpu_stopper_thread) from [<c0142330>]
(smpboot_thread_fn+0x150/0x2bc)
[   40.488687] [<c0142330>] (smpboot_thread_fn) from [<c013e78c>]
(kthread+0x144/0x14c)
[   40.496450] [<c013e78c>] (kthread) from [<c01010e8>]
(ret_from_fork+0x14/0x2c)
[   40.503686] Exception stack(0xe809dfb0 to 0xe809dff8)
[   40.508749] dfa0:                                     00000000
00000000 00000000 00000000
[   40.516946] dfc0: 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   40.525142] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[   40.531771] Kernel panic - not syncing: softlockup: hung tasks
[   40.537619] CPU: 1 PID: 15 Comm: migration/1 Tainted: G             L
   5.2.0-rc3 #1
[   40.545464] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
[   40.552012] [<c0110be4>] (unwind_backtrace) from [<c010bac0>]
(show_stack+0x10/0x14)
[   40.559778] [<c010bac0>] (show_stack) from [<c069f790>]
(dump_stack+0x88/0x9c)
[   40.567028] [<c069f790>] (dump_stack) from [<c0120ec0>]
(panic+0x114/0x324)
[   40.574013] [<c0120ec0>] (panic) from [<c01af610>]
(watchdog_timer_fn+0x294/0x2bc)
[   40.581608] [<c01af610>] (watchdog_timer_fn) from [<c01876a8>]
(__hrtimer_run_queues+0x154/0x1fc)
[   40.590504] [<c01876a8>] (__hrtimer_run_queues) from [<c0187a84>]
(hrtimer_interrupt+0x11c/0x2b0)
[   40.599399] [<c0187a84>] (hrtimer_interrupt) from [<c010fa48>]
(twd_handler+0x30/0x38)
[   40.607338] [<c010fa48>] (twd_handler) from [<c0172e7c>]
(handle_percpu_devid_irq+0x78/0x138)
[   40.615886] [<c0172e7c>] (handle_percpu_devid_irq) from [<c016d424>]
(generic_handle_irq+0x24/0x34)
[   40.624953] [<c016d424>] (generic_handle_irq) from [<c016d9e0>]
(__handle_domain_irq+0x5c/0xb4)
[   40.633676] [<c016d9e0>] (__handle_domain_irq) from [<c0398cd0>]
(gic_handle_irq+0x3c/0x78)
[   40.642049] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>]
(__irq_svc+0x6c/0xa8)
[   40.649546] Exception stack(0xe809dec0 to 0xe809df08)
[   40.654611] dec0: 00000000 00000004 00000000 00000001 e81cbeb8
00000001 e81cbea4 00000001
[   40.662809] dee0: 00000000 a0000013 00000000 00000000 00000000
e809df10 c01ae50c c01ae4d8
[   40.671003] df00: 60000013 ffffffff
[   40.674505] [<c0101a8c>] (__irq_svc) from [<c01ae4d8>]
(multi_cpu_stop+0xe0/0x124)
[   40.682096] [<c01ae4d8>] (multi_cpu_stop) from [<c01ae748>]
(cpu_stopper_thread+0x8c/0x128)
[   40.690469] [<c01ae748>] (cpu_stopper_thread) from [<c0142330>]
(smpboot_thread_fn+0x150/0x2bc)
[   40.699191] [<c0142330>] (smpboot_thread_fn) from [<c013e78c>]
(kthread+0x144/0x14c)
[   40.706954] [<c013e78c>] (kthread) from [<c01010e8>]
(ret_from_fork+0x14/0x2c)
[   40.714191] Exception stack(0xe809dfb0 to 0xe809dff8)
[   40.719255] dfa0:                                     00000000
00000000 00000000 00000000
[   40.727453] dfc0: 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   40.735650] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[   40.742284] CPU0: stopping
[   40.745004] CPU: 0 PID: 7 Comm: kworker/u4:0 Tainted: G             L
   5.2.0-rc3 #1
[   40.752850] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
[   40.759397] Workqueue: events_unbound async_run_entry_fn
[   40.764731] [<c0110be4>] (unwind_backtrace) from [<c010bac0>]
(show_stack+0x10/0x14)
[   40.772497] [<c010bac0>] (show_stack) from [<c069f790>]
(dump_stack+0x88/0x9c)
[   40.779741] [<c069f790>] (dump_stack) from [<c010f100>]
(handle_IPI+0x1a8/0x1d4)
[   40.787159] [<c010f100>] (handle_IPI) from [<c0398d08>]
(gic_handle_irq+0x74/0x78)
[   40.794749] [<c0398d08>] (gic_handle_irq) from [<c0101a8c>]
(__irq_svc+0x6c/0xa8)
[   40.802247] Exception stack(0xe8081a88 to 0xe8081ad0)
[   40.807311] 1a80:                   2ad3e000 00000000 2ad3e000
c0a60f00 00000002 00000000
[   40.815510] 1aa0: 00000001 ffffe000 e800c000 c0b03080 c0b4eb88
c0b4e688 04208060 e8081ad8
[   40.823706] 1ac0: 04208060 c0102258 60000113 ffffffff
[   40.828774] [<c0101a8c>] (__irq_svc) from [<c0102258>]
(__do_softirq+0xb0/0x2ac)
[   40.836191] [<c0102258>] (__do_softirq) from [<c01259c0>]
(irq_exit+0xb0/0xd4)
[   40.843432] [<c01259c0>] (irq_exit) from [<c016d9e4>]
(__handle_domain_irq+0x60/0xb4)
[   40.851283] [<c016d9e4>] (__handle_domain_irq) from [<c0398cd0>]
(gic_handle_irq+0x3c/0x78)
[   40.859654] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>]
(__irq_svc+0x6c/0xa8)
[   40.867151] Exception stack(0xe8081b68 to 0xe8081bb0)
[   40.872215] 1b60:                   20000193 2ad3e000 00000000
20000113 00000001 00000000
[   40.880414] 1b80: 00000053 00000000 e8080000 c01149e4 c0b4eb88
c0b4e688 0000000a e8081bb8
[   40.888609] 1ba0: c016ace4 c016acec 20000113 ffffffff
[   40.893680] [<c0101a8c>] (__irq_svc) from [<c016acec>]
(console_unlock+0x290/0x410)
[   40.901358] [<c016acec>] (console_unlock) from [<c016c4f8>]
(vprintk_emit+0x170/0x228)
[   40.909300] [<c016c4f8>] (vprintk_emit) from [<c0429c48>]
(dev_vprintk_emit+0x1d4/0x1f4)
[   40.917410] [<c0429c48>] (dev_vprintk_emit) from [<c0429c94>]
(dev_printk_emit+0x2c/0x50)
[   40.925608] [<c0429c94>] (dev_printk_emit) from [<c0429d34>]
(__dev_printk+0x7c/0x90)
[   40.933457] [<c0429d34>] (__dev_printk) from [<c042a058>]
(_dev_info+0x44/0x68)
[   40.940791] [<c042a058>] (_dev_info) from [<c03c4154>]
(devm_of_pci_get_host_bridge_resources+0x198/0x298)
[   40.950471] [<c03c4154>] (devm_of_pci_get_host_bridge_resources) from
[<c03d0a2c>] (dw_pcie_host_init+0xb4/0x544)
[   40.960757] [<c03d0a2c>] (dw_pcie_host_init) from [<c03d261c>]
(imx6_pcie_probe+0x3a0/0x6b8)
[   40.969220] [<c03d261c>] (imx6_pcie_probe) from [<c042dd20>]
(platform_drv_probe+0x48/0x98)
[   40.977593] [<c042dd20>] (platform_drv_probe) from [<c042bfac>]
(really_probe+0xf0/0x2c8)
[   40.985792] [<c042bfac>] (really_probe) from [<c042c2e4>]
(driver_probe_device+0x60/0x16c)
[   40.994079] [<c042c2e4>] (driver_probe_device) from [<c042c440>]
(__driver_attach_async_helper+0x50/0x54)
[   41.003671] [<c042c440>] (__driver_attach_async_helper) from
[<c014188c>] (async_run_entry_fn+0x44/0x118)
[   41.013266] [<c014188c>] (async_run_entry_fn) from [<c013865c>]
(process_one_work+0x17c/0x390)
[   41.021902] [<c013865c>] (process_one_work) from [<c01393a0>]
(worker_thread+0x44/0x518)
[   41.030015] [<c01393a0>] (worker_thread) from [<c013e78c>]
(kthread+0x144/0x14c)
[   41.037430] [<c013e78c>] (kthread) from [<c01010e8>]
(ret_from_fork+0x14/0x2c)
[   41.044667] Exception stack(0xe8081fb0 to 0xe8081ff8)
[   41.049730] 1fa0:                                     00000000
00000000 00000000 00000000
[   41.057926] 1fc0: 00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   41.066123] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[   41.072758] Rebooting in 30 seconds..


-- 
Robert Hancock
Senior Software Developer
SED Systems, a division of Calian Ltd.
Email: hancock@xxxxxxxxxxxxx