Re: PROBLEM: BUG appearing when trying to allocate interrupt on Exynos MCT after CPU hotplug

[Marcin Jabrzyk]

On 23/10/14 20:41, Stephen Boyd wrote:
> On 10/23/2014 07:06 AM, Russell King - ARM Linux wrote:
> > On Thu, Oct 23, 2014 at 03:51:16PM +0200, Marcin Jabrzyk wrote:
> > > [1.] One line summary of the problem: "BUG: sleeping function called from
> > > invalid context at mm/slub.c:1250" after CPU hotplug
> > I'm really not surprised.
> >
> > > When SoC have MCT_INT_SPI interrupt it is being allocated after hotplugging
> > > of the CPU, secondary_start_kernel() is sending CPU boot notifications which
> > > are send when preemption and interrupts are disabled. Exynos_mct
> > > notification handler tries to set up and allocate IRQ for SPI type interrupt
> > > for started CPU and then BUG appears.
> > > There might be similar problem on qcom-timer I think just after looking on
> > > the code.
>
> There's no problem for qcom-timer because there are only PPIs on SMP
> platforms.

Ok, so it's only a problem on Exynos platform for now.
> > The CPU notifier is called via notify_cpu_starting(), which is called
> > with interrupts disabled, and a reason code of CPU_STARTING.  Interrupts
> > at this point /must/ remain disabled.
> >
> > The Exynos code then goes on to call exynos4_local_timer_setup() which
> > tries to reverse the free_irq() in exynos4_local_timer_stop() by calling
> > request_irq().  Calling request_irq() with interrupts off has never been
> > permissible.
> >
> > So, this code is wrong today, and it was also wrong when it was written.
> > It /couldn't/ have been tested.  It looks like this commit added this
> > buggy code:
> >
> > commit ee98d27df6827b5ba4bd99cb7d5cb1239b6a1a31
> > Author: Stephen Boyd <sboyd@xxxxxxxxxxxxxx>
> > Date:   Fri Feb 15 16:40:51 2013 -0800
> >
> >      ARM: EXYNOS4: Divorce mct from local timer API
> >
> >      Separate the mct local timers from the local timer API. This will
> >      allow us to remove ARM local timer support in the near future and
> >      gets us closer to moving this driver to drivers/clocksource.
> >
> >      Acked-by: Kukjin Kim <kgene.kim@xxxxxxxxxxx>
> >      Acked-by: Marc Zyngier <marc.zyngier@xxxxxxx>
> >      Cc: Thomas Abraham <thomas.abraham@xxxxxxxxxx>
> >      Signed-off-by: Stephen Boyd <sboyd@xxxxxxxxxxxxxx>
>
> I'm not so sure. It looks like in that patch I didn't change anything
> with respect to when things are called. In fact, it looks like we were
> calling setup_irq() there, but another patch around the same time
> changed that to request_irq()
>
> commit 7114cd749a12ff9fd64a2f6f04919760f45ab183
> Author: Chander Kashyap <chander.kashyap@xxxxxxxxxx>
> Date:   Wed Jun 19 00:29:35 2013 +0900
>
>      clocksource: exynos_mct: use (request/free)_irq calls for local timer registration
>
>      Replace the (setup/remove)_irq calls for local timer registration with
>      (request/free)_irq calls. This generalizes the local timer registration API.
>      Suggested by Mark Rutland.
>
>      Signed-off-by: Chander Kashyap <chander.kashyap@xxxxxxxxxx>
>      Acked-by: Mark Rutland <mark.rutland@xxxxxxx>
>      Reviewed-by: Tomasz Figa <t.figa@xxxxxxxxxxx>
>      Signed-off-by: Kukjin Kim <kgene.kim@xxxxxxxxxxx>
>
> I don't believe setup_irq() allocates anything so we should probably go
> back to using that over request_irq() or explore requesting the irqs
> once and then enabling/disabling instead.

So what would be a better way to handle this? Going back to setup_irq or 
trying to enable/disable irqs on CPU hotplug? As this touched low level 
things and it's rare case for setting/enabling irqs just after CPU is 
coming back to life again.

> > A good question would be: why doesn't this happen at boot time when CPU1
> > is first brought up?  The conditions here are no different from hotplugging
> > CPU1 back in.  Do you see a similar warning on boot too?

No the boot looks clean and there is not any sign of that problem.
> Probably because such checks are completely avoided until the system
> state is switched to SYSTEM_RUNNING (see the first if statement in
> __might_sleep()). It would be nice if we could remove that.

That's most probably the reason of no warnings on boot process.

Best regards,
--
Marcin Jabrzyk
Samsung R&D Institute Poland
Samsung Electronics
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/