Re: [PANIC][2.5.66bk3+] run_timer_softirq - IRQ Mishandlings

From: Manfred Spraul (manfred@colorfullife.com)
Date: Sat Mar 29 2003 - 17:10:27 EST


Robert wrote:

>> Code: 89 50 04 89 02 c7 41 30 00 00 00 00 81 3d 60 98 41 c0 3c 4b
>> kernel/timer.c:258: spin_lock(kernel/timer.c:c0419860) already locked by
>> kernel/timer.c/398
>> Kernel panic: Aiee, killing interrupt handler!
>> In interrupt handler - not syncing
>
>This is not a panic, just an oops. And it was just a debugging check
>from spin lock debugging, but unfortunately you were in an interrupt
>handler so the machine went bye bye.
>
>It is probably a simple double-lock deadlock, detected by spin lock
>debugging. Knowing the EIP would help... but timer_interrupt() is a
>good first guess.
>
>
No, this is wrong. spinlock debugging never forces an oops, it just
complains with printk and tries to continue.

What happened is that someone registered a timer, and then kfreed the
timer while it was still active. Then the call from run_timers() caused
a crash, which corrupted the spinlock state, which provoked a spinlock
debugging message.

Shawn: If you want to debug this, then you should try to print the "last
user" field of the slab object that contains the timer. Add a test into
run_timers that checks if timer->function is < 0xC0000000.

Something like

    kmem_cache_t *c = GET_PAGE_CACHE(virt_to_page(timer));
    struct slab *slabp = GET_PAGE_SLAB(virt_to_page(timer));
    void * obj = slabp->s_mem+c->objsize*((timer-slabp->s_mem)/c->objsize);
    unsigned long last_user = *(unsigned
long*)(obj+c->objsize-BYTE_PER_WORD);

finds address of the last caller of kfree() or kmem_cache_free() on the
slab object. It only works if slab debugging is enabled. Just print
last_user, and look it up in System.map. Or use print_symbol (see
mm/slab.c for an example).

If you need help I can write a patch.

--
    Manfred

- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Mon Mar 31 2003 - 22:00:34 EST