Re: frequent lockups in 3.18rc4

[Jürgen Groß]

On 11/24/2014 07:48 PM, Konrad Rzeszutek Wilk wrote:
> On Fri, Nov 21, 2014 at 03:23:13PM -0500, Josh Boyer wrote:
> > On Fri, Nov 21, 2014 at 3:16 PM, Andy Lutomirski <luto@xxxxxxxxxxxxxx> wrote:
> > > On Fri, Nov 21, 2014 at 12:14 PM, Josh Boyer <jwboyer@xxxxxxxxxxxxxxxxx> wrote:
> > > > On Fri, Nov 21, 2014 at 2:52 PM, Andy Lutomirski <luto@xxxxxxxxxxxxxx> wrote:
> > > > > On Fri, Nov 21, 2014 at 11:46 AM, Linus Torvalds
> > > > > <torvalds@xxxxxxxxxxxxxxxxxxxx> wrote:
> > > > > > On Fri, Nov 21, 2014 at 11:34 AM, Linus Torvalds
> > > > > > <torvalds@xxxxxxxxxxxxxxxxxxxx> wrote:
> > > > > > > So I kind of agree, but it wouldn't be my primary worry. My primary
> > > > > > > worry is actually paravirt doing something insane.
> > > > > >
> > > > > > Btw, on that tangent, does anybody actually care about paravirt any more?

Funny, during testing some patches related to Xen I hit the lockup
issue. It looked a little bit different, but a variation of your patch
solved my problem. The difference to the original report might be due
to the rather low system load during my test, so the system was still
responsive when the first lockup messages appeared. I could see the
hanging cpus were spinning in pmd_lock() called during
__handle_mm_fault().

I could reproduce the issue within a few minutes reliably without the
patch below. With it the machine survived 12 hours and is still running.

WHY my test would trigger the problem so fast I have no idea. I saw it
on a rather huge machine only (128GB memory, 120 cpus), that's quite
understandable. My test remapped some pages via the hypervisor and
removed those mappings again. Perhaps the TLB flushing involved in these
operations is triggering the problem.


diff --git a/arch/x86/mm/fault.c b/arch/x86/mm/fault.c
index d973e61..b847ff7 100644
--- a/arch/x86/mm/fault.c
+++ b/arch/x86/mm/fault.c
@@ -377,7 +377,7 @@ static noinline int vmalloc_fault(unsigned long address)
         * happen within a race in page table update. In the later
         * case just flush:
         */
-       pgd = pgd_offset(current->active_mm, address);
+       pgd = (pgd_t *)__va(read_cr3()) + pgd_index(address);
        pgd_ref = pgd_offset_k(address);
        if (pgd_none(*pgd_ref))
                return -1;



Juergen
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/