Re: Regression in mobility grouping?

From: Vlastimil Babka
Date: Thu Sep 29 2016 - 03:18:14 EST

On 09/29/2016 04:25 AM, Johannes Weiner wrote:
On Wed, Sep 28, 2016 at 11:39:25AM -0400, Johannes Weiner wrote:
On Wed, Sep 28, 2016 at 11:00:15AM +0200, Vlastimil Babka wrote:
I guess testing revert of 9c0415e could give us some idea. Commit
3a1086f shouldn't result in pageblock marking differences and as I said
above, 99592d5 should be just restoring to what 3.10 did.

I can give this a shot, but note that this commit makes only unmovable
stealing more aggressive. We see reclaimable blocks up as well.

Quick update, I reverted back to stealing eagerly only on behalf of
MIGRATE_RECLAIMABLE allocations in a 4.6 kernel:

static bool can_steal_fallback(unsigned int order, int start_mt)
if (order >= pageblock_order / 2 ||
return true;

return false;

Yet, I still see UNMOVABLE growing to the thousands within minutes,
whereas 3.10 didn't reach those numbers even after days of uptime.

Okay, that wasn't it. However, there is something fishy going on,
because I see extfrag traces like these:

<idle>-0 [006] d.s. 1110.217281: mm_page_alloc_extfrag: page=ffffea0064142000 pfn=26235008 alloc_order=3 fallback_order=3 pageblock_order=9 alloc_migratetype=0 fallback_migratetype=2 fragmenting=1 change_ownership=1

enum {
MIGRATE_PCPTYPES, /* the number of types on the pcp lists */

This is an UNMOVABLE order-3 allocation falling back to RECLAIMABLE.
According to can_steal_fallback(), this allocation shouldn't steal the
pageblock, yet change_ownership=1 indicates the block is UNMOVABLE.

Who converted it? I wonder if there is a bug in ownership management,
and there was an UNMOVABLE block on the RECLAIMABLE freelist from the
beginning. AFAICS we never validate list/mt consistency anywhere.

Hm yes there are e.g. no strong guarantees for pageblock migratetype and relevant pages being on freelist of the same type, except for ISOLATE, for performance reasons. IIRC pageblock type is checked when putting a page on pcplist and then it may diverge before it's flushed on freelist. So it's possible the fallback page was on RECLAIMABLE list
while the pageblock was marked as UNMOVABLE.

Also the tracepoint is racy so that steal_suitable_fallback() doesn't have to communicate back whether it was truly stealing whole pageblock.

I'll continue looking tomorrow.