Re: [RFC PATCH 0/3] Avoid the use of congestion_wait under zone pressure

From: Christian Ehrhardt
Date: Fri Mar 12 2010 - 01:39:47 EST




Andrew Morton wrote:
On Mon, 8 Mar 2010 11:48:20 +0000
Mel Gorman <mel@xxxxxxxxx> wrote:

Under memory pressure, the page allocator and kswapd can go to sleep using
congestion_wait(). In two of these cases, it may not be the appropriate
action as congestion may not be the problem.

clear_bdi_congested() is called each time a write completes and the
queue is below the congestion threshold.

So if the page allocator or kswapd call congestion_wait() against a
non-congested queue, they'll wake up on the very next write completion.

Well the issue came up in all kind of loads where you don't have any writes at all that can wake up congestion_wait.
Thats true for several benchmarks, but also real workload as well e.g. A backup job reading almost all files sequentially and pumping out stuff via network.

Hence the above-quoted claim seems to me to be a significant mis-analysis and
perhaps explains why the patchset didn't seem to help anything?

While I might have misunderstood you and it is a mis-analysis in your opinion, it fixes a -80% Throughput regression on sequential read workloads, thats not nothing - its more like absolutely required :-)

You might check out the discussion with the subject "Performance regression in scsi sequential throughput (iozone) due to "e084b - page-allocator: preserve PFN ordering when __GFP_COLD is set"".
While the original subject is misleading from todays point of view, it contains a lengthy discussion about exactly when/why/where time is lost due to congestion wait with a lot of traces, counters, data attachments and such stuff.

--

Grüsse / regards, Christian Ehrhardt
IBM Linux Technology Center, System z Linux Performance
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/