Re: request baset device mapper in Linux
From: Jun'ichi Nomura
Date: Wed Oct 05 2011 - 04:29:48 EST
On 09/30/11 05:57, Lukas Hejtmanek wrote:
> On Mon, Sep 19, 2011 at 02:50:08PM +0900, Jun'ichi Nomura wrote:
>> no-multipath: 2.8 GB/s
>> multipath: 600 MB/s
>> multipath w/ patch: 2.8-2.9 GB/s
>> no-multipath: ??
>> multipath: 2.5 GB/s
>> multipath w/ patch: 2.5 GB/s(?)
>> Have you tried 3.0.3 without multipath?
> yes, 3GB/s and only kwapd0 and kswapd1 is running, no kworker or ksoftirqd..
Hmm.. did you find any difference in your profile this time?
I'm trying to reproduce it myself but no success so far
(perhaps disks are not fast enough to saturate CPU on my test machine).
As ksoftirqd in top implies your CPU4 gets too much I/O completions,
'rq_affnity = 2' for both dm and SCSI devices might be a solution.
It'll distribute block completion softirqs to submitters and possibly
reduce the loads of the 1st CPU in the socket.
(See the commit below. It's a new feature of 3.1. Not available in 3.0...)
Author: Dan Williams <dan.j.williams@xxxxxxxxx>
Date: Sat Jul 23 20:44:25 2011 +0200
block: strict rq_affinity
Some systems benefit from completions always being steered to the strict
requester cpu rather than the looser "per-socket" steering that
blk_cpu_to_group() attempts by default. This is because the first
CPU in the group mask ends up being completely overloaded with work,
while the others (including the original submitter) has power left
Allow the strict mode to be set by writing '2' to the sysfs control
file. This is identical to the scheme used for the nomerges file,
where '2' is a more aggressive setting than just being turned on.
echo 2 > /sys/block/<bdev>/queue/rq_affinity
Jun'ichi Nomura, NEC Corporation
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/