Re: [PATCH 00/11] IO-less dirty throttling v12

From: Wu Fengguang
Date: Sun Oct 16 2011 - 23:03:23 EST

Next
Previous
Next
Messages

Hi Trond,

I enhanced the write/commit stats.

3.1.0-rc4-vanilla+ ------------------------ (MB/s) 275.28
5649.00 261987.00
(MB) 866.52 2.94
(ms) 47814.05 1405.05 49237.94
4320.98 22943.13 27307.42
(*) The x3 nfs_nr_writes with a salt same time.

(**) The TOTAL because the comparing values). Ditto cases should the values
Below are the detailed which shows how
Thanks,
Fengguang
---

3.1.0-rc4-vanilla+ ------------------------ 20.89 39.43 26.60 12.70 27.41 26.52 40.70 45.28 35.74 275.28
3.1.0-rc4-vanilla+ ------------------------ 825.00 250.00 272.00 1477.00 997.00 1521.00 235.00 29.00 43.00 5649.00
3.1.0-rc4-vanilla+ ------------------------ 32294.00 28858.00 32593.00 18937.00 18762.00 21473.00 47281.00 33108.00 28681.00 261987.00
3.1.0-rc4-vanilla+ ------------------------ 7.69 47.41 29.39 2.73 8.24 5.21 56.99 453.65 255.21 866.52
3.1.0-rc4-vanilla+ ------------------------ 0.41 0.25 0.21 0.44 0.37 0.28 0.40 0.38 2.94
3.1.0-rc4-vanilla+ ------------------------ 3249.09 221.23 5942.01 285.75 6.21 34.73 29155.55 2704.81 6214.66 47814.05
3.1.0-rc4-vanilla+ ------------------------ 268.37 80.00 110.81 295.72 36.64 100.70 253.68 55.16 203.96 1405.05
3.1.0-rc4-vanilla+ ------------------------ 3517.58 302.26 6053.53 581.52 42.99 135.56 29411.03 2768.01 6425.46 49237.94
3.1.0-rc4-vanilla+ ------------------------ 99.56 108.12 89.87 9.00 2.41 2.68 1398.01 1558.97 1052.37 4320.98
3.1.0-rc4-vanilla+ ------------------------ 896.68 919.00 1088.05 266.54 191.28 187.90 4671.46 6586.97 8135.26 22943.13
3.1.0-rc4-vanilla+ ------------------------ 996.58 1027.14 1178.59 275.75 193.71 190.67 6071.22 8146.03 9227.72 27307.42

Attachment: Description: application/ruby message: Linus Torvalds: "Re: kernel 3.0: BUG: soft lockup: find_get_pages+0x51/0x110" message: Hugh Dickins: "Re: kernel 3.0: BUG: soft lockup: find_get_pages+0x51/0x110" in thread: Wu Fengguang: "Re: [PATCH 00/11] IO-less dirty throttling v12" sorted by: [ date ] [ thread ] [ subject ] [ author ] script to compare the write_bw as well as the NFS
3.1.0-rc8-nfs-wq+
------------------------
+28.5% 353.72 TOTAL write_bw
+192.3% 16510.00 TOTAL nfs_nr_commits (*)
+205.1% 799451.00 TOTAL nfs_nr_writes (*)
-18.1% 709.85 TOTAL nfs_commit_size (**)
-44.8% 1.62 TOTAL nfs_write_size
-84.0% 7631.57 TOTAL nfs_write_queue_time
-53.6% 652.59 TOTAL nfs_write_rtt_time
-83.2% 8292.74 TOTAL nfs_write_execute_time
-83.2% 726.27 TOTAL nfs_commit_queue_time
-8.6% 20963.46 TOTAL nfs_commit_rtt_time
-20.5% 21714.12 TOTAL nfs_commit_execute_time
and nfs_nr_commits numbers should be taken
because the total written bytes are increased at the
nfs_commit_size mainly reflects the thresh=1G cases
numbers in the 10M/100M cases are very small
to the 1G cases (as shown in the below case by case
for the *_time values. However the thresh=1G
be most close to the typical NFS client setup, so
are still mostly representative numbers.
case by case views. The script is attached,
exactly the numbers are calculated from mountstats.
3.1.0-rc8-nfs-wq+
------------------------
+95.2% 40.77 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
+9.2% 43.07 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
+70.6% 45.39 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
+56.1% 19.83 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
+19.7% 32.81 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
+16.8% 30.97 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
+16.5% 47.42 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-2.4% 44.20 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
+37.8% 49.26 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
+28.5% 353.72 TOTAL write_bw
3.1.0-rc8-nfs-wq+
------------------------
+196.8% 2449.00 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
+6.8% 267.00 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
+114.7% 584.00 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
+350.8% 6658.00 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
+115.8% 2152.00 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
+154.3% 3868.00 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
+83.4% 431.00 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
+20.7% 35.00 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
+53.5% 66.00 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
+192.3% 16510.00 TOTAL nfs_nr_commits
3.1.0-rc8-nfs-wq+
------------------------
-14.6% 27571.00 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
+616.0% 206620.00 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
+202.7% 98662.00 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
+111.7% 40085.00 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
+660.5% 142691.00 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
+298.8% 85640.00 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
+5.0% 49625.00 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
+77.1% 58632.00 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
+213.5% 89925.00 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
+205.1% 799451.00 TOTAL nfs_nr_writes
3.1.0-rc8-nfs-wq+
------------------------
-35.6% 4.95 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
-1.3% 46.81 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-22.1% 22.90 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-68.3% 0.87 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-46.7% 4.39 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-55.1% 2.34 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-42.5% 32.79 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-18.1% 371.54 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-12.5% 223.26 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-18.1% 709.85 TOTAL nfs_commit_size
3.1.0-rc8-nfs-wq+
------------------------
0.20 +123.8% 0.44 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
-85.3% 0.06 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-44.7% 0.14 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-32.4% 0.14 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-84.9% 0.07 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-71.4% 0.11 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
+0.5% 0.28 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-44.2% 0.22 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-57.2% 0.16 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-44.8% 1.62 TOTAL nfs_write_size
3.1.0-rc8-nfs-wq+
------------------------
-93.2% 222.32 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
+98.2% 438.48 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-68.7% 1857.66 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-99.9% 0.38 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-95.4% 0.28 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-92.4% 2.63 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-99.3% 215.70 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-6.3% 2535.52 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-62.0% 2358.60 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-84.0% 7631.57 TOTAL nfs_write_queue_time
3.1.0-rc8-nfs-wq+
------------------------
-69.6% 81.55 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
-38.0% 49.59 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-50.8% 54.54 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-41.7% 172.52 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-31.6% 25.05 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-33.5% 66.93 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-67.2% 83.33 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
+46.4% 80.77 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-81.2% 38.30 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-53.6% 652.59 TOTAL nfs_write_rtt_time
3.1.0-rc8-nfs-wq+
------------------------
-91.4% 304.13 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
+61.7% 488.90 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-68.4% 1912.75 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-70.3% 173.00 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-40.7% 25.47 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-48.5% 69.75 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-99.0% 299.78 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-5.4% 2618.62 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-62.6% 2400.33 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-83.2% 8292.74 TOTAL nfs_write_execute_time
3.1.0-rc8-nfs-wq+
------------------------
-97.5% 2.49 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
-83.8% 17.50 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-97.5% 2.26 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-90.5% 0.85 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-58.2% 1.01 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-59.9% 1.07 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-64.0% 503.61 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-97.9% 33.03 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-84.4% 164.45 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-83.2% 726.27 TOTAL nfs_commit_queue_time
3.1.0-rc8-nfs-wq+
------------------------
-6.3% 840.25 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
+0.9% 926.98 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-24.0% 827.14 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-22.7% 206.09 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-41.3% 112.32 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-34.0% 123.98 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-11.8% 4119.49 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-3.1% 6382.66 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-8.7% 7424.56 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-8.6% 20963.46 TOTAL nfs_commit_rtt_time
3.1.0-rc8-nfs-wq+
------------------------
-15.4% 843.02 NFS-thresh=100M/nfs-10dd-1M-32p-32768M-100M:10-X
-8.0% 944.51 NFS-thresh=100M/nfs-1dd-1M-32p-32768M-100M:10-X
-29.6% 829.52 NFS-thresh=100M/nfs-2dd-1M-32p-32768M-100M:10-X
-24.9% 207.03 NFS-thresh=10M/nfs-10dd-1M-32p-32768M-10M:10-X
-41.5% 113.35 NFS-thresh=10M/nfs-1dd-1M-32p-32768M-10M:10-X
-34.4% 125.12 NFS-thresh=10M/nfs-2dd-1M-32p-32768M-10M:10-X
-23.8% 4624.14 NFS-thresh=1G/nfs-10dd-1M-32p-32768M-1024M:10-X
-21.2% 6415.71 NFS-thresh=1G/nfs-1dd-1M-32p-32768M-1024M:10-X
-17.5% 7611.71 NFS-thresh=1G/nfs-2dd-1M-32p-32768M-1024M:10-X
-20.5% 21714.12 TOTAL nfs_commit_execute_time
>compare.rb

Next message: Linus Torvalds: "Re: kernel 3.0: BUG: soft lockup: find_get_pages+0x51/0x110"
Previous message: Hugh Dickins: "Re: kernel 3.0: BUG: soft lockup: find_get_pages+0x51/0x110"
Next in thread: Wu Fengguang: "Re: [PATCH 00/11] IO-less dirty throttling v12"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]