NFS instability, related to heavy load,downed servers,and SMP (?)

Braddock Gaskill (braddock@braddock.com)
Fri, 5 Nov 1999 11:13:24 -0500 (EST)


This message is in MIME format. The first part should be readable text,
while the remaining parts are likely unreadable without MIME-aware tools.
Send mail to mime@docserver.cac.washington.edu for more info.

--0-1524633238-941818404=:17063
Content-Type: TEXT/PLAIN; charset=US-ASCII

We are a lab with a computing cluster of 24 Linux RedHat 5.2 hosts with 2
SMP CPU's each which run kernel 2.2.12 patched with NFSv3 version 0.14.6.
The cluster is used for VERY large, intensive jobs reading and writing
data to/from NFS drives served by Suns.

When one of the Sun servers go down for a couple hours, we get many
messages logged (as expected) in the form of:
Nov 4 13:10:06 a03 kernel: nfs: server dc04 not responding, timed out
and when the server comes back up, a:
Nov 4 13:10:06 a03 kernel: nfs: server dc04 OK
Load usually rises to an absurd level (as high as 30!) until the server
returns.

However, the NFS system (and the kernel in general) seems to become
unstable during and after this period, and we get frequent log messages in
the form:
Nov 4 22:09:48 a03 kernel: nfs: task 51371 can't get a request slot
even hours after the NFS server is back online. Some of our hosts die
(they return pings, but won't allow even console logins or any network
services. a hard reset is necessary) either during the server down time,
and even hours after the down time.

Looking through the linux-kernel archives, I found several of you who have
reported the same problem, all seeming to run SMP with 2.2 series
kernels, some with and some without the NFSv3 patches.
No solutons were posted, however. I've attached a consolidated copy of
the problem reports in the hopes that it would be useful.

Please let me know of any solutions or fixes, and post it to linux-kernel
so other can find it.

Thanks,
Braddock Gaskill

braddock@braddock.com - Voice: 410.340.7672 - FAX: 410.234.1664
3100 St. Paul St. Suite 506, Baltimore, MD 21218

--0-1524633238-941818404=:17063
Content-Type: TEXT/PLAIN; charset=US-ASCII; name=tmp3
Content-ID: <Pine.BSF.4.05.9911051113240.17063@server.yournode.net>
Content-Description: Collected NFS Bug reports
Content-Disposition: attachment; filename=tmp3
Content-Transfer-Encoding: BASE64

TkZTIDIuMmJldGE0MCAoZndkKQ0KDQpKYW1lcyBPJ0thbmUgKGpvMnlAanBy
Yy5jb20pDQpNb24sIDE1IEZlYiAxOTk5IDE1OjMxOjQyIC0wNTAwIChFU1Qp
DQoNCiAgICAgW3N0YXJ0fGVuZF1fYmhfYXRvbWljPyINCiAgICAgQURNSU5J
U1RSQVRJT04hIg0KDQpJIHNlbnQgdGhpcyB0byBPbGFmIGxhc3Qgd2Vlaywg
YnV0IGFmdGVyIHJlYWRpbmcgc29tZSBvdGhlciBwb3N0cyBJIGdldA0KdGhl
IGZlZWxpbmcgdGhhdCBoZSBpcyB0b28gYnVzeSBmb3IgTkZTLg0KDQotLS0t
LS0tLS0tIEZvcndhcmRlZCBtZXNzYWdlIC0tLS0tLS0tLS0NCkhpLA0KSSdt
IGd1ZXNzaW5nIHlvdSBnZXQgYXNrZWQgdGhpcyBhbG90LCBidXQgSSBjYW4n
dCBmaW5kIGFueSBvZmZpY2FsDQpub3RpY2UgcmVnYXJkaW5nIGl0LiBUaGUg
Mi4yIGtlcm5lbCBjaGFuZ2Vsb2cgc2F5cyB5b3Ugc2hvdWxkIHVzZQ0KMi4y
YmV0YTQwIG9mIE5GUywgYnV0IHRoYXQgaXMgbG9jYXRlZCBpbiBhIGRpciBj
YWxsZWQgZG9udHVzZS4gSXQncyBteQ0KdW5kZXJzdGFuZGluZyB0aGF0IHlv
dSBtYWludGFpbiBpdD8gU29tZW9uZSBhc2tlZCBvbiB0aGUgbGludXgta2Vy
bmVsIGxpc3QNCmFuZCB0aGUgcXVlc3Rpb24gd2VudCB1bmFuc3dlcmVkLiBJ
ZiB5b3Ugd2FudCBJJ2xsIGFzayB0aGVyZSBhZ2FpbiBhbmQgc2VlDQppZiBJ
IGdldCBhIHJlc3BvbnNlIGZyb20gc29tZW9uZSBlbHNlLg0KDQpCYXNpY2Fs
bHkgd2UgYXJlIGhhdmluZyBhIHByb2JsZW0gd2l0aCBORlMgb24gc2V2ZXJh
bCBvZiBvdXIgbWFjaGluZXMgdGhhdA0KYXJlIHJ1bm5pbmcgMi4yLjEtYWM1
IGtlcm5lbHMgYW5kIGEgbWl4IG9mIFNNUCBhbmQgVVAuDQoNClRoZSBzaW1w
bGUgd2FybmluZyBpczoNCkZlYiAxMiAxODoyMjo0MSB0aGVsaWEga2VybmVs
OiBuZnMgd2FybmluZzogbW91bnQgdmVyc2lvbiBvbGRlciB0aGFuDQprZXJu
ZWwNCg0KVGhlIHByb2JsZW0gaXMgd2hlbiBuZnMgdGFrZXMgdGhlIGNwdSBs
b2FkIHVwIHRvIDEyLjAgb3IgaGlnaGVyLg0KDQpUaGUgbWVzc2FnZSB0aGF0
IGlzIGRpc3BsYXllZCBpczoNCkZlYiAxMiAxNzo1Njo1MCBodXJyaWNhbmUg
a2VybmVsOiBuZnM6IHRhc2sgNTE2ODYgY2FuJ3QgZ2V0IGEgcmVxdWVzdCBz
bG90DQpGZWIgMTIgMTc6NTY6NTEgaHVycmljYW5lIGtlcm5lbDogbmZzOiB0
YXNrIDUxNjg4IGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0KRmViIDEyIDE3
OjU2OjUyIGh1cnJpY2FuZSBrZXJuZWw6IG5mczogdGFzayA1MTY4NSBjYW4n
dCBnZXQgYSByZXF1ZXN0IHNsb3QNCkZlYiAxMiAxNzo1Njo1MyBodXJyaWNh
bmUga2VybmVsOiBuZnM6IHRhc2sgNTE2ODcgY2FuJ3QgZ2V0IGEgcmVxdWVz
dCBzbG90DQpGZWIgMTIgMTc6NTY6NTQgaHVycmljYW5lIGtlcm5lbDogbmZz
OiB0YXNrIDUxNjkxIGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0KRmViIDEy
IDE3OjU2OjU4IGh1cnJpY2FuZSBrZXJuZWw6IG5mczogdGFzayA1MTY5MCBj
YW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QNCkZlYiAxMiAxNzo1NzowMiBodXJy
aWNhbmUga2VybmVsOiBuZnM6IHRhc2sgNTE2ODYgY2FuJ3QgZ2V0IGEgcmVx
dWVzdCBzbG90DQpGZWIgMTIgMTc6NTc6MDMgaHVycmljYW5lIGtlcm5lbDog
bmZzOiB0YXNrIDUxNjg4IGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0KRmVi
IDEyIDE3OjU3OjA0IGh1cnJpY2FuZSBrZXJuZWw6IG5mczogdGFzayA1MTY4
NSBjYW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QNCkZlYiAxMiAxNzo1NzowNSBo
dXJyaWNhbmUga2VybmVsOiBuZnM6IHRhc2sgNTE2ODcgY2FuJ3QgZ2V0IGEg
cmVxdWVzdCBzbG90DQoNClRoZXNlIHJlcGVhdCBjb25zdGFudGx5IGFuZCBO
RlMgaXMgYmFzaWNhbGx5IHVudXNhYmxlLg0KDQpDb3VsZCB5b3UgZ2l2ZSBt
ZSBzb21lIHN1Z2dlc3Rpb25zIG9uIHRoaW5ncyB0byB0cnkgYW5kIHBvc3Np
Ymx5IGFuc3dlcg0KdGhlIHF1ZXN0aW9uIGV2ZXJ5b25lIHdhbnRzIHRvIGtu
b3cgd2hpY2ggaXMgYWJvdXQgdGhlIGRvbnR1c2U/DQoNCnRoYW5rcw0KLWph
bWVzDQoNCi0NClRvIHVuc3Vic2NyaWJlIGZyb20gdGhpcyBsaXN0OiBzZW5k
IHRoZSBsaW5lICJ1bnN1YnNjcmliZSBsaW51eC1rZXJuZWwiIGluDQp0aGUg
Ym9keSBvZiBhIG1lc3NhZ2UgdG8gbWFqb3Jkb21vQHZnZXIucnV0Z2Vycy5l
ZHUNClBsZWFzZSByZWFkIHRoZSBGQVEgYXQgaHR0cDovL3d3dy50dXgub3Jn
L2xrbWwvDQoNCiAgICAgW3N0YXJ0fGVuZF1fYmhfYXRvbWljPyINCiAgICAg
QURNSU5JU1RSQVRJT04hIg0KPT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQ0KTkZT
IHBlcmZvcm1hbmNlIGRyb3BzIGFmdGVyIGRheXMgb2YgdXB0aW1lDQoNCkJ1
cmtoYXJkIEJ1bmsgKGJ1bmtAcGh5c2lrLmh1LWJlcmxpbi5kZSkNClRodSwg
MTAgSnVuIDE5OTkgMTc6NDQ6NDQgKzAyMDAgKE1FU1QpDQoNCg0KDQoNCkhp
LA0KDQpJIGhhdmUgYSBwcm9ibGVtIHdpdGggdGhlIGxvbmcgdGVybSBwZXJm
b3JtYW5jZSBvZiBORlMuDQpBZnRlciBzb21lIGRheXMgKG9yIHdlZWtzKSBv
ZiB1cHRpbWUsIHRoZSBmb2xsb3dpbmcgbWVzc2FnZXMgc2V0IGluIG9uDQp0
aGUgTkZTIENMSUVOVCAoImZpY3VzNSIpOg0KDQpKdW4gIDQgMTM6MDk6MjUg
ZmljdXM1IGtlcm5lbDogbmZzOiBzZXJ2ZXIgbGluZGUgbm90IHJlc3BvbmRp
bmcsIHN0aWxsIHRyeWluZw0KSnVuICA0IDEzOjA5OjM1IGZpY3VzNSBrZXJu
ZWw6IG5mczogc2VydmVyIGxpbmRlIE9LDQpKdW4gIDQgMTM6MTk6MzYgZmlj
dXM1IGtlcm5lbDogbmZzOiBzZXJ2ZXIgbGluZGUgbm90IHJlc3BvbmRpbmcs
IHN0aWxsIHRyeWluZw0KSnVuICA0IDEzOjE5OjM2IGZpY3VzNSBrZXJuZWw6
IG5mczogc2VydmVyIGxpbmRlIE9LDQpKdW4gIDQgMTM6Mjg6NTggZmljdXM1
IGtlcm5lbDogbmZzOiBzZXJ2ZXIgZmljdXM3IG5vdCByZXNwb25kaW5nLCBz
dGlsbCB0cnlpbmcNCkp1biAgNCAxMzoyOToyNCBmaWN1czUga2VybmVsOiBu
ZnM6IHRhc2sgMzU3MTUgY2FuJ3QgZ2V0IGEgcmVxdWVzdCBzbG90DQpKdW4g
IDQgMTM6Mjk6MzMgZmljdXM1IGtlcm5lbDogbmZzOiBzZXJ2ZXIgZmljdXM3
IE9LDQpKdW4gIDQgMTM6Mjk6MzggZmljdXM1IGtlcm5lbDogbmZzOiBzZXJ2
ZXIgZmljdXM3IE9LDQpKdW4gIDQgMTM6Mjk6NDkgZmljdXM1IGtlcm5lbDog
bmZzOiBzZXJ2ZXIgZmljdXM3IG5vdCByZXNwb25kaW5nLCBzdGlsbCB0cnlp
bmcNCkp1biAgNCAxMzoyOTo0OSBmaWN1czUga2VybmVsOiBuZnM6IHNlcnZl
ciBmaWN1czcgT0sNCkp1biAgNCAxMzoyOTo1MCBmaWN1czUga2VybmVsOiBu
ZnM6IHRhc2sgMzU3MjggY2FuJ3QgZ2V0IGEgcmVxdWVzdCBzbG90DQpKdW4g
IDQgMTM6Mjk6NTYgZmljdXM1IGtlcm5lbDogbmZzOiBzZXJ2ZXIgZmljdXM3
IE9LDQpKdW4gIDQgMTM6MzA6MDYgZmljdXM1IGtlcm5lbDogbmZzOiBzZXJ2
ZXIgZmljdXM3IG5vdCByZXNwb25kaW5nLCBzdGlsbCB0cnlpbmcNCkp1biAg
NCAxMzozMDowOCBmaWN1czUga2VybmVsOiBuZnM6IHRhc2sgMzU3NTAgY2Fu
J3QgZ2V0IGEgcmVxdWVzdCBzbG90DQpKdW4gIDQgMTM6MzA6MDggZmljdXM1
IGtlcm5lbDogbmZzOiB0YXNrIDM1NzQ5IGNhbid0IGdldCBhIHJlcXVlc3Qg
c2xvdA0KSnVuICA0IDEzOjMwOjA5IGZpY3VzNSBrZXJuZWw6IG5mczogdGFz
ayAzNTc1NCBjYW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QNCkp1biAgNCAxMzoz
MDozNiBmaWN1czUga2VybmVsOiBuZnM6IHNlcnZlciBmaWN1czcgT0sNCkp1
biAgNCAxMzozMDo0NyBmaWN1czUga2VybmVsOiBuZnM6IHNlcnZlciBmaWN1
czcgbm90IHJlc3BvbmRpbmcsIHN0aWxsIHRyeWluZw0KSnVuICA0IDEzOjMw
OjQ3IGZpY3VzNSBrZXJuZWw6IG5mczogc2VydmVyIGZpY3VzNyBPSw0KSnVu
ICA0IDEzOjMwOjUyIGZpY3VzNSBsYXN0IG1lc3NhZ2UgcmVwZWF0ZWQgMyB0
aW1lcw0KLi4uDQoNCkF0IHRoZSBzYW1lIHRpbWUsIGFsbCBvcGVyYXRpb25z
IHdpdGggbmZzIGZpbGUgc3lzdGVtcyBzbG93IGRvd24gYW5kIG1ha2UNCnRo
ZSBjbGllbnQgdW51c2FibGUuIFVubW91bnRpbmcgb3IgcmVzdGFydGluZyBu
ZnMgZG9lc24ndCBoZWxwLg0KTm90ZSB0aGF0IHNlcnZlciAiZmljdXM3IiBp
cyBhbm90aGVyIGxpbnV4IHN5c3RlbSwgYnV0ICJsaW5kZSIgaXMgYSBIUA0K
KHJ1bm5pbmcgSFAtVVggMTAuMjApLiBBdCB0aGUgc2FtZSB0aW1lLCBvdGhl
ciBjbGllbnRzIGNhbiBhY2Nlc3MgdGhlc2UNCnNlcnZlcnMgYXMgYWx3YXlz
LiBUaGUgc2ljayBjbGllbnQgY2FuIG9ubHkgYmUgY3VyZWQgYnkgYSBSRUJP
T1QgKEFGQUlLKS4NClRoZSBzeW1wdG9tcyBtYXkgcmVhcHBlYXIgYWZ0ZXIg
ZGF5cyBvciB3ZWVrcyBvZiBub3JtYWwgdXB0aW1lLg0KDQpIYXJkd2FyZTog
ICBEdWFsIFBQcm8yMDAgb24gUzE2NjJEIDQ0MEZYIFBDSS1JU0EgYm9hcmQN
CiAgICAgICAgICAgIEFkYXB0ZWMgQUhBLTI5NDBBIFVsdHJhIFNDU0kgaG9z
dCBhZGFwdGVyDQogICAgICAgICAgICBTTUMtVWx0cmEgZXRoZXJuZXQgY2Fy
ZA0KDQpUaGUgcHJvYmxlbSB3YXMgYWxyZWFkeSBwcmVzZW50IHdoZW4gcnVu
bmluZw0KICAgICAgUmVkSGF0IDQuMiAvIGtlcm5lbCAyLjAuM3gtU01QDQph
bmQgdW5mb3J0dW5hdGVseSBwZXJzaXN0cyB1bmRlcg0KICAgICAgRGViaWFu
IDIuMSAvIGtlcm5lbCAyLjIuezQsOX0tU01QDQoNClNpbmNlIGFsbCBvdXIg
bGludXggYm94ZXMgYXJlIHJ1bm5pbmcgU01QIGtlcm5lbHMsIEkgZG9uJ3Qg
a25vdyB3aGV0aGVyDQp0aGUgcHJvYmxlbSBpcyByZWxhdGVkIHRvIFNNUC4N
Cg0KSG93IHRvIGdldCBmdXJ0aGVyIGRpYWdub3N0aWNzPw0KTmVlZCBmYW5j
eSBtb3VudCBvcHRpb25zPw0KQW55IGlkZWFzPw0KDQpCdXJraGFyZA0KLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0KIGJ1bmtAcGh5c2lrLmh1LWJlcmxp
bi5kZSAgICAgIFBoeXNpY3MgSW5zdGl0dXRlLCBIdW1ib2xkdCBVbml2ZXJz
aXR5DQogZmF4OiAgICArKzQ5LTMwIDIwOTMgNzYyOCAgICAgSW52YWxpZGVu
c3RyLiAxMTANCiBwaG9uZTogICsrNDktMzAgMjA5MyA3NjQ2ICAgICAxMDEx
NSBCZXJsaW4sIEdlcm1hbnkNCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0N
Cg0KLQ0KVG8gdW5zdWJzY3JpYmUgZnJvbSB0aGlzIGxpc3Q6IHNlbmQgdGhl
IGxpbmUgInVuc3Vic2NyaWJlIGxpbnV4LW5ldCIgaW4NCnRoZSBib2R5IG9m
IGEgbWVzc2FnZSB0byBtYWpvcmRvbW9Admdlci5ydXRnZXJzLmVkdQ0KDQoN
Cg0KPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PQ0KMi4yLjEgU01QOiBORlMgY2Fu
J3QgZ2V0IGEgcmVxdWVzdCBzbG90DQoNClN0ZXZlIEhzaWVoIChzdGV2ZWhA
ZWVjcy51bWljaC5lZHUpDQpUdWUsIDIzIEZlYiAxOTk5IDAxOjEwOjE4IC0w
NTAwIChFU1QpDQoNCiAgICAgcGF0Y2g7IHRlc3RlcnMgd2FudGVkIg0KICAg
ICByZXF1ZXN0IHNsb3QiDQoNCkNhbiBzb21lb25lIGV4cGxhaW4gd2hhdCB0
aGlzIG1lc3NhZ2UgbWVhbnM/DQoNCkZlYiA0IDA4OjUxOjE1IHNrIGtlcm5l
bDogbmZzOiB0YXNrIDMxNjU4IGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0K
RmViIDQgMDg6NTE6NDEgc2sga2VybmVsOiBuZnM6IHRhc2sgMzE2NTkgY2Fu
J3QgZ2V0IGEgcmVxdWVzdCBzbG90DQpGZWIgNCAwODo1MTo0OSBzayBrZXJu
ZWw6IG5mczogdGFzayAzMTY2MCBjYW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QN
Cg0KQWZ0ZXIgc2VlaW5nIHRoZXNlIG1lc3NhZ2VzLCBuZnMgb24gdGhpcyBT
TVAgMi4yLjEgbWFjaGluZSBubyBsb25nZXINCndvcmtzLiBUaGUgcHJvYmxl
bSBvbmx5IHNlZW1zIHRvIGNyb3AgdXAgaWYgdGhlIG1hY2hpbmUgYWNjZXNz
ZXMgaXRzIG93bg0KbmZzIHNlcnZlciAoaWU6IGV4cG9ydCBhIGRpcmVjdG9y
eSBhbmQgdGhlbiBhY2Nlc3MgdGhlIGRpcmVjdG9yeSB2aWEgYW1kJ3MNCmF1
dG9tb3VudGVyIG9uIHRoZSBzYW1lIG1hY2hpbmUpLg0KDQpUaGFua3MNCg0K
LQ0KVG8gdW5zdWJzY3JpYmUgZnJvbSB0aGlzIGxpc3Q6IHNlbmQgdGhlIGxp
bmUgInVuc3Vic2NyaWJlIGxpbnV4LWtlcm5lbCIgaW4NCnRoZSBib2R5IG9m
IGEgbWVzc2FnZSB0byBtYWpvcmRvbW9Admdlci5ydXRnZXJzLmVkdQ0KUGxl
YXNlIHJlYWQgdGhlIEZBUSBhdCBodHRwOi8vd3d3LnR1eC5vcmcvbGttbC8N
Cg0KICAgICBwYXRjaDsgdGVzdGVycyB3YW50ZWQiDQogICAgIHJlcXVlc3Qg
c2xvdCINCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0NClJlOiAyLjIuMSBTTVA6
IE5GUyBjYW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QNCg0KTWVlbGlzIFJvb3Mg
KG1yb29zQHRhcnR1LmN5YmVyLmVlKQ0KVGh1LCAyNSBNYXIgMTk5OSAyMTo0
NzoxNSArMDIwMA0KDQogICAgIFByb2JsZW1zKSINCg0KDQpbZGlnZ2luZyBv
dXQgYW4gb2xkIG1lc3NhZ2UgZnJvbSBsLWsgYXJjaGl2ZV0NCg0KPj4gQWZ0
ZXIgc2VlaW5nIHRoZXNlIG1lc3NhZ2VzLCBuZnMgb24gdGhpcyBTTVAgMi4y
LjEgbWFjaGluZSBubyBsb25nZXINCj4+IHdvcmtzLiBUaGUgcHJvYmxlbSBv
bmx5IHNlZW1zIHRvIGNyb3AgdXAgaWYgdGhlIG1hY2hpbmUgYWNjZXNzZXMg
aXRzIG93bg0KPj4gbmZzIHNlcnZlciAoaWU6IGV4cG9ydCBhIGRpcmVjdG9y
eSBhbmQgdGhlbiBhY2Nlc3MgdGhlIGRpcmVjdG9yeSB2aWENCmFtZCdzDQo+
PiBhdXRvbW91bnRlciBvbiB0aGUgc2FtZSBtYWNoaW5lKS4NCg0KVE0+IFRo
ZSBxdWVzdGlvbiB0aGVuIGFyaXNlcyBhcyB0byB3aHkgdGhlIFJQQyBsYXll
ciBnZXRzIGNvbmdlc3RlZCB3aGVuDQpUTT4gYWNjZXNzaW5nIHlvdXIgb3du
IG5mcyBzZXJ2ZXIuIEkgaGF2ZSBubyBwcm9ibGVtcyB3aXRoIHRoaXMgb24g
bXkgb3duDQpUTT4gbWFjaGluZSwgc28gSSB3b3VsZCBmaXJzdCBhbmQgZm9y
ZW1vc3Qgc3VzcGVjdCBhbWQuIENhbiB5b3UgcmVwZWF0IHRoZQ0KVE0+IHBy
b2JsZW0gdXNpbmcganVzdCB0aGUgc3RvY2sgTkZTIGNsaWVudCArIHNlcnZl
cj8NCg0KSSdtIGhhdmluZyB0aGUgc2FtZSBwcm9ibGVtIHdpdGggcHJpc3Rp
bmUgMi4yLjQuIEFsc28gd2l0aCBhbWQgKGxhdGVzdA0KYW0tdXRpbHMgcGFj
a2FnZSBmcm9tIHJlZGhhdCwgb3RoZXIgcGxhY2VzIG1heSBoYXZlIG5ld2Vy
IG9uZXMpLg0KDQpJIHRyaWVkIHRvIGFkZCBhbm91dGhlciBhbWQgbW91bnQg
cG9pbnQgYnV0IGdvdCB0aGUgY29uZmlndXJhdGlvbiBmaWxlDQp3cm9uZyBh
dCB0aGUgZmlyc3QgdHJ5LiBTbyBhbWQgaGFkIDEgd29ya2luZyBhbmQgMSBu
b253b3JraW5nIG1vdW50DQpwb2ludCAobW91bnQgcG9pbnQgdHlwZSBwYXJh
bWV0ZXIgd2FzIHdyb25nIGluIG15IGNvbmYuIGZpbGUpLiBBbmQgd2hlbg0K
SSB0ZWxsIGFtZCB0byBzdG9wICh2aWEgL2V0Yy9yYy5kL2luaXQuZC9hbWQg
c3RvcCksIHRoZSBwcm9jZXNzIGp1c3QNCmhhbmdzLiBJdCdzIHNpdHRpbmcg
dGhlcmUgcmlnaHQgbm93OiAyIHByb2Nlc3NlcyBpbiBycGNfZXhlY3V0ZSwg
b25lIGFtZA0KYW5kIG9uZSBzaGVsbCBzY3JpcHQgdG8gdW5sb2FkIGFtZC4g
QW5kIHN5c2xvZyBzYXlzDQpuZnM6IHRhc2sgMTM4MjAgY2FuJ3QgZ2V0IGEg
cmVxdWVzdCBzbG90DQoNClNvIHByb2JhYmx5IGFtZCBtZXNzZWQgc29tZXRo
aW5nIHVwIGFuZCB0aGUgbmZzIGNsaWVudCBjYW4ndCB0YWxrIHRvDQphbWQu
IFRoZSBtZXNzYWdlIHNlZW1zIHRvIGJlIGEgb25seSBjb25zZXF1ZW5jZSBv
ZiB0aGUgYW1kIHByb2JsZW0gYW5kDQp0aGUgcmVhbCBwcm9ibGVtIGlzIHBy
b2JhYmx5IHRoZSBoYW5naW5nIGFtZC4NCg0KLS0NCk1lZWxpcyBSb29zICht
cm9vc0B0YXJ0dS5jeWJlci5lZSkNCg0KLQ0KVG8gdW5zdWJzY3JpYmUgZnJv
bSB0aGlzIGxpc3Q6IHNlbmQgdGhlIGxpbmUgInVuc3Vic2NyaWJlIGxpbnV4
LWtlcm5lbCIgaW4NCnRoZSBib2R5IG9mIGEgbWVzc2FnZSB0byBtYWpvcmRv
bW9Admdlci5ydXRnZXJzLmVkdQ0KUGxlYXNlIHJlYWQgdGhlIEZBUSBhdCBo
dHRwOi8vd3d3LnR1eC5vcmcvbGttbC8NCg0KDQoNCiAgICAgUHJvYmxlbXMp
Ig0KPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PQ0KUmU6IDIuMi4xIFNNUDogTkZT
IGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0KDQpTdGV2ZSBIc2llaCAoc3Rl
dmVoQGVlY3MudW1pY2guZWR1KQ0KV2VkLCAyNCBGZWIgMTk5OSAwMzoyMzoz
NyAtMDUwMCAoRVNUKQ0KDQogICAgIHNwZWNpYWwgZmlsZXM/Ig0KDQo+ID4g
RmViIDQgMDg6NTE6NDkgc2sga2VybmVsOiBuZnM6IHRhc2sgMzE2NjAgY2Fu
J3QgZ2V0IGEgcmVxdWVzdCBzbG90DQo+ID4NCj4gPiBBZnRlciBzZWVpbmcg
dGhlc2UgbWVzc2FnZXMsIG5mcyBvbiB0aGlzIFNNUCAyLjIuMSBtYWNoaW5l
IG5vIGxvbmdlcg0KPiA+IHdvcmtzLiBUaGUgcHJvYmxlbSBvbmx5IHNlZW1z
IHRvIGNyb3AgdXAgaWYgdGhlIG1hY2hpbmUgYWNjZXNzZXMgaXRzIG93bg0K
PiA+IG5mcyBzZXJ2ZXIgKGllOiBleHBvcnQgYSBkaXJlY3RvcnkgYW5kIHRo
ZW4gYWNjZXNzIHRoZSBkaXJlY3RvcnkgdmlhDQphbWQncw0KPiA+IGF1dG9t
b3VudGVyIG9uIHRoZSBzYW1lIG1hY2hpbmUpLg0KPiA+DQo+DQo+IFRoZSBt
ZXNzYWdlcyB0aGVtc2VsdmVzIGp1c3QgbWVhbiB0aGF0IHRoZSBSUEMgbGF5
ZXIgaXMgY29uZ2VzdGVkLCBhbmQNCj4gdGhhdCBhIGJhY2tsb2cgb2YgbWVz
c2FnZXMgd2FpdGluZyB0byBiZSBzZW50IGlzIGJ1aWxkaW5nIHVwLiBXaGVu
ZXZlcg0KPiBvbmUgb2YgdGhlc2UgbWVzc2FnZXMgdGltZXMgb3V0LCBpdCBp
c3N1ZXMgdGhlICd0YXNrIHh4eCBjYW4ndCBnZXQgYQ0KPiByZXF1ZXN0IHNs
b3QnIGVycm9yLg0KPg0KPiBUaGUgcXVlc3Rpb24gdGhlbiBhcmlzZXMgYXMg
dG8gd2h5IHRoZSBSUEMgbGF5ZXIgZ2V0cyBjb25nZXN0ZWQgd2hlbg0KPiBh
Y2Nlc3NpbmcgeW91ciBvd24gbmZzIHNlcnZlci4gSSBoYXZlIG5vIHByb2Js
ZW1zIHdpdGggdGhpcyBvbiBteSBvd24NCj4gbWFjaGluZSwgc28gSSB3b3Vs
ZCBmaXJzdCBhbmQgZm9yZW1vc3Qgc3VzcGVjdCBhbWQuIENhbiB5b3UgcmVw
ZWF0IHRoZQ0KPiBwcm9ibGVtIHVzaW5nIGp1c3QgdGhlIHN0b2NrIE5GUyBj
bGllbnQgKyBzZXJ2ZXI/DQoNClRoZSBwcm9ibGVtIG9ubHkgb2NjdXJzIG9u
IG91ciBxdWFkIFNNUCB3aGVuIGFsbCBwcm9jZXNzb3JzIGFyZSBydW5uaW5n
DQpkaXNrLWludGVuc2l2ZSBzaW11bGF0aW9ucy4gSSB3aWxsIHRyeSB0byBi
eXBhc3MgYW1kIGFuZCBzZWUgd2hhdA0KaGFwcGVucy4uLiBUaGUgcHJvYmxl
bSBpcyBzcG9yYWRpYyBhbmQgdGhlcmVmb3JlIGhhcmQgdG8gcmVwZWF0Lg0K
DQotDQpUbyB1bnN1YnNjcmliZSBmcm9tIHRoaXMgbGlzdDogc2VuZCB0aGUg
bGluZSAidW5zdWJzY3JpYmUgbGludXgta2VybmVsIiBpbg0KdGhlIGJvZHkg
b2YgYSBtZXNzYWdlIHRvIG1ham9yZG9tb0B2Z2VyLnJ1dGdlcnMuZWR1DQpQ
bGVhc2UgcmVhZCB0aGUgRkFRIGF0IGh0dHA6Ly93d3cudHV4Lm9yZy9sa21s
Lw0KDQogICAgIHNwZWNpYWwgZmlsZXM/Ig0KPT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PQ0KSG9ycmlibGUgTkZTIHBlcmZvcm1hY2UNCg0KUGhpbCBCbGVja2Vy
ICh0bXdnQGlueHNlcnZpY2VzLmNvbSkNClRodSwgMjkgQXByIDE5OTkgMTU6
MTM6MzUgLTA3MDANCg0KICAgICBkZXZpY2VzIg0KDQpJIGhvcGUgdGhhdCBz
b21lb25lIGNhbiBzaGVkIHNvbWUgbGlnaHQgaGVyZSwgb3IgZ2l2ZSBtZSBh
IHdheSB0bw0KaW52ZXN0aWdhdGUuIDMgY29tcHV0ZXJzLCAyIGFyZSAyLjIu
NiwgMSBpcyAyLjAuMzYuIEFsbCBldGhlcm5ldC4gMi4yLjYgaGFzDQpQQ0kg
dm9ydGV4LCAyLjAuMzYgaGFzIEludGVsIGV0aGVyIGV4cHJlc3MgMTYuIExv
dHMgb2YgdGhlIGZvbGxvd2luZyBpbg0KbG9nczoNCg0KQXByIDI5IDE0OjQ1
OjU5IG13ZyBrZXJuZWw6IG5mczogc2VydmVyIGlueCBub3QgcmVzcG9uZGlu
Zywgc3RpbGwgdHJ5aW5nDQpBcHIgMjkgMTQ6NDU6NTkgbXdnIGtlcm5lbDog
bmZzOiBzZXJ2ZXIgaW54IE9LDQpBcHIgMjkgMTQ6NDY6MTkgbXdnIGtlcm5l
bDogbmZzOiBzZXJ2ZXIgaW54IG5vdCByZXNwb25kaW5nLCBzdGlsbCB0cnlp
bmcNCkFwciAyOSAxNDo0NjoyMCBtd2cga2VybmVsOiBuZnM6IHRhc2sgNzY4
IGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0KQXByIDI5IDE0OjQ2OjIwIG13
ZyBrZXJuZWw6IG5mczogdGFzayA3NjkgY2FuJ3QgZ2V0IGEgcmVxdWVzdCBz
bG90DQpBcHIgMjkgMTQ6NDY6MzEgbXdnIGtlcm5lbDogbmZzOiBzZXJ2ZXIg
aW54IE9LDQpBcHIgMjkgMTQ6NDY6NTUgbXdnIGxhc3QgbWVzc2FnZSByZXBl
YXRlZCAyIHRpbWVzDQpBcHIgMjkgMTQ6NDY6NTUgbXdnIGtlcm5lbDogbmZz
OiB0YXNrIDc4MyBjYW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QNCkFwciAyOSAx
NDo0Njo1NSBtd2cga2VybmVsOiBuZnM6IHRhc2sgNzg0IGNhbid0IGdldCBh
IHJlcXVlc3Qgc2xvdA0KQXByIDI5IDE1OjA0OjMwIHN1cHBvcnQga2VybmVs
OiBuZnM6IHRhc2sgOTE0NCBjYW4ndCBnZXQgYSByZXF1ZXN0IHNsb3QNCkFw
ciAyOSAxNTowNDozOSBzdXBwb3J0IGtlcm5lbDogbmZzOiBzZXJ2ZXIgaW54
IG5vdCByZXNwb25kaW5nLCBzdGlsbCB0cnlpbmcNCg0KQXByIDI5IDE1OjA0
OjQxIHN1cHBvcnQga2VybmVsOiBuZnM6IHRhc2sgOTE0NSBjYW4ndCBnZXQg
YSByZXF1ZXN0IHNsb3QNCkFwciAyOSAxNTowNDo0MSBzdXBwb3J0IGtlcm5l
bDogbmZzOiB0YXNrIDkxNDYgY2FuJ3QgZ2V0IGEgcmVxdWVzdCBzbG90DQpB
cHIgMjkgMTU6MDQ6NDEgc3VwcG9ydCBrZXJuZWw6IG5mczogdGFzayA5MTQ3
IGNhbid0IGdldCBhIHJlcXVlc3Qgc2xvdA0KQXByIDI5IDE1OjA0OjU4IHN1
cHBvcnQga2VybmVsOiBuZnM6IHNlcnZlciBpbnggT0sNCkFwciAyOSAxNTow
NToxNiBzdXBwb3J0IGtlcm5lbDogbmZzOiBzZXJ2ZXIgaW54IG5vdCByZXNw
b25kaW5nLCBzdGlsbCB0cnlpbmcNCg0KQXByIDI5IDE1OjA1OjE2IHN1cHBv
cnQga2VybmVsOiBuZnM6IHNlcnZlciBpbnggT0sNCkFwciAyOSAxNTowNToz
OCBzdXBwb3J0IGtlcm5lbDogbmZzOiBzZXJ2ZXIgaW54IG5vdCByZXNwb25k
aW5nLCBzdGlsbCB0cnlpbmcNCg0KQXByIDI5IDE1OjA1OjM4IHN1cHBvcnQg
a2VybmVsOiBuZnM6IHNlcnZlciBpbnggT0sNCg0KaW54IGlzIHRoZSAyLjAu
MzYga2VybmVsLiBUaGlzIGNhbWUgZnJvbSBjb3B5aW5nIGEgZmlsZSBmcm9t
IGVpdGhlciBtd2cgb3INCnN1cHBvcnQgdG8gaW54LiBJIGdldCBhIGxvdCBv
ZiBzZXJ2ZXIgbm90IHJlc3BvbmRpbmcgZnJvbSBtd2cgYW5kIHN1cHBvcnQs
DQp0b28uIEV2ZXJ5dGhpbmcgaXMgdXNlciBORlMgZGFlbW9ucywgYmVjYXVz
ZSBJIGNhbid0IGdldCB0aGUga2VybmVsIGRhZW1vbnMNCnRvIGV4cG9ydCBh
bGwgdGhlIG1vdW50IHBvaW50czoga2V4cG9ydGZzIGdldHMgYW4gaW52YWxp
ZCBhcmd1bWVudCBvbiBtb3VudA0KZGlyZWN0b3JpZXMgZnJvbSB0aGUga2Vy
bmVsLiBUaGUgYmFja3VwIGxhc3QgbmlnaHQgKHRhcGUgZHJpdmUgaXMgb24g
aW54KQ0KZGlkIG5vdCBmaW5pc2ggYmVjYXVzZSBvZiB0aGVzZSBwcm9ibGVt
cy4NCg0KLQ0KVG8gdW5zdWJzY3JpYmUgZnJvbSB0aGlzIGxpc3Q6IHNlbmQg
dGhlIGxpbmUgInVuc3Vic2NyaWJlIGxpbnV4LWtlcm5lbCIgaW4NCnRoZSBi
b2R5IG9mIGEgbWVzc2FnZSB0byBtYWpvcmRvbW9Admdlci5ydXRnZXJzLmVk
dQ0KUGxlYXNlIHJlYWQgdGhlIEZBUSBhdCBodHRwOi8vd3d3LnR1eC5vcmcv
bGttbC8NCg0KICAgICBkZXZpY2VzIg0KPT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PQ0KUmU6IFByb2JsZW0gd2l0aCAyLjIuMTBhYzMgYW5kIE5GU3YzKDAuOS45
KQ0KDQpUcm9uZCBNeWtsZWJ1c3QgKHRyb25kLm15a2xlYnVzdEBmeXMudWlv
Lm5vKQ0KMzAgSnVuIDE5OTkgMTM6MTY6MjAgKzAyMDANCg0KICAgICBhdm9p
ZCB0aGUgbmVlZCBmb3Igc3RyZWFtcyINCiAgICogSW4gcmVwbHkgdG86ID0/
aXNvLTg4NTktMT9xP0RvbWluaWs9MjBXZWlzPz06ICJQcm9ibGVtIHdpdGgg
Mi4yLjEwYWMzDQogICAgIGFuZCBORlN2MygwLjkuOSkiDQogICAgIDIuMi4x
MGFjMyBhbmQgTkZTdjMoMC45LjkpIg0KDQpEb21pbmlrIFdlaXMgPHdlaXNf
ZG9taW5pa0B5YWhvby5kZT4gd3JpdGVzOg0KDQo+IFdlIHVzZSBvbmUgTGlu
dXggc3lzdGVtIGFzIGEgZ2F0ZXdheSBiZXR3ZWVuIE5UKFNNQikNCj4gYW5k
IFN1biBTb2xhcmlzKE5GUykgc3lzdGVtcy4gVG9kYXkgSSBleHBlcmllbmNl
ZCBhDQo+IHByb2JsZW0gd2l0aCB0aGUgTkZTIGNsaWVudC4gVGhlIGxvYWQg
b24gdGhlIHN5c3RlbXMNCj4ga2VlcHQgcmlzaW5nIGFuZCBJIGdvdCB0aGlz
IGVycm9yIG1lc3NhZ2U6DQo+DQo+IEp1biAzMCAxMTozMzozOSBuZnNzbWIx
IGtlcm5lbDogbmZzOiB0YXNrIDMxMzA4IGNhbid0DQo+IGdldCBhIHJlcXVl
c3Qgc2xvdA0KPiBKdW4gMzAgMTE6MzQ6MTUgbmZzc21iMSBsYXN0IG1lc3Nh
Z2UgcmVwZWF0ZWQgMyB0aW1lcw0KPiBKdW4gMzAgMTE6MzQ6NTEgbmZzc21i
MSBsYXN0IG1lc3NhZ2UgcmVwZWF0ZWQgMyB0aW1lcw0KPiBKdW4gMzAgMTE6
MzQ6NTMgbmZzc21iMSBrZXJuZWw6IG5mczogdGFzayAzMTQxOCBjYW4ndA0K
PiBnZXQgYSByZXF1ZXN0IHNsb3QNCj4gSnVuIDMwIDExOjM1OjAzIG5mc3Nt
YjEga2VybmVsOiBuZnM6IHRhc2sgMzEzMDggY2FuJ3QNCj4gZ2V0IGEgcmVx
dWVzdCBzbG90DQo+IEp1biAzMCAxMTozNTowNSBuZnNzbWIxIGtlcm5lbDog
bmZzOiB0YXNrIDMxNDE4IGNhbid0DQo+IGdldCBhIHJlcXVlc3Qgc2xvdA0K
PiBKdW4gMzAgMTE6MzU6MTUgbmZzc21iMSBrZXJuZWw6IG5mczogdGFzayAz
MTMwOCBjYW4ndA0KPiBnZXQgYSByZXF1ZXN0IHNsb3QNCj4gSnVuIDMwIDEx
OjM1OjE3IG5mc3NtYjEga2VybmVsOiBuZnM6IHRhc2sgMzE0MTggY2FuJ3QN
Cj4gZ2V0IGEgcmVxdWVzdCBzbG90DQo+IEp1biAzMCAxMTozNToyNyBuZnNz
bWIxIGtlcm5lbDogbmZzOiB0YXNrIDMxMzA4IGNhbid0DQo+IGdldCBhIHJl
cXVlc3Qgc2xvdA0KPg0KPiBUaGUgbWVzc2FnZXMga2VwdCBnb2luZyBvbiB0
aWxsIEkgcmVib290ZWQuDQo+DQo+IElzIHRoaXMgYSBrbm93biBwcm9ibGVt
IG9ubHkgZm9yIE5GU3YzIG9yIHdpbGwgSQ0KPiBleHBlcmllbmNlIHRoZSBz
YW1lIHByb2JsZW0gd2l0aCAyLjIuMTAoTkZTdjIpPw0KDQpJdCdzIGEgcHJv
YmxlbSB0aGF0IGNhbiBvY2N1ciBib3RoIHVuZGVyIE5GU3YzIGFuZCBzdG9j
ayAyLjIuMTAgKHNpbmNlDQppdCBqdXN0IG1lYW5zIHRoYXQgdGhlIFJQQyBs
YXllciBpcyBibG9ja2VkIGZvciBzb21lIHJlYXNvbikuDQoNCkkgaGF2ZSBy
ZWNlbnRseSBiZWVuIHRyeWluZyB0byBoYWNrIHVwIHRoZSBSUEMgbGF5ZXIg
dW5kZXIgdGhlIE5GU3YzDQpwYXRjaGVzLiBUaGUgbWFpbiBpbnRlcmVzdCBp
cyBnZXR0aW5nIHRoZSBSUEMgb3ZlciBUQ1AgdG8gd29yaw0KcmVsaWFibHks
IGFuZCB0byByZWR1Y2UgdGhlIHByb2JsZW1zIHdpdGggdGhlIHNvY2tldCBs
YXllcnMgcnVubmluZw0Kb3V0IG9mIGJ1ZmZlciBtZW1vcnkgKHRoZSBsYXR0
ZXIgaXMgYSBwcm9ibGVtIHdoZW4geW91IGhhdmUgMzJrDQp3c2l6ZXMpLiBU
aGlzIG1lYW5zIHRoYXQgdGhlIGxhc3QgZmV3IGJhdGNoZXMgb2YgTkZTdjMg
cGF0Y2hlcyBoYXZlDQpiZWVuIGEgYml0IHVuc3RhYmxlIChzb3JyeSkgYnV0
IHNob3VsZCBob3BlZnVsbHkgaW1wcm92ZS4NCg0KSXQgd291bGQgdGhlcmVm
b3JlIGJlIHZlcnkgaGVscGZ1bCB0byBtZSBpZiB5b3UgY291bGQgZ2l2ZSBt
ZSBzb21lDQptb3JlIGRldGFpbHMgYWJvdXQgd2hpY2ggdmVyc2lvbiBvZiB0
aGUgcGF0Y2hlcyB5b3UncmUgdXNpbmcuIE5vdGUNCnRoYXQgdmVyc2lvbiAw
LjkuOS4yIGRpZCBoYXZlIGEgYnVnIHdoaWNoIGNvdWxkIGdpdmUgc3ltcHRv
bXMgbGlrZSB0aGUNCm9uZXMgeW91J3JlIHNlZWluZy4gSSBwdXQgb3V0IDAu
OS4xMCBsYXN0IGV2ZW5pbmcgaW4gb3JkZXIgdG8gZml4IGl0Lg0KDQpDaGVl
cnMsDQpUcm9uZA0KDQotDQpUbyB1bnN1YnNjcmliZSBmcm9tIHRoaXMgbGlz
dDogc2VuZCB0aGUgbGluZSAidW5zdWJzY3JpYmUgbGludXgta2VybmVsIiBp
bg0KdGhlIGJvZHkgb2YgYSBtZXNzYWdlIHRvIG1ham9yZG9tb0B2Z2VyLnJ1
dGdlcnMuZWR1DQpQbGVhc2UgcmVhZCB0aGUgRkFRIGF0IGh0dHA6Ly93d3cu
dHV4Lm9yZy9sa21sLw0KDQogICAgIGF2b2lkIHRoZSBuZWVkIGZvciBzdHJl
YW1zIg0KICAgKiBJbiByZXBseSB0bzogPT9pc28tODg1OS0xP3E/RG9taW5p
az0yMFdlaXM/PTogIlByb2JsZW0gd2l0aCAyLjIuMTBhYzMNCiAgICAgYW5k
IE5GU3YzKDAuOS45KSINCiAgICAgMi4yLjEwYWMzIGFuZCBORlN2MygwLjku
OSkiDQo=
--0-1524633238-941818404=:17063--

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.rutgers.edu
Please read the FAQ at http://www.tux.org/lkml/