memory leak in 2.1.2[79], bridging or LLC

bofh@snoopy.virtual.net.au
Fri, 28 Mar 97 13:02:03 +1000


I have determined that this problem is apparently related to bridging or LLC. When I enable bridging and LLC the problem occurs. When I disable them it doesn't. If anyone would like more information on this then I'll perform more tests on demand.

< # CONFIG_BRIDGE is not set
< # CONFIG_LLC is not set

---
> CONFIG_BRIDGE=y
> CONFIG_LLC=y

------------------------------------------------------------------------- The following message is forwarded to you by bofh@snoopy.virtual.net.au (list as the From user of this message). The original sender (see the header, below) was bofh@snoopy.virtual.net.au and has been set as the "Reply-To" field of this message. ------------------------------------------------------------------------- From: bofh@snoopy.virtual.net.au Date: Fri, 14 Mar 97 23:59:27 +1000 To: linux-kernel@vger.rutgers.edu Subject: memory leak in 2.1.2[79]?

I have just had one of my servers grind to a halt 3 times (once on 2.1.27 and the other 2 times on 2.1.29). What happens is that the kernel appears to have some sort of internal memory leak which results in the amount of RAM that's usable by application code/data getting smaller. This makes the system eventually thrash to death. I have currently got the machine setup with 2.1.29 and the software watchdog enab

Below there is a log that I made from a cron script run every 5 minutes. The system was rebooted by the watchdog at 16:41:22.

If you have any ideas where the problem could be, or know of any further tests I could run then please let me know.

If you would like to see some more of this logging info then let me know, I've got over 8 hours worth...

Russell Coker

Fri Mar 14 16:35:13 EST 1997 ++STAT++ cpu 55199 0 65537 2788709 disk 310633 0 0 0 disk_rio 182600 0 0 0 disk_wio 128033 0 0 0 disk_rblk 612286 0 0 0 disk_wblk 353560 0 0 0 page 466502 198035 swap 41221 21686 intr 3882158 2909445 8 0 0 1 0 2 0 0 0 0 649227 0 0 323475 0 ctxt 1734945 btime 858288620 processes 7667 ++PS++ PID TT MAJFL MINFL TRS DRS SIZE SWAP SHRD LIB DT COMMAND 1 ? 821 110 0 0 19 19 0 540 0 init 2 ? 0 1 0 0 0 0 0 0 0 kflushd 3 ? 12588 1 0 0 0 0 0 0 0 kswapd 4 ? 0 1 0 0 0 0 0 0 0 nfsiod 5 ? 0 1 0 0 0 0 0 0 0 nfsiod 6 ? 0 1 0 0 0 0 0 0 0 nfsiod 7 ? 0 1 0 0 0 0 0 0 0 nfsiod 359 1 68 17 0 0 15 15 0 540 0 getty 7600 p1 118 39 0 0 27 27 0 540 0 pppd 360 2 68 17 0 0 15 15 0 540 0 getty 205 ? 924 76 0 0 20 20 0 540 0 klogd 217 ? 17 12 0 0 18 18 0 540 0 rpc.portmap 219 ? 890 929 0 0 16 16 0 540 0 inetd 274 ? 42 26 0 0 30 30 0 540 0 dhcpd 295 ? 169 104 0 0 46 46 0 856 0 RunCache 302 ? 146 33 0 0 18 18 0 540 0 dnsserver 303 ? 68 19 0 0 15 15 0 540 0 dnsserver 304 ? 68 19 0 0 15 15 0 540 0 dnsserver 305 ? 68 19 0 0 15 15 0 540 0 dnsserver 306 ? 85 24 0 0 20 20 0 540 0 ftpget 3774 p2 279 144 0 0 42 42 0 856 0 snoopy 7019 ? 396 85 0 0 28 28 0 736 0 in.telnetd 7020 p7 698 244 0 0 69 69 0 856 0 bash 7029 p7 1945 228 0 0 137 137 0 736 0 pine 7591 p1 313 125 0 2 44 42 2 856 0 ppp04 7594 p1 191 79 0 4 46 42 4 856 0 ppp.sh 17 ? 316 3 2 8 20 10 7 540 3 update (bdflus 7589 ? 324 73 6 6 36 24 8 736 4 in.telnetd 3773 ? 490 71 6 6 36 24 8 736 4 in.telnetd 322 ? 1703 2517 0 13 27 14 13 540 7 cron 325 ? 1671 232 5 10 32 17 12 540 2 /usr/sbin/idle 3780 p2 907 109 8 7 37 22 10 540 3 /usr/local/dia 291 ? 2004 2822 8 9 70 53 17 596 0 sendmail 317 ? 237 14 4 13 32 15 11 540 6 /usr/sbin/rpc. 358 ? 1766 265 2 17 34 15 19 540 0 rwhod 203 ? 868 51 6 14 38 18 12 540 5 /sbin/syslogd 301 ? 1041 207 2 19 33 12 15 540 5 (dnsserver) 7661 ? 24 8 2 22 34 10 21 540 10 cron 7640 ? 39 40 4 25 44 15 26 540 3 /usr/sbin/watc 311 ? 822 39 3 30 47 14 20 540 13 (pinger) 266 ? 1113 1508 6 29 59 24 30 548 22 /usr/sbin/apac 496 ? 1775 328 23 20 61 18 27 540 12 nmbd 310 ? 381 51 19 30 63 14 38 540 9 /usr/local/sbi 315 ? 1684 70 13 47 71 11 41 540 17 /usr/sbin/rpc. 7473 ? 989 78 7 62 83 14 51 548 29 /usr/sbin/apac 7668 ? 119 31 6 93 99 0 73 584 26 /bin/ps -axmp 7455 ? 1105 89 20 80 105 5 73 548 34 /usr/sbin/apac 7474 ? 1131 90 23 82 112 7 80 548 34 /usr/sbin/apac 7512 ? 771 63 23 84 111 4 79 548 35 /usr/sbin/apac 7506 ? 803 57 22 85 110 3 78 548 37 /usr/sbin/apac 7479 ? 1080 84 23 85 111 3 79 548 35 /usr/sbin/apac 7652 ? 406 116 49 61 163 53 83 540 27 imapd 7456 ? 1132 95 23 87 114 4 82 548 36 /usr/sbin/apac 7480 ? 1169 113 23 87 114 4 80 548 34 /usr/sbin/apac 7464 ? 1156 97 23 89 116 4 84 548 35 /usr/sbin/apac 7504 ? 882 69 23 89 115 3 83 548 35 /usr/sbin/apac 222 ? 4049 809 31 103 182 48 47 540 65 /usr/sbin/name 7662 ? 480 113 59 121 180 0 138 856 42 bash /staff/rj 300 ? 23274 4514 44 480 2985 2461 90 540 326 squid -D -s -f ++FREE++ total used free shared buffers cached Mem: 30676 30416 260 5824 104 1736 -/+ buffers: 28576 2100 Swap: 127004 15204 111800 ++UPTIME++ 4:35pm up 8:04h, 3 users, load average: 1.17, 1.02, 0.88 Fri Mar 14 16:40:15 EST 1997 ++STAT++ cpu 57161 0 69869 2812700 disk 321652 0 0 0 disk_rio 190940 0 0 0 disk_wio 130712 0 0 0 disk_rblk 649312 0 0 0 disk_wblk 369550 0 0 0 page 485516 201294 swap 44615 23825 intr 3932076 2939730 8 0 0 1 0 2 0 0 0 0 657686 0 0 334649 0 ctxt 1772048 btime 858288620 processes 9983 ++PS++ PID TT MAJFL MINFL TRS DRS SIZE SWAP SHRD LIB DT COMMAND 1 ? 844 112 0 0 19 19 0 540 0 init 2 ? 0 1 0 0 0 0 0 0 0 kflushd 3 ? 13692 1 0 0 0 0 0 0 0 kswapd 4 ? 0 1 0 0 0 0 0 0 0 nfsiod 5 ? 0 1 0 0 0 0 0 0 0 nfsiod 6 ? 0 1 0 0 0 0 0 0 0 nfsiod 7 ? 0 1 0 0 0 0 0 0 0 nfsiod 359 1 68 17 0 0 15 15 0 540 0 getty 7600 p1 145 43 0 0 27 27 0 540 0 pppd 360 2 68 17 0 0 15 15 0 540 0 getty 205 ? 1025 82 0 0 20 20 0 540 0 klogd 217 ? 17 12 0 0 18 18 0 540 0 rpc.portmap 7591 p1 313 125 0 0 42 42 0 856 0 ppp04 274 ? 42 26 0 0 30 30 0 540 0 dhcpd 291 ? 2095 2832 0 0 53 53 0 596 0 sendmail 295 ? 169 104 0 0 46 46 0 856 0 RunCache 7697 p0 137 46 0 0 27 27 0 540 0 pppd 302 ? 146 33 0 0 18 18 0 540 0 dnsserver 303 ? 68 19 0 0 15 15 0 540 0 dnsserver 304 ? 68 19 0 0 15 15 0 540 0 dnsserver 305 ? 68 19 0 0 15 15 0 540 0 dnsserver 306 ? 85 24 0 0 20 20 0 540 0 ftpget 310 ? 381 51 0 0 25 25 0 540 0 sshd 325 ? 1793 241 0 0 20 20 0 540 0 idled 3774 p2 279 144 0 0 42 42 0 856 0 snoopy 7594 p1 191 79 0 0 42 42 0 856 0 ppp.sh 219 ? 1039 950 0 1 17 16 1 540 0 inetd 301 ? 1135 215 0 1 19 18 1 540 0 dnsserver 7020 p7 947 262 1 0 70 69 1 856 0 bash 7688 ? 351 69 0 2 30 28 2 736 0 in.telnetd 7689 p0 360 125 1 1 44 42 2 856 0 ppp01 7692 p0 217 79 2 0 44 42 2 856 0 ppp.sh 358 ? 1915 270 0 2 17 15 2 540 0 rwhod 8037 ? 215 26 0 4 59 55 4 596 0 sendmail 203 ? 1028 61 4 2 30 24 4 540 2 /sbin/syslogd 322 ? 1880 2560 0 8 23 15 8 540 6 cron 3780 p2 1109 126 6 2 35 27 8 540 0 pppd 3773 ? 598 92 5 5 35 25 7 736 3 in.telnetd 17 ? 367 3 2 9 21 10 8 540 3 update (bdflus 7589 ? 389 79 6 6 36 24 8 736 4 in.telnetd 7019 ? 465 93 6 6 36 24 8 736 4 in.telnetd 9955 ? 25 9 0 14 28 14 14 540 6 cron 7640 ? 171 93 4 12 31 15 13 540 3 /usr/sbin/watc 317 ? 328 18 4 13 32 15 11 540 3 /usr/sbin/rpc. 9779 ? 351 69 6 16 46 24 18 736 4 in.telnetd 7706 p7 6 23 3 24 44 17 27 856 25 sh 311 ? 965 40 3 25 47 19 20 540 6 (pinger) 496 ? 2078 355 19 10 51 22 17 540 8 nmbd 315 ? 1891 74 5 25 48 18 18 540 12 /usr/sbin/rpc. 222 ? 4496 870 17 15 151 119 16 540 15 /usr/sbin/name 9857 p3 159 39 8 24 51 19 24 540 8 pppd 266 ? 1261 1528 6 29 59 24 31 548 22 /usr/sbin/apac 9808 p3 337 125 23 19 84 42 42 856 0 ppp03 9837 p3 203 79 29 24 94 41 52 856 1 ppp.sh 9964 ? 38 9 11 43 75 21 47 548 25 /usr/sbin/apac 7512 ? 1214 92 12 45 75 18 43 548 26 /usr/sbin/apac 7506 ? 1224 89 9 49 76 18 44 548 28 /usr/sbin/apac 9994 p7 56 13 3 57 60 0 47 540 13 sed s/[^c]//g 8121 ? 356 41 13 50 83 20 51 548 27 /usr/sbin/apac 9786 ? 215 34 11 59 88 18 56 548 27 /usr/sbin/apac 7029 p7 2687 306 37 45 195 113 58 736 17 pine 7504 ? 1395 105 15 80 102 7 70 548 34 /usr/sbin/apac 9984 ? 120 34 6 96 102 0 73 584 29 /bin/ps -axmp 7707 p7 132 8506 44 64 111 3 91 856 46 sh -c (showpic 9781 ? 266 33 14 95 113 4 81 548 34 /usr/sbin/apac 9809 ? 214 30 16 95 114 3 82 548 41 /usr/sbin/apac 9992 p7 1 43 59 88 147 0 128 856 49 sh -c (showpic 9991 p7 55 30 62 98 160 0 140 856 49 sh -c (showpic 9959 ? 403 113 57 103 175 15 133 856 27 bash /staff/rj 300 ? 25730 4641 43 436 2986 2507 91 540 284 squid -D -s -f ++FREE++ total used free shared buffers cached Mem: 30676 30112 564 5372 132 1616 -/+ buffers: 28364 2312 Swap: 127004 16596 110408 ++UPTIME++ 4:40pm up 8:10h, 4 users, load average: 4.45, 2.06, 1.25 Fri Mar 14 16:50:01 EST 1997 ++STAT++ cpu 10614 0 7186 29269 disk 36176 0 0 0 disk_rio 34670 0 0 0 disk_wio 1506 0 0 0 disk_rblk 69346 0 0 0 disk_wblk 3054 0 0 0 page 127244 3780 swap 1 19 intr 107995 47069 8 0 0 1 0 2 0 0 0 0 22829 0 0 38086 0 ctxt 92558 btime 858318131 processes 398 ++PS++ PID TT MAJFL MINFL TRS DRS SIZE SWAP SHRD LIB DT COMMAND 2 ? 0 1 0 0 0 0 0 0 0 kflushd 3 ? 19 1 0 0 0 0 0 0 0 kswapd 4 ? 0 1 0 0 0 0 0 0 0 nfsiod 5 ? 0 1 0 0 0 0 0 0 0 nfsiod 6 ? 0 1 0 0 0 0 0 0 0 nfsiod 7 ? 0 1 0 0 0 0 0 0 0 nfsiod 17 ? 1 3 3 47 57 7 44 540 6 update (bdflus 362 1 68 17 4 66 70 0 55 540 15 /sbin/getty 96 363 2 68 17 4 66 70 0 55 540 15 /sbin/getty 96 219 ? 17 12 6 64 70 0 52 540 18 /usr/sbin/rpc. 367 ? 168 44 5 66 71 0 56 540 15 cucipop -Ya 221 ? 15 35 5 66 71 0 55 540 16 /usr/sbin/inet 306 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 307 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 308 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 309 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 1 ? 149 33 6 69 78 3 59 540 16 init 207 ? 11 14 5 70 77 2 57 540 18 /sbin/klogd 211 ? 14 74 6 70 76 0 58 540 18 /usr/sbin/watc 361 ? 16 11 3 76 79 0 64 540 15 /usr/sbin/rwho 313 ? 74 39 3 83 86 0 59 540 27 (pinger) 310 ? 85 24 8 79 87 0 67 540 20 /usr/lib/squid 328 ? 11 14 8 79 87 0 67 540 20 /usr/sbin/idle 305 ? 82 27 3 85 88 0 70 540 18 (dnsserver) 394 ? 0 8 7 83 90 0 86 540 20 /USR/SBIN/CRON 325 ? 14 50 7 84 91 0 86 540 21 /usr/sbin/cron 205 ? 28 27 7 90 99 2 73 540 24 /sbin/syslogd 320 ? 10 14 10 89 99 0 78 540 21 /usr/sbin/rpc. 399 ? 108 32 6 94 100 0 73 584 27 /bin/ps -axmp 276 ? 42 26 17 94 111 0 81 540 30 /usr/sbin/dhcp 314 ? 13 19 28 85 113 0 88 540 25 /usr/local/sbi 224 ? 22 29 40 93 137 4 92 540 41 /usr/sbin/name 268 ? 12 72 27 125 152 0 125 548 46 /usr/sbin/apac 272 ? 7 35 30 130 160 0 128 548 48 /usr/sbin/apac 275 ? 9 36 30 130 160 0 128 548 48 /usr/sbin/apac 271 ? 10 38 30 131 161 0 127 548 49 /usr/sbin/apac 274 ? 8 35 30 131 161 0 128 548 48 /usr/sbin/apac 283 ? 9 33 30 132 162 0 132 548 49 /usr/sbin/apac 273 ? 8 39 30 133 163 0 128 548 50 /usr/sbin/apac 294 ? 12 31 42 137 179 0 126 596 53 sendmail: acce 318 ? 15 94 14 166 180 0 81 540 99 /usr/sbin/rpc. 396 ? 329 114 59 121 180 0 138 856 42 bash /staff/rj 298 ? 169 104 66 123 189 0 143 856 46 sh /usr/lib/sq 303 ? 900 779 57 731 788 0 152 540 601 squid -D -s -f ++FREE++ total used free shared buffers cached Mem: 30676 30336 340 12764 10552 9484 -/+ buffers: 10300 20376 Swap: 127004 72 126932 ++UPTIME++ 4:50pm up 7 min, 0 users, load average: 1.12, 0.82, 0.39 Fri Mar 14 16:55:01 EST 1997 ++STAT++ cpu 12504 0 8571 55951 disk 38709 0 0 0 disk_rio 35917 0 0 0 disk_wio 2792 0 0 0 disk_rblk 71840 0 0 0 disk_wblk 5626 0 0 0 page 129133 5780 swap 1 19 intr 161514 77026 8 0 0 1 0 2 0 0 0 0 43811 0 0 40666 0 ctxt 117333 btime 858318131 processes 498 ++PS++ PID TT MAJFL MINFL TRS DRS SIZE SWAP SHRD LIB DT COMMAND 2 ? 0 1 0 0 0 0 0 0 0 kflushd 3 ? 19 1 0 0 0 0 0 0 0 kswapd 4 ? 0 1 0 0 0 0 0 0 0 nfsiod 5 ? 0 1 0 0 0 0 0 0 0 nfsiod 6 ? 0 1 0 0 0 0 0 0 0 nfsiod 7 ? 0 1 0 0 0 0 0 0 0 nfsiod 17 ? 1 3 3 47 57 7 44 540 6 update (bdflus 362 1 68 17 4 66 70 0 55 540 15 /sbin/getty 96 363 2 68 17 4 66 70 0 55 540 15 /sbin/getty 96 219 ? 17 12 6 64 70 0 52 540 18 /usr/sbin/rpc. 367 ? 168 44 5 66 71 0 56 540 15 cucipop -Ya 221 ? 15 58 5 66 71 0 55 540 16 /usr/sbin/inet 306 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 307 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 308 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 309 ? 68 19 2 71 73 0 58 540 15 (dnsserver) 1 ? 149 33 6 69 78 3 59 540 16 init 207 ? 11 14 5 70 77 2 57 540 18 /sbin/klogd 211 ? 14 134 6 70 76 0 58 540 18 /usr/sbin/watc 361 ? 16 12 3 75 78 0 63 540 15 /usr/sbin/rwho 313 ? 74 39 3 83 86 0 59 540 27 (pinger) 328 ? 11 20 8 78 86 0 66 540 20 /usr/sbin/idle 310 ? 85 24 8 79 87 0 67 540 20 /usr/lib/squid 305 ? 82 32 3 85 88 0 70 540 18 (dnsserver) 494 ? 0 8 7 83 90 0 86 540 20 /USR/SBIN/CRON 325 ? 14 83 7 84 91 0 86 540 21 /usr/sbin/cron 205 ? 28 27 7 90 99 2 73 540 24 /sbin/syslogd 320 ? 10 14 10 89 99 0 78 540 21 /usr/sbin/rpc. 499 ? 88 35 6 97 103 0 73 584 30 /bin/ps -axmp 276 ? 42 26 17 94 111 0 81 540 30 /usr/sbin/dhcp 314 ? 13 19 28 85 113 0 88 540 25 /usr/local/sbi 455 p1 104 39 19 102 121 0 94 540 27 /usr/local/dia 430 p0 129 46 19 102 121 0 94 540 27 /usr/local/dia 468 p2 104 40 19 102 121 0 94 540 27 /usr/local/dia 447 ? 206 69 9 116 125 0 97 736 28 in.telnetd 414 ? 207 69 9 116 125 0 97 736 28 in.telnetd 460 ? 206 69 9 116 125 0 97 736 28 in.telnetd 473 ? 241 70 33 98 131 0 98 540 33 nmbd 224 ? 22 35 40 97 141 4 92 540 45 /usr/sbin/name 268 ? 12 72 27 125 152 0 123 548 46 /usr/sbin/apac 272 ? 9 49 30 130 160 0 126 548 48 /usr/sbin/apac 275 ? 22 51 30 130 160 0 126 548 48 /usr/sbin/apac 271 ? 13 53 30 131 161 0 126 548 49 /usr/sbin/apac 274 ? 10 49 30 131 161 0 127 548 48 /usr/sbin/apac 283 ? 13 45 30 132 162 0 130 548 49 /usr/sbin/apac 273 ? 11 47 30 133 163 0 127 548 50 /usr/sbin/apac 294 ? 12 51 42 137 179 0 157 596 53 sendmail: acce 415 p0 257 125 58 121 179 0 137 856 42 sh /usr/local/ 448 p1 247 125 58 121 179 0 137 856 42 sh /usr/local/ 461 p2 248 125 58 121 179 0 137 856 42 sh /usr/local/ 496 ? 328 114 59 121 180 0 138 856 42 bash /staff/rj 450 p1 164 79 60 121 181 0 139 856 42 sh /usr/local/ 419 p0 165 79 60 121 181 0 139 856 42 sh /usr/local/ 463 p2 164 79 60 121 181 0 139 856 42 sh /usr/local/ 318 ? 35 100 14 172 186 0 81 540 105 /usr/sbin/rpc. 472 ? 5 29 47 139 186 0 168 596 55 sendmail: serv 298 ? 169 104 66 123 189 0 143 856 46 sh /usr/lib/sq 474 ? 13 36 55 152 207 0 172 596 63 sendmail: QAA0 303 ? 904 901 58 852 910 0 154 540 721 squid -D -s -f ++FREE++ total used free shared buffers cached Mem: 30676 30264 412 20068 7608 8952 -/+ buffers: 13704 16972 Swap: 127004 72 126932 ++UPTIME++ 4:55pm up 12 min, 3 users, load average: 0.42, 0.46, 0.35

----------------------------------------------------- -- End of forwarded message -----------------------------------------------------

-- 
-----------------------------------------------------------
bofh@snoopy.virtual.net.au
-----------------------------------------------------------