2.0.35 crash report

Vladimir Ivaschenok (hazard@blkseanet.net.eu.org)
Fri, 13 Nov 1998 14:06:21 +0300


Several days ago I had a 2.0.35 crash on one of my servers (MII-166 CPU, IWILL
motherboard). This happened for the first time on this machine and didn't ever
happen again. RedHat 4.2 libc5+glibc 2.0.6.
An interesting fact that server was half-functioning after the first Oops
for sometime, i.e. telnet didnt work (never gave a login:), while ftpd, nfs
were ok. I didn't wait until it went fully dead - it was night, and I wanted
to sleep (I wasn't at the office), but I assume that it did. In the morning
the server was rebooted without me.
Here is some info saved to my log, bzImage is available on request :) :

Nov 8 01:21:27 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24
Nov 8 01:21:27 bbs kernel: current->tss.cr3 = 02ce7000, 4r3 = 02ce7000
Nov 8 01:21:27 bbs kernel: *pde = 00000000
Nov 8 01:21:27 bbs kernel: Oops: 0002
Nov 8 01:21:27 bbs kernel: CPU: 0
Nov 8 01:21:28 bbs kernel: EIP: 0010:[refill_freelist+485/1144]
Nov 8 01:21:28 bbs kernel: EFLAGS: 00010206
Nov 8 01:21:28 bbs kernel: eax: 00000000 ebx: 035de198 ecx: 035de198 edx: 12c3bb18
Nov 8 01:21:28 bbs kernel: esi: 00000000 edi: 00000400 ebp: 0000d400 esp: 00e9ce5c
Nov 8 01:21:28 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Nov 8 01:21:28 bbs kernel: Process find (pid: 8756, process nr: 34, stackpage=00e9c000)
Nov 8 01:21:28 bbs kernel: Stack: 002aa010 001f1603 00000001 002aa010 00000009 000000be 000024f7 00000b31
Nov 8 01:21:28 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 002aa010 001f2c14
Nov 8 01:21:28 bbs kernel: 02530700 00000580 00000001 0012661e 00001603 002aa010 00000400 000003e8
Nov 8 01:21:28 bbs kernel: Call Trace: [getblk+854/952] [bread+22/120] [ext2_read_inode+244/848] [__iget+302/544] [ext2_lookup+129/364] [ext2_lookup+179/364] [lookup+221/244]
Nov 8 01:21:28 bbs kernel: [_namei+83/216] [lnamei+44/68] [sys_newlstat+39/84] [system_call+85/128]
Nov 8 01:21:28 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74
Nov 8 01:21:28 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24
Nov 8 01:21:28 bbs kernel: current->tss.cr3 = 00449000, 4r3 = 00449000
Nov 8 01:21:28 bbs kernel: *pde = 00000000
Nov 8 01:21:28 bbs kernel: Oops: 0002
Nov 8 01:21:28 bbs kernel: CPU: 0
Nov 8 01:21:28 bbs kernel: EIP: 0010:[refill_freelist+485/1144]
Nov 8 01:21:28 bbs kernel: EFLAGS: 00010206
Nov 8 01:21:28 bbs kernel: eax: 00000000 ebx: 017e4d8c ecx: 035de198 edx: 12c3bb18
Nov 8 01:21:28 bbs kernel: esi: 00000000 edi: 00000098 ebp: 00010000 esp: 017e4d74
Nov 8 01:21:28 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Nov 8 01:21:28 bbs kernel: Process sort (pid: 8757, process nr: 36, stackpage=017e4000)
Nov 8 01:21:28 bbs kernel: Stack: 000009ba 001f0342 00000001 000029b4 000009ba 000000be 000024fd 00000b16
Nov 8 01:21:28 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 000009ba 001f2758
Nov 8 01:21:28 bbs kernel: 0009cc00 000029b4 00000001 0015c775 00000342 000029b4 00000400 000029b4
Nov 8 01:21:28 bbs kernel: Call Trace: [getblk+854/952] [ext2_new_block+2077/2348] [getblk+53/952] [ext2_alloc_block+359/376] [inode_getblk+234/408] [ext2_getblk+183/528] [ext2_file_write+387/1112]
Nov 8 01:21:28 bbs kernel: [ext2_create+335/356] [do_no_page+436/776] [do_no_page+382/776] [do_no_page+0/776] [sys_write+325/384] [error_code+64/80] [system_call+85/128]
Nov 8 01:21:28 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74
Nov 8 01:21:38 bbs named[493]: unapproved query from [10.0.1.10].1034 for "blkseanet.com"
Nov 8 01:22:17 bbs named[493]: unapproved query from [10.0.1.10].1035 for "esrouter"
Nov 8 01:22:36 bbs named[493]: unapproved query from [10.0.1.10].1036 for "\164\249\255"
Nov 8 01:22:38 bbs named[493]: unapproved query from [10.0.1.10].1037 for "\164\249\255"
Nov 8 01:22:41 bbs named[493]: unapproved query from [10.0.1.10].1038 for "www.\164\249\255.com"
Nov 8 01:22:43 bbs named[493]: unapproved query from [10.0.1.10].1039 for "www.\164\249\255.edu"
Nov 8 01:22:46 bbs named[493]: unapproved query from [10.0.1.10].1040 for "www.\164\249\255.org"
Nov 8 01:22:48 bbs named[493]: unapproved query from [10.0.1.10].1041 for "\164\249\255.com"
Nov 8 01:22:50 bbs named[493]: unapproved query from [10.0.1.10].1042 for "\164\249\255.edu"
Nov 8 01:22:53 bbs named[493]: unapproved query from [10.0.1.10].1043 for "\164\249\255.org"
Nov 8 01:22:59 bbs named[493]: unapproved query from [10.0.1.10].1044 for "home.microsoft.com"
Nov 8 01:23:07 bbs named[493]: unapproved query from [10.0.1.10].1045 for "blkseanet.com"
Nov 8 01:23:10 bbs named[493]: unapproved query from [10.0.1.10].1046 for "www.\164\249\255.com"
Nov 8 01:23:10 bbs named[493]: unapproved query from [10.0.1.10].1047 for "blkseanet.com"
Nov 8 01:24:08 bbs named[493]: unapproved query from [10.0.1.10].1048 for "www.blkseanet.com"
Nov 8 01:24:19 bbs named[493]: unapproved query from [10.0.1.10].1049 for "www.microsoft.com"
Nov 8 01:24:59 bbs named[493]: unapproved query from [10.0.1.10].1050 for "www.blkseanet.com"
Nov 8 01:25:10 bbs named[493]: unapproved query from [10.0.1.10].1051 for "www.iechannelguide.com"
Nov 8 01:25:20 bbs gated[32054]: trace_rotate: rotating /var/log/gated.log
Nov 8 01:25:20 bbs gated[32054]: trace_on: tracing to "/var/log/gated.log" started
Nov 8 01:25:23 bbs named[493]: unapproved query from [10.0.1.10].1052 for "www.iechannelguide.com"
Nov 8 01:25:25 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24
Nov 8 01:25:25 bbs kernel: current->tss.cr3 = 0293b000, 4r3 = 0293b000
Nov 8 01:25:25 bbs kernel: *pde = 00000000
Nov 8 01:25:25 bbs kernel: Oops: 0002
Nov 8 01:25:25 bbs kernel: CPU: 0
Nov 8 01:25:25 bbs kernel: EIP: 0010:[refill_freelist+485/1144]
Nov 8 01:25:25 bbs kernel: EFLAGS: 00010206
Nov 8 01:25:25 bbs kernel: eax: 00000000 ebx: 02829e54 ecx: 035de198 edx: 12c3bb18
Nov 8 01:25:25 bbs kernel: esi: 00000000 edi: 00000098 ebp: 0000f000 esp: 02829e3c
Nov 8 01:25:25 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Nov 8 01:25:25 bbs kernel: Process in.nnrpd (pid: 9035, process nr: 69, stackpage=02829000)
Nov 8 01:25:25 bbs kernel: Stack: 001fc0d8 001f1603 00000001 001fc0d8 001fc0d8 000000be 00002550 00000a8b
Nov 8 01:25:25 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 001fc0d8 001f2c14
Nov 8 01:25:25 bbs kernel: 0186fc00 00032400 00000001 0012661e 00001603 001fc0d8 00000400 000003e8
Nov 8 01:25:25 bbs kernel: Call Trace: [getblk+854/952] [bread+22/120] [ext2_read_inode+244/848] [__iget+302/544] [ext2_lookup+341/364] [lookup+221/244] [open_namei+516/1032]
Nov 8 01:25:25 bbs kernel: [do_open+87/284] [sys_open+57/112] [system_call+85/128]
Nov 8 01:25:25 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74
Nov 8 01:28:10 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24
Nov 8 01:28:10 bbs kernel: current->tss.cr3 = 01b18000, 4r3 = 01b18000
Nov 8 01:28:10 bbs kernel: *pde = 00000000
Nov 8 01:28:10 bbs kernel: Oops: 0002
Nov 8 01:28:10 bbs kernel: CPU: 0
Nov 8 01:28:10 bbs kernel: EIP: 0010:[refill_freelist+485/1144]
Nov 8 01:28:10 bbs kernel: EFLAGS: 00010206
Nov 8 01:28:10 bbs kernel: eax: 00000000 ebx: 03c6ddd4 ecx: 035de198 edx: 12c3bb18
Nov 8 01:28:10 bbs kernel: esi: 00000000 edi: 00000098 ebp: 0000e000 esp: 03c6ddbc
Nov 8 01:28:10 bbs kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Nov 8 01:28:10 bbs kernel: Process gated (pid: 32054, process nr: 51, stackpage=03c6d000)
Nov 8 01:28:10 bbs kernel: Stack: 002721d6 03c61603 00000001 002721d6 002721d6 000000be 00002530 00000a55
Nov 8 01:28:10 bbs kernel: 00000000 035de118 01fddd18 00000000 0012616e 00000400 002721d6 03c6def4
Nov 8 01:28:10 bbs kernel: 001f2c14 002721d6 00000001 0015e72e 00001603 002721d6 00000400 00000000
Nov 8 01:28:10 bbs kernel: Call Trace: [getblk+854/952] [ext2_alloc_block+122/376] [getblk+53/952] [block_getblk+347/612] [ext2_getblk+253/528] [ext2_file_write+387/1112] [sys_write+325/384]
Nov 8 01:28:10 bbs kernel: [sys_gettimeofday+44/112] [system_call+85/128]
Nov 8 01:28:10 bbs kernel: Code: 89 42 0c 66 8b 41 04 33 01 89 c3 81 e3 ff 0f 00 00 8b 15 74
Nov 8 01:35:37 bbs named[493]: unapproved query from [10.0.1.12].1076 for "www.vitalsigns.com"
Nov 8 01:35:37 bbs named[493]: unapproved query from [10.0.1.12].1077 for "www.vitalsigns.com"
Nov 8 01:54:42 bbs named[493]: unapproved query from [10.0.1.10].1053 for "blkseanet.com"
Nov 8 01:57:12 bbs named[493]: unapproved query from [10.0.1.10].1054 for "blkseanet.com"
Nov 8 02:01:00 bbs gdc: performing a "gdc start" command for user root
Nov 8 02:01:09 bbs kernel: Unable to handle kernel paging request at virtual address d2c3bb24

Here the log stops - seems that syslog died. In the morning the server is
rebooted, and the logging starts again, I saved it so you could see
kernel configuration:

Nov 8 10:37:30 bbs syslogd 1.3-3: restart.
Nov 8 10:37:30 bbs kernel: klogd 1.3-3, log source = /proc/kmsg started.
Nov 8 10:37:30 bbs kernel: Loaded 4176 symbols from /usr/src/linux/System.map.
Nov 8 10:37:30 bbs kernel: Symbols match kernel version 2.0.35.
Nov 8 10:37:31 bbs kernel: Loaded 21 symbols from 5 modules.
Nov 8 10:37:31 bbs kernel: Console: 16 point font, 400 scans
Nov 8 10:37:31 bbs kernel: Console: colour VGA+ 80x25, 1 virtual console (max 63)
Nov 8 10:37:31 bbs kernel: pcibios_init : BIOS32 Service Directory structure at 0x000facd0
Nov 8 10:37:31 bbs kernel: pcibios_init : BIOS32 Service Directory entry at 0xfb150
Nov 8 10:37:31 bbs kernel: pcibios_init : PCI BIOS revision 2.10 entry at 0xfb180
Nov 8 10:37:31 bbs kernel: Probing PCI hardware.
Nov 8 10:37:31 bbs kernel: Calibrating delay loop.. ok - 133.12 BogoMIPS
Nov 8 10:37:31 bbs kernel: Memory: 63092k/65536k available (728k kernel code, 384k reserved, 1332k data)
Nov 8 10:37:31 bbs kernel: This processor honours the WP bit even when in supervisor mode. Good.
Nov 8 10:37:31 bbs kernel: Swansea University Computer Society NET3.035 for Linux 2.0
Nov 8 10:37:31 bbs kernel: NET3: Unix domain sockets 0.13 for Linux NET3.035.
Nov 8 10:37:31 bbs kernel: Swansea University Computer Society TCP/IP for NET3.034
Nov 8 10:37:31 bbs kernel: IP Protocols: IGMP, ICMP, UDP, TCP
Nov 8 10:37:31 bbs kernel: Linux IP multicast router 0.07.
Nov 8 10:37:31 bbs kernel: VFS: Diskquotas version dquot_5.6.0 initialized
Nov 8 10:37:31 bbs kernel:
Nov 8 10:37:31 bbs kernel: Checking 386/387 coupling... Ok, fpu using exception 16 error reporting.
Nov 8 10:37:31 bbs kernel: Checking 'hlt' instruction... Ok.
Nov 8 10:37:31 bbs kernel: Linux version 2.0.35 (root@bbs.blkseanet.ru) (gcc version 2.7.2) #15 Thu Oct 22 02:35:42 MSK 1998
Nov 8 10:37:31 bbs kernel: Starting kswapd v 1.4.2.2
Nov 8 10:37:31 bbs kernel: Serial driver version 4.13 with no serial options enabled
Nov 8 10:37:31 bbs kernel: tty00 at 0x03f8 (irq = 4) is a 16550A
Nov 8 10:37:31 bbs kernel: tty01 at 0x02f8 (irq = 3) is a 16550A
Nov 8 10:37:31 bbs kernel: Ramdisk driver initialized : 16 ramdisks of 4096K size
Nov 8 10:37:31 bbs kernel: hda: Seagate Technology 1275MB - ST31276A, 1221MB w/0kB Cache, CHS=620/64/63
Nov 8 10:37:31 bbs kernel: hdb: FUJITSU M1638TAU, 2452MB w/128kB Cache, CHS=622/128/63
Nov 8 10:37:31 bbs kernel: hdc: QUANTUM BIGFOOT_CY4320A, 4134MB w/67kB Cache, CHS=8960/15/63
Nov 8 10:37:31 bbs kernel: hdd: CD620E, ATAPI CDROM drive
Nov 8 10:37:31 bbs kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Nov 8 10:37:31 bbs kernel: ide1 at 0x170-0x177,0x376 on irq 15
Nov 8 10:37:31 bbs kernel: FDC 0 is a post-1991 82077
Nov 8 10:37:31 bbs kernel: md driver 0.36.3 MAX_MD_DEV=4, MAX_REAL=8
Nov 8 10:37:31 bbs kernel: Ethernet Bridge 002 for NET3.035 (Linux 2.0)
Nov 8 10:37:31 bbs kernel: eth0: PCnet/PCI II 79C970A at 0x6400, 00 00 01 35 95 58pcnet32.c:v0.99B 4/4/98 DJBecker/TSBogend.
Nov 8 10:37:31 bbs kernel: Partition check:
Nov 8 10:37:31 bbs kernel: hda: hda1 hda2
Nov 8 10:37:31 bbs kernel: hdb: hdb1 hdb2 hdb3
Nov 8 10:37:31 bbs kernel: hdc: hdc1 hdc2 hdc3
Nov 8 10:37:31 bbs kernel: VFS: Mounted root (ext2 filesystem) readonly.
Nov 8 10:37:31 bbs kernel: Adding Swap: 130748k swap-space (priority -1)
Nov 8 10:37:31 bbs kernel: raid0 personality registered
Nov 8 10:37:31 bbs kernel: raid1 personality registered
Nov 8 10:37:31 bbs kernel: raid5 personality registered
Nov 8 10:37:31 bbs kernel: REGISTER_DEV hda1 to md0 done
Nov 8 10:37:31 bbs kernel: REGISTER_DEV hdc1 to md0 done
Nov 8 10:37:31 bbs kernel: raid0 : Allocating 4928 bytes for hash.
Nov 8 10:37:31 bbs kernel: REGISTER_DEV hda2 to md1 done
Nov 8 10:37:31 bbs kernel: REGISTER_DEV hdb1 to md1 done
Nov 8 10:37:31 bbs kernel: REGISTER_DEV hdc2 to md1 done
Nov 8 10:37:31 bbs kernel: md: 09:01: raid array is not clean -- run ckraid
Nov 8 10:37:31 bbs kernel: raid5: device 03:02 operational as raid disk 0
Nov 8 10:37:31 bbs kernel: raid5: device 03:41 operational as raid disk 1
Nov 8 10:37:31 bbs kernel: raid5: device 16:02 operational as raid disk 2
Nov 8 10:37:31 bbs kernel: raid5: raid level 5 set 09:01 active with 3 out of 3 devices, algorithm 2
Nov 8 10:37:31 bbs kernel: md: updating raid superblock on device 03:02, sb_offset == 435392
Nov 8 10:37:31 bbs kernel: md: updating raid superblock on device 03:41, sb_offset == 435328
Nov 8 10:37:31 bbs kernel: md: updating raid superblock on device 16:02, sb_offset == 434624
Nov 8 10:37:31 bbs kernel: Swansea University Computer Society IPX 0.34 for NET3.035
Nov 8 10:37:31 bbs kernel: IPX Portions Copyright (c) 1995 Caldera, Inc.
Nov 8 10:37:31 bbs kernel: Manual mode (use sbniautodetect=<number of SBNI> to Autodetect mode)
Nov 8 10:37:31 bbs kernel: Counting num specified card....1 cards specified.
Nov 8 10:37:31 bbs kernel: SBNI adapter probe at 0x210:
Nov 8 10:37:31 bbs kernel: sbni0: sbni adapter at 0x210, using assigned IRQ 5
Nov 8 10:37:31 bbs kernel: sbni0: receive level: 0x3 (fixed), baud rate: 3
Nov 8 10:37:52 bbs PAM_pwdb[410]: (su) session opened for user news by (uid=9)
Nov 8 10:37:52 bbs PAM_pwdb[410]: (su) session closed for user news
Nov 8 10:37:55 bbs kernel: irqtune/0.4: setting system IRQ priority to 3/14
Nov 8 10:37:55 bbs kernel: CSLIP: code copyright 1989 Regents of the University of California
Nov 8 10:37:55 bbs kernel: PPP: version 2.2.0 (dynamic channel allocation)
Nov 8 10:37:55 bbs kernel: PPP Dynamic channel allocation code copyright 1995 Caldera, Inc.
Nov 8 10:37:55 bbs kernel: PPP line discipline registered.
Nov 8 10:37:55 bbs kernel: PPP BSD Compression module registered
Nov 8 10:38:15 bbs kernel: Cyclades driver 2.1.1.9 1998/09/02 14:47:01
Nov 8 10:38:15 bbs kernel: built Oct 22 1998 02:15:21
Nov 8 10:38:15 bbs kernel: Cyclom-Y/ISA #1: 0xd6000-0xd7fff, IRQ10, 8 channels starting from port 0.

If you answer, please email me directly, as I'm not subscribed to linux-kernel.
BTW, I run the same kernel now and everything is ok.

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.rutgers.edu
Please read the FAQ at http://www.tux.org/lkml/