oops in generic_delete_inode when doing frequent i/o to disk
From: ruben
Date: Thu Mar 30 2006 - 13:07:22 EST
[1] One line Summary of problem: sun java and freenet makes kernel
2.6.16.1 oops and crashes the machine on AMD64.
-------------------------------------------------------------
[2] Full Description
When running a java application which writes to disk constantly for a long
time, an oops is generated.
This oops will crash the machine eventually.
I think the oops will be generated as well with any program which writes
constantly to disc, but I have only one such program:
Freenet running on Sun Java. The versions of the programs are described
below.
Some oops are shown below, with the disassembled functions and code.
I hope you find this useful in finding the bug.
There are some sections in the REPORTING BUGS which I think are not relevant
to the code, so I omited them. These include /proc/ioports, /proc/iomem,
lspci -vvv and /proc/scsi/scsi.
Please contact me if you need any more information.
-------------------------------------------------------------
[3.] Keywords
oops, generic_delete_inode, frequent and continuous i/o to disk
-------------------------------------------------------------
[4.] Kernel version (from /proc/version):
Linux version 2.6.16.1 (root@blackhole) (gcc version 4.0.2 20050808
(prerelease) (Ubuntu 4.0.1-4ubuntu9)) #4 PREEMPT Thu Mar 30 00:07:11 CEST
2006
-------------------------------------------------------------
[5.] Most recent kernel version which did not have the bug:
Kernel 2.6.12-9-amd-generic from Ubuntu 5.2 has the bug as well.
I don't have older kernels, will test if requested.
--------------------------------------------------------------
[6.] Output of Oops.. message (if applicable) with symbolic information
resolved (see Documentation/oops-tracing.txt)
Oops:
Mar 30 10:21:19 blackhole kernel: [18628.027629] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats
freq_table cpufreq_powersave cpufreq_ondemand cpufreq_conservative lp
video thermal processor fan container button battery ac ipv6 mousedev
tsdev ide_cd cdrom parport_pc parport pcspkr psmouse rtc ide_generic
snd_seq_dummy snd_seq_oss snd_seq_midi snd_seq_midi_event snd_seq
snd_via82xx gameport
snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss snd_pcm snd_timer
snd_page_alloc snd_mpu401_uart snd_rawmidi snd_seq_device snd soundcore
i2c_viapro ehci_hcd uhci_hcd generic sata_via libata scsi_mod bt878 tuner
bttv video_buf firmware_class compat_ioctl32 i2c_algo_bit v4l2_common
btcx_risc ir_common tveeprom i2c_core videodev sk98lin skge shpchp
pci_hotplug aes dm_crypt loop dm_mod md_mod unix
Mar 30 10:21:19 blackhole kernel: [18628.027667] Pid: 21039, comm: java
Not tainted 2.6.16.1 #4
Mar 30 10:21:19 blackhole kernel: [18628.027671] RIP:
0010:[generic_delete_inode+283/387]
<ffffffff8017fb8b>{generic_delete_inode+283}
Mar 30 10:21:19 blackhole kernel: [18628.027677] RSP:
0018:ffff8100041fbec8 EFLAGS: 00010246
Mar 30 10:21:19 blackhole kernel: [18628.027681] RAX: 0000000000000000
RBX: ffff810037a93750 RCX: ffff81000ea24870
Mar 30 10:21:19 blackhole kernel: [18628.027687] RDX: ffff800001f7f2b0
RSI: ffff81003ba72680 RDI: ffff81003223f240
Mar 30 10:21:19 blackhole kernel: [18628.027691] RBP: ffffffff801c694e
R08: 0000000000000002 R09: 00000000000000a0
Mar 30 10:21:19 blackhole kernel: [18628.027695] R10: 0000000000000000
R11: 0000000000000000 R12: ffff81003f718ed0
Mar 30 10:21:19 blackhole kernel: [18628.027699] R13: ffff81003e349000
R14: 0000000000000000 R15: 00002aaaab2d7b40
Mar 30 10:21:19 blackhole kernel: [18628.027704] FS:
0000000044304960(0063) GS:ffffffff803fa000(0000) knlGS:00000000f750d6c0
Mar 30 10:21:19 blackhole kernel: [18628.027708] CS: 0010 DS: 0000 ES:
0000 CR0: 0000000080050033
Mar 30 10:21:19 blackhole kernel: [18628.027712] CR2: ffff800001f7f2b0
CR3: 0000000028507000 CR4: 00000000000006e0
Mar 30 10:21:19 blackhole kernel: [18628.027717] Process java (pid: 21039,
threadinfo ffff8100041fa000, task ffff81003ef5e380)
Mar 30 10:21:19 blackhole kernel: [18628.027720] Stack: ffffffff8017fbf3
0000000000000000 ffff810037a93750 ffffffff80176ba6
Mar 30 10:21:19 blackhole kernel: [18628.027727] ffff81000b34a7c8
ffff81003dab4080 0000004612bd64da ffff81003e34900b
Mar 30 10:21:19 blackhole kernel: [18628.027733] 0000000000000010
0000000000000000
Mar 30 10:21:19 blackhole kernel: [18628.027736] Call Trace:
<ffffffff8017fbf3>{generic_drop_inode+0}
Mar 30 10:21:19 blackhole kernel: [18628.027744]
<ffffffff80176ba6>{do_unlinkat+213} <ffffffff8010a76e>{system_call+126}
Mar 30 10:21:19 blackhole kernel: [18628.027771]
Mar 30 10:21:19 blackhole kernel: [18628.027772] Code: 48 89 02 74 04 48
89 50 08 48 c7 03 00 00 00 00 48 c7 43 08
Mar 30 10:21:19 blackhole kernel: [18628.027789] <6>note: java[21039]
exited with preempt_count 1
gdb /usr/src/linux/vmlinux
gdb> disassemble generic_delete_inode
Dump of assembler code for function generic_delete_inode:
0xffffffff8017fa70 <generic_delete_inode+0>: push %rbp
0xffffffff8017fa71 <generic_delete_inode+1>: push %rbx
0xffffffff8017fa72 <generic_delete_inode+2>: mov %rdi,%rbx
0xffffffff8017fa75 <generic_delete_inode+5>: push %rax
0xffffffff8017fa76 <generic_delete_inode+6>: mov 0x100(%rdi),%rax
0xffffffff8017fa7d <generic_delete_inode+13>: mov 0x10(%rdi),%rcx
0xffffffff8017fa81 <generic_delete_inode+17>: mov 0x38(%rax),%rbp
0xffffffff8017fa85 <generic_delete_inode+21>: lea 0x10(%rdi),%rax
0xffffffff8017fa89 <generic_delete_inode+25>: mov 0x8(%rax),%rdx
0xffffffff8017fa8d <generic_delete_inode+29>: mov %rdx,0x8(%rcx)
0xffffffff8017fa91 <generic_delete_inode+33>: mov %rcx,(%rdx)
0xffffffff8017fa94 <generic_delete_inode+36>: mov %rax,0x8(%rax)
0xffffffff8017fa98 <generic_delete_inode+40>: mov %rax,0x10(%rdi)
0xffffffff8017fa9c <generic_delete_inode+44>: lea 0x20(%rdi),%rax
0xffffffff8017faa0 <generic_delete_inode+48>: mov 0x20(%rdi),%rcx
0xffffffff8017faa4 <generic_delete_inode+52>: mov 0x8(%rax),%rdx
0xffffffff8017faa8 <generic_delete_inode+56>: mov %rdx,0x8(%rcx)
0xffffffff8017faac <generic_delete_inode+60>: mov %rcx,(%rdx)
0xffffffff8017faaf <generic_delete_inode+63>: mov %rax,0x8(%rax)
0xffffffff8017fab3 <generic_delete_inode+67>: orq $0x10,0x218(%rdi)
0xffffffff8017fabb <generic_delete_inode+75>: mov %rax,0x20(%rdi)
0xffffffff8017fabf <generic_delete_inode+79>: decl 2426923(%rip)
# 0xffffffff803d02f0 <inodes_stat>
0xffffffff8017fac5 <generic_delete_inode+85>: mov %gs:0x10,%rax
0xffffffff8017face <generic_delete_inode+94>: decl
0xffffffffffffe044(%rax)
0xffffffff8017fad4 <generic_delete_inode+100>: mov %gs:0x10,%rax
0xffffffff8017fadd <generic_delete_inode+109>: mov
0xffffffffffffe038(%rax),%eax
0xffffffff8017fae3 <generic_delete_inode+115>: mov %eax,%eax
0xffffffff8017fae5 <generic_delete_inode+117>: test $0x8,%al
0xffffffff8017fae7 <generic_delete_inode+119>: je 0xffffffff8017faee
<generic_delete_inode+126>
0xffffffff8017fae9 <generic_delete_inode+121>: callq 0xffffffff802decf9
<preempt_schedule>
0xffffffff8017faee <generic_delete_inode+126>: testb $0x2,0x229(%rbx)
0xffffffff8017faf5 <generic_delete_inode+133>: jne 0xffffffff8017fb07
<generic_delete_inode+151>
0xffffffff8017faf7 <generic_delete_inode+135>: mov 2463842(%rip),%rax
# 0xffffffff803d9360 <security_ops>
0xffffffff8017fafe <generic_delete_inode+142>: mov %rbx,%rdi
0xffffffff8017fb01 <generic_delete_inode+145>: callq *0x190(%rax)
0xffffffff8017fb07 <generic_delete_inode+151>: mov 0x38(%rbp),%rbp
0xffffffff8017fb0b <generic_delete_inode+155>: test %rbp,%rbp
0xffffffff8017fb0e <generic_delete_inode+158>: je 0xffffffff8017fb57
<generic_delete_inode+231>
0xffffffff8017fb10 <generic_delete_inode+160>: mov %rbx,%rdi
0xffffffff8017fb13 <generic_delete_inode+163>: callq 0xffffffff801809be
<is_bad_inode>
0xffffffff8017fb18 <generic_delete_inode+168>: test %eax,%eax
0xffffffff8017fb1a <generic_delete_inode+170>: jne 0xffffffff8017fb50
<generic_delete_inode+224>
0xffffffff8017fb1c <generic_delete_inode+172>: mov 0x100(%rbx),%rax
0xffffffff8017fb23 <generic_delete_inode+179>: test %rax,%rax
0xffffffff8017fb26 <generic_delete_inode+182>: jne 0xffffffff8017fb32
<generic_delete_inode+194>
0xffffffff8017fb28 <generic_delete_inode+184>: ud2a
0xffffffff8017fb2a <generic_delete_inode+186>: pushq $0xffffffff802fec56
0xffffffff8017fb2f <generic_delete_inode+191>: retq $0x41
0xffffffff8017fb32 <generic_delete_inode+194>: testb $0x3,0x120(%rax)
0xffffffff8017fb39 <generic_delete_inode+201>: je 0xffffffff8017fb50
<generic_delete_inode+224>
0xffffffff8017fb3b <generic_delete_inode+203>: testb $0x20,0x228(%rbx)
0xffffffff8017fb42 <generic_delete_inode+210>: jne 0xffffffff8017fb50
<generic_delete_inode+224>
---Type <return> to continue, or q <return> to quit---
0xffffffff8017fb44 <generic_delete_inode+212>: mov 0x40(%rax),%rax
0xffffffff8017fb48 <generic_delete_inode+216>: or
$0xffffffffffffffff,%esi
0xffffffff8017fb4b <generic_delete_inode+219>: mov %rbx,%rdi
0xffffffff8017fb4e <generic_delete_inode+222>: callq *(%rax)
0xffffffff8017fb50 <generic_delete_inode+224>: mov %rbx,%rdi
0xffffffff8017fb53 <generic_delete_inode+227>: callq *%ebp
0xffffffff8017fb55 <generic_delete_inode+229>: jmp 0xffffffff8017fb6d
<generic_delete_inode+253>
0xffffffff8017fb57 <generic_delete_inode+231>: lea 0x118(%rbx),%rdi
0xffffffff8017fb5e <generic_delete_inode+238>: xor %esi,%esi
0xffffffff8017fb60 <generic_delete_inode+240>: callq 0xffffffff80150984
<truncate_inode_pages>
0xffffffff8017fb65 <generic_delete_inode+245>: mov %rbx,%rdi
0xffffffff8017fb68 <generic_delete_inode+248>: callq 0xffffffff8017f483
<clear_inode>
0xffffffff8017fb6d <generic_delete_inode+253>: mov %gs:0x10,%rax
0xffffffff8017fb76 <generic_delete_inode+262>: incl
0xffffffffffffe044(%rax)
0xffffffff8017fb7c <generic_delete_inode+268>: mov 0x8(%rbx),%rdx
0xffffffff8017fb80 <generic_delete_inode+272>: test %rdx,%rdx
0xffffffff8017fb83 <generic_delete_inode+275>: je 0xffffffff8017fba3
<generic_delete_inode+307>
0xffffffff8017fb85 <generic_delete_inode+277>: mov (%rbx),%rax
0xffffffff8017fb88 <generic_delete_inode+280>: test %rax,%rax
0xffffffff8017fb8b <generic_delete_inode+283>: mov %rax,(%rdx)
0xffffffff8017fb8e <generic_delete_inode+286>: je 0xffffffff8017fb94
<generic_delete_inode+292>
0xffffffff8017fb90 <generic_delete_inode+288>: mov %rdx,0x8(%rax)
0xffffffff8017fb94 <generic_delete_inode+292>: movq $0x0,(%rbx)
0xffffffff8017fb9b <generic_delete_inode+299>: movq $0x0,0x8(%rbx)
0xffffffff8017fba3 <generic_delete_inode+307>: mov %gs:0x10,%rax
0xffffffff8017fbac <generic_delete_inode+316>: decl
0xffffffffffffe044(%rax)
0xffffffff8017fbb2 <generic_delete_inode+322>: mov %gs:0x10,%rax
0xffffffff8017fbbb <generic_delete_inode+331>: mov
0xffffffffffffe038(%rax),%eax
0xffffffff8017fbc1 <generic_delete_inode+337>: mov %eax,%eax
0xffffffff8017fbc3 <generic_delete_inode+339>: test $0x8,%al
0xffffffff8017fbc5 <generic_delete_inode+341>: je 0xffffffff8017fbcc
<generic_delete_inode+348>
0xffffffff8017fbc7 <generic_delete_inode+343>: callq 0xffffffff802decf9
<preempt_schedule>
0xffffffff8017fbcc <generic_delete_inode+348>: mov %rbx,%rdi
0xffffffff8017fbcf <generic_delete_inode+351>: callq 0xffffffff8017ec70
<wake_up_inode>
0xffffffff8017fbd4 <generic_delete_inode+356>: cmpq $0x20,0x218(%rbx)
0xffffffff8017fbdc <generic_delete_inode+364>: je 0xffffffff8017fbe8
<generic_delete_inode+376>
0xffffffff8017fbde <generic_delete_inode+366>: ud2a
0xffffffff8017fbe0 <generic_delete_inode+368>: pushq $0xffffffff80300d05
0xffffffff8017fbe5 <generic_delete_inode+373>: retq $0x422
0xffffffff8017fbe8 <generic_delete_inode+376>: pop %rax
0xffffffff8017fbe9 <generic_delete_inode+377>: mov %rbx,%rdi
0xffffffff8017fbec <generic_delete_inode+380>: pop %rbx
0xffffffff8017fbed <generic_delete_inode+381>: pop %rbp
0xffffffff8017fbee <generic_delete_inode+382>: jmpq 0xffffffff8017eb2e
<destroy_inode>
End of assembler dump.
(gdb)
cat bug.c
char str[] =
"\x48\x89\x02\x74\x04\x48\x89\x50\x08\x48\xc7\x03\x00\x00\x00\x00\x48\xc7\x43\x08";
main(){}
(gdb) disassemble str
Dump of assembler code for function str:
0x0000000000500820 <str+0>: mov %rax,(%rdx)
0x0000000000500823 <str+3>: je 0x500829 <str+9>
0x0000000000500825 <str+5>: mov %rdx,0x8(%rax)
0x0000000000500829 <str+9>: movq $0x0,(%rbx)
0x0000000000500830 <str+16>: movq $0x0,0x8(%rbx)
End of assembler dump.
(gdb)
The code doesn't seem to be corrupt.
I have some other oops with the same code and different stack:
-----------Begin oops -------------
Mar 30 02:23:12 blackhole kernel: [ 4290.494412] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats freq_table cpufreq_powersave cpufreq_ondemand
cpufreq_conservative lp video thermal processor fan container button
battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc parport pcspkr
psmouse rtc ide_generic snd_seq_dummy snd_seq_oss snd_seq_midi
snd_seq_midi_event snd_seq snd_via82xx gameport snd_ac97_codec
snd_ac97_bus
snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_mpu401_uart
snd_rawmidi snd_seq_device snd soundcore i2c_viapro ehci_hcd uhci_hcd
generic sata_via libata scsi_mod bt878 tuner bttv video_buf firmware_class
compat_ioctl32 i2c_algo_bit v4l2_common btcx_risc ir_common tveeprom
i2c_core videodev sk98lin skge shpchp pci_hotplug aes dm_crypt loop dm_mod
md_mod unix
Mar 30 02:23:12 blackhole kernel: [ 4290.494450] Pid: 12645, comm: java
Not tainted 2.6.16.1 #4
Mar 30 02:23:12 blackhole kernel: [ 4290.494453] RIP:
0010:[generic_delete_inode+283/387]
<ffffffff8017fb8b>{generic_delete_inode+283}
Mar 30 02:23:12 blackhole kernel: [ 4290.494460] RSP:
0018:ffff810027d21ec8 EFLAGS: 00010246
Mar 30 02:23:12 blackhole kernel: [ 4290.494464] RAX: 0000000000000000
RBX: ffff81003b055690 RCX: ffff81000ea24870
Mar 30 02:23:12 blackhole kernel: [ 4290.494469] RDX: ffff800001fa50d0
RSI: ffff81003ba72680 RDI: ffff81002aafab88
Mar 30 02:23:12 blackhole kernel: [ 4290.494474] RBP: ffffffff801c694e
R08: 0000000000000002 R09: 0000000000000340
Mar 30 02:23:12 blackhole kernel: [ 4290.494477] R10: 0000000000000000
R11: 0000000000000000 R12: ffff81003f9e1c38
Mar 30 02:23:12 blackhole kernel: [ 4290.494482] R13: ffff81003e2fb000
R14: 0000000000000000 R15: 00002aaab019f410
Mar 30 02:23:12 blackhole kernel: [ 4290.494487] FS:
0000000047f40960(0063) GS:ffffffff803fa000(0000) knlGS:00000000f5bc2bb0
Mar 30 02:23:12 blackhole kernel: [ 4290.494491] CS: 0010 DS: 0000 ES:
0000 CR0: 0000000080050033
Mar 30 02:23:12 blackhole kernel: [ 4290.494495] CR2: ffff800001fa50d0
CR3: 000000000e3c3000 CR4: 00000000000006e0
Mar 30 02:23:12 blackhole kernel: [ 4290.494500] Process java (pid: 12645,
threadinfo ffff810027d20000, task ffff810021d82340)
Mar 30 02:23:12 blackhole kernel: [ 4290.494503] Stack: ffffffff8017fbf3
0000000000000000 ffff81003b055690 ffffffff80176ba6
Mar 30 02:23:12 blackhole kernel: [ 4290.494510] ffff810010fde468
ffff81003dab4080 00000009ca093089 ffff81003e2fb006
Mar 30 02:23:12 blackhole kernel: [ 4290.494516] 0000000000000010
ffffffff00000000
Mar 30 02:23:12 blackhole kernel: [ 4290.494520] Call Trace:
<ffffffff8017fbf3>{generic_drop_inode+0}
Mar 30 02:23:12 blackhole kernel: [ 4290.494527]
<ffffffff80176ba6>{do_unlinkat+213}
<ffffffff801816c5>{mntput_no_expire+23}
Mar 30 02:23:12 blackhole kernel: [ 4290.494540]
<ffffffff80165a73>{filp_close+89} <ffffffff8010a76e>{system_call+126}
Mar 30 02:23:12 blackhole kernel: [ 4290.494560]
Mar 30 02:23:12 blackhole kernel: [ 4290.494561] Code: 48 89 02 74 04 48
89 50 08 48 c7 03 00 00 00 00 48 c7 43 08
Mar 30 02:23:12 blackhole kernel: [ 4290.494578] <6>note: java[12645]
exited with preempt_count 1
----------End oops -----------
----------Begin oops ---------
Mar 30 14:35:00 blackhole kernel: [26295.049536] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats freq_table cpufreq_powersave cpufreq_ondemand
cpufreq_conservative lp video thermal processor fan container button
battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc parport pcspkr
psmouse rtc ide_generic snd_seq_dummy snd_seq_oss snd_seq_midi
snd_seq_midi_event snd_seq snd_via82xx gameport snd_ac97_codec
snd_ac97_bus
snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_mpu401_uart
snd_rawmidi snd_seq_device snd soundcore i2c_viapro ehci_hcd uhci_hcd
generic sata_via libata scsi_mod bt878 tuner bttv video_buf firmware_class
compat_ioctl32 i2c_algo_bit v4l2_common btcx_risc ir_common tveeprom
i2c_core videodev sk98lin skge shpchp pci_hotplug aes dm_crypt loop dm_mod
md_mod unix
Mar 30 14:35:00 blackhole kernel: [26295.049699] Pid: 140, comm: kswapd0
Not tainted 2.6.16.1 #4
Mar 30 14:35:00 blackhole kernel: [26295.049711] RIP:
0010:[dispose_list+114/319] <ffffffff8017f5ff>{dispose_list+114}Mar 30
14:35:00 blackhole kernel: [26295.049727] RSP: 0018:ffff81003fdd7d78
EFLAGS: 00010246
Mar 30 14:35:00 blackhole kernel: [26295.049743] RAX: 0000000000000000
RBX: ffff81003487a760 RCX: 0000000000000036
Mar 30 14:35:00 blackhole kernel: [26295.049757] RDX: ffff800001f64870
RSI: ffff81003487a8d8 RDI: ffffffffffffffff
Mar 30 14:35:00 blackhole kernel: [26295.049770] RBP: ffff81003487a750
R08: ffff810001cd4228 R09: 0000000000000006
Mar 30 14:35:00 blackhole kernel: [26295.049783] R10: 0000000000000006
R11: ffffffff801b4912 R12: 000000000000001b
Mar 30 14:35:00 blackhole kernel: [26295.049795] R13: ffff81003fdd7da8
R14: 0000000000000080 R15: 0000000000000080
Mar 30 14:35:00 blackhole kernel: [26295.049809] FS:
00000000424e6960(0000) GS:ffffffff803fa000(0000) knlGS:000000007c355bb0
Mar 30 14:35:00 blackhole kernel: [26295.049827] CS: 0010 DS: 0018 ES:
0018 CR0: 000000008005003b
Mar 30 14:35:00 blackhole kernel: [26295.049838] CR2: ffff800001f64870
CR3: 0000000028507000 CR4: 00000000000006e0
Mar 30 14:35:00 blackhole kernel: [26295.049852] Process kswapd0 (pid:
140, threadinfo ffff81003fdd6000, task ffff81003fd0f040)
Mar 30 14:35:00 blackhole kernel: [26295.049869] Stack: 0000000000000000
ffff810027f21438 ffff810027f21448 0000000000000080
Mar 30 14:35:00 blackhole kernel: [26295.049885] 0000000000000000
ffffffff8017f8b3 ffff8100286199f8 ffff81002944fa78
Mar 30 14:35:00 blackhole kernel: [26295.049906] ffff81003fdd7db8
ffff81003ffa84c0
Mar 30 14:35:00 blackhole kernel: [26295.049919] Call Trace:
<ffffffff8017f8b3>{shrink_icache_memory+487}
Mar 30 14:35:00 blackhole kernel: [26295.049944]
<ffffffff80150b4b>{shrink_slab+223} <ffffffff80151f19>{balance_pgdat+568}
Mar 30 14:35:00 blackhole kernel: [26295.049982]
<ffffffff80152150>{kswapd+255}
<ffffffff8013aa0c>{autoremove_wake_function+0}
Mar 30 14:35:00 blackhole kernel: [26295.050012]
<ffffffff8010b286>{child_rip+8} <ffffffff80152051>{kswapd+0}
Mar 30 14:35:00 blackhole kernel: [26295.050042]
<ffffffff8010b27e>{child_rip+0}
Mar 30 14:35:00 blackhole kernel: [26295.050061]
Mar 30 14:35:00 blackhole kernel: [26295.050062] Code: 48 89 02 74 04 48
89 50 08 48 c7 43 f0 00 00 00 00 48 c7 43
Mar 30 14:35:00 blackhole kernel: [26295.050303] <6>note: kswapd0[140]
exited with preempt_count 1
-----------end oops------------
-----------begin oops----------
Mar 30 18:19:38 blackhole kernel: [33029.714304] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats freq_table cpufreq_powersave cpufreq_ondemand
cpufreq_conservative lp video thermal processor fan container button
battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc parport pcspkr
psmouse rtc ide_generic snd_seq_dummy snd_seq_oss snd_seq_midi
snd_seq_midi_event snd_seq snd_via82xx gameport snd_ac97_codec
snd_ac97_bus
snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_mpu401_uart
snd_rawmidi snd_seq_device snd soundcore i2c_viapro ehci_hcd uhci_hcd
generic sata_via libata scsi_mod bt878 tuner bttv video_buf firmware_class
compat_ioctl32 i2c_algo_bit v4l2_common btcx_risc ir_common tveeprom
i2c_core videodev sk98lin skge shpchp pci_hotplug aes dm_crypt loop dm_mod
md_mod unix
Mar 30 18:19:38 blackhole kernel: [33029.714467] Pid: 10977, comm: java
Not tainted 2.6.16.1 #4
Mar 30 18:19:38 blackhole kernel: [33029.714478] RIP:
0010:[generic_delete_inode+283/387]
<ffffffff8017fb8b>{generic_delete_inode+283}
Mar 30 18:19:38 blackhole kernel: [33029.714494] RSP:
0018:ffff81003b049ec8 EFLAGS: 00010246
Mar 30 18:19:38 blackhole kernel: [33029.714511] RAX: 0000000000000000
RBX: ffff810027c396d0 RCX: ffff8100016dedf8
Mar 30 18:19:38 blackhole kernel: [33029.714524] RDX: ffff800001f78520
RSI: 0000000000000004 RDI: ffff81002ade5fa8
Mar 30 18:19:38 blackhole kernel: [33029.714538] RBP: ffffffff801c694e
R08: ffff8100016dedf8 R09: 00000000fffffffa
Mar 30 18:19:38 blackhole kernel: [33029.714550] R10: 0000000000000004
R11: 0000000000000004 R12: ffff810009b1f080
Mar 30 18:19:38 blackhole kernel: [33029.714563] R13: ffff81003e2ff000
R14: 0000000000000000 R15: 00002aaaad255a00
Mar 30 18:19:38 blackhole kernel: [33029.714577] FS:
0000000041bdd960(0063) GS:ffffffff803fa000(0000) knlGS:000000007c85abb0
Mar 30 18:19:38 blackhole kernel: [33029.714594] CS: 0010 DS: 0000 ES:
0000 CR0: 0000000080050033
Mar 30 18:19:38 blackhole kernel: [33029.714606] CR2: ffff800001f78520
CR3: 0000000002eda000 CR4: 00000000000006e0
Mar 30 18:19:38 blackhole kernel: [33029.714620] Process java (pid: 10977,
threadinfo ffff81003b048000, task ffff810018582760)
Mar 30 18:19:38 blackhole kernel: [33029.714636] Stack: ffffffff8017fbf3
0000000000000000 ffff810027c396d0 ffffffff80176ba6
Mar 30 18:19:38 blackhole kernel: [33029.714653] ffff81000ed304a8
ffff81003dab4080 00000012b838aae8 ffff81003e2ff000
Mar 30 18:19:38 blackhole kernel: [33029.714675] 0000000000000010
0000000000000000
Mar 30 18:19:38 blackhole kernel: [33029.714686] Call Trace:
<ffffffff8017fbf3>{generic_drop_inode+0}
Mar 30 18:19:38 blackhole kernel: [33029.714704]
<ffffffff80176ba6>{do_unlinkat+213} <ffffffff8010a76e>{system_call+126}
Mar 30 18:19:38 blackhole kernel: [33029.714750]
Mar 30 18:19:38 blackhole kernel: [33029.714751] Code: 48 89 02 74 04 48
89 50 08 48 c7 03 00 00 00 00 48 c7 43 08
Mar 30 18:19:38 blackhole kernel: [33029.714997] <6>note: java[10977]
exited with preempt_count 1
-----------end oops----------
----------------------------------------------------------------------------------------------------
[7.] A small shell script or example program which triggers the
problem (if possible)
How to recreate:
-AMD64
-kernel 2.6.16.1
-java version "1.5.0_06"
-freenet Build 5106 (http://freenet.sourceforge.net/)
Run freenet with this java version in 64 bit mode for a few
hours. I have one oops every 6 hours, more or less.
---------------------------------------------------------------------------------
[8.] Environment
[8.1.] Software (add the output of the ver_linux script here)
./ver_linux
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.
Linux blackhole 2.6.16.1 #4 PREEMPT Thu Mar 30 00:07:11 CEST 2006 x86_64
GNU/Linux
Gnu C 4.0.2
Gnu make 3.80
binutils 2.16.1
util-linux 2.12p
mount 2.12p
module-init-tools 3.2-pre7
e2fsprogs 1.38
jfsutils 1.1.8
reiserfsprogs 3.6.19
reiser4progs 1.0.4
xfsprogs 2.6.28
PPP 2.4.3
Linux C Library 2.3.5
Dynamic linker (ldd) 2.3.5
Procps 3.2.5
Net-tools 1.60
Console-tools 0.2.3
Sh-utils 5.2.1
udev 060
Modules Loaded rfcomm l2cap bluetooth powernow_k8
cpufreq_userspace cpufreq_stats freq_table cpufreq_powersave
cpufreq_ondemand cpufreq_conservative lp video thermal processor fan
container button battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc
parport pcspkr psmouse rtc ide_generic snd_seq_dummy snd_seq_oss
snd_seq_midi snd_seq_midi_event snd_seq snd_via82xx gameport
snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss snd_pcm snd_timer
snd_page_alloc snd_mpu401_uart snd_rawmidi snd_seq_device snd soundcore
i2c_viapro ehci_hcd uhci_hcd generic sata_via libata scsi_mod bt878 tuner
bttv video_buf firmware_class compat_ioctl32 i2c_algo_bit v4l2_common
btcx_risc ir_common tveeprom i2c_core videodev sk98lin skge shpchp
pci_hotplug aes dm_crypt loop dm_mod md_mod unix
[8.2.] Processor information (from /proc/cpuinfo):
$cat /proc/cpuinfo
processor : 0
vendor_id : AuthenticAMD
cpu family : 15
model : 47
model name : AMD Athlon(tm) 64 Processor 3200+
stepping : 2
cpu MHz : 1000.000
cache size : 512 KB
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca
cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt lm
3dnowext 3dnow pni lahf_lm
bogomips : 2007.70
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp tm stc
[8.3.] Module information (from /proc/modules):
cat /proc/modules
rfcomm 38824 0 - Live 0xffffffff882d8000
l2cap 27016 5 rfcomm, Live 0xffffffff882d0000
bluetooth 51620 4 rfcomm,l2cap, Live 0xffffffff882c2000
powernow_k8 10384 0 - Live 0xffffffff882be000
cpufreq_userspace 4884 1 - Live 0xffffffff882bb000
cpufreq_stats 6024 0 - Live 0xffffffff882b8000
freq_table 5256 2 powernow_k8,cpufreq_stats, Live 0xffffffff882b5000
cpufreq_powersave 2432 0 - Live 0xffffffff882b3000
cpufreq_ondemand 7084 0 - Live 0xffffffff882b0000
cpufreq_conservative 7980 0 - Live 0xffffffff882ad000
lp 13056 0 - Live 0xffffffff882a8000
video 17800 0 - Live 0xffffffff882a2000
thermal 15500 0 - Live 0xffffffff8829d000
processor 26456 2 powernow_k8,thermal, Live 0xffffffff88295000
fan 5512 0 - Live 0xffffffff88292000
container 5376 0 - Live 0xffffffff8828f000
button 7968 0 - Live 0xffffffff8828c000
battery 10888 0 - Live 0xffffffff88288000
ac 5896 0 - Live 0xffffffff88285000
ipv6 267680 251 - Live 0xffffffff88242000
mousedev 12928 1 - Live 0xffffffff8823d000
tsdev 8960 0 - Live 0xffffffff88239000
ide_cd 40864 0 - Live 0xffffffff8822e000
cdrom 36792 1 ide_cd, Live 0xffffffff88224000
parport_pc 37488 1 - Live 0xffffffff88219000
parport 40588 2 lp,parport_pc, Live 0xffffffff8820e000
pcspkr 4104 0 - Live 0xffffffff8820b000
psmouse 39564 0 - Live 0xffffffff88200000
rtc 15352 0 - Live 0xffffffff881fb000
ide_generic 1792 0 [permanent], Live 0xffffffff881f6000
snd_seq_dummy 4484 0 - Live 0xffffffff881f8000
snd_seq_oss 32868 0 - Live 0xffffffff881ec000
snd_seq_midi 9536 0 - Live 0xffffffff881e8000
snd_seq_midi_event 8320 2 snd_seq_oss,snd_seq_midi, Live 0xffffffff881e4000
snd_seq 54552 6 snd_seq_dummy,snd_seq_oss,snd_seq_midi,snd_seq_midi_event,
Live 0xffffffff881d5000
snd_via82xx 30120 1 - Live 0xffffffff881cc000
gameport 16784 1 snd_via82xx, Live 0xffffffff881c6000
snd_ac97_codec 102588 1 snd_via82xx, Live 0xffffffff881ab000
snd_ac97_bus 3072 1 snd_ac97_codec, Live 0xffffffff881a9000
snd_pcm_oss 52256 0 - Live 0xffffffff8819b000
snd_mixer_oss 17920 1 snd_pcm_oss, Live 0xffffffff88195000
snd_pcm 95372 3 snd_via82xx,snd_ac97_codec,snd_pcm_oss, Live
0xffffffff8817c000
snd_timer 26120 2 snd_seq,snd_pcm, Live 0xffffffff88174000
snd_page_alloc 11536 2 snd_via82xx,snd_pcm, Live 0xffffffff88170000
snd_mpu401_uart 8576 1 snd_via82xx, Live 0xffffffff8816c000
snd_rawmidi 28064 2 snd_seq_midi,snd_mpu401_uart, Live 0xffffffff88164000
snd_seq_device 9872 5
snd_seq_dummy,snd_seq_oss,snd_seq_midi,snd_seq,snd_rawmidi, Live
0xffffffff88160000
snd 60928 13
snd_seq_oss,snd_seq,snd_via82xx,snd_ac97_codec,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_timer,snd_mpu401_uart,snd_rawmidi,snd_seq_device,
Live 0xffffffff88150000
soundcore 11680 1 snd, Live 0xffffffff8814c000
i2c_viapro 9880 0 - Live 0xffffffff88148000
ehci_hcd 32136 0 - Live 0xffffffff8813f000
uhci_hcd 32544 0 - Live 0xffffffff88136000
generic 5764 0 [permanent], Live 0xffffffff88133000
sata_via 9988 0 - Live 0xffffffff8812f000
libata 61720 1 sata_via, Live 0xffffffff8811e000
scsi_mod 147992 1 libata, Live 0xffffffff880f8000
bt878 12620 0 - Live 0xffffffff880f3000
tuner 52780 0 - Live 0xffffffff880e5000
bttv 194620 1 bt878, Live 0xffffffff880b4000
video_buf 23812 1 bttv, Live 0xffffffff880ad000
firmware_class 11904 1 bttv, Live 0xffffffff880a9000
compat_ioctl32 9088 1 bttv, Live 0xffffffff880a5000
i2c_algo_bit 9608 1 bttv, Live 0xffffffff880a1000
v4l2_common 9984 3 tuner,bttv,compat_ioctl32, Live 0xffffffff8809d000
btcx_risc 5512 1 bttv, Live 0xffffffff8809a000
ir_common 10884 1 bttv, Live 0xffffffff88096000
tveeprom 17040 1 bttv, Live 0xffffffff88090000
i2c_core 23832 5 i2c_viapro,tuner,bttv,i2c_algo_bit,tveeprom, Live
0xffffffff88089000
videodev 12032 1 bttv, Live 0xffffffff88085000
sk98lin 146016 0 - Live 0xffffffff88060000
skge 39056 0 - Live 0xffffffff88055000
shpchp 45440 0 - Live 0xffffffff88048000
pci_hotplug 29672 1 shpchp, Live 0xffffffff8803f000
aes 27304 2 - Live 0xffffffff88037000
dm_crypt 12560 1 - Live 0xffffffff88032000
loop 16656 2 - Live 0xffffffff8802c000
dm_mod 55144 3 dm_crypt, Live 0xffffffff8801d000
md_mod 76056 0 - Live 0xffffffff88009000
unix 31160 657 - Live 0xffffffff88000000
[8.4.] Loaded driver and hardware information (/proc/ioports, /proc/iomem)
I don't think it is relevant, will post if asked
[8.5.] PCI information ('lspci -vvv' as root)
I don't think it is relevant, will post if asked
[8.6.] SCSI information (from /proc/scsi/scsi)
I don't think it is relevant, will post if asked
[8.7.] Other information that might be relevant to the problem
(please look in /proc and include all information that you
think to be relevant):
[X.] Other notes, patches, fixes, workarounds:
Will post if I find a way to make the oops go away.
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/