[vm] writing to UDF DVD+RW (/dev/sr0) while under memory pressure:box ==> doorstop
From: Mike Galbraith
Date: Fri Jan 04 2008 - 06:47:19 EST
Greetings,
I discovered that I can easily turn my P4/HT 2.6.24.git box into a
doorstop by simply copying a checked-out [~500MB] git repository to a
DVD+RW. This isn't a 2.6.24.git regression, the stock openSuSE 10.3
kernel (2.6.22) does the same. A modest write with no memory pressure
works fine, but add pressure, and box chokes to death every time.
recipe:
dvd+rw-format
mkudffs
mount
/dev/sr0 on /media/LinuxUDF type udf (rw,nosuid,nodev,noatime,uid=0)
cp -av linux-2.6 /media/LinuxUDF/.
Give cp a good head start, and then start a couple parallel kbuilds.
After a while, box slogs to a halt, or perhaps it's just a very VERY
slow crawl. Box is not oom, but it may as well be.
Snippet of serial console output while box is impersonating doorstop:
(264k boot->SysRq-B log available, config.gz attached)
Anybody unfortunate enough to enter shrink_slab() reclaim path (Xorg
did below) ends up sleeping on iprune_mutex, if not forever, for long
enough that I give up and forcibly reboot. I've waited for up to an
hour to see if it would eventually recover, but it never has before I
became impatient. The iprune_mutex appears to be held my kswapd, which
is asleep after having also gone down the shrink_slab() reclaim path.
homer:/root # vmstat 1
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
0 4 44 8196 70276 609588 0 0 205 229 38 862 70 10 7 13
0 4 44 8196 70276 609588 0 0 0 0 14 37 0 0 32 68
0 4 44 8196 70276 609588 0 0 0 0 7 35 0 0 51 49
0 4 44 8200 70276 609588 0 0 0 0 5 37 0 0 50 50
0 4 44 8200 70276 609588 0 0 0 0 6 41 0 0 35 65
0 4 44 8200 70276 609588 0 0 0 0 6 35 0 0 48 52
0 4 44 8200 70276 609588 0 0 0 0 5 36 0 0 50 50
0 4 44 8200 70276 609588 0 0 0 0 6 33 0 0 52 48
0 4 44 8200 70276 609588 0 0 0 0 5 41 0 0 50 50
0 4 44 8200 70276 609588 0 0 0 0 5 33 0 0 48 52
homer:/root # [ 2188.489078] SysRq : Show Blocked State
[ 2188.492870] task PC stack pid father
[ 2188.498113] pdflush D ef863d7c 0 155 2
[ 2188.503400] ef863d90 00000046 00000002 ef863d7c ef863d74 00000000 00000000 00000960
[ 2188.511783] 00000000 b0406240 b0408f80 ef898e70 ef8990a0 b180bf80 ef863000 00000000
[ 2188.520305] ee2cf5d0 ef86a908 0019c2c6 b01dd062 b014214d 00000000 00000003 00000000
[ 2188.527995] Call Trace:
[ 2188.531469] [<b01dd062>] generic_unplug_device+0x15/0x21
[ 2188.534022] [<b014214d>] getnstimeofday+0x2f/0xd7
[ 2188.539493] [<b02e2689>] io_schedule+0x4f/0x89
[ 2188.539505] [<b01a252d>] sync_buffer+0x30/0x34
[ 2188.539511] [<b02e28a8>] __wait_on_bit+0x42/0x5e
[ 2188.539515] [<b01a24fd>] sync_buffer+0x0/0x34
[ 2188.539525] [<b02e292b>] out_of_line_wait_on_bit+0x67/0x6f
[ 2188.539533] [<b01a24fd>] sync_buffer+0x0/0x34
[ 2188.539543] [<b013ccbd>] wake_bit_function+0x0/0x3c
[ 2188.539558] [<b01a24c4>] __wait_on_buffer+0x24/0x29
[ 2188.539565] [<b01a3ed5>] __bread+0x55/0x8a
[ 2188.539572] [<f0d70e53>] udf_tread+0x3c/0x41 [udf]
[ 2188.539585] [<f0d66add>] udf_update_inode+0x43/0xb8d [udf]
[ 2188.539597] [<b01692fd>] pagevec_lookup_tag+0x24/0x2c
[ 2188.539612] [<b01676bc>] __writepage+0x0/0x25
[ 2188.539661] [<f0d68ca4>] udf_write_inode+0x14/0x20 [udf]
[ 2188.539671] [<b019d9cc>] __writeback_single_inode+0x228/0x306
[ 2188.539689] [<b015fd15>] delayacct_end+0x71/0x79
[ 2188.539699] [<b01e6795>] _atomic_dec_and_lock+0x31/0x5c
[ 2188.539713] [<b019de52>] sync_sb_inodes+0x1c3/0x295
[ 2188.539730] [<b019e100>] writeback_inodes+0x7d/0xac
[ 2188.539739] [<b01685df>] background_writeout+0x98/0xb7
[ 2188.539765] [<b0168abc>] pdflush+0x0/0x1d4
[ 2188.539770] [<b0168bc3>] pdflush+0x107/0x1d4
[ 2188.539777] [<b0168547>] background_writeout+0x0/0xb7
[ 2188.539789] [<b013ca06>] kthread+0x34/0x56
[ 2188.539793] [<b013c9d2>] kthread+0x0/0x56
[ 2188.539800] [<b0104d8b>] kernel_thread_helper+0x7/0x1c
[ 2188.539814] =======================
[ 2188.539818] pdflush D b1811b40 0 156 2
[ 2188.539822] ef864ef4 00000046 00000818 b1811b40 00000002 ef864edc 00000001 db6b063e
[ 2188.539829] 0000019a b0406240 b0408f80 ef8987d0 ef898a00 b1814f80 ef864000 00000202
[ 2188.539836] ef84e000 ee1f7588 b0133013 00000002 00000000 ef864f04 00000202 b013312e
[ 2188.539843] Call Trace:
[ 2188.539870] [<b0133013>] lock_timer_base+0x19/0x35
[ 2188.539881] [<b013312e>] __mod_timer+0x9d/0xac
[ 2188.539894] [<b02e2717>] schedule_timeout+0x44/0xa1
[ 2188.539906] [<b0132cb1>] process_timeout+0x0/0x5
[ 2188.539913] [<b02e2712>] schedule_timeout+0x3f/0xa1
[ 2188.539927] [<b02e255a>] io_schedule_timeout+0x54/0x93
[ 2188.539938] [<b016d3af>] congestion_wait+0x4d/0x61
[ 2188.539946] [<b013cc88>] autoremove_wake_function+0x0/0x35
[ 2188.539958] [<b01686c4>] wb_kupdate+0x9c/0xe2
[ 2188.539980] [<b0168abc>] pdflush+0x0/0x1d4
[ 2188.539984] [<b0168bc3>] pdflush+0x107/0x1d4
[ 2188.539990] [<b0168628>] wb_kupdate+0x0/0xe2
[ 2188.540001] [<b013ca06>] kthread+0x34/0x56
[ 2188.540005] [<b013c9d2>] kthread+0x0/0x56
[ 2188.540012] [<b0104d8b>] kernel_thread_helper+0x7/0x1c
[ 2188.540025] =======================
[ 2188.540027] kswapd0 D 00000004 0 157 2
[ 2188.540031] ef8aacd4 00000046 d8fdb0e8 00000004 00000000 ee2cf5d0 00000000 dec5cace
[ 2188.540037] 00000197 b0406240 b0408f80 ef89b550 ef89b780 b180bf80 ef8aa000 00000000
[ 2188.540044] ee2cf5d0 ee310208 ee2cf5d0 00000000 00000000 ef814914 0039768c 01403000
[ 2188.540051] Call Trace:
[ 2188.540094] [<b02e2689>] io_schedule+0x4f/0x89
[ 2188.540103] [<b01a252d>] sync_buffer+0x30/0x34
[ 2188.540107] [<b02e28a8>] __wait_on_bit+0x42/0x5e
[ 2188.540111] [<b01a24fd>] sync_buffer+0x0/0x34
[ 2188.540120] [<b02e292b>] out_of_line_wait_on_bit+0x67/0x6f
[ 2188.540128] [<b01a24fd>] sync_buffer+0x0/0x34
[ 2188.540138] [<b013ccbd>] wake_bit_function+0x0/0x3c
[ 2188.540150] [<b01a24c4>] __wait_on_buffer+0x24/0x29
[ 2188.540158] [<b01a348a>] sync_dirty_buffer+0x7e/0xc4
[ 2188.540171] [<f0d67400>] udf_update_inode+0x966/0xb8d [udf]
[ 2188.540223] [<f0d6fafc>] extent_trunc+0xac/0x16e [udf]
[ 2188.540244] [<f0d68ca4>] udf_write_inode+0x14/0x20 [udf]
[ 2188.540253] [<b019d9cc>] __writeback_single_inode+0x228/0x306
[ 2188.540284] [<b019db3a>] write_inode_now+0x66/0xb3
[ 2188.540310] [<f0d691f3>] udf_clear_inode+0x33/0x47 [udf]
[ 2188.540318] [<b019549a>] clear_inode+0x62/0x136
[ 2188.540327] [<b0195a79>] dispose_list+0x1a/0xd6
[ 2188.540337] [<b0195caf>] shrink_icache_memory+0x17a/0x233
[ 2188.540352] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.540375] [<b016bcaa>] kswapd+0x314/0x4a6
[ 2188.540411] [<b013cc88>] autoremove_wake_function+0x0/0x35
[ 2188.540422] [<b012099a>] complete+0x3a/0x4a
[ 2188.540433] [<b016b996>] kswapd+0x0/0x4a6
[ 2188.540438] [<b013ca06>] kthread+0x34/0x56
[ 2188.540442] [<b013c9d2>] kthread+0x0/0x56
[ 2188.540449] [<b0104d8b>] kernel_thread_helper+0x7/0x1c
[ 2188.540463] =======================
[ 2188.540485] hald-addon-st D ede4bb5c 0 2308 2202
[ 2188.540489] ede4bb70 00000082 00000002 ede4bb5c ede4bb54 00000000 00000000 ee2cf5d0
[ 2188.540496] ee2cf5d0 b0406240 b0408f80 ee3204b0 ee3206e0 b180bf80 ede4b000 e82600b0
[ 2188.540503] 00000001 ef86a908 0019c2c6 00000002 ef3c3ec8 00000000 00000003 00000000
[ 2188.540509] Call Trace:
[ 2188.540553] [<b02e273c>] schedule_timeout+0x69/0xa1
[ 2188.540560] [<b01d8e70>] elv_drain_elevator+0x15/0x5d
[ 2188.540570] [<b01d9912>] elv_insert+0x107/0x220
[ 2188.540574] [<b01dd0ad>] blk_plug_device+0x3f/0xb1
[ 2188.540590] [<b02e1b97>] wait_for_common+0x6a/0x101
[ 2188.540599] [<b01228e7>] default_wake_function+0x0/0xc
[ 2188.540612] [<b01dcda1>] blk_execute_rq+0x72/0xb3
[ 2188.540618] [<b01dbbb9>] blk_end_sync_rq+0x0/0x23
[ 2188.540635] [<b01a53b2>] bio_add_pc_page+0x23/0x28
[ 2188.540650] [<b01dbd5f>] blk_rq_bio_prep+0x9a/0xae
[ 2188.540658] [<b01dc01b>] blk_rq_append_bio+0x14/0x44
[ 2188.540666] [<b01dc1c4>] blk_rq_map_user+0x11d/0x199
[ 2188.540684] [<b01e03ec>] sg_io+0x196/0x2f3
[ 2188.540737] [<b01e081e>] scsi_cmd_ioctl+0x2d5/0x417
[ 2188.540754] [<f084be00>] scsi_test_unit_ready+0x56/0x95 [scsi_mod]
[ 2188.540819] [<f0aab3a8>] cdrom_ioctl+0x2b/0xdca [cdrom]
[ 2188.540832] [<b018c1c8>] __link_path_walk+0x9eb/0xd0f
[ 2188.540841] [<b017ed94>] cache_free_debugcheck+0xf8/0x240
[ 2188.540852] [<f0aa8074>] media_changed+0x47/0x7e [cdrom]
[ 2188.540868] [<f0ac1068>] sr_block_ioctl+0x47/0x7f [sr_mod]
[ 2188.540886] [<b01de50f>] blkdev_driver_ioctl+0x55/0x5e
[ 2188.540898] [<b01de72f>] blkdev_ioctl+0x217/0x7c8
[ 2188.540913] [<b0181ae1>] get_unused_fd_flags+0xb5/0xce
[ 2188.540925] [<b01e7502>] kobject_get+0xf/0x13
[ 2188.540932] [<b01df0fd>] get_disk+0x1b/0x80
[ 2188.540940] [<b01df169>] exact_lock+0x7/0xd
[ 2188.540944] [<b0252fff>] kobj_lookup+0x157/0x172
[ 2188.540952] [<b01e7502>] kobject_get+0xf/0x13
[ 2188.540964] [<f0ac03a1>] sr_block_open+0x70/0x81 [sr_mod]
[ 2188.540975] [<b01a68e4>] do_open+0xb5/0x28b
[ 2188.540992] [<b01a6c84>] blkdev_open+0x25/0x53
[ 2188.541002] [<b0181c80>] __dentry_open+0x17f/0x1d9
[ 2188.541014] [<b0181d67>] nameidata_to_filp+0x31/0x3a
[ 2188.541020] [<b01a6c5f>] blkdev_open+0x0/0x53
[ 2188.541024] [<b017eadc>] poison_obj+0x1c/0x33
[ 2188.541027] [<b0181da9>] do_filp_open+0x39/0x40
[ 2188.541038] [<b017ed94>] cache_free_debugcheck+0xf8/0x240
[ 2188.541054] [<b01a60c4>] block_ioctl+0x18/0x1d
[ 2188.541060] [<b01a60ac>] block_ioctl+0x0/0x1d
[ 2188.541064] [<b018e68f>] do_ioctl+0x1f/0x6d
[ 2188.541075] [<b018e8e0>] vfs_ioctl+0x203/0x27f
[ 2188.541081] [<b0181e5b>] do_sys_open+0xab/0xc0
[ 2188.541091] [<b018e9b2>] sys_ioctl+0x56/0x68
[ 2188.541101] [<b010413a>] sysenter_past_esp+0x5f/0x85
[ 2188.541118] [<b02e0000>] netlbl_cipsov4_genl_init+0x40/0x57
[ 2188.541135] =======================
[ 2188.541137] Xorg D ede7bd38 0 2340 2318
[ 2188.541141] ede7bd4c 00203082 00000002 ede7bd38 ede7bd30 00000000 00000001 ede7bd94
[ 2188.541147] 00000020 b0406240 b0408f80 ee26e9d0 ee26ec00 b1814f80 ede7b000 b016998a
[ 2188.541154] 00000020 edee0ac8 001a5d24 00000000 00000000 00000000 00000003 00000000
[ 2188.541161] Call Trace:
[ 2188.541184] [<b016998a>] __pagevec_release+0x15/0x1d
[ 2188.541208] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.541222] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.541226] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.541233] [<f083a45c>] mb_cache_shrink_fn+0xde/0xe0 [mbcache]
[ 2188.541250] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.541273] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.541304] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.541331] [<b017c382>] shmem_getpage+0x144/0x68b
[ 2188.541351] [<b0143084>] clocksource_get_next+0x3a/0x40
[ 2188.541355] [<b0141be1>] update_wall_time+0x3f0/0x865
[ 2188.541367] [<b017c9a3>] shmem_fault+0x68/0x97
[ 2188.541382] [<b01cc2fc>] shm_fault+0xc/0xd
[ 2188.541387] [<b016e4ba>] __do_fault+0x55/0x376
[ 2188.541415] [<b01cc2f0>] shm_fault+0x0/0xd
[ 2188.541419] [<b016fb79>] handle_mm_fault+0x11d/0x634
[ 2188.541449] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.541470] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.541478] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.541483] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.541500] [<b02e0000>] netlbl_cipsov4_genl_init+0x40/0x57
[ 2188.541516] =======================
[ 2188.541538] vmstat D e0b1bdec 0 4690 3811
[ 2188.541542] e0b1be00 00200082 00000002 e0b1bdec e0b1bde4 00000000 00000001 ee2291a0
[ 2188.541549] b01bb098 b0406240 b0408f80 ee19c2b0 ee19c4e0 b1814f80 e0b1b000 00000001
[ 2188.541555] 00000004 e0836908 001af82e 00000000 00005c5e 00000000 00000003 00000000
[ 2188.541562] Call Trace:
[ 2188.541576] [<b01bb098>] show_stat+0x791/0x87f
[ 2188.541609] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.541624] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.541628] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.541631] [<b0192fcb>] prune_dcache+0x145/0x189
[ 2188.541647] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.541669] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.541701] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.541728] [<b0167016>] __get_free_pages+0x39/0x47
[ 2188.541734] [<b01b8783>] proc_file_read+0x6d/0x27c
[ 2188.541755] [<b01b8716>] proc_file_read+0x0/0x27c
[ 2188.541761] [<b01b47f6>] proc_reg_read+0x58/0x79
[ 2188.541775] [<b01b479e>] proc_reg_read+0x0/0x79
[ 2188.541781] [<b0183bc6>] vfs_read+0xa1/0x147
[ 2188.541788] [<b0182ea1>] vfs_llseek+0x36/0x3c
[ 2188.541798] [<b018403c>] sys_read+0x41/0x6a
[ 2188.541810] [<b010413a>] sysenter_past_esp+0x5f/0x85
[ 2188.541839] =======================
[ 2188.541841] cp D 00000004 0 4911 3894
[ 2188.541844] e0b38b14 00200082 0000024e 00000004 00000000 ee2cf5d0 00000000 96ccdff3
[ 2188.541851] 00000199 b0406240 b0408f80 e0845710 e0845940 b180bf80 e0b38000 00000000
[ 2188.541858] ee2cf5d0 e09c5208 ee2cf5d0 00000002 00000000 edeb8914 0039f4ce 01403000
[ 2188.541865] Call Trace:
[ 2188.541909] [<b02e2689>] io_schedule+0x4f/0x89
[ 2188.541918] [<b01a252d>] sync_buffer+0x30/0x34
[ 2188.541921] [<b02e28a8>] __wait_on_bit+0x42/0x5e
[ 2188.541925] [<b01a24fd>] sync_buffer+0x0/0x34
[ 2188.541935] [<b02e292b>] out_of_line_wait_on_bit+0x67/0x6f
[ 2188.541943] [<b01a24fd>] sync_buffer+0x0/0x34
[ 2188.541953] [<b013ccbd>] wake_bit_function+0x0/0x3c
[ 2188.541966] [<b01a24c4>] __wait_on_buffer+0x24/0x29
[ 2188.541974] [<b01a3ed5>] __bread+0x55/0x8a
[ 2188.541981] [<f0d70e53>] udf_tread+0x3c/0x41 [udf]
[ 2188.541991] [<f0d66add>] udf_update_inode+0x43/0xb8d [udf]
[ 2188.542003] [<b01692fd>] pagevec_lookup_tag+0x24/0x2c
[ 2188.542017] [<b01676bc>] __writepage+0x0/0x25
[ 2188.542050] [<b017e56a>] dbg_redzone1+0xe/0x19
[ 2188.542056] [<b017eb68>] cache_alloc_debugcheck_after+0x75/0x1a9
[ 2188.542073] [<f0d68ca4>] udf_write_inode+0x14/0x20 [udf]
[ 2188.542083] [<b019d9cc>] __writeback_single_inode+0x228/0x306
[ 2188.542106] [<b01e6795>] _atomic_dec_and_lock+0x31/0x5c
[ 2188.542118] [<b019de52>] sync_sb_inodes+0x1c3/0x295
[ 2188.542135] [<b019e100>] writeback_inodes+0x7d/0xac
[ 2188.542143] [<b01682fd>] balance_dirty_pages_ratelimited_nr+0x21f/0x33c
[ 2188.542188] [<b0162c9f>] generic_file_buffered_write+0x1c7/0x65f
[ 2188.542217] [<b013ff2d>] ktime_get_ts+0x16/0x44
[ 2188.542226] [<b015fd15>] delayacct_end+0x71/0x79
[ 2188.542250] [<b01633e4>] __generic_file_aio_write_nolock+0x2ad/0x50d
[ 2188.542266] [<b0161859>] file_read_actor+0xcf/0xd9
[ 2188.542289] [<b016178a>] file_read_actor+0x0/0xd9
[ 2188.542303] [<b01636a9>] generic_file_aio_write+0x65/0xd3
[ 2188.542311] [<b012e8e7>] current_fs_time+0x13/0x15
[ 2188.542328] [<f0d6442c>] udf_file_aio_write+0x4e/0xfc [udf]
[ 2188.542348] [<b018323f>] do_sync_write+0xd2/0x10e
[ 2188.542377] [<b013cc88>] autoremove_wake_function+0x0/0x35
[ 2188.542396] [<b0145517>] tick_program_event+0x38/0x58
[ 2188.542417] [<b018316d>] do_sync_write+0x0/0x10e
[ 2188.542423] [<b0183a7f>] vfs_write+0xa4/0x14a
[ 2188.542436] [<b01840a6>] sys_write+0x41/0x6a
[ 2188.542448] [<b010413a>] sysenter_past_esp+0x5f/0x85
[ 2188.542478] =======================
[ 2188.542483] cc1 D b1808b40 0 14511 14510
[ 2188.542486] d6f87e04 00200082 00000400 b1808b40 00000002 d6f87dec 00000000 93edb8a2
[ 2188.542493] 00000198 b0406240 b0408f80 d70ac3f0 d70ac620 b180bf80 d6f87000 00000000
[ 2188.542500] 00000020 ee3103c8 001902d9 b8accb99 ffffffff 00000001 00000003 00000000
[ 2188.542506] Call Trace:
[ 2188.542551] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.542566] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.542570] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.542586] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.542609] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.542640] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.542667] [<b016fc89>] handle_mm_fault+0x22d/0x634
[ 2188.542678] [<b0104c08>] apic_timer_interrupt+0x28/0x30
[ 2188.542701] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.542723] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.542730] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.542736] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.542752] [<b02e0000>] netlbl_cipsov4_genl_init+0x40/0x57
[ 2188.542768] =======================
[ 2188.542771] cc1 D b03ac500 0 14878 14876
[ 2188.542775] cc474e04 00200086 b11d35a0 b03ac500 b016a58c 00000001 00000001 2eedb85d
[ 2188.542782] 00000198 b0406240 b0408f80 e0845070 e08452a0 b1814f80 cc474000 00000000
[ 2188.542789] 00000020 e35ca048 cc474e54 00000000 00000000 b0406560 b0406560 b03ac880
[ 2188.542795] Call Trace:
[ 2188.542803] [<b016a58c>] isolate_lru_pages+0x5f/0x1bb
[ 2188.542842] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.542857] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.542861] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.542865] [<b0192fcb>] prune_dcache+0x145/0x189
[ 2188.542879] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.542903] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.542934] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.542961] [<b016fc89>] handle_mm_fault+0x22d/0x634
[ 2188.542991] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.543013] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.543020] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.543026] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.543042] [<b02e0000>] netlbl_cipsov4_genl_init+0x40/0x57
[ 2188.543058] =======================
[ 2188.543061] cc1 D b03ac080 0 14953 14952
[ 2188.543064] e3480e04 00200086 b100a340 b03ac080 b016a58c 00000001 00000001 2f20bdcf
[ 2188.543071] 00000198 b0406240 b0408f80 e0880950 e0880b80 b1814f80 e3480000 00000000
[ 2188.543078] b03ac080 c65f6588 e3480e54 00000000 00000000 b0406560 b0406560 b03ac400
[ 2188.543085] Call Trace:
[ 2188.543093] [<b016a58c>] isolate_lru_pages+0x5f/0x1bb
[ 2188.543133] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.543147] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.543151] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.543155] [<b0192f7b>] prune_dcache+0xf5/0x189
[ 2188.543170] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.543192] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.543223] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.543250] [<b016fc89>] handle_mm_fault+0x22d/0x634
[ 2188.543281] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.543302] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.543310] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.543315] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.543344] =======================
[ 2188.543346] cc1 D d717de4c 0 15009 15008
[ 2188.543350] d717de04 00200082 b12d9720 d717de4c 00000001 00000001 00000000 ebc981b4
[ 2188.543357] 00000197 b0406240 b0408f80 cc6de2f0 cc6de520 b180bf80 d717d000 00000000
[ 2188.543364] 00000001 ee310208 d717de44 00000000 00000000 b03ac400 00000017 d717dea8
[ 2188.543370] Call Trace:
[ 2188.543414] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.543429] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.543433] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.543436] [<b0192fcb>] prune_dcache+0x145/0x189
[ 2188.543451] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.543473] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.543504] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.543530] [<b016fc89>] handle_mm_fault+0x22d/0x634
[ 2188.543561] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.543581] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.543589] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.543594] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.543611] [<b02e0000>] netlbl_cipsov4_genl_init+0x40/0x57
[ 2188.543627] =======================
[ 2188.543630] cc1 D e371adf0 0 15093 15092
[ 2188.543633] e371ae04 00200086 00000002 e371adf0 e371ade8 00000000 00000001 e371ae4c
[ 2188.543640] 00000020 b0406240 b0408f80 eded50b0 eded52e0 b1814f80 e371a000 b016998a
[ 2188.543647] 00000020 c65f6748 0019034d 00000000 00000000 00000000 00000003 00000000
[ 2188.543653] Call Trace:
[ 2188.543677] [<b016998a>] __pagevec_release+0x15/0x1d
[ 2188.543701] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.543716] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.543720] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.543724] [<b0192f7b>] prune_dcache+0xf5/0x189
[ 2188.543738] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.543761] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.543792] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.543819] [<b016fc89>] handle_mm_fault+0x22d/0x634
[ 2188.543849] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.543870] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.543877] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.543883] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.543899] [<b02e0000>] netlbl_cipsov4_genl_init+0x40/0x57
[ 2188.543915] =======================
[ 2188.543918] cc1 D d6d33df0 0 15147 15146
[ 2188.543921] d6d33e04 00200086 00000002 d6d33df0 d6d33de8 00000000 00000000 b013ff2d
[ 2188.543928] 03312780 b0406240 b0408f80 cc7dcfb0 cc7dd1e0 b180bf80 d6d33000 db730a00
[ 2188.543935] 000001c3 d7015588 001908bd 000001c3 b18093a0 00000000 00000003 00000000
[ 2188.543941] Call Trace:
[ 2188.543953] [<b013ff2d>] ktime_get_ts+0x16/0x44
[ 2188.543987] [<b02e2abe>] __mutex_lock_slowpath+0x57/0x90
[ 2188.544002] [<b02e293d>] mutex_lock+0xa/0xb
[ 2188.544006] [<b0195b8d>] shrink_icache_memory+0x58/0x233
[ 2188.544010] [<b0192f7b>] prune_dcache+0xf5/0x189
[ 2188.544024] [<b016b8c3>] shrink_slab+0x12e/0x197
[ 2188.544046] [<b016c2b7>] try_to_free_pages+0x182/0x267
[ 2188.544077] [<b0166dd9>] __alloc_pages+0x146/0x34a
[ 2188.544104] [<b016fc89>] handle_mm_fault+0x22d/0x634
[ 2188.544134] [<b011ca6c>] do_page_fault+0xd0/0x5d4
[ 2188.544155] [<b0117f47>] smp_apic_timer_interrupt+0x59/0x84
[ 2188.544162] [<b011c99c>] do_page_fault+0x0/0x5d4
[ 2188.544168] [<b02e3d9a>] error_code+0x72/0x78
[ 2188.544197] =======================
Attachment:
config.gz
Description: GNU Zip compressed data