Skip to content

Instantly share code, notes, and snippets.

@jbergstroem
Created April 29, 2016 23:16
Show Gist options
  • Save jbergstroem/787473898a2758071e0bf12c8b05271e to your computer and use it in GitHub Desktop.
Save jbergstroem/787473898a2758071e0bf12c8b05271e to your computer and use it in GitHub Desktop.
[4328033.992514] init: systemd-logind main process (559) killed by TERM signal
[4328035.923692] systemd-udevd[17805]: starting version 204
[5380731.308659] end_request: I/O error, dev xvda, sector 10624280
[5380731.308679] EXT4-fs warning (device xvda2): ext4_end_bio:317: I/O error -5 writing to inode 677876 (offset 0 size 0 starting block 1328036)
[5380731.308685] Buffer I/O error on device xvda2, logical block 1265571
[5380731.308731] JBD2: Detected IO errors while flushing file data on xvda2-8
[5380779.308708] end_request: I/O error, dev xvda, sector 26397440
[5380779.309028] Aborting journal on device xvda2-8.
[5380779.309069] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309090] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309101] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309111] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309121] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309131] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309141] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309151] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309161] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380779.309172] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5380800.284102] INFO: task cdm:23597 blocked for more than 120 seconds.
[5380800.284117] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284120] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284124] cdm D 0000000000000000 0 23597 22860 0x00000000
[5380800.284129] ffff8803e3cffaf8 0000000000000286 ffff8803e396e000 ffff8803e3cfffd8
[5380800.284132] 0000000000013180 0000000000013180 ffff8803e396e000 ffff8803fda93a18
[5380800.284134] ffff8803fdfe3508 0000000000000002 ffffffff811effc0 ffff8803e3cffb70
[5380800.284136] Call Trace:
[5380800.284150] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380800.284155] [<ffffffff81729f0d>] io_schedule+0x9d/0x140
[5380800.284157] [<ffffffff811effce>] sleep_on_buffer+0xe/0x20
[5380800.284159] [<ffffffff8172a392>] __wait_on_bit+0x62/0x90
[5380800.284161] [<ffffffff811f18cd>] ? __getblk+0x2d/0x2e0
[5380800.284164] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380800.284166] [<ffffffff8172a437>] out_of_line_wait_on_bit+0x77/0x90
[5380800.284170] [<ffffffff810ab520>] ? autoremove_wake_function+0x40/0x40
[5380800.284172] [<ffffffff811f12fa>] __wait_on_buffer+0x2a/0x30
[5380800.284177] [<ffffffff8124c7b6>] ext4_find_entry+0x116/0x4e0
[5380800.284181] [<ffffffff811d7052>] ? __d_alloc+0x122/0x180
[5380800.284183] [<ffffffff8124cbc2>] ext4_lookup+0x42/0x150
[5380800.284187] [<ffffffff811c836d>] lookup_real+0x1d/0x50
[5380800.284189] [<ffffffff811c8cd3>] __lookup_hash+0x33/0x40
[5380800.284193] [<ffffffff817222af>] lookup_slow+0x42/0xa7
[5380800.284196] [<ffffffff811cd6b9>] path_lookupat+0x749/0x790
[5380800.284199] [<ffffffff811a35f5>] ? kmem_cache_alloc+0x35/0x1e0
[5380800.284201] [<ffffffff811ce5ff>] ? getname_flags+0x4f/0x190
[5380800.284204] [<ffffffff811cd72b>] filename_lookup+0x2b/0xc0
[5380800.284206] [<ffffffff811cf2d4>] user_path_at_empty+0x54/0x90
[5380800.284210] [<ffffffff813154cf>] ? apparmor_cred_prepare+0x2f/0x50
[5380800.284212] [<ffffffff811cf321>] user_path_at+0x11/0x20
[5380800.284216] [<ffffffff811bcd02>] SyS_access+0xa2/0x1f0
[5380800.284220] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380800.284233] INFO: task sshd:30394 blocked for more than 120 seconds.
[5380800.284238] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284241] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284245] sshd D 0000000000000000 0 30394 941 0x00000004
[5380800.284247] ffff8802a6f3fa18 0000000000000286 ffff880110d29800 ffff8802a6f3ffd8
[5380800.284249] 0000000000013180 0000000000013180 ffff880110d29800 ffff8803fda93a18
[5380800.284251] ffff8803fdfdbc90 ffff8802a6f3faa0 0000000000000002 ffffffff811effc0
[5380800.284253] Call Trace:
[5380800.284256] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380800.284258] [<ffffffff81729f0d>] io_schedule+0x9d/0x140
[5380800.284260] [<ffffffff811effce>] sleep_on_buffer+0xe/0x20
[5380800.284262] [<ffffffff8172a498>] __wait_on_bit_lock+0x48/0xb0
[5380800.284265] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380800.284267] [<ffffffff8172a577>] out_of_line_wait_on_bit_lock+0x77/0x90
[5380800.284269] [<ffffffff810ab520>] ? autoremove_wake_function+0x40/0x40
[5380800.284271] [<ffffffff811f146a>] __lock_buffer+0x2a/0x30
[5380800.284276] [<ffffffff81289c90>] do_get_write_access+0x250/0x4d0
[5380800.284278] [<ffffffff811f18cd>] ? __getblk+0x2d/0x2e0
[5380800.284281] [<ffffffff81289f37>] jbd2_journal_get_write_access+0x27/0x40
[5380800.284286] [<ffffffff8126fa0b>] __ext4_journal_get_write_access+0x3b/0x80
[5380800.284290] [<ffffffff81244b90>] ext4_reserve_inode_write+0x70/0xa0
[5380800.284292] [<ffffffff81247e80>] ? ext4_dirty_inode+0x40/0x60
[5380800.284294] [<ffffffff81244c04>] ext4_mark_inode_dirty+0x44/0x1f0
[5380800.284296] [<ffffffff81247e80>] ext4_dirty_inode+0x40/0x60
[5380800.284299] [<ffffffff811e84da>] __mark_inode_dirty+0x10a/0x2d0
[5380800.284302] [<ffffffff811d9431>] update_time+0x81/0xd0
[5380800.284304] [<ffffffff811d9640>] file_update_time+0x80/0xd0
[5380800.284308] [<ffffffff81151170>] __generic_file_aio_write+0x180/0x3d0
[5380800.284310] [<ffffffff81151418>] generic_file_aio_write+0x58/0xa0
[5380800.284312] [<ffffffff8123c612>] ext4_file_write+0xa2/0x3f0
[5380800.284316] [<ffffffff810f4712>] ? from_kgid_munged+0x12/0x20
[5380800.284318] [<ffffffff811c381d>] ? cp_new_stat+0x13d/0x160
[5380800.284321] [<ffffffff811bdeaa>] do_sync_write+0x5a/0x90
[5380800.284324] [<ffffffff811be634>] vfs_write+0xb4/0x1f0
[5380800.284326] [<ffffffff811bf069>] SyS_write+0x49/0xa0
[5380800.284328] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380800.284330] INFO: task xe-update-guest:30396 blocked for more than 120 seconds.
[5380800.284335] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284338] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284342] xe-update-guest D 0000000000000000 0 30396 581 0x00000000
[5380800.284344] ffff88027f7899c8 0000000000000286 ffff8801e09fb000 ffff88027f789fd8
[5380800.284346] 0000000000013180 0000000000013180 ffff8801e09fb000 ffff8803fda13a18
[5380800.284348] ffff8803fdfd7490 ffff88027f789a50 0000000000000002 ffffffff811effc0
[5380800.284350] Call Trace:
[5380800.284353] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380800.284355] [<ffffffff81729f0d>] io_schedule+0x9d/0x140
[5380800.284357] [<ffffffff811effce>] sleep_on_buffer+0xe/0x20
[5380800.284359] [<ffffffff8172a498>] __wait_on_bit_lock+0x48/0xb0
[5380800.284361] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380800.284363] [<ffffffff8172a577>] out_of_line_wait_on_bit_lock+0x77/0x90
[5380800.284365] [<ffffffff810ab520>] ? autoremove_wake_function+0x40/0x40
[5380800.284368] [<ffffffff811f146a>] __lock_buffer+0x2a/0x30
[5380800.284370] [<ffffffff81289c90>] do_get_write_access+0x250/0x4d0
[5380800.284373] [<ffffffff81289f37>] jbd2_journal_get_write_access+0x27/0x40
[5380800.284375] [<ffffffff8126fa0b>] __ext4_journal_get_write_access+0x3b/0x80
[5380800.284378] [<ffffffff81288ae3>] ? jbd2__journal_start+0xf3/0x1e0
[5380800.284380] [<ffffffff8124ecc6>] ext4_orphan_add+0xc6/0x1f0
[5380800.284382] [<ffffffff8126f6f9>] ? __ext4_journal_start_sb+0x69/0xe0
[5380800.284384] [<ffffffff81247d83>] ext4_setattr+0x653/0x710
[5380800.284387] [<ffffffff811daed1>] notify_change+0x231/0x390
[5380800.284389] [<ffffffff811bb6ed>] do_truncate+0x6d/0xa0
[5380800.284392] [<ffffffff811cb656>] do_last+0xdf6/0x1200
[5380800.284395] [<ffffffff8131697b>] ? apparmor_file_alloc_security+0x5b/0x180
[5380800.284397] [<ffffffff811cdfdb>] path_openat+0xbb/0x640
[5380800.284401] [<ffffffff8107788b>] ? recalc_sigpending+0x1b/0x50
[5380800.284404] [<ffffffff811cf3ca>] do_filp_open+0x3a/0x90
[5380800.284406] [<ffffffff811dc227>] ? __alloc_fd+0xa7/0x130
[5380800.284408] [<ffffffff811bd959>] do_sys_open+0x129/0x280
[5380800.284411] [<ffffffff811bdace>] SyS_open+0x1e/0x20
[5380800.284413] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380800.284414] INFO: task xe-update-guest:30397 blocked for more than 120 seconds.
[5380800.284420] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284423] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284426] xe-update-guest D 0000000000000000 0 30397 973 0x00000000
[5380800.284428] ffff88020b1e5c20 0000000000000282 ffff880177460000 ffff88020b1e5fd8
[5380800.284430] 0000000000013180 0000000000013180 ffff880177460000 ffff8801b4023b00
[5380800.284432] ffff8801b4023b04 ffff880177460000 00000000ffffffff ffff8801b4023b08
[5380800.284434] Call Trace:
[5380800.284437] [<ffffffff8172a109>] schedule_preempt_disabled+0x29/0x70
[5380800.284440] [<ffffffff8172bf75>] __mutex_lock_slowpath+0x135/0x1b0
[5380800.284442] [<ffffffff8172c00f>] mutex_lock+0x1f/0x2f
[5380800.284445] [<ffffffff81321816>] ima_file_check+0x86/0x180
[5380800.284448] [<ffffffff8123bb20>] ? ext4_htree_store_dirent+0x120/0x120
[5380800.284450] [<ffffffff811cadd0>] do_last+0x570/0x1200
[5380800.284452] [<ffffffff8131697b>] ? apparmor_file_alloc_security+0x5b/0x180
[5380800.284455] [<ffffffff811cdfdb>] path_openat+0xbb/0x640
[5380800.284457] [<ffffffff8107788b>] ? recalc_sigpending+0x1b/0x50
[5380800.284460] [<ffffffff811cf3ca>] do_filp_open+0x3a/0x90
[5380800.284462] [<ffffffff811dc227>] ? __alloc_fd+0xa7/0x130
[5380800.284464] [<ffffffff811bd959>] do_sys_open+0x129/0x280
[5380800.284466] [<ffffffff811bdace>] SyS_open+0x1e/0x20
[5380800.284468] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380800.284470] INFO: task sshd:30406 blocked for more than 120 seconds.
[5380800.284474] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284477] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284481] sshd D 0000000000000000 0 30406 941 0x00000004
[5380800.284483] ffff8803e4261c20 0000000000000286 ffff8803e55a0000 ffff8803e4261fd8
[5380800.284485] 0000000000013180 0000000000013180 ffff8803e55a0000 ffff880082118530
[5380800.284487] ffff880082118534 ffff8803e55a0000 00000000ffffffff ffff880082118538
[5380800.284489] Call Trace:
[5380800.284491] [<ffffffff8172a109>] schedule_preempt_disabled+0x29/0x70
[5380800.284493] [<ffffffff8172bf75>] __mutex_lock_slowpath+0x135/0x1b0
[5380800.284495] [<ffffffff8172c00f>] mutex_lock+0x1f/0x2f
[5380800.284497] [<ffffffff81321816>] ima_file_check+0x86/0x180
[5380800.284499] [<ffffffff8123bb20>] ? ext4_htree_store_dirent+0x120/0x120
[5380800.284502] [<ffffffff811cadd0>] do_last+0x570/0x1200
[5380800.284504] [<ffffffff8131697b>] ? apparmor_file_alloc_security+0x5b/0x180
[5380800.284506] [<ffffffff811cdfdb>] path_openat+0xbb/0x640
[5380800.284510] [<ffffffff8160e48f>] ? sock_destroy_inode+0x2f/0x40
[5380800.284513] [<ffffffff811d9adb>] ? evict+0x11b/0x1b0
[5380800.284515] [<ffffffff811cf3ca>] do_filp_open+0x3a/0x90
[5380800.284517] [<ffffffff811dc227>] ? __alloc_fd+0xa7/0x130
[5380800.284519] [<ffffffff811bd959>] do_sys_open+0x129/0x280
[5380800.284522] [<ffffffff811bdace>] SyS_open+0x1e/0x20
[5380800.284524] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380800.284525] INFO: task sshd:30410 blocked for more than 120 seconds.
[5380800.284530] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284533] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284536] sshd D 0000000000000000 0 30410 941 0x00000004
[5380800.284538] ffff880296f7dc20 0000000000000286 ffff8800fff08000 ffff880296f7dfd8
[5380800.284540] 0000000000013180 0000000000013180 ffff8800fff08000 ffff880082118530
[5380800.284542] ffff880082118534 ffff8800fff08000 00000000ffffffff ffff880082118538
[5380800.284544] Call Trace:
[5380800.284546] [<ffffffff8172a109>] schedule_preempt_disabled+0x29/0x70
[5380800.284548] [<ffffffff8172bf75>] __mutex_lock_slowpath+0x135/0x1b0
[5380800.284550] [<ffffffff8172c00f>] mutex_lock+0x1f/0x2f
[5380800.284553] [<ffffffff81321816>] ima_file_check+0x86/0x180
[5380800.284555] [<ffffffff8123bb20>] ? ext4_htree_store_dirent+0x120/0x120
[5380800.284558] [<ffffffff811cadd0>] do_last+0x570/0x1200
[5380800.284559] [<ffffffff8131697b>] ? apparmor_file_alloc_security+0x5b/0x180
[5380800.284562] [<ffffffff811cdfdb>] path_openat+0xbb/0x640
[5380800.284564] [<ffffffff8160e48f>] ? sock_destroy_inode+0x2f/0x40
[5380800.284566] [<ffffffff811d9adb>] ? evict+0x11b/0x1b0
[5380800.284569] [<ffffffff811cf3ca>] do_filp_open+0x3a/0x90
[5380800.284571] [<ffffffff811dc227>] ? __alloc_fd+0xa7/0x130
[5380800.284573] [<ffffffff811bd959>] do_sys_open+0x129/0x280
[5380800.284575] [<ffffffff811bdace>] SyS_open+0x1e/0x20
[5380800.284578] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380800.284579] INFO: task sshd:30412 blocked for more than 120 seconds.
[5380800.284584] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380800.284587] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380800.284590] sshd D 0000000000000000 0 30412 941 0x00000004
[5380800.284592] ffff8800fff33c20 0000000000000286 ffff8800fff0b000 ffff8800fff33fd8
[5380800.284594] 0000000000013180 0000000000013180 ffff8800fff0b000 ffff880082118530
[5380800.284596] ffff880082118534 ffff8800fff0b000 00000000ffffffff ffff880082118538
[5380800.284598] Call Trace:
[5380800.284600] [<ffffffff8172a109>] schedule_preempt_disabled+0x29/0x70
[5380800.284602] [<ffffffff8172bf75>] __mutex_lock_slowpath+0x135/0x1b0
[5380800.284604] [<ffffffff8172c00f>] mutex_lock+0x1f/0x2f
[5380800.284607] [<ffffffff81321816>] ima_file_check+0x86/0x180
[5380800.284609] [<ffffffff8123bb20>] ? ext4_htree_store_dirent+0x120/0x120
[5380800.284611] [<ffffffff811cadd0>] do_last+0x570/0x1200
[5380800.284613] [<ffffffff8131697b>] ? apparmor_file_alloc_security+0x5b/0x180
[5380800.284616] [<ffffffff811cdfdb>] path_openat+0xbb/0x640
[5380800.284618] [<ffffffff8160e48f>] ? sock_destroy_inode+0x2f/0x40
[5380800.284620] [<ffffffff811d9adb>] ? evict+0x11b/0x1b0
[5380800.284623] [<ffffffff811cf3ca>] do_filp_open+0x3a/0x90
[5380800.284624] [<ffffffff811dc227>] ? __alloc_fd+0xa7/0x130
[5380800.284627] [<ffffffff811bd959>] do_sys_open+0x129/0x280
[5380800.284629] [<ffffffff811bdace>] SyS_open+0x1e/0x20
[5380800.284631] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380920.284086] INFO: task jbd2/xvda2-8:155 blocked for more than 120 seconds.
[5380920.284100] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380920.284103] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380920.284107] jbd2/xvda2-8 D 0000000000000000 0 155 2 0x00000000
[5380920.284111] ffff8803e373db48 0000000000000246 ffff8803e3451800 ffff8803e373dfd8
[5380920.284115] 0000000000013180 0000000000013180 ffff8803e3451800 ffff8803fda13a18
[5380920.284117] ffff8803fdfe4c90 0000000000000002 ffffffff811effc0 ffff8803e373dbc0
[5380920.284119] Call Trace:
[5380920.284131] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380920.284136] [<ffffffff81729f0d>] io_schedule+0x9d/0x140
[5380920.284139] [<ffffffff811effce>] sleep_on_buffer+0xe/0x20
[5380920.284141] [<ffffffff8172a392>] __wait_on_bit+0x62/0x90
[5380920.284144] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380920.284146] [<ffffffff8172a437>] out_of_line_wait_on_bit+0x77/0x90
[5380920.284150] [<ffffffff810ab520>] ? autoremove_wake_function+0x40/0x40
[5380920.284153] [<ffffffff811f1200>] ? _submit_bh+0x150/0x200
[5380920.284156] [<ffffffff811f12fa>] __wait_on_buffer+0x2a/0x30
[5380920.284160] [<ffffffff81292e5a>] jbd2_write_superblock+0x8a/0x150
[5380920.284162] [<ffffffff812934a7>] jbd2_journal_update_sb_errno+0x37/0x40
[5380920.284164] [<ffffffff81292a40>] __journal_abort_soft+0x40/0x60
[5380920.284166] [<ffffffff81292dce>] jbd2_journal_abort+0xe/0x10
[5380920.284170] [<ffffffff8128c96e>] jbd2_journal_commit_transaction+0x18ee/0x1ab0
[5380920.284175] [<ffffffff810979e7>] ? finish_task_switch+0x57/0x170
[5380920.284180] [<ffffffff810757df>] ? try_to_del_timer_sync+0x4f/0x70
[5380920.284182] [<ffffffff81290d3d>] kjournald2+0xbd/0x250
[5380920.284184] [<ffffffff810ab4e0>] ? prepare_to_wait_event+0x100/0x100
[5380920.284185] [<ffffffff81290c80>] ? commit_timeout+0x10/0x10
[5380920.284189] [<ffffffff8108b8a2>] kthread+0xd2/0xf0
[5380920.284191] [<ffffffff8108b7d0>] ? kthread_create_on_node+0x1c0/0x1c0
[5380920.284194] [<ffffffff81736328>] ret_from_fork+0x58/0x90
[5380920.284196] [<ffffffff8108b7d0>] ? kthread_create_on_node+0x1c0/0x1c0
[5380920.284200] INFO: task rs:main Q:Reg:585 blocked for more than 120 seconds.
[5380920.284204] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380920.284207] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380920.284210] rs:main Q:Reg D 0000000000000000 0 585 1 0x00000000
[5380920.284213] ffff8803e4151628 0000000000000286 ffff8803e4318000 ffff8803e4151fd8
[5380920.284215] 0000000000013180 0000000000013180 ffff8803e4318000 ffff8803fda13a18
[5380920.284218] ffff8803fdfdd8b0 ffff8803e41516b0 0000000000000002 ffffffff811effc0
[5380920.284220] Call Trace:
[5380920.284223] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380920.284225] [<ffffffff81729f0d>] io_schedule+0x9d/0x140
[5380920.284227] [<ffffffff811effce>] sleep_on_buffer+0xe/0x20
[5380920.284229] [<ffffffff8172a498>] __wait_on_bit_lock+0x48/0xb0
[5380920.284231] [<ffffffff811effc0>] ? generic_block_bmap+0x50/0x50
[5380920.284233] [<ffffffff8172a577>] out_of_line_wait_on_bit_lock+0x77/0x90
[5380920.284235] [<ffffffff810ab520>] ? autoremove_wake_function+0x40/0x40
[5380920.284238] [<ffffffff811f146a>] __lock_buffer+0x2a/0x30
[5380920.284241] [<ffffffff81289c90>] do_get_write_access+0x250/0x4d0
[5380920.284243] [<ffffffff81289f42>] ? jbd2_journal_get_write_access+0x32/0x40
[5380920.284246] [<ffffffff81289f37>] jbd2_journal_get_write_access+0x27/0x40
[5380920.284251] [<ffffffff8126fa0b>] __ext4_journal_get_write_access+0x3b/0x80
[5380920.284253] [<ffffffff8127658e>] ext4_mb_mark_diskspace_used+0x6e/0x4c0
[5380920.284256] [<ffffffff81247e94>] ? ext4_dirty_inode+0x54/0x60
[5380920.284259] [<ffffffff81277d8d>] ext4_mb_new_blocks+0x2ad/0x550
[5380920.284261] [<ffffffff8127d7c3>] ext4_alloc_branch+0x383/0x3d0
[5380920.284263] [<ffffffff8127e19f>] ext4_ind_map_blocks+0x1ef/0x710
[5380920.284268] [<ffffffff81009f50>] ? xen_clocksource_get_cycles+0x20/0x30
[5380920.284272] [<ffffffff81241fb1>] ext4_map_blocks+0x161/0x560
[5380920.284274] [<ffffffff8124242c>] _ext4_get_block+0x7c/0x1b0
[5380920.284277] [<ffffffff81242576>] ext4_get_block+0x16/0x20
[5380920.284279] [<ffffffff811f3157>] __block_write_begin+0x177/0x430
[5380920.284281] [<ffffffff81242560>] ? _ext4_get_block+0x1b0/0x1b0
[5380920.284284] [<ffffffff8126f6f9>] ? __ext4_journal_start_sb+0x69/0xe0
[5380920.284286] [<ffffffff81246486>] ext4_write_begin+0x176/0x400
[5380920.284292] [<ffffffff8114fafc>] generic_file_buffered_write+0x10c/0x250
[5380920.284294] [<ffffffff811511b1>] __generic_file_aio_write+0x1c1/0x3d0
[5380920.284296] [<ffffffff81151418>] generic_file_aio_write+0x58/0xa0
[5380920.284299] [<ffffffff8123c612>] ext4_file_write+0xa2/0x3f0
[5380920.284303] [<ffffffff811cf3ca>] ? do_filp_open+0x3a/0x90
[5380920.284307] [<ffffffff811bdeaa>] do_sync_write+0x5a/0x90
[5380920.284310] [<ffffffff811be634>] vfs_write+0xb4/0x1f0
[5380920.284312] [<ffffffff811bf069>] SyS_write+0x49/0xa0
[5380920.284314] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5380920.284319] INFO: task spooler:23077 blocked for more than 120 seconds.
[5380920.284323] Not tainted 3.13.0-79-generic #123-Ubuntu
[5380920.284325] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[5380920.284329] spooler D 0000000000000000 0 23077 22860 0x00000000
[5380920.284331] ffff8803e4a19ae0 0000000000000282 ffff8803e3bbe000 ffff8803e4a19fd8
[5380920.284333] 0000000000013180 0000000000013180 ffff8803e3bbe000 ffff8803e3b7b210
[5380920.284335] ffff8803e3b7b214 ffff8803e3bbe000 00000000ffffffff ffff8803e3b7b218
[5380920.284337] Call Trace:
[5380920.284339] [<ffffffff8172a109>] schedule_preempt_disabled+0x29/0x70
[5380920.284342] [<ffffffff8172bf75>] __mutex_lock_slowpath+0x135/0x1b0
[5380920.284345] [<ffffffff8172c00f>] mutex_lock+0x1f/0x2f
[5380920.284347] [<ffffffff8124ec70>] ext4_orphan_add+0x70/0x1f0
[5380920.284350] [<ffffffff8126f6f9>] ? __ext4_journal_start_sb+0x69/0xe0
[5380920.284353] [<ffffffff812460c6>] ext4_truncate+0x176/0x3c0
[5380920.284354] [<ffffffff81247a2f>] ext4_setattr+0x2ff/0x710
[5380920.284358] [<ffffffff811daed1>] notify_change+0x231/0x390
[5380920.284361] [<ffffffff811bb6ed>] do_truncate+0x6d/0xa0
[5380920.284364] [<ffffffff811cb656>] do_last+0xdf6/0x1200
[5380920.284367] [<ffffffff8131697b>] ? apparmor_file_alloc_security+0x5b/0x180
[5380920.284370] [<ffffffff811cdfdb>] path_openat+0xbb/0x640
[5380920.284372] [<ffffffff810ab4f2>] ? autoremove_wake_function+0x12/0x40
[5380920.284377] [<ffffffff810aadf8>] ? __wake_up_common+0x58/0x90
[5380920.284379] [<ffffffff8172d660>] ? _raw_spin_unlock_irqrestore+0x20/0x40
[5380920.284382] [<ffffffff811cf3ca>] do_filp_open+0x3a/0x90
[5380920.284384] [<ffffffff811dc227>] ? __alloc_fd+0xa7/0x130
[5380920.284386] [<ffffffff811bd959>] do_sys_open+0x129/0x280
[5380920.284389] [<ffffffff811bdace>] SyS_open+0x1e/0x20
[5380920.284391] [<ffffffff817363dd>] system_call_fastpath+0x1a/0x1f
[5381127.292346] end_request: I/O error, dev xvda, sector 499712
[5381127.292363] Buffer I/O error on device xvda2, logical block 0
[5381127.292367] lost page write due to I/O error on xvda2
[5381127.292386] Buffer I/O error on device xvda2, logical block 1
[5381127.292389] lost page write due to I/O error on xvda2
[5381127.292440] EXT4-fs error: 3 callbacks suppressed
[5381127.292443] EXT4-fs error (device xvda2) in ext4_orphan_add:2611: Journal has aborted
[5381127.292456] EXT4-fs (xvda2): previous I/O error to superblock detected
[5381127.292463] EXT4-fs error (device xvda2) in ext4_orphan_add:2611: Journal has aborted
[5381127.292466] EXT4-fs (xvda2): Remounting filesystem read-only
[5381247.291389] end_request: I/O error, dev xvda, sector 10461184
[5381247.291408] Buffer I/O error on device xvda2, logical block 1245184
[5381247.291414] lost page write due to I/O error on xvda2
[5381247.291473] EXT4-fs error (device xvda2) in ext4_orphan_add:2611: Journal has aborted
[5381307.290617] end_request: I/O error, dev xvda, sector 22257808
[5381307.290633] Buffer I/O error on device xvda2, logical block 2719762
[5381307.290637] lost page write due to I/O error on xvda2
[5381307.290688] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5381427.289770] end_request: I/O error, dev xvda, sector 22781952
[5381427.289787] Buffer I/O error on device xvda2, logical block 2785280
[5381427.289791] lost page write due to I/O error on xvda2
[5381487.280817] end_request: I/O error, dev xvda, sector 23320704
[5381487.280834] Buffer I/O error on device xvda2, logical block 2852624
[5381487.280837] lost page write due to I/O error on xvda2
[5381607.282123] end_request: I/O error, dev xvda, sector 24354816
[5381607.282140] Buffer I/O error on device xvda2, logical block 2981888
[5381607.282143] lost page write due to I/O error on xvda2
[5381649.285178] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5381649.335736] EXT4-fs error (device xvda2): ext4_journal_check_start:56: Detected aborted journal
[5381649.335758] EXT4-fs (xvda2): ext4_writepages: jbd2_start: 13312 pages, ino 1052648; err -30
[5381649.335755] EXT4-fs error (device xvda2): ext4_journal_check_start:56: Detected aborted journal
[5381649.335786] EXT4-fs error (device xvda2): ext4_journal_check_start:56: Detected aborted journal
[5381649.335815] EXT4-fs error (device xvda2) in ext4_reserve_inode_write:4928: Journal has aborted
[5381649.353772] JBD2: Detected IO errors while flushing file data on xvda2-8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment