Skip to content

Instantly share code, notes, and snippets.

@trinitronx

trinitronx/xfs_mount_failure.log

Created March 6, 2025 19:19
Show Gist options
  • Save trinitronx/2a69d50d1753c14c02d87b03f7f8f635 to your computer and use it in GitHub Desktop.
Save trinitronx/2a69d50d1753c14c02d87b03f7f8f635 to your computer and use it in GitHub Desktop.
Download ZIP
XFS mount failure - mdadm, xfs_info & dmesg logs
Raw
xfs_mount_failure.log
$ cat /proc/mdstat
Personalities : [raid1] [raid6] [raid5] [raid4]
md0 : active raid6 sdf1[2] sda1[1] sdb[0] nvme0n1p6[3] nvme1n1p6[4]
5860540224 blocks level 6, 64k chunk, algorithm 2 [5/5] [UUUUU]
unused devices: <none>
$ sudo mdadm --detail /dev/md0
/dev/md0:
Version : 0.90
Creation Time : Fri Jan 9 03:40:39 2009
Raid Level : raid6
Array Size : 5860540224 (5.46 TiB 6.00 TB)
Used Dev Size : 1953513408 (1863.02 GiB 2000.40 GB)
Raid Devices : 5
Total Devices : 5
Preferred Minor : 0
Persistence : Superblock is persistent
Update Time : Sat Mar 1 14:06:11 2025
State : clean
Active Devices : 5
Working Devices : 5
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 64K
Consistency Policy : resync
UUID : 7a0e5ba8:669595fc:852484a6:e390a598
Events : 0.1058949
Number Major Minor RaidDevice State
0 8 16 0 active sync /dev/sdb
1 8 1 1 active sync /dev/sda1
2 8 81 2 active sync /dev/sdf1
3 259 13 3 active sync /dev/nvme0n1p6
4 259 7 4 active sync /dev/nvme1n1p6
$ sudo xfs_info /dev/md0
meta-data=/dev/md0 isize=256 agcount=128, agsize=11446448 blks
= sectsz=4096 attr=2, projid32bit=0
= crc=0 finobt=0, sparse=0, rmapbt=0
= reflink=0 bigtime=0 inobtcount=0 nrext64=0
= exchange=0 metadir=0
data = bsize=4096 blocks=1465135056, imaxpct=5
= sunit=16 swidth=48 blks
naming =version 2 bsize=4096 ascii-ci=0, ftype=0, parent=0
log =internal log bsize=4096 blocks=32768, version=2
= sectsz=4096 sunit=1 blks, lazy-count=0
realtime =none extsz=131072 blocks=0, rtextents=0
= rgcount=0 rgsize=0 extents
$ sudo mount -t xfs -o defaults,user,exec,relatime,nosuid,nodev,allocsize=512m,sunit=128,swidth=384 /dev/md0 /mnt/terabyte
[Mar 6 12:12] SGI XFS with ACLs, security attributes, realtime, scrub, repair, quota, no debug enabled
[ +0.002936] XFS (md0): Deprecated V4 format (crc=0) will not be supported after September 2030.
[ +0.000109] XFS (md0): Mounting V4 Filesystem 29af87eb-2c60-4383-8596-079de2033a48
[ +0.769639] XFS (md0): Starting recovery (logdev: internal)
[ +0.065727] XFS (md0): Internal error ltbno + ltlen > bno at line 2103 of file fs/xfs/libxfs/xfs_alloc.c. Caller xfs_free_ag_extent+0x52e/0xa30 [xfs]
[ +0.000148] CPU: 7 UID: 0 PID: 2476080 Comm: mount Tainted: G U OE 6.12.17-1-MANJARO #1 ce7278bfc2481f5b671010c4d8e96dbb13626209
[ +0.000003] Tainted: [U]=USER, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[ +0.000001] Hardware name: Gigabyte Technology Co., Ltd. Z170X-UD5/Z170X-UD5-CF, BIOS F23i 03/09/2018
[ +0.000001] Call Trace:
[ +0.000001] <TASK>
[ +0.000001] dump_stack_lvl+0x5d/0x80
[ +0.000003] xfs_corruption_error+0x92/0xa0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000144] ? xfs_free_ag_extent+0x52e/0xa30 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000125] xfs_free_ag_extent+0x190/0xa30 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000123] ? xfs_free_ag_extent+0x52e/0xa30 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000122] ? xfs_free_extent_fix_freelist+0x65/0xa0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000123] __xfs_free_extent+0xa1/0x1b0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000123] xfs_extent_free_finish_item+0xaa/0x1d0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000151] xfs_defer_finish_one+0x107/0x2b0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000131] xlog_recover_finish_intent+0x7d/0x90 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000149] xfs_extent_free_recover_work+0x1cd/0x250 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000148] xfs_defer_finish_recovery+0x21/0x90 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000132] xlog_recover_process_intents+0x79/0x230 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000150] ? unlock_new_inode+0x44/0x60
[ +0.000002] ? lock_timer_base+0x76/0xa0
[ +0.000003] xlog_recover_finish+0x4a/0x310 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000148] xfs_log_mount_finish+0x115/0x170 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000152] xfs_mountfs+0x58d/0x990 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000143] xfs_fs_fill_super+0x5a3/0x9b0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000149] ? __pfx_xfs_fs_fill_super+0x10/0x10 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000145] get_tree_bdev_flags+0x131/0x1d0
[ +0.000002] vfs_get_tree+0x26/0xd0
[ +0.000002] vfs_cmd_create+0x59/0xe0
[ +0.000001] __do_sys_fsconfig+0x4e3/0x6b0
[ +0.000002] do_syscall_64+0x82/0x190
[ +0.000002] ? flock_lock_inode+0x213/0x3d0
[ +0.000002] ? do_syscall_64+0x8e/0x190
[ +0.000001] ? locks_lock_inode_wait+0xee/0x1d0
[ +0.000002] ? apparmor_file_lock+0x85/0x1a0
[ +0.000002] ? __do_sys_flock+0x126/0x1e0
[ +0.000003] ? _copy_from_user+0x29/0x70
[ +0.000001] ? __x64_sys_rt_sigprocmask+0xdb/0x150
[ +0.000003] ? syscall_exit_to_user_mode+0x37/0x1c0
[ +0.000001] ? do_syscall_64+0x8e/0x190
[ +0.000002] ? __count_memcg_events+0x53/0xf0
[ +0.000001] ? count_memcg_events.constprop.0+0x1a/0x30
[ +0.000002] ? handle_mm_fault+0x1bb/0x2c0
[ +0.000003] ? do_user_addr_fault+0x36c/0x620
[ +0.000003] entry_SYSCALL_64_after_hwframe+0x76/0x7e
[ +0.000001] RIP: 0033:0x74958832682e
[ +0.000020] Code: 73 01 c3 48 8b 0d e2 d4 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 49 89 ca b8 af 01 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d b2 d4 0c 00 f7 d8 64 89 01 48
[ +0.000001] RSP: 002b:00007ffc17557348 EFLAGS: 00000246 ORIG_RAX: 00000000000001af
[ +0.000002] RAX: ffffffffffffffda RBX: 00005e533a6784f0 RCX: 000074958832682e
[ +0.000001] RDX: 0000000000000000 RSI: 0000000000000006 RDI: 0000000000000003
[ +0.000001] RBP: 00007ffc17557380 R08: 0000000000000000 R09: 0000000000000000
[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 000074958844baa0
[ +0.000001] R13: 0000000000000000 R14: 00005e533a678e20 R15: 0000749588442f9b
[ +0.000002] </TASK>
[ +0.000022] XFS (md0): Corruption detected. Unmount and run xfs_repair
[ +0.000005] 00000000: 36 12 01 00 01 00 00 00 60 1e 7b 52 ac 9b ff ff 6.......`.{R....
[ +0.000002] XFS (md0): Internal error xfs_extent_free_recover_work at line 627 of file fs/xfs/xfs_extfree_item.c. Caller xfs_defer_finish_recovery+0x21/0x90 [xfs]
[ +0.000134] CPU: 7 UID: 0 PID: 2476080 Comm: mount Tainted: G U OE 6.12.17-1-MANJARO #1 ce7278bfc2481f5b671010c4d8e96dbb13626209
[ +0.000003] Tainted: [U]=USER, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[ +0.000000] Hardware name: Gigabyte Technology Co., Ltd. Z170X-UD5/Z170X-UD5-CF, BIOS F23i 03/09/2018
[ +0.000001] Call Trace:
[ +0.000001] <TASK>
[ +0.000000] dump_stack_lvl+0x5d/0x80
[ +0.000002] xfs_corruption_error+0x92/0xa0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000184] ? xfs_defer_finish_recovery+0x21/0x90 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000243] xfs_extent_free_recover_work+0x221/0x250 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000223] ? xfs_defer_finish_recovery+0x21/0x90 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000133] xfs_defer_finish_recovery+0x21/0x90 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000131] xlog_recover_process_intents+0x79/0x230 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000150] ? unlock_new_inode+0x44/0x60
[ +0.000002] ? lock_timer_base+0x76/0xa0
[ +0.000003] xlog_recover_finish+0x4a/0x310 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000203] xfs_log_mount_finish+0x115/0x170 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000234] xfs_mountfs+0x58d/0x990 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000186] xfs_fs_fill_super+0x5a3/0x9b0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000147] ? __pfx_xfs_fs_fill_super+0x10/0x10 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000145] get_tree_bdev_flags+0x131/0x1d0
[ +0.000002] vfs_get_tree+0x26/0xd0
[ +0.000002] vfs_cmd_create+0x59/0xe0
[ +0.000001] __do_sys_fsconfig+0x4e3/0x6b0
[ +0.000002] do_syscall_64+0x82/0x190
[ +0.000002] ? flock_lock_inode+0x213/0x3d0
[ +0.000002] ? do_syscall_64+0x8e/0x190
[ +0.000001] ? locks_lock_inode_wait+0xee/0x1d0
[ +0.000001] ? apparmor_file_lock+0x85/0x1a0
[ +0.000003] ? __do_sys_flock+0x126/0x1e0
[ +0.000002] ? _copy_from_user+0x29/0x70
[ +0.000002] ? __x64_sys_rt_sigprocmask+0xdb/0x150
[ +0.000002] ? syscall_exit_to_user_mode+0x37/0x1c0
[ +0.000002] ? do_syscall_64+0x8e/0x190
[ +0.000001] ? __count_memcg_events+0x53/0xf0
[ +0.000002] ? count_memcg_events.constprop.0+0x1a/0x30
[ +0.000001] ? handle_mm_fault+0x1bb/0x2c0
[ +0.000003] ? do_user_addr_fault+0x36c/0x620
[ +0.000003] entry_SYSCALL_64_after_hwframe+0x76/0x7e
[ +0.000001] RIP: 0033:0x74958832682e
[ +0.000016] Code: 73 01 c3 48 8b 0d e2 d4 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 49 89 ca b8 af 01 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d b2 d4 0c 00 f7 d8 64 89 01 48
[ +0.000001] RSP: 002b:00007ffc17557348 EFLAGS: 00000246 ORIG_RAX: 00000000000001af
[ +0.000002] RAX: ffffffffffffffda RBX: 00005e533a6784f0 RCX: 000074958832682e
[ +0.000001] RDX: 0000000000000000 RSI: 0000000000000006 RDI: 0000000000000003
[ +0.000000] RBP: 00007ffc17557380 R08: 0000000000000000 R09: 0000000000000000
[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 000074958844baa0
[ +0.000001] R13: 0000000000000000 R14: 00005e533a678e20 R15: 0000749588442f9b
[ +0.000002] </TASK>
[ +0.000036] XFS (md0): Corruption detected. Unmount and run xfs_repair
[ +0.000003] XFS (md0): Internal error xfs_trans_cancel at line 978 of file fs/xfs/xfs_trans.c. Caller xfs_extent_free_recover_work+0x234/0x250 [xfs]
[ +0.000186] CPU: 7 UID: 0 PID: 2476080 Comm: mount Tainted: G U OE 6.12.17-1-MANJARO #1 ce7278bfc2481f5b671010c4d8e96dbb13626209
[ +0.000003] Tainted: [U]=USER, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[ +0.000001] Hardware name: Gigabyte Technology Co., Ltd. Z170X-UD5/Z170X-UD5-CF, BIOS F23i 03/09/2018
[ +0.000001] Call Trace:
[ +0.000001] <TASK>
[ +0.000001] dump_stack_lvl+0x5d/0x80
[ +0.000003] xfs_trans_cancel+0x131/0x150 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000214] xfs_extent_free_recover_work+0x234/0x250 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000211] xfs_defer_finish_recovery+0x21/0x90 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000165] xlog_recover_process_intents+0x79/0x230 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000174] ? unlock_new_inode+0x44/0x60
[ +0.000002] ? lock_timer_base+0x76/0xa0
[ +0.000003] xlog_recover_finish+0x4a/0x310 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000185] xfs_log_mount_finish+0x115/0x170 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000230] xfs_mountfs+0x58d/0x990 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000183] xfs_fs_fill_super+0x5a3/0x9b0 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000146] ? __pfx_xfs_fs_fill_super+0x10/0x10 [xfs 2217d1ef271a69c89702a37e3bba9f5e1cd52c25]
[ +0.000145] get_tree_bdev_flags+0x131/0x1d0
[ +0.000002] vfs_get_tree+0x26/0xd0
[ +0.000002] vfs_cmd_create+0x59/0xe0
[ +0.000001] __do_sys_fsconfig+0x4e3/0x6b0
[ +0.000002] do_syscall_64+0x82/0x190
[ +0.000003] ? flock_lock_inode+0x213/0x3d0
[ +0.000001] ? do_syscall_64+0x8e/0x190
[ +0.000002] ? locks_lock_inode_wait+0xee/0x1d0
[ +0.000001] ? apparmor_file_lock+0x85/0x1a0
[ +0.000003] ? __do_sys_flock+0x126/0x1e0
[ +0.000002] ? _copy_from_user+0x29/0x70
[ +0.000001] ? __x64_sys_rt_sigprocmask+0xdb/0x150
[ +0.000003] ? syscall_exit_to_user_mode+0x37/0x1c0
[ +0.000002] ? do_syscall_64+0x8e/0x190
[ +0.000001] ? __count_memcg_events+0x53/0xf0
[ +0.000002] ? count_memcg_events.constprop.0+0x1a/0x30
[ +0.000001] ? handle_mm_fault+0x1bb/0x2c0
[ +0.000002] ? do_user_addr_fault+0x36c/0x620
[ +0.000004] entry_SYSCALL_64_after_hwframe+0x76/0x7e
[ +0.000001] RIP: 0033:0x74958832682e
[ +0.000018] Code: 73 01 c3 48 8b 0d e2 d4 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 49 89 ca b8 af 01 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d b2 d4 0c 00 f7 d8 64 89 01 48
[ +0.000001] RSP: 002b:00007ffc17557348 EFLAGS: 00000246 ORIG_RAX: 00000000000001af
[ +0.000002] RAX: ffffffffffffffda RBX: 00005e533a6784f0 RCX: 000074958832682e
[ +0.000001] RDX: 0000000000000000 RSI: 0000000000000006 RDI: 0000000000000003
[ +0.000000] RBP: 00007ffc17557380 R08: 0000000000000000 R09: 0000000000000000
[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 000074958844baa0
[ +0.000001] R13: 0000000000000000 R14: 00005e533a678e20 R15: 0000749588442f9b
[ +0.000003] </TASK>
[ +0.000020] XFS (md0): Corruption of in-memory data (0x8) detected at xfs_trans_cancel+0x14a/0x150 [xfs] (fs/xfs/xfs_trans.c:979). Shutting down filesystem.
[ +0.000166] XFS (md0): Please unmount the filesystem and rectify the problem(s)
[ +0.000004] XFS (md0): Failed to recover intents
[ +0.000002] XFS (md0): Ending recovery (logdev: internal)
[ +0.000020] XFS (md0): log mount finish failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment