Skip to content

Instantly share code, notes, and snippets.

@jmcarp
Created April 13, 2026 14:48
Show Gist options
  • Select an option

  • Save jmcarp/f08f4e519400dc02b79444d2a525ae7a to your computer and use it in GitHub Desktop.

Select an option

Save jmcarp/f08f4e519400dc02b79444d2a525ae7a to your computer and use it in GitHub Desktop.
monitoring-data
Disk is haunted:
```
ubuntu@monitoring:~/monitoring$ ls /data/
ls: cannot open directory '/data/': Input/output error
```
Disk is very haunted:
```
ubuntu@monitoring:~/monitoring$ sudo dmesg | grep -i "error\|i/o\|fail" | tail -10
[400929.546943] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401049.545604] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401097.444605] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #5505039: lblock 0: comm loki: error -5 reading directory block
[401109.673687] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401229.670445] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401289.794600] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401397.428623] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #5505039: lblock 0: comm loki: error -5 reading directory block
[401409.791094] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401469.928585] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
[401589.925193] EXT4-fs warning (device nvme1n1p1): htree_dirblock_to_tree:1083: inode #3276801: lblock 0: comm prometheus: error -5 reading directory block
```
Apparently fixed by a restart.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment