Skip to content

Instantly share code, notes, and snippets.

@andir
Created October 20, 2025 18:04
Show Gist options
  • Select an option

  • Save andir/6915e2fc146c1fef95908f1e3c8ec20d to your computer and use it in GitHub Desktop.

Select an option

Save andir/6915e2fc146c1fef95908f1e3c8ec20d to your computer and use it in GitHub Desktop.
[117434.251657] systemd-journald[268]: File /var/log/journal/73dc5ecda65653aa20c75f4452b0567e/user-1007.journal corrupted or uncleanly shut down, renaming and replacing.
[234148.780698] systemd invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
[234148.781805] CPU: 1 UID: 0 PID: 1 Comm: systemd Not tainted 6.12.48+deb13-amd64 #1 Debian 6.12.48-1
[234148.781809] Hardware name: Hetzner vServer/Standard PC (i440FX + PIIX, 1996), BIOS 20171111 11/11/2017
[234148.781811] Call Trace:
[234148.781815] <TASK>
[234148.781819] dump_stack_lvl+0x5d/0x80
[234148.781826] dump_header+0x43/0x1aa
[234148.781831] oom_kill_process.cold+0x8/0x8d
[234148.781836] out_of_memory+0x219/0x4b0
[234148.781842] __alloc_pages_slowpath.constprop.0+0xbe2/0xd80
[234148.781850] __alloc_pages_noprof+0x2fb/0x310
[234148.781855] alloc_pages_mpol_noprof+0xd7/0x1c0
[234148.781861] folio_alloc_noprof+0x5b/0xb0
[234148.781864] __filemap_get_folio+0x1aa/0x300
[234148.781869] filemap_fault+0x1fb/0xd40
[234148.781876] __do_fault+0x33/0x170
[234148.781881] do_fault+0x341/0x550
[234148.781885] __handle_mm_fault+0x7c2/0xf70
[234148.781888] ? srso_return_thunk+0x5/0x5f
[234148.781891] ? asm_common_interrupt+0x26/0x40
[234148.781899] handle_mm_fault+0xe2/0x2c0
[234148.781902] do_user_addr_fault+0x217/0x620
[234148.781907] exc_page_fault+0x7e/0x180
[234148.781911] asm_exc_page_fault+0x26/0x30
[234148.781914] RIP: 0033:0x7fa907afe9c0
[234148.781933] Code: Unable to access opcode bytes at 0x7fa907afe996.
[234148.781935] RSP: 002b:00007ffcc9007728 EFLAGS: 00010297
[234148.781937] RAX: 0000000000000008 RBX: 00005638efbcdfc0 RCX: 0000000000000000
[234148.781939] RDX: 00005638efab5600 RSI: 000000000000000e RDI: 00005638efbcdfc0
[234148.781941] RBP: 000000000000de5a R08: 0000000000000020 R09: 00005638efbebef0
[234148.781942] R10: 00007ffcc9007890 R11: 0000000000000055 R12: 00000000017d7840
[234148.781944] R13: 0000000000000000 R14: 0000000000000008 R15: 00005638efab5600
[234148.781949] </TASK>
[234148.781950] Mem-Info:
[234148.809826] active_anon:224747 inactive_anon:230183 isolated_anon:0
active_file:40 inactive_file:67 isolated_file:0
unevictable:128 dirty:0 writeback:0
slab_reclaimable:4542 slab_unreclaimable:10240
mapped:702 shmem:763 pagetables:1881
sec_pagetables:0 bounce:0
kernel_misc_reclaimable:0
free:13282 free_pcp:176 free_cma:0
[234148.815239] Node 0 active_anon:856720kB inactive_anon:963000kB active_file:32kB inactive_file:1312kB unevictable:512kB isolated(anon):0kB isolated(file):0kB mapped:2808kB dirty:0kB writeback:0kB shmem:3052kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:1300480kB writeback_tmp:0kB kernel_stack:2528kB pagetables:7524kB sec_pagetables:0kB all_unreclaimable? no
[234148.818352] Node 0 DMA free:7892kB boost:0kB min:356kB low:444kB high:532kB reserved_highatomic:0KB active_anon:2120kB inactive_anon:5056kB active_file:12kB inactive_file:8kB unevictable:0kB writepending:0kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
[234148.821068] lowmem_reserve[]: 0 1869 1869 1869 1869
[234148.822339] Node 0 DMA32 free:44928kB boost:0kB min:44696kB low:55868kB high:67040kB reserved_highatomic:0KB active_anon:872372kB inactive_anon:940172kB active_file:204kB inactive_file:184kB unevictable:512kB writepending:0kB present:2031472kB managed:1956440kB mlocked:512kB bounce:0kB free_pcp:700kB local_pcp:0kB free_cma:0kB
[234148.826418] lowmem_reserve[]: 0 0 0 0 0
[234148.827863] Node 0 DMA: 0*4kB 3*8kB (UME) 2*16kB (UE) 3*32kB (UME) 3*64kB (UME) 2*128kB (UE) 2*256kB (ME) 3*512kB (UME) 1*1024kB (E) 2*2048kB (ME) 0*4096kB = 7768kB
[234148.829580] Node 0 DMA32: 506*4kB (UME) 687*8kB (UME) 399*16kB (UME) 182*32kB (UME) 116*64kB (UME) 43*128kB (UME) 16*256kB (UME) 7*512kB (ME) 3*1024kB (M) 1*2048kB (M) 0*4096kB = 45456kB
[234148.832160] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[234148.833781] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[234148.835771] 1023 total pagecache pages
[234148.836316] 0 pages in swap cache
[234148.837348] Free swap = 0kB
[234148.839788] Total swap = 0kB
[234148.841491] 511866 pages RAM
[234148.843556] 0 pages HighMem/MovableOnly
[234148.845167] 18916 pages reserved
[234148.845524] 0 pages hwpoisoned
[234148.845854] Tasks state (memory values in pages):
[234148.846355] [ pid ] uid tgid total_vm rss rss_anon rss_file rss_shmem pgtables_bytes swapents oom_score_adj name
[234148.847488] [ 268] 0 268 18934 341 320 19 2 131072 0 -250 systemd-journal
[234148.848657] [ 319] 112 319 22968 281 256 25 0 77824 0 0 systemd-timesyn
[234148.849829] [ 329] 0 329 8780 508 480 28 0 86016 0 -1000 systemd-udevd
[234148.851512] [ 633] 0 633 2095 958 945 13 0 57344 0 0 haveged
[234148.854429] [ 644] 0 644 961 55 32 23 0 45056 0 0 cron
[234148.856171] [ 645] 105 645 2105 175 160 15 0 61440 0 -900 dbus-daemon
[234148.858983] [ 649] 0 649 61473 2369 1761 0 608 151552 0 0 php-fpm8.4
[234148.861437] [ 650] 119 650 384737 1276 1243 33 0 163840 0 0 prometheus-node
[234148.863822] [ 651] 0 651 54922 385 352 33 0 77824 0 0 rsyslogd
[234148.865155] [ 654] 0 654 4768 329 288 41 0 90112 0 0 systemd-logind
[234148.868989] [ 658] 110 658 1384 168 128 40 0 49152 0 0 vnstatd
[234148.872374] [ 668] 0 668 2976 365 320 45 0 69632 0 -1000 sshd
[234148.873916] [ 692] 102 692 13375 8850 8837 13 0 147456 0 0 atheme-services
[234148.876092] [ 697] 111 697 9097 3543 3520 23 0 110592 0 0 unbound
[234148.878071] [ 704] 33 704 61615 2019 1820 36 163 139264 0 0 php-fpm8.4
[234148.881546] [ 705] 33 705 61615 2428 1852 61 515 139264 0 0 php-fpm8.4
[234148.885310] [ 827] 108 827 37606 6052 6047 5 0 167936 0 0 lua
[234148.888342] [ 834] 0 834 10996 142 142 0 0 61440 0 0 master
[234148.891628] [ 840] 103 840 11163 198 160 38 0 81920 0 0 qmgr
[234148.894478] [ 856] 0 856 2131 62 32 30 0 53248 0 0 agetty
[234148.898949] [ 857] 0 857 1195 71 32 39 0 45056 0 0 agetty
[234148.900840] [ 940] 0 940 4032 622 594 28 0 77824 0 0 nginx
[234148.903298] [ 956] 1006 956 10160 3800 3756 44 0 126976 0 0 biboumi
[234148.907656] [ 2221] 63335 2221 347251 344187 344175 12 0 2830336 0 0 solanum
[234148.909914] [ 2226] 63335 2226 3420 759 736 23 0 73728 0 0 authd
[234148.914280] [ 2227] 63335 2227 3597 987 960 27 0 61440 0 0 ssld
[234148.918543] [ 2228] 63335 2228 3633 992 992 0 0 73728 0 0 ssld
[234148.920498] [ 2229] 63335 2229 3537 349 288 61 0 65536 0 0 bandb
[234148.922385] [ 2444] 113 2444 81105 580 417 163 0 110592 0 0 systemd-network
[234148.924754] [ 5267] 63335 5267 10575 7536 7527 9 0 122880 0 0 solanum
[234148.927684] [ 5272] 63335 5272 2942 347 320 27 0 61440 0 0 authd
[234148.932942] [ 5273] 63335 5273 3244 605 585 20 0 61440 0 0 ssld
[234148.936877] [ 5274] 63335 5274 3223 576 576 0 0 61440 0 0 ssld
[234148.938844] [ 5275] 63335 5275 3537 348 288 60 0 69632 0 0 bandb
[234148.941110] [ 9506] 0 9506 5037 628 576 52 0 81920 0 0 sshd-session
[234148.944970] [ 9513] 1007 9513 5481 536 512 24 0 86016 0 100 systemd
[234148.948455] [ 9515] 1007 9515 5794 502 486 16 0 86016 0 100 (sd-pam)
[234148.950401] [ 9537] 1007 9537 5142 644 636 8 0 81920 0 0 sshd-session
[234148.953914] [ 9538] 1007 9538 1591 702 640 62 0 53248 0 0 bash
[234148.955876] [ 10633] 1007 10633 4401 389 352 37 0 73728 0 0 sudo
[234148.957735] [ 10637] 1007 10637 4401 417 360 57 0 65536 0 0 sudo
[234148.961854] [ 10638] 0 10638 1105 181 160 21 0 40960 0 0 bash
[234148.965561] [ 10803] 0 10803 656 22 0 22 0 40960 0 0 tail
[234148.969110] [ 14837] 33 14837 4422 717 704 13 0 81920 0 0 nginx
[234148.972776] [ 14838] 33 14838 4434 748 704 44 0 81920 0 0 nginx
[234148.976418] [ 16322] 103 16322 11116 160 160 0 0 73728 0 0 pickup
[234148.979732] [ 16338] 0 16338 78683 61127 61127 0 0 593920 0 0 borg
[234148.984494] [ 16343] 0 16343 4565 567 516 51 0 77824 0 0 ssh
[234148.989084] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/system-solanum.slice/[email protected],task=solanum,pid=2221,uid=63335
[234148.992926] Out of memory: Killed process 2221 (solanum) total-vm:1389004kB, anon-rss:1376700kB, file-rss:48kB, shmem-rss:0kB, UID:63335 pgtables:2764kB oom_score_adj:0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment