Skip to content

Instantly share code, notes, and snippets.

heapstats INFO: Heap Ranking at 2016-07-20 19:02:14 (caused by GC, GCCause: unknown GCCause)
heapstats INFO: Rank usage(byte) increment(byte) Class name
heapstats INFO: ---- --------------- --------------- ----------
heapstats INFO: 1 242011720 122933688 [B
heapstats INFO: 2 44071272 15421840 [I
heapstats INFO: 3 2854104 2848880 [J
heapstats INFO: 4 2655696 2652368 [Z
heapstats INFO: 5 2404280 1863472 [C
*** glibc detected *** java: free(): invalid next size (normal): 0x00007f3d54138130 ***
======= Backtrace: =========
$ gdb /usr/java/jdk1.8.0_92/bin/java /usr/local/presto/datadir/core.44958
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
$ gdb /usr/java/jdk1.8.0_92/bin/java core.22935
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f321ccc3354, pid=22935, tid=0x00007f2e38ab3700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_92-b14) (build 1.8.0_92-b14)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.92-b14 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# V [libjvm.so+0x9bd354] SharedRuntime::compute_compiled_exc_handler(nmethod*, unsigned char*, Handle&, bool, bool)+0x134
#
$ gdb /usr/java/jdk1.8.0_92/bin/java /usr/local/presto/datadir/core.51134
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
$ gdb /usr/java/jdk1.8.0_92/bin/java /usr/local/presto/datadir/core.51134
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007fdfebd0d3bd, pid=51134, tid=0x00007fdee9e6b700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_92-b14) (build 1.8.0_92-b14)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.92-b14 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [libheapstats-engine-avx-2.0.so+0x493bd] TSnapShotContainer::mergeChildren()+0x11d
#
Attaching to core core.51134 from executable /usr/java/jdk1.8.0_92/bin/java, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 25.92-b14
Deadlock Detection:
No deadlocks found.
----------------- 1454 -----------------
0x00000037e960b5bc __pthread_cond_wait + 0xcc
$ jstack -m core.51134
Attaching to remote server core.51134, please wait...
Error attaching to remote server: java.net.MalformedURLException: invalid authority: //core.51134/SARemoteDebugger
sun.jvm.hotspot.debugger.DebuggerException: java.net.MalformedURLException: invalid authority: //core.51134/SARemoteDebugger
at sun.jvm.hotspot.RMIHelper.lookup(RMIHelper.java:115)
at sun.jvm.hotspot.HotSpotAgent.connectRemoteDebugger(HotSpotAgent.java:517)
at sun.jvm.hotspot.HotSpotAgent.setupDebugger(HotSpotAgent.java:374)
at sun.jvm.hotspot.HotSpotAgent.go(HotSpotAgent.java:304)
at sun.jvm.hotspot.HotSpotAgent.attach(HotSpotAgent.java:183)
at sun.jvm.hotspot.tools.Tool.start(Tool.java:196)
This file has been truncated, but you can view the full file.
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
java 6163 yarn cwd DIR 8,2 4096 1581994 /usr/hdp/2.4.0.0-169/hadoop-yarn
java 6163 yarn rtd DIR 8,2 4096 2 /
java 6163 yarn txt REG 8,2 7734 16912906 /usr/java/jdk1.8.0_72/bin/java
java 6163 yarn mem REG 8,2 157072 11272201 /lib64/ld-2.12.so
java 6163 yarn mem REG 8,2 22536 11272216 /lib64/libdl-2.12.so
java 6163 yarn mem REG 8,2 1926520 11272208 /lib64/libc-2.12.so
java 6163 yarn mem REG 8,2 145896 11272224 /lib64/libpthread-2.12.so
java 6163 yarn mem REG 8,2 47112 11272232 /lib64/librt-2.12.so
java 6163 yarn mem REG 8,2 599392 11272265 /lib64/libm-2.12.so