Created
August 17, 2016 14:11
-
-
Save wobu/e6566bb2387823964c7627ddd98dbc35 to your computer and use it in GitHub Desktop.
Spark MapR LinkageError MapRPut
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 16/08/17 14:41:17 INFO HFileOutputFormat2: detected MapR table /mapr/dev-hadoop01-samham/firstaid/Developer1/tables/rescoredDocPref, switching to BulkLoadRecordWriter | |
| 16/08/17 14:41:17 ERROR Executor: Exception in task 0.0 in stage 2.2 (TID 514) | |
| java.lang.LinkageError: loader constraint violation: when resolving method "com.mapr.fs.jni.MapRPut.<init>(Ljava/lang/Object;Lcom/mapr/fs/jni/MapRCallBackQueue;)V" the class loader (instance of org/apache/spark/util/MutableURLClassLoader) of the current class, com/mapr/fs/hbase/PutConverter, and the class loader (instance of sun/misc/Launcher$ExtClassLoader) for the method's defining class, com/mapr/fs/jni/MapRPut, have different Class objects for the type com/mapr/fs/jni/MapRCallBackQueue used in the signature | |
| at com.mapr.fs.hbase.PutConverter.createMapRPut(PutConverter.java:124) | |
| at com.mapr.fs.hbase.PutConverter.sortedKeyValuesToMapRPut(PutConverter.java:106) | |
| at com.mapr.fs.hbase.BulkLoadRecordWriter.appendRow(BulkLoadRecordWriter.java:123) | |
| at com.mapr.fs.hbase.BulkLoadRecordWriter.close(BulkLoadRecordWriter.java:167) | |
| at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:1007) | |
| at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:979) | |
| at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) | |
| at org.apache.spark.scheduler.Task.run(Task.scala:64) | |
| at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 16/08/17 14:41:17 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker-8,5,main] | |
| java.lang.LinkageError: loader constraint violation: when resolving method "com.mapr.fs.jni.MapRPut.<init>(Ljava/lang/Object;Lcom/mapr/fs/jni/MapRCallBackQueue;)V" the class loader (instance of org/apache/spark/util/MutableURLClassLoader) of the current class, com/mapr/fs/hbase/PutConverter, and the class loader (instance of sun/misc/Launcher$ExtClassLoader) for the method's defining class, com/mapr/fs/jni/MapRPut, have different Class objects for the type com/mapr/fs/jni/MapRCallBackQueue used in the signature | |
| at com.mapr.fs.hbase.PutConverter.createMapRPut(PutConverter.java:124) | |
| at com.mapr.fs.hbase.PutConverter.sortedKeyValuesToMapRPut(PutConverter.java:106) | |
| at com.mapr.fs.hbase.BulkLoadRecordWriter.appendRow(BulkLoadRecordWriter.java:123) | |
| at com.mapr.fs.hbase.BulkLoadRecordWriter.close(BulkLoadRecordWriter.java:167) | |
| at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:1007) | |
| at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:979) | |
| at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) | |
| at org.apache.spark.scheduler.Task.run(Task.scala:64) | |
| at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) | |
| at java.lang.Thread.run(Thread.java:745) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment