John Zhuge jzhuge
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java b/launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java | |
| index c434941a58..23ee4d6605 100644 | |
| --- a/launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java | |
| +++ b/launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java | |
| @@ -48,6 +48,7 @@ abstract class AbstractCommandBuilder { | |
| String mainClass; | |
| String master; | |
| protected String propertiesFile; | |
| + protected List<String> extraPropertiesFiles = new ArrayList<>(); | |
| final List<String> appArgs; |
jzhuge
/ explain_so
Last active
December 27, 2023 21:50
Writing to iceberg table with sort order after coalesce
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| == Parsed Logical Plan == | |
| OverwriteByExpression RelationV2[id#61L] prodhive.jzhuge.wso_244_so_1633558130, true, Map(matchByName -> true), true | |
| +- Repartition 4, false | |
| +- Sort [id#3L ASC NULLS FIRST], true | |
| +- Project [id#0L AS id#3L] | |
| +- Range (0, 100000, step=1, splits=Some(6)) | |
| == Analyzed Logical Plan == | |
| OverwriteByExpression RelationV2[id#61L] prodhive.jzhuge.wso_244_so_1633558130, true, Map(matchByName -> true), true | |
| +- Repartition 4, false |
jzhuge
/ hs_err_pid14147.log
Created
September 19, 2017 05:52
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # A fatal error has been detected by the Java Runtime Environment: | |
| # | |
| # SIGSEGV (0xb) at pc=0x00000001052968f7, pid=14147, tid=775 | |
| # | |
| # JRE version: Java(TM) SE Runtime Environment (7.0_79-b15) (build 1.7.0_79-b15) | |
| # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.79-b02 mixed mode bsd-amd64 compressed oops) | |
| # Problematic frame: | |
| # C [libhdfs.0.0.0.dylib+0x38f7] setTLSExceptionStrings+0x47 | |
| # |
jzhuge
/ setTLSExceptionStrings-SEGV.txt
Created
September 19, 2017 05:41
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ echo $CLASSPATH | |
| /Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/etc/hadoop:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/common/lib/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/common/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/hdfs:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/hdfs/lib/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/hdfs/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/yarn/lib/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/yarn/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/mapreduce/lib/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/mapreduce/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5.12.1/share/hadoop/tools/lib/*:/Users/jzhuge/hadoop2/hadoop-dist/target/hadoop-2.6.0-cdh5 |