Skip to content

Instantly share code, notes, and snippets.

@aorjoa
Created March 26, 2017 05:25
Show Gist options
  • Save aorjoa/77792193f7b950a09afedeee929eb1d1 to your computer and use it in GitHub Desktop.
Save aorjoa/77792193f7b950a09afedeee929eb1d1 to your computer and use it in GitHub Desktop.
Sparktest with sbt custom task
AorJoa@aorjoa:~/Dropbox/repository/sparktest$ sbt 'testOnCluster'
[info] Loading project definition from /Users/AorJoa/Dropbox/repository/sparktest/project
[info] Set current project to sparktest (in build file:/Users/AorJoa/Dropbox/repository/sparktest/)
[info] Including from cache: curator-recipes-2.4.0.jar
[info] Including from cache: curator-framework-2.4.0.jar
[info] Including from cache: curator-client-2.4.0.jar
[info] Including from cache: zookeeper-3.4.5.jar
[info] Including from cache: guava-14.0.1.jar
[info] Including from cache: scala-library-2.11.8.jar
[info] Including from cache: javax.servlet-api-3.1.0.jar
[info] Including from cache: commons-math3-3.4.1.jar
[info] Including from cache: jul-to-slf4j-1.7.16.jar
[info] Including from cache: jcl-over-slf4j-1.7.16.jar
[info] Including from cache: compress-lzf-1.0.3.jar
[info] Including from cache: lz4-1.3.0.jar
[info] Including from cache: RoaringBitmap-0.5.11.jar
[info] Including from cache: json4s-jackson_2.11-3.2.11.jar
[info] Including from cache: json4s-core_2.11-3.2.11.jar
[info] Including from cache: json4s-ast_2.11-3.2.11.jar
[info] Including from cache: paranamer-2.6.jar
[info] Including from cache: scalap-2.11.8.jar
[info] Including from cache: spark-core_2.11-2.1.0.jar
[info] Including from cache: avro-mapred-1.7.7-hadoop2.jar
[info] Including from cache: avro-ipc-1.7.7.jar
[info] Including from cache: avro-ipc-1.7.7-tests.jar
[info] Including from cache: avro-1.7.7.jar
[info] Including from cache: jackson-core-asl-1.9.13.jar
[info] Including from cache: jackson-mapper-asl-1.9.13.jar
[info] Including from cache: snappy-java-1.1.2.6.jar
[info] Including from cache: commons-compress-1.4.1.jar
[info] Including from cache: xz-1.0.jar
[info] Including from cache: slf4j-api-1.7.16.jar
[info] Including from cache: chill_2.11-0.8.0.jar
[info] Including from cache: chill-java-0.8.0.jar
[info] Including from cache: kryo-shaded-3.0.3.jar
[info] Including from cache: minlog-1.3.0.jar
[info] Including from cache: objenesis-2.1.jar
[info] Including from cache: xbean-asm5-shaded-4.4.jar
[info] Including from cache: scala-compiler-2.11.8.jar
[info] Including from cache: hadoop-client-2.2.0.jar
[info] Including from cache: hadoop-common-2.2.0.jar
[info] Including from cache: hadoop-annotations-2.2.0.jar
[info] Including from cache: jsr305-1.3.9.jar
[info] Including from cache: commons-cli-1.2.jar
[info] Including from cache: commons-math-2.1.jar
[info] Including from cache: xmlenc-0.52.jar
[info] Including from cache: scala-reflect-2.11.8.jar
[info] Including from cache: commons-httpclient-3.1.jar
[info] Including from cache: commons-io-2.1.jar
[info] Including from cache: commons-net-2.2.jar
[info] Including from cache: scala-parser-combinators_2.11-1.0.4.jar
[info] Including from cache: log4j-1.2.17.jar
[info] Including from cache: commons-lang-2.5.jar
[info] Including from cache: jersey-client-2.22.2.jar
[info] Including from cache: javax.ws.rs-api-2.0.1.jar
[info] Including from cache: commons-configuration-1.6.jar
[info] Including from cache: jersey-common-2.22.2.jar
[info] Including from cache: javax.annotation-api-1.2.jar
[info] Including from cache: commons-collections-3.2.1.jar
[info] Including from cache: commons-digester-1.8.jar
[info] Including from cache: jersey-guava-2.22.2.jar
[info] Including from cache: hk2-api-2.4.0-b34.jar
[info] Including from cache: commons-beanutils-1.7.0.jar
[info] Including from cache: hk2-utils-2.4.0-b34.jar
[info] Including from cache: aopalliance-repackaged-2.4.0-b34.jar
[info] Including from cache: javax.inject-2.4.0-b34.jar
[info] Including from cache: commons-beanutils-core-1.8.0.jar
[info] Including from cache: hk2-locator-2.4.0-b34.jar
[info] Including from cache: javassist-3.18.1-GA.jar
[info] Including from cache: osgi-resource-locator-1.0.1.jar
[info] Including from cache: protobuf-java-2.5.0.jar
[info] Including from cache: jersey-server-2.22.2.jar
[info] Including from cache: hadoop-auth-2.2.0.jar
[info] Including from cache: jersey-media-jaxb-2.22.2.jar
[info] Including from cache: validation-api-1.1.0.Final.jar
[info] Including from cache: jersey-container-servlet-2.22.2.jar
[info] Including from cache: jersey-container-servlet-core-2.22.2.jar
[info] Including from cache: netty-3.8.0.Final.jar
[info] Including from cache: stream-2.7.0.jar
[info] Including from cache: metrics-jvm-3.1.2.jar
[info] Including from cache: metrics-json-3.1.2.jar
[info] Including from cache: metrics-graphite-3.1.2.jar
[info] Including from cache: jackson-module-scala_2.11-2.6.5.jar
[info] Including from cache: jackson-module-paranamer-2.6.5.jar
[info] Including from cache: hadoop-hdfs-2.2.0.jar
[info] Including from cache: jetty-util-6.1.26.jar
[info] Including from cache: hadoop-mapreduce-client-app-2.2.0.jar
[info] Including from cache: ivy-2.4.0.jar
[info] Including from cache: oro-2.0.8.jar
[info] Including from cache: hadoop-mapreduce-client-common-2.2.0.jar
[info] Including from cache: pyrolite-4.13.jar
[info] Including from cache: py4j-0.10.4.jar
[info] Including from cache: hadoop-yarn-common-2.2.0.jar
[info] Including from cache: commons-crypto-1.0.0.jar
[info] Including from cache: hadoop-yarn-api-2.2.0.jar
[info] Including from cache: slf4j-log4j12-1.7.16.jar
[info] Including from cache: guice-3.0.jar
[info] Including from cache: javax.inject-1.jar
[info] Including from cache: aopalliance-1.0.jar
[info] Including from cache: cglib-2.2.1-v20090111.jar
[info] Including from cache: hadoop-yarn-client-2.2.0.jar
[info] Including from cache: hadoop-mapreduce-client-core-2.2.0.jar
[info] Including from cache: hadoop-yarn-server-common-2.2.0.jar
[info] Including from cache: hadoop-mapreduce-client-shuffle-2.2.0.jar
[info] Including from cache: hadoop-mapreduce-client-jobclient-2.2.0.jar
[info] Including from cache: spark-sql_2.11-2.1.0.jar
[info] Including from cache: spark-launcher_2.11-2.1.0.jar
[info] Including from cache: spark-tags_2.11-2.1.0.jar
[info] Including from cache: unused-1.0.0.jar
[info] Including from cache: univocity-parsers-2.2.1.jar
[info] Including from cache: spark-sketch_2.11-2.1.0.jar
[info] Including from cache: spark-network-common_2.11-2.1.0.jar
[info] Including from cache: netty-all-4.0.42.Final.jar
[info] Including from cache: commons-lang3-3.5.jar
[info] Including from cache: spark-catalyst_2.11-2.1.0.jar
[info] Including from cache: leveldbjni-all-1.8.jar
[info] Including from cache: janino-3.0.0.jar
[info] Including from cache: commons-compiler-3.0.0.jar
[info] Including from cache: jackson-databind-2.6.5.jar
[info] Including from cache: jackson-annotations-2.6.5.jar
[info] Including from cache: antlr4-runtime-4.5.3.jar
[info] Including from cache: jackson-core-2.6.5.jar
[info] Including from cache: spark-network-shuffle_2.11-2.1.0.jar
[info] Including from cache: commons-codec-1.10.jar
[info] Including from cache: metrics-core-3.1.2.jar
[info] Including from cache: spark-unsafe_2.11-2.1.0.jar
[info] Including from cache: jets3t-0.7.1.jar
[info] Including from cache: parquet-column-1.8.1.jar
[info] Including from cache: parquet-common-1.8.1.jar
[info] Including from cache: parquet-encoding-1.8.1.jar
[info] Including from cache: parquet-hadoop-1.8.1.jar
[info] Including from cache: parquet-format-2.3.0-incubating.jar
[info] Including from cache: parquet-jackson-1.8.1.jar
[info] Including from cache: scalactic_2.11-3.0.1.jar
[info] Including from cache: asm-all-5.1.jar
[info] Including from cache: scalatest_2.11-3.0.1.jar
[info] Including from cache: scala-xml_2.11-1.0.5.jar
[info] Checking every *.class/*.jar file's SHA-1.
[info] Merging files...
[warn] Merging 'META-INF/ASL2.0' with strategy 'discard'
[warn] Merging 'META-INF/DEPENDENCIES' with strategy 'discard'
[warn] Merging 'META-INF/DUMMY.DSA' with strategy 'discard'
[warn] Merging 'META-INF/DUMMY.SF' with strategy 'discard'
[warn] Merging 'META-INF/INDEX.LIST' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-ipc-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-ipc-1.7.7-tests' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-mapred-1.7.7-hadoop2' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-beanutils-1.7.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-beanutils-core-1.8.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-cli-1.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-codec-1.10.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-collections-3.2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-compress-1.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-configuration-1.6.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-digester-1.8.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-httpclient-3.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-io-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-lang-2.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-lang3-3.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-math-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-math3-3.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-net-2.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_compress-lzf-1.0.3' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_curator-client-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_curator-framework-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_curator-recipes-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_guice-3.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_ivy-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-annotations-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-core-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-core-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-databind-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-mapper-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-module-paranamer-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-module-scala_2.11-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_javax.annotation-api-1.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_javax.servlet-api-3.1.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_log4j-1.2.17' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_netty-3.8.0.Final.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_objenesis-2.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_oro-2.0.8' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-column-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-common-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-encoding-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-format-2.3.0-incubating' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-hadoop-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-jackson-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-catalyst_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-core_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-launcher_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-network-common_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-network-shuffle_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-sketch_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-sql_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-tags_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-unsafe_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_xbean-asm5-shaded-4.4' with strategy 'discard'
[warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-ipc-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-ipc-1.7.7-tests' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-mapred-1.7.7-hadoop2' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-beanutils-1.7.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-beanutils-core-1.8.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-cli-1.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-codec-1.10.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-collections-3.2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-compress-1.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-configuration-1.6.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-digester-1.8.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-httpclient-3.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-io-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-lang-2.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-lang3-3.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-math-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-math3-3.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-net-2.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_compress-lzf-1.0.3' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_curator-client-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_curator-framework-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_curator-recipes-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_guice-3.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_ivy-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-core-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-core-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-databind-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-mapper-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-module-paranamer-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_log4j-1.2.17' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_netty-3.8.0.Final.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_objenesis-2.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-column-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-common-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-encoding-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-format-2.3.0-incubating' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-hadoop-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-jackson-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-catalyst_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-core_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-launcher_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-network-common_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-network-shuffle_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-sketch_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-sql_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-tags_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-unsafe_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_xbean-asm5-shaded-4.4' with strategy 'discard'
[warn] Merging 'META-INF/README_commons-httpclient-3.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/io.netty.versions.properties' with strategy 'discard'
[warn] Merging 'META-INF/jboss-beans.xml' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.base64.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.commons-logging.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.felix.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.jboss-logging.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.jsr166y.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.jzlib.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.log4j.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.protobuf.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.slf4j.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.webbit.txt' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.clearspring.analytics/stream/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.clearspring.analytics/stream/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/kryo-shaded/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/kryo-shaded/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/minlog/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/minlog/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/reflectasm/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/reflectasm/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-annotations/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-annotations/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-databind/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-databind/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.module/jackson-module-paranamer/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.module/jackson-module-paranamer/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.guava/guava/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.guava/guava/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.protobuf/protobuf-java/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.protobuf/protobuf-java/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.ning/compress-lzf/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.ning/compress-lzf/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.thoughtworks.paranamer/paranamer/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.thoughtworks.paranamer/paranamer/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.univocity/univocity-parsers/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.univocity/univocity-parsers/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-cli/commons-cli/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-cli/commons-cli/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-codec/commons-codec/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-codec/commons-codec/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-collections/commons-collections/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-collections/commons-collections/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-configuration/commons-configuration/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-configuration/commons-configuration/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-io/commons-io/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-io/commons-io/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-lang/commons-lang/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-lang/commons-lang/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-net/commons-net/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-net/commons-net/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-graphite/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-graphite/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-json/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-json/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-jvm/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-jvm/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty-all/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty-all/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.annotation/javax.annotation-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.annotation/javax.annotation-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.servlet/javax.servlet-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.servlet/javax.servlet-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.validation/validation-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.validation/validation-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.ws.rs/javax.ws.rs-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.ws.rs/javax.ws.rs-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/jline/jline/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/jline/jline/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/log4j/log4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/log4j/log4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.razorvine/pyrolite/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.razorvine/pyrolite/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.sf.py4j/py4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.sf.py4j/py4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.antlr/antlr4-runtime/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.antlr/antlr4-runtime/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-ipc/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-ipc/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-mapred/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-mapred/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-compress/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-compress/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-crypto/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-crypto/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-lang3/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-lang3/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math3/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math3/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-framework/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-framework/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-recipes/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-recipes/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-annotations/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-annotations/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-auth/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-auth/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-hdfs/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-hdfs/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-app/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-app/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-jobclient/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-jobclient/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-shuffle/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-shuffle/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-server-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-server-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-column/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-column/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-encoding/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-encoding/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-format/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-format/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-hadoop/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-hadoop/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-jackson/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-jackson/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-catalyst_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-catalyst_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-core_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-core_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-launcher_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-launcher_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-common_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-common_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-shuffle_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-shuffle_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sketch_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sketch_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sql_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sql_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-tags_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-tags_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-unsafe_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-unsafe_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm-util/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm-util/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm5-shaded/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm5-shaded/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-continuation/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-continuation/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-http/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-http/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-io/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-io/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-plus/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-plus/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-proxy/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-proxy/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-security/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-security/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-server/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-server/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlet/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlet/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlets/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlets/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-util/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-util/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.fusesource.leveldbjni/leveldbjni-all/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.fusesource.leveldbjni/leveldbjni-all/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/aopalliance-repackaged/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/aopalliance-repackaged/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/javax.inject/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/javax.inject/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-locator/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-locator/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-utils/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-utils/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/osgi-resource-locator/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/osgi-resource-locator/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.bundles.repackaged/jersey-guava/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.bundles.repackaged/jersey-guava/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-server/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-server/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.media/jersey-media-jaxb/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.media/jersey-media-jaxb/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.javassist/javassist/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.javassist/javassist/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.jvnet/tiger-types/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.jvnet/tiger-types/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.mortbay.jetty/jetty-util/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.mortbay.jetty/jetty-util/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.roaringbitmap/RoaringBitmap/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.roaringbitmap/RoaringBitmap/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jcl-over-slf4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jcl-over-slf4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jul-to-slf4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jul-to-slf4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-log4j12/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-log4j12/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.spark-project.spark/unused/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.spark-project.spark/unused/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/native/libnetty-transport-native-epoll.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux32/libjansi.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux32/libleveldbjni.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux64/libjansi.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux64/libleveldbjni.so' with strategy 'discard'
[warn] Merging 'META-INF/native/osx/libjansi.jnilib' with strategy 'discard'
[warn] Merging 'META-INF/native/osx/libleveldbjni.jnilib' with strategy 'discard'
[warn] Merging 'META-INF/native/windows32/jansi.dll' with strategy 'discard'
[warn] Merging 'META-INF/native/windows32/leveldbjni.dll' with strategy 'discard'
[warn] Merging 'META-INF/native/windows64/jansi.dll' with strategy 'discard'
[warn] Merging 'META-INF/native/windows64/leveldbjni.dll' with strategy 'discard'
[warn] Merging 'META-INF/services/com.fasterxml.jackson.core.JsonFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/com.fasterxml.jackson.core.ObjectCodec' with strategy 'discard'
[warn] Merging 'META-INF/services/com.fasterxml.jackson.databind.Module' with strategy 'discard'
[warn] Merging 'META-INF/services/javax.script.ScriptEngineFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/javax.servlet.ServletContainerInitializer' with strategy 'discard'
[warn] Merging 'META-INF/services/javax.ws.rs.ext.RuntimeDelegate' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.commons.logging.LogFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.fs.FileSystem' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.io.compress.CompressionCodec' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.security.SecurityInfo' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.security.token.TokenIdentifier' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.security.token.TokenRenewer' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.spark.scheduler.SparkHistoryListenerFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.spark.sql.sources.DataSourceRegister' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.hk2.extension.ServiceLocatorGenerator' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.internal.spi.AutoDiscoverable' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.internal.spi.ForcedAutoDiscoverable' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.servlet.spi.AsyncContextDelegateProvider' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.servlet.spi.FilterUrlMappingsProvider' with strategy 'discard'
[warn] Merging 'javax/inject/Inject.class' with strategy 'first'
[warn] Merging 'javax/inject/Named.class' with strategy 'first'
[warn] Merging 'javax/inject/Provider.class' with strategy 'first'
[warn] Merging 'javax/inject/Qualifier.class' with strategy 'first'
[warn] Merging 'javax/inject/Scope.class' with strategy 'first'
[warn] Merging 'javax/inject/Singleton.class' with strategy 'first'
[warn] Merging 'org/aopalliance/aop/Advice.class' with strategy 'first'
[warn] Merging 'org/aopalliance/aop/AspectException.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/ConstructorInterceptor.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/ConstructorInvocation.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/Interceptor.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/Invocation.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/Joinpoint.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/MethodInterceptor.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/MethodInvocation.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BasicDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BasicDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanAccessLanguageException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanUtilsBean$1.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConstructorUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ContextClassLoaderLocal.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConversionException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConvertUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConvertUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/Converter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConvertingWrapDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/DynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/DynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/DynaProperty.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/JDBCDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/LazyDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/LazyDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/LazyDynaMap.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MappedPropertyDescriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MethodUtils$MethodDescriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MethodUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MutableDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/NestedNullException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/PropertyUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/PropertyUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ResultSetDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ResultSetIterator.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/RowSetDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/WrapDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/WrapDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/AbstractArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BigDecimalConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BigIntegerConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BooleanArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BooleanConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ByteArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ByteConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/CharacterArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/CharacterConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ClassConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/DoubleArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/DoubleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/FileConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/FloatArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/FloatConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/IntegerArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/IntegerConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/LongArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/LongConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ShortArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ShortConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/SqlDateConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/SqlTimeConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/SqlTimestampConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/StringArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/StringConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/URLConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/BaseLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtils$Descriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$1.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$Descriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleConvertUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleConvertUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/BigDecimalLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/BigIntegerLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/ByteLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/DateLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/DecimalLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/DoubleLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/FloatLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/IntegerLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/LongLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/ShortLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/SqlDateLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/SqlTimeLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/SqlTimestampLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/StringLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/ArrayStack.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/Buffer.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/BufferUnderflowException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$1.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$CollectionView.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$EntrySet.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$KeySet.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$Values.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap.class' with strategy 'first'
[warn] Merging 'org/apache/hadoop/yarn/factories/package-info.class' with strategy 'first'
[warn] Merging 'org/apache/hadoop/yarn/factory/providers/package-info.class' with strategy 'first'
[warn] Merging 'org/apache/hadoop/yarn/util/package-info.class' with strategy 'first'
[warn] Merging 'org/apache/spark/unused/UnusedStubClass.class' with strategy 'first'
[warn] Merging 'overview.html' with strategy 'first'
[warn] Merging 'rootdoc.txt' with strategy 'first'
[warn] Strategy 'discard' was applied to 375 files
[warn] Strategy 'first' was applied to 113 files
[info] Assembly up to date: /Users/AorJoa/Dropbox/repository/sparktest/target/scala-2.11/sparktest-testfatjar.jar
[info] FunSuiteWrapper:
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
17/03/26 12:23:28 INFO SparkContext: Running Spark version 2.1.0
17/03/26 12:23:28 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/03/26 12:23:28 INFO SecurityManager: Changing view acls to: AorJoa
17/03/26 12:23:28 INFO SecurityManager: Changing modify acls to: AorJoa
17/03/26 12:23:28 INFO SecurityManager: Changing view acls groups to:
17/03/26 12:23:28 INFO SecurityManager: Changing modify acls groups to:
17/03/26 12:23:28 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(AorJoa); groups with view permissions: Set(); users with modify permissions: Set(AorJoa); groups with modify permissions: Set()
17/03/26 12:23:29 INFO Utils: Successfully started service 'sparkDriver' on port 57240.
17/03/26 12:23:29 INFO SparkEnv: Registering MapOutputTracker
17/03/26 12:23:29 INFO SparkEnv: Registering BlockManagerMaster
17/03/26 12:23:29 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
17/03/26 12:23:29 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
17/03/26 12:23:29 INFO DiskBlockManager: Created local directory at /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/blockmgr-bf88de57-0276-44ce-92d4-838ed2583b59
17/03/26 12:23:29 INFO MemoryStore: MemoryStore started with capacity 380.7 MB
17/03/26 12:23:30 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/26 12:23:30 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/26 12:23:30 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.0.2:4040
17/03/26 12:23:30 INFO SparkContext: Added JAR /Users/AorJoa/Dropbox/repository/sparktest/target/scala-2.11/sparktest-testfatjar.jar at spark://192.168.0.2:57240/jars/sparktest-testfatjar.jar with timestamp 1490505810578
17/03/26 12:23:30 INFO Executor: Starting executor ID driver on host localhost
17/03/26 12:23:30 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 57242.
17/03/26 12:23:30 INFO NettyBlockTransferService: Server created on 192.168.0.2:57242
17/03/26 12:23:30 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
17/03/26 12:23:30 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.0.2, 57242, None)
17/03/26 12:23:30 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.0.2:57242 with 380.7 MB RAM, BlockManagerId(driver, 192.168.0.2, 57242, None)
17/03/26 12:23:30 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.0.2, 57242, None)
17/03/26 12:23:30 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.0.2, 57242, None)
17/03/26 12:23:32 INFO SparkContext: Starting job: count at CheckpointingTest.scala:30
17/03/26 12:23:32 INFO DAGScheduler: Got job 0 (count at CheckpointingTest.scala:30) with 10 output partitions
17/03/26 12:23:32 INFO DAGScheduler: Final stage: ResultStage 0 (count at CheckpointingTest.scala:30)
17/03/26 12:23:32 INFO DAGScheduler: Parents of final stage: List()
17/03/26 12:23:32 INFO DAGScheduler: Missing parents: List()
17/03/26 12:23:32 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[11] at filter at CheckpointingTest.scala:29), which has no missing parents
17/03/26 12:23:32 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 3.6 KB, free 380.7 MB)
17/03/26 12:23:32 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.1 KB, free 380.7 MB)
17/03/26 12:23:32 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 192.168.0.2:57242 (size: 2.1 KB, free: 380.7 MB)
17/03/26 12:23:32 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:996
17/03/26 12:23:32 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 0 (MapPartitionsRDD[11] at filter at CheckpointingTest.scala:29)
17/03/26 12:23:32 INFO TaskSchedulerImpl: Adding task set 0.0 with 10 tasks
17/03/26 12:23:32 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, executor driver, partition 0, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, localhost, executor driver, partition 1, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, localhost, executor driver, partition 2, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, localhost, executor driver, partition 3, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, localhost, executor driver, partition 4, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, localhost, executor driver, partition 5, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, localhost, executor driver, partition 6, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, localhost, executor driver, partition 7, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, localhost, executor driver, partition 8, PROCESS_LOCAL, 5935 bytes)
17/03/26 12:23:32 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, localhost, executor driver, partition 9, PROCESS_LOCAL, 5992 bytes)
17/03/26 12:23:32 INFO Executor: Running task 7.0 in stage 0.0 (TID 7)
17/03/26 12:23:32 INFO Executor: Running task 9.0 in stage 0.0 (TID 9)
17/03/26 12:23:32 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/03/26 12:23:32 INFO Executor: Running task 8.0 in stage 0.0 (TID 8)
17/03/26 12:23:32 INFO Executor: Running task 6.0 in stage 0.0 (TID 6)
17/03/26 12:23:32 INFO Executor: Running task 5.0 in stage 0.0 (TID 5)
17/03/26 12:23:32 INFO Executor: Running task 4.0 in stage 0.0 (TID 4)
17/03/26 12:23:32 INFO Executor: Running task 3.0 in stage 0.0 (TID 3)
17/03/26 12:23:32 INFO Executor: Running task 2.0 in stage 0.0 (TID 2)
17/03/26 12:23:32 INFO Executor: Running task 1.0 in stage 0.0 (TID 1)
17/03/26 12:23:32 INFO Executor: Fetching spark://192.168.0.2:57240/jars/sparktest-testfatjar.jar with timestamp 1490505810578
17/03/26 12:23:32 INFO TransportClientFactory: Successfully created connection to /192.168.0.2:57240 after 55 ms (0 ms spent in bootstraps)
17/03/26 12:23:32 INFO Utils: Fetching spark://192.168.0.2:57240/jars/sparktest-testfatjar.jar to /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/spark-6f97432e-033f-4c3e-9fb9-3b7cbfae916d/userFiles-63e5f879-d755-4a60-b918-cc6498794b55/fetchFileTemp2895856040943498387.tmp
17/03/26 12:23:34 INFO Executor: Adding file:/private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/spark-6f97432e-033f-4c3e-9fb9-3b7cbfae916d/userFiles-63e5f879-d755-4a60-b918-cc6498794b55/sparktest-testfatjar.jar to class loader
17/03/26 12:23:34 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1050 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 6.0 in stage 0.0 (TID 6). 1050 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 2.0 in stage 0.0 (TID 2). 963 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 5.0 in stage 0.0 (TID 5). 963 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 963 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 8.0 in stage 0.0 (TID 8). 963 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 7.0 in stage 0.0 (TID 7). 963 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 4.0 in stage 0.0 (TID 4). 1050 bytes result sent to driver
17/03/26 12:23:34 INFO Executor: Finished task 9.0 in stage 0.0 (TID 9). 963 bytes result sent to driver
17/03/26 12:23:34 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 2211 ms on localhost (executor driver) (1/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 2278 ms on localhost (executor driver) (2/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 8.0 in stage 0.0 (TID 8) in 2208 ms on localhost (executor driver) (3/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 2223 ms on localhost (executor driver) (4/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 2217 ms on localhost (executor driver) (5/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 2217 ms on localhost (executor driver) (6/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 2216 ms on localhost (executor driver) (7/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 9.0 in stage 0.0 (TID 9) in 2210 ms on localhost (executor driver) (8/10)
17/03/26 12:23:34 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 2214 ms on localhost (executor driver) (9/10)
17/03/26 12:23:34 INFO Executor: Finished task 3.0 in stage 0.0 (TID 3). 1050 bytes result sent to driver
17/03/26 12:23:34 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 2248 ms on localhost (executor driver) (10/10)
17/03/26 12:23:34 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
17/03/26 12:23:34 INFO DAGScheduler: ResultStage 0 (count at CheckpointingTest.scala:30) finished in 2.325 s
17/03/26 12:23:34 INFO DAGScheduler: Job 0 finished: count at CheckpointingTest.scala:30, took 2.918057 s
17/03/26 12:23:34 INFO SparkContext: Starting job: foreachPartition at HashRDD.scala:116
17/03/26 12:23:34 INFO DAGScheduler: Got job 1 (foreachPartition at HashRDD.scala:116) with 10 output partitions
17/03/26 12:23:34 INFO DAGScheduler: Final stage: ResultStage 1 (foreachPartition at HashRDD.scala:116)
17/03/26 12:23:34 INFO DAGScheduler: Parents of final stage: List()
17/03/26 12:23:34 INFO DAGScheduler: Missing parents: List()
17/03/26 12:23:34 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[9] at map at CheckpointingTest.scala:27), which has no missing parents
17/03/26 12:23:34 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 4.3 KB, free 380.7 MB)
17/03/26 12:23:36 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.5 KB, free 380.7 MB)
17/03/26 12:23:36 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on 192.168.0.2:57242 (size: 2.5 KB, free: 380.7 MB)
17/03/26 12:23:36 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:996
17/03/26 12:23:36 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 1 (MapPartitionsRDD[9] at map at CheckpointingTest.scala:27)
17/03/26 12:23:36 INFO TaskSchedulerImpl: Adding task set 1.0 with 10 tasks
17/03/26 12:23:36 INFO BlockManagerInfo: Removed broadcast_0_piece0 on 192.168.0.2:57242 in memory (size: 2.1 KB, free: 380.7 MB)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 10, localhost, executor driver, partition 0, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 11, localhost, executor driver, partition 1, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 12, localhost, executor driver, partition 2, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 13, localhost, executor driver, partition 3, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 14, localhost, executor driver, partition 4, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 5.0 in stage 1.0 (TID 15, localhost, executor driver, partition 5, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 6.0 in stage 1.0 (TID 16, localhost, executor driver, partition 6, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 7.0 in stage 1.0 (TID 17, localhost, executor driver, partition 7, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 8.0 in stage 1.0 (TID 18, localhost, executor driver, partition 8, PROCESS_LOCAL, 6023 bytes)
17/03/26 12:23:36 INFO TaskSetManager: Starting task 9.0 in stage 1.0 (TID 19, localhost, executor driver, partition 9, PROCESS_LOCAL, 6080 bytes)
17/03/26 12:23:36 INFO Executor: Running task 0.0 in stage 1.0 (TID 10)
17/03/26 12:23:36 INFO Executor: Running task 1.0 in stage 1.0 (TID 11)
17/03/26 12:23:36 INFO Executor: Running task 2.0 in stage 1.0 (TID 12)
17/03/26 12:23:36 INFO Executor: Finished task 1.0 in stage 1.0 (TID 11). 1418 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Finished task 0.0 in stage 1.0 (TID 10). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Running task 3.0 in stage 1.0 (TID 13)
17/03/26 12:23:36 INFO Executor: Finished task 2.0 in stage 1.0 (TID 12). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Running task 4.0 in stage 1.0 (TID 14)
17/03/26 12:23:36 INFO Executor: Finished task 3.0 in stage 1.0 (TID 13). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Running task 5.0 in stage 1.0 (TID 15)
17/03/26 12:23:36 INFO Executor: Finished task 4.0 in stage 1.0 (TID 14). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Running task 6.0 in stage 1.0 (TID 16)
17/03/26 12:23:36 INFO Executor: Running task 7.0 in stage 1.0 (TID 17)
17/03/26 12:23:36 INFO Executor: Finished task 6.0 in stage 1.0 (TID 16). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Running task 8.0 in stage 1.0 (TID 18)
17/03/26 12:23:36 INFO Executor: Finished task 7.0 in stage 1.0 (TID 17). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Running task 9.0 in stage 1.0 (TID 19)
17/03/26 12:23:36 INFO Executor: Finished task 9.0 in stage 1.0 (TID 19). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO Executor: Finished task 8.0 in stage 1.0 (TID 18). 1331 bytes result sent to driver
17/03/26 12:23:36 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 10) in 155 ms on localhost (executor driver) (1/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 11) in 81 ms on localhost (executor driver) (2/10)
17/03/26 12:23:36 INFO Executor: Finished task 5.0 in stage 1.0 (TID 15). 1252 bytes result sent to driver
17/03/26 12:23:36 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 12) in 85 ms on localhost (executor driver) (3/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 13) in 85 ms on localhost (executor driver) (4/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 14) in 85 ms on localhost (executor driver) (5/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 6.0 in stage 1.0 (TID 16) in 90 ms on localhost (executor driver) (6/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 7.0 in stage 1.0 (TID 17) in 95 ms on localhost (executor driver) (7/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 9.0 in stage 1.0 (TID 19) in 98 ms on localhost (executor driver) (8/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 8.0 in stage 1.0 (TID 18) in 102 ms on localhost (executor driver) (9/10)
17/03/26 12:23:36 INFO TaskSetManager: Finished task 5.0 in stage 1.0 (TID 15) in 117 ms on localhost (executor driver) (10/10)
17/03/26 12:23:36 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool
17/03/26 12:23:36 INFO DAGScheduler: ResultStage 1 (foreachPartition at HashRDD.scala:116) finished in 0.200 s
17/03/26 12:23:36 INFO DAGScheduler: Job 1 finished: foreachPartition at HashRDD.scala:116, took 1.477974 s
Path exist
17/03/26 12:23:36 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 127.1 KB, free 380.6 MB)
17/03/26 12:23:36 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 14.3 KB, free 380.6 MB)
17/03/26 12:23:36 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on 192.168.0.2:57242 (size: 14.3 KB, free: 380.7 MB)
17/03/26 12:23:36 INFO SparkContext: Created broadcast 2 from ReliableCheckpointRDD at ReliableCPRDDCheckpointData.scala:26
43
[info] CheckpointingTest:
[info] - Parallelize data from Sparktest Context
[info] - Duplicate test case
[info] Run completed in 9 seconds, 71 milliseconds.
[info] Total number of tests run: 2
[info] Suites: completed 2, aborted 0
[info] Tests: succeeded 2, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 27 s, completed Mar 26, 2017 12:23:36 PM
17/03/26 12:23:36 INFO SparkContext: Invoking stop() from shutdown hook
17/03/26 12:23:36 INFO SparkUI: Stopped Spark web UI at http://192.168.0.2:4040
17/03/26 12:23:36 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/26 12:23:36 INFO MemoryStore: MemoryStore cleared
17/03/26 12:23:36 INFO BlockManager: BlockManager stopped
17/03/26 12:23:36 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/26 12:23:36 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/26 12:23:36 INFO SparkContext: Successfully stopped SparkContext
17/03/26 12:23:36 INFO ShutdownHookManager: Shutdown hook called
17/03/26 12:23:36 INFO ShutdownHookManager: Deleting directory /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/spark-6f97432e-033f-4c3e-9fb9-3b7cbfae916d
AorJoa@aorjoa:~/Dropbox/repository/sparktest$ sbt 'testOnlyOnSparkCluster th.ac.sut.aiyara.sparktest.CheckpointingTest'
[info] Loading project definition from /Users/AorJoa/Dropbox/repository/sparktest/project
[info] Set current project to sparktest (in build file:/Users/AorJoa/Dropbox/repository/sparktest/)
>> th.ac.sut.aiyara.sparktest.CheckpointingTest
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
17/03/26 12:11:32 INFO SparkContext: Running Spark version 2.1.0
17/03/26 12:11:33 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/03/26 12:11:33 INFO SecurityManager: Changing view acls to: AorJoa
17/03/26 12:11:33 INFO SecurityManager: Changing modify acls to: AorJoa
17/03/26 12:11:33 INFO SecurityManager: Changing view acls groups to:
17/03/26 12:11:33 INFO SecurityManager: Changing modify acls groups to:
17/03/26 12:11:33 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(AorJoa); groups with view permissions: Set(); users with modify permissions: Set(AorJoa); groups with modify permissions: Set()
17/03/26 12:11:34 INFO Utils: Successfully started service 'sparkDriver' on port 57159.
17/03/26 12:11:34 INFO SparkEnv: Registering MapOutputTracker
17/03/26 12:11:34 INFO SparkEnv: Registering BlockManagerMaster
17/03/26 12:11:34 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
17/03/26 12:11:34 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
17/03/26 12:11:34 INFO DiskBlockManager: Created local directory at /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/blockmgr-a7146bc6-d994-451f-8c51-d0d98cd07184
17/03/26 12:11:34 INFO MemoryStore: MemoryStore started with capacity 408.9 MB
17/03/26 12:11:34 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/26 12:11:35 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/26 12:11:35 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.0.2:4040
17/03/26 12:11:36 INFO Executor: Starting executor ID driver on host localhost
17/03/26 12:11:36 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 57160.
17/03/26 12:11:36 INFO NettyBlockTransferService: Server created on 192.168.0.2:57160
17/03/26 12:11:36 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
17/03/26 12:11:36 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.0.2, 57160, None)
17/03/26 12:11:36 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.0.2:57160 with 408.9 MB RAM, BlockManagerId(driver, 192.168.0.2, 57160, None)
17/03/26 12:11:36 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.0.2, 57160, None)
17/03/26 12:11:36 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.0.2, 57160, None)
[info] CheckpointingTest:
[info] - Parallelize data from Sparktest Context
[info] Run completed in 8 seconds, 562 milliseconds.
[info] Total number of tests run: 1
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 1, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 11 s, completed Mar 26, 2017 12:11:40 PM
17/03/26 12:11:40 INFO SparkContext: Invoking stop() from shutdown hook
17/03/26 12:11:40 INFO SparkUI: Stopped Spark web UI at http://192.168.0.2:4040
17/03/26 12:11:40 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/26 12:11:40 INFO MemoryStore: MemoryStore cleared
17/03/26 12:11:40 INFO BlockManager: BlockManager stopped
17/03/26 12:11:40 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/26 12:11:40 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/26 12:11:40 INFO SparkContext: Successfully stopped SparkContext
17/03/26 12:11:40 INFO ShutdownHookManager: Shutdown hook called
17/03/26 12:11:40 INFO ShutdownHookManager: Deleting directory /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/spark-1e0e289f-7066-46a9-8d63-1d15f9020bbc
AorJoa@aorjoa:~/Dropbox/repository/sparktest$ sbt 'testOnlyOnSparkCluster th.ac.sut.aiyara.sparktest.CheckpointingTest -- -z """"Parallelize data from Sparktest Context""""'
[info] Loading project definition from /Users/AorJoa/Dropbox/repository/sparktest/project
[info] Set current project to sparktest (in build file:/Users/AorJoa/Dropbox/repository/sparktest/)
>> th.ac.sut.aiyara.sparktest.CheckpointingTest -- -z "Parallelize data from Sparktest Context"
[info] Compiling 1 Scala source to /Users/AorJoa/Dropbox/repository/sparktest/target/scala-2.11/test-classes...
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
17/03/26 12:12:44 INFO SparkContext: Running Spark version 2.1.0
17/03/26 12:12:45 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/03/26 12:12:45 INFO SecurityManager: Changing view acls to: AorJoa
17/03/26 12:12:45 INFO SecurityManager: Changing modify acls to: AorJoa
17/03/26 12:12:45 INFO SecurityManager: Changing view acls groups to:
17/03/26 12:12:45 INFO SecurityManager: Changing modify acls groups to:
17/03/26 12:12:45 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(AorJoa); groups with view permissions: Set(); users with modify permissions: Set(AorJoa); groups with modify permissions: Set()
17/03/26 12:12:46 INFO Utils: Successfully started service 'sparkDriver' on port 57184.
17/03/26 12:12:47 INFO SparkEnv: Registering MapOutputTracker
17/03/26 12:12:47 INFO SparkEnv: Registering BlockManagerMaster
17/03/26 12:12:47 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
17/03/26 12:12:47 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
17/03/26 12:12:47 INFO DiskBlockManager: Created local directory at /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/blockmgr-d47b6539-5d8d-48c6-afd9-c1441489beed
17/03/26 12:12:47 INFO MemoryStore: MemoryStore started with capacity 408.9 MB
17/03/26 12:12:47 INFO SparkEnv: Registering OutputCommitCoordinator
17/03/26 12:12:48 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/03/26 12:12:48 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.0.2:4040
17/03/26 12:12:48 INFO Executor: Starting executor ID driver on host localhost
17/03/26 12:12:48 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 57185.
17/03/26 12:12:48 INFO NettyBlockTransferService: Server created on 192.168.0.2:57185
17/03/26 12:12:48 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
17/03/26 12:12:48 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.0.2, 57185, None)
17/03/26 12:12:48 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.0.2:57185 with 408.9 MB RAM, BlockManagerId(driver, 192.168.0.2, 57185, None)
17/03/26 12:12:48 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.0.2, 57185, None)
17/03/26 12:12:48 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.0.2, 57185, None)
[info] CheckpointingTest:
[info] - Parallelize data from Sparktest Context
[info] Run completed in 6 seconds, 647 milliseconds.
[info] Total number of tests run: 1
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 1, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 29 s, completed Mar 26, 2017 12:12:50 PM
17/03/26 12:12:50 INFO SparkContext: Invoking stop() from shutdown hook
17/03/26 12:12:50 INFO SparkUI: Stopped Spark web UI at http://192.168.0.2:4040
17/03/26 12:12:50 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/03/26 12:12:50 INFO MemoryStore: MemoryStore cleared
17/03/26 12:12:50 INFO BlockManager: BlockManager stopped
17/03/26 12:12:50 INFO BlockManagerMaster: BlockManagerMaster stopped
17/03/26 12:12:50 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/03/26 12:12:50 INFO SparkContext: Successfully stopped SparkContext
17/03/26 12:12:50 INFO ShutdownHookManager: Shutdown hook called
17/03/26 12:12:50 INFO ShutdownHookManager: Deleting directory /private/var/folders/mz/8t0285053c93rldpy6bm5v8h0000gn/T/spark-d16f7462-2c5d-4d74-96be-d6debb9daadd
AorJoa@aorjoa:~/Dropbox/repository/sparktest$ sbt 'testQuickOnCluster'
[info] Loading project definition from /Users/AorJoa/Dropbox/repository/sparktest/project
[info] Set current project to sparktest (in build file:/Users/AorJoa/Dropbox/repository/sparktest/)
[info] Including from cache: curator-recipes-2.4.0.jar
[info] Including from cache: curator-framework-2.4.0.jar
[info] Including from cache: curator-client-2.4.0.jar
[info] Including from cache: zookeeper-3.4.5.jar
[info] Including from cache: guava-14.0.1.jar
[info] Including from cache: javax.servlet-api-3.1.0.jar
[info] Including from cache: scala-library-2.11.8.jar
[info] Including from cache: commons-math3-3.4.1.jar
[info] Including from cache: jul-to-slf4j-1.7.16.jar
[info] Including from cache: jcl-over-slf4j-1.7.16.jar
[info] Including from cache: compress-lzf-1.0.3.jar
[info] Including from cache: lz4-1.3.0.jar
[info] Including from cache: RoaringBitmap-0.5.11.jar
[info] Including from cache: json4s-jackson_2.11-3.2.11.jar
[info] Including from cache: json4s-core_2.11-3.2.11.jar
[info] Including from cache: json4s-ast_2.11-3.2.11.jar
[info] Including from cache: paranamer-2.6.jar
[info] Including from cache: scalap-2.11.8.jar
[info] Including from cache: spark-core_2.11-2.1.0.jar
[info] Including from cache: avro-mapred-1.7.7-hadoop2.jar
[info] Including from cache: avro-ipc-1.7.7.jar
[info] Including from cache: avro-ipc-1.7.7-tests.jar
[info] Including from cache: avro-1.7.7.jar
[info] Including from cache: jackson-core-asl-1.9.13.jar
[info] Including from cache: jackson-mapper-asl-1.9.13.jar
[info] Including from cache: scala-compiler-2.11.8.jar
[info] Including from cache: snappy-java-1.1.2.6.jar
[info] Including from cache: commons-compress-1.4.1.jar
[info] Including from cache: xz-1.0.jar
[info] Including from cache: slf4j-api-1.7.16.jar
[info] Including from cache: chill_2.11-0.8.0.jar
[info] Including from cache: chill-java-0.8.0.jar
[info] Including from cache: kryo-shaded-3.0.3.jar
[info] Including from cache: minlog-1.3.0.jar
[info] Including from cache: objenesis-2.1.jar
[info] Including from cache: xbean-asm5-shaded-4.4.jar
[info] Including from cache: scala-reflect-2.11.8.jar
[info] Including from cache: hadoop-client-2.2.0.jar
[info] Including from cache: scala-parser-combinators_2.11-1.0.4.jar
[info] Including from cache: jersey-client-2.22.2.jar
[info] Including from cache: javax.ws.rs-api-2.0.1.jar
[info] Including from cache: jersey-common-2.22.2.jar
[info] Including from cache: javax.annotation-api-1.2.jar
[info] Including from cache: hadoop-common-2.2.0.jar
[info] Including from cache: hadoop-annotations-2.2.0.jar
[info] Including from cache: jsr305-1.3.9.jar
[info] Including from cache: jersey-guava-2.22.2.jar
[info] Including from cache: commons-cli-1.2.jar
[info] Including from cache: hk2-api-2.4.0-b34.jar
[info] Including from cache: commons-math-2.1.jar
[info] Including from cache: hk2-utils-2.4.0-b34.jar
[info] Including from cache: xmlenc-0.52.jar
[info] Including from cache: aopalliance-repackaged-2.4.0-b34.jar
[info] Including from cache: javax.inject-2.4.0-b34.jar
[info] Including from cache: commons-httpclient-3.1.jar
[info] Including from cache: commons-io-2.1.jar
[info] Including from cache: hk2-locator-2.4.0-b34.jar
[info] Including from cache: javassist-3.18.1-GA.jar
[info] Including from cache: commons-net-2.2.jar
[info] Including from cache: osgi-resource-locator-1.0.1.jar
[info] Including from cache: log4j-1.2.17.jar
[info] Including from cache: commons-lang-2.5.jar
[info] Including from cache: jersey-server-2.22.2.jar
[info] Including from cache: jersey-media-jaxb-2.22.2.jar
[info] Including from cache: validation-api-1.1.0.Final.jar
[info] Including from cache: commons-configuration-1.6.jar
[info] Including from cache: jersey-container-servlet-2.22.2.jar
[info] Including from cache: commons-collections-3.2.1.jar
[info] Including from cache: jersey-container-servlet-core-2.22.2.jar
[info] Including from cache: commons-digester-1.8.jar
[info] Including from cache: netty-3.8.0.Final.jar
[info] Including from cache: stream-2.7.0.jar
[info] Including from cache: commons-beanutils-1.7.0.jar
[info] Including from cache: metrics-jvm-3.1.2.jar
[info] Including from cache: metrics-json-3.1.2.jar
[info] Including from cache: commons-beanutils-core-1.8.0.jar
[info] Including from cache: metrics-graphite-3.1.2.jar
[info] Including from cache: protobuf-java-2.5.0.jar
[info] Including from cache: jackson-module-scala_2.11-2.6.5.jar
[info] Including from cache: hadoop-auth-2.2.0.jar
[info] Including from cache: jackson-module-paranamer-2.6.5.jar
[info] Including from cache: ivy-2.4.0.jar
[info] Including from cache: oro-2.0.8.jar
[info] Including from cache: pyrolite-4.13.jar
[info] Including from cache: py4j-0.10.4.jar
[info] Including from cache: commons-crypto-1.0.0.jar
[info] Including from cache: hadoop-hdfs-2.2.0.jar
[info] Including from cache: jetty-util-6.1.26.jar
[info] Including from cache: hadoop-mapreduce-client-app-2.2.0.jar
[info] Including from cache: hadoop-mapreduce-client-common-2.2.0.jar
[info] Including from cache: hadoop-yarn-common-2.2.0.jar
[info] Including from cache: hadoop-yarn-api-2.2.0.jar
[info] Including from cache: slf4j-log4j12-1.7.16.jar
[info] Including from cache: guice-3.0.jar
[info] Including from cache: javax.inject-1.jar
[info] Including from cache: aopalliance-1.0.jar
[info] Including from cache: cglib-2.2.1-v20090111.jar
[info] Including from cache: hadoop-yarn-client-2.2.0.jar
[info] Including from cache: spark-sql_2.11-2.1.0.jar
[info] Including from cache: univocity-parsers-2.2.1.jar
[info] Including from cache: spark-sketch_2.11-2.1.0.jar
[info] Including from cache: hadoop-mapreduce-client-core-2.2.0.jar
[info] Including from cache: hadoop-yarn-server-common-2.2.0.jar
[info] Including from cache: hadoop-mapreduce-client-shuffle-2.2.0.jar
[info] Including from cache: hadoop-mapreduce-client-jobclient-2.2.0.jar
[info] Including from cache: spark-launcher_2.11-2.1.0.jar
[info] Including from cache: spark-tags_2.11-2.1.0.jar
[info] Including from cache: unused-1.0.0.jar
[info] Including from cache: spark-catalyst_2.11-2.1.0.jar
[info] Including from cache: spark-network-common_2.11-2.1.0.jar
[info] Including from cache: janino-3.0.0.jar
[info] Including from cache: commons-compiler-3.0.0.jar
[info] Including from cache: antlr4-runtime-4.5.3.jar
[info] Including from cache: netty-all-4.0.42.Final.jar
[info] Including from cache: commons-codec-1.10.jar
[info] Including from cache: commons-lang3-3.5.jar
[info] Including from cache: parquet-column-1.8.1.jar
[info] Including from cache: parquet-common-1.8.1.jar
[info] Including from cache: parquet-encoding-1.8.1.jar
[info] Including from cache: parquet-hadoop-1.8.1.jar
[info] Including from cache: leveldbjni-all-1.8.jar
[info] Including from cache: parquet-format-2.3.0-incubating.jar
[info] Including from cache: parquet-jackson-1.8.1.jar
[info] Including from cache: jackson-databind-2.6.5.jar
[info] Including from cache: jackson-annotations-2.6.5.jar
[info] Including from cache: scalactic_2.11-3.0.1.jar
[info] Including from cache: jackson-core-2.6.5.jar
[info] Including from cache: asm-all-5.1.jar
[info] Including from cache: spark-network-shuffle_2.11-2.1.0.jar
[info] Including from cache: metrics-core-3.1.2.jar
[info] Including from cache: spark-unsafe_2.11-2.1.0.jar
[info] Including from cache: jets3t-0.7.1.jar
[info] Including from cache: scalatest_2.11-3.0.1.jar
[info] Including from cache: scala-xml_2.11-1.0.5.jar
[info] Checking every *.class/*.jar file's SHA-1.
[info] Merging files...
[warn] Merging 'META-INF/ASL2.0' with strategy 'discard'
[warn] Merging 'META-INF/DEPENDENCIES' with strategy 'discard'
[warn] Merging 'META-INF/DUMMY.DSA' with strategy 'discard'
[warn] Merging 'META-INF/DUMMY.SF' with strategy 'discard'
[warn] Merging 'META-INF/INDEX.LIST' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-ipc-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-ipc-1.7.7-tests' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_avro-mapred-1.7.7-hadoop2' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-beanutils-1.7.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-beanutils-core-1.8.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-cli-1.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-codec-1.10.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-collections-3.2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-compress-1.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-configuration-1.6.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-digester-1.8.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-httpclient-3.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-io-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-lang-2.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-lang3-3.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-math-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-math3-3.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_commons-net-2.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_compress-lzf-1.0.3' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_curator-client-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_curator-framework-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_curator-recipes-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_guice-3.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_ivy-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-annotations-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-core-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-core-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-databind-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-mapper-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-module-paranamer-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_jackson-module-scala_2.11-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_javax.annotation-api-1.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_javax.servlet-api-3.1.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_log4j-1.2.17' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_netty-3.8.0.Final.txt' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_objenesis-2.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_oro-2.0.8' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-column-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-common-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-encoding-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-format-2.3.0-incubating' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-hadoop-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_parquet-jackson-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-catalyst_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-core_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-launcher_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-network-common_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-network-shuffle_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-sketch_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-sql_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-tags_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_spark-unsafe_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/LICENSE_xbean-asm5-shaded-4.4' with strategy 'discard'
[warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-ipc-1.7.7' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-ipc-1.7.7-tests' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_avro-mapred-1.7.7-hadoop2' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-beanutils-1.7.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-beanutils-core-1.8.0.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-cli-1.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-codec-1.10.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-collections-3.2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-compress-1.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-configuration-1.6.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-digester-1.8.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-httpclient-3.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-io-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-lang-2.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-lang3-3.5.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-math-2.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-math3-3.4.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_commons-net-2.2.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_compress-lzf-1.0.3' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_curator-client-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_curator-framework-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_curator-recipes-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_guice-3.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_ivy-2.4.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-core-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-core-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-databind-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-mapper-asl-1.9.13' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_jackson-module-paranamer-2.6.5' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_log4j-1.2.17' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_netty-3.8.0.Final.txt' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_objenesis-2.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-column-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-common-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-encoding-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-format-2.3.0-incubating' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-hadoop-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_parquet-jackson-1.8.1' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-catalyst_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-core_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-launcher_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-network-common_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-network-shuffle_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-sketch_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-sql_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-tags_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_spark-unsafe_2.11-2.1.0' with strategy 'discard'
[warn] Merging 'META-INF/NOTICE_xbean-asm5-shaded-4.4' with strategy 'discard'
[warn] Merging 'META-INF/README_commons-httpclient-3.1.txt' with strategy 'discard'
[warn] Merging 'META-INF/io.netty.versions.properties' with strategy 'discard'
[warn] Merging 'META-INF/jboss-beans.xml' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.base64.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.commons-logging.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.felix.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.jboss-logging.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.jsr166y.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.jzlib.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.log4j.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.protobuf.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.slf4j.txt' with strategy 'discard'
[warn] Merging 'META-INF/license_netty-3.8.0.Final/LICENSE.webbit.txt' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.clearspring.analytics/stream/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.clearspring.analytics/stream/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/kryo-shaded/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/kryo-shaded/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/minlog/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/minlog/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/reflectasm/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.esotericsoftware/reflectasm/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-annotations/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-annotations/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-databind/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.core/jackson-databind/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.module/jackson-module-paranamer/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.fasterxml.jackson.module/jackson-module-paranamer/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.guava/guava/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.guava/guava/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.protobuf/protobuf-java/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.google.protobuf/protobuf-java/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.ning/compress-lzf/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.ning/compress-lzf/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.thoughtworks.paranamer/paranamer/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.thoughtworks.paranamer/paranamer/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.univocity/univocity-parsers/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/com.univocity/univocity-parsers/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-cli/commons-cli/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-cli/commons-cli/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-codec/commons-codec/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-codec/commons-codec/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-collections/commons-collections/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-collections/commons-collections/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-configuration/commons-configuration/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-configuration/commons-configuration/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-io/commons-io/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-io/commons-io/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-lang/commons-lang/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-lang/commons-lang/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-net/commons-net/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/commons-net/commons-net/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-graphite/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-graphite/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-json/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-json/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-jvm/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.dropwizard.metrics/metrics-jvm/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty-all/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty-all/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/io.netty/netty/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.annotation/javax.annotation-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.annotation/javax.annotation-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.servlet/javax.servlet-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.servlet/javax.servlet-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.validation/validation-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.validation/validation-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.ws.rs/javax.ws.rs-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/javax.ws.rs/javax.ws.rs-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/jline/jline/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/jline/jline/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/log4j/log4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/log4j/log4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.razorvine/pyrolite/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.razorvine/pyrolite/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.sf.py4j/py4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/net.sf.py4j/py4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.antlr/antlr4-runtime/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.antlr/antlr4-runtime/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-ipc/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-ipc/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-mapred/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro-mapred/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.avro/avro/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-compress/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-compress/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-crypto/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-crypto/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-lang3/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-lang3/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math3/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.commons/commons-math3/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-framework/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-framework/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-recipes/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.curator/curator-recipes/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-annotations/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-annotations/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-auth/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-auth/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-hdfs/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-hdfs/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-app/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-app/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-jobclient/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-jobclient/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-shuffle/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-mapreduce-client-shuffle/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-server-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.hadoop/hadoop-yarn-server-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-column/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-column/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-encoding/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-encoding/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-format/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-format/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-hadoop/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-hadoop/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-jackson/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.parquet/parquet-jackson/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-catalyst_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-catalyst_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-core_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-core_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-launcher_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-launcher_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-common_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-common_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-shuffle_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-network-shuffle_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sketch_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sketch_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sql_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-sql_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-tags_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-tags_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-unsafe_2.11/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.spark/spark-unsafe_2.11/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm-util/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm-util/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm5-shaded/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.apache.xbean/xbean-asm5-shaded/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-continuation/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-continuation/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-http/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-http/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-io/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-io/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-plus/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-plus/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-proxy/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-proxy/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-security/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-security/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-server/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-server/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlet/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlet/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlets/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-servlets/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-util/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.eclipse.jetty/jetty-util/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.fusesource.leveldbjni/leveldbjni-all/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.fusesource.leveldbjni/leveldbjni-all/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/aopalliance-repackaged/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/aopalliance-repackaged/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/javax.inject/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2.external/javax.inject/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-locator/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-locator/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-utils/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/hk2-utils/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/osgi-resource-locator/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.hk2/osgi-resource-locator/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.bundles.repackaged/jersey-guava/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.bundles.repackaged/jersey-guava/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet-core/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet-core/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.containers/jersey-container-servlet/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-client/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-client/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-common/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-common/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-server/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.core/jersey-server/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.media/jersey-media-jaxb/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.glassfish.jersey.media/jersey-media-jaxb/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.javassist/javassist/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.javassist/javassist/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.jvnet/tiger-types/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.jvnet/tiger-types/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.mortbay.jetty/jetty-util/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.mortbay.jetty/jetty-util/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.roaringbitmap/RoaringBitmap/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.roaringbitmap/RoaringBitmap/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jcl-over-slf4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jcl-over-slf4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jul-to-slf4j/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/jul-to-slf4j/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-api/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-api/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-log4j12/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.slf4j/slf4j-log4j12/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.spark-project.spark/unused/pom.properties' with strategy 'discard'
[warn] Merging 'META-INF/maven/org.spark-project.spark/unused/pom.xml' with strategy 'discard'
[warn] Merging 'META-INF/native/libnetty-transport-native-epoll.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux32/libjansi.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux32/libleveldbjni.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux64/libjansi.so' with strategy 'discard'
[warn] Merging 'META-INF/native/linux64/libleveldbjni.so' with strategy 'discard'
[warn] Merging 'META-INF/native/osx/libjansi.jnilib' with strategy 'discard'
[warn] Merging 'META-INF/native/osx/libleveldbjni.jnilib' with strategy 'discard'
[warn] Merging 'META-INF/native/windows32/jansi.dll' with strategy 'discard'
[warn] Merging 'META-INF/native/windows32/leveldbjni.dll' with strategy 'discard'
[warn] Merging 'META-INF/native/windows64/jansi.dll' with strategy 'discard'
[warn] Merging 'META-INF/native/windows64/leveldbjni.dll' with strategy 'discard'
[warn] Merging 'META-INF/services/com.fasterxml.jackson.core.JsonFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/com.fasterxml.jackson.core.ObjectCodec' with strategy 'discard'
[warn] Merging 'META-INF/services/com.fasterxml.jackson.databind.Module' with strategy 'discard'
[warn] Merging 'META-INF/services/javax.script.ScriptEngineFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/javax.servlet.ServletContainerInitializer' with strategy 'discard'
[warn] Merging 'META-INF/services/javax.ws.rs.ext.RuntimeDelegate' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.commons.logging.LogFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.fs.FileSystem' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.io.compress.CompressionCodec' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.security.SecurityInfo' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.security.token.TokenIdentifier' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.hadoop.security.token.TokenRenewer' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.spark.scheduler.SparkHistoryListenerFactory' with strategy 'discard'
[warn] Merging 'META-INF/services/org.apache.spark.sql.sources.DataSourceRegister' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.hk2.extension.ServiceLocatorGenerator' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.internal.spi.AutoDiscoverable' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.internal.spi.ForcedAutoDiscoverable' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.servlet.spi.AsyncContextDelegateProvider' with strategy 'discard'
[warn] Merging 'META-INF/services/org.glassfish.jersey.servlet.spi.FilterUrlMappingsProvider' with strategy 'discard'
[warn] Merging 'javax/inject/Inject.class' with strategy 'first'
[warn] Merging 'javax/inject/Named.class' with strategy 'first'
[warn] Merging 'javax/inject/Provider.class' with strategy 'first'
[warn] Merging 'javax/inject/Qualifier.class' with strategy 'first'
[warn] Merging 'javax/inject/Scope.class' with strategy 'first'
[warn] Merging 'javax/inject/Singleton.class' with strategy 'first'
[warn] Merging 'org/aopalliance/aop/Advice.class' with strategy 'first'
[warn] Merging 'org/aopalliance/aop/AspectException.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/ConstructorInterceptor.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/ConstructorInvocation.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/Interceptor.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/Invocation.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/Joinpoint.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/MethodInterceptor.class' with strategy 'first'
[warn] Merging 'org/aopalliance/intercept/MethodInvocation.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BasicDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BasicDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanAccessLanguageException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanUtilsBean$1.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/BeanUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConstructorUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ContextClassLoaderLocal.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConversionException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConvertUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConvertUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/Converter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ConvertingWrapDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/DynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/DynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/DynaProperty.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/JDBCDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/LazyDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/LazyDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/LazyDynaMap.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MappedPropertyDescriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MethodUtils$MethodDescriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MethodUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/MutableDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/NestedNullException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/PropertyUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/PropertyUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ResultSetDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/ResultSetIterator.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/RowSetDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/WrapDynaBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/WrapDynaClass.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/AbstractArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BigDecimalConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BigIntegerConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BooleanArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/BooleanConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ByteArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ByteConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/CharacterArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/CharacterConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ClassConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/DoubleArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/DoubleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/FileConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/FloatArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/FloatConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/IntegerArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/IntegerConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/LongArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/LongConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ShortArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/ShortConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/SqlDateConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/SqlTimeConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/SqlTimestampConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/StringArrayConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/StringConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/converters/URLConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/BaseLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtils$Descriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$1.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$Descriptor.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleBeanUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleConvertUtils.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleConvertUtilsBean.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/LocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/BigDecimalLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/BigIntegerLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/ByteLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/DateLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/DecimalLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/DoubleLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/FloatLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/IntegerLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/LongLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/ShortLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/SqlDateLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/SqlTimeLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/SqlTimestampLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/beanutils/locale/converters/StringLocaleConverter.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/ArrayStack.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/Buffer.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/BufferUnderflowException.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$1.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$CollectionView.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$EntrySet.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$KeySet.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap$Values.class' with strategy 'first'
[warn] Merging 'org/apache/commons/collections/FastHashMap.class' with strategy 'first'
[warn] Merging 'org/apache/hadoop/yarn/factories/package-info.class' with strategy 'first'
[warn] Merging 'org/apache/hadoop/yarn/factory/providers/package-info.class' with strategy 'first'
[warn] Merging 'org/apache/hadoop/yarn/util/package-info.class' with strategy 'first'
[warn] Merging 'org/apache/spark/unused/UnusedStubClass.class' with strategy 'first'
[warn] Merging 'overview.html' with strategy 'first'
[warn] Merging 'rootdoc.txt' with strategy 'first'
[warn] Strategy 'discard' was applied to 375 files
[warn] Strategy 'first' was applied to 113 files
[info] Assembly up to date: /Users/AorJoa/Dropbox/repository/sparktest/target/scala-2.11/sparktest-testfatjar.jar
[info] Run completed in 95 milliseconds.
[info] Total number of tests run: 0
[info] Suites: completed 0, aborted 0
[info] Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
[info] No tests were executed.
[info] No tests to run for test:testQuick
[success] Total time: 18 s, completed Mar 26, 2017 12:19:46 PM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment