Skip to content

Instantly share code, notes, and snippets.

@timrobertson100

timrobertson100/gist:cbbd1175bcfce8132746

Created October 13, 2014 15:16
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save timrobertson100/cbbd1175bcfce8132746 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save timrobertson100/cbbd1175bcfce8132746 to your computer and use it in GitHub Desktop.
Download ZIP
Complete download log
Raw
gistfile1.txt
Task Logs: 'attempt_201410110944_1171_m_000000_0'
stdout logs
Oozie Launcher starts
Heart beat
Starting the execution of prepare actions
Completed the execution of prepare actions successfully
Files in current dir:/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/.
======================
File: .action.xml.crc
File: execute-query.q
Dir: tmp
File: action.xml
Oozie Java/Map-Reduce/Pig action launcher-job configuration
=================================================================
Workflow job id : 0000345-141011094409524-oozie-oozi-W
Workflow action id: 0000345-141011094409524-oozie-oozi-W@execute_query
Classpath :
------------------------
/var/run/cloudera-scm-agent/process/6086-mapreduce-TASKTRACKER
/etc/alternatives/java_sdk/lib/tools.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar
/usr/share/cmf/lib/plugins/tt-instrumentation-4.8.4.jar
/usr/share/cmf/lib/plugins/navigator-plugin-4.8.4-shaded.jar
/usr/share/cmf/lib/plugins/event-publish-4.8.4-shaded.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsp-api-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/log4j-1.2.17.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-cli-1.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-core-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/asm-3.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-io-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-el-1.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/guava-11.0.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-server-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-lang-2.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/xmlenc-0.52.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/servlet-api-2.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jline-0.9.94.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-codec-1.4.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0-tests.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/stax-api-1.0.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jettison-1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-digester-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsp-api-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/log4j-1.2.17.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-cli-1.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-core-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/asm-3.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-json-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/activation-1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-io-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-httpclient-3.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-collections-3.2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/kfs-0.3.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-logging-1.1.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-core-asl-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-math-2.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-el-1.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-xc-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-compiler-5.5.23.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/guava-11.0.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-api-1.6.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-server-1.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-1.7.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-compress-1.4.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-lang-2.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/protobuf-java-2.4.0a.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xmlenc-0.52.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/zookeeper-3.4.5-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xz-1.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/servlet-api-2.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-configuration-1.6.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsch-0.1.42.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-api-2.2.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jets3t-0.6.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/avro-1.7.4.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jline-0.9.94.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsr305-1.3.9.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/junit-4.8.2.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/snappy-java-1.0.4.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-runtime-5.5.23.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-net-3.1.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/paranamer-2.3.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/hue-plugins-2.3.0-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-codec-1.4.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/mockito-all-1.8.5.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth-2.0.0-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0-tests.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0.jar
/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations-2.0.0-cdh4.3.0.jar
/mnt/disk_k/mapred/local/taskTracker/tim/distcache/-2419547164330444746_-924393689_168854042/c1n8.gbif.org/user/tim/oozie-oozi/0000345-141011094409524-oozie-oozi-W/execute_query--hive/hive-launcher.jar
/mnt/disk_l/mapred/local/taskTracker/tim/distcache/1327830332319217524_-1424817990_168819721/c1n8.gbif.org/user/tim/occurrence-download/lib/dwc-api-1.8.jar
/mnt/disk_m/mapred/local/taskTracker/tim/distcache/-2276870508301785354_1671550193_168819768/c1n8.gbif.org/user/tim/occurrence-download/lib/dwca-reader-1.18.jar
/mnt/disk_a/mapred/local/taskTracker/tim/distcache/-378732202986136417_436075483_168819903/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-api-0.15.jar
/mnt/disk_b/mapred/local/taskTracker/tim/distcache/-8036343093385781896_1674591892_168819967/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-common-0.15.jar
/mnt/disk_c/mapred/local/taskTracker/tim/distcache/2197863525673714827_2037280993_168820021/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-common-service-0.10.jar
/mnt/disk_d/mapred/local/taskTracker/tim/distcache/7479254169846544280_-1504854081_168820134/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-common-ws-0.15.jar
/mnt/disk_e/mapred/local/taskTracker/tim/distcache/8871098396950670709_1120760165_168820192/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-httputils-0.5.jar
/mnt/disk_f/mapred/local/taskTracker/tim/distcache/8642479400905384723_-1746157353_168820299/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-metadata-profile-1.0.2.2.jar
/mnt/disk_g/mapred/local/taskTracker/tim/distcache/837553663409715071_1171670679_168820564/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-parsers-0.8.jar
/mnt/disk_h/mapred/local/taskTracker/tim/distcache/3565441052995130458_229475709_168820643/c1n8.gbif.org/user/tim/occurrence-download/lib/hbase-utils-0.6.jar
/mnt/disk_i/mapred/local/taskTracker/tim/distcache/-1889397436385831009_-1889068960_168820744/c1n8.gbif.org/user/tim/occurrence-download/lib/jts-1.13.jar
/mnt/disk_j/mapred/local/taskTracker/tim/distcache/-97356936702020438_-1525610503_168820801/c1n8.gbif.org/user/tim/occurrence-download/lib/name-parser-2.4.jar
/mnt/disk_k/mapred/local/taskTracker/tim/distcache/1619906511928542682_-934670950_168820906/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-common-0.21.1-SNAPSHOT.jar
/mnt/disk_l/mapred/local/taskTracker/tim/distcache/-6704578665744900776_-825542307_168820976/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-download-0.21.1-SNAPSHOT.jar
/mnt/disk_m/mapred/local/taskTracker/tim/distcache/1211068886385056434_-551785995_168821057/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-hive-0.21.1-SNAPSHOT.jar
/mnt/disk_a/mapred/local/taskTracker/tim/distcache/-3867503521597705103_-1231285786_168821259/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-parser-0.21.1-SNAPSHOT.jar
/mnt/disk_b/mapred/local/taskTracker/tim/distcache/-1400956900580716579_-1747164164_168821374/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-persistence-0.21.1-SNAPSHOT.jar
/mnt/disk_c/mapred/local/taskTracker/tim/distcache/1040774508414451330_322789161_168821518/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-processor-0.21.1-SNAPSHOT.jar
/mnt/disk_i/mapred/local/taskTracker/distcache/660722571291778850_592074918_2032697981/c1n8.gbif.org/user/oozie/share/lib/hive/JavaEWAH-0.3.2.jar
/mnt/disk_j/mapred/local/taskTracker/distcache/-7919792044136664633_-191053639_2032698028/c1n8.gbif.org/user/oozie/share/lib/hive/ST4-4.0.4.jar
/mnt/disk_k/mapred/local/taskTracker/distcache/1115078426298823665_-1537676361_2032698070/c1n8.gbif.org/user/oozie/share/lib/hive/antlr-2.7.7.jar
/mnt/disk_l/mapred/local/taskTracker/distcache/808390822123018727_-55620254_2032698109/c1n8.gbif.org/user/oozie/share/lib/hive/antlr-3.4.jar
/mnt/disk_m/mapred/local/taskTracker/distcache/1086172539559942778_815158583_2032698141/c1n8.gbif.org/user/oozie/share/lib/hive/antlr-runtime-3.4.jar
/mnt/disk_a/mapred/local/taskTracker/distcache/-6453988693767730670_-409859930_2032698186/c1n8.gbif.org/user/oozie/share/lib/hive/avro-ipc-1.7.3-tests.jar
/mnt/disk_b/mapred/local/taskTracker/distcache/-5885142604894956797_484618426_2032698216/c1n8.gbif.org/user/oozie/share/lib/hive/avro-ipc-1.7.3.jar
/mnt/disk_c/mapred/local/taskTracker/distcache/2342855131755552549_-1171435783_2032698242/c1n8.gbif.org/user/oozie/share/lib/hive/avro-mapred-1.7.3.jar
/mnt/disk_d/mapred/local/taskTracker/distcache/-8661369265046894942_-1557262226_2066282374/c1n8.gbif.org/user/oozie/share/lib/hive/brickhouse.jar
/mnt/disk_e/mapred/local/taskTracker/distcache/-656153433533474799_-105747152_2032698267/c1n8.gbif.org/user/oozie/share/lib/hive/commons-beanutils-1.7.0.jar
/mnt/disk_f/mapred/local/taskTracker/distcache/-1558402481333088828_-359982675_2032698291/c1n8.gbif.org/user/oozie/share/lib/hive/commons-beanutils-core-1.8.0.jar
/mnt/disk_g/mapred/local/taskTracker/distcache/-8069497393172855715_1229323422_2032698329/c1n8.gbif.org/user/oozie/share/lib/hive/commons-collections-3.2.1.jar
/mnt/disk_h/mapred/local/taskTracker/distcache/-4316918033027840345_1742093049_2032698367/c1n8.gbif.org/user/oozie/share/lib/hive/commons-compress-1.4.1.jar
/mnt/disk_i/mapred/local/taskTracker/distcache/-2995491173417893214_-1539802306_2032698392/c1n8.gbif.org/user/oozie/share/lib/hive/commons-configuration-1.6.jar
/mnt/disk_j/mapred/local/taskTracker/distcache/2259397256737111007_-1723259917_2032698418/c1n8.gbif.org/user/oozie/share/lib/hive/commons-dbcp-1.4.jar
/mnt/disk_k/mapred/local/taskTracker/distcache/5076429935541653262_123363881_2032698450/c1n8.gbif.org/user/oozie/share/lib/hive/commons-digester-1.8.jar
/mnt/disk_l/mapred/local/taskTracker/distcache/3197054020845034197_-176739397_2032698474/c1n8.gbif.org/user/oozie/share/lib/hive/commons-pool-1.5.4.jar
/mnt/disk_m/mapred/local/taskTracker/distcache/-1996853769606979102_-1253764861_2032698500/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-connectionpool-2.0.3.jar
/mnt/disk_a/mapred/local/taskTracker/distcache/7705918878927518275_-620910082_2032698549/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-core-2.0.3.jar
/mnt/disk_b/mapred/local/taskTracker/distcache/-8142213829332673036_935803385_2032698574/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-enhancer-2.0.3.jar
/mnt/disk_c/mapred/local/taskTracker/distcache/3103344607238516921_-1770915715_2032698613/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-rdbms-2.0.3.jar
/mnt/disk_d/mapred/local/taskTracker/distcache/-6144063379545239762_499444284_2032698668/c1n8.gbif.org/user/oozie/share/lib/hive/derby-10.6.1.0.jar
/mnt/disk_e/mapred/local/taskTracker/distcache/4963212666244545307_1293020600_2032698712/c1n8.gbif.org/user/oozie/share/lib/hive/guava-11.0.2.jar
/mnt/disk_f/mapred/local/taskTracker/distcache/3096406466083731725_1308999569_2032698747/c1n8.gbif.org/user/oozie/share/lib/hive/haivvreo-1.0.7-cdh-4.jar
/mnt/disk_g/mapred/local/taskTracker/distcache/-7287018635889773791_-495153396_2066326503/c1n8.gbif.org/user/oozie/share/lib/hive/hbase-0.94.6-cdh4.3.0-security.jar
/mnt/disk_h/mapred/local/taskTracker/distcache/-7212712620247681758_1670524825_2032698778/c1n8.gbif.org/user/oozie/share/lib/hive/hive-builtins-0.10.0-cdh4.2.1.jar
/mnt/disk_i/mapred/local/taskTracker/distcache/-5508838536153655850_-852934155_2032698806/c1n8.gbif.org/user/oozie/share/lib/hive/hive-cli-0.10.0-cdh4.2.1.jar
/mnt/disk_j/mapred/local/taskTracker/distcache/-1724760949819760235_1937524798_2032698837/c1n8.gbif.org/user/oozie/share/lib/hive/hive-common-0.10.0-cdh4.2.1.jar
/mnt/disk_k/mapred/local/taskTracker/distcache/8779018562166004250_1622138524_2032698865/c1n8.gbif.org/user/oozie/share/lib/hive/hive-contrib-0.10.0-cdh4.2.1.jar
/mnt/disk_l/mapred/local/taskTracker/distcache/4453643090167504797_859430104_2032698938/c1n8.gbif.org/user/oozie/share/lib/hive/hive-exec-0.10.0-cdh4.2.1.jar
/mnt/disk_m/mapred/local/taskTracker/distcache/-150472142332504288_929193439_2066328583/c1n8.gbif.org/user/oozie/share/lib/hive/hive-hbase-handler-0.10.0-cdh4.3.0.jar
/mnt/disk_a/mapred/local/taskTracker/distcache/-6459279734595263991_204088345_2032698995/c1n8.gbif.org/user/oozie/share/lib/hive/hive-metastore-0.10.0-cdh4.2.1.jar
/mnt/disk_b/mapred/local/taskTracker/distcache/-2134212567176594704_901207252_2032699029/c1n8.gbif.org/user/oozie/share/lib/hive/hive-serde-0.10.0-cdh4.2.1.jar
/mnt/disk_c/mapred/local/taskTracker/distcache/-7604375827486635078_-583979008_2032699072/c1n8.gbif.org/user/oozie/share/lib/hive/hive-service-0.10.0-cdh4.2.1.jar
/mnt/disk_d/mapred/local/taskTracker/distcache/-300471604788145946_1339116411_2032699098/c1n8.gbif.org/user/oozie/share/lib/hive/hive-shims-0.10.0-cdh4.2.1.jar
/mnt/disk_e/mapred/local/taskTracker/distcache/-80402232484241882_-1593090421_2032699133/c1n8.gbif.org/user/oozie/share/lib/hive/httpclient-4.1.3.jar
/mnt/disk_f/mapred/local/taskTracker/distcache/-8414054380262483919_968032375_2032699157/c1n8.gbif.org/user/oozie/share/lib/hive/httpcore-4.1.3.jar
/mnt/disk_g/mapred/local/taskTracker/distcache/2969346412340279255_1617347983_2032699185/c1n8.gbif.org/user/oozie/share/lib/hive/jackson-core-asl-1.8.8.jar
/mnt/disk_h/mapred/local/taskTracker/distcache/7335450254919805525_1782213101_2032699222/c1n8.gbif.org/user/oozie/share/lib/hive/jackson-mapper-asl-1.8.8.jar
/mnt/disk_i/mapred/local/taskTracker/distcache/-299617206559022358_-1562481212_2032699248/c1n8.gbif.org/user/oozie/share/lib/hive/jdo2-api-2.3-ec.jar
/mnt/disk_j/mapred/local/taskTracker/distcache/5704944918383210922_1698170961_2032699276/c1n8.gbif.org/user/oozie/share/lib/hive/jetty-util-6.1.26.cloudera.2.jar
/mnt/disk_k/mapred/local/taskTracker/distcache/1589926563671077777_1529448496_2032699306/c1n8.gbif.org/user/oozie/share/lib/hive/jline-0.9.94.jar
/mnt/disk_l/mapred/local/taskTracker/distcache/-4247066182055940134_-1974914195_2032699339/c1n8.gbif.org/user/oozie/share/lib/hive/json-20090211.jar
/mnt/disk_m/mapred/local/taskTracker/distcache/-7819630153425881455_-1161105686_2032699371/c1n8.gbif.org/user/oozie/share/lib/hive/jsr305-1.3.9.jar
/mnt/disk_a/mapred/local/taskTracker/distcache/9061426366440182887_114757533_2032699403/c1n8.gbif.org/user/oozie/share/lib/hive/jta-1.1.jar
/mnt/disk_b/mapred/local/taskTracker/distcache/3196277594091925445_375536424_2032699432/c1n8.gbif.org/user/oozie/share/lib/hive/libfb303-0.9.0.jar
/mnt/disk_c/mapred/local/taskTracker/distcache/-1938470968400338142_823916269_2032699462/c1n8.gbif.org/user/oozie/share/lib/hive/libthrift-0.9.0.jar
/mnt/disk_d/mapred/local/taskTracker/distcache/-2983104662351042407_2004880227_2032699499/c1n8.gbif.org/user/oozie/share/lib/hive/netty-3.4.0.Final.jar
/mnt/disk_e/mapred/local/taskTracker/distcache/-730911584618403147_-1214278315_2032699532/c1n8.gbif.org/user/oozie/share/lib/hive/stringtemplate-3.2.1.jar
/mnt/disk_f/mapred/local/taskTracker/distcache/100082538975350415_1204788005_2032699560/c1n8.gbif.org/user/oozie/share/lib/hive/xz-1.0.jar
/mnt/disk_g/mapred/local/taskTracker/distcache/-1762199384237602021_2172619_2066330759/c1n8.gbif.org/user/oozie/share/lib/hive/zookeeper-3.4.5-cdh4.3.0.jar
/mnt/disk_l/mapred/local/taskTracker/distcache/8382222431042772074_1681337991_2032699653/c1n8.gbif.org/user/oozie/share/lib/oozie/json-simple-1.1.jar
/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work
------------------------
Main class : org.apache.oozie.action.hadoop.HiveMain
Maximum output : 2048
Arguments :
Java System Properties:
------------------------
#
#Mon Oct 13 17:11:42 CEST 2014
java.runtime.name=OpenJDK Runtime Environment
hadoop.tasklog.taskid=attempt_201410110944_1171_m_000000_0
oozie.action.externalChildIDs.properties=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/externalChildIds.properties
sun.boot.library.path=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/amd64
java.vm.version=24.65-b04
hadoop.root.logger=INFO,TLA
java.vm.vendor=Oracle Corporation
java.vendor.url=http\://java.oracle.com/
path.separator=\:
java.vm.name=OpenJDK 64-Bit Server VM
file.encoding.pkg=sun.io
user.country=US
sun.java.launcher=SUN_STANDARD
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work
java.runtime.version=1.7.0_65-mockbuild_2014_07_16_06_06-b00
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/endorsed
os.arch=amd64
oozie.job.id=0000345-141011094409524-oozie-oozi-W
oozie.action.id=0000345-141011094409524-oozie-oozi-W@execute_query
java.io.tmpdir=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/tmp
line.separator=\n
oozie.action.output.properties=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/output.properties
hadoop.tasklog.totalLogFileSize=0
java.vm.specification.vendor=Oracle Corporation
os.name=Linux
log4j.configuration=task-log4j.properties
sun.jnu.encoding=UTF-8
java.library.path=/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64\:/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work
oozie.action.conf.xml=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/action.xml
java.specification.name=Java Platform API Specification
java.class.version=51.0
sun.management.compiler=HotSpot 64-Bit Tiered Compilers
os.version=2.6.32-431.29.2.el6.x86_64
user.home=/var/lib/hadoop-mapreduce
user.timezone=Europe/Copenhagen
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=UTF-8
java.specification.version=1.7
java.class.path=/var/run/cloudera-scm-agent/process/6086-mapreduce-TASKTRACKER\:/etc/alternatives/java_sdk/lib/tools.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar\:/usr/share/cmf/lib/plugins/tt-instrumentation-4.8.4.jar\:/usr/share/cmf/lib/plugins/navigator-plugin-4.8.4-shaded.jar\:/usr/share/cmf/lib/plugins/event-publish-4.8.4-shaded.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0-tests.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/stax-api-1.0.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-digester-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-core-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-json-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/activation-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-io-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-httpclient-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-collections-3.2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/kfs-0.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-logging-1.1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-math-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-server-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-lang-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/zookeeper-3.4.5-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-configuration-1.6.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsch-0.1.42.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jets3t-0.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/avro-1.7.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jline-0.9.94.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsr305-1.3.9.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/junit-4.8.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-net-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/hue-plugins-2.3.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/mockito-all-1.8.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth-2.0.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0-tests.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations-2.0.0-cdh4.3.0.jar\:/mnt/disk_k/mapred/local/taskTracker/tim/distcache/-2419547164330444746_-924393689_168854042/c1n8.gbif.org/user/tim/oozie-oozi/0000345-141011094409524-oozie-oozi-W/execute_query--hive/hive-launcher.jar\:/mnt/disk_l/mapred/local/taskTracker/tim/distcache/1327830332319217524_-1424817990_168819721/c1n8.gbif.org/user/tim/occurrence-download/lib/dwc-api-1.8.jar\:/mnt/disk_m/mapred/local/taskTracker/tim/distcache/-2276870508301785354_1671550193_168819768/c1n8.gbif.org/user/tim/occurrence-download/lib/dwca-reader-1.18.jar\:/mnt/disk_a/mapred/local/taskTracker/tim/distcache/-378732202986136417_436075483_168819903/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-api-0.15.jar\:/mnt/disk_b/mapred/local/taskTracker/tim/distcache/-8036343093385781896_1674591892_168819967/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-common-0.15.jar\:/mnt/disk_c/mapred/local/taskTracker/tim/distcache/2197863525673714827_2037280993_168820021/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-common-service-0.10.jar\:/mnt/disk_d/mapred/local/taskTracker/tim/distcache/7479254169846544280_-1504854081_168820134/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-common-ws-0.15.jar\:/mnt/disk_e/mapred/local/taskTracker/tim/distcache/8871098396950670709_1120760165_168820192/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-httputils-0.5.jar\:/mnt/disk_f/mapred/local/taskTracker/tim/distcache/8642479400905384723_-1746157353_168820299/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-metadata-profile-1.0.2.2.jar\:/mnt/disk_g/mapred/local/taskTracker/tim/distcache/837553663409715071_1171670679_168820564/c1n8.gbif.org/user/tim/occurrence-download/lib/gbif-parsers-0.8.jar\:/mnt/disk_h/mapred/local/taskTracker/tim/distcache/3565441052995130458_229475709_168820643/c1n8.gbif.org/user/tim/occurrence-download/lib/hbase-utils-0.6.jar\:/mnt/disk_i/mapred/local/taskTracker/tim/distcache/-1889397436385831009_-1889068960_168820744/c1n8.gbif.org/user/tim/occurrence-download/lib/jts-1.13.jar\:/mnt/disk_j/mapred/local/taskTracker/tim/distcache/-97356936702020438_-1525610503_168820801/c1n8.gbif.org/user/tim/occurrence-download/lib/name-parser-2.4.jar\:/mnt/disk_k/mapred/local/taskTracker/tim/distcache/1619906511928542682_-934670950_168820906/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-common-0.21.1-SNAPSHOT.jar\:/mnt/disk_l/mapred/local/taskTracker/tim/distcache/-6704578665744900776_-825542307_168820976/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-download-0.21.1-SNAPSHOT.jar\:/mnt/disk_m/mapred/local/taskTracker/tim/distcache/1211068886385056434_-551785995_168821057/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-hive-0.21.1-SNAPSHOT.jar\:/mnt/disk_a/mapred/local/taskTracker/tim/distcache/-3867503521597705103_-1231285786_168821259/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-parser-0.21.1-SNAPSHOT.jar\:/mnt/disk_b/mapred/local/taskTracker/tim/distcache/-1400956900580716579_-1747164164_168821374/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-persistence-0.21.1-SNAPSHOT.jar\:/mnt/disk_c/mapred/local/taskTracker/tim/distcache/1040774508414451330_322789161_168821518/c1n8.gbif.org/user/tim/occurrence-download/lib/occurrence-processor-0.21.1-SNAPSHOT.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/660722571291778850_592074918_2032697981/c1n8.gbif.org/user/oozie/share/lib/hive/JavaEWAH-0.3.2.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-7919792044136664633_-191053639_2032698028/c1n8.gbif.org/user/oozie/share/lib/hive/ST4-4.0.4.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/1115078426298823665_-1537676361_2032698070/c1n8.gbif.org/user/oozie/share/lib/hive/antlr-2.7.7.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/808390822123018727_-55620254_2032698109/c1n8.gbif.org/user/oozie/share/lib/hive/antlr-3.4.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/1086172539559942778_815158583_2032698141/c1n8.gbif.org/user/oozie/share/lib/hive/antlr-runtime-3.4.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-6453988693767730670_-409859930_2032698186/c1n8.gbif.org/user/oozie/share/lib/hive/avro-ipc-1.7.3-tests.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-5885142604894956797_484618426_2032698216/c1n8.gbif.org/user/oozie/share/lib/hive/avro-ipc-1.7.3.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/2342855131755552549_-1171435783_2032698242/c1n8.gbif.org/user/oozie/share/lib/hive/avro-mapred-1.7.3.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-8661369265046894942_-1557262226_2066282374/c1n8.gbif.org/user/oozie/share/lib/hive/brickhouse.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-656153433533474799_-105747152_2032698267/c1n8.gbif.org/user/oozie/share/lib/hive/commons-beanutils-1.7.0.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-1558402481333088828_-359982675_2032698291/c1n8.gbif.org/user/oozie/share/lib/hive/commons-beanutils-core-1.8.0.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-8069497393172855715_1229323422_2032698329/c1n8.gbif.org/user/oozie/share/lib/hive/commons-collections-3.2.1.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-4316918033027840345_1742093049_2032698367/c1n8.gbif.org/user/oozie/share/lib/hive/commons-compress-1.4.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-2995491173417893214_-1539802306_2032698392/c1n8.gbif.org/user/oozie/share/lib/hive/commons-configuration-1.6.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/2259397256737111007_-1723259917_2032698418/c1n8.gbif.org/user/oozie/share/lib/hive/commons-dbcp-1.4.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/5076429935541653262_123363881_2032698450/c1n8.gbif.org/user/oozie/share/lib/hive/commons-digester-1.8.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/3197054020845034197_-176739397_2032698474/c1n8.gbif.org/user/oozie/share/lib/hive/commons-pool-1.5.4.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-1996853769606979102_-1253764861_2032698500/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-connectionpool-2.0.3.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/7705918878927518275_-620910082_2032698549/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-core-2.0.3.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-8142213829332673036_935803385_2032698574/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-enhancer-2.0.3.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/3103344607238516921_-1770915715_2032698613/c1n8.gbif.org/user/oozie/share/lib/hive/datanucleus-rdbms-2.0.3.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-6144063379545239762_499444284_2032698668/c1n8.gbif.org/user/oozie/share/lib/hive/derby-10.6.1.0.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/4963212666244545307_1293020600_2032698712/c1n8.gbif.org/user/oozie/share/lib/hive/guava-11.0.2.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/3096406466083731725_1308999569_2032698747/c1n8.gbif.org/user/oozie/share/lib/hive/haivvreo-1.0.7-cdh-4.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-7287018635889773791_-495153396_2066326503/c1n8.gbif.org/user/oozie/share/lib/hive/hbase-0.94.6-cdh4.3.0-security.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-7212712620247681758_1670524825_2032698778/c1n8.gbif.org/user/oozie/share/lib/hive/hive-builtins-0.10.0-cdh4.2.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-5508838536153655850_-852934155_2032698806/c1n8.gbif.org/user/oozie/share/lib/hive/hive-cli-0.10.0-cdh4.2.1.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-1724760949819760235_1937524798_2032698837/c1n8.gbif.org/user/oozie/share/lib/hive/hive-common-0.10.0-cdh4.2.1.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/8779018562166004250_1622138524_2032698865/c1n8.gbif.org/user/oozie/share/lib/hive/hive-contrib-0.10.0-cdh4.2.1.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/4453643090167504797_859430104_2032698938/c1n8.gbif.org/user/oozie/share/lib/hive/hive-exec-0.10.0-cdh4.2.1.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-150472142332504288_929193439_2066328583/c1n8.gbif.org/user/oozie/share/lib/hive/hive-hbase-handler-0.10.0-cdh4.3.0.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-6459279734595263991_204088345_2032698995/c1n8.gbif.org/user/oozie/share/lib/hive/hive-metastore-0.10.0-cdh4.2.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-2134212567176594704_901207252_2032699029/c1n8.gbif.org/user/oozie/share/lib/hive/hive-serde-0.10.0-cdh4.2.1.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/-7604375827486635078_-583979008_2032699072/c1n8.gbif.org/user/oozie/share/lib/hive/hive-service-0.10.0-cdh4.2.1.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-300471604788145946_1339116411_2032699098/c1n8.gbif.org/user/oozie/share/lib/hive/hive-shims-0.10.0-cdh4.2.1.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-80402232484241882_-1593090421_2032699133/c1n8.gbif.org/user/oozie/share/lib/hive/httpclient-4.1.3.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-8414054380262483919_968032375_2032699157/c1n8.gbif.org/user/oozie/share/lib/hive/httpcore-4.1.3.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/2969346412340279255_1617347983_2032699185/c1n8.gbif.org/user/oozie/share/lib/hive/jackson-core-asl-1.8.8.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/7335450254919805525_1782213101_2032699222/c1n8.gbif.org/user/oozie/share/lib/hive/jackson-mapper-asl-1.8.8.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-299617206559022358_-1562481212_2032699248/c1n8.gbif.org/user/oozie/share/lib/hive/jdo2-api-2.3-ec.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/5704944918383210922_1698170961_2032699276/c1n8.gbif.org/user/oozie/share/lib/hive/jetty-util-6.1.26.cloudera.2.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/1589926563671077777_1529448496_2032699306/c1n8.gbif.org/user/oozie/share/lib/hive/jline-0.9.94.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-4247066182055940134_-1974914195_2032699339/c1n8.gbif.org/user/oozie/share/lib/hive/json-20090211.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-7819630153425881455_-1161105686_2032699371/c1n8.gbif.org/user/oozie/share/lib/hive/jsr305-1.3.9.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/9061426366440182887_114757533_2032699403/c1n8.gbif.org/user/oozie/share/lib/hive/jta-1.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/3196277594091925445_375536424_2032699432/c1n8.gbif.org/user/oozie/share/lib/hive/libfb303-0.9.0.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/-1938470968400338142_823916269_2032699462/c1n8.gbif.org/user/oozie/share/lib/hive/libthrift-0.9.0.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-2983104662351042407_2004880227_2032699499/c1n8.gbif.org/user/oozie/share/lib/hive/netty-3.4.0.Final.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-730911584618403147_-1214278315_2032699532/c1n8.gbif.org/user/oozie/share/lib/hive/stringtemplate-3.2.1.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/100082538975350415_1204788005_2032699560/c1n8.gbif.org/user/oozie/share/lib/hive/xz-1.0.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-1762199384237602021_2172619_2066330759/c1n8.gbif.org/user/oozie/share/lib/hive/zookeeper-3.4.5-cdh4.3.0.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/8382222431042772074_1681337991_2032699653/c1n8.gbif.org/user/oozie/share/lib/oozie/json-simple-1.1.jar\:/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work
user.name=mapred
hadoop.tasklog.iscleanup=false
oozie.action.newId.properties=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/newId.properties
java.vm.specification.version=1.7
sun.java.command=org.apache.hadoop.mapred.Child 127.0.0.1 44936 attempt_201410110944_1171_m_000000_0 /var/log/hadoop-0.20-mapreduce/userlogs/job_201410110944_1171/attempt_201410110944_1171_m_000000_0 2145492720
java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre
sun.arch.data.model=64
user.language=en
java.specification.vendor=Oracle Corporation
awt.toolkit=sun.awt.X11.XToolkit
hadoop.log.dir=/var/log/hadoop-0.20-mapreduce
java.vm.info=mixed mode
java.version=1.7.0_65
java.ext.dirs=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/ext\:/usr/java/packages/lib/ext
sun.boot.class.path=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/resources.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/rt.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/sunrsasign.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/jsse.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/jce.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/charsets.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/rhino.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/lib/jfr.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65.x86_64/jre/classes
java.vendor=Oracle Corporation
file.separator=/
oozie.launcher.job.id=job_201410110944_1171
oozie.action.stats.properties=/mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/stats.properties
java.vendor.url.bug=http\://bugreport.sun.com/bugreport/
sun.io.unicode.encoding=UnicodeLittle
sun.cpu.endian=little
sun.cpu.isalist=
------------------------
=================================================================
>>> Invoking Main class now >>>
Oozie Hive action configuration
=================================================================
Using action configuration file /mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/action.xml
------------------------
Setting env property for mapreduce.job.credentials.binary to: /mnt/disk_c/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/jobToken
------------------------
Hive Configuration Properties:
------------------------
dfs.datanode.data.dir=file://${hadoop.tmp.dir}/dfs/data
dfs.namenode.checkpoint.txns=1000000
s3.replication=3
mapred.disk.healthChecker.interval=60000
dfs.datanode.failed.volumes.tolerated=0
hadoop.http.filter.initializers=org.apache.hadoop.http.lib.StaticUserWebFilter
mapred.task.tracker.http.address=0.0.0.0:50060
mapred.userlog.retain.hours=24
dfs.namenode.checkpoint.max-retries=3
mapred.local.dir.minspacestart=0
io.sort.spill.percent=0.8
dfs.https.server.keystore.resource=ssl-server.xml
hive.metastore.warehouse.dir=/user/hive/warehouse/prod_b.db
dfs.domain.socket.path=/var/run/hdfs-sockets/dn
hadoop.http.authentication.kerberos.keytab=${user.home}/hadoop.keytab
mapred.job.classpath.files=/user/tim/oozie-oozi/0000345-141011094409524-oozie-oozi-W/execute_query--hive/hive-launcher.jar:/user/tim/occurrence-download/lib/dwc-api-1.8.jar:/user/tim/occurrence-download/lib/dwca-reader-1.18.jar:/user/tim/occurrence-download/lib/gbif-api-0.15.jar:/user/tim/occurrence-download/lib/gbif-common-0.15.jar:/user/tim/occurrence-download/lib/gbif-common-service-0.10.jar:/user/tim/occurrence-download/lib/gbif-common-ws-0.15.jar:/user/tim/occurrence-download/lib/gbif-httputils-0.5.jar:/user/tim/occurrence-download/lib/gbif-metadata-profile-1.0.2.2.jar:/user/tim/occurrence-download/lib/gbif-parsers-0.8.jar:/user/tim/occurrence-download/lib/hbase-utils-0.6.jar:/user/tim/occurrence-download/lib/jts-1.13.jar:/user/tim/occurrence-download/lib/name-parser-2.4.jar:/user/tim/occurrence-download/lib/occurrence-common-0.21.1-SNAPSHOT.jar:/user/tim/occurrence-download/lib/occurrence-download-0.21.1-SNAPSHOT.jar:/user/tim/occurrence-download/lib/occurrence-hive-0.21.1-SNAPSHOT.jar:/user/tim/occurrence-download/lib/occurrence-parser-0.21.1-SNAPSHOT.jar:/user/tim/occurrence-download/lib/occurrence-persistence-0.21.1-SNAPSHOT.jar:/user/tim/occurrence-download/lib/occurrence-processor-0.21.1-SNAPSHOT.jar:/user/oozie/share/lib/hive/JavaEWAH-0.3.2.jar:/user/oozie/share/lib/hive/ST4-4.0.4.jar:/user/oozie/share/lib/hive/antlr-2.7.7.jar:/user/oozie/share/lib/hive/antlr-3.4.jar:/user/oozie/share/lib/hive/antlr-runtime-3.4.jar:/user/oozie/share/lib/hive/avro-ipc-1.7.3-tests.jar:/user/oozie/share/lib/hive/avro-ipc-1.7.3.jar:/user/oozie/share/lib/hive/avro-mapred-1.7.3.jar:/user/oozie/share/lib/hive/brickhouse.jar:/user/oozie/share/lib/hive/commons-beanutils-1.7.0.jar:/user/oozie/share/lib/hive/commons-beanutils-core-1.8.0.jar:/user/oozie/share/lib/hive/commons-collections-3.2.1.jar:/user/oozie/share/lib/hive/commons-compress-1.4.1.jar:/user/oozie/share/lib/hive/commons-configuration-1.6.jar:/user/oozie/share/lib/hive/commons-dbcp-1.4.jar:/user/oozie/share/lib/hive/commons-digester-1.8.jar:/user/oozie/share/lib/hive/commons-pool-1.5.4.jar:/user/oozie/share/lib/hive/datanucleus-connectionpool-2.0.3.jar:/user/oozie/share/lib/hive/datanucleus-core-2.0.3.jar:/user/oozie/share/lib/hive/datanucleus-enhancer-2.0.3.jar:/user/oozie/share/lib/hive/datanucleus-rdbms-2.0.3.jar:/user/oozie/share/lib/hive/derby-10.6.1.0.jar:/user/oozie/share/lib/hive/guava-11.0.2.jar:/user/oozie/share/lib/hive/haivvreo-1.0.7-cdh-4.jar:/user/oozie/share/lib/hive/hbase-0.94.6-cdh4.3.0-security.jar:/user/oozie/share/lib/hive/hive-builtins-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-cli-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-common-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-contrib-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-exec-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-hbase-handler-0.10.0-cdh4.3.0.jar:/user/oozie/share/lib/hive/hive-metastore-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-serde-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-service-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/hive-shims-0.10.0-cdh4.2.1.jar:/user/oozie/share/lib/hive/httpclient-4.1.3.jar:/user/oozie/share/lib/hive/httpcore-4.1.3.jar:/user/oozie/share/lib/hive/jackson-core-asl-1.8.8.jar:/user/oozie/share/lib/hive/jackson-mapper-asl-1.8.8.jar:/user/oozie/share/lib/hive/jdo2-api-2.3-ec.jar:/user/oozie/share/lib/hive/jetty-util-6.1.26.cloudera.2.jar:/user/oozie/share/lib/hive/jline-0.9.94.jar:/user/oozie/share/lib/hive/json-20090211.jar:/user/oozie/share/lib/hive/jsr305-1.3.9.jar:/user/oozie/share/lib/hive/jta-1.1.jar:/user/oozie/share/lib/hive/libfb303-0.9.0.jar:/user/oozie/share/lib/hive/libthrift-0.9.0.jar:/user/oozie/share/lib/hive/netty-3.4.0.Final.jar:/user/oozie/share/lib/hive/stringtemplate-3.2.1.jar:/user/oozie/share/lib/hive/xz-1.0.jar:/user/oozie/share/lib/hive/zookeeper-3.4.5-cdh4.3.0.jar:/user/oozie/share/lib/oozie/json-simple-1.1.jar
mapred.reduce.parallel.copies=10
ha.failover-controller.new-active.rpc-timeout.ms=60000
ha.health-monitor.check-interval.ms=1000
io.file.buffer.size=65536
mapred.submit.replication=1
dfs.namenode.checkpoint.period=3600
mapred.local.dir.minspacekill=0
ipc.client.kill.max=10
mapred.task.profile=false
mapred.heartbeats.in.second=100
user.name=tim
mapred.output.compress=false
s3.stream-buffer-size=4096
mapred.healthChecker.interval=60000
mapred.task.timeout=600000
dfs.namenode.secondary.http-address=0.0.0.0:50090
mapred.temp.dir=${hadoop.tmp.dir}/mapred/temp
dfs.namenode.decommission.interval=30
dfs.namenode.http-address=c1n8.gbif.org:50070
dfs.encrypt.data.transfer=false
dfs.namenode.avoid.write.stale.datanode=false
dfs.datanode.address=0.0.0.0:50010
jobclient.completion.poll.interval=5000
hadoop.http.authentication.token.validity=36000
hadoop.security.group.mapping.ldap.search.filter.group=(objectClass=group)
mapred.queue.default.state=RUNNING
dfs.client.failover.max.attempts=15
mapred.create.symlink=yes
kfs.client-write-packet-size=65536
mapred.job.tracker.persist.jobstatus.active=false
dfs.client.failover.connection.retries.on.timeouts=0
mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec
file.stream-buffer-size=4096
zlib.compress.level=DEFAULT_COMPRESSION
dfs.webhdfs.enabled=false
ipc.client.connection.maxidletime=10000
dfs.datanode.ipc.address=0.0.0.0:50020
mapred.job.shuffle.merge.percent=0.66
dfs.client.read.shortcircuit=false
mapred.map.max.attempts=4
dfs.namenode.safemode.extension=30000
hbase.zookeeper.quorum=c1n10.gbif.org:2181,c1n9.gbif.org:2181,c1n8.gbif.org:2181
ha.zookeeper.parent-znode=/hadoop-ha
io.skip.checksum.errors=false
mapred.job.reduce.input.buffer.percent=0.0
hadoop.http.authentication.kerberos.principal=HTTP/_HOST@LOCALHOST
fs.s3.maxRetries=4
mapred.task.cache.levels=2
io.sort.factor=64
mapred.jobtracker.instrumentation=org.apache.hadoop.mapred.JobTrackerMetricsInst
mapred.userlog.limit.kb=0
hadoop.kerberos.kinit.command=kinit
dfs.namenode.name.dir.restore=false
dfs.client.use.datanode.hostname=false
hadoop.util.hash.type=murmur
dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction=0.75f
io.seqfile.lazydecompress=true
dfs.datanode.dns.interface=default
mapred.job.reduce.memory.mb=-1
mapred.skip.map.max.skip.records=0
mapred.job.tracker.jobhistory.lru.cache.size=5
mapred.job.tracker.persist.jobstatus.hours=0
hadoop.security.group.mapping.ldap.search.attr.group.name=cn
local.cache.size=10737418240
fs.df.interval=60000
mapred.job.tracker.handler.count=10
dfs.namenode.kerberos.internal.spnego.principal=${dfs.web.authentication.kerberos.principal}
mapreduce.job.reduce.shuffle.consumer.plugin.class=org.apache.hadoop.mapred.ReduceTask$ReduceCopier
mapreduce.jobtracker.address=c1n10.gbif.org:8021
dfs.journalnode.rpc-address=0.0.0.0:8485
dfs.namenode.fs-limits.max-blocks-per-file=1048576
mapreduce.job.acl-view-job=
dfs.client.block.write.replace-datanode-on-failure.policy=DEFAULT
dfs.namenode.replication.interval=3
mapred.cache.files=/user/tim/occurrence-download/hive-scripts/execute-query.q#execute-query.q,hdfs://c1n8.gbif.org:8020/user/tim/oozie-oozi/0000345-141011094409524-oozie-oozi-W/execute_query--hive/hive-launcher.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/dwc-api-1.8.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/dwca-reader-1.18.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-api-0.15.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-common-0.15.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-common-service-0.10.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-common-ws-0.15.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-httputils-0.5.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-metadata-profile-1.0.2.2.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/gbif-parsers-0.8.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/hbase-utils-0.6.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/jts-1.13.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/name-parser-2.4.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/occurrence-common-0.21.1-SNAPSHOT.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/occurrence-download-0.21.1-SNAPSHOT.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/occurrence-hive-0.21.1-SNAPSHOT.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/occurrence-parser-0.21.1-SNAPSHOT.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/occurrence-persistence-0.21.1-SNAPSHOT.jar,hdfs://c1n8.gbif.org:8020/user/tim/occurrence-download/lib/occurrence-processor-0.21.1-SNAPSHOT.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/JavaEWAH-0.3.2.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/ST4-4.0.4.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/antlr-2.7.7.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/antlr-3.4.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/antlr-runtime-3.4.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/avro-ipc-1.7.3-tests.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/avro-ipc-1.7.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/avro-mapred-1.7.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/brickhouse.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-beanutils-1.7.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-beanutils-core-1.8.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-collections-3.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-compress-1.4.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-configuration-1.6.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-dbcp-1.4.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-digester-1.8.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/commons-pool-1.5.4.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/datanucleus-connectionpool-2.0.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/datanucleus-core-2.0.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/datanucleus-enhancer-2.0.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/datanucleus-rdbms-2.0.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/derby-10.6.1.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/guava-11.0.2.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/haivvreo-1.0.7-cdh-4.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hbase-0.94.6-cdh4.3.0-security.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-builtins-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-cli-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-common-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-contrib-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-exec-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-hbase-handler-0.10.0-cdh4.3.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-metastore-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-serde-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-service-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/hive-shims-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/httpclient-4.1.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/httpcore-4.1.3.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jackson-core-asl-1.8.8.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jackson-mapper-asl-1.8.8.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jdo2-api-2.3-ec.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jetty-util-6.1.26.cloudera.2.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jline-0.9.94.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/json-20090211.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jsr305-1.3.9.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/jta-1.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/libfb303-0.9.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/libthrift-0.9.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/netty-3.4.0.Final.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/stringtemplate-3.2.1.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/xz-1.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/hive/zookeeper-3.4.5-cdh4.3.0.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/oozie/json-simple-1.1.jar
dfs.namenode.num.checkpoints.retained=2
dfs.datanode.directoryscan.threads=1
hadoop.security.group.mapping.ldap.ssl=false
dfs.heartbeat.interval=3
net.topology.script.number.args=100
dfs.client-write-packet-size=65536
hadoop.security.group.mapping.ldap.directory.search.timeout=10000
io.native.lib.available=true
dfs.client.failover.connection.retries=0
hive.warehouse.subdir.inherit.perms=true
dfs.blocksize=134217728
mapreduce.reduce.shuffle.maxfetchfailures=10
dfs.blockreport.initialDelay=0
io.sort.mb=256
ha.health-monitor.rpc-timeout.ms=45000
dfs.ha.tail-edits.period=60
mapred.combine.recordsBeforeProgress=10000
file.bytes-per-checksum=512
dfs.replication.max=512
dfs.namenode.max.extra.edits.segments.retained=10000
io.map.index.skip=0
mapred.task.profile.maps=0-2
mapred.map.tasks.speculative.execution=false
dfs.datanode.du.reserved=0
dfs.support.append=true
ftp.blocksize=67108864
dfs.client.file-block-storage-locations.num-threads=10
ipc.server.listen.queue.size=128
hadoop.ssl.hostname.verifier=DEFAULT
mapred.reduce.tasks=108
hadoop.security.group.mapping.ldap.search.attr.member=member
mapreduce.tasktracker.outofband.heartbeat=false
dfs.namenode.delegation.token.renew-interval=86400000
mapred.min.split.size=0
hadoop.ssl.keystores.factory.class=org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory
dfs.datanode.sync.behind.writes=false
mapreduce.tasktracker.cache.local.numberdirectories=10000
dfs.client.read.shortcircuit.skip.checksum=false
mapreduce.job.credentials.binary=/mnt/disk_c/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/jobToken
dfs.datanode.handler.count=10
hadoop.ssl.require.client.cert=false
ftp.client-write-packet-size=65536
dfs.client.write.exclude.nodes.cache.expiry.interval.millis=600000
ipc.server.tcpnodelay=false
ha.health-monitor.connect-retry-interval.ms=1000
hadoop.fuse.connection.timeout=300
dfs.permissions.superusergroup=supergroup
fs.ftp.host.port=21
dfs.datanode.data.dir.perm=700
s3native.blocksize=67108864
mapred.tasktracker.dns.nameserver=default
dfs.namenode.replication.min=1
mapred.tasktracker.taskmemorymanager.monitoring-interval=5000
mapred.tasktracker.expiry.interval=600000
hadoop.security.uid.cache.secs=14400
map.sort.class=org.apache.hadoop.util.QuickSort
oozie.hive.params.size=6
fs.trash.checkpoint.interval=0
dfs.image.transfer.timeout=600000
mapred.max.tracker.failures=4
dfs.namenode.name.dir=file://${hadoop.tmp.dir}/dfs/name
fs.AbstractFileSystem.file.impl=org.apache.hadoop.fs.local.LocalFs
mapreduce.jobtracker.split.metainfo.maxsize=10000000
dfs.image.compression.codec=org.apache.hadoop.io.compress.DefaultCodec
mapreduce.job.complete.cancel.delegation.tokens=true
mapred.job.tracker.persist.jobstatus.dir=/jobtracker/jobsInfo
hadoop.security.group.mapping.ldap.search.filter.user=(&(objectClass=user)(sAMAccountName={0}))
io.sort.record.percent=0.05
job.end.retry.attempts=0
hadoop.security.auth_to_local=DEFAULT
kfs.bytes-per-checksum=512
dfs.namenode.backup.http-address=0.0.0.0:50105
hadoop.rpc.protection=authentication
dfs.namenode.https-address=c1n8.gbif.org:50470
mapred.reduce.tasks.speculative.execution=false
ftp.stream-buffer-size=4096
dfs.ha.log-roll.period=120
file.client-write-packet-size=65536
hadoop.http.authentication.simple.anonymous.allowed=true
mapred.task.tracker.task-controller=org.apache.hadoop.mapred.DefaultTaskController
dfs.datanode.drop.cache.behind.reads=false
dfs.image.transfer.bandwidthPerSec=0
mapred.jobtracker.maxtasks.per.job=-1
ha.failover-controller.cli-check.rpc-timeout.ms=20000
mapreduce.shuffle.ssl.address=0.0.0.0
dfs.namenode.write.stale.datanode.ratio=0.5f
io.mapfile.bloom.size=1048576
mapred.reduce.child.log.level=INFO
mapred.reduce.max.attempts=4
dfs.ha.fencing.ssh.connect-timeout=30000
s3.bytes-per-checksum=512
fs.automatic.close=true
mapred.cluster.max.map.memory.mb=-1
fs.trash.interval=1
hadoop.security.authentication=simple
fs.defaultFS=hdfs://c1n8.gbif.org:8020
hadoop.ssl.server.conf=ssl-server.xml
ipc.client.connect.max.retries=10
dfs.journalnode.http-address=0.0.0.0:8480
mapred.map.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec
net.topology.node.switch.mapping.impl=org.apache.hadoop.net.ScriptBasedMapping
dfs.namenode.replication.considerLoad=true
dfs.namenode.fs-limits.min-block-size=1048576
mapred.job.shuffle.input.buffer.percent=0.70
dfs.namenode.audit.loggers=default
mapreduce.job.counters.max=120
yarn.resourcemanager.address=c1n10.gbif.org:8021
mapred.user.jobconf.limit=5242880
dfs.client.block.write.retries=3
io.map.index.interval=128
mapred.child.java.opts= -Xmx1073741824
dfs.client.https.keystore.resource=ssl-client.xml
io.mapfile.bloom.error.rate=0.005
ipc.client.tcpnodelay=false
dfs.https.port=50470
hadoop.relaxed.worker.version.check=true
dfs.datanode.dns.nameserver=default
dfs.namenode.accesstime.precision=3600000
mapred.task.tracker.report.address=127.0.0.1:0
io.seqfile.compress.blocksize=1000000
keep.failed.task.files=false
hadoop.security.groups.cache.secs=300
datanucleus.plugin.pluginRegistryBundleCheck=LOG
mapreduce.reduce.input.limit=-1
mapreduce.fileoutputcommitter.marksuccessfuljobs=true
mapred.cluster.reduce.memory.mb=-1
tasktracker.http.threads=40
hadoop.security.authorization=false
mapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.MapTask$MapOutputBuffer
fs.ftp.host=0.0.0.0
mapreduce.ifile.readahead=true
ha.zookeeper.session-timeout.ms=5000
dfs.namenode.avoid.read.stale.datanode=false
oozie.job.id=0000345-141011094409524-oozie-oozi-W
dfs.https.enable=false
mapred.acls.enabled=false
mapreduce.reduce.shuffle.read.timeout=180000
dfs.blockreport.intervalMsec=21600000
dfs.datanode.balance.bandwidthPerSec=1048576
mapred.max.tracker.blacklists=4
file.blocksize=67108864
mapred.tasktracker.indexcache.mb=10
mapreduce.jobtracker.staging.root.dir=${hadoop.tmp.dir}/mapred/staging
job.end.notification.url=http://c1n8.gbif.org:11000/oozie/callback?id=0000345-141011094409524-oozie-oozi-W@execute_query&status=$jobStatus&
ipc.client.connect.max.retries.on.timeouts=45
hive.metastore.local=false
ha.zookeeper.acl=world:anyone:rwcda
mapred.skip.attempts.to.start.skipping=2
mapreduce.reduce.shuffle.connect.timeout=180000
dfs.block.access.key.update.interval=600
dfs.block.access.token.lifetime=600
mapred.tasktracker.reduce.tasks.maximum=2
mapred.job.name=
jobclient.output.filter=FAILED
mapred.jobtracker.restart.recover=false
mapred.local.dir=${hadoop.tmp.dir}/mapred/local
dfs.namenode.checkpoint.check.period=60
dfs.client.block.write.replace-datanode-on-failure.enable=true
dfs.datanode.directoryscan.interval=21600
mapred.job.tracker=c1n10.gbif.org:8021
dfs.default.chunk.view.size=32768
jobclient.progress.monitor.poll.interval=1000
hadoop.security.instrumentation.requires.admin=false
dfs.namenode.safemode.min.datanodes=0
hadoop.http.authentication.signature.secret.file=${user.home}/hadoop-http-auth-signature-secret
mapred.map.child.log.level=INFO
s3native.replication=3
dfs.datanode.https.address=0.0.0.0:50475
mapred.output.compression.type=BLOCK
mapreduce.jobhistory.cleaner.interval-ms=86400000
file.replication=1
hadoop.hdfs.configuration.version=1
mapred.job.tracker.retiredjobs.cache.size=1000
ipc.client.idlethreshold=4000
hadoop.tmp.dir=/tmp/hadoop-${user.name}
hadoop.skip.worker.version.check=false
oozie.HadoopAccessorService.created=true
dfs.namenode.decommission.nodes.per.interval=5
dfs.namenode.delegation.key.update-interval=86400000
fs.s3.buffer.dir=${hadoop.tmp.dir}/s3
mapred.tasktracker.dns.interface=default
dfs.namenode.support.allow.format=true
io.compression.codecs=org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec,org.apache.hadoop.io.compress.Lz4Codec
mapred.task.profile.reduces=0-2
mapred.cluster.map.memory.mb=-1
mapred.skip.reduce.auto.incr.proc.count=true
hadoop.work.around.non.threadsafe.getpwuid=false
dfs.ha.automatic-failover.enabled=false
dfs.namenode.stale.datanode.interval=30000
dfs.namenode.logging.level=info
ha.health-monitor.sleep-after-disconnect.ms=1000
dfs.namenode.checkpoint.edits.dir=${dfs.namenode.checkpoint.dir}
hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.StandardSocketFactory
oozie.action.id=0000345-141011094409524-oozie-oozi-W@execute_query
oozie.hive.params.0=hiveDB=tim
oozie.hive.params.1=verbatimTable=download_tim_verbatim
dfs.datanode.http.address=0.0.0.0:50075
dfs.namenode.edits.dir=${dfs.namenode.name.dir}
job.end.retry.interval=30000
hadoop.fuse.timer.period=5
oozie.hive.params.5=whereClause=taxonKey=1001
oozie.hive.params.4=multimediaTable=download_tim_multimedia
oozie.hive.params.3=citationTable=download_tim_citation
oozie.hive.script=execute-query.q
oozie.hive.params.2=interpretedTable=download_tim_interpreted
fs.AbstractFileSystem.viewfs.impl=org.apache.hadoop.fs.viewfs.ViewFs
mapred.queue.names=default
s3native.stream-buffer-size=4096
dfs.secondary.namenode.kerberos.internal.spnego.principal=${dfs.web.authentication.kerberos.principal}
dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold=10737418240
mapred.jobtracker.job.history.block.size=3145728
dfs.namenode.safemode.threshold-pct=0.999f
mapreduce.ifile.readahead.bytes=4194304
mapred.child.tmp=./tmp
hive.metastore.execute.setugi=true
s3native.bytes-per-checksum=512
mapred.cluster.max.reduce.memory.mb=-1
kfs.replication=3
mapred.line.input.format.linespermap=1
mapred.map.tasks=2
hadoop.http.authentication.type=simple
dfs.client.failover.sleep.base.millis=500
mapred.tasktracker.map.tasks.maximum=2
hadoop.jetty.logs.serve.aliases=true
ha.failover-controller.graceful-fence.rpc-timeout.ms=5000
hive.metastore.uris=thrift://c1n8.gbif.org:9083
dfs.datanode.max.transfer.threads=4096
dfs.namenode.handler.count=10
hadoop.ssl.client.conf=ssl-client.xml
hadoop.ssl.enabled=false
fs.AbstractFileSystem.hdfs.impl=org.apache.hadoop.fs.Hdfs
mapred.job.queue.name=default
kfs.stream-buffer-size=4096
dfs.namenode.invalidate.work.pct.per.iteration=0.32f
dfs.bytes-per-checksum=512
dfs.replication=3
dfs.permissions.enabled=true
mapred.jobtracker.taskScheduler=org.apache.hadoop.mapred.JobQueueTaskScheduler
dfs.datanode.use.datanode.hostname=false
dfs.namenode.fs-limits.max-directory-items=0
s3.client-write-packet-size=65536
mapred.skip.reduce.max.skip.groups=0
dfs.client.failover.sleep.max.millis=15000
dfs.namenode.fs-limits.max-component-length=0
s3.blocksize=67108864
kfs.blocksize=67108864
dfs.namenode.edits.journal-plugin.qjournal=org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager
mapred.job.tracker.http.address=0.0.0.0:50030
dfs.client.https.need-auth=false
mapreduce.jobhistory.max-age-ms=2592000000
mapred.healthChecker.script.timeout=600000
ftp.replication=3
fs.s3n.block.size=67108864
hive.exec.mode.local.auto=false
mapred.tasktracker.instrumentation=org.apache.hadoop.mapred.TaskTrackerMetricsInst
dfs.namenode.num.extra.edits.retained=1000000
hadoop.http.staticuser.user=dr.who
mapred.system.dir=${hadoop.tmp.dir}/mapred/system
mapred.job.reuse.jvm.num.tasks=1
dfs.namenode.checkpoint.dir=file://${hadoop.tmp.dir}/dfs/namesecondary
tfile.fs.input.buffer.size=262144
mapred.skip.map.auto.incr.proc.count=true
fs.s3.block.size=67108864
tfile.io.chunk.size=1048576
io.serializations=org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
mapred.inmem.merge.threshold=1000
mapred.job.map.memory.mb=-1
dfs.namenode.backup.address=0.0.0.0:50100
mapred.reduce.slowstart.completed.maps=0.8
dfs.block.access.token.enable=false
io.seqfile.sorter.recordlimit=1000000
s3native.client-write-packet-size=65536
ftp.bytes-per-checksum=512
hadoop.security.group.mapping=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback
dfs.client.domain.socket.data.traffic=false
dfs.client.file-block-storage-locations.timeout=60
hive.exec.scratchdir=/tmp/hive-occurrence.download
mapred.tasktracker.tasks.sleeptime-before-sigkill=5000
dfs.namenode.max.objects=0
mapred.jobtracker.completeuserjobs.maximum=100
dfs.namenode.delegation.token.max-lifetime=604800000
mapred.job.restart.recover=true
mapred.compress.map.output=true
dfs.datanode.hdfs-blocks-metadata.enabled=true
dfs.datanode.readahead.bytes=4193404
dfs.image.compress=false
mapreduce.shuffle.ssl.enabled=${hadoop.ssl.enabled}
mapred.merge.recordsBeforeProgress=10000
dfs.stream-buffer-size=4096
tfile.fs.output.buffer.size=262144
fs.permissions.umask-mode=022
ha.failover-controller.graceful-fence.connection.retries=1
dfs.datanode.drop.cache.behind.writes=false
hadoop.common.configuration.version=0.23.0
dfs.namenode.replication.work.multiplier.per.iteration=2
mapreduce.job.acl-modify-job=
io.seqfile.local.dir=${hadoop.tmp.dir}/io/local
mapreduce.shuffle.ssl.port=50443
fs.s3.sleepTimeSeconds=10
------------------------
Current (local) dir = /mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work
------------------------
.action.xml.crc
hive-exec-log4j.properties
execute-query.q
tmp
hive-site.xml
hive-log4j.properties
action.xml
------------------------
Script [execute-query.q] content:
------------------------
USE ${hiveDB};
CREATE TEMPORARY FUNCTION cleanNull AS 'org.gbif.occurrence.hive.udf.NullStringRemoverUDF';
CREATE TEMPORARY FUNCTION contains AS 'org.gbif.occurrence.hive.udf.ContainsUDF';
CREATE TEMPORARY FUNCTION toISO8601 AS 'org.gbif.occurrence.hive.udf.ToISO8601UDF';
CREATE TEMPORARY FUNCTION cleanDelimiters AS 'org.gbif.occurrence.hive.udf.CleanDelimiterCharsUDF';
CREATE TEMPORARY FUNCTION joinArray AS 'brickhouse.udf.collect.JoinArrayUDF';
-- TODO: enable this when we're done testing the basics
-- setup for our custom, combinable deflated compression
-- SET hive.exec.compress.output=true;
-- SET io.seqfile.compression.type=BLOCK;
-- SET mapred.output.compression.codec=org.gbif.hadoop.compress.d2.D2Codec;
-- SET io.compression.codecs=org.gbif.hadoop.compress.d2.D2Codec;
-- in case this job is relaunched
DROP TABLE IF EXISTS ${verbatimTable};
DROP TABLE IF EXISTS ${interpretedTable};
DROP TABLE IF EXISTS ${citationTable};
DROP TABLE IF EXISTS ${multimediaTable};
-- pre-create verbatim table so it can be used in the multi-insert
CREATE TABLE ${verbatimTable} (
gbifid BIGINT,
v_license STRING,
v_rights STRING,
v_rightsholder STRING,
v_type STRING,
v_basisofrecord STRING,
v_catalognumber STRING,
v_class STRING,
v_collectioncode STRING,
v_continent STRING,
v_coordinateprecision STRING,
v_coordinateuncertaintyinmeters STRING,
v_country STRING,
v_countrycode STRING,
v_county STRING,
v_datasetid STRING,
v_datasetname STRING,
v_dateidentified STRING,
v_day STRING,
v_decimallatitude STRING,
v_decimallongitude STRING,
v_enddayofyear STRING,
v_eventdate STRING,
v_eventid STRING,
v_eventtime STRING,
v_family STRING,
v_footprintspatialfit STRING,
v_footprintsrs STRING,
v_footprintwkt STRING,
v_genus STRING,
v_geodeticdatum STRING,
v_higherclassification STRING,
v_highergeography STRING,
v_highergeographyid STRING,
v_individualid STRING,
v_institutioncode STRING,
v_kingdom STRING,
v_locality STRING,
v_materialsampleid STRING,
v_maximumdepthinmeters STRING,
v_maximumdistanceabovesurfaceinmeters STRING,
v_maximumelevationinmeters STRING,
v_minimumdepthinmeters STRING,
v_minimumdistanceabovesurfaceinmeters STRING,
v_minimumelevationinmeters STRING,
v_month STRING,
v_occurrenceid STRING,
v_order STRING,
v_othercatalognumbers STRING,
v_ownerinstitutioncode STRING,
v_phylum STRING,
v_previousidentifications STRING,
v_recordedby STRING,
v_recordnumber STRING,
v_scientificname STRING,
v_scientificnameauthorship STRING,
v_startdayofyear STRING,
v_stateprovince STRING,
v_subgenus STRING,
v_taxonrank STRING,
v_typestatus STRING,
v_verbatimcoordinates STRING,
v_verbatimcoordinatesystem STRING,
v_verbatimdepth STRING,
v_verbatimelevation STRING,
v_verbatimeventdate STRING,
v_verbatimlatitude STRING,
v_verbatimlocality STRING,
v_verbatimlongitude STRING,
v_verbatimsrs STRING,
v_verbatimtaxonrank STRING,
v_vernacularname STRING,
v_waterbody STRING,
v_year STRING
) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t';
-- pre-create interpreted table so it can be used in the multi-insert
CREATE TABLE ${interpretedTable} (
gbifid BIGINT,
license STRING,
rights STRING,
rightsholder STRING,
type STRING,
basisofrecord STRING,
catalognumber STRING,
class STRING,
collectioncode STRING,
continent STRING,
countrycode STRING,
datasetid STRING,
datasetname STRING,
dateidentified STRING,
day STRING,
decimallatitude STRING,
decimallongitude STRING,
eventdate STRING,
eventid STRING,
family STRING,
genus STRING,
individualid STRING,
institutioncode STRING,
kingdom STRING,
locality STRING,
materialsampleid STRING,
month STRING,
occurrenceid STRING,
order_ STRING,
phylum STRING,
recordedby STRING,
recordnumber STRING,
scientificname STRING,
stateprovince STRING,
subgenus STRING,
typestatus STRING,
year STRING,
classkey STRING,
coordinateaccuracy STRING,
datasetkey STRING,
depth STRING,
depthaccuracy STRING,
distanceabovesurface STRING,
distanceabovesurfaceaccuracy STRING,
elevation STRING,
elevationaccuracy STRING,
familykey STRING,
genericname STRING,
genuskey STRING,
hascoordinate STRING,
hasgeospatialissues STRING,
issue STRING,
kingdomkey STRING,
lastinterpreted STRING,
orderkey STRING,
phylumkey STRING,
publishingcountry STRING,
species STRING,
specieskey STRING,
subgenuskey STRING,
taxonkey STRING,
typifiedname STRING
) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t';
--
-- Uses multi-table inserts format to reduce to a single scan of the source table.
--
FROM occurrence_download_simple
INSERT INTO TABLE ${verbatimTable}
SELECT
gbifid,
v_license,
v_rights,
v_rightsholder,
v_type,
v_basisofrecord,
v_catalognumber,
v_class,
v_collectioncode,
v_continent,
v_coordinateprecision,
v_coordinateuncertaintyinmeters,
v_country,
v_countrycode,
v_county,
v_datasetid,
v_datasetname,
v_dateidentified,
v_day,
v_decimallatitude,
v_decimallongitude,
v_enddayofyear,
v_eventdate,
v_eventid,
v_eventtime,
v_family,
v_footprintspatialfit,
v_footprintsrs,
v_footprintwkt,
v_genus,
v_geodeticdatum,
v_higherclassification,
v_highergeography,
v_highergeographyid,
v_individualid,
v_institutioncode,
v_kingdom,
v_locality,
v_materialsampleid,
v_maximumdepthinmeters,
v_maximumdistanceabovesurfaceinmeters,
v_maximumelevationinmeters,
v_minimumdepthinmeters,
v_minimumdistanceabovesurfaceinmeters,
v_minimumelevationinmeters,
v_month,
v_occurrenceid,
v_order,
v_othercatalognumbers,
v_ownerinstitutioncode,
v_phylum,
v_previousidentifications,
v_recordedby,
v_recordnumber,
v_scientificname,
v_scientificnameauthorship,
v_startdayofyear,
v_stateprovince,
v_subgenus,
v_taxonrank,
v_typestatus,
v_verbatimcoordinates,
v_verbatimcoordinatesystem,
v_verbatimdepth,
v_verbatimelevation,
v_verbatimeventdate,
v_verbatimlatitude,
v_verbatimlocality,
v_verbatimlongitude,
v_verbatimsrs,
v_verbatimtaxonrank,
v_vernacularname,
v_waterbody,
v_year
WHERE ${whereClause}
INSERT INTO TABLE ${interpretedTable}
SELECT
gbifid,
license,
rights,
rightsholder,
type,
basisofrecord,
catalognumber,
class,
collectioncode,
continent,
countrycode,
datasetid,
datasetname,
dateidentified,
day,
decimallatitude,
decimallongitude,
eventdate,
eventid,
family,
genus,
individualid,
institutioncode,
kingdom,
locality,
materialsampleid,
month,
occurrenceid,
order_,
phylum,
recordedby,
recordnumber,
scientificname,
stateprovince,
subgenus,
typestatus,
year,
classkey,
coordinateaccuracy,
datasetkey,
depth,
depthaccuracy,
distanceabovesurface,
distanceabovesurfaceaccuracy,
elevation,
elevationaccuracy,
familykey,
genericname,
genuskey,
hascoordinate,
hasgeospatialissues,
issue,
kingdomkey,
lastinterpreted,
orderkey,
phylumkey,
publishingcountry,
species,
specieskey,
subgenuskey,
taxonkey,
typifiedname
WHERE ${whereClause};
--
-- Creates the citation table
--
CREATE TABLE ${citationTable}
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'
AS SELECT datasetkey, count(*) as num_occurrences FROM ${interpretedTable} GROUP BY datasetkey;
--
-- Creates the multimedia table
--
CREATE TABLE ${multimediaTable}
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'
AS SELECT m.*
FROM
occurrence_multimedia m
JOIN ${interpretedTable} i ON m.gbifId = i.gbifId;
------------------------
Parameters:
------------------------
hiveDB=tim
verbatimTable=download_tim_verbatim
interpretedTable=download_tim_interpreted
citationTable=download_tim_citation
multimediaTable=download_tim_multimedia
whereClause=taxonKey=1001
------------------------
Hive command arguments :
--hivevar
hiveDB=tim
--hivevar
verbatimTable=download_tim_verbatim
--hivevar
interpretedTable=download_tim_interpreted
--hivevar
citationTable=download_tim_citation
--hivevar
multimediaTable=download_tim_multimedia
--hivevar
whereClause=taxonKey=1001
-f
execute-query.q
=================================================================
>>> Invoking Hive command line now >>>
Heart beat
Heart beat
Heart beat
Heart beat
Heart beat
Heart beat
<<< Invocation of Hive command completed <<<
Hadoop Job IDs executed by Hive:
<<< Invocation of Main class completed <<<
Oozie Launcher, capturing output data:
=======================
#
#Mon Oct 13 17:14:52 CEST 2014
hadoopJobs=
=======================
Oozie Launcher ends
stderr logs
Logging initialized using configuration in jar:file:/mnt/disk_j/mapred/local/taskTracker/distcache/-1724760949819760235_1937524798_2032698837/c1n8.gbif.org/user/oozie/share/lib/hive/hive-common-0.10.0-cdh4.2.1.jar!/hive-log4j.properties
Hive history file=/tmp/mapred/hive_job_log_mapred_201410131711_1037911247.txt
OK
Time taken: 1.514 seconds
OK
Time taken: 0.007 seconds
OK
Time taken: 0.007 seconds
OK
Time taken: 0.003 seconds
OK
Time taken: 0.003 seconds
OK
Time taken: 0.028 seconds
OK
Time taken: 0.042 seconds
OK
Time taken: 0.014 seconds
OK
Time taken: 0.013 seconds
OK
Time taken: 0.013 seconds
OK
Time taken: 0.427 seconds
OK
Time taken: 0.259 seconds
Total MapReduce jobs = 5
Launching Job 1 out of 5
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201410110944_1174, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201410110944_1174
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job -kill job_201410110944_1174
Hadoop job information for Stage-2: number of mappers: 236; number of reducers: 0
2014-10-13 17:11:54,501 Stage-2 map = 0%, reduce = 0%
2014-10-13 17:12:04,556 Stage-2 map = 1%, reduce = 0%, Cumulative CPU 4.7 sec
2014-10-13 17:12:05,568 Stage-2 map = 4%, reduce = 0%, Cumulative CPU 4.7 sec
2014-10-13 17:12:06,579 Stage-2 map = 9%, reduce = 0%, Cumulative CPU 12.93 sec
2014-10-13 17:12:07,598 Stage-2 map = 13%, reduce = 0%, Cumulative CPU 12.93 sec
2014-10-13 17:12:08,856 Stage-2 map = 14%, reduce = 0%, Cumulative CPU 23.94 sec
2014-10-13 17:12:09,899 Stage-2 map = 26%, reduce = 0%, Cumulative CPU 42.31 sec
2014-10-13 17:12:10,926 Stage-2 map = 28%, reduce = 0%, Cumulative CPU 67.17 sec
2014-10-13 17:12:11,966 Stage-2 map = 32%, reduce = 0%, Cumulative CPU 146.36 sec
2014-10-13 17:12:13,010 Stage-2 map = 40%, reduce = 0%, Cumulative CPU 358.3 sec
2014-10-13 17:12:14,090 Stage-2 map = 44%, reduce = 0%, Cumulative CPU 593.17 sec
2014-10-13 17:12:15,133 Stage-2 map = 47%, reduce = 0%, Cumulative CPU 824.95 sec
2014-10-13 17:12:16,175 Stage-2 map = 54%, reduce = 0%, Cumulative CPU 1236.37 sec
2014-10-13 17:12:17,228 Stage-2 map = 55%, reduce = 0%, Cumulative CPU 1335.24 sec
2014-10-13 17:12:18,282 Stage-2 map = 58%, reduce = 0%, Cumulative CPU 1517.45 sec
2014-10-13 17:12:19,323 Stage-2 map = 61%, reduce = 0%, Cumulative CPU 1634.66 sec
2014-10-13 17:12:20,362 Stage-2 map = 62%, reduce = 0%, Cumulative CPU 1659.98 sec
2014-10-13 17:12:21,387 Stage-2 map = 66%, reduce = 0%, Cumulative CPU 1687.52 sec
2014-10-13 17:12:22,398 Stage-2 map = 70%, reduce = 0%, Cumulative CPU 1731.53 sec
2014-10-13 17:12:23,409 Stage-2 map = 75%, reduce = 0%, Cumulative CPU 1773.95 sec
2014-10-13 17:12:24,426 Stage-2 map = 81%, reduce = 0%, Cumulative CPU 1938.75 sec
2014-10-13 17:12:25,447 Stage-2 map = 84%, reduce = 0%, Cumulative CPU 2084.19 sec
2014-10-13 17:12:26,460 Stage-2 map = 87%, reduce = 0%, Cumulative CPU 2317.47 sec
2014-10-13 17:12:27,471 Stage-2 map = 91%, reduce = 0%, Cumulative CPU 2443.13 sec
2014-10-13 17:12:28,483 Stage-2 map = 95%, reduce = 0%, Cumulative CPU 2719.49 sec
2014-10-13 17:12:29,495 Stage-2 map = 96%, reduce = 0%, Cumulative CPU 2889.28 sec
2014-10-13 17:12:30,519 Stage-2 map = 97%, reduce = 0%, Cumulative CPU 3041.19 sec
2014-10-13 17:12:31,531 Stage-2 map = 99%, reduce = 0%, Cumulative CPU 3270.88 sec
2014-10-13 17:12:32,543 Stage-2 map = 99%, reduce = 0%, Cumulative CPU 3331.97 sec
2014-10-13 17:12:33,555 Stage-2 map = 99%, reduce = 0%, Cumulative CPU 3346.18 sec
2014-10-13 17:12:34,568 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3364.28 sec
2014-10-13 17:12:35,593 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3364.28 sec
2014-10-13 17:12:36,605 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3377.09 sec
2014-10-13 17:12:37,618 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3389.96 sec
2014-10-13 17:12:38,629 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3409.39 sec
2014-10-13 17:12:39,642 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3437.77 sec
2014-10-13 17:12:40,674 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3437.77 sec
2014-10-13 17:12:41,685 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3477.57 sec
2014-10-13 17:12:42,697 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3477.57 sec
2014-10-13 17:12:43,708 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3479.35 sec
2014-10-13 17:12:44,720 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3481.56 sec
2014-10-13 17:12:45,747 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3481.56 sec
2014-10-13 17:12:46,758 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 3481.56 sec
2014-10-13 17:12:47,770 Stage-2 map = 100%, reduce = 100%, Cumulative CPU 3481.56 sec
MapReduce Total cumulative CPU time: 58 minutes 1 seconds 560 msec
Ended Job = job_201410110944_1174
Ended Job = 762456742, job is filtered out (removed at runtime).
Ended Job = -851905973, job is filtered out (removed at runtime).
Ended Job = -1602248040, job is filtered out (removed at runtime).
Ended Job = -2030348212, job is filtered out (removed at runtime).
Launching Job 4 out of 5
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201410110944_1177, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201410110944_1177
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job -kill job_201410110944_1177
Hadoop job information for Stage-4: number of mappers: 1; number of reducers: 0
2014-10-13 17:12:53,679 Stage-4 map = 0%, reduce = 0%
2014-10-13 17:12:59,699 Stage-4 map = 100%, reduce = 0%, Cumulative CPU 1.65 sec
2014-10-13 17:13:00,704 Stage-4 map = 100%, reduce = 0%, Cumulative CPU 1.65 sec
2014-10-13 17:13:01,709 Stage-4 map = 100%, reduce = 100%, Cumulative CPU 1.65 sec
MapReduce Total cumulative CPU time: 1 seconds 650 msec
Ended Job = job_201410110944_1177
Launching Job 5 out of 5
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201410110944_1178, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201410110944_1178
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job -kill job_201410110944_1178
Hadoop job information for Stage-10: number of mappers: 1; number of reducers: 0
2014-10-13 17:13:06,152 Stage-10 map = 0%, reduce = 0%
2014-10-13 17:13:11,170 Stage-10 map = 100%, reduce = 0%, Cumulative CPU 1.55 sec
2014-10-13 17:13:12,175 Stage-10 map = 100%, reduce = 0%, Cumulative CPU 1.55 sec
2014-10-13 17:13:13,180 Stage-10 map = 100%, reduce = 0%, Cumulative CPU 1.55 sec
2014-10-13 17:13:14,185 Stage-10 map = 100%, reduce = 100%, Cumulative CPU 1.55 sec
MapReduce Total cumulative CPU time: 1 seconds 550 msec
Ended Job = job_201410110944_1178
Loading data to table tim.download_tim_interpreted
Table tim.download_tim_interpreted stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 324107, raw_data_size: 0]
Loading data to table tim.download_tim_verbatim
Table tim.download_tim_verbatim stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 366232, raw_data_size: 0]
626 Rows loaded to download_tim_interpreted
626 Rows loaded to download_tim_verbatim
MapReduce Jobs Launched:
Job 0: Map: 236 Cumulative CPU: 3481.56 sec HDFS Read: 70253480102 HDFS Write: 690339 SUCCESS
Job 1: Map: 1 Cumulative CPU: 1.65 sec HDFS Read: 393509 HDFS Write: 366232 SUCCESS
Job 2: Map: 1 Cumulative CPU: 1.55 sec HDFS Read: 351384 HDFS Write: 324107 SUCCESS
Total MapReduce CPU Time Spent: 58 minutes 4 seconds 760 msec
OK
Time taken: 88.885 seconds
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks not specified. Defaulting to jobconf value of: 108
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapred.reduce.tasks=<number>
Starting Job = job_201410110944_1180, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201410110944_1180
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job -kill job_201410110944_1180
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 108
2014-10-13 17:13:19,801 Stage-1 map = 0%, reduce = 0%
2014-10-13 17:13:23,815 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:24,820 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:25,826 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:26,832 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:27,853 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:28,859 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:29,867 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:30,873 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.29 sec
2014-10-13 17:13:31,878 Stage-1 map = 100%, reduce = 30%, Cumulative CPU 130.17 sec
2014-10-13 17:13:32,885 Stage-1 map = 100%, reduce = 65%, Cumulative CPU 283.94 sec
2014-10-13 17:13:33,892 Stage-1 map = 100%, reduce = 79%, Cumulative CPU 342.94 sec
2014-10-13 17:13:34,899 Stage-1 map = 100%, reduce = 91%, Cumulative CPU 372.94 sec
2014-10-13 17:13:35,906 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 407.36 sec
2014-10-13 17:13:36,912 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 413.28 sec
2014-10-13 17:13:37,934 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 425.21 sec
2014-10-13 17:13:38,941 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 433.18 sec
2014-10-13 17:13:39,948 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 441.25 sec
2014-10-13 17:13:40,955 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 445.29 sec
2014-10-13 17:13:41,962 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 449.33 sec
2014-10-13 17:13:42,981 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 449.33 sec
2014-10-13 17:13:43,988 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 449.33 sec
MapReduce Total cumulative CPU time: 7 minutes 29 seconds 330 msec
Ended Job = job_201410110944_1180
Moving data to: hdfs://c1n8.gbif.org:8020/user/hive/warehouse/tim.db/download_tim_citation
Table tim.download_tim_citation stats: [num_partitions: 0, num_files: 108, num_rows: 0, total_size: 320, raw_data_size: 0]
8 Rows loaded to hdfs://c1n8.gbif.org:8020/tmp/hive-occurrence.download/hive_2014-10-13_17-13-15_176_5966249776058554251/-ext-10000
MapReduce Jobs Launched:
Job 0: Map: 1 Reduce: 108 Cumulative CPU: 449.33 sec HDFS Read: 324322 HDFS Write: 320 SUCCESS
Total MapReduce CPU Time Spent: 7 minutes 29 seconds 330 msec
OK
Time taken: 29.464 seconds
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks not specified. Defaulting to jobconf value of: 108
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapred.reduce.tasks=<number>
Starting Job = job_201410110944_1181, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201410110944_1181
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job -kill job_201410110944_1181
Hadoop job information for Stage-1: number of mappers: 6; number of reducers: 108
2014-10-13 17:13:48,786 Stage-1 map = 0%, reduce = 0%
2014-10-13 17:13:54,805 Stage-1 map = 17%, reduce = 0%, Cumulative CPU 3.47 sec
2014-10-13 17:13:55,810 Stage-1 map = 33%, reduce = 0%, Cumulative CPU 4.8 sec
2014-10-13 17:13:56,815 Stage-1 map = 33%, reduce = 0%, Cumulative CPU 4.8 sec
2014-10-13 17:13:57,819 Stage-1 map = 33%, reduce = 0%, Cumulative CPU 4.8 sec
2014-10-13 17:13:58,824 Stage-1 map = 33%, reduce = 0%, Cumulative CPU 4.8 sec
2014-10-13 17:13:59,829 Stage-1 map = 33%, reduce = 0%, Cumulative CPU 4.8 sec
2014-10-13 17:14:00,834 Stage-1 map = 33%, reduce = 0%, Cumulative CPU 4.8 sec
2014-10-13 17:14:01,838 Stage-1 map = 50%, reduce = 0%, Cumulative CPU 16.53 sec
2014-10-13 17:14:02,843 Stage-1 map = 50%, reduce = 0%, Cumulative CPU 16.53 sec
2014-10-13 17:14:03,848 Stage-1 map = 59%, reduce = 0%, Cumulative CPU 16.53 sec
2014-10-13 17:14:04,853 Stage-1 map = 59%, reduce = 0%, Cumulative CPU 16.53 sec
2014-10-13 17:14:05,878 Stage-1 map = 67%, reduce = 0%, Cumulative CPU 16.53 sec
2014-10-13 17:14:06,883 Stage-1 map = 84%, reduce = 0%, Cumulative CPU 34.99 sec
2014-10-13 17:14:07,888 Stage-1 map = 84%, reduce = 0%, Cumulative CPU 34.99 sec
2014-10-13 17:14:08,893 Stage-1 map = 84%, reduce = 0%, Cumulative CPU 34.99 sec
2014-10-13 17:14:09,898 Stage-1 map = 92%, reduce = 0%, Cumulative CPU 34.99 sec
2014-10-13 17:14:10,918 Stage-1 map = 92%, reduce = 0%, Cumulative CPU 34.99 sec
2014-10-13 17:14:11,923 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 55.86 sec
2014-10-13 17:14:12,928 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 55.86 sec
2014-10-13 17:14:13,932 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 55.86 sec
2014-10-13 17:14:14,937 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 82.76 sec
2014-10-13 17:14:15,950 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 82.76 sec
2014-10-13 17:14:16,957 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 82.76 sec
2014-10-13 17:14:17,962 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 82.76 sec
2014-10-13 17:14:18,967 Stage-1 map = 100%, reduce = 5%, Cumulative CPU 104.65 sec
2014-10-13 17:14:19,973 Stage-1 map = 100%, reduce = 46%, Cumulative CPU 303.12 sec
2014-10-13 17:14:21,000 Stage-1 map = 100%, reduce = 75%, Cumulative CPU 444.18 sec
2014-10-13 17:14:22,007 Stage-1 map = 100%, reduce = 92%, Cumulative CPU 527.46 sec
2014-10-13 17:14:23,014 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 545.4 sec
2014-10-13 17:14:24,022 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 545.4 sec
2014-10-13 17:14:25,029 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 545.4 sec
2014-10-13 17:14:26,048 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 558.55 sec
2014-10-13 17:14:27,104 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:28,110 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:29,117 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:30,124 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:31,146 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:32,153 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:33,160 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:34,167 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:35,173 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:36,180 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:37,187 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:38,195 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:39,202 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:40,209 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 563.09 sec
2014-10-13 17:14:41,235 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:42,242 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:43,248 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:44,255 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:45,261 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:46,282 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:47,289 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:48,295 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 590.18 sec
2014-10-13 17:14:49,301 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 600.12 sec
2014-10-13 17:14:50,308 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 600.12 sec
2014-10-13 17:14:51,339 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 600.12 sec
2014-10-13 17:14:52,345 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 600.12 sec
MapReduce Total cumulative CPU time: 10 minutes 0 seconds 120 msec
Ended Job = job_201410110944_1181
Moving data to: hdfs://c1n8.gbif.org:8020/user/hive/warehouse/tim.db/download_tim_multimedia
Table tim.download_tim_multimedia stats: [num_partitions: 0, num_files: 108, num_rows: 0, total_size: 0, raw_data_size: 0]
0 Rows loaded to hdfs://c1n8.gbif.org:8020/tmp/hive-occurrence.download/hive_2014-10-13_17-13-44_640_7054930929074397513/-ext-10000
MapReduce Jobs Launched:
Job 0: Map: 6 Reduce: 108 Cumulative CPU: 600.12 sec HDFS Read: 128914079 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 10 minutes 0 seconds 120 msec
OK
Time taken: 68.103 seconds
Log file: /mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/hive-oozie-job_201410110944_1171.log not present. Therefore no Hadoop jobids found
syslog logs
2014-10-13 17:11:41,704 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2014-10-13 17:11:42,060 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /mnt/disk_j/mapred/local/taskTracker/tim/distcache/5608937037471599868_23010131_168819650/c1n8.gbif.org/user/tim/occurrence-download/hive-scripts/execute-query.q <- /mnt/disk_j/mapred/local/taskTracker/tim/jobcache/job_201410110944_1171/attempt_201410110944_1171_m_000000_0/work/execute-query.q
2014-10-13 17:11:42,102 WARN org.apache.hadoop.conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.session-id
2014-10-13 17:11:42,103 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=MAP, sessionId=
2014-10-13 17:11:42,144 WARN org.apache.hadoop.conf.Configuration: slave.host.name is deprecated. Instead, use dfs.datanode.hostname
2014-10-13 17:11:42,485 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0
2014-10-13 17:11:42,488 INFO org.apache.hadoop.mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@9b3f577
2014-10-13 17:11:42,718 INFO org.apache.hadoop.mapred.MapTask: Processing split: hdfs://c1n8.gbif.org:8020/user/tim/oozie-oozi/0000345-141011094409524-oozie-oozi-W/execute_query--hive/input/dummy.txt:0+5
2014-10-13 17:11:42,737 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use FileInputFormatCounters as group name and BYTES_READ as counter name instead
2014-10-13 17:11:42,740 INFO org.apache.hadoop.mapred.MapTask: numReduceTasks: 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment