Skip to content

Instantly share code, notes, and snippets.

@alienrobotwizard
Created April 20, 2011 21:32
Show Gist options
  • Save alienrobotwizard/932926 to your computer and use it in GitHub Desktop.
Save alienrobotwizard/932926 to your computer and use it in GitHub Desktop.
Task Logs: 'attempt_201104192141_0024_r_000000_0'
stdout logs
stderr logs
syslog logs
2011-04-20 19:23:39,995 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:23:39,997 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:23:39,997 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:23:39,998 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:23:40,001 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:23:40,013 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:23:40,014 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:23:40,017 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:23:40,017 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:23:40,018 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:23:40,167 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library
2011-04-20 19:23:40,780 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId=
2011-04-20 19:23:41,054 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:23:41,055 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:23:41,055 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:23:41,055 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:23:41,055 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:23:41,055 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:23:41,057 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:23:41,057 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:23:41,059 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:23:41,072 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:23:41,072 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:23:41,072 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:23:41,073 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:23:41,075 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:23:41,075 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:23:41,075 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:23:41,075 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:23:41,075 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:23:41,076 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:23:41,076 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
2011-04-20 19:23:41,878 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:23:41,879 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:23:41,879 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:23:41,879 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:23:41,879 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:23:41,880 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:23:41,882 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:23:41,882 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:23:41,882 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:23:41,883 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:23:41,883 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:23:41,883 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:23:41,884 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:23:41,918 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:23:41,918 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:23:41,918 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:23:41,918 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:23:41,918 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:23:41,919 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:23:41,919 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
2011-04-20 19:23:42,011 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:23:42,012 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:23:42,012 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:23:42,012 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:23:42,012 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:23:42,012 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:23:42,073 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:23:42,073 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:23:42,073 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:23:42,074 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:23:42,103 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:23:42,104 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:23:42,105 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:23:42,107 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:23:42,107 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:23:42,107 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:23:42,107 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:23:42,107 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:23:42,108 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:23:42,108 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14 GMT
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=ip-10-204-246-6.ec2.internal
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/usr/lib/hadoop-0.20/conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hadoop-0.20:/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u0.jar:/usr/lib/hadoop-0.20/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop-0.20/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop-0.20/lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop-0.20/lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop-0.20/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop-0.20/lib/commons-net-1.4.1.jar:/usr/lib/hadoop-0.20/lib/core-3.1.1.jar:/usr/lib/hadoop-0.20/lib/hadoop-fairscheduler-0.20.2-cdh3u0.jar:/usr/lib/hadoop-0.20/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20/lib/jetty-6.1.26.jar:/usr/lib/hadoop-0.20/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop-0.20/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop-0.20/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20/lib/junit-4.5.jar:/usr/lib/hadoop-0.20/lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar:/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop-0.20/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop-0.20/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop-0.20/lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-api-2.1.jar:/mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/jars/classes:/mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/jars/job.jar:/mnt2/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/attempt_201104192141_0024_r_000000_0/work
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=/usr/lib/hadoop-0.20/lib/native/Linux-amd64-64:/mnt2/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/attempt_201104192141_0024_r_000000_0/work
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/mnt2/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/attempt_201104192141_0024_r_000000_0/work/tmp
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=2.6.35-24-virtual
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=mapred
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/var/run/hadoop-0.20
2011-04-20 19:23:42,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/mnt2/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/attempt_201104192141_0024_r_000000_0/work
2011-04-20 19:23:42,336 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=10.118.125.197:2181,10.85.47.210:2181,10.98.163.41:2181,10.85.30.59:2181,10.80.213.62:2181 sessionTimeout=90000 watcher=hconnection
2011-04-20 19:23:42,380 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.118.125.197:2181
2011-04-20 19:23:42,382 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-118-125-197.ec2.internal/10.118.125.197:2181, initiating session
2011-04-20 19:23:42,414 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:23:42,538 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.85.47.210:2181
2011-04-20 19:23:42,540 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-47-210.ec2.internal/10.85.47.210:2181, initiating session
2011-04-20 19:23:42,552 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server ip-10-85-47-210.ec2.internal/10.85.47.210:2181, sessionid = 0x32f5798129d0696, negotiated timeout = 40000
2011-04-20 19:23:42,936 INFO org.apache.hadoop.hbase.mapreduce.TableOutputFormat: Created table instance for geo_location_infochimps_place
2011-04-20 19:23:43,003 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:23:43,003 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:23:43,003 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:23:43,004 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:23:43,004 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:23:43,004 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:23:43,005 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:23:43,005 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:23:43,005 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:23:43,007 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:23:43,007 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:23:43,007 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:23:43,008 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:23:43,020 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:23:43,020 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:23:43,020 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:23:43,020 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:23:43,020 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:23:43,021 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:23:43,021 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
2011-04-20 19:23:43,106 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=1360383104, MaxSingleShuffleLimit=340095776
2011-04-20 19:23:43,118 INFO org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
2011-04-20 19:23:43,119 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,133 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,149 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,173 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,191 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,213 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,226 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor
2011-04-20 19:23:43,271 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Thread started: Thread for merging on-disk files
2011-04-20 19:23:43,271 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Thread waiting: Thread for merging on-disk files
2011-04-20 19:23:43,298 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Thread started: Thread for merging in memory files
2011-04-20 19:23:43,301 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 207 map output(s) where 0 is already in progress
2011-04-20 19:23:43,301 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Thread started: Thread for polling Map Completion Events
2011-04-20 19:23:43,301 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:48,310 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:49,996 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:50,133 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:50,347 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:50,522 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:50,725 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:50,982 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:51,052 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:51,132 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:51,262 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:51,462 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:51,664 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:23:56,751 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:06,954 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:12,118 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:17,230 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:32,524 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:32,588 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:47,690 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 189 map output(s) where 0 is already in progress
2011-04-20 19:24:47,690 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:47,772 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:24:47,842 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:02,958 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:03,198 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:18,306 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:23,444 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:33,594 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:38,651 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:48,732 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 180 map output(s) where 0 is already in progress
2011-04-20 19:25:48,732 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:49,065 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:59,187 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:25:59,242 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:04,315 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:14,484 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:24,577 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:34,661 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:39,919 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:44,996 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:26:50,076 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 170 map output(s) where 0 is already in progress
2011-04-20 19:26:50,076 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:27:05,094 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:27:15,142 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:27:25,212 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:27:30,315 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:27:40,432 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:27:50,505 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 165 map output(s) where 0 is already in progress
2011-04-20 19:27:50,506 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:00,613 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:10,708 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:25,845 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:35,935 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:51,018 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 160 map output(s) where 0 is already in progress
2011-04-20 19:28:51,019 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:51,088 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:28:56,126 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:29:16,184 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:29:21,422 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:29:31,522 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:29:36,594 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:29:46,651 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:29:51,758 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 152 map output(s) where 0 is already in progress
2011-04-20 19:29:51,758 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:01,762 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:11,900 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:16,964 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:27,176 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:37,248 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:37,352 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:52,412 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 146 map output(s) where 0 is already in progress
2011-04-20 19:30:52,412 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:30:57,602 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:02,733 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:17,827 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:23,420 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:23,477 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:38,616 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:48,759 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:48,858 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:31:53,924 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 137 map output(s) where 0 is already in progress
2011-04-20 19:31:53,924 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:03,935 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:09,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:14,180 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:29,308 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:34,376 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:34,445 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:54,561 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 131 map output(s) where 0 is already in progress
2011-04-20 19:32:54,562 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:59,734 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:32:59,794 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:19,849 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:24,926 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:24,982 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:45,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:50,135 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:50,221 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:33:55,259 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 122 map output(s) where 0 is already in progress
2011-04-20 19:33:55,259 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:05,259 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:15,372 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:15,429 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:30,534 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:35,582 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:35,757 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:34:55,796 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 116 map output(s) where 0 is already in progress
2011-04-20 19:34:55,796 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:00,854 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:00,936 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:16,010 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:26,074 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:26,172 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:41,248 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:51,347 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:51,398 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:35:56,462 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 107 map output(s) where 0 is already in progress
2011-04-20 19:35:56,463 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:06,463 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:11,587 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:16,652 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:31,706 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:36,958 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:37,017 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:52,077 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:36:57,230 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 100 map output(s) where 0 is already in progress
2011-04-20 19:36:57,230 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:02,230 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:02,297 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:17,342 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:22,487 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:27,533 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:42,589 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:47,765 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:52,821 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:37:57,871 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 92 map output(s) where 0 is already in progress
2011-04-20 19:37:57,872 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:07,872 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:12,920 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:13,536 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:33,606 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:38,662 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:38,768 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:53,822 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:38:58,879 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 85 map output(s) where 0 is already in progress
2011-04-20 19:38:58,880 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:03,880 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:03,935 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:18,976 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:19,231 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor
2011-04-20 19:39:19,234 INFO org.apache.hadoop.mapred.ReduceTask: Initiating in-memory merge with 124 segments...
2011-04-20 19:39:19,247 INFO org.apache.hadoop.mapred.Merger: Merging 124 sorted segments
2011-04-20 19:39:19,249 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 124 segments left of total size: 895402956 bytes
2011-04-20 19:39:24,209 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:29,309 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:44,395 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:50,084 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:39:55,153 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:00,251 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 77 map output(s) where 0 is already in progress
2011-04-20 19:40:00,251 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:10,255 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:14,151 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Merge of the 124 files in-memory complete. Local file is /mnt2/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/attempt_201104192141_0024_r_000000_0/output/map_1.out of size 110569296
2011-04-20 19:40:14,151 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Thread waiting: Thread for merging on-disk files
2011-04-20 19:40:15,523 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:20,586 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:35,641 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:41,284 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:46,333 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:40:56,427 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:01,492 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 70 map output(s) where 0 is already in progress
2011-04-20 19:41:01,493 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:06,493 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:21,602 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:26,673 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:31,743 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:46,790 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:51,912 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:41:56,955 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:02,005 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 63 map output(s) where 0 is already in progress
2011-04-20 19:42:02,005 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:07,006 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:12,142 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:22,201 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:32,683 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:37,774 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:42,876 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:57,941 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:42:58,012 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:03,059 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 55 map output(s) where 0 is already in progress
2011-04-20 19:43:03,059 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:08,068 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:18,121 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:23,169 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:33,271 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:43,340 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:48,402 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:43:53,558 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:03,598 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 48 map output(s) where 0 is already in progress
2011-04-20 19:44:03,599 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:08,599 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:13,657 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:18,985 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:34,042 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:34,091 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:44,125 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:54,231 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:44:59,288 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:04,392 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 40 map output(s) where 0 is already in progress
2011-04-20 19:45:04,393 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:19,447 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:24,505 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:29,624 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:49,678 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:49,757 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:45:49,867 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:04,928 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 33 map output(s) where 0 is already in progress
2011-04-20 19:46:04,928 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:09,928 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:15,337 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:15,429 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:35,469 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:35,537 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:46:35,652 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:00,698 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:05,865 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 26 map output(s) where 0 is already in progress
2011-04-20 19:47:05,865 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:05,944 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:31,027 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:31,183 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:31,226 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:56,285 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:56,424 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:47:56,479 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:06,694 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 18 map output(s) where 0 is already in progress
2011-04-20 19:48:06,694 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:16,695 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:21,754 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:36,805 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:41,901 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:41,951 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:48:56,983 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:02,119 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:07,176 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Need another 11 map output(s) where 0 is already in progress
2011-04-20 19:49:07,176 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:17,256 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:22,357 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:27,467 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:32,520 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:37,581 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:42,620 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:47,646 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:52,748 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:49:57,760 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:50:02,772 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201104192141_0024_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts)
2011-04-20 19:50:03,148 INFO org.apache.hadoop.mapred.ReduceTask: GetMapEventsThread exiting
2011-04-20 19:50:03,148 INFO org.apache.hadoop.mapred.ReduceTask: getMapsEventsThread joined.
2011-04-20 19:50:03,149 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager
2011-04-20 19:50:03,150 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 1 files left.
2011-04-20 19:50:03,150 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 83 files left.
2011-04-20 19:50:03,170 INFO org.apache.hadoop.mapred.Merger: Merging 83 sorted segments
2011-04-20 19:50:03,170 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 83 segments left of total size: 540387212 bytes
2011-04-20 19:50:31,706 INFO org.apache.hadoop.mapred.ReduceTask: Merged 83 segments, 540387212 bytes to disk to satisfy reduce memory limit
2011-04-20 19:50:31,706 INFO org.apache.hadoop.mapred.ReduceTask: Merging 2 files, 171180510 bytes from disk
2011-04-20 19:50:31,707 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce
2011-04-20 19:50:31,707 INFO org.apache.hadoop.mapred.Merger: Merging 2 sorted segments
2011-04-20 19:50:31,745 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 171180502 bytes
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:50:31,809 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:50:31,810 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:50:31,826 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:50:31,827 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
2011-04-20 19:50:31,834 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=10.118.125.197:2181,10.85.47.210:2181,10.98.163.41:2181,10.85.30.59:2181,10.80.213.62:2181 sessionTimeout=90000 watcher=hconnection
2011-04-20 19:50:31,845 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.80.213.62:2181
2011-04-20 19:50:31,848 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-80-213-62.ec2.internal/10.80.213.62:2181, initiating session
2011-04-20 19:50:31,849 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:32,908 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.85.47.210:2181
2011-04-20 19:50:32,910 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-47-210.ec2.internal/10.85.47.210:2181, initiating session
2011-04-20 19:50:32,910 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:33,225 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.98.163.41:2181
2011-04-20 19:50:33,227 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-98-163-41.ec2.internal/10.98.163.41:2181, initiating session
2011-04-20 19:50:33,246 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:33,366 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.118.125.197:2181
2011-04-20 19:50:33,378 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-118-125-197.ec2.internal/10.118.125.197:2181, initiating session
2011-04-20 19:50:33,378 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:33,903 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.85.30.59:2181
2011-04-20 19:50:33,905 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-30-59.ec2.internal/10.85.30.59:2181, initiating session
2011-04-20 19:50:33,906 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:34,165 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-80-213-62.ec2.internal/10.80.213.62:2181
2011-04-20 19:50:34,165 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-80-213-62.ec2.internal/10.80.213.62:2181, initiating session
2011-04-20 19:50:34,166 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:34,619 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-47-210.ec2.internal/10.85.47.210:2181
2011-04-20 19:50:34,620 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-47-210.ec2.internal/10.85.47.210:2181, initiating session
2011-04-20 19:50:34,621 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:35,533 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-98-163-41.ec2.internal/10.98.163.41:2181
2011-04-20 19:50:35,534 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-98-163-41.ec2.internal/10.98.163.41:2181, initiating session
2011-04-20 19:50:35,534 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:35,644 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-118-125-197.ec2.internal/10.118.125.197:2181
2011-04-20 19:50:35,645 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-118-125-197.ec2.internal/10.118.125.197:2181, initiating session
2011-04-20 19:50:35,646 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:36,665 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-30-59.ec2.internal/10.85.30.59:2181
2011-04-20 19:50:36,666 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-30-59.ec2.internal/10.85.30.59:2181, initiating session
2011-04-20 19:50:36,666 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:36,856 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-80-213-62.ec2.internal/10.80.213.62:2181
2011-04-20 19:50:36,856 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-80-213-62.ec2.internal/10.80.213.62:2181, initiating session
2011-04-20 19:50:36,857 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:37,648 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-47-210.ec2.internal/10.85.47.210:2181
2011-04-20 19:50:37,649 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-47-210.ec2.internal/10.85.47.210:2181, initiating session
2011-04-20 19:50:37,649 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:37,985 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-98-163-41.ec2.internal/10.98.163.41:2181
2011-04-20 19:50:37,985 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-98-163-41.ec2.internal/10.98.163.41:2181, initiating session
2011-04-20 19:50:37,986 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:38,668 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-118-125-197.ec2.internal/10.118.125.197:2181
2011-04-20 19:50:38,669 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-118-125-197.ec2.internal/10.118.125.197:2181, initiating session
2011-04-20 19:50:38,669 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:39,054 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-30-59.ec2.internal/10.85.30.59:2181
2011-04-20 19:50:39,054 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-30-59.ec2.internal/10.85.30.59:2181, initiating session
2011-04-20 19:50:39,055 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:39,372 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-80-213-62.ec2.internal/10.80.213.62:2181
2011-04-20 19:50:39,373 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-80-213-62.ec2.internal/10.80.213.62:2181, initiating session
2011-04-20 19:50:39,373 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:39,872 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-47-210.ec2.internal/10.85.47.210:2181
2011-04-20 19:50:39,872 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-47-210.ec2.internal/10.85.47.210:2181, initiating session
2011-04-20 19:50:39,873 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:40,128 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-98-163-41.ec2.internal/10.98.163.41:2181
2011-04-20 19:50:40,129 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-98-163-41.ec2.internal/10.98.163.41:2181, initiating session
2011-04-20 19:50:40,130 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:40,336 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-118-125-197.ec2.internal/10.118.125.197:2181
2011-04-20 19:50:40,336 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-118-125-197.ec2.internal/10.118.125.197:2181, initiating session
2011-04-20 19:50:40,337 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:41,300 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-30-59.ec2.internal/10.85.30.59:2181
2011-04-20 19:50:41,301 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-30-59.ec2.internal/10.85.30.59:2181, initiating session
2011-04-20 19:50:41,301 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:41,779 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-80-213-62.ec2.internal/10.80.213.62:2181
2011-04-20 19:50:41,779 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-80-213-62.ec2.internal/10.80.213.62:2181, initiating session
2011-04-20 19:50:41,780 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:41,881 ERROR org.apache.hadoop.hbase.mapreduce.TableOutputFormat: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
2011-04-20 19:50:42,078 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server ip-10-85-47-210.ec2.internal/10.85.47.210:2181
2011-04-20 19:50:42,079 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to ip-10-85-47-210.ec2.internal/10.85.47.210:2181, initiating session
2011-04-20 19:50:42,080 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2011-04-20 19:50:42,123 INFO com.infochimps.hadoop.pig.hbase.DynamicFamilyStorage: family:[[B@12072edc], colname:[[B@159576c3], timestamp:[1303329042123], colval:[[B@7a80747]
2011-04-20 19:50:42,142 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2011-04-20 19:50:42,152 WARN org.apache.hadoop.mapred.Child: Error running child
java.io.IOException: java.lang.NullPointerException
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:438)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:401)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:381)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:251)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:571)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:413)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:126)
at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:81)
at com.infochimps.hadoop.pig.hbase.DynamicFamilyStorage.putNext(DynamicFamilyStorage.java:159)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:138)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:97)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:513)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:436)
... 11 more
2011-04-20 19:50:42,158 INFO org.apache.hadoop.mapred.Task: Runnning cleanup for the task
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.trash.interval; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xceivers; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.reduce.tasks.maximum; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: fs.checkpoint.dir; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.permissions; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.block.size; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.tasktracker.map.tasks.maximum; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.hosts.exclude; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.rpc.socket.factory.class.default; Ignoring.
2011-04-20 19:50:42,171 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.namenode.handler.count; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.child.ulimit; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: tasktracker.http.threads; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: mapred.job.tracker.handler.count; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.max.xcievers; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.du.reserved; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring.
2011-04-20 19:50:42,172 WARN org.apache.hadoop.conf.Configuration: /mnt4/hadoop/mapred/local/taskTracker/jacob/jobcache/job_201104192141_0024/job.xml:a attempt to override final parameter: dfs.datanode.handler.count; Ignoring.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment