miguno miguno
miguno
/ gist:994938
Created
May 27, 2011 09:35
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/hadoop/gutenberg/gutenberg/gutenberg.txt could only be replicated to 0 nodes, instead of 1 | |
| at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1271) | |
| at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:422) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) | |
| at java.lang.reflect.Method.invoke(Method.java:597) | |
| at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508) | |
| at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959) | |
| at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/hadoop/gutenberg/gutenberg/gutenberg.txt could only be replicated to 0 nodes, instead of 1 | |
| at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1271) | |
| at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:422) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) | |
| at java.lang.reflect.Method.invoke(Method.java:597) | |
| at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508) | |
| at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959) | |
| at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-05-15 22:06:55,605 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting TaskTracker | |
| STARTUP_MSG: host = mandar/127.0.1.1 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 0.20.2 | |
| STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 | |
| ************************************************************/ | |
| 2011-05-15 22:07:00,861 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | |
| 2011-05-15 22:07:00,986 INFO org.apache.hadoop.http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50060 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| bin/hadoop jar hadoop-0.20.2-test.jar TestDFSIO -nrFiles 1 -fileSize 10 | |
| TestFDSIO.0.0.4 | |
| 11/05/30 14:26:08 INFO mapred.FileInputFormat: nrFiles = 1 | |
| 11/05/30 14:26:08 INFO mapred.FileInputFormat: fileSize (MB) = 10 | |
| 11/05/30 14:26:08 INFO mapred.FileInputFormat: bufferSize = 1000000 | |
| 11/05/30 14:28:12 INFO mapred.FileInputFormat: creating control file: 10 mega bytes, 1 files | |
| 11/05/30 14:28:12 WARN hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /benchmarks/TestDFSIO/io_control/in_file_test_io_0 could only be replicated to 0 nodes, instead of 1 | |
| at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1271) | |
| at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:422) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-05-31 14:44:47,611 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting JobTracker | |
| STARTUP_MSG: host = PDCloud-Host3/9.126.113.177 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 0.20.2 | |
| STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 | |
| ************************************************************/ | |
| 2011-05-31 14:44:47,747 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1) | |
| 2011-05-31 14:44:47,833 INFO org.apache.hadoop.ipc.metrics.RpcMetrics: Initializing RPC Metrics with hostName=JobTracker, port=54311 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-07-28 21:14:19,714 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting DataNode | |
| STARTUP_MSG: host = ubuntu/127.0.1.1 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 0.20.203.0 | |
| STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203 -r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011 | |
| ************************************************************/ | |
| 2011-07-28 21:14:20,311 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties | |
| 2011-07-28 21:14:20,342 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-09-02 14:54:19,733 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201108251643_0006_m_000008_0 task’s state:UNASSIGNED | |
| 2011-09-02 14:54:19,733 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201108251643_0006_m_000008_0 which needs 1 slots | |
| 2011-09-02 14:54:19,733 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 2 and trying to launch attempt_201108251643_0006_m_000008_0 which needs 1 slots | |
| 2011-09-02 14:54:19,786 INFO org.apache.hadoop.mapred.JobLocalizer: Initializing user hadoop on this TT. | |
| 2011-09-02 14:54:19,878 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201108251643_0006_m_-1954605197 | |
| 2011-09-02 14:54:19,878 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201108251643_0006_m_-1954605197 spawned. | |
| 2011-09-02 14:54:19,879 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /var/hadoop/tmp/mapred/local/ttprivate/taskTracker/hadoop/jobcache/job_201108251643 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| hduser@host:/usr/local/hadoop$ bin/hadoop jar hadoop*examples*.jar wordcount /user/hduser/gutenberg /user/hduser/gutenberg-output | |
| 11/10/22 22:03:33 INFO input.FileInputFormat: Total input paths to process : 3 | |
| 11/10/22 22:03:34 INFO mapred.JobClient: Running job: job_201110222200_0001 | |
| 11/10/22 22:03:35 INFO mapred.JobClient: map 0% reduce 0% | |
| 11/10/22 22:03:54 INFO mapred.JobClient: map 66% reduce 0% | |
| 11/10/22 22:04:00 INFO mapred.JobClient: map 100% reduce 0% | |
| 11/10/22 22:04:02 INFO mapred.JobClient: Task Id : attempt_201110222200_0001_r_000000_0, Status : FAILED | |
| Error: java.lang.NullPointerException | |
| at java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:768) | |
| at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.getMapCompletionEvents(ReduceTask.java:2900) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-11-08 20:34:36,671 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: | |
| /************************************************************ | |
| STARTUP_MSG: Starting DataNode | |
| STARTUP_MSG: host = dinesh-Studio-1555/172.16.9.93 | |
| STARTUP_MSG: args = [] | |
| STARTUP_MSG: version = 0.20.2 | |
| STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 | |
| ************************************************************/ | |
| 2011-11-08 20:34:41,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Storage directory /app/hadoop/tmp/dfs/data is not formatted. | |
| 2011-11-08 20:34:41,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Formatting ... |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| lrmraxm:hadoop-0.20.2-cdh3u2 anuj.maurice$ bin/hadoop jar contrib/streaming/hadoop-streaming-0.20.2-cdh3u2.jar -file /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/mapper.py -mapper mapper.py -file /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/reducer.py -reducer reducer.py -input /oos.txt -output /oos_new | |
| packageJobJar: [/Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/mapper.py, /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/reducer.py, /tmp/hadoop-anuj.maurice/hadoop-unjar2426556812178658809/] [] /var/folders/Yu/YuXibLtIHOuWcHsjWu8zM-Ccvdo/-Tmp-/streamjob4679204253733026415.jar tmpDir=null | |
| 12/01/04 12:02:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable | |
| 12/01/04 12:02:02 WARN snappy.LoadSnappy: Snappy native library not loaded | |
| 12/01/04 12:02:02 INFO mapred.FileInputFormat: Total input paths to process : 1 | |
| 12/01/04 12:02:03 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-anuj.ma |
OlderNewer