Created
January 20, 2015 02:14
-
-
Save apple-corps/fe2723948171886310bf to your computer and use it in GitHub Desktop.
hadoop standby namenode log snippet
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 015-01-19 18:55:46,845 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50626862&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50626862&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4 of size 113416 edits # 711 loaded in 0 seconds | |
| 2015-01-19 18:55:47,323 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 711 edits starting from txid 50626861 | |
| 2015-01-19 18:57:17,662 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:19,705 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:21,275 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:23,599 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:26,354 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:27,974 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:29,566 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:31,551 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:57:47,809 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode us3sm2nn011r08.comp.prod.local/10.51.28.141:8020 | |
| 2015-01-19 18:57:47,893 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@74057363 expecting start txid #50627573 | |
| 2015-01-19 18:57:47,893 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk011r08.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4 | |
| 2015-01-19 18:57:47,893 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk011r08.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4' to transaction ID 50627573 | |
| 2015-01-19 18:57:47,894 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4' to transaction ID 50627573 | |
| 2015-01-19 18:57:47,904 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode ON. | |
| The reported blocks 1892537 needs additional 869530 blocks to reach the threshold 0.9990 of total blocks 2764831. | |
| Safe mode will be turned off automatically | |
| 2015-01-19 18:57:47,919 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk011r08.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50627573&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4 of size 132950 edits # 719 loaded in 0 seconds | |
| 2015-01-19 18:57:48,341 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 719 edits starting from txid 50627572 | |
| 2015-01-19 18:58:52,010 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:58:54,452 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Get corrupt file blocks returned error: Operation category READ is not supported in state standby | |
| 2015-01-19 18:59:04,533 INFO org.apache.hadoop.hdfs.server.namenode.ha.StandbyCheckpointer: Triggering checkpoint because it has been 3621 seconds since the last checkpoint, which exceeds the configured interval 3600 | |
| 2015-01-19 18:59:04,533 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Save namespace ... | |
| 2015-01-19 18:59:13,417 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Going to retain 2 images with txid >= 50576218 | |
| 2015-01-19 18:59:13,418 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old image FSImageFile(file=/var/lib/hadoop-hdfs/cache/hdfs/dfs/name/current/fsimage_0000000000050483413, cpktTxId=0000000000050483413) | |
| 2015-01-19 18:59:13,503 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old image FSImageFile(file=/nfs/namedir/current/fsimage_0000000000050483413, cpktTxId=0000000000050483413) | |
| 2015-01-19 18:59:25,706 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Uploaded image with txid 50628291 to namenode at http://us3sm2nn011r08.comp.prod.local:50070 in 12.04 seconds | |
| 2015-01-19 18:59:48,773 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode us3sm2nn011r08.comp.prod.local/10.51.28.141:8020 | |
| 2015-01-19 18:59:48,872 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@3e91d58b expecting start txid #50628292 | |
| 2015-01-19 18:59:48,872 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4 | |
| 2015-01-19 18:59:48,872 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4' to transaction ID 50628292 | |
| 2015-01-19 18:59:48,872 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4' to transaction ID 50628292 | |
| 2015-01-19 18:59:48,878 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode ON. | |
| The reported blocks 1892537 needs additional 869906 blocks to reach the threshold 0.9990 of total blocks 2765208. | |
| Safe mode will be turned off automatically | |
| 2015-01-19 18:59:48,881 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://us3sm2zk012r09.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4, http://us3sm2zk010r07.comp.prod.local:8480/getJournal?jid=whprod&segmentTxId=50628292&storageInfo=-55%3A977585766%3A0%3ACID-1ccb02a5-bfd7-4808-a925-8e9804d40ec4 of size 23716 edits # 194 loaded in 0 seconds | |
| 2015-01-19 18:59:49,305 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 194 edits starting from txid 50628291 | |
| 2015-01-19 19:01:49,738 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode us3sm2nn011r08.comp.prod.local/10.51.28.141:8020 | |
| 2015-01-19 19:01:49,820 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@578b9dbe expecting start txid #50628486 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment