boylez 发表于 2011-11-25 14:19

测试的hadoop出了个警告,啥都没干又消失了

在dfs的网页上红字
WARNING : There are about 1 missing blocks. Please check the log or run fsck.

点进去显示
Reported Corrupt Files
No missing blocks found at the moment.
Please run fsck for a thorough health analysis.

过了10分钟,没了
完全啥都没干!!!

有错的时候,所有的内存,硬盘啊,都是0了

测试的环境,2个datanode,我关了一个,剩下的一个,出了这个问题,现在又好了

各位碰到过么

boylez 发表于 2011-11-25 14:27

在那个好的datanode上,日志里记录
2011-11-25 14:24:49,757 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action: DNA_REGISTER
2011-11-25 14:24:49,763 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 1 blocks got processed in 3 msecs
2011-11-25 14:24:52,758 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action: DNA_REGISTER
2011-11-25 14:24:52,764 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 1 blocks got processed in 3 msecs
2011-11-25 14:24:55,759 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action: DNA_REGISTER
2011-11-25 14:24:55,765 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 1 blocks got processed in 3 msecs
2011-11-25 14:24:58,760 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action: DNA_REGISTER
2011-11-25 14:24:58,765 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 1 blocks got processed in 2 msecs
2011-11-25 14:25:01,761 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action: DNA_REGISTER
2011-11-25 14:25:01,767 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 1 blocks got processed in 2 msecs
2011-11-25 14:25:04,761 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Unexpected error trying to delete block blk_981066449475511145_1005. BlockInfo not found in volumeMap.
2011-11-25 14:25:04,763 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Error processing datanode Command
java.io.IOException: Error in deleting blocks.
      at org.apache.hadoop.hdfs.server.datanode.FSDataset.invalidate(FSDataset.java:1650)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.processCommand(DataNode.java:916)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.processCommand(DataNode.java:878)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.offerService(DataNode.java:821)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1334)
      at java.lang.Thread.run(Unknown Source)


或者谁告诉我hadoop的问题发到哪个区?
谢谢

taojie2000 发表于 2011-11-25 14:48

回复 1# boylez


    你得看有没有熟悉 hadoop的 :shock:
页: [1]
查看完整版本: 测试的hadoop出了个警告,啥都没干又消失了