hadoop2.2.0下配置hbase的问题

zhaopingzi

1. 
   
2. 本人安装配置为hadoop2.2.0，并采用的是HA的方式。
   
3. 安装完，测试访问等，正常
   
4. 
   
5. 于是有安装了HBASE0.96.11，配置完后，发现有个现象：
   
6. 直接用./start-hbase.sh启动，相关的HRegionServer无法带起来（后面会有相关日志）
   
7. 如果先手工启动RegionServer,再启动hmater就正常了
   
8. 
   
9. 截取相关主要配置如下：
   
10. core-site.xml:
    
11. <property>
    
12.     <name>fs.defaultFS</name>
    
13.     <value>hdfs://testcluster</value>
    
14. </property>
    
15. 
    
16. 注意在这个文件里我没有配置fs.default.name这个，请帮我确认hadoop2.2.0中是否还需要这个配置
    
17. 
    
18. hdfs-site.xml:
    
19. <property>
    
20. <name>dfs.nameservices</name>
    
21. <value>testcluster</value>
    
22. </property>
    
23. 
    
24. <property>
    
25. <name>hbase.rootdir</name>
    
26. <value>hdfs://testcluster/hbase</value>
    
27. </property>
    
28. 
    
29. hbase-site.xml:
    
30. <property>
    
31. <name>hbase.rootdir</name>
    
32. <value>hdfs://testcluster/hbase</value>  <--这也要确定一下，是否2.0是这样配置的，我知道1.0不是这样配置的
    
33. </property>
    
34. <property>
    
35. 
    
36. 
    
37. 直接使用./start-hbase.sh启动时，regionserver.log报错的日志：
    
38. 
    
39. 2014-02-28 13:19:31,405 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
    
40. 2014-02-28 13:19:31,405 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
    
41. 2014-02-28 13:19:31,405 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:os.name=Linux
    
42. 2014-02-28 13:19:31,406 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:os.arch=amd64
    
43. 2014-02-28 13:19:31,406 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:os.version=2.6.18-194.el5
    
44. 2014-02-28 13:19:31,406 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:user.name=hadoop
    
45. 2014-02-28 13:19:31,406 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:user.home=/hadoop/hadoop
    
46. 2014-02-28 13:19:31,406 INFO  [regionserver60020] zookeeper.ZooKeeper: Client environment:user.dir=/hadoop/hadoop/hbase-0.96
    
47. 2014-02-28 13:19:31,520 INFO  [main] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver60020
    
48. 2014-02-28 13:19:32,293 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
    
49. java.io.IOException: java.lang.reflect.InvocationTargetException
    
50.         at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:389)
    
51.         at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:366)
    
52.         at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:247)
    
53.         at org.apache.hadoop.hbase.catalog.CatalogTracker.<init>(CatalogTracker.java:149)
    
54.         at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:681)
    
55.         at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:644)
    
56.         at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:772)
    
57.         at java.lang.Thread.run(Thread.java:724)
    
58. Caused by: java.lang.reflect.InvocationTargetException
    
59.         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    
60.         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    
61.         at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:387)
    
62.         ... 7 more
    
63. Caused by: java.lang.ExceptionInInitializerError
    
64.         at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
    
65.         at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:69)
    
66.         at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
    
67.         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:801)
    
68.         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:633)
    
69.         ... 12 more
    
70. Caused by: java.lang.IllegalArgumentException: java.net.UnknownHostException: testcluster
    
71.         at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:418)
    
72.         at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:231)
    
73.         at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:139)
    
74.         at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:510)
    
75.         at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:453)
    
76.         at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136)
    
77.         at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2433)
    
78.         at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88)
    
79.         at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2467)
    
80.         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2449)
    
81.         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:367)
    
82.         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:287)
    
83.         at org.apache.hadoop.hbase.util.DynamicClassLoader.<init>(DynamicClassLoader.java:104)
    
84.         at org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:197)
    
85.         ... 17 more
    
86. Caused by: java.net.UnknownHostException: testcluster
    
87.         ... 31 more
    
88. 2014-02-28 13:19:32,298 FATAL [regionserver60020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
    
89. 2014-02-28 13:19:32,298 INFO  [regionserver60020] regionserver.HRegionServer: STOPPED: Initialization of RS failed.  Hence aborting RS.
    
90. 2014-02-28 13:19:32,304 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
    
91. 2014-02-28 13:19:32,305 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
    
92. java.lang.RuntimeException: HRegionServer Aborted
    
93.         at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
    
94.         at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
    
95.         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    
96.         at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
    
97.         at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2313)
    
98. 2014-02-28 13:19:32,307 INFO  [Thread-5] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Ca
    
99. che$ClientFinalizer@40891d67
    
100. 2014-02-28 13:19:32,307 INFO  [Thread-5] regionserver.HRegionServer: STOPPED: Shutdown hook
     
101. 2014-02-28 13:19:32,307 INFO  [Thread-5] regionserver.ShutdownHook: Starting fs shutdown hook thread.
     
102. 2014-02-28 13:19:32,308 INFO  [Thread-5] regionserver.ShutdownHook: Shutdown hook finished.
     
103.         

复制代码

zhaopingzi

奇诡：
./hbase-daemon.sh start regionserver单独这样起，regionserver就没问题