HRegionServer经常性的挂掉

ighack

我在regionserver的log日志中发现

1. 2019-05-20 21:10:46,802 INFO  [main] zookeeper.ZooKeeper: Initiating client connection, connectString=moniser:2181,basappser2:2181 sessionTimeout=30000 watcher=org.apache.zookee
   
2. per.ZooKeeperMain$MyWatcher@3a034642019-05-20 21:10:46,826 INFO  [main-SendThread(moniser:2181)] zookeeper.ClientCnxn: Opening socket connection to server moniser/192.168.0.238:2181. Will not attempt to authentic
   
3. ate using SASL (unknown error)2019-05-20 21:10:46,831 INFO  [main-SendThread(moniser:2181)] zookeeper.ClientCnxn: Socket connection established to moniser/192.168.0.238:2181, initiating session
   
4. 2019-05-20 21:10:46,839 INFO  [main-SendThread(moniser:2181)] zookeeper.ClientCnxn: Session establishment complete on server moniser/192.168.0.238:2181, sessionid = 0x16ac4a4aee
   
5. c000c, negotiated timeout = 80000

复制代码

在out日志中发现

1. hbase-daemon.sh: line 226:  7824 Killed     nice -n $HBASE_NICENESS "$HBASE_HOME"/bin/hbase --config "${HBASE_CONF_DIR}" $command "$@" start >> ${HBASE_LOGOUT} 2>&1

复制代码

我在zookeeper是志中

1. 2019-05-20 21:10:47,175 [myid:1] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception
   
2. EndOfStreamException: Unable to read additional data from client sessionid 0x16ac4a4aeec000c, likely client has closed socket
   
3.         at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   
4.         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   
5.         at java.lang.Thread.run(Thread.java:748)
   
6. 2019-05-20 21:10:47,176 [myid:1] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /192.168.0.238:26831 which had sess
   
7. ionid 0x16ac4a4aeec000c
   
8. 2019-05-21 02:14:40,886 [myid:1] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /127.0.0.1:15554
   
9. 2019-05-21 02:14:42,886 [myid:1] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception
   
10. EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
    
11.         at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
    
12.         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
    
13.         at java.lang.Thread.run(Thread.java:748)
    
14. 2019-05-21 02:14:42,886 [myid:1] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /127.0.0.1:15554 (no session establ
    
15. ished for client)

复制代码

regionserver的gc日志好像没80秒这么长时间的

1. 2019-05-20T21:10:03.602+0800: 45547.027: [GC (Allocation Failure) 2019-05-20T21:10:03.602+0800: 45547.027: [ParNew: 438860K->41220K(463872K), 0.0069203 secs] 875108K->477468K(19
   
2. 78992K), 0.0070983 secs] [Times: user=0.06 sys=0.00, real=0.00 secs] 2019-05-20T21:10:29.477+0800: 45572.902: [GC (Allocation Failure) 2019-05-20T21:10:29.477+0800: 45572.902: [ParNew: 453572K->50054K(463872K), 0.0119884 secs] 889820K->501429K(19
   
3. 78992K), 0.0122355 secs] [Times: user=0.09 sys=0.00, real=0.01 secs] 2019-05-20T21:10:45.608+0800: 45589.033: [GC (Allocation Failure) 2019-05-20T21:10:45.608+0800: 45589.033: [ParNew: 462406K->12536K(463872K), 0.0090531 secs] 913781K->485752K(19
   
4. 78992K), 0.0092621 secs] [Times: user=0.07 sys=0.00, real=0.01 secs]

复制代码

zookeeper的tickTime=40000