免费注册 查看新帖 |

Chinaunix

  平台 论坛 博客 文库
最近访问板块 发新帖
楼主: specialwj

[FastDFS] 添加storage服务器的时候不能同步 [复制链接]

论坛徽章:
0
发表于 2010-01-11 14:57 |显示全部楼层

回复 #10 happy_fish100 的帖子

139 storage server logs
[2010-01-08 10:40:34] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-08 10:40:35] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-08 10:40:35] ERROR - file: storage_sync.c, line: 1831, connect to storage server 192.168.2.51:23000 fail, errno: 111, error info: Connection refused
[2010-01-08 10:41:36] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.141:23000
[2010-01-08 10:45:10] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.51:23000, continuous fail count: 265
[2010-01-11 14:49:40] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-11 14:49:40] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-11 14:49:40] ERROR - file: storage_sync.c, line: 1831, connect to storage server 192.168.2.51:23000 fail, errno: 111, error info: Connection refused
[2010-01-11 14:50:11] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.51:23000, continuous fail count: 31
[2010-01-11 14:51:14] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-11 14:51:15] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-11 14:51:15] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.51:23000

论坛徽章:
0
发表于 2010-01-11 14:59 |显示全部楼层

回复 #11 specialwj 的帖子

141 storage server logs
[2010-01-08 10:27:53] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-08 10:27:53] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-08 10:27:53] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.139:23000
[2010-01-08 10:27:53] ERROR - file: storage_sync.c, line: 1831, connect to storage server 192.168.2.51:23000 fail, errno: 111, error info: Connection refused
[2010-01-08 10:28:02] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCpJ4AA
AAAAAN7mRfoHTc5803.gz already exists, ignore it
[2010-01-08 10:28:02] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCpJ4AA
AAAAAN7mRfoHTc5803.gz-m already exists, ignore it
[2010-01-08 10:28:02] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCpJ4AA
AAAAAN7mRfoHTc5803_big.gz already exists, ignore it
[2010-01-08 10:28:02] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCpJ4AA
AAAAAN7mRfoHTc5803_big.gz-m already exists, ignore it
[2010-01-08 10:28:02] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCzuUAA
AAAAIp52Xj2bMQ540.bz2 already exists, ignore it
[2010-01-08 10:28:03] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCzuUAA
AAAAIp52Xj2bMQ540.bz2-m already exists, ignore it
[2010-01-08 10:28:03] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCzuUAA
AAAAIp52Xj2bMQ540_big.bz2 already exists, ignore it
[2010-01-08 10:28:04] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tCzuUAA
AAAAIp52Xj2bMQ540_big.bz2-m already exists, ignore it
[2010-01-08 10:28:04] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC2QMAA
AAAAIp52V_xDbE953.bz2 already exists, ignore it
[2010-01-08 10:28:05] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC2QMAA
AAAAIp52V_xDbE953.bz2-m already exists, ignore it
[2010-01-08 10:28:05] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC2QMAA
AAAAIp52V_xDbE953_big.bz2 already exists, ignore it
[2010-01-08 10:28:06] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC2QMAA
AAAAIp52V_xDbE953_big.bz2-m already exists, ignore it
[2010-01-08 10:28:06] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC7i4AA
AAAAARdHHfC338835.zip already exists, ignore it
[2010-01-08 10:28:06] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC7i4AA
AAAAARdHHfC338835.zip-m already exists, ignore it
[2010-01-08 10:28:06] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC7i4AA
AAAAARdHHfC338835_big.zip already exists, ignore it
[2010-01-08 10:28:06] WARNING - file: storage_service.c, line: 1891, cmd=16, client ip: 192.168.2.139, data file: /usr/local/FastDFS/data/00/00/wKgCi0tC7i4AA
AAAAARdHHfC338835_big.zip-m already exists, ignore it
[2010-01-08 10:31:37] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.51:23000, continuous fail count: 214
[2010-01-11 14:37:47] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-11 14:37:48] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-11 14:37:48] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.51:23000

论坛徽章:
0
发表于 2010-01-11 15:00 |显示全部楼层

回复 #12 specialwj 的帖子

51 storage server logs
[2010-01-08 10:46:18] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-08 10:46:19] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-08 10:46:19] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.141:23000
[2010-01-08 10:46:19] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.139:23000
[2010-01-08 10:58:30] CRIT - file: fdfs_storaged.c, line: 283, catch signal 15, program exiting...
[2010-01-08 10:58:32] INFO - exit nomally.

[2010-01-11 14:51:45] INFO - FastDFS v1.23, base_path=/usr/local/FastDFS, store_path_count=1, subdir_count_per_path=256, group_name=group1, network_timeout=2
0s, port=23000, bind_addr=, client_bind=1, max_connections=256, heart_beat_interval=30s, stat_report_interval=600s, tracker_server_count=1, sync_wait_msec=20
0ms, sync_interval=0ms, sync_start_time=00:00, sync_end_time: 23:59, allow_ip_count=-1, file_distribute_path_mode=0, file_distribute_rotate_count=100, fsync_
after_written_bytes=0, sync_log_buff_interval=10s, sync_binlog_buff_interval=60s, thread_stack_size=1024 KB, upload_priority=10, check_file_duplicate=0, FDHT
group count=0, FDHT server count=0, FDHT key_namespace=, FDHT keep_alive=0
[2010-01-11 14:51:45] INFO - file: tracker_client_thread.c, line: 192, successfully connect to tracker server 192.168.2.131:22122
[2010-01-11 14:51:45] INFO - file: storage_sync.c, line: 1819, successfully connect to storage server 192.168.2.139:23000

论坛徽章:
0
发表于 2010-01-11 15:02 |显示全部楼层

回复 #10 happy_fish100 的帖子

如果以上信息不够全面的话,我会试一下开启debug,麻烦你了。


刚才试了把storage的log级别改变为debug,但storaged.log里面显示的还是为INFO的信息,是不是日志的级别对日志的内容显示没有区别啊?

[ 本帖最后由 specialwj 于 2010-1-11 15:23 编辑 ]

论坛徽章:
4
2015年辞旧岁徽章
日期:2015-03-03 16:54:152015年迎新春徽章
日期:2015-03-04 09:56:11IT运维版块每日发帖之星
日期:2016-08-11 06:20:00IT运维版块每日发帖之星
日期:2016-08-15 06:20:00
发表于 2010-01-11 16:16 |显示全部楼层

回复 #14 specialwj 的帖子

这个问题一直可以重现的么?

论坛徽章:
0
发表于 2010-01-11 16:47 |显示全部楼层

回复 #15 happy_fish100 的帖子

恩,是的。只要我把51尝试连接上去,139和141就会马上显示为OFFLINE,如果在51服务器显示为WAIT_SYNC的时候,用ps查看有进程在运行的时候,139和141无论怎么的尝试连接,都显示为OFFLINE,而且用ps查看是没有进程在运行的。
使用版本为FastDFS_1.23

[ 本帖最后由 specialwj 于 2010-1-11 16:52 编辑 ]

论坛徽章:
4
2015年辞旧岁徽章
日期:2015-03-03 16:54:152015年迎新春徽章
日期:2015-03-04 09:56:11IT运维版块每日发帖之星
日期:2016-08-11 06:20:00IT运维版块每日发帖之星
日期:2016-08-15 06:20:00
发表于 2010-01-11 18:47 |显示全部楼层

回复 #16 specialwj 的帖子

初步怀疑是线程栈过大造成的或者系统资源不足引起的程序异常退出。
你可以试试减少线程数,参数名为max_connections,比如减少到64;同时增大storage server的线程栈大小,参数名为thread_stack_size,比如加大到2MB。然后重启storage server服务,看问题是否仍然存在。

也可能是程序的bug造成的。你试试最新版本V1.24,看这个问题是否还存在。谢谢!

论坛徽章:
0
发表于 2010-01-13 15:51 |显示全部楼层

回复 #17 happy_fish100 的帖子

版主你好
按照你给出的方法,我在FastDFS_v1.23上面设置和调整了你给出的两个参数,max_connections = 64和thread_stack_size = 2MB还是不行,问题依然存在。
接着我下载了FastDFS_v1.24的版本,目前在安装php_client的时候出现问题。当我需要加载fastdfs_client.ini文件时,只要fastdfs_client.ini放到php扩展文件能被扫描到的目录,就会出现问题。比如
[root@localhost php_client]# /usr/local/bin/php --ini
Configuration File (php.ini) Path: /usr/local/lib
Loaded Configuration File:         /usr/local/lib/php.ini
Scan for additional .ini files in: /usr/local/lib
Additional .ini files parsed:      /usr/local/lib/php.ini
但如果我把fastdfs_client.ini文件放到/usr/local/lib目录下面,就会出现下列状况
[root@localhost php_client]# /usr/local/bin/php --ini
Segmentation fault
请问这是什么问题?谢谢!

论坛徽章:
4
2015年辞旧岁徽章
日期:2015-03-03 16:54:152015年迎新春徽章
日期:2015-03-04 09:56:11IT运维版块每日发帖之星
日期:2016-08-11 06:20:00IT运维版块每日发帖之星
日期:2016-08-15 06:20:00
发表于 2010-01-13 16:35 |显示全部楼层

回复 #18 specialwj 的帖子

V1.24 c语言client API和php扩展有问题,问题已经修复。
请通过:
svn export http://fastdfs.googlecode.com/svn/trunk/ fastdfs-read-only
获取最新代码。
为此给大家带来的不便,敬请谅解。

最新版本支持调试功能,当程序异常退出时,会在日志文件中记录当时的调用堆栈。
修改文件 make.sh,将:
#DEBUG_FLAG=1
前的注释符去掉,然后重现编译所有程序。
注:新增的调试功能仅支持Linux系统。

[ 本帖最后由 happy_fish100 于 2010-1-13 16:39 编辑 ]

论坛徽章:
0
发表于 2010-01-15 18:29 |显示全部楼层

回复 #19 happy_fish100 的帖子

版主你好
按照你给的方法,已经从svn服务器上下载了新的代码,并已经成功安装了php_client客户端.
不过,在换用了FastDFS_v1.24版本后,之前在v1.23版本下发生的问题,在v1.24下还是发生.
tracker服务器49,storage服务器为46和48,之后在46和48运行正常,并已经成功上传文件后,尝试添加47服务器到正在运行的环境中,还是发生了46和48显示为OFFLINE,47显示为WAIT_SYNC.请问版主,我可以如何调整.谢谢.
您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

  

北京盛拓优讯信息技术有限公司. 版权所有 京ICP备16024965号-6 北京市公安局海淀分局网监中心备案编号:11010802020122 niuxiaotong@pcpop.com 17352615567
未成年举报专区
中国互联网协会会员  联系我们:huangweiwei@itpub.net
感谢所有关心和支持过ChinaUnix的朋友们 转载本站内容请注明原作者名及出处

清除 Cookies - ChinaUnix - Archiver - WAP - TOP