Chinaunix

标题: fastdfs storage 报 too many open 然后异常退出 [打印本页]

作者: mayaowu2019 时间: 2019-10-28 10:22
标题: fastdfs storage 报 too many open 然后异常退出

表现如下
  fastdfs storage 报too many open file 然后异常退出。

参数如下
1：max_connections=1024
2：openfile 设置的是65535
3：fastdfs 使用的root 用户启动
4：版本如下
fastdfs-5.11.tar
fastdfs-nginx-module-1.20.tar
libfastcommon-1.0.39.tar

具体日志
[2019-10-24 08:35:47] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/05/3F/CgGvhl2QbMuAbxIHAAARZjrmWKM264.png fail, errno: 24, error info: Too many open files
[2019-10-24 08:35:47] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/03/2A/CgGvhV2QZJ6ANVFaAAAV_2bYAl8828.png fail, errno: 24, error info: Too many open files
[2019-10-24 08:35:47] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/03/2A/CgGvhV2QZJ6ANVFaAAAV_2bYAl8828.png fail, errno: 24, error info: Too many open files
[2019-10-24 08:35:47] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/05/3F/CgGvhl2QbMuAbxIHAAARZjrmWKM264.png fail, errno: 24, error info: Too many open files
"1.log" 919366L, 115056503C                                                                                                          1,1          Top
[2019-10-25 18:14:17] ERROR - file: storage_service.c, line: 1794, accept failed, errno: 24, error info: Too many open files
[2019-10-25 18:14:17] ERROR - file: storage_service.c, line: 1794, accept failed, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/06/8C/CgGvhl2QbgqAAQuHAAPZLayxNMo956.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/06/8C/CgGvhl2QbgqAAQuHAAPZLayxNMo956.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:18] ERROR - file: storage_dio.c, line: 268, open file: /data/dfs_data/fastdfs/storage/data/00/02/CgGvhV2QJDeAHQrVAAAMC-IIPo0694.png fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:19] INFO - file: storage_sync.c, line: 2732, successfully connect to storage server 10.1.175.134:23000[2019-10-25 18:14:19] ERROR - file: shared_func.c, line: 993, o
pen file /data/dfs_data/fastdfs/data/sync/10.1.175.134_23000.mark fail, errno: 24, error info: Too many open files
[2019-10-25 18:14:19] ERROR - file: storage_sync.c, line: 1970, load from mark file "/data/dfs_data/fastdfs/data/sync/10.1.175.134_23000.mark" fail, error code: 24
[2019-10-25 18:14:19] CRIT - file: storage_sync.c, line: 2794, storage_reader_init fail, errno=24, program exit!
[2019-10-25 18:15:21] INFO - exit normally.

作者: mayaowu2019 时间: 2019-10-29 17:06
已经解决，/etc/$(pid)/limits open file 显示1024，当前虽然设置了 /etc/security/limits.conf， ulimit -SHn 65535 等，但是由于fastdfs /etc/ini.d/fdfs_storage 脚本启动的时候默认采用systemd 方式，systemd 方式对pam 认证（也就是security是不起作用的）方法1:直接用 /usr/bin/fdfs_storaged /etc/fdfs/storage.conf 方法2:更改 /etc/systemd/system.conf 重启

欢迎光临 Chinaunix (http://bbs.chinaunix.net/)