OCFS2 inode和空间明明还很多怎么就无法创建新文件

yuhuohu

这次出问题的是/video/data01文件系统，采用ocfs2，空间和inode都剩余很多，就是创建不了新文件

# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda10             16G  534M   15G   4% /
/dev/sda5             9.7G  151M  9.1G   2% /app
/dev/sda1              92M   16M   71M  19% /boot
tmpfs                 3.9G     0  3.9G   0% /dev/shm
/dev/sda2              33G  2.1G   30G   7% /home
/dev/sda6             3.9G  177M  3.6G   5% /opt
/dev/sda7             3.9G   73M  3.7G   2% /tmp
/dev/sda9              16G  3.3G   12G  23% /usr
/dev/sda8              27G  1.1G   25G   5% /var
/dev/sda3             9.7G  151M  9.1G   2% /weblogic
/dev/mapper/vgvideo01-lvvideo01
                       13T   13T  296G  98% /video/data01
/dev/mapper/vgvideo01-lvvideo02
                       13T   13T  344G  98% /video/data02
/dev/mapper/vgvideo01-lvvideo03
                       13T   13T   56M 100% /video/data03
/dev/mapper/vgvideo01-lvbackup01
                      750G  1.1G  749G   1% /backup


# df -i
Filesystem            Inodes   IUsed   IFree IUse% Mounted on
/dev/sda10           4194304    6900 4187404    1% /
/dev/sda5            2621440      11 2621429    1% /app
/dev/sda1              24096      40   24056    1% /boot
tmpfs                1021921       1 1021920    1% /dev/shm
/dev/sda2            8919456   13829 8905627    1% /home
/dev/sda6            1048576     924 1047652    1% /opt
/dev/sda7            1048576      27 1048549    1% /tmp
/dev/sda9            4194304  149052 4045252    4% /usr
/dev/sda8            7176192    5729 7170463    1% /var
/dev/sda3            2621440      11 2621429    1% /weblogic
/dev/mapper/vgvideo01-lvvideo01
                     26880000 26273965  606035   98% /video/data01
/dev/mapper/vgvideo01-lvvideo02
                     26880000 26187994  692006   98% /video/data02
/dev/mapper/vgvideo01-lvvideo03
                     25344000 25344000       0  100% /video/data03
/dev/mapper/vgvideo01-lvbackup01
                     1535160    2122 1533038    1% /backup

空间和inode都剩余很多

# cd /video/data01/storage/

# mkdir test
mkdir: cannot create directory `test': No space left on device
# touch 01
touch: cannot touch `01': No space left on device

/video/data01,02,03都是ocfs2文件系统，共有4台机器一起使用，时不时就出现某台机器无法在某文件系统上无法创建新文件的现象，但与此同时另外几台却依然没问题

困扰我好久了，不知道怎么回事，2楼是strace的详细输出，请帮忙诊断一下

[ 本帖最后由 yuhuohu 于 2008-10-28 17:10 编辑 ]

yuhuohu

以下是strace的输出

# strace -f -o /tmp/strace.log mkdir test
mkdir: cannot create directory `test': No space left on device


# more /tmp/strace.log
15396 execve("/bin/mkdir", ["mkdir", "test"], [/* 31 vars */]) = 0
15396 brk(0)                            = 0xfc54000
15396 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2aaaaaaab000
15396 uname({sys="Linux", node="spossxmnru01", ...}) = 0
15396 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
15396 open("tls/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("tls/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/tls/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib/tls/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/tls/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib/tls", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
15396 open("/lib/tls/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/lib/tls/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/lib/tls/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/lib/tls", 0x7fffe4f78bc0)  = -1 ENOENT (No such file or directory)
15396 open("/lib/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/lib/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/lib/libselinux.so.1", O_RDONLY) = 3
15396 read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\20U\325"..., 832) = 832
15396 close(3)                          = 0
15396 stat("/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
15396 open("/usr/lib/tls/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/usr/lib/tls/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/usr/lib/tls/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/usr/lib/tls", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/usr/lib/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/usr/lib/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/usr/lib/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/usr/lib", {st_mode=S_IFDIR|0755, st_size=61440, ...}) = 0
15396 open("/home/oracle/product/10.2.0/db_1/lib32/tls/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib32/tls/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib32/tls/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib32/tls", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib32/x86_64/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib32/x86_64", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib32/libselinux.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 stat("/home/oracle/product/10.2.0/db_1/lib32", 0x7fffe4f78bc0) = -1 ENOENT (No such file or directory)
15396 open("/etc/ld.so.cache", O_RDONLY) = 3
15396 fstat(3, {st_mode=S_IFREG|0644, st_size=129269, ...}) = 0
15396 mmap(NULL, 129269, PROT_READ, MAP_PRIVATE, 3, 0) = 0x2aaaaaaac000
15396 close(3)                          = 0
15396 open("/lib64/libselinux.so.1", O_RDONLY) = 3
15396 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0PE\340\231"..., 832) = 832
15396 fstat(3, {st_mode=S_IFREG|0755, st_size=95480, ...}) = 0
15396 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2aaaaaacc000
15396 mmap(0x3f99e00000, 2192816, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x3f99e00000
15396 mprotect(0x3f99e15000, 2097152, PROT_NONE) = 0
15396 mmap(0x3f9a015000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15000) = 0x3f9a015000
15396 mmap(0x3f9a017000, 1456, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x3f9a017000
15396 close(3)                          = 0
15396 open("tls/x86_64/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("tls/libc.so.6", O_RDONLY)   = -1 ENOENT (No such file or directory)
15396 open("x86_64/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("libc.so.6", O_RDONLY)       = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/lib/libc.so.6", O_RDONLY)  = 3
15396 read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0000\317"..., 832) = 832
15396 close(3)                          = 0
15396 open("/usr/lib/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/lib64/libc.so.6", O_RDONLY) = 3
15396 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\331"..., 832) = 832
15396 fstat(3, {st_mode=S_IFREG|0755, st_size=1678480, ...}) = 0
15396 mmap(0x3f93600000, 3461272, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x3f93600000
15396 mprotect(0x3f93744000, 2097152, PROT_NONE) = 0
15396 mmap(0x3f93944000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x144000) = 0x3f93944000
15396 mmap(0x3f93949000, 16536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x3f93949000
15396 close(3)                          = 0
15396 open("tls/x86_64/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("tls/libdl.so.2", O_RDONLY)  = -1 ENOENT (No such file or directory)
15396 open("x86_64/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("libdl.so.2", O_RDONLY)      = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/lib/libdl.so.2", O_RDONLY) = 3
15396 read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0P\332\245"..., 832) = 832
15396 close(3)                          = 0
15396 open("/usr/lib/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/lib64/libdl.so.2", O_RDONLY) = 3
15396 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \16\340"..., 832) = 832
15396 fstat(3, {st_mode=S_IFREG|0755, st_size=23520, ...}) = 0
15396 mmap(0x3f93e00000, 2109728, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x3f93e00000
15396 mprotect(0x3f93e02000, 2097152, PROT_NONE) = 0
15396 mmap(0x3f94002000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x3f94002000
15396 close(3)                          = 0
15396 open("tls/x86_64/libsepol.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("tls/libsepol.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("x86_64/libsepol.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("libsepol.so.1", O_RDONLY)   = -1 ENOENT (No such file or directory)
15396 open("/home/oracle/product/10.2.0/db_1/lib/libsepol.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/lib/libsepol.so.1", O_RDONLY) = 3
15396 read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\16"..., 832) = 832
15396 close(3)                          = 0
15396 open("/usr/lib/libsepol.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
15396 open("/lib64/libsepol.so.1", O_RDONLY) = 3
15396 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340< \232"..., 832) = 832
15396 fstat(3, {st_mode=S_IFREG|0755, st_size=247528, ...}) = 0
15396 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2aaaaaacd000
15396 mmap(0x3f9a200000, 2383168, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x3f9a200000
15396 mprotect(0x3f9a23b000, 2097152, PROT_NONE) = 0
15396 mmap(0x3f9a43b000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3b000) = 0x3f9a43b000
15396 mmap(0x3f9a43c000, 40256, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x3f9a43c000
15396 close(3)                          = 0
15396 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2aaaaaace000
15396 arch_prctl(ARCH_SET_FS, 0x2aaaaaace3b0) = 0
15396 mprotect(0x3f93944000, 16384, PROT_READ) = 0
15396 mprotect(0x3f94002000, 4096, PROT_READ) = 0
15396 mprotect(0x3f93419000, 4096, PROT_READ) = 0
15396 munmap(0x2aaaaaaac000, 129269)    = 0
15396 access("/etc/selinux/", F_OK)     = 0
15396 brk(0)                            = 0xfc54000
15396 brk(0xfc75000)                    = 0xfc75000
15396 open("/etc/selinux/config", O_RDONLY) = 3
15396 fstat(3, {st_mode=S_IFREG|0644, st_size=447, ...}) = 0
15396 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2aaaaaaac000
15396 read(3, "# This file controls the state o"..., 4096) = 447
15396 read(3, "", 4096)                 = 0
15396 close(3)                          = 0
15396 munmap(0x2aaaaaaac000, 4096)      = 0
15396 open("/proc/mounts", O_RDONLY)    = 3
15396 fstat(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
15396 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2aaaaaaac000
15396 read(3, "rootfs / rootfs rw 0 0\n/dev/root"..., 4096) = 1131
15396 read(3, "", 4096)                 = 0
15396 close(3)                          = 0
15396 munmap(0x2aaaaaaac000, 4096)      = 0
15396 mkdir("test", 0777)               = -1 ENOSPC (No space left on device)
15396 write(2, "mkdir: ", 7)            = 7
15396 write(2, "cannot create directory `test\'", 30) = 30
15396 write(2, ": No space left on device", 25) = 25
15396 write(2, "\n", 1)                 = 1
15396 close(1)                          = 0
15396 exit_group(1)                     = ?
#

ziggler

http://bbs.zdnet.com.cn/thread-161736-1-1.html

ziggler

linux下无法在分区中创建新文件问题
故障现象:
1 when you create a new directory or file , system will say : No space left on device
[shelladm@linux /var]# mkdir aa
mkdir: cannot create directory `aa': No space left on device

2 when create crontab for account shelladm , you will receive error information as follows:

"crontab.6655" 1L, 13C written
crontab: installing new crontab
cron/tmp.6655: No space left on device
crontab: edits left in /tmp/crontab.6655




顶部
国内最大的面向.NET开发人员的博客社区--博客园 IT博客网 BlogJava C++博客
zdcs11
忠诚会员
Rank: 9Rank: 9Rank: 9



UID 268514
精华 2
积分 8841
帖子 578
威望 4266
ZD币 994 元
阅读权限 200
注册 2007-11-17
状态 离线
       
  沙发
使用道具  
发表于 2007-12-7 13:24  资料  个人空间  短消息  加为好友
处理步骤:

1 检查分区使用率

[root@linux ~]# df -lk
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/hda2              3020172    136008   2730744   5% /
/dev/hda1               101089      9378     86492  10% /boot
/dev/hda7            105708092  38996880  61341488  39% /b2006
none                   1028548         0   1028548   0% /dev/shm
/dev/hda3              3020172   1421092   1445660  50% /usr
/dev/hda6               497829    371795    100332  79% /var
分区/var的使用率只有79%，系统有空间可以用

2 检查/var/lock下的文件，删除/var/lock/subsys/nfs后，touch /var/aa，成功创建文件，删除/var/aa

3 发现删除/var/lock下的任意一个文件后

[root@linux /var]#touch /var/aa        -------------------成功

[root@linux /var]# touch aa1                -------------------失败
touch: creating `aa1': No space left on device

4 将检查扩大到/var下的其他目录，
[root@linux icons]# cd /var/www/icons
[root@linux icons]# mv a.gif /tmp
[root@linux icons]# mv a.png /tmp     -------------------移走两个文件
[root@linux icons]# df -li
[root@linux icons]# touch aa
[root@linux icons]# touch bb
[root@linux icons]# touch cc
touch: creating `cc': No space left on device -----------只能创建两个文件，当创建第三个文件时，出错

5 怀疑分区/var的inode用尽导致上述问题，检查inode使用率

[root@linux icons]# df -li
Filesystem            Inodes   IUsed   IFree IUse% Mounted on
/dev/hda2             384000   23698  360302    7% /
/dev/hda1              26104      41   26063    1% /boot
/dev/hda7            13434880    7964 13426916    1% /b2006
none                  257137       1  257136    1% /dev/shm
/dev/hda3             384000   78026  305974   21% /usr
/dev/hda6             128520  128520       0  100% /var
发现/var的inode使用率已经达到100%，空余的inode为0

6 分区/var没有配置quota ,平均每个inode的占用空间为：497829k(var size)/128520(inodes)=3.87k，说明分区的最小block为4k，无法增加inode限额。

7 发现/var/spool/clientmqueue下面有太多的文件，共有127679个，占用了127679/128520(inodes)=99.3%的inode
  系统的邮件配置有问题，导致系统发出的邮件堆积在队列中，占用的大量的inode.


处理方法：确认/var/spool/clientmqueue下的文件已经无用后，删除之。然后/var写入正常。
          最好的解决办法是重新设置系统邮件，使其能正常发送。

删除文件后的inode使用情况
[root@linux clientmqueue]# df -li
Filesystem            Inodes   IUsed   IFree IUse% Mounted on
/dev

yuhuohu

XIEXIE哥们的关注，可是我的inode数还剩余很多。。。已补上，在1楼

[ 本帖最后由 yuhuohu 于 2008-10-28 17:07 编辑 ]

ziggler

原帖由 yuhuohu 于 2008-10-28 17:05 发表
XIEXIE哥们的关注，可是我的inode数还剩余很多。。。已补上，在1楼

http://www.mail-archive.com/ocfs2-users@oss.oracle.com/msg02158.html

yuhuohu

再次感谢，这篇还是没给出最后的处理结果 郁闷 我再google一把看看

@ OCFS does not have the concept of inodes, however, for the vfs layer in the
@ kernel we need to fill out structures. the number returned by df -i is
@ based on diskspace free. it's the number of clusterblocsk in the filesystem
@ we dont' preallocate inodes like most filesystems do. nor do we HAVE to do
@ that. not a bug, expected behaviour, not required to do what any other
@ filesystem does.

怎么看ocfs2的clusterblocks用了多少？

[ 本帖最后由 yuhuohu 于 2008-10-28 18:31 编辑 ]

jerrywjl

其实感觉INODE已经使用了98%，最好的测试方法是删除一些文件来释放一部分inode然后试试看。

柔柔乖

我前天遇到了跟你一样的情况，重启了就没事了

yuhuohu

更加诡异的一个：

ocfs2文件系统，4节点 13t,在剩下200G左右时

有3个节点可创建文件，但无法创建目录，另外一个节点一切正常

创建目录时，提示input/output error

/var/log/messages中相关日志如下：

Oct 31 11:11:25 spossxmnru02 kernel: attempt to access beyond end of device
Oct 31 11:11:25 spossxmnru02 kernel: dm-2: rw=0, want=26126843912, limit=25952256000
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_end_buffer_io_sync:46 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_search_chain:1058 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_claim_suballoc_bits:1231 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_claim_clusters:1466 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_local_alloc_new_window:838 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_local_alloc_slide_window:945 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_reserve_local_alloc_bits:502 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_reserve_clusters:645 ERROR: status = -5
Oct 31 11:11:25 spossxmnru02 kernel: (4437,1)cfs2_mknod:369 ERROR: status = -5