shell按规则处理目录中的某类型文件

hope1234567hope

有一个需求！
在某个目录下比如：/home/tstfolder/（此目录下可能还有子目录）下搜寻文件名类似为request.log.2014-05-14-10-21-17（也就是request.log开头的文件）
request.log文件的内容为(此类型文件多且比较大)
18.107.2.70 - yanin1 [14/Apr/2014:10:07:05 +0800] "GET /applis/apst/images/facebox/b.png HTTP/1.1" 200 84
13.107.2.70 - ngin1  [14/Apr/2014:10:07:05 +0800] "GET /applis/aist/images/agesApplist/bl.png HTTP/1.1" 200 124
12.107.2.70 - yann1 [14/Apr/2014:10:07:05 +0800] "GET /appt/appst/images/appShow/br.png HTTP/1.1" 200 124
11.107.2.70 - ngbin [14/Apr/2014:10:07:05 +0800] "GET /apjct/apt/images/facebox/tl.png HTTP/1.1" 200 132
12.107.2.70 - yangb [14/Apr/2014:10:07:05 +0800] "GET /apjct/appst/images/jquery/tr.png HTTP/1.1" 200 125
对每个request.log作如下的处理：
首先判断如果最后入一个字段大于130则输request.log.2014-05-14-10-21-17_a文件，不符合输入equest.log.2014-05-14-10-21-17_b文件；
然后再判断：如果在GET那个字段含有appShow或者jquery 或者agesApplist的则将其输入request.log.2014-05-14-10-21-17_a文件，不含有这些字段的将其输入到request.log.2014-05-14-10-21-17_b文件

请问这个shell怎么写啊？

hope1234567hope

我也在写，望大家帮帮忙

elu_ligao

1. find . -name "request.log.*" | awk '$NF>130||/appShow/||/jquery/||/agesApplist/{print > "a.txt";next}{print > "b.txt"}'

复制代码

ydzcjj

那么问题来了
如果在GET那个字段含有appShow或者jquery 或者agesApplist 和 最后入一个字段小于等于130 的一条数据 究竟是输入到哪个文件中？

hope1234567hope

回复 4# ydzcjj


是先判断130的，确定输出，
如果不是130的再判断所含字段

hope1234567hope

回复 3# elu_ligao


    好厉害啊，我写了一大堆，还在变量目录下的文件，然后再处理呢

ydzcjj

回复 5# hope1234567hope


    上面大神的满分好评

jason680

回复 1# hope1234567hope

1. make sure you can find all files
$ find . -name "request.log*[0-9]"
./2016/request.log.2016-05-14-10-21-17
./request.log.2014-05-14-10-21-17
./2015/request.log.2015-05-14-10-21-17


2. make files by your rule
$ find . -name "request.log*[0-9]" | xargs awk '{if(F!=FILENAME){if(F){close(F"_a");close(F"_b")}F=FILENAME;print F};if($NF>130 || $7~/appShow|jquer|agesApplist/){print > F"_a";next};print > F"_b"}'
./2016/request.log.2016-05-14-10-21-17
./request.log.2014-05-14-10-21-17
./2015/request.log.2015-05-14-10-21-17

3. list all files
$ find . -name "request.log*"
./2016/request.log.2016-05-14-10-21-17_b
./2016/request.log.2016-05-14-10-21-17
./2016/request.log.2016-05-14-10-21-17_a
./request.log.2014-05-14-10-21-17
./request.log.2014-05-14-10-21-17_b
./request.log.2014-05-14-10-21-17_a
./2015/request.log.2015-05-14-10-21-17_a
./2015/request.log.2015-05-14-10-21-17
./2015/request.log.2015-05-14-10-21-17_b

4. check files with xxx_a & xxx_b
$ cat request.log.2014-05-14-10-21-17_a
13.107.2.70 - ngin1  [14/Apr/2014:10:07:05 +0800] "GET /applis/aist/images/agesApplist/bl.png HTTP/1.1" 200 124
12.107.2.70 - yann1 [14/Apr/2014:10:07:05 +0800] "GET /appt/appst/images/appShow/br.png HTTP/1.1" 200 124
11.107.2.70 - ngbin [14/Apr/2014:10:07:05 +0800] "GET /apjct/apt/images/facebox/tl.png HTTP/1.1" 200 132
12.107.2.70 - yangb [14/Apr/2014:10:07:05 +0800] "GET /apjct/appst/images/jquery/tr.png HTTP/1.1" 200 125

$ cat request.log.2014-05-14-10-21-17_b
18.107.2.70 - yanin1 [14/Apr/2014:10:07:05 +0800] "GET /applis/apst/images/facebox/b.png HTTP/1.1" 200 84


   

hope1234567hope

但是find . -name "request.log.*" | awk '$NF>130||/appShow/||/jquery/||/agesApplist/{print > "a.txt";next}{print > "b.txt"}'
我这怎么不是我想要的结果啊，只出来了b文件

hope1234567hope

回复 8# jason680

你好，对awk研究的不深入。能分段讲讲awk '{if(F!=FILENAME){if(F){close(F"_a");close(F"_b")}F=FILENAME;print F};if($NF>130 || $7~/appShow|jquer|agesApplist/){print > F"_a";next};print > F"_b"}'    的意思么？ 正在查资料看你的这段话的意思！谢谢了