请教这个shell的写法，统计行数

lucash

好像 把sort 后面的尾巴去掉也可以。。呵呵。短一点

1. awk -F'[ :]+' '/^[A-Z]/{a=$7"|"$2"|"$3"|"} /^[0-9]/{b=a$1"|"$4;++S[b]}END{for(i in S) print i"|"S[i] | "sort" }' alert

复制代码

[ 本帖最后由 lucash 于 2009-7-3 14:09 编辑 ]

olivenan

awk '{a[substr($1,2)" "$1]++}END{for (j in a) print j" "a[j]} ' urfile

chinaglwo

cat urfile |awk -F: '{print $1,$4}' |awk '{print $1,$2}'|sort |uniq -c

lbaby

原帖由 ywlscpl 于 2009-7-3 11:48 发表
吃饭回来答题
awk 'NR==FNR{a[$1]=$2}NR>FNR{if ($0~/[0-9][0-9]:[0-9][0-9]:[0-9][0-9] [0-9]+$/) day=$NF"|"a[$2]"|"$3;else {split($1,M,":");b[day"|"M[1]"|"$2]++}}END{for (i in b) print i"|"b}'  

用root 来写代码啊，习惯不好

lbaby

感觉python 很优雅，尝试一下使用python.

lbaby

#!/usr/bin/env python import sys import re re_hour = re.compile(r'^\d\d:') re_sp_split = re.compile(r'\s+') #extract the day from time line make_day = lambda d:d[4] + '|' + d[1]  + '|' + d[2] make_key = lambda d,c:d + '|' + c[0][0:2] + '|' + c[1] cur_day = 'n/a|n/a|n/a' log_cnt=dict() for line in sys.stdin:     m = re_hour.match(line)     cols = re_sp_split.split(line)     if m is not None: #this is log line ,not date        key = make_key(cur_day, cols)        #date | hour | err_type        if key not in log_cnt:             log_cnt[key] = 1        else:             log_cnt[key] += 1     else:         cur_day=make_day(cols) sorted_key = log_cnt.keys() sorted_key.sort() for key in sorted_key:     print '%s|%d' % (key, log_cnt[key])

[of@lbaby py]$ cat tuc
09:55:54: ERROR1 /tmp/error/log.3 50 times
Mon Jun 28 00:00:53 2009
09:55:54: ERROR1 /tmp/error/log.3 50 times
09:56:09: ERROR1 /tmp/error/log.14 50 times
10:56:12: ERROR1 /tmp/error/log.14 100 times
10:56:23: ERROR2 /tmp/error/log.5 50 times
11:56:26: ERROR2 /tmp/error/log.1 50 times
11:56:27: ERROR2 /tmp/error/log.5 100 times
Mon Jun 29 00:00:53 2009
15:56:29: ERROR3 /tmp/error/log.1 100 times
15:56:32: ERROR3 /tmp/error/log.1 150 times
16:56:33: ERROR4 /tmp/error/log.6 50 times
16:56:36: ERROR4 /tmp/error/log.6 100 times
16:56:40: ERROR4 /tmp/error/log.12 50 times
Mon Jun 30 00:00:53 2009
[of@lbaby py]$ cat tuc | ./ec.py
2009|Jun|28|09|ERROR1|2
2009|Jun|28|10|ERROR1|1
2009|Jun|28|10|ERROR2|1
2009|Jun|28|11|ERROR2|2
2009|Jun|29|15|ERROR3|2
2009|Jun|29|16|ERROR4|3
n/a|n/a|n/a|09|ERROR1|1
[of@lbaby py]$
看起来效果不错，看来是离不开re 模块了，可怜啊

[ 本帖最后由 lbaby 于 2009-7-7 18:47 编辑 ]

saudi

编程高手帖，学学习习