shell怎样实现日志访问流量统计

redhatuser

通过shell脚本，怎样实现对日志每30秒进行一次访问量的统计，求指点

zxy877298415

回复 1# redhatuser
日志内容是什么？根据什么判断日志的访问量?什么都不说大神们怎么回答啊！


   

redhatuser

这个是tail 日志出来的结果。根据访问请求来判断，每30秒统计一次


119.250.80.245 - - [14/Nov/2014:15:47:56 +0800] "POST /api.php?s=Account/reg_user_by_3rd HTTP/1.1" 200 190 "-" "Dalvik/1.4.0 (Linux; U; Android 2.3.6; GT-S5830i Build/GINGERBREAD)" "-"
122.94.45.233 - - [14/Nov/2014:15:47:56 +0800] "GET /Public/ccj/js/localstorage_lm.js HTTP/1.1" 200 166 "http://wx.ccj.com/index.php?s=/Product/product_detail/product_id/10000214124&imei=A000004338FD33&version=2.5.8" "Mozilla/5.0 (Linux; U; Android 4.1.1; zh-cn; HUAWEI C8813 Build/HuaweiC8813) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"
175.51.64.56 - - [14/Nov/2014:15:47:56 +0800] "POST /sqe.php?s=/User/ajax_reset_password HTTP/1.1" 200 27 "http://wx.ccj.com/index.php?s=/User/reset_pwd/phoneNumber/13538987577/verfiyCode/600376&imei=359357054518205&version=2.5.9" "Mozilla/5.0 (Linux; U; Android 4.3; zh-cn; SM-G3502I Build/JLS36C) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"
117.176.187.141 - - [14/Nov/2014:15:47:57 +0800] "GET /index.php?s=/Product/product_detail/product_id/100001693&imei=863216024591446&version=2.5.9 HTTP/1.1" 200 86098 "-" "Mozilla/5.0 (Linux; U; Android 4.2.2; zh-cn; R829T Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"
175.51.64.56 - - [14/Nov/2014:15:47:57 +0800] "POST /sqe.php?s=/User/ajax_reset_password HTTP/1.1" 200 27 "http://wx.ccj.com/index.php?s=/User/reset_pwd/phoneNumber/13538987577/verfiyCode/600376&imei=359357054518205&version=2.5.9" "Mozilla/5.0 (Linux; U; Android 4.3; zh-cn; SM-G3502I Build/JLS36C) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"
117.176.187.141 - - [14/Nov/2014:15:47:57 +0800] "GET /Public/ccj/js/localstorage_lm.js HTTP/1.1" 200 166 "http://wx.ccj.com/index.php?s=/Product/product_detail/product_id/100001693&imei=863216024591446&version=2.5.9" "Mozilla/5.0 (Linux; U; Android 4.2.2; zh-cn; R829T Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"
175.51.64.56 - - [14/Nov/2014:15:47:57 +0800] "POST /sqe.php?s=/User/ajax_reset_password HTTP/1.1" 200 27 "http://wx.ccj.com/index.php?s=/User/reset_pwd/phoneNumber/13538987577/verfiyCode/600376&imei=359357054518205&version=2.5.9" "Mozilla/5.0 (Linux; U; Android 4.3; zh-cn; SM-G3502I Build/JLS36C) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"
123.93.27.38 - - [14/Nov/2014:15:47:57 +0800] "GET /index.php?s=Order/view_order_index&imei=862354020023485&version=2.5.8 HTTP/1.1" 200 7033 "-" "Mozilla/5.0 (Linux; U; Android 4.2.2; zh-cn; C803 Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30" "-"

wiliiwin

你是统计什么   统计单个ip的总量 还是统计页面的总量  还是2个都统计  需求不明

redhatuser

不按IP，就统计每30秒的总访问量，然后再做一个平均取值。

wiliiwin

不按 ip 不按页面  难道按文件行数？

redhatuser

日志滚动比较快，也比较大，按这种方式统计

A_Traveler

#!/bin/bash
count=$(cat 1.f |wc -l)
while [ true ]
do
         count_new=$(cat 1.txt |wc -l)
         acl=$(( count_new - count ))
         if [ ! -n "$acl" ]
         then
         acl=0
         fi
         echo "acl number is: $acl" >>2.f
         count=$count_new
         fi
         sleep 30
done