免费注册 查看新帖 |

Chinaunix

  平台 论坛 博客 文库
12下一页
最近访问板块 发新帖
查看: 1998 | 回复: 13

[文本处理] 求助,关于文本处理,按照这种要求,该写哪种shell语句啊?谢谢大家 [复制链接]

论坛徽章:
2
程序设计版块每日发帖之星
日期:2016-02-28 06:20:00IT运维版块每日发帖之星
日期:2016-03-31 06:20:00
发表于 2016-12-22 09:40 |显示全部楼层
本帖最后由 zw86620032 于 2016-12-22 09:51 编辑

有一个sample.log日志文件,里面内容如截图所示。
1、列出能成功访问网页的IP地址,不要重复。(应该就是状态码200的)
2、计算每个IP地址总共发出多少个GET请求,列出最多的5个
3、求出状态码不是200的总请求个数

日志部分内容在图片截图中,谢谢大家。文件数据如下:

93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/accounts/ HTTP/1.1" 200 5338 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4553 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/search/ HTTP/1.1" 200 5083 "https://sample-server/isec/checkMe/?browser=Chrome&ver=35.0.1916.114&sys=Windows%207&plugins=Java:1.7.0.55,Flash:13.0.0.214,VLC%20Player:2.1.3.0,Silverlight:5.1.30214.0" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /static/js/affected.js HTTP/1.1" 200 2452 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET / HTTP/1.1" 302 6988 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/css/bootstrap.min.css HTTP/1.1" 200 12249 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/prettify/prettify.css HTTP/1.1" 200 852 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/extra.css HTTP/1.1" 200 3516 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/autocomplete_light/style.css HTTP/1.1" 200 1884 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/css.css HTTP/1.1" 200 956 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/all/ HTTP/1.1" 200 5280 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpiicon.ico HTTP/1.1" 200 1970 "-" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:58 +0200] "GET /isec/search/ HTTP/1.1" 200 4938 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:59 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:01 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:02 +0200] "GET /static/prettify/prettify.js HTTP/1.1" 200 6564 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/task_1/ HTTP/1.1" 200 10470 "-" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://www.sample-server/isec/task_1/" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"


QQ截图20161221193509.png

论坛徽章:
28
15-16赛季CBA联赛之八一
日期:2016-02-22 19:10:4215-16赛季CBA联赛之深圳
日期:2016-12-01 10:34:0415-16赛季CBA联赛之新疆
日期:2016-12-07 10:24:2915-16赛季CBA联赛之同曦
日期:2016-12-15 12:06:43CU十四周年纪念徽章
日期:2016-12-18 13:03:4415-16赛季CBA联赛之吉林
日期:2017-01-03 15:52:2515-16赛季CBA联赛之辽宁
日期:2017-01-04 14:58:2415-16赛季CBA联赛之辽宁
日期:2017-01-15 09:42:512016科比退役纪念章
日期:2017-02-06 17:21:50黑曼巴
日期:2017-02-10 15:46:1215-16赛季CBA联赛之上海
日期:2017-03-18 10:14:5415-16赛季CBA联赛之青岛
日期:2017-03-18 22:00:44
发表于 2016-12-22 09:45 |显示全部楼层

文本数据能贴出来吗?

论坛徽章:
2
程序设计版块每日发帖之星
日期:2016-02-28 06:20:00IT运维版块每日发帖之星
日期:2016-03-31 06:20:00
发表于 2016-12-22 09:48 |显示全部楼层
回复 2# moperyblue

93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/accounts/ HTTP/1.1" 200 5338 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4553 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/search/ HTTP/1.1" 200 5083 "https://sample-server/isec/checkMe/?browser=Chrome&ver=35.0.1916.114&sys=Windows%207&plugins=Java:1.7.0.55,Flash:13.0.0.214,VLC%20Player:2.1.3.0,Silverlight:5.1.30214.0" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /static/js/affected.js HTTP/1.1" 200 2452 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET / HTTP/1.1" 302 6988 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/css/bootstrap.min.css HTTP/1.1" 200 12249 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/prettify/prettify.css HTTP/1.1" 200 852 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/extra.css HTTP/1.1" 200 3516 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/autocomplete_light/style.css HTTP/1.1" 200 1884 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/css.css HTTP/1.1" 200 956 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/all/ HTTP/1.1" 200 5280 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpiicon.ico HTTP/1.1" 200 1970 "-" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:58 +0200] "GET /isec/search/ HTTP/1.1" 200 4938 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:59 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:01 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:02 +0200] "GET /static/prettify/prettify.js HTTP/1.1" 200 6564 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/task_1/ HTTP/1.1" 200 10470 "-" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://www.sample-server/isec/task_1/" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"

这是文件数据,谢谢啦朋友

论坛徽章:
2
程序设计版块每日发帖之星
日期:2016-02-28 06:20:00IT运维版块每日发帖之星
日期:2016-03-31 06:20:00
发表于 2016-12-22 09:48 |显示全部楼层
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/accounts/ HTTP/1.1" 200 5338 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4553 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/search/ HTTP/1.1" 200 5083 "https://sample-server/isec/checkMe/?browser=Chrome&ver=35.0.1916.114&sys=Windows%207&plugins=Java:1.7.0.55,Flash:13.0.0.214,VLC%20Player:2.1.3.0,Silverlight:5.1.30214.0" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /static/js/affected.js HTTP/1.1" 200 2452 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET / HTTP/1.1" 302 6988 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/css/bootstrap.min.css HTTP/1.1" 200 12249 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/prettify/prettify.css HTTP/1.1" 200 852 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/extra.css HTTP/1.1" 200 3516 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/autocomplete_light/style.css HTTP/1.1" 200 1884 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/css.css HTTP/1.1" 200 956 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/all/ HTTP/1.1" 200 5280 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpiicon.ico HTTP/1.1" 200 1970 "-" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:58 +0200] "GET /isec/search/ HTTP/1.1" 200 4938 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:59 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:01 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:02 +0200] "GET /static/prettify/prettify.js HTTP/1.1" 200 6564 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/task_1/ HTTP/1.1" 200 10470 "-" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://www.sample-server/isec/task_1/" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"

这是文件数据,谢谢啦诸位

论坛徽章:
2
程序设计版块每日发帖之星
日期:2016-02-28 06:20:00IT运维版块每日发帖之星
日期:2016-03-31 06:20:00
发表于 2016-12-22 09:49 |显示全部楼层

求助,关于文本处理,按照这种要求,该写哪种shell语句啊?谢谢大家

93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
93.193.91.75 - - [25/May/2014:15:26:51 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/accounts/ HTTP/1.1" 200 5338 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4553 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/search/ HTTP/1.1" 200 5083 "https://sample-server/isec/checkMe/?browser=Chrome&ver=35.0.1916.114&sys=Windows%207&plugins=Java:1.7.0.55,Flash:13.0.0.214,VLC%20Player:2.1.3.0,Silverlight:5.1.30214.0" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.24.149.124 - - [25/May/2014:15:26:53 +0200] "GET /static/js/affected.js HTTP/1.1" 200 2452 "https://sample-server/isec/accounts/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
37.201.226.131 - - [25/May/2014:15:26:53 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET / HTTP/1.1" 302 6988 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:54 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/css/bootstrap.min.css HTTP/1.1" 200 12249 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:55 +0200] "GET /static/prettify/prettify.css HTTP/1.1" 200 852 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/extra.css HTTP/1.1" 200 3516 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/autocomplete_light/style.css HTTP/1.1" 200 1884 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/css/css.css HTTP/1.1" 200 956 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/all/ HTTP/1.1" 200 5280 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:56 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpi-claim_01.png HTTP/1.1" 200 3114 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/Logo.png HTTP/1.1" 200 7930 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/hpiicon.ico HTTP/1.1" 200 1970 "-" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
37.201.226.131 - - [25/May/2014:15:26:58 +0200] "GET /isec/search/ HTTP/1.1" 200 4938 "https://sample-server/isec/all/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
37.201.226.131 - - [25/May/2014:15:26:59 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://sample-server/isec/search/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.114 Safari/537.36"
85.183.238.26 - - [25/May/2014:15:26:56 +0200] "GET /static/img/startseite_blau.png HTTP/1.1" 200 654957 "https://sample-server/static/css/extra.css" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:01 +0200] "GET /isec/ HTTP/1.1" 200 5890 "http://www.pcwelt.de/news/Gratis-Check_verraet__ob_Ihre_Daten_sicher_sind-Identity_Leak_Checker-8725246.html?r=563613162754286&lid=331276&pm_ln=11" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
85.183.238.26 - - [25/May/2014:15:27:02 +0200] "GET /static/prettify/prettify.js HTTP/1.1" 200 6564 "https://sample-server/isec/" "Mozilla/5.0 (Windows NT 6.1; rv:29.0) Gecko/20100101 Firefox/29.0"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/task_1/ HTTP/1.1" 200 10470 "-" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"
46.223.101.196 - - [25/May/2014:15:27:02 +0200] "GET /isec/my_admin/jsi18n/ HTTP/1.1" 200 4394 "https://www.sample-server/isec/task_1/" "Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko"

论坛徽章:
2
程序设计版块每日发帖之星
日期:2016-02-28 06:20:00IT运维版块每日发帖之星
日期:2016-03-31 06:20:00
发表于 2016-12-22 09:52 |显示全部楼层
回复 2# moperyblue

哥们,我贴出来了,帮忙看看,谢谢

论坛徽章:
28
15-16赛季CBA联赛之八一
日期:2016-02-22 19:10:4215-16赛季CBA联赛之深圳
日期:2016-12-01 10:34:0415-16赛季CBA联赛之新疆
日期:2016-12-07 10:24:2915-16赛季CBA联赛之同曦
日期:2016-12-15 12:06:43CU十四周年纪念徽章
日期:2016-12-18 13:03:4415-16赛季CBA联赛之吉林
日期:2017-01-03 15:52:2515-16赛季CBA联赛之辽宁
日期:2017-01-04 14:58:2415-16赛季CBA联赛之辽宁
日期:2017-01-15 09:42:512016科比退役纪念章
日期:2017-02-06 17:21:50黑曼巴
日期:2017-02-10 15:46:1215-16赛季CBA联赛之上海
日期:2017-03-18 10:14:5415-16赛季CBA联赛之青岛
日期:2017-03-18 22:00:44
发表于 2016-12-22 10:35 |显示全部楼层
本帖最后由 moperyblue 于 2016-12-22 12:27 编辑

回复 6# zw86620032


  1. #1.
  2. awk '$9==200&&!b[$1]++{print$1}' file

  3. #2.
  4. awk '/"GET /{a[$1]++}END{for(i in a)print i,a[i]|"sort -k2nr|head -5|cut -f1"}' OFS=\\t file

  5. #3.
  6. awk '$9!=200{i++}END{print i}' file
复制代码

论坛徽章:
307
程序设计版块每周发帖之星
日期:2016-04-08 00:41:33操作系统版块每日发帖之星
日期:2015-09-02 06:20:00每日论坛发贴之星
日期:2015-09-02 06:20:00程序设计版块每日发帖之星
日期:2015-09-04 06:20:00每日论坛发贴之星
日期:2015-09-04 06:20:00每周论坛发贴之星
日期:2015-09-06 22:22:00程序设计版块每日发帖之星
日期:2015-09-09 06:20:00程序设计版块每日发帖之星
日期:2015-09-19 06:20:00程序设计版块每日发帖之星
日期:2015-09-20 06:20:00每日论坛发贴之星
日期:2015-09-20 06:20:00程序设计版块每日发帖之星
日期:2015-09-22 06:20:00程序设计版块每日发帖之星
日期:2015-09-24 06:20:00
发表于 2016-12-22 12:06 |显示全部楼层
1、列出能成功访问网页的IP地址,不要重复。(应该就是状态码200的)
2、计算每个IP地址总共发出多少个GET请求,列出最多的5个
3、求出状态码不是200的总请求个数

你的数据处理要求,如何理解? 三种结果?

论坛徽章:
0
发表于 2016-12-22 12:18 |显示全部楼层
需求一:
        [root@ /tmp/cdly]# awk '$9==200{a[$1]}END{for(i in a)print i}' file              
        37.201.226.131
        37.24.149.124
        93.193.91.75
        46.223.101.196
        85.183.238.26

需求二:       
        [root@ /tmp/cdly]# awk '$6~/GET/{a[$1]++}END{for(i in a)print a[i],i}' file|sort -nr|head -5
        13 85.183.238.26
        6 37.201.226.131
        3 93.193.91.75
        3 37.24.149.124
        2 46.223.101.196
需求三:
        [root@ /tmp/cdly]# awk '$9!=200{a++}END{print a}' file
        1

论坛徽章:
1
15-16赛季CBA联赛之江苏
日期:2016-10-26 16:19:04
发表于 2016-12-22 13:49 |显示全部楼层
1、awk '$9==200{!a[$1]++;}END{for(i in a)print i}'  file
2、awk  '$6=="\"GET"{count[$1]++}END{for(i in count)print count[i],i}' file
3awk '$9!="200"{count++;next}END{print count}'  file
您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

  

北京盛拓优讯信息技术有限公司. 版权所有 京ICP备16024965号-6 北京市公安局海淀分局网监中心备案编号:11010802020122 niuxiaotong@pcpop.com 17352615567
未成年举报专区
中国互联网协会会员  联系我们:huangweiwei@itpub.net
感谢所有关心和支持过ChinaUnix的朋友们 转载本站内容请注明原作者名及出处

清除 Cookies - ChinaUnix - Archiver - WAP - TOP