shell去除连续两行或者多行相同开头的行

zhangheng520

现在遇到一个问题,文件内容如下;


Sep 06 01:12:20.079649 pid 9275 (pool default)
script_filename = /export/home/index.php
Sep 06 01:12:21.384616 pid 9441 (pool default)
script_filename = /export/home/more.php
Sep 06 01:12:28.822470 pid 9419 (pool default)
Sep 06 01:12:35.870249 pid 9124 (pool default)
script_filename = /export/home/ps_more.php
Sep 06 01:12:40.830110 pid 9341 (pool default)
script_filename = /export/home/pb_index.php
Sep 06 01:12:28.822470 pid 9419 (pool default)
Sep 06 01:12:35.870249 pid 9124 (pool default)
Sep 06 01:12:28.822470 pid 9419 (pool default)
Sep 06 01:12:45.922982 pid 9023 (pool default)
script_filename = /export/home/auto/index.php

现在需要将重复的Sep开头的行去除.结果应该如下:

Sep 06 01:12:20.079649 pid 9275 (pool default)
script_filename = /export/home/index.php
Sep 06 01:12:21.384616 pid 9441 (pool default)
script_filename = /export/home/more.php
Sep 06 01:12:35.870249 pid 9124 (pool default)
script_filename = /export/home/ps_more.php
Sep 06 01:12:45.922982 pid 9023 (pool default)
script_filename = /export/home/auto/index.php

就是凡是连续两个或者多个Sep开头的行下面没有script_filename的都删除.结果就变成一行Sep时间行,下面就应该是script_filename行.

谢谢 大家.............

xinglu1983

awk 'a!=$1{a=$1;print}' urfile

zhangheng520

回复 2# xinglu1983


    真效率啊,,,感谢......

cjaizss

按原语意.
sed -n '/^Sep/{p;ba;};p;d;:a;n;/^Sep/ba'

cjaizss

哦,不好意思,你需要的是Sep的最后一行:
sed -n '/^Sep/{h;ba;};p;d;:a;$p;n;/^Sep/{h;ba;};H;x;p'

cjaizss

再来一个awk版本
awk '/^Sep/{flag=1;x=$0;next}flag==1{flag=0;print x}{print}END{if(flag==1)print x}'

角落的猫

学习了……还真不知道怎么写

bbgg1983

回复 1# zhangheng520

1. tac file|uniq -w 3|tac

复制代码