邮件日志过滤

mid2015

1. 2015-11-12 21:26:46.712831500 new msg 3045090
   
2. 2015-11-12 21:26:46.712832500 info msg 3045090: bytes 5666 from <shop@abc.com> qp 20071 uid 7791
   
3. 2015-11-12 21:26:46.712833500 starting delivery 717848: msg 3045090 to local pc_order@abc.com
   
4. 2015-11-12 21:26:46.718283500 delivery 717848: success: did_0+1+0/qp_20073/
   
5. 2015-11-12 21:26:46.718286500 end msg 3045090
   
6. 
   
7. 2015-11-12 21:26:46.665919500 new msg 3044951
   
8. 2015-11-12 21:26:46.665920500 info msg 3044951: bytes 5718 from <shop@abc.com> qp 20064 uid 7791
   
9. 2015-11-12 21:26:46.665921500 starting delivery 717847: msg 3044951 to remote paulmccaya@yahoo.com
   
10. 2015-11-12 21:26:46.914771500 delivery 717847: success: <From:shop@abc.com_To:paulmccaya@yahoo.com>_/28.203.242.17_accepted_message./Remote_host_said:_250_ok:__
    
11. Message_6166415_accepted/
    
12. 2015-11-12 21:26:46.914864500 end msg 3044951
    
13. 
    
14. 2015-11-12 21:26:46.722202500 new msg 3045124
    
15. 2015-11-12 21:26:46.722203500 info msg 3045124: bytes 5774 from <shop@abc.com> qp 20073 uid 1000
    
16. 2015-11-12 21:26:46.722204500 starting delivery 717849: msg 3045124 to remote maildealer-12@mdmonicagw.com
    
17. 2015-11-12 21:26:47.047059500 delivery 717849: success: <From:shop@abc.com_To:maildealer-12@mdmonicagw.com>_/28.203.242.17_accepted_message./Remote_host
    
18. _said:_250_ok:__Message_6166416_accepted/
    
19. 2015-11-12 21:26:47.047158500 end msg 3045124
    
20. 
    
21. 2015-11-12 22:10:08.722847500 new msg 3045119
    
22. 2015-11-12 22:10:08.722848500 info msg 3045119: bytes 8871 from <it-admin-hk@abc.com> qp 25201 uid 1000
    
23. 2015-11-12 22:10:08.722850500 starting delivery 717993: msg 3045119 to local andy@abc.com
    
24. 2015-11-12 22:10:08.722852500 starting delivery 717994: msg 3045119 to local shito@abc.com
    
25. 2015-11-12 22:10:08.722854500 starting delivery 717995: msg 3045119 to local rebecca_yue@abc.com
    
26. 2015-11-12 22:10:08.722876500 starting delivery 717996: msg 3045119 to local jacky@abc.com
    
27. 2015-11-12 22:10:08.722878500 starting delivery 717997: msg 3045119 to local karen@abc.com
    
28. 2015-11-12 22:10:08.722878500 starting delivery 717999: msg 3045124 to remote youe@ntop.com
    
29. 2015-11-12 22:10:08.767499500 delivery 717994: success: did_1+0+0/
    
30. 2015-11-12 22:10:08.791566500 delivery 717993: success: did_1+0+0/
    
31. 2015-11-12 22:10:08.801569500 delivery 717996: success: did_1+0+0/
    
32. 2015-11-12 22:10:08.805564500 delivery 717997: success: did_1+0+0/
    
33. 2015-11-12 22:10:08.813091500 delivery 717995: success: did_1+0+0/
    
34. 2015-11-12 22:10:08.813160500 end msg 3045119
    
35. 
    
36. 2015-11-12 21:10:38.012659500 new msg 3044951
    
37. 2015-11-12 21:10:38.012661500 info msg 3044951: bytes 8172 from <sellercenter-GUIA@info.lazada.com> qp 18341 uid 7791
    
38. 2015-11-12 21:10:38.012662500 starting delivery 717825: msg 3044951 to local miu@abc.com
    
39. 2015-11-12 21:10:38.031149500 delivery 717825: success: did_1+0+0/
    
40. 2015-11-12 21:10:38.031288500 end msg 3044951
    

复制代码

如上的邮件日志内容，我想统计一下用户的邮件发送记录：

data,time,from,to

例如：
2015-11-12,21:26:46,shop@abc.com,paulmccaya@yahoo.com
2015-11-12,22:10:08,it-admin-hk@abc.com,andy@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,shito@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,rebecca_yue@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,jacky@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,karen@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,youe@ntop.com
.....

如何实现？

songyc_2015

awk -F'[. ]' '/new msg [0-9]+$/{m=$NF;p=1}p&&match($0,/bytes [0-9]+ from <([^>]+)>/,a){f=a[1]}p&&/msg [0-9]+ to/{print $1,$2,f,$(NF-1)""$NF}$0~"end msg"m{p=0;f="";m=""}' OFS="," file

sync_1521

[root@test]# awk -vOFS="," '/info msg.*from/{match($0,/<(.*)>/,a);from=a[1]}/starting delivery/{sub(/\..*/,"",$2);to=$NF;print $1,$2,from,to}' 1      
2015-11-12,21:26:46,shop@abc.com,pc_order@abc.com
2015-11-12,21:26:46,shop@abc.com,paulmccaya@yahoo.com
2015-11-12,21:26:46,shop@abc.com,maildealer-12@mdmonicagw.com
2015-11-12,22:10:08,it-admin-hk@abc.com,andy@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,shito@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,rebecca_yue@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,jacky@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,karen@abc.com
2015-11-12,22:10:08,it-admin-hk@abc.com,youe@ntop.com
2015-11-12,21:10:38,sellercenter-GUIA@info.lazada.com,miu@abc.com