文本求助-删除html内容和缺项补空

bikkuri

大家好！
我有一个问题向大家请教，
有如下一个文本。

1. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000006DVa3AAG/view" style3D"color:rgb(0,112,210); word-break:break-all">00332240</a>
   
2. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000006DVa3AAG/view" style3D"color:rgb(0,112,210); word-break:break-all">Inovasi Lintas Media - Fiberstar// Request graph snmp service on nokia 7550-SR</a>
   
3. Indonesia
   
4. <a href3D"https://nokia.lightning.force.com/lightning/r/0014100000RhiacAAB/view" style3D"color:rgb(0,112,210); word-break:break-all">PT INOVASI LINTAS MEDIA</a>
   
5. <a href3D"https://nokia.lightning.force.com/lightning/r/0033h000008tZq5AAE/view" style3D"color:rgb(0,112,210); word-break:break-all">Chairudin Setiawan</a>
   
6. 7/12/2020 6:46 PM
   
7. 7/12/2020 8:00 PM
   
8. 7
   
9. <a href3D"https://nokia.lightning.force.com/lightning/r/0052M000009BySQQA0/view" style3D"color:rgb(0,112,210); word-break:break-all">Marugaobozu</a>
   
10. Responded in Progress
    
11. Open Violation
    
12. Low
    
13. Minor
    
14. NSP (Network Services Platform)
    
15. -
    
16. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005mj9EAAQ/view" style3D"color:rgb(0,112,210); word-break:break-all">00324914</a>
    
17. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005mj9EAAQ/view" style3D"color:rgb(0,112,210); word-break:break-all">NFM-P Statistical Counter for Wavence Product</a>
    
18. Malaysia
    
19. <a href3D"https://nokia.lightning.force.com/lightning/r/0014100000LUkyoAAD/view" style3D"color:rgb(0,112,210); word-break:break-all">U MOBILE SDN BHD</a>
    
20. <a href3D"https://nokia.lightning.force.com/lightning/r/0033h000007Xuh9AAC/view" style3D"color:rgb(0,112,210); word-break:break-all">Guruh Samodra</a>
    
21. 7/6/2020 4:11 PM
    
22. 7/6/2020 4:15 PM
    
23. 154
    
24. <a href3D"https://nokia.lightning.force.com/lightning/r/0052M000009BySQQA0/view" style3D"color:rgb(0,112,210); word-break:break-all">Marugaobozu</a>
    
25. Responded in Progress
    
26. Compliant
    
27. Low
    
28. Minor
    
29. NSP (Network Services Platform)
    
30. NFM-P (Network Functions Manager - Packet)
    
31. -
    
32. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h00000625xqAAA/view" style3D"color:rgb(0,112,210); word-break:break-all">00329600</a>
    
33. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h00000625xqAAA/view" style3D"color:rgb(0,112,210); word-break:break-all">License Creation</a>
    
34. Australia
    
35. <a href3D"https://nokia.lightning.force.com/lightning/r/0014100000LUkiTAAT/view" style3D"color:rgb(0,112,210); word-break:break-all">SA POWER NETWORKS</a>
    
36. <a href3D"https://nokia.lightning.force.com/lightning/r/0033h000009t7wQAAQ/view" style3D"color:rgb(0,112,210); word-break:break-all">Madhan K</a>
    
37. 7/7/2020 9:12 AM
    
38. 7/9/2020 2:34 PM
    
39. 137
    
40. <a href3D"https://nokia.lightning.force.com/lightning/r/0052M000009BySQQA0/view" style3D"color:rgb(0,112,210); word-break:break-all">Marugaobozu</a>
    
41. Pending Customer
    
42. -
    
43. Low
    
44. Minor
    
45. 5620 SAM (Service Aware Manager)
    
46. -
    
47. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005Hxk4AAC/view" style3D"color:rgb(0,112,210); word-break:break-all">00317443</a>
    
48. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005Hxk4AAC/view" style3D"color:rgb(0,112,210); word-break:break-all">NSP 19.9 All Wavences Radio NE capacity License in the Umobile network.</a>
    
49. Malaysia
    
50. <a href3D"https://nokia.lightning.force.com/lightning/r/0014100000LUkyoAAD/view" style3D"color:rgb(0,112,210); word-break:break-all">U MOBILE SDN BHD</a>
    
51. <a href3D"https://nokia.lightning.force.com/lightning/r/0033h000007Xuh9AAC/view" style3D"color:rgb(0,112,210); word-break:break-all">Guruh Samodra</a>
    
52. 6/25/2020 3:30 PM
    
53. 6/25/2020 3:32 PM
    
54. 418
    
55. <a href3D"https://nokia.lightning.force.com/lightning/r/0052M000009BySQQA0/view" style3D"color:rgb(0,112,210); word-break:break-all">Marugaobozu</a>
    
56. Pending Customer
    
57. Compliant
    
58. Medium
    
59. Major
    
60. NSP (Network Services Platform)
    
61. NFM-P (Network Functions Manager - Packet)
    
62. NSPD-260050
    
63. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005fHlQAAU/view" style3D"color:rgb(0,112,210); word-break:break-all">00320535</a>
    
64. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005fHlQAAU/view" style3D"color:rgb(0,112,210); word-break:break-all">NFM-P Switchover's long time more than 45 minutes (Calculate from user can access to NFM-P GUI)</a>
    
65. Thailand
    
66. <a href3D"https://nokia.lightning.force.com/lightning/r/0014100000LUo6bAAD/view" style3D"color:rgb(0,112,210); word-break:break-all">TRUE INTERNET CORPORATION COMPANY LIMITED</a>
    
67. <a href3D"https://nokia.lightning.force.com/lightning/r/0033h000009I74tAAC/view" style3D"color:rgb(0,112,210); word-break:break-all">Patisamphitha Atthangkikamak</a>
    
68. 6/30/2020 3:48 PM
    
69. 7/1/2020 3:06 PM
    
70. 298
    
71. <a href3D"https://nokia.lightning.force.com/lightning/r/0052M000009BySQQA0/view" style3D"color:rgb(0,112,210); word-break:break-all">Marugaobozu</a>
    
72. Pending Customer
    
73. -
    
74. Medium
    
75. Major
    
76. NSP (Network Services Platform)
    
77. NFM-P (Network Functions Manager - Packet)
    
78. -
    
79. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005fBPAAA2/view" style3D"color:rgb(0,112,210); word-break:break-all">00320485</a>
    
80. <a href3D"https://nokia.lightning.force.com/lightning/r/5003h000005fBPAAA2/view" style3D"color:rgb(0,112,210); word-break:break-all">[Customer/Major] CMG Measurement Missing</a>
    
81. Indonesia
    
82. <a href3D"https://nokia.lightning.force.com/lightning/r/0014100000LUkfCAAT/view" style3D"color:rgb(0,112,210); word-break:break-all">PT HUTCHISON 3 INDONESIA</a>
    
83. <a href3D"https://nokia.lightning.force.com/lightning/r/0033h000003M8a0AAC/view" style3D"color:rgb(0,112,210); word-break:break-all">H3I FO Core</a>
    
84. 6/30/2020 12:05 PM
    
85. 6/30/2020 12:09 PM
    
86. 302
    
87. <a href3D"https://nokia.lightning.force.com/lightning/r/0052M000009BySQQA0/view" style3D"color:rgb(0,112,210); word-break:break-all">Marugaobozu</a>
    
88. Responded in Progress
    
89. Compliant
    
90. Medium
    
91. Major
    
92. NSP (Network Services Platform)
    
93. NFM-P (Network Functions Manager - Packet)
    
94. -

复制代码

希望用awk做以下处理：
1. 去除html内容：将<a href...>和</a>去掉，只显示夹在中间的内容，比如第一行处理后仅显示：00332240；
2. 缺项补空：每一组数据由16行内容组成，以仅含有一个8位数字的行开头，后面紧接着的15行是属性行；
   但是有时候倒数第二行会丢失，使得有的数据块有16行，有的只有15行；
   希望对于只有15行的数据块在倒数第二行的位置插入一个空行补足16行。
例如：第一个数据块就只有15行，希望处理后显示为：

######################分割线######################

00332240

Inovasi Lintas Media - Fiberstar// Request graph snmp service on nokia 7550-SR
Indonesia
PT INOVASI LINTAS MEDIA
Chairudin Setiawan
7/12/2020 6:46 PM
7/12/2020 8:00 PM
7
Marugaobozu
Responded in Progress
Open Violation
Low
Minor
NSP (Network Services Platform)

-

######################分割线######################

谢谢大家的指点和帮助。

cfwyy

好久没来，python写个吧。仅保证对例子有效。

1. import re
   
2. from io import StringIO
   
3. 
   
4. buf = StringIO()
   
5. with open("1.html","r") as f:
   
6.     for line in f:
   
7.         match = re.search(r"(?<=>).+?(?=<)",line)
   
8.         if match:
   
9.             buf.write(match.group()+"\n")
   
10.         else:
    
11.             buf.write(line)
    
12. 
    
13. res = re.findall("(?s)\d{8}.+?(?=\d{8}|$)",buf.getvalue())
    
14. 
    
15. with open("res.txt","w") as f:
    
16.     for s in res:
    
17.         a = s.strip("\n").split("\n")
    
18.         if len(a)==15:
    
19.             a.insert(-1,"")
    
20.         f.write("\n".join(a)+"\n")
    
21.         f.write("##################################################################\n")

复制代码

用awk：test.awk

1. BEGIN        {
   
2.     FS="<|>"
   
3. }
   
4. {
   
5.     if ($3 ~/[0-9]{8}/)
   
6.     {
   
7.         j=0
   
8.         a[++i][++j]=$3
   
9.     }
   
10.     else if (NF==1)
    
11.     {
    
12.         a[i][++j]=$0
    
13.     }
    
14.     else if (NF>4 && $3 !~/[0-9]{8}/)
    
15.     {
    
16.         a[i][++j]=$3
    
17.     }
    
18. }
    
19. END        {
    
20.     for (i in a)
    
21.     {
    
22.         if (length(a[i])==15)
    
23.         {
    
24.             a[i][16] = a[i][15]
    
25.             a[i][15] = ""
    
26.         }
    
27.         for (j in a[i])
    
28.         {
    
29.             print a[i][j]
    
30.         }
    
31.         print "##################################################################"
    
32.     }
    
33. }

复制代码

1. awk -f test.awk 1.html >res.txt

复制代码

bikkuri

谢谢，请问能用awk处理吗？

bikkuri

非常感谢！

您的代码前面处理都没问题，输出的时候有点问题。
我改成了以下代码后可以正确输出了。

1. awk 'BEGIN{FS="<|>"}{if ($3 ~/[0-9]{8}/&&length($3)==8){j=0;a[++i][++j]=$3}else if(NF==1&& $0!=""){a[i][++j]=$0}else if(NF>4){a[i][++j]=$3}}END{for(z in a){if(length(a[z])==15){a[z][16]=a[z][15];a[z][15]=""}}for(x=1;x<=i;x++)for(y=1;y<=16;y++)print a[x][y]}'

复制代码

回复 4# cfwyy

renxiao2003

使用Python。