[求助]一组数据整理办法

cai6642113

20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
24,13032256323,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0


求助一组数据整理办法，上为部分数据

以红色字段为条件完全相同的为一组，分别计算黄色字段去重后的条数，以及蓝色字段数值相加



回复 4# 关阴月飞


多谢大神，受教了，如果我还有个文件B，要在最后输出的$3与n 之间再加一个B文件中的一列字段，只要$1,$2 完全相同就插入文件B的$3到输出的结果的$4，应该怎么做啊


文件B的内容
898 0762  12345
220 022    54321
898 0898   45678
输出的结果
898 0762  40 12345 2

220 022  42 54321 2

898 0898  12 45678 2
     

seesea2517

你目前做到哪里，有啥问题可以发出来，大家讨论讨论。
如果没有头绪，建议用 awk 试试。

reyleon

建议多贴点数据,然后举个例子,期望得到何种结果

关阴月飞

回复 1# cai6642113

目测楼主是这个意思：

1. awk -F, '{a[$7" "$8]+=$13;b[$7" "$8]=$2?b[$7" "$8]" "$2:$2}END{for(i in a)print i,a[i],b[i]}'  urfile |awk '{for(i=4;i<=NF;i++)if(!a[$i]++)n++;print $1,$2,$3,n;n=0}'

复制代码

1. [root@localhost awktest]# cat file
   
2. 20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
   
3. 20,13016236391,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
   
4. 21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
   
5. 21,13016240089,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
   
6. 24,13032256323,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0
   
7. 24,13032256324,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0
   
8. [root@localhost awktest]# awk -F, '{a[$7" "$8]+=$13;b[$7" "$8]=$2?b[$7" "$8]" "$2:$2}END{for(i in a)print i,a[i],b[i]}' file |awk '{for(i=4;i<=NF;i++)if(!a[$i]++)n++;print $1,$2,$3,n;n=0}'
   
9. 898 0762 40 2
   
10. 220 022 42 2
    
11. 898 0898 12 2

复制代码

seesea2517

我也觉得是这样的。

1. [seesea2517@UC ~] $awk -F"," '{sum[$7,$8]+=$13; if(! ($7 SUBSEP $8 SUBSEP $2 in ar)) count[$7,$8]++; ar[$7,$8,$2]++} END{for(i in sum) print gensub(/[^0-9]/, "-", "x", i) " : " sum[i] " : " count[i]}' file
   
2. 898-0762 : 40 : 1
   
3. 220-022 : 42 : 2
   
4. 898-0898 : 12 : 1
   
5. 
   
6. [seesea2517@UC ~] $cat file
   
7. 20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
   
8. 21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
   
9. 24,13032256323,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0
   
10. 20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
    
11. 21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
    
12. 24,xxxxxxxxxxx,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0

复制代码

reyleon

@seesea2517@关阴月飞  你们都是目测大神

seesea2517

回复 6# reyleon


    其实lz表达的还算好了。

关阴月飞

@reyleon   @seesea2517  同意LS观点，LZ表达很清楚了。

dn833

晃死眼了。。。。。。

心若寒江雪

20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
24,13032256323,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0
20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
24,13032256323,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0
20,13016236390,0,0,0,0,898,0898,9999999999,,2,0,6,0,0,0,0
21,13016240088,0,0,0,0,898,0762,9999999999,,2,0,20,0,0,0,0
24,13032256323,0,0,0,0,220,022,9999999999,,2,0,21,0,0,0,0

#!/bin/awk -f
BEGIN{
FS=",";SUBSEP="-"
}
{
array[$2,$7,$8]++
num[$7,$8]+=$13
}END{
for(i in array){
printf("The total of %s is\t %s\n",i,array)
}
for(ii in num){
printf("The num of %s is %s\n",ii,num[ii])}
}

The total of 13032256323-220-022 is      3
The total of 13016236390-898-0898 is     3
The total of 13016240088-898-0762 is     3
The num of 898-0898 is 18
The num of 220-022 is 63
The num of 898-0762 is 60
大晚上的就是睡不着爬起来翻翻

回复 1# cai6642113