awk初学之常见问题

yuloveban

回复 1# yinyuemi


    非常感谢共享！

yuloveban

回复 1# yinyuemi


    楼主具体解析下 awk -v RS="#" '{$1=$1;print $0}'  $1=$1应该如何理解啊？ 刚刚看了你给发的那个帖子，没有看明白！

yinyuemi

回复  yinyuemi


    楼主具体解析下 awk -v RS="#" '{$1=$1;print $0}'  $1=$1应该如何理解啊？ 刚刚 ...
yuloveban 发表于 2011-11-07 22:37

http://www.gnu.org/s/gawk/manual/gawk.html#Fields
Advanced Notes: Understanding $0

It is important to remember that $0 is the full record, exactly as it was read from the input. This includes any leading or trailing whitespace, and the exact whitespace (or other characters) that separate the fields.

It is a not-uncommon error to try to change the field separators in a record simply by setting FS and OFS, and then expecting a plain ‘print’ or ‘print $0’ to print the modified record.

But this does not work, since nothing was done to change the record itself. Instead, you must force the record to be rebuilt, typically with a statement such as ‘$1 = $1’, as described earlier.

1. $1=$1可以使OFS生效
   
2. 
   
3. 
   
4. echo '1#1#1
   
5. 2#2#2'  |awk -vRS="#" '{$1=$1;print $0}'
   
6. 1
   
7. 1
   
8. 1 2 # OFS默认值为空格，生效！或者说，任意一个对域进行操作的action，都会使得OFS生效，比如$2=$2,NF+=0;
   
9. 2
   
10. 2
    
11. 
    
12. 再举两个例子：
    
13.     echo '1 1 1
    
14.     2 2 2' |awk 'NR==1{OFS=":";$1=$1;print}NR==2{OFS="#";$1=$1;print}'  
    
15.     1:1:1
    
16.     2#2#2
    
17. 
    
18.     echo '1 1 1
    
19.     2 2 2' |awk 'NR==1{OFS=":";$0=$0;print}NR==2{OFS="#";$0=$0;print}'   # $0=$0的指令并不会引起OFS生效。
    
20.     1 1 1
    
21.     2 2 2
    
22. 
    

复制代码

yuloveban

回复 43# yinyuemi


    3qs

rayzhang11

总结的真好，感谢

xiaopan3322

关于第四点，今天看manual的时候找到了，贴下：

Finally, there are times when it is convenient to force awk to rebuild the entire record, using the current value of the fields and OFS. To do this, use the seemingly innocuous assignment:

     $1 = $1   # force record to be reconstituted
     print $0  # or whatever else with $0

This forces awk rebuild the record. It does help to add a comment, as we've shown here.

There is a flip side to the relationship between $0 and the fields. Any assignment to $0 causes the record to be reparsed into fields using the current value of FS. This also applies to any built-in function that updates $0, such as sub() and gsub() (see String Functions).

Advanced Notes: Understanding $0
It is important to remember that $0 is the full record, exactly as it was read from the input. This includes any leading or trailing whitespace, and the exact whitespace (or other characters) that separate the fields.

It is a not-uncommon error to try to change the field separators in a record simply by setting FS and OFS, and then expecting a plain ‘print’ or ‘print $0’ to print the modified record.

But this does not work, since nothing was done to change the record itself. Instead, you must force the record to be rebuilt, typically with a statement such as ‘$1 = $1’, as described earlier.

yinyuemi

回复 46# xiaopan3322


    多谢Bob

manganese_zh

不错，给力的贴子

freeterman

10. awk ‘! a[$0]++’ 怎么理解？

这是一个非常经典的去重复项的awk语句，虽然短小，不过涉及到了不少知识点，下面一一解读：

<1> ：”!” 即非。

<2>：a[$0]，以$0为数据下标，建立数组a

<3>：a[$0]++，即给数组a赋值，a[$0]+=1

<4> ：那么组合起来，awk是怎么执行!a[$0]++的呢？我用一个实际例子来解释：


01.cat file

02.111

03.222

04.111

05.222

06.333

07.

08.awk '{print a[$0],!a[$0]++,a[$0],!a[$0],$0}' file

09.  1 1 0 111

10.  1 1 0 222

11.1 0 2 0 111

12.1 0 2 0 222

13.  1 1 0 333
复制代码


原来，第一个a[$0]的值为空，所以!a[$0]++是先作判断，结果为1（非空为真，即为1），再作数组赋值a[$0]++。这也就是为什么前面的!a[$0]++并不一定等于后面的!a[$0]。

awk ‘++a[$0]==1’ 和上面的代码作用一样，你理解了么?


不懂

ulovko

总结的真好 ，感谢分享！