如何删除文件中重复的字符

sunzhiguolu

1. perl -pe 's/(\w+)\h+\1/$1/' f

复制代码

we avoid bois
ccccc  ddddd 1123
fdsaflsj  we

sunzhiguolu

1. perl -ane 'print"$_ " for grep {!$h{$_}++} @F;print"\n";%h=()' f

复制代码

we avoid bois
ccccc ddddd 1123
fdsaflsj we

moperyblue

貌似楼主的需求不是单行字符串去重

1. sed -r ':a;s/(\b\S+\b) +(.*) *\1/\1 \2/;ta;N;ba'

复制代码

sunzhiguolu

1. perl -0777 -pe 'while(s/(\w+)(.*?)\b\1\b/$1$2/s){}' f

复制代码

we avoid   bois
ccccc  ddddd 1123
fdsaflsj

sunzhiguolu

1. perl -ane 'print"$_ " for grep {!$h{$_}++} @F;print"\n"' f

复制代码

we avoid bois
ccccc ddddd 1123
fdsaflsj

sunzhiguolu

再来一个,

1. perl -007 -pe 'while(s/(?=(\w+))(.+?)\b\1\b/$2/gs){}' f

复制代码

we avoid   bois
ccccc  ddddd 1123
fdsaflsj

重楼君

1. with open('file.txt', 'r') as f:
   
2.     for line in f:
   
3.         i = line.split()
   
4.         j = []
   
5.         for x in i:
   
6.             if not x in j:
   
7.                 j.append(x)
   
8.         print ' '.join(j)
   
9. 
   

复制代码

回复 1# learnllehs