免费注册 查看新帖 |

Chinaunix

  平台 论坛 博客 文库
最近访问板块 发新帖
查看: 1195 | 回复: 2
打印 上一主题 下一主题

[文本处理] 文本中的特殊字符处理问题 [复制链接]

论坛徽章:
0
跳转到指定楼层
1 [收藏(0)] [报告]
发表于 2017-11-10 16:29 |只看该作者 |倒序浏览
本帖最后由 heiheihacker 于 2017-11-10 17:15 编辑

从存储里通过ssh收的日志源文件有很多特殊字符,影响shell处理,请大家帮忙看看如果处理有特殊字符的日志文件,谢谢。以下是日志源文件,已将部分乱码标为红色,剩下的乱码跟标颜色的类似:
Trying ::1...
Connected to localhost.
Escape character is '^]'.

Enter User Name:                                                                                                                                 
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
service

Password:                                                                                                                                       
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D

creating logfile:/var/log/VPlex/cli/session.log_service_localhost_T27970_20171110080509

VPlexcli:/>                                                                                                                                      
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
ESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[DESC[D
source --file /var/log/VPlex/cli/get_vplexinfo.txt
ESC[1mstorage-viewESC[0m: TC_test_ViewESC[0mESC[33m (cluster-2)ESC[0m
ESC[1mstorage-viewESC[0m: test_ViewESC[0mESC[33m (cluster-1)ESC[0m
ESC[1mstorage-viewESC[0m: AA_ViewESC[0mESC[33m (cluster-1)ESC[0m
  ESC[1mconsistency-groupESC[0m: test_CG_ProdESC[0mESC[33m (synchronous)ESC[0m
    ESC[1mvirtual-volumeESC[0m: ESC[1;32mdd_volESC[0mESC[33m (80G, distributed @ cluster-1, running)ESC[0m
      ESC[1mdistributed-deviceESC[0m: dd_AABBESC[0mESC[33m (80G, raid-1)ESC[0m
        ESC[1mdistributed-device-componentESC[0m: device_AABBSC[0mESC[33m (80G, raid-0, cluster-1)ESC[0m
          ESC[1mextentESC[0m: extent_AABB[0mESC[33m (80G)ESC[0m
            ESC[1mstorage-volumeESC[0m: AABBESC[0mESC[33m (80G)ESC[0m
              ESC[1mlogical-unitESC[0m: VPD83T3:60000970000495700123533032334141ESC[0m
                ESC[1mstorage-arrayESC[0m: EMC-SYMMETRIX-1234567ESC[0m
        ESC[1mdistributed-device-componentESC[0m: device_AABBESC[0mESC[33m (80G, raid-0, cluster-2)ESC[0m
          ESC[1mextentESC[0m: extent_AABB_1ESC[0mESC[33m (80G)ESC[0m
            ESC[1mstorage-volumeESC[0m: AABBESC[0mESC[33m (80G)ESC[0m

论坛徽章:
145
技术图书徽章
日期:2013-10-01 15:32:13戌狗
日期:2013-10-25 13:31:35金牛座
日期:2013-11-04 16:22:07子鼠
日期:2013-11-18 18:48:57白羊座
日期:2013-11-29 10:09:11狮子座
日期:2013-12-12 09:57:42白羊座
日期:2013-12-24 16:24:46辰龙
日期:2014-01-08 15:26:12技术图书徽章
日期:2014-01-17 13:24:40巳蛇
日期:2014-02-18 14:32:59未羊
日期:2014-02-20 14:12:13白羊座
日期:2014-02-26 12:06:59
2 [报告]
发表于 2017-11-10 16:46 |只看该作者
回复 1# heiheihacker

$ perl -ne '{s/\x1b\[\d*\w//g;print}' FILE

or dump your file

$ hexdump -C FILE

论坛徽章:
0
3 [报告]
发表于 2017-11-10 17:13 |只看该作者
回复 2# jason680
hi,我刚才又将哪些属于乱码的部分标了一下颜色,因为我看了您用perl写的那条语句漏掉了个别的乱码,您在帮忙看看,另外您说的hexdump -C FILE好像不行吧?

您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

  

北京盛拓优讯信息技术有限公司. 版权所有 京ICP备16024965号-6 北京市公安局海淀分局网监中心备案编号:11010802020122 niuxiaotong@pcpop.com 17352615567
未成年举报专区
中国互联网协会会员  联系我们:huangweiwei@itpub.net
感谢所有关心和支持过ChinaUnix的朋友们 转载本站内容请注明原作者名及出处

清除 Cookies - ChinaUnix - Archiver - WAP - TOP