sed/awk处理多行文本

cniter

具体是这样的,我需要截取ansible的输出结果中的一部分,为"stdout_lines"到下一个出现IP之间的内容,即获取"stdout_lines"这个输出的内容,样例大概是这样子
192.168.1.1 | SUCCESS => {
    "changed": true,
    "rc": 0,
    "stderr": "",
    "stdout": "--"

    "stdout_lines": [
         4646546546
         13212313
          ........
        ]
}

192.168.1.2 | SUCCESS => {
    "changed": true,
    "rc": 0,
    "stderr": "",
    "stdout": "--"

    "stdout_lines": [
         4646546546
         132af12313
         sfgjldjfkglagf
          ........
        ]
}

192.168.1.3 | SUCCESS => {
    "changed": true,
    "rc": 0,
    "stderr": "",
    "stdout": "--"

    "stdout_lines": [
         4646546546
         13212313
         apoifsdafja
          ........
        ]
}

192.168.1.4 |  UNREACHABLE! => {
    "changed": false,
    "msg": "Failed to connect to the host via ssh.",
    "unreachable": true
}



希望的结果是,stdout_lines里面会有列表,字曲,或者是元组之类,即带符号[], {}, ()
4646546546
13212313
........

4646546546
132af12313
sfgjldjfkglagf
........


4646546546
13212313
apoifsdafja
........
谢各位大神

moperyblue

希望的结果是怎样?

1. sed '/"stdout_lines": \[/,/]/!d' file

复制代码

?

sunzhiguolu

1. perl -0nle 'print map {s/^\s+//gmr."\n"} m/"stdout_lines":.*?\n([^]]+)/g' f

复制代码

cniter

回复 3# sunzhiguolu

测试了您的命令,发现它会把多行的输出截取一行,比如下面这行"|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zon
e=cache_one:4000m inactive=2d max_size=20g'), ('upstream', OrderedDict([('backend', OrderedDict([('server', '
127.0.0.1:80 weight=1'), ('sticky', None)]))])), ('include', 'mime.types'), ('default_type', 'application/oct
et-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('ser
ver_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_
cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', '
X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/
apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('roo
t', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('acces
s_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('inclu
de', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_in
dex', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000')]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root
', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_para
m', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page
', '500 502 503 504 /50x.html')]))]",

它截取后只有
"|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', [OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)

sunzhiguolu

1. perl -ne 'if(/"stdout_lines"/){$P=1;next}if(/\]/){$P=0;print"\n"}if($P){s/^\s+//gm;print}' f

复制代码

sunzhiguolu

回复 4# cniter

具体是这样的,我需要截取ansible的输出结果中的一部分,为"stdout_lines"到下一个出现IP之间的内容,即获取"stdout_lines"这个输出的内容

你提供的文本与发帖时的文本格式存在差异, 能否提供一条完整的记录?

cniter

回复 6# sunzhiguolu
内容具体是这样子
192.168.1.1 | SUCCESS => {
    "changed": true,
    "rc": 0,
    "stderr": "",
    "stdout": "------------------------------------------------------------------------------------------\r\n|http.server.listen                      |   check failed|                              the value is 80|\r\n------------------------------------------------------------------------------------------\r\n|http.server.server_name                 |       check ok|                                             |\r\n------------------------------------------------------------------------------------------\r\n|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)]))])), ('include', 'mime.types'), ('default_type', 'application/octet-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('server_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', 'X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('root', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('access_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('include', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_index', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000')]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page', '500 502 503 504 /50x.html')]))]\r\n------------------------------------------------------------------------------------------\r\n|events                                  |['worker_connections']\r\n------------------------------------------------------------------------------------------\r\n",
    "stdout_lines": [
        "------------------------------------------------------------------------------------------",
        "|http.server.listen                      |   check failed|                              the value is 80|",
        "------------------------------------------------------------------------------------------",
        "|http.server.server_name                 |       check ok|                                             |",
        "------------------------------------------------------------------------------------------",
        "|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)]))])), ('include', 'mime.types'), ('default_type', 'application/octet-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('server_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', 'X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('root', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('access_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('include', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_index', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000')]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page', '500 502 503 504 /50x.html')]))]",
        "------------------------------------------------------------------------------------------",
        "|events                                  |['worker_connections']",
        "------------------------------------------------------------------------------------------"
    ]
}
192.168.1.2 | SUCCESS => {
    "changed": true,
    "rc": 0,
    "stderr": "",
    "stdout": "------------------------------------------------------------------------------------------\r\n|http.server.listen                      |   check failed|                              the value is 80|\r\n------------------------------------------------------------------------------------------\r\n|http.server.server_name                 |       check ok|                                             |\r\n------------------------------------------------------------------------------------------\r\n|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', [OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)]))]), OrderedDict([('tomcat', OrderedDict([('server', ['127.0.0.1:80 weight=1', '127.0.0.1:8080 weight=1']), ('sticky', None)]))])]), ('include', 'mime.types'), ('default_type', 'application/octet-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('server_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', 'X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('root', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('access_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('include', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_index', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000'), ('if', OrderedDict([('($query_string ~ /id/)', OrderedDict())]))]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page', '500 502 503 504 /50x.html')]))]\r\n------------------------------------------------------------------------------------------\r\n|events                                  |['worker_connections']\r\n------------------------------------------------------------------------------------------\r\n",
    "stdout_lines": [
        "------------------------------------------------------------------------------------------",
        "|http.server.listen                      |   check failed|                              the value is 80|",
        "------------------------------------------------------------------------------------------",
        "|http.server.server_name                 |       check ok|                                             |",
        "------------------------------------------------------------------------------------------",
        "|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', [OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)]))]), OrderedDict([('tomcat', OrderedDict([('server', ['127.0.0.1:80 weight=1', '127.0.0.1:8080 weight=1']), ('sticky', None)]))])]), ('include', 'mime.types'), ('default_type', 'application/octet-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('server_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', 'X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('root', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('access_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('include', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_index', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000'), ('if', OrderedDict([('($query_string ~ /id/)', OrderedDict())]))]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page', '500 502 503 504 /50x.html')]))]",
        "------------------------------------------------------------------------------------------",
        "|events                                  |['worker_connections']",
        "------------------------------------------------------------------------------------------"
    ]
}
192.168.1.3 | SUCCESS => {
    "changed": true,
    "rc": 0,
    "stderr": "",
    "stdout": "------------------------------------------------------------------------------------------\r\n|http.server.listen                      |   check failed|                              the value is 80|\r\n------------------------------------------------------------------------------------------\r\n|http.server.server_name                 |       check ok|                                             |\r\n------------------------------------------------------------------------------------------\r\n|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)]))])), ('include', 'mime.types'), ('default_type', 'application/octet-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('server_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', 'X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('root', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('access_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('include', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_index', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000')]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page', '500 502 503 504 /50x.html')]))]\r\n------------------------------------------------------------------------------------------\r\n|events                                  |['worker_connections']\r\n------------------------------------------------------------------------------------------\r\n",
    "stdout_lines": [
        "------------------------------------------------------------------------------------------",
        "|http.server.listen                      |   check failed|                              the value is 80|",
        "------------------------------------------------------------------------------------------",
        "|http.server.server_name                 |       check ok|                                             |",
        "------------------------------------------------------------------------------------------",
        "|http                                    |[('proxy_cache_path', '/opt/proxy_temp levels=1:2 keys_zone=cache_one:4000m inactive=2d max_size=20g'), ('upstream', OrderedDict([('backend', OrderedDict([('server', '127.0.0.1:80 weight=1'), ('sticky', None)]))])), ('include', 'mime.types'), ('default_type', 'application/octet-stream'), ('sendfile', 'on'), ('keepalive_timeout', '65'), ('server', OrderedDict([('listen', '80'), ('server_name', 'localhost'), ('location', [OrderedDict([('/', OrderedDict([('proxy_cache', 'cache_one'), ('proxy_cache_valid', '200 304 12h'), ('proxy_cache_key', '$uri$is_args$args'), ('proxy_set_header', ['Host $host', 'X-Forwarded-For $remote_addr']), ('expires', '2d'), ('concat', 'on'), ('concat_max_files', '30'), ('root', '/apps/data/nginx_80'), ('index', 'index.html index.htm')]))]), OrderedDict([('= /50x.html', OrderedDict([('root', '/apps/data/nginx_80')]))]), OrderedDict([('= /nginx_status', OrderedDict([('stub_status', 'on'), ('access_log', 'off'), ('allow', '127.0.0.1'), ('deny', 'all')]))]), OrderedDict([('= /status', OrderedDict([('include', 'fastcgi_params'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('fastcgi_index', 'index.php'), ('fastcgi_pass', '127.0.0.1:9000')]))]), OrderedDict([('~ \\\\.php$', OrderedDict([('root', '/apps/data/nginx_80'), ('fastcgi_pass', '127.0.0.1:9000'), ('fastcgi_index', 'index.php'), ('fastcgi_param', 'SCRIPT_FILENAME $document_root$fastcgi_script_name'), ('include', 'fastcgi_params')]))])]), ('error_page', '500 502 503 504 /50x.html')]))]",
        "------------------------------------------------------------------------------------------",
        "|events                                  |['worker_connections']",
        "------------------------------------------------------------------------------------------"
    ]
}
192.168.1.4 | UNREACHABLE! => {
    "changed": false,
    "msg": "Failed to connect to the host via ssh.",
    "unreachable": true
}

sunzhiguolu

1. perl -0ne 'print $1 while(/"stdout_lines"\N+\n(.*?)(?=\]$)/smg);' f

复制代码

sunzhiguolu

1. perl -nle 'if(/"stdout_lines"/){$P=1;next}if(/\]\Z/){$P=0}print if($P)' f

复制代码

cniter

回复 9# sunzhiguolu

3q,哥