
平台论坛博客文库

› 论坛 › 程序设计 › Shell › 求一个shell中一段的编写

[文本处理] 求一个shell中一段的编写 [复制链接]

xiaoyawl

白手起家

论坛徽章:: 0

电梯直达

1楼 [收藏(0)] [报告]

发表于 2012-10-04 01:17 |只看该作者 |倒序浏览

<tr>
<td class="rowfollow nowrap" valign="middle" style='padding: 0px'><a href="?cat=402"><img class="c_tvseries" src="pic/cattrans.gif" alt="电视剧(TV Series)" title="电视剧(TV Series)" style="background-image: url(pic/category/chd/nanosofts/catsprites.png);" /></a><img class="si_riph264" src="pic/cattrans.gif" style="background-image: url(pic/category/chd/nanosofts/additional/addsprites.gif);" alt="Encode/x.264" title="Encode/x.264" /></td>
<td class="rowfollow" width="100%" align="left"><table class="torrentname" width="100%"><tr><td class="embedded"><a title="The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS" href="details.php?id=120814&hit=1">The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS</a> 极速前进（第二十一季第1集） [iTunes版] <img class="pro_free" src="pic/trans.gif" alt="Free" onmouseover="domTT_activate(this, event, 'content', '免费限时: 5时45分', 'trail', false, 'delay',500,'lifetime',3000,'fade','both','styleClass','niceTitle', 'fadeMax',87, 'maxWidth', 300);" /> (限时: 5时45分)</td><td width="60" class="embedded" style="text-align: right; " valign="middle"><a href="download.php?id=120814"><img class="download" src="pic/trans.gif" style="margin: 0 2px 3px 0;" alt="download" title="下载本种" /></a><a id="rssdown32" href="javascript: rssdown(120814,32);" ><img style="margin: 0 2px 3px 0;" class="rssdown" src="pic/trans.gif" alt="Rss Down" title="RSS下载" /></a><a id="bookmark32" href="javascript: bookmark(120814,32);" ><img style="margin: 0 2px 3px 0;" class="delbookmark" src="pic/trans.gif" alt="Unbookmarked" title="收藏" /></a> <a href="http://www.imdb.com/title/tt0285335">IMDb: 7.6</a></td>
</tr></table></td><td class="rowfollow"><a href="comment.php?action=add&pid=120814&type=torrent" title="添加评论">0</a></td><td class="rowfollow nowrap">14分</td><td class="rowfollow">1.34 GB</td><td class="rowfollow" align="center"><a href="details.php?id=120814&hit=1&dllist=1#seeders">1</a></td>
<td class="rowfollow"><a href="details.php?id=120814&hit=1&dllist=1#leechers">9</a></td>
<td class="rowfollow">0</td>
<td class="rowfollow"><a href="userdetails.php?id=83776" class='ExtremeUser_Name'>feidaoshou</a></td>
</tr>
<tr>
<td class="rowfollow nowrap" valign="middle" style='padding: 0px'><a href="?cat=405"><img class="c_anime" src="pic/cattrans.gif" alt="动画/动漫(Animations)" title="动画/动漫(Animations)" style="background-image: url(pic/category/chd/nanosofts/catsprites.png);" /></a><img class="si_bdh264" src="pic/cattrans.gif" style="background-image: url(pic/category/chd/nanosofts/additional/addsprites.gif);" alt="Blu-ray/H.264" title="Blu-ray/H.264" /></td>
<td class="rowfollow" width="100%" align="left"><table class="torrentname" width="100%"><tr><td class="embedded"><a title="Fullmetal Alchemist Brotherhood BDrip 1920x1080 Vol 01-Vol 16 Fin x264 AAC-FN@Lv 1" href="details.php?id=120813&hit=1">Fullmetal Alchemist Brotherhood BDrip 1920x1080 Vol 01-Vol 16 Fin x264 AAC-FN@Lv 1</a> 钢之炼金术师2009 <img class="pro_50pctdown" src="pic/trans.gif" alt="50%" title="50%" /></td><td width="60" class="embedded" style="text-align: right; " valign="middle"><a href="download.php?id=120813"><img class="download" src="pic/trans.gif" style="margin: 0 2px 3px 0;" alt="download" title="下载本种" /></a><a id="rssdown33" href="javascript: rssdown(120813,33);" ><img style="margin: 0 2px 3px 0;" class="rssdown" src="pic/trans.gif" alt="Rss Down" title="RSS下载" /></a><a id="bookmark33" href="javascript: bookmark(120813,33);" ><img style="margin: 0 2px 3px 0;" class="delbookmark" src="pic/trans.gif" alt="Unbookmarked" title="收藏" /></a></td>
</tr></table></td><td class="rowfollow"><a href="comment.php?action=add&pid=120813&type=torrent" title="添加评论">0</a></td><td class="rowfollow nowrap">25分</td><td class="rowfollow">50.55 GB</td><td class="rowfollow" align="center"><a href="details.php?id=120813&hit=1&dllist=1#seeders">1</a></td>
<td class="rowfollow"><a href="details.php?id=120813&hit=1&dllist=1#leechers">2</a></td>
<td class="rowfollow">0</td>
<td class="rowfollow"><a href="userdetails.php?id=116047" class='User_Name'>YUEchan</a></td>
</tr>
<tr>
<td class="rowfollow nowrap" valign="middle" style='padding: 0px'><a href="?cat=410"><img class="c_pad" src="pic/cattrans.gif" alt="iPad影视(iP/iPad)" title="iPad影视(iP/iPad)" style="background-image: url(pic/category/chd/nanosofts/catsprites.png);" /></a><img class="si_remuxh264" src="pic/cattrans.gif" style="background-image: url(pic/category/chd/nanosofts/additional/addsprites.gif);" alt="Remux/H.264" title="Remux/H.264" /></td>
<td class="rowfollow" width="100%" align="left"><table class="torrentname" width="100%"><tr><td class="embedded"><a title="And God Created Woman 1956 BluRay 720p iPad AAC x264-CHDPAD" href="details.php?id=120812&hit=1">And God Created Woman 1956 BluRay 720p iPad AAC x264-CHDPAD</a> 上帝创造女人[原盘制作德语]</td><td width="60" class="embedded" style="text-align: right; " valign="middle"><a href="download.php?id=120812"><img class="download" src="pic/trans.gif" style="margin: 0 2px 3px 0;" alt="download" title="下载本种" /></a><a id="rssdown34" href="javascript: rssdown(120812,34);" ><img style="margin: 0 2px 3px 0;" class="rssdown" src="pic/trans.gif" alt="Rss Down" title="RSS下载" /></a><a id="bookmark34" href="javascript: bookmark(120812,34);" ><img style="margin: 0 2px 3px 0;" class="delbookmark" src="pic/trans.gif" alt="Unbookmarked" title="收藏" /></a></td>
</tr></table></td><td class="rowfollow"><a href="details.php?id=120812&hit=1&cmtpage=1#startcomments" onmouseover="domTT_activate(this, event, 'content', document.getElementById('lastcom_34'), 'trail', false, 'delay', 500,'lifetime',3000,'fade','both','styleClass','niceTitle','fadeMax', 87,'maxWidth', 400);">1</a></td><td class="rowfollow nowrap">36分</td><td class="rowfollow">1.40 GB</td><td class="rowfollow" align="center"><a href="details.php?id=120812&hit=1&dllist=1#seeders">1</a></td>
<td class="rowfollow"><a href="details.php?id=120812&hit=1&dllist=1#leechers">61</a></td>
<td class="rowfollow">0</td>
<td class="rowfollow"><a href="userdetails.php?id=23554" class='User_Name'>wgymyz520</a></td>
</tr>

复制代码

假如我有一个php文件文件内容如上，我现在想过提取一个url后缀的ID
条件：
每个<tr>……<tr/>段查看有没有<img class="pro_free" src="pic/trans.gif" alt="Free"
如果有，则把此段中的<a title="The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS" href="details.php?id=120814&hit=1"> 120814提取出来并生成一个wget的下载连接 (wget -O The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS.torrent http://www.123.com/download.php?id=120814)
下载连接中的urlID是变量保存的种子名也是变量了

求大神帮忙，小白shell只会最最简单的，这样高级的想实现但是不会

文库|博客

winway1988

家境小康

论坛徽章:: 1

2楼 [报告]

发表于 2012-10-04 09:30 |只看该作者

本帖最后由 winway1988 于 2012-10-04 14:26 编辑

#! /bin/bash
#
sed -nr ':a;\,<tr>.*</tr>,!{N;$!ba};:b;s#<tr>(.*<tr>)#<TR>\1#;tb;h;s#.*(<tr>.*</tr>).*#\1#;\,<tr>.*<img class="pro_free" src="pic/trans.gif" alt="Free".*</tr>,s#<tr>.*<a title="([^"]*)" *href="details\.php\?id=([0-9]*)\&hit=1">.*</tr>#\1:\2#p;g;s#<tr>.*</tr>##;s#<TR>#<tr>#g;$!ba' $1 | { OIFS="$IFS";IFS=:';while read title id;do echo "wget -O ${title}.torrent http://www.123.com/download.php?id=${id}";done;IFS="$OIFS"; }

复制代码

$ cat test.sh
#! /bin/bash
#
sed -nr ':a;\,<tr>.*</tr>,!{N;$!ba};:b;s#<tr>(.*<tr>)#<TR>\1#;tb;h;s#.*(<tr>.*</tr>).*#\1#;\,<tr>.*<img class="pro_free" src="pic/trans.gif" alt="Free".*</tr>,s#<tr>.*<a title="([^"]*)" *href="details\.php\?id=([0-9]*)\&hit=1">.*</tr>#\1:\2#p;g;s#<tr>.*</tr>##;s#<TR>#<tr>#g;$!ba' $1 | { OIFS="$IFS";IFS=:';while read title id;do echo "wget -O ${title}.torrent http://www.123.com/download.php?id=${id}";done;IFS="$OIFS"; }
$ ./test.sh urfile
wget -O The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS.torrent http://www.123.com/download.php?id=120814

复制代码

实战分享：从技术角度谈机器学习入门| 【大话IT】RadonDB低门槛向MySQL集群下战书 | ChinaUnix打赏功能已上线！ | 新一代分布式关系型数据库RadonDB知多少？

xiaoyawl

白手起家

论坛徽章:: 0

3楼 [报告]

发表于 2012-10-04 12:26 |只看该作者

回复 2# winway1988

谢谢了但是我测试运行是错误的

123.sh: line 8: unexpected EOF while looking for matching `''
123.sh: line 9: syntax error: unexpected end of file

复制代码

提示的错误两行就是您给我的那个sed段 line9 没用总共就8行

yinyuemi

大富大贵

论坛徽章:: 2

4楼 [报告]

发表于 2012-10-04 13:58 |只看该作者

回复 3# xiaoyawl

awk '{s=s $0}END{for(i=1;i<=split(s,a,/<tr>|<\/tr>/);i++)if(a[i]~/<img class="pro_free" src="pic\/trans.gif" alt="Free"/){print gensub(/^<[^<]+<a title="([^"]+)" +href="details.php\?(id=[^&]+).*/,"wget -O \\1.torrent http://www.123.com/download.php?\\2",1,a[i])}}' file
wget -O The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS.torrent http://www.123.com/download.php?id=120814

复制代码

L_kernel

巨富豪门

论坛徽章:: 1

5楼 [报告]

发表于 2012-10-07 23:04 |只看该作者

$ awk 'BEGIN{RS="";FS="<[/]tr>"}{for(i=1;i<=NF;i++)if($i~/<img class="pro_free" src="pic\/trans.gif" alt="Free"/)print gensub(/.*\<a title="([^"]+)"[^>]+id=([0-9]+).*/,"wget -O \\1.torrent http://www.123.com/download.php?id=\\2","G",$i)}' log.txt
wget -O The Amazing Race S21E01 720p WEB-DL AAC2.0 H.264-KiNGS.torrent http://www.123.com/download.php?id=120814

复制代码

疑惑，到时候wget如何运行？文件名当中有空格。
我觉得是不是应该用double quota引起来？