Python 抓取网页信息（正则表达式问题） 急求好心人帮忙 在线等 万分感谢！

Cam_Un

急需从网页抓点信息分析，初次接触Python和正则表达式，自己捯饬了几天，但有些地方还是晕晕的，请大神指教。
网页源码如下，想抓取
<a href="/user/ur2509775/">carflo</a> <small>from Texas</small><br>
中的 ur2509775

<div>
<small>1801 out of 2099 people found the following review useful:</small><br>
<a href="/user/ur2509775/"><img class="avatar" src="http://ia.media-imdb.com/images/M/MV5BMTk0MzY5MjExM15BMl5BanBnXkFtZTcwOTQyNjE3OQ@@._V1._SX40_SY40_SS40_.jpg" height=${avatar.image.size} width=${avatar.image.size}></a>
<h2>Tied for the best movie I have ever seen</h2>
<img width="102" height="12" alt="10/10" src="http://i.media-imdb.com/images/showtimes/100.gif"><br>
<b>Author:</b>
<a href="/user/ur2509775/">carflo</a> <small>from Texas</small><br>
<small>26 November 2003</small><br>

</div>

已尝试使用如下代码抓取，但是抓到的都是空值，没有输出显示，就是啥都没抓到...
j=0
for i in range(0, 20, 10):  
    url = 'xxx'  
    hash = 'start=%d' % i  
    url = url + hash  
    content = urllib2.urlopen(url).read()
    name = re.findall(r' <a href="/user/（.*?）/">.*?</a> <small>.*?</small><br>', content)
    for i in range(0,len(name)):  
        j = j+1
        print mid
print j
print 'done'

输出：
>>>
0
done
>>>


怀疑是正则表达式的问题，但不确定，试了几次也木有成功，急求大神帮助！！万分感谢！！

whitelotus19

看看这样可以吗

1. #!/usr/bin/env python
   
2. # -*- coding: utf-8 -*-
   
3. 
   
4. import re
   
5. 
   
6. def fa():
   
7.     text='''
   
8. <div>
   
9. <small>1801 out of 2099 people found the following review useful:</small><br>
   
10. <a href="/user/ur2509775/"><img class="avatar" src="http://ia.media-imdb.com/images/M/MV5BMTk0MzY5MjExM15BMl5BanBnXkFtZTcwOTQyNjE3OQ@@._V1._SX40_SY40_SS40_.jpg" height=${avatar.image.size} width=${avatar.image.size}></a>
    
11. <h2>Tied for the best movie I have ever seen</h2>
    
12. <img width="102" height="12" alt="10/10" src="http://i.media-imdb.com/images/showtimes/100.gif"><br>
    
13. <b>Author:</b>
    
14. <a href="/user/ur2509775/">carflo</a> <small>from Texas</small><br>
    
15. <small>26 November 2003</small><br>
    
16. 
    
17. </div>
    
18. 
    
19.         '''
    
20.     print '\n'.join(re.findall(r'<a href="/user/([\d\w]+)/">\w+</a>',text))
    
21. 
    
22. fa()
    

复制代码

Cam_Un

回复 2# whitelotus19


    谢谢！我试了这段是可以的，可是我是想从这个页面（http://www.imdb.com/title/tt0111161/reviews?start=0）直接抓出评价人的id和评价分数（评价分数不为空时），评价分数是可以抓出来的，但是用户id一直抓不到。我刚刚把你写的正则表达式贴进我的代码里试了一下，但抓出的还是空。

我的全部代码是：

1. # coding=utf-8 ##  
   
2. import urllib2  
   
3. import re  
   
4. import sys  
   
5.   
   
6. type = sys.getfilesystemencoding()  
   
7. j = 0  
   
8. for i in range(0, 20, 10):  
   
9.     url = 'http://www.imdb.com/title/tt0111161/reviews?'  
   
10.     hash = 'start=%d' % i  
    
11.     url = url + hash  
    
12.     content = urllib2.urlopen(url).read()
    
13.     content = content.decode('UTF-8','ignore')
    
14.     # 读取用户编号  
    
15.     name = re.findall(r' <a href="/user/（.*?）/">.*?</a> <small>.*?</small><br>', content)
    
16.     # 读取分数  
    
17.     score = re.findall(r'<img width="102" height="12" alt="(.*?)/10" .*?>', content)
    
18.     for i in range(0,len(name)):  
    
19.         if score[i]!="":   
    
20.             j = j + 1                 
    
21.             print mid[i]+"+"+score[i]   
    
22. print ('共有'+ str(j) +'条').decode('UTF-8','ignore')  
    
23. print 'done'
    

复制代码

看样子真的是正则表达式的问题，求大神看看有没有救，谢谢！

whitelotus19

不知道是不是这样子？

1. #!/usr/bin/env python
   
2. # -*- coding: utf-8 -*-
   
3. 
   
4. import re
   
5. 
   
6. def fa():
   
7.     text='''
   
8.         <div>
   
9.         <small>865 out of 1160 people found the following review useful:</small><br>
   
10.         <a href="/user/ur1285640/"><img class="avatar" src="http://ia.media-imdb.com/images/M/MV5BMjI2NDEyMjYyMF5BMl5BanBnXkFtZTcwMzM3MDk0OQ@@._SX40_SY40_SS40_.jpg" height=${avatar.image.size} width=${avatar.image.size}></a>
    
11.         <h2>The best story ever told on film</h2>
    
12.         <img width="102" height="12" alt="8/10" src="http://i.media-imdb.com/images/showtimes/80.gif"><br>
    
13.         <b>Author:</b>
    
14.         <a href="/user/ur1285640/">Si Cole</a><br>
    
15.         <small>3 August 2001</small><br>
    
16.         <p><b>*** This review may contain spoilers ***</b></p>
    
17. 
    
18.         </div>
    
19.         <p>
    
20. 
    
21.         I believe that this film is the best story ever told on film, and I'm about
    
22.         to tell you why.<br><br>Tim Robbins plays Andy Dufresne, a city banker, wrongfully convicted of
    
23.         murdering his wife and her lover. He is sent to Shawshank Prison in 1947
    
24.         and
    
25.         receives a double life sentence for the crime. Andy forms an unlikely
    
26.         friendship with &quot;Red&quot; (Morgan Freeman), the man who knows how to get
    
27.         things.
    
28.         Andy faces many trials in prison, but forms an alliance with the wardens
    
29.         because he is able to use his banking experience to help the corrupt
    
30.         officials amass personal fortunes. The story unfolds....<br><br>I was so impressed with how every single subplot was given a great deal of
    
31.         respect and attention from the director. The acting was world-class. I have
    
32.         never seen Tim Robbins act as well since, Morgan Freeman maybe (e.g.
    
33.         Seven).
    
34.         The twists were unexpected, an although this film had a familiar feel, it
    
35.         wasn't even slightly pretentious or cliched, it was original. The
    
36.         cinematography was grand and expressive. It gave a real impression of the
    
37.         sheer magnitude of this daunting prison.<br><br>But the one thing which makes THE SHAWSHANK REDEMPTION stand above all
    
38.         other
    
39.         films, is the attention given to the story. The film depends on the story
    
40.         and the way in which it unravels. It's a powerful, poignant,
    
41.         thought-provoking, challenging film like no other. If Andy were to comment
    
42.         on this film, I think he might say: &quot;Get busy watching, or get busy dying.&quot;
    
43.         Take his advice.<br><br>Thoroughly recommended.
    
44.         </p>
    
45. 
    
46.         <div class="yn" id="ynd_348829">
    
47. 
    
48.         <form method="get"
    
49. 
    
50.          action="/register/login"
    
51. 
    
52.         >
    
53.         Was the above review useful to you?
    
54. 
    
55.         <input class="click linkasbutton-secondary" type="submit"
    
56.          name="ynb_348829_yes" value="Yes"
    
57. 
    
58.          rel="login"
    
59. 
    
60.         >
    
61.         <input class="click linkasbutton-secondary" type="submit"
    
62.          name="ynb_348829_no" value="No"
    
63. 
    
64.          rel="login"
    
65. 
    
66.         >
    
67. 
    
68.         </form>
    
69. 
    
70.         </div>
    
71. 
    
72.         <hr noshade="1" size="1" width="50%" align="center">
    
73. 
    
74.         <div>
    
75.         <small>583 out of 721 people found the following review useful:</small><br>
    
76.         <a href="/user/ur0257957/"><img class="avatar" src="http://ia.media-imdb.com/images/M/MV5BMjI2NDEyMjYyMF5BMl5BanBnXkFtZTcwMzM3MDk0OQ@@._SX40_SY40_SS40_.jpg" height=${avatar.image.size} width=${avatar.image.size}></a>
    
77.         <h2>The Shawshank Redemption</h2>
    
78.         <img width="102" height="12" alt="10/10" src="http://i.media-imdb.com/images/showtimes/100.gif"><br>
    
79.         <b>Author:</b>
    
80.         <a href="/user/ur0257957/">Tim Cox</a> <small>from Marietta, OH</small><br>
    
81.         <small>25 March 1999</small><br>
    
82. 
    
83.         </div>
    
84.         <p>
    
85. 
    
86.         One of the finest films made in recent years. It's a poignant story
    
87.         about hope. Hope gets me. That's what makes a film like this more than a
    
88.         movie. It tells a lesson about life.
    
89.         Those are the films people talk about 50 or even 100 years from you. It's
    
90.         also a story for freedom. Freedom from isolation,
    
91.         from rule, from bigotry and hate. Freeman and Robbins are
    
92.         majestic in their performances. Each learns from the other.
    
93.         Their relationship is strong and you feel that from the first
    
94.         moment they make contact with one another. There is also a
    
95.         wonderful performance from legend James Whitmore as Brooks.<br><br>He shines when it is his time to go back into the world,
    
96.         only
    
97.         to find that the world grew up so fast he never even got
    
98.         a chance to blink. Stephen King's story is brought to the
    
99.         screen with great elegance and excitement. It is an extraordinary motion
    
100.         that people &quot;will&quot; be talking about in
     
101.         50 or 100 years.  
     
102.         </p>
     
103. 
     
104.         <div class="yn" id="ynd_348222">
     
105. 
     
106.         <form method="get"
     
107. 
     
108.          action="/register/login"
     
109. 
     
110.         >
     
111.         Was the above review useful to you?
     
112. 
     
113.         <input class="click linkasbutton-secondary" type="submit"
     
114.          name="ynb_348222_yes" value="Yes"
     
115. 
     
116.          rel="login"
     
117. 
     
118.         >
     
119.         <input class="click linkasbutton-secondary" type="submit"
     
120.          name="ynb_348222_no" value="No"
     
121. 
     
122.          rel="login"
     
123. 
     
124.         >
     
125. 
     
126.         </form>
     
127. 
     
128.         </div>
     
129. 
     
130.         <hr noshade="1" size="1" width="50%" align="center">
     
131. 
     
132.         <div>
     
133.         <small>574 out of 706 people found the following review useful:</small><br>
     
134.         <a href="/user/ur0611718/"><img class="avatar" src="http://ia.media-imdb.com/images/M/MV5BMjI2NDEyMjYyMF5BMl5BanBnXkFtZTcwMzM3MDk0OQ@@._SX40_SY40_SS40_.jpg" height=${avatar.image.size} width=${avatar.image.size}></a>
     
135.         <h2>Powerful</h2>
     
136.         <img width="102" height="12" alt="10/10" src="http://i.media-imdb.com/images/showtimes/100.gif"><br>
     
137.         <b>Author:</b>
     
138.         <a href="/user/ur0611718/">Thomas McFadden (tmac4)</a> <small>from Houston, Texas</small><br>
     
139.         <small>25 July 2001</small><br>
     
140. 
     
141.         </div>
     
142.         '''
     
143.     for x in re.findall(r'<img width="\d+" height="\d+" alt="(\d+)/\d+" src=.*?<a href="/user/([\d\w]+)/">[^<]+</a>',text,re.DOTALL):
     
144.         print x
     
145. 
     
146. fa()
     

复制代码

Cam_Un

回复 4# whitelotus19


    可以了！太感谢了！！！

lizhihui_kevin

pattern_match = re.compile(r'<a href="/user/(.*)/">(.*)</a> <small>(.*)</small><br>')
results = re.findall(pattern_match, content)
if results:
    print results