网页抓取问题求助

anna_bi

1. import urllib2
   
2. import re
   
3. url =“https://sph.uth.edu/retnet/disease.htm”
   
4. request = urllib2.Request(url)
   
5. response = urllib2.urlopen(request)
   
6. print response.read()

复制代码

这个网址如何抓取啊，提示报错啊~谢谢大神

iamlimeng

1. #!/usr/bin/perl -w
   
2. 
   
3. use LWP::UserAgent;
   
4. my $ua = LWP::UserAgent->new(keep_alive=>1);
   
5. my $request = HTTP::Request->new(GET=>'https://sph.uth.edu/retnet/disease.htm');
   
6. my $response = $ua->request($request);
   
7. if ($response) {
   
8.         open (OUT,">disease.htm");
   
9.         print OUT $response->content;
   
10.         close OUT;
    
11.         print "Succeed!\n";
    
12. }
    
13. else  { print "Failed!\n"; }
    
14. <STDIN>;

复制代码

LWP-Protocol-https这个包先更新一下，旧版的不行！

anna_bi

回复 2# iamlimeng

好的，谢谢大神~