论坛徽章:: 0

电梯直达

1楼 [收藏(0)] [报告]

发表于 2014-09-21 22:15 |只看该作者 |倒序浏览

怎么按 “零基础写py爬虫” http://www.2cto.com/kf/201210/159597.html
这个操作会报这个错呢？

>>> import urllib2
>>> request = urllib2.Request(url="www.baidu.com")
>>> result = urllib2.urlopen(request).read()

Traceback (most recent call last):
  File "<pyshell#9>", line 1, in <module>
result = urllib2.urlopen(request).read()
  File "C:\Python27\lib\urllib2.py", line 127, in urlopen
return _opener.open(url, data, timeout)
  File "C:\Python27\lib\urllib2.py", line 396, in open
protocol = req.get_type()
  File "C:\Python27\lib\urllib2.py", line 258, in get_type
raise ValueError, "unknown url type: %s" % self.__original
ValueError: unknown url type: www.baidu.com
>>> request = urllib2.Request(url="http://www.baidu.com")
>>> result = urllib2.urlopen(request).read()

Traceback (most recent call last):
  File "<pyshell#11>", line 1, in <module>
result = urllib2.urlopen(request).read()
  File "C:\Python27\lib\urllib2.py", line 127, in urlopen
return _opener.open(url, data, timeout)
  File "C:\Python27\lib\urllib2.py", line 404, in open
response = self._open(req, data)
  File "C:\Python27\lib\urllib2.py", line 422, in _open
'_open', req)
  File "C:\Python27\lib\urllib2.py", line 382, in _call_chain
result = func(*args)
  File "C:\Python27\lib\urllib2.py", line 1214, in http_open
return self.do_open(httplib.HTTPConnection, req)
  File "C:\Python27\lib\urllib2.py", line 1184, in do_open
raise URLError(err)
URLError: <urlopen error [Errno 10061] >

请高手支招，这个跟网络有关系吗，我打开百度没问题啊

文库|博客

smalltom30

小富即安

论坛徽章:: 0

2楼 [报告]

发表于 2014-09-21 22:34 |只看该作者

看了下我的网络设置，居然开了一个代理，不可思议，唉
下面这个在公司环境下应该有用，公司是得经过代理上网的
http://stackoverflow.com/questio ... n-http-proxy-python

实战分享：从技术角度谈机器学习入门| 【大话IT】RadonDB低门槛向MySQL集群下战书 | ChinaUnix打赏功能已上线！ | 新一代分布式关系型数据库RadonDB知多少？

smalltom30

小富即安

论坛徽章:: 0

3楼 [报告]

发表于 2014-09-21 22:37 |只看该作者

这个例子也有用：

from urllib import urlopen
from time import ctime
ticks = ('YHOO','EBAY','AMZN')

import csv
URL = 'http://quote.yahoo.com/d/quotes.csv?s=%s&f=sl1c1p2'

print '\nRrices qouted as of:',ctime()
print '\nticker'.ljust(9),'PRICE'.ljust(

,'CHG'.ljust(5),'%AGE'
print '----'.ljust(

,'----'.ljust(

,'----'.ljust(5),'----'
u = urlopen('http://quote.yahoo.com/d/quotes.csv?s=GOOG,EBAY&f=sl1c1p2')

for row in u:
   tick,price,chg,per=row.split(',')
   print eval(tick).ljust(7), \
         ('%.2f' % round(float(price),2)).rjust(7), \
         chg.rjust(6),eval(per.rstrip()).rjust(6)
u.close()

"""
u = urlopen(URL % ','.join(ticks))
for row in csv.DictReader(u):
   print row
f.close()

import csv
u = urlopen ('http://download.finance.yahoo.com/d/quotes.csv?s=GOOG&f=sl1d1t1c1ohgv')
for row in u:
   print row
%s %s % 'abc' 'cde'
round(float(price),2))

"""