perl lwp模块抓取网页

Bisn

http://www.molecular-networks.com/online_demos/corina_demo.html
这个网址是提交小分子的化学式（N[C@@H](C)C(=O)O）后能生成 3D 结构，因需要生成很多的小分子3D结构，想写程序生成，望高手指点！

提交后会跳转到页面

http://www.molecular-networks.co ... esultname=L-alanine

然后到页面

http://www.molecular-networks.com/tmp/corina000AnNYWn.html


我只需要 Download 3D structure as PDB file 的链接就ok了


不知道这个perl能抓取到吗？

changejun

这个重点在第一步

如何用程序进行提交验证　this is the key!

xti9er

原帖由 changejun 于 2009-5-21 16:06 发表
这个重点在第一步

如何用程序进行提交验证　this is the key!

就别管他是XXXXX步，抓数据报，看提交了啥东西，懒一点儿，直接socket连接。

Bisn

可否具体点？

churchmice

firefox live http headers

Bisn

没什么利用价值
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
http://www.molecular-networks.com/cgi-bin/corina/gen3dmolnet.tcl

POST /cgi-bin/corina/gen3dmolnet.tcl HTTP/1.1
Host: www.molecular-networks.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us
Accept-Encoding: gzip,deflate
Accept-Charset: gb2312,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
Referer: http://www.molecular-networks.com/online_demos/corina_demo.html
Content-Type: application/x-www-form-urlencoded
Content-Length: 62
smiles=N%5BC%40%40H%5D%28C%29C%28%3DO%29O&resultname=L-alanine
HTTP/1.x 302 Moved Temporarily
Date: Fri, 22 May 2009 05:16:04 GMT
Server: Apache/2.2.4 (Linux/SUSE)
Pragma: no-cache
Location: http://www.molecular-networks.com/tmp/corina000EOVy6Z.html
Content-Length: 0
Keep-Alive: timeout=15, max=100
Connection: Keep-Alive
Content-Type: text/html
----------------------------------------------------------
http://www.molecular-networks.com/tmp/corina000EOVy6Z.html

GET /tmp/corina000EOVy6Z.html HTTP/1.1
Host: www.molecular-networks.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us
Accept-Encoding: gzip,deflate
Accept-Charset: gb2312,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
Referer: http://www.molecular-networks.com/online_demos/corina_demo.html

HTTP/1.x 200 OK
Date: Fri, 22 May 2009 05:16:05 GMT
Server: Apache/2.2.4 (Linux/SUSE)
X-Powered-By: PHP/5.2.9
Keep-Alive: timeout=15, max=99
Connection: Keep-Alive
Transfer-Encoding: chunked
Content-Type: text/html
----------------------------------------------------------

这个页面不能访问的 http://www.molecular-networks.com/cgi-bin/corina/gen3dmolnet.tcl