江湖救急, nginx+webpy+fastcgi模式, 多线程模式会服务挂起不响应

isnowran

这个问题折腾了好久, 都想换框架了, 但webpy实在用顺手了, 请众位大神帮忙看看
python fastcgi 代码:

1. 
   
2. #!/usr/local/bin/python2.7
   
3. 
   
4. import web
   
5. 
   
6. class version(object):
   
7.     def GET(self, v):
   
8.         print "in"
   
9.         return "0.1.2"
   
10. 
    
11. urls = ('/(.*)', 'version')
    
12. 
    
13. if __name__ == "__main__":
    
14.     web.config.debug = False
    
15.     app = web.application(urls, globals())
    
16.     app.run()
    

复制代码

运行

1. 
   
2. [binary@APP src]$ ./run.py fcgi 9002
   

复制代码

nginx检查:

1. 
   
2. [root@APP ~]# nginx -t
   
3. nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok
   
4. nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful
   

复制代码

nginx配置:

1. 
   
2. [root@APP ~]# cat /usr/local/nginx/conf/nginx.conf
   
3. worker_processes  1;
   
4. 
   
5. events {
   
6.     worker_connections  1024;
   
7.     use epoll;
   
8. }
   
9. 
   
10. http {
    
11.     include       mime.types;
    
12.     default_type  application/octet-stream;
    
13. 
    
14.     sendfile        on;
    
15. 
    
16.     keepalive_timeout  65;
    
17. 
    
18.     server {
    
19.         listen       80;
    
20.         server_name  localhost;
    
21. 
    
22.         location / {
    
23.             root   html;
    
24.             index  index.html index.htm;
    
25.             include fastcgi_params;
    
26.                 fastcgi_param REQUEST_METHOD $request_method;
    
27.                 fastcgi_param QUERY_STRING $query_string;
    
28.                 fastcgi_param CONTENT_TYPE $content_type;
    
29.                 fastcgi_param CONTENT_LENGTH $content_length;
    
30.                 fastcgi_param GATEWAY_INTERFACE CGI/1.1;
    
31.                 fastcgi_param SERVER_SOFTWARE nginx/$nginx_version;
    
32.                 fastcgi_param REMOTE_ADDR $remote_addr;
    
33.                 fastcgi_param REMOTE_PORT $remote_port;
    
34.                 fastcgi_param SERVER_ADDR $server_addr;
    
35.                 fastcgi_param SERVER_PORT $server_port;
    
36.                 fastcgi_param SERVER_NAME $server_name;
    
37.                 fastcgi_param SERVER_PROTOCOL $server_protocol;
    
38.                 fastcgi_param SCRIPT_FILENAME $fastcgi_script_name;
    
39.                 fastcgi_param PATH_INFO $fastcgi_script_name;
    
40.                 fastcgi_pass 127.0.0.1:9002;
    
41.         }
    
42. 
    
43.         error_page   500 502 503 504  /50x.html;
    
44.         location = /50x.html {
    
45.             root   html;
    
46.         }
    
47.     }
    
48. }
    
49. [root@APP ~]#
    

复制代码

第一次请求测试:

1. 
   
2. [root@APP ~]# curl http://127.0.0.1/
   
3. 0.1.2
   

复制代码

ab1000个并发测试:

1. 
   
2. [root@APP ~]# ab -c1000 -n 1000 http://127.0.0.1/      
   
3. This is ApacheBench, Version 2.3 <$Revision: 655654 $>
   
4. Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
   
5. Licensed to The Apache Software Foundation, http://www.apache.org/
   
6. 
   
7. Benchmarking 127.0.0.1 (be patient)
   
8. apr_socket_recv: Connection reset by peer (104)
   
9. Total of 32 requests completed
   

复制代码

再次请求测试, 就卡死了, 但是, fcgi能打印出"in":

1. 
   
2. [root@APP ~]# curl http://127.0.0.1/
   

复制代码

重启nginx没用, 必须重启fastcgi

为了排除是nginx的问题, 我又用c做fastcgi测试, 就没有问题, 无论并发有多大, 都不会造成无响应, 代码如下:

1. 
   
2. [binary@APP src]$ cat cgi.cpp
   
3. #include <iostream>
   
4. #include <fcgi_stdio.h>
   
5. #include <stdlib.h>
   
6. #include <stdio.h>
   
7. 
   
8. using namespace std;
   
9. 
   
10. int main ()
    
11. {
    
12.         int count = 0;
    
13. 
    
14.         while (FCGI_Accept () >= 0)
    
15.         {
    
16. 
    
17.                 printf ("Content-type:text/html\r\n\r\n");
    
18.                 printf ("<p> Hello FastCGI !  </ p>");
    
19.                 printf ("<br /> Request number = [%d]", ++count);
    
20.                 printf ("<br /> Process ID: %d ", getpid ());
    
21.         }
    
22. 
    
23.         return 0;
    
24. }
    

复制代码

各个组件版本, nginx:1.63. webpy:0.3.7:

1. 
   
2. [binary@APP src]$ nginx -v  
   
3. nginx version: nginx/1.6.3
   
4. [binary@APP src]$
   

复制代码

1. 
   
2. NAME
   
3.     web - web.py: makes web apps (http://webpy.org)
   
4. 
   
5. FILE
   
6.     /usr/local/lib/python2.7/site-packages/web/__init__.py
   
7. 
   
8. PACKAGE CONTENTS
   
9.     application
   
10.     browser
    
11.     contrib (package)
    
12.     db
    
13.     debugerror
    
14.     form
    
15.     http
    
16.     httpserver
    
17.     net
    
18.     python23
    
19.     session
    
20.     template
    
21.     test
    
22.     utils
    
23.     webapi
    
24.     webopenid
    
25.     wsgi
    
26.     wsgiserver (package)
    
27. 
    
28. SUBMODULES
    
29.     __init__
    
30.     web
    
31. 
    
32. DATA
    
33.     __author__ = ['Aaron Swartz <me@aaronsw.com>', 'Anand Chitipothu <anan...
    
34.     __contributors__ = 'see http://webpy.org/changes'
    
35.     __license__ = 'public domain'
    
36.     __version__ = '0.37'
    
37.     config = <Storage {'debug': True, '__doc__': '\nA configu...A0A0J', 'h...
    
38.     ctx = <ThreadedDict {'__doc__': '\nA `storage` object ...`\n   : A str...
    
39.     generators = _Feature((2, 2, 0, 'alpha', 1), (2, 3, 0, 'final', 0), 0)
    
40.     iters = (<type 'list'>, <type 'tuple'>, <type 'set'>, <type 'set'>)
    
41.     re_compile = <web.utils.Memoize instance>
    
42. 
    
43. VERSION
    
44.     0.37
    
45. 
    
46. AUTHOR
    
47.     ['Aaron Swartz <me@aaronsw.com>', 'Anand Chitipothu <anandology@gmail.com>']
    

复制代码

isnowran

找到了问题所在, 应该是flup多线程不加锁导致的, 但不知道为啥, 莫非这个参数会导致flup死锁?:
哪位大侠能深究一下, 给兄弟长长眼吧
在 /usr/local/lib/python2.7/site-packages/web/wsgi.py:

1. 
   
2. def runfcgi(func, addr=('localhost', 8000)):
   
3.     """Runs a WSGI function as a FastCGI server."""
   
4.     import flup.server.fcgi as flups
   
5.     #return flups.WSGIServer(func, multiplexed=True, bindAddress=addr, debug=False).run()
   
6.     # 改为 multiplexed = False
   
7.     return flups.WSGIServer(func, multiplexed=False, bindAddress=addr, debug=False).run()
   

复制代码

影响到的flup代码:
vi /usr/local/lib/python2.7/site-packages/flup/server/fcgi_base.py

1. 
   
2.         if not self.multithreaded:
   
3.             self._appLock.acquire()
   
4.         try:
   
5.             try:
   
6.                 result = self.application(environ, start_response)
   
7.                 try:
   
8.                     for data in result:
   
9.                         if data:
   
10.                             write(data)
    
11.                     if not headers_sent:
    
12.                         write('') # in case body was empty
    
13.                 finally:
    
14.                     if hasattr(result, 'close'):
    
15.                         result.close()
    
16.             except socket.error, e:
    
17.                 if e[0] != errno.EPIPE:
    
18.                     raise # Don't let EPIPE propagate beyond server
    
19.         finally:
    
20.             if not self.multithreaded:
    
21.                 self._appLock.release()
    

复制代码

freshkkalice

我来学习了！！好帖，支持下！