Problems with the server stalling out. Setting up debuging.
215 views
Skip to first unread message
Jason Brower
Feb 2, 2014, 1:14:21 PM2/2/14
to web2py-users
It seems that I have an issue I can't resolve.
Every once in a while at seemingly the worst and most random times, the
service will stall out. It simply doesn't respond to anything.
Going into the computer and running htop shows that the computer is
doing nothing.
I am not running the server with a compiled version of my code.
I am running:
2.8.2-stable+timestamp.2013.11.28.13.54.07
(Running on Apache/2.2.22 (Ubuntu), Python 2.7.3)
The application does only basic uploading and loading of a single item.
Here is an example of the webplayer:
melodigram.com/melodigram/default/gram/b662a1da-8c2b-11e3-b0dc-1231390a0101
I can run F5 reloads on the site for 15 minutes straight, not have
anyone access the system then then try to load something, be it the
admin interface or the page I show you here and it site for a very long
time. The time it is unresponsive seems random, but that's because I
haven't discovered how to replicate the problem.
If I restart apache and try, it seems to work every time.
This issue is very annoying and I seem to hit this kind of thing in many
of the sites I am making and working on. We really need to figure out
what is going on.
I am running ubuntu 12.04 and set up the server using the scripts found
in web2py for postgres and so forth. I am using postgres and the issue
happens in both sqlite and postgres database setups.
I can't seem to replicate the issue when running locally with rocket
rather than apache.
The amazon server is a Medium instance. I thought maybe it was because
of the microinstance issues, but I seem to be wrong?
Any ideas into this?
Our app goes live next week and I really hope to resolve this issue.
The server is currently stalling out and has actually stopped mid page.
I have the htop running on the server on the right.
Last, is how do you think I could setup the server to better see what is
going on and solve the issue. It's really annoying knowing how simple
my service is, but seeing how very slow or inresponsive the site is.
BR,
Jason Brower
Every once in a while at seemingly the worst and most random times, the
service will stall out. It simply doesn't respond to anything.
Going into the computer and running htop shows that the computer is
doing nothing.
I am not running the server with a compiled version of my code.
I am running:
2.8.2-stable+timestamp.2013.11.28.13.54.07
(Running on Apache/2.2.22 (Ubuntu), Python 2.7.3)
The application does only basic uploading and loading of a single item.
Here is an example of the webplayer:
melodigram.com/melodigram/default/gram/b662a1da-8c2b-11e3-b0dc-1231390a0101
I can run F5 reloads on the site for 15 minutes straight, not have
anyone access the system then then try to load something, be it the
admin interface or the page I show you here and it site for a very long
time. The time it is unresponsive seems random, but that's because I
haven't discovered how to replicate the problem.
If I restart apache and try, it seems to work every time.
This issue is very annoying and I seem to hit this kind of thing in many
of the sites I am making and working on. We really need to figure out
what is going on.
I am running ubuntu 12.04 and set up the server using the scripts found
in web2py for postgres and so forth. I am using postgres and the issue
happens in both sqlite and postgres database setups.
I can't seem to replicate the issue when running locally with rocket
rather than apache.
The amazon server is a Medium instance. I thought maybe it was because
of the microinstance issues, but I seem to be wrong?
Any ideas into this?
Our app goes live next week and I really hope to resolve this issue.
The server is currently stalling out and has actually stopped mid page.
I have the htop running on the server on the right.
Last, is how do you think I could setup the server to better see what is
going on and solve the issue. It's really annoying knowing how simple
my service is, but seeing how very slow or inresponsive the site is.
BR,
Jason Brower
Encompass solutions
Feb 2, 2014, 2:52:21 PM2/2/14
to web...@googlegroups.com
To give more information I looked in the error logs and found the following:
I am not sure if it is related, but it seems to happen around the same time as the error.
Ideas?
-----------------------------------------
[Sun Feb 02 17:38:52 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:38:52 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:38:52 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:38:58 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:29 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:29 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:35 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:42 2014] [error] [client 83.145.241.129] (70007)The timeout specified has expired: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10726): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10726): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:42:46 2014] [error] [client 83.145.241.129] (70007)The timeout specified has expired: mod_wsgi (pid=10726): Unable to get bucket brigade for request.
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:44:37 2014] [error] [client 83.145.241.129] (70007)The timeout specified has expired: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
avconv version 0.8.9-4:0.8.9-0ubuntu0.12.04.1, Copyright (c) 2000-2013 the Libav developers
built on Nov 9 2013 19:08:00 with gcc 4.6.3
.....
I am not sure if it is related, but it seems to happen around the same time as the error.
Ideas?
-----------------------------------------
[Sun Feb 02 17:38:52 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:38:52 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:38:52 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:38:58 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:29 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:29 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:35 2014] [error] [client 83.145.241.129] Script timed out before returning headers: wsgihandler.py
[Sun Feb 02 17:40:42 2014] [error] [client 83.145.241.129] (70007)The timeout specified has expired: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:44 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:46 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10726): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:48 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:52 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10726): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:54 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] (70014)End of file found: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:40:56 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:42:46 2014] [error] [client 83.145.241.129] (70007)The timeout specified has expired: mod_wsgi (pid=10726): Unable to get bucket brigade for request.
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:42:48 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
[Sun Feb 02 17:44:37 2014] [error] [client 83.145.241.129] (70007)The timeout specified has expired: mod_wsgi (pid=10727): Unable to get bucket brigade for request.
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] mod_wsgi (pid=10725): Exception occurred processing WSGI script '/home/www-data/web2py/wsgihandler.py'.
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] Traceback (most recent call last):
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/main.py", line 532, in wsgibase
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] if request.body:
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] File "/home/www-data/web2py/gluon/globals.py", line 252, in body
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] raise HTTP(400, "Bad Request - HTTP body is incomplete")
[Sun Feb 02 17:44:39 2014] [error] [client 83.145.241.129] HTTP: 400 BAD REQUEST
avconv version 0.8.9-4:0.8.9-0ubuntu0.12.04.1, Copyright (c) 2000-2013 the Libav developers
built on Nov 9 2013 19:08:00 with gcc 4.6.3
.....
Niphlod
Feb 2, 2014, 3:09:18 PM2/2/14
to web...@googlegroups.com
seems related to apache and timeouts.......
https://groups.google.com/forum/#!topic/modwsgi/UqmMeV0lhC8
BTW: odd errors and unforgiving syntax complexity is what moved me (among many others) to nginx+uwsgi. Things there are far more understandable, debuggable and reproduceable.
BTW2: how many processes and threads are running for web2py ? How much time a request takes to be processed ?
https://groups.google.com/forum/#!topic/modwsgi/UqmMeV0lhC8
BTW: odd errors and unforgiving syntax complexity is what moved me (among many others) to nginx+uwsgi. Things there are far more understandable, debuggable and reproduceable.
BTW2: how many processes and threads are running for web2py ? How much time a request takes to be processed ?
Simon Ashley
Feb 2, 2014, 4:32:34 PM2/2/14
to
Spin up an instance on Rackspace/ Limode/ Digital Ocean and compare the result.
(have had unpleasant experiences with AWS and elements of this have a similar smell)
Jason Brower
Feb 2, 2014, 4:54:18 PM2/2/14
to web...@googlegroups.com
Have others had issues similar to this on Amazon?
Takes a bit of effort to do such things, and eventually I will need many
of the services amazon provide to import the sites abilities. Like S3
and the Transcoding services. It would be a big step to move away from
Amazon.
Additionally, I think the issue should seriously be looked at because I
use Amazon on many sites my business runs and it would be a large
annoyance to have to transition just one of them.
BR,
Jason
On Sun, 2014-02-02 at 13:26 -0800, Simon Ashley wrote:
> Spin up an instance on Rackspace/ Linmode/ Digital Ocean and compare
> Resources:
> - http://web2py.com
> - http://web2py.com/book (Documentation)
> - http://github.com/web2py/web2py (Source code)
> - https://code.google.com/p/web2py/issues/list (Report Issues)
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "web2py-users" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/web2py/BZQF88jug54/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> web2py+un...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
Takes a bit of effort to do such things, and eventually I will need many
of the services amazon provide to import the sites abilities. Like S3
and the Transcoding services. It would be a big step to move away from
Amazon.
Additionally, I think the issue should seriously be looked at because I
use Amazon on many sites my business runs and it would be a large
annoyance to have to transition just one of them.
BR,
Jason
On Sun, 2014-02-02 at 13:26 -0800, Simon Ashley wrote:
> Spin up an instance on Rackspace/ Linmode/ Digital Ocean and compare
> the result.
> (have had unpleasant experiences with AWS and elements of this have a
> similar smell)
>
>
> --
> (have had unpleasant experiences with AWS and elements of this have a
> similar smell)
>
>
> Resources:
> - http://web2py.com
> - http://web2py.com/book (Documentation)
> - http://github.com/web2py/web2py (Source code)
> - https://code.google.com/p/web2py/issues/list (Report Issues)
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "web2py-users" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/web2py/BZQF88jug54/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> web2py+un...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
Jason Brower
Feb 2, 2014, 4:58:36 PM2/2/14
to web...@googlegroups.com
Attached is a quick report I did and it has some results. They seemed
pretty normal to me.
NGIX would be an option, though it would take some time to move to that
server type. I estimate a days work if I have the script for the
installation which I think exists.
BR,
Jason Brower
pretty normal to me.
NGIX would be an option, though it would take some time to move to that
server type. I estimate a days work if I have the script for the
installation which I think exists.
BR,
Jason Brower
Simon Ashley
Feb 2, 2014, 5:00:53 PM2/2/14
to web...@googlegroups.com
Not saying to move, but to identify where it could be infrastructure related. If so, you can take it up with Amazon support.
Message has been deleted
Simon Ashley
Feb 2, 2014, 7:48:49 PM2/2/14
to web...@googlegroups.com
One quick thing that could/ may rule it in or out is to change data centres.
For example, in this part of the world, I would go for the SG rather than the local AU data centre.
Ricardo Pedroso
Feb 3, 2014, 2:08:05 PM2/3/14
to web...@googlegroups.com
On Sun, Feb 2, 2014 at 6:14 PM, Jason Brower <enco...@gmail.com> wrote:
It seems that I have an issue I can't resolve.
Every once in a while at seemingly the worst and most random times, the
service will stall out. It simply doesn't respond to anything.
Going into the computer and running htop shows that the computer is
doing nothing.
I am not running the server with a compiled version of my code.
I am running:
2.8.2-stable+timestamp.2013.11.28.13.54.07
(Running on Apache/2.2.22 (Ubuntu), Python 2.7.3)
The application does only basic uploading and loading of a single item.
Here is an example of the webplayer:
melodigram.com/melodigram/default/gram/b662a1da-8c2b-11e3-b0dc-1231390a0101
I can run F5 reloads on the site for 15 minutes straight, not have
anyone access the system then then try to load something, be it the
admin interface or the page I show you here and it site for a very long
time. The time it is unresponsive seems random, but that's because I
haven't discovered how to replicate the problem.
If I restart apache and try, it seems to work every time.
This king of issues are hard to know exactly, where the problem is,
without having a clear picture of the application and the infrastructure.
without having a clear picture of the application and the infrastructure.
For sure, something is holding apache worker threads for a long time or indefinitely.
when a request for melodigram.com/melodigram/default/gram/b662a1da-8c2b-11e3-b0dc-1231390a0101
is running:
Are you using any third party C extension?
Are you calling any external program?
Where are the files, that are retrieved by the download function, stored? In the same
box, or been retrieved from a remote location?
box, or been retrieved from a remote location?
the first thing I would try is using strace utility against an apache worker thread to see
were it is sitting.
Ricardo
Jason Brower
Feb 3, 2014, 4:06:32 PM2/3/14
to web...@googlegroups.com
Thanks for the pointers!
I run two programs... avconv (ffmpeg) and sox both handle file
conversions at the moment an upload happens. They bail pretty easily if
there was an error. They are using files I have stored according to my
model.
BR,
Jason Brower
I run two programs... avconv (ffmpeg) and sox both handle file
conversions at the moment an upload happens. They bail pretty easily if
there was an error. They are using files I have stored according to my
model.
BR,
Jason Brower
Niphlod
Feb 4, 2014, 10:05:51 AM2/4/14
to web...@googlegroups.com
that's the problem!!!
Running external programs within the webserver execution model causes the thread to be killed if the request takes too much.
It's process handling 101: NEVER spawn processes from the web application!
Michele Comitini
Feb 4, 2014, 10:37:25 AM2/4/14
to web...@googlegroups.com
Jason,
I think scheduler can do all you need.
http://web2py.com/books/default/chapter/29/04/the-core#Scheduler
HTHI think scheduler can do all you need.
http://web2py.com/books/default/chapter/29/04/the-core#Scheduler
You received this message because you are subscribed to the Google Groups "web2py-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.
Jason Brower
Feb 4, 2014, 2:43:16 PM2/4/14
to web...@googlegroups.com
HMM, the processes are very fast and never take long. maybe 5 seconds,
but most of the time 1 or 2 seconds. Do I really need create a queing
server for this? It's going to be a lot of database reading to make it
happen smoothly.
BR,
Jason Brower
but most of the time 1 or 2 seconds. Do I really need create a queing
server for this? It's going to be a lot of database reading to make it
happen smoothly.
BR,
Jason Brower
Niphlod
Feb 4, 2014, 3:11:54 PM2/4/14
to web...@googlegroups.com
On Tuesday, February 4, 2014 8:43:16 PM UTC+1, Encompass solutions wrote:
HMM, the processes are very fast and never take long. maybe 5 seconds,
but most of the time 1 or 2 seconds. Do I really need create a queing
server for this? It's going to be a lot of database reading to make it
happen smoothly.
BR,
Jason Brower
even if "usually" they take 5 seconds, it seems that you're facing problems with runaway processes hanging around until apaches goes into timeout....
Ricardo Pedroso
Feb 4, 2014, 4:17:45 PM2/4/14
to web...@googlegroups.com
On Tue, Feb 4, 2014 at 8:11 PM, Niphlod <nip...@gmail.com> wrote:
On Tuesday, February 4, 2014 8:43:16 PM UTC+1, Encompass solutions wrote:HMM, the processes are very fast and never take long. maybe 5 seconds,
but most of the time 1 or 2 seconds. Do I really need create a queing
server for this? It's going to be a lot of database reading to make it
happen smoothly.
BR,
Jason Brower
Just to clear thing out....
Jason, can you replicate the problem only going to
melodigram.com/melodigram/default/gram/b662a1da-8c2b-11e3-b0dc-1231390a0101
melodigram.com/melodigram/default/gram/b662a1da-8c2b-11e3-b0dc-1231390a0101
and repeatedly refresh the browser several times?
This URL doesn't call any external program, right?
Gary Climacosa
Mar 21, 2014, 5:00:48 AM3/21/14
to web...@googlegroups.com
Hi any did anyone have a chance to fixed this issue?
Encompass solutions
Mar 22, 2014, 1:54:46 AM3/22/14
to web...@googlegroups.com
The issue was fixed. Sorry for not seeing the follow up. I switched to NGIX and everything works perfectly. Haven't seen this issue since.
BR,
Jason Brower
On Sunday, February 2, 2014 8:14:21 PM UTC+2, Encompass solutions wrote:
Gary Climacosa
Mar 22, 2014, 2:10:41 AM3/22/14
to web...@googlegroups.com
Thanks we are also planning to migrate to nginx.
--
Sent from Gmail Mobile
--
Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
---
You received this message because you are subscribed to a topic in the Google Groups "web2py-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/web2py/BZQF88jug54/unsubscribe.
To unsubscribe from this group and all its topics, send an email to web2py+un...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Sent from Gmail Mobile
Jason Brower
Mar 24, 2014, 3:27:51 AM3/24/14
to web...@googlegroups.com
Yeah, something with apache. But ngix is much better for us anyway. I
don't think I will go back to apache any time soon.
As for the time to process the files, about 1 second max at the absolute
most. Honestly I don't know how to test or check this kind of stuff.
But what we do know is that it's handle requests right now just fine.
BR,
Jason Brower
On Sun, 2014-02-02 at 12:09 -0800, Niphlod wrote:
don't think I will go back to apache any time soon.
As for the time to process the files, about 1 second max at the absolute
most. Honestly I don't know how to test or check this kind of stuff.
But what we do know is that it's handle requests right now just fine.
BR,
Jason Brower
On Sun, 2014-02-02 at 12:09 -0800, Niphlod wrote:
> --
> Resources:
> - http://web2py.com
> - http://web2py.com/book (Documentation)
> - http://github.com/web2py/web2py (Source code)
> - https://code.google.com/p/web2py/issues/list (Report Issues)
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "web2py-users" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/web2py/BZQF88jug54/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> web2py+un...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
> Resources:
> - http://web2py.com
> - http://web2py.com/book (Documentation)
> - http://github.com/web2py/web2py (Source code)
> - https://code.google.com/p/web2py/issues/list (Report Issues)
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "web2py-users" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/web2py/BZQF88jug54/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> web2py+un...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages