Bug#368315: apache: [notice] child pid xxxxx exit signal Segmentation fault (11)
tech
Version: 1.3.34-2
Severity: normal
my /var/log/apache/error.log is filled with error messages like :
[notice] child pid 15353 exit signal Segmentation fault (11)
I've looked in bugs.debian.org and goole but this kind of problem seems to have disapeared since 2004, it's strange because my apache installation is up to date
and there's little time I get these errors
-- System Information:
Debian Release: testing/unstable
APT prefers proposed-updates
APT policy: (500, 'proposed-updates'), (500, 'testing'), (500, 'stable')
Architecture: i386 (i686)
Shell: /bin/sh linked to /bin/bash
Kernel: Linux 2.4.20
Locale: LANG=fr_FR@euro, LC_CTYPE=fr_FR@euro (charmap=ISO-8859-15)
Versions of packages apache depends on:
ii apache-common 1.3.34-2 support files for all Apache webse
ii debconf [debconf-2.0] 1.5.0 Debian configuration management sy
ii libc6 2.3.6-7 GNU C Library: Shared libraries
ii libdb4.3 4.3.29-4.1 Berkeley v4.3 Database Libraries [
ii libexpat1 1.95.8-3.2 XML parsing C library - runtime li
ii libmagic1 4.17-1 File type determination library us
ii logrotate 3.7.1-3 Log rotation utility
ii lsb-base 3.1-5 Linux Standard Base 3.1 init scrip
ii mime-support 3.36-1 MIME files 'mime.types' & 'mailcap
ii perl 5.8.8-4 Larry Wall's Practical Extraction
apache recommends no packages.
-- debconf information:
* apache/enable-suexec: false
apache/server-name: ns1.mimizan.net
apache/document-root: /home/sites/www_root
apache/server-port: 80
* apache/init: true
apache/server-admin: te...@mediaforest.net
--
To UNSUBSCRIBE, email to debian-bugs-...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listm...@lists.debian.org
Adam Conrad
>
> my /var/log/apache/error.log is filled with error messages like :
> [notice] child pid 15353 exit signal Segmentation fault (11)
Please run "apache -X" under gdb and see if you can get a backtrace of
the segfault, so we know who's at fault here.
Also, a list of modules you have loaded (and their package versions, or
information if they've been compiled/installed manually) would be useful.
... Adam
te...@mediaforest.net
>>
>> my /var/log/apache/error.log is filled with error messages like :
>> [notice] child pid 15353 exit signal Segmentation fault (11)
>
> the segfault, so we know who's at fault here.
>
> Also, a list of modules you have loaded (and their package versions, or
> information if they've been compiled/installed manually) would be useful.
>
> ... Adam
Hello, as it is a server in production and hosting 50 virtualhosts, it's a bit problematic to let it run under gdb until
the segfault occurs, as it seems take some time after a restart before it happens...
Here are more infos I can provide :
- when apache starts to segfault, it can happen many times a minute :
> [Wed May 24 10:28:01 2006] [notice] child pid 28729 exit signal Segmentation fault (11)
> [Wed May 24 10:28:03 2006] [notice] child pid 28726 exit signal Segmentation fault (11)
> [Wed May 24 10:28:07 2006] [notice] child pid 28719 exit signal Segmentation fault (11)
> [Wed May 24 10:28:09 2006] [notice] child pid 28716 exit signal Segmentation fault (11)
> [Wed May 24 10:28:10 2006] [notice] child pid 28723 exit signal Segmentation fault (11)
> [Wed May 24 10:28:12 2006] [notice] child pid 28721 exit signal Segmentation fault (11)
> [Wed May 24 10:28:14 2006] [notice] child pid 28715 exit signal Segmentation fault (11)
> [Wed May 24 10:28:18 2006] [notice] child pid 28725 exit signal Segmentation fault (11)
> [Wed May 24 10:28:20 2006] [notice] child pid 28728 exit signal Segmentation fault (11)
> [Wed May 24 10:28:22 2006] [notice] child pid 28727 exit signal Segmentation fault (11)
> [Wed May 24 10:28:24 2006] [notice] child pid 28724 exit signal Segmentation fault (11)
> [Wed May 24 10:28:26 2006] [notice] child pid 28722 exit signal Segmentation fault (11)
> [Wed May 24 10:28:28 2006] [notice] child pid 28718 exit signal Segmentation fault (11)
> [Wed May 24 10:28:30 2006] [notice] child pid 28710 exit signal Segmentation fault (11)
> [Wed May 24 10:28:32 2006] [notice] child pid 28709 exit signal Segmentation fault (11)
> [Wed May 24 10:28:34 2006] [notice] child pid 28707 exit signal Segmentation fault (11)
> [Wed May 24 10:28:36 2006] [notice] child pid 28706 exit signal Segmentation fault (11)
> [Wed May 24 10:28:38 2006] [notice] child pid 28705 exit signal Segmentation fault (11)
> [Wed May 24 10:28:40 2006] [notice] child pid 28703 exit signal Segmentation fault (11)
> [Wed May 24 10:28:42 2006] [notice] child pid 28702 exit signal Segmentation fault (11)
> [Wed May 24 10:28:44 2006] [notice] child pid 28701 exit signal Segmentation fault (11)
> [Wed May 24 10:28:46 2006] [notice] child pid 28700 exit signal Segmentation fault (11)
> [Wed May 24 10:28:48 2006] [notice] child pid 28699 exit signal Segmentation fault (11)
> [Wed May 24 10:28:50 2006] [notice] child pid 28698 exit signal Segmentation fault (11)
> [Wed May 24 10:28:52 2006] [notice] child pid 28697 exit signal Segmentation fault (11)
> [Wed May 24 10:28:54 2006] [notice] child pid 28696 exit signal Segmentation fault (11)
> [Wed May 24 10:28:56 2006] [notice] child pid 28695 exit signal Segmentation fault (11)
> [Wed May 24 10:28:58 2006] [notice] child pid 28694 exit signal Segmentation fault (11)
> [Wed May 24 10:29:00 2006] [notice] child pid 28693 exit signal Segmentation fault (11)
> [Wed May 24 10:29:04 2006] [notice] child pid 28691 exit signal Segmentation fault (11)
> [Wed May 24 10:29:06 2006] [notice] child pid 28690 exit signal Segmentation fault (11)
> [Wed May 24 10:29:08 2006] [notice] child pid 28689 exit signal Segmentation fault (11)
> [Wed May 24 10:29:10 2006] [notice] child pid 28688 exit signal Segmentation fault (11)
> [Wed May 24 10:29:12 2006] [notice] child pid 28687 exit signal Segmentation fault (11)
> [Wed May 24 10:29:14 2006] [notice] child pid 28686 exit signal Segmentation fault (11)
> [Wed May 24 10:29:17 2006] [notice] child pid 28685 exit signal Segmentation fault (11)
> [Wed May 24 10:29:21 2006] [notice] child pid 28681 exit signal Segmentation fault (11)
> [Wed May 24 10:29:23 2006] [notice] child pid 28680 exit signal Segmentation fault (11)
> [Wed May 24 10:29:25 2006] [notice] child pid 28679 exit signal Segmentation fault (11)
> [Wed May 24 10:29:27 2006] [notice] child pid 28626 exit signal Segmentation fault (11)
> [Wed May 24 10:30:39 2006] [notice] child pid 28824 exit signal Segmentation fault (11)
> [Wed May 24 10:30:42 2006] [notice] child pid 28817 exit signal Segmentation fault (11)
> [Wed May 24 10:30:44 2006] [notice] child pid 28812 exit signal Segmentation fault (11)
> [Wed May 24 10:31:20 2006] [notice] child pid 28819 exit signal Segmentation fault (11)
> [Wed May 24 10:54:40 2006] [notice] child pid 29142 exit signal Segmentation fault (11)
> [Wed May 24 10:54:42 2006] [notice] child pid 29141 exit signal Segmentation fault (11)
> [Wed May 24 10:54:44 2006] [notice] child pid 29140 exit signal Segmentation fault (11)
> [Wed May 24 10:54:46 2006] [notice] child pid 29139 exit signal Segmentation fault (11)
> [Wed May 24 10:54:48 2006] [notice] child pid 29138 exit signal Segmentation fault (11)
> [Wed May 24 10:54:50 2006] [notice] child pid 29137 exit signal Segmentation fault (11)
> [Wed May 24 10:54:52 2006] [notice] child pid 29136 exit signal Segmentation fault (11)
> [Wed May 24 10:54:54 2006] [notice] child pid 29135 exit signal Segmentation fault (11)
> [Wed May 24 10:54:56 2006] [notice] child pid 29134 exit signal Segmentation fault (11)
> [Wed May 24 10:54:58 2006] [notice] child pid 29133 exit signal Segmentation fault (11)
> [Wed May 24 10:55:01 2006] [notice] child pid 29132 exit signal Segmentation fault (11)
> [Wed May 24 10:55:09 2006] [notice] child pid 29131 exit signal Segmentation fault (11)
> [Wed May 24 10:55:19 2006] [notice] child pid 29130 exit signal Segmentation fault (11)
in this case, I restarted apache at 10:31:20
- here is th result of : apt-show-versions -r .*apache.* :
> libapache-mod-perl-doc/stable uptodate 1.29.0.2-5cvs20040129
> libapache-mod-ssl-doc/testing uptodate 2.8.25-1
> apache/testing uptodate 1.3.34-2
> apache2-common/testing uptodate 2.0.55-4
> apache2-utils/testing uptodate 2.0.55-4
> libapache-mod-cgi-debug/testing uptodate 0.7-10
> apache-common/testing uptodate 1.3.34-2
> libapache-request-perl/testing uptodate 1.33-1
> webmin-apache 1.220-2 newer than version in archive
> libapache2-mod-php4/testing uptodate 4:4.4.2-1+b1
> libapache-mod-php4/testing uptodate 4:4.4.2-1+b1
> apache2-mpm-prefork/testing uptodate 2.0.55-4
> libapache-mod-gzip/testing uptodate 1.3.26.1a-9
> libapache-mod-ssl/testing uptodate 2.8.25-1
> libapache-mod-jk/testing uptodate 1:1.2.14.1-2
> libapache-modxslt/testing uptodate 2004112100-3.1
> libapache-mod-perl/testing uptodate 1.29.0.4-2
and here is my /etc/apache/modules.conf
> # Autogenerated file - do not edit!
> # This file is maintained by the apache package.
> # To update it, run the command:
> # /usr/sbin/apache-modconf apache
> LoadModule vhost_alias_module /usr/lib/apache/1.3/mod_vhost_alias.so
> LoadModule env_module /usr/lib/apache/1.3/mod_env.so
> LoadModule config_log_module /usr/lib/apache/1.3/mod_log_config.so
> LoadModule agent_log_module /usr/lib/apache/1.3/mod_log_agent.so
> LoadModule referer_log_module /usr/lib/apache/1.3/mod_log_referer.so
> #LoadModule log_forensic_module /usr/lib/apache/1.3/mod_log_forensic.so
> LoadModule mime_magic_module /usr/lib/apache/1.3/mod_mime_magic.so
> LoadModule mime_module /usr/lib/apache/1.3/mod_mime.so
> LoadModule negotiation_module /usr/lib/apache/1.3/mod_negotiation.so
> LoadModule status_module /usr/lib/apache/1.3/mod_status.so
> LoadModule info_module /usr/lib/apache/1.3/mod_info.so
> LoadModule includes_module /usr/lib/apache/1.3/mod_include.so
> LoadModule autoindex_module /usr/lib/apache/1.3/mod_autoindex.so
> LoadModule dir_module /usr/lib/apache/1.3/mod_dir.so
> LoadModule cgi_module /usr/lib/apache/1.3/mod_cgi.so
> LoadModule asis_module /usr/lib/apache/1.3/mod_asis.so
> LoadModule imap_module /usr/lib/apache/1.3/mod_imap.so
> LoadModule speling_module /usr/lib/apache/1.3/mod_speling.so
> LoadModule userdir_module /usr/lib/apache/1.3/mod_userdir.so
> LoadModule alias_module /usr/lib/apache/1.3/mod_alias.so
> LoadModule rewrite_module /usr/lib/apache/1.3/mod_rewrite.so
> LoadModule access_module /usr/lib/apache/1.3/mod_access.so
> LoadModule auth_module /usr/lib/apache/1.3/mod_auth.so
> LoadModule expires_module /usr/lib/apache/1.3/mod_expires.so
> LoadModule headers_module /usr/lib/apache/1.3/mod_headers.so
> #LoadModule usertrack_module /usr/lib/apache/1.3/mod_usertrack.so
> LoadModule setenvif_module /usr/lib/apache/1.3/mod_setenvif.so
> LoadModule perl_module /usr/lib/apache/1.3/mod_perl.so
> #LoadModule ssl_module /usr/lib/apache/1.3/mod_ssl.so
> LoadModule php4_module /usr/lib/apache/1.3/libphp4.so
> LoadModule gzip_module /usr/lib/apache/1.3/mod_gzip.so
> #LoadModule whatkilledus_module /usr/lib/apache/1.3/mod_whatkilledus.so
I also get very often this kind of messages :
>
> [Wed May 24 12:26:45 2006] [info] server seems busy, (you may need to increase StartServers, or Min/MaxSpareServers), spawning 8 children, there are 0 idle, and 20 total children
> [Wed May 24 12:26:46 2006] [info] server seems busy, (you may need to increase StartServers, or Min/MaxSpareServers), spawning 16 children, there are 0 idle, and 28 total children
> [Wed May 24 12:26:47 2006] [info] server seems busy, (you may need to increase StartServers, or Min/MaxSpareServers), spawning 32 children, there are 0 idle, and 44 total children
and also this :
> [info] [client 80.224.222.5] (32)Broken pipe: client stopped connection before send mmap completed
and then when I restart apache, whether with "apachectl restart" or with "/etc/init.d/apache restart"
I always get this kind of messages :
> [Wed May 24 12:53:37 2006] [warn] child process 1780 did not exit, sending another SIGHUP
> [Wed May 24 12:53:37 2006] [warn] child process 1781 did not exit, sending another SIGHUP
> [Wed May 24 12:53:37 2006] [warn] child process 1782 did not exit, sending another SIGHUP
> [Wed May 24 12:53:37 2006] [warn] child process 1783 did not exit, sending another SIGHUP
I hope all of this will help to find where the problem come from ;)
Stéphane CHIRON
--
Ce message a été vérifié par MailScanner
pour des virus ou des polluriels et rien de
suspect n'a été trouvé.
MailScanner remercie transtec pour son soutien.
te...@mediaforest.net
I've found this message on lists.debian.org. It seems it describe the same problem but it never got any answer :(
Adam Conrad
> Have a look at http://lists.debian.org/debian-user/2005/09/msg00382.html
> I've found this message on lists.debian.org. It seems it describe the same problem but it never got any answer :(
Apache can segfault for any number of wonderful reasons. One person
reporting segfaults does not mean it's "the same problem you're having".
The only way I can reliably debug this is with a gdb backtrace of the
offending process. I can't magically determine why it crashed just from
reading logfiles that say "apache crashed".
... Adam
te...@mediaforest.net
There's now nearly one year and many updates, and I always have the same
problem, but now, I have to restart apache manually every day, because
it hangs completely, I also have to kill manually defective apache
processes before restarting.
I have tried the procedure given for the #394714 bug
but it's really annoying, because the "gdb --args apache -X" command
forbids apache to fork childrens and in normal use, I usually have at
least 24 child running :(
I've also tried to run
"gdb --args apache -F" or "gdb --args apache -f /etc/apache/httpd.conf"
to avoid having only a single apache process, and having my server
working normally, but nothing works.
the only messages given by gdb are :
- Using host libthread_db library "/lib/libthread_db.so.1"
- [Thread debugging using libthread_db enabled]
- [New Thread 16384 (LWP 5612)]
Then many many times :
no debugging symbols found
then
- Program exited normally
While gdb is running the only useful information I get is in the
/var/log/apache/error.log :
[notice] child pid xxx exit signal Trace/breakpoint trap (5)
and that's all.
another info : I never managed to have my server answer to queries,
while it's running under gdb : my websites doesn't answer at all during
all the time apache runs under gdb, so I cannot try this during a long
time :(
I hope that these infos will help you to finally solve my problem
Stéphane CHIRON
Service Technologies de L'Information et de la Communication
Communauté de Communes de Mimizan
Adam Conrad a écrit :