why mogilefsd[monitor] memory usage grows up constantly

13 views
Skip to first unread message

lei

unread,
Nov 23, 2009, 5:48:33 AM11/23/09
to mogile
Hi.
We have installed 2 trackers and 3 storage nodes on 3 host from CPAN
for a few days.
After 10+ days, we noticed that both 2 trackers nodes(4GB RAM) have
run out of memory,
mogilefsd[monitor]/[job_master] used about 850M memory, but we haven't
set any files to
mogilefs during these days,mogilefs domain only contains 200 small
files, this make us confused.

Here are some information for the system:
mogilefs: v2.3
perl: v5.10.0 built for i486-linux-thread-multi

ps -aux result:
-----------------------
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME
COMMAND
mogile 18432 0.1 0.2 16784 9124 ? S Oct27 65:27
mogilefsd
mogile 18435 0.0 0.2 19556 11924 ? S Oct27 3:48
mogilefsd [queryworker]
mogile 18436 0.0 0.2 17688 10140 ? S Oct27 3:59
mogilefsd [queryworker]
mogile 18437 0.0 0.2 17812 10160 ? S Oct27 3:43
mogilefsd [queryworker]
mogile 18438 0.0 0.2 17696 10160 ? S Oct27 3:44
mogilefsd [queryworker]
mogile 18439 0.0 0.2 19560 11900 ? S Oct27 3:52
mogilefsd [queryworker]
mogile 18440 0.0 0.2 19560 11912 ? S Oct27 3:47
mogilefsd [queryworker]
mogile 18441 0.0 0.2 19532 11892 ? S Oct27 3:49
mogilefsd [queryworker]
mogile 18442 0.0 0.2 17836 10176 ? S Oct27 3:45
mogilefsd [queryworker]
mogile 18443 0.0 0.2 19360 11748 ? S Oct27 3:53
mogilefsd [queryworker]
mogile 18444 0.0 0.2 18032 10352 ? S Oct27 3:43
mogilefsd [queryworker]
mogile 18446 0.0 1.5 73328 63856 ? S Oct27 8:02
mogilefsd [reaper]
mogile 24108 0.0 0.9 47104 40164 ? S Nov09 4:25
mogilefsd [delete]
mogile 25204 0.0 0.2 16784 8928 ? SN Nov09 3:03
mogilefsd [fsck]
mogile 25206 0.0 5.1 218992 211672 ? S Nov09 16:24
mogilefsd [job_master]
mogile 25454 0.3 16.6 697556 691264 ? S Nov09 64:36
mogilefsd [monitor]

mogilefsd.conf
-------------------------
db_dsn DBI:mysql:mogilefs:192.168.1.x
db_user mogile
db_pass XXX
conf_port 6001
listener_jobs 10
memcache_servers 192.168.1.61:32101,192.168.1.63:32102
-------------------------

uname -a
----------------------
Linux serv2 2.6.27.7-smp-pae #1 SMP Wed Jul 8 17:08:29 CST 2009 i686
Intel(R) Pentium(R) Dual CPU E2220 @ 2.40GHz GenuineIntel GNU/Linux

We use innodb tables and system/CPU load is quite low ,storage nodes
seems work fine.
Anyone has idea on this issue? Sorry for the poor english :)

Regards
Leiphi

dormando

unread,
Nov 25, 2009, 3:39:30 AM11/25/09
to mogile
Hey,

What distribution are you using? What versions of the various software
(CPAN modules) do you have?

I've not seen a memory leak like that in quite a while... definitely not
in the monitor code, which hasn't changed in a long time.

-Dormando

lei

unread,
Nov 25, 2009, 9:20:03 PM11/25/09
to mogile
We switch MogileFS::Server 2.30 to 2.33 using CPAN update.
We'll watch for a while.
thanks,Dormando.
Reply all
Reply to author
Forward
0 new messages