Issue 184 in s3fs: S3FS 1.40 using 3.6GB of memory!

18 views
Skip to first unread message

s3...@googlecode.com

unread,
May 11, 2011, 8:39:55 AM5/11/11
to s3fs-...@googlegroups.com
Status: New
Owner: ----
Labels: Type-Defect Priority-Medium

New issue 184 by N.sherl...@gmail.com: S3FS 1.40 using 3.6GB of memory!
http://code.google.com/p/s3fs/issues/detail?id=184

Detailed description of observed behavior:

After mlocate ran on our mounted s3fs bucket with between 500,000 and 1
million files (silly me, hadn't disabled it), s3fs process is suddenly
consuming 3.6GB of memory, and has shown no signs of giving any of it back.
I tried unmounting and remounting - no joy.

What steps will reproduce the problem - please be very specific and
detailed. (if the developers cannot reproduce the issue, then it is
unlikely a fix will be found)?

Allow mlocate to index a mounted bucket that contains many files.

===================================================================
The following information is very important in order to help us to help
you. Omission of the following details may delay your support request or
receive no attention at all.
===================================================================
Version of s3fs being used (s3fs --version):

1.40

Version of fuse being used (pkg-config --modversion fuse):

2.8.4

System information (uname -a):

Linux ip-10-90-138-131 2.6.38-8-virtual #42-Ubuntu SMP Mon Apr 11 04:06:34
UTC 2011 x86_64 x86_64 x86_64 GNU/Linux

Distro (cat /etc/issue):

Ubuntu 11.04 \n \l

s3fs command line used (if applicable):

s3fs s3.chickensmoothie.com /s3 -ouse_cache=/caches/s3 -oallow_other

/etc/fstab entry (if applicable):

s3fs syslog messages (grep s3fs /var/log/syslog):

Attached syslog shows all log messages from the beginning of the mlocate to
the end


Attachments:
syslog 71.5 KB

s3...@googlecode.com

unread,
May 11, 2011, 8:43:57 AM5/11/11
to s3fs-...@googlegroups.com

Comment #1 on issue 184 by N.sherl...@gmail.com: S3FS 1.40 using 3.6GB of
memory!
http://code.google.com/p/s3fs/issues/detail?id=184

s3fs has actually given back the memory now - after having held on to it
for 6 hours. I guess the umount/mount cleared it?

s3...@googlecode.com

unread,
Aug 30, 2011, 12:00:29 PM8/30/11
to s3fs-...@googlegroups.com
Updates:
Status: Fixed

Comment #2 on issue 184 by ben.lema...@gmail.com: S3FS 1.40 using 3.6GB of
memory!
http://code.google.com/p/s3fs/issues/detail?id=184

unmount/mount should definitely clear any memory. Let us know if you're
still seeing this is 1.61

s3...@googlecode.com

unread,
Nov 27, 2011, 4:59:17 PM11/27/11
to s3fs-...@googlegroups.com

Comment #3 on issue 184 by r...@codeoasis.com: S3FS 1.40 using 3.6GB of
memory!
http://code.google.com/p/s3fs/issues/detail?id=184

Hi,
I have the same problem )-:..
In my case s3fs allocates 7GB RAM of memory after a while.
Unmount/mount clears the memory for a while and than it happens again.
I've upgraded to 1.61 and it still happans.
I'm using fuse 2.8.4 on a CentOS 5.5 server..

Any help would be appreciated!

Thanks

s3...@googlecode.com

unread,
Feb 29, 2012, 8:43:04 PM2/29/12
to s3fs-...@googlegroups.com

Comment #4 on issue 184 by srinivas...@gmail.com: S3FS 1.40 using 3.6GB of
memory!
http://code.google.com/p/s3fs/issues/detail?id=184

i face the same problem...after few days memory keeps growing...is
unmounting in cronjob and remounting is only option??

s3...@googlecode.com

unread,
Jun 8, 2012, 1:33:29 PM6/8/12
to s3fs-...@googlegroups.com

Comment #5 on issue 184 by ad...@onair.tv: S3FS 1.40 using 3.6GB of memory!
http://code.google.com/p/s3fs/issues/detail?id=184

I am facing the same problem now, bnut it is consuming 11.1G. Is there
another known fix instead umount/mount?

Thanks in advance!

Reply all
Reply to author
Forward
0 new messages