Issue 232 in s3fs: Possible to get upload progress when saving to s3fs mounted directory?

41 views
Skip to first unread message

s3...@googlecode.com

unread,
Oct 25, 2011, 9:45:48 PM10/25/11
to s3fs-...@googlegroups.com
Status: New
Owner: ----
Labels: Type-Support Priority-Medium

New issue 232 by jm.magnu...@gmail.com: Possible to get upload progress
when saving to s3fs mounted directory?
http://code.google.com/p/s3fs/issues/detail?id=232

Detailed description of support request:

I have a Drupal 7 site on an Ubuntu 10 server, and I have installed and
configured s3fs, and connected it to my drupal file directory using this
fstab:

s3fs#pixel-scrapper
/srv/www/pixelscrapper/public_html/sites/default/files/s3 fuse
defaults,noatime,use_rrs=1,allow_other,uid=33,gid=33,default_acl=public-read
0 0

Everything works: I can drag files into the mounted directory and see them
in my bucket, and vice-versa. I can also upload files to my s3 directory
from Drupal.

I have pecl upload_progress enabled, so that normally when uploading files
with Drupal I see an upload progress bar which is obviously handy for large
files. This works when uploading to any of the local directories on my
server. When uploading to the s3fs mounted directory, however, the progress
bar just sits at 0 until the upload is complete--not as useful. Is there
any way to get the s3fs directory to work with pecl upload progress?


===================================================================
The following information is very important in order to help us to help
you. Omission of the following details may delay your support request or
receive no attention at all.
===================================================================
Version of s3fs being used (s3fs --version): 1.61

Version of fuse being used (pkg-config --modversion fuse): 2.8.4

System information (uname -a): Linux ubuntu 2.6.32-34-server #77-Ubuntu SMP
Tue Sep 13 20:54:38 UTC 2011 x86_64 GNU/Linux

Distro (cat /etc/issue): Ubuntu 10.04.3 LTS \n \l

/etc/fstab entry (if applicable): s3fs#pixel-scrapper
/srv/www/pixelscrapper/public_html/sites/default/files/s3 fuse
defaults,noatime,use_rrs=1,allow_other,uid=33,gid=33,default_acl=public-read
0 0

s3fs syslog messages (grep s3fs /var/log/syslog):
Oct 26 02:25:10 ubuntu s3fs: init $Rev: 367 $
Oct 26 02:34:50 ubuntu s3fs: init $Rev: 367 $

s3...@googlecode.com

unread,
Mar 5, 2012, 4:23:48 PM3/5/12
to s3fs-...@googlegroups.com

Comment #1 on issue 232 by jm.magnu...@gmail.com: Possible to get upload
progress when saving to s3fs mounted directory?
http://code.google.com/p/s3fs/issues/detail?id=232

Someone recommended adding use_cache=/tmp to my trigger, but this doesn't
seem to be helping. My new fstab entry reads:

s3fs#pixel-scrapper
/srv/www/pixelscrapper/public_html/sites/default/files/s3 fuse
defaults,noatime,use_rrs=1,allow_other,uid=33,gid=33,use_cache=/tmp,default_acl=public-read
0 0

s3...@googlecode.com

unread,
May 22, 2013, 9:14:03 PM5/22/13
to s3fs-...@googlegroups.com
Updates:
Status: Done

Comment #2 on issue 232 by ggta...@gmail.com: Possible to get upload
progress when saving to s3fs mounted directory?
http://code.google.com/p/s3fs/issues/detail?id=232

Hi,

As a premise, I'm sorry that I don't know how to implement pecl upload
progress.

When s3fs upload a object, at first s3fs makes 0 byte object on S3.
And this object is replaced with uploaded object after completing uploading.
So that, I think that the "upload progress" looks 0 byte during uploading.

The size of object can not read during uploading, this is S3's
specifications.
Then this issue can not be fixed by changing s3fs.

Regards,

--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

s3...@googlecode.com

unread,
May 23, 2013, 3:32:27 AM5/23/13
to s3fs-...@googlegroups.com

Comment #3 on issue 232 by jm.magnu...@gmail.com: Possible to get upload
progress when saving to s3fs mounted directory?
http://code.google.com/p/s3fs/issues/detail?id=232

Hm... this problem seems to have disappeared when I moved from my local
development server to my production server. I don't know why they weren't
working together in development, but s3fs and pecl upload progress are
working fine together on my production server.
Reply all
Reply to author
Forward
0 new messages