Issue 448 in s3fs: -o enable_content_md5 always sets ETag="1B2M2Y8AsgTpgAmY7PhCfg=="

[s3...@googlecode.com]

Status: New
Owner: ----
Labels: Type-Defect Priority-Medium

New issue 448 by leocple...@gmail.com: -o enable_content_md5 always sets
ETag="1B2M2Y8AsgTpgAmY7PhCfg=="
https://code.google.com/p/s3fs/issues/detail?id=448

Detailed description of observed behavior:
with enable_content_md5 checking the ETag is always set
to "1B2M2Y8AsgTpgAmY7PhCfg==", this is equivalent to and md5sum
of "d41d8cd98f00b204e9800998ecf8427e" which is a zero size file.

Looking at the code curl.cpp::GetContentMD5(int fd)
Looks like it always call md5hexsum(fd, 0, -1);
It needs the size of the file to generate the proper md5sum.

What steps will reproduce the problem - please be very specific and
detailed. (if the developers cannot reproduce the issue, then it is
unlikely a fix will be found)?

mount s3fs foreground with debug enable.
copy a file from local dir to mount point (s3)


===================================================================
The following information is very important in order to help us to help
you. Omission of the following details may delay your support request or
receive no attention at all.
===================================================================
Version of s3fs being used (s3fs --version):
1.74

Version of fuse being used (pkg-config --modversion fuse):
fuse x86_64 2.9.2.5.el7

System information (uname -a):
Linux hsm110 3.10.0-123.el7.x86_64 #1 SMP Mon Jun 30 12:09:22 UTC 2014
x86_64 x86_64 x86_64 GNU/Linux

Distro (cat /etc/issue):
CentOS 7

s3fs command line used (if applicable):
s3fs -f <mybucket...> /mnt/<somemount> -o url=http://<amazons3> -o
passwd_file=~/.passwd-s3fs -o parallel_count=10 -d -o enable_content_md5


/etc/fstab entry (if applicable):
foreground mount.

s3fs syslog messages (grep s3fs /var/log/syslog):

<date....><host> s3fs: Body Text: <?xml version="1.0"
encoding="UTF-8"?><Error><Code>BadDigest</Code><Message>The Content-MD5 you
specified did not match what we
received.</Message><ExpectedDigest>1B2M2Y8AsgTpgAmY7PhCfg==</ExpectedDigest><CalculatedDigest>H7fEtBbCe5RuXHFhAlUC7w==</CalculatedDigest><....>



--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

[s3...@googlecode.com]

Updates:
Status: Done

Comment #1 on issue 448 by ggta...@gmail.com: -o enable_content_md5 always

sets ETag="1B2M2Y8AsgTpgAmY7PhCfg=="
https://code.google.com/p/s3fs/issues/detail?id=448

Hi, leocpleung

We had moved s3fs project to Github(https://github.com/s3fs-fuse/s3fs-fuse).
And I probably changed some codes about this issue, now latest version of
s3fs is 1.78.

Please try to use latest version or master branch on Github.
If you have a problem after that, please post new issue on Giuhub.
I'm going to close this issue.

Regards,