[JIRA] (JENKINS-58633) Losing Metadata if upload file bigger than 100MB

[hungvotrung@gmail.com (JIRA)]

Hung Vo created an issue

Jenkins / JENKINS-58633 Losing Metadata if upload file bigger than 100MB Issue Type: Bug Assignee: Azure DevOps Attachments: image-2019-07-24-16-50-24-468.png, image-2019-07-24-16-51-06-043.png Components: windows-azure-storage-plugin Created: 2019-07-24 08:51 Priority: Major Reporter: Hung Vo I'm using latest plugin, If upload small file with custom metadata everything went through. But if I upload big file (I think plugin spit file > 100MB) and custom metadata, the metadata will not be updated. Big file: Small file Add Comment

This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

[jieshe@microsoft.com (JIRA)]

Jie Shen assigned an issue to Jie Shen

Jenkins / JENKINS-58633 Losing Metadata if upload file bigger than 100MB

Change By: Jie Shen Assignee: Azure DevOps Jie Shen

Add Comment

[jieshe@microsoft.com (JIRA)]

Jie Shen commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB Thanks for reporting this issue. I will follow up.

Add Comment

[jieshe@microsoft.com (JIRA)]

Jie Shen commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB

Hung Vo How do you add custom metadata to your file? I have made some fixes, but I want to verify your real cases. Thanks.

Add Comment

[hungvotrung@gmail.com (JIRA)]

Hung Vo commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB

Jie Shen I added like this: azureUpload containerName: 'test', fileShareName: '', filesPath: 'bigfile.test', storageCredentialId: 'storageCredID', storageType: 'blobstorage', metadata: [[key: 'VERSION', value: BUILD_NUMBER]] azureUpload containerName: 'test', fileShareName: '', filesPath: 'smallerfile.test', storageCredentialId: 'storageCredID', storageType: 'blobstorage', metadata: [[key: 'VERSION', value: BUILD_NUMBER]]

Add Comment

[jieshe@microsoft.com (JIRA)]

Jie Shen resolved as Fixed

Jenkins / JENKINS-58633

Losing Metadata if upload file bigger than 100MB

Change By: Jie Shen Status: Open Resolved Resolution: Fixed Released As: 1.1.0

Add Comment

[kimitake@gmail.com (JIRA)]

Kimitake Abe commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB I'm using v1.1.2 and Content-MD5 is still missing for large file like this screenshot when I uploading. I tried to download and upload the same file again by Azure Storage Explorer and confirmed that the Content-MD5 exists in this case.

Add Comment

This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)

[jieshe@microsoft.com (JIRA)]

Jie Shen commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB

Kimitake Abe thanks for reporting this. I have created a PR to fix this.

Add Comment

[kimitake@gmail.com (JIRA)]

Kimitake Abe updated an issue

Jenkins / JENKINS-58633

Losing Metadata if upload file bigger than 100MB

Change By: Kimitake Abe Attachment: image-2019-12-31-05-36-24-330.png

Add Comment

[kimitake@gmail.com (JIRA)]

[kimitake@gmail.com (JIRA)]

Kimitake Abe commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB Jie Shen Thanks for quick fixing. I tried new version but it seems that some files generate wrong MD5. e.g. mongodb-win32-x86_64-2008plus-ssl-3.6.6-signed.msi This file size is 184MB and its MD5 is BQCiryKdBHReOlcnRBS76A== , but uploaded info is 1B2M2Y8AsgTpgAmY7PhCfg==  This is same as empty file's MD5 and I got same values with several files. $ echo -n "" | openssl dgst -md5 -binary | base64 1B2M2Y8AsgTpgAmY7PhCfg==

Add Comment

[jieshe@microsoft.com (JIRA)]

Jie Shen updated an issue

Jenkins / JENKINS-58633

Losing Metadata if upload file bigger than 100MB

Change By: Jie Shen I GI 'm using latest plugin, If upload small file with custom metadata everything went through.

But if I upload big file (I think plugin spit file > 100MB) and custom metadata, the metadata will not be updated. Big file:

!image-2019-07-24-16-50-24-468.png! Small file !image-2019-07-24-16-51-06-043.png!

Add Comment

[jieshe@microsoft.com (JIRA)]

Jie Shen commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB Kimitake Abe You are right. The fix consumes the same stream twice and gets the wrong md5 value. I have released a new version. Thanks for your feedback.

Add Comment

[kimitake@gmail.com (JIRA)]

Kimitake Abe commented on JENKINS-58633

Re: Losing Metadata if upload file bigger than 100MB

Jie Shen I just confirmed the latest version does work as expected. Thanks for quick fixing.

Add Comment