Lfs plugin issue: S3 upload size limit

111 views
Skip to first unread message

tech....@gmail.com

unread,
Mar 9, 2021, 11:08:55 PM3/9/21
to Repo and Gerrit Discussion
Hello Guys,

we are using gerrit v3.0.9 and S3 as backbone for Lfs objects.

lfs.config:
[storage]
    backend = s3

[s3]
    region = ap-south-1
    bucket = gerrit-lfs-test
    storageClass = REDUCED_REDUNDANCY
    expiration = 60
    disableSslVerify = false
 
we have been using this from a year , until we faced an issue pushing 10 gb file using LFS.
It is documented on AWS that to upload files more than 5gb size we need to use multipart upload API. and S3 has highest limit of upload size upto 5 gb in a singleshot.

1. The question is the Lfs plugin, is it using multipart upload technology ? if yes what changes we need to do on our lfs config to achieve that. 
2. If not what are the other solutions you suggest to use S3 as a backbone for gitlfs to upload unlimited size of large objects

Regards
Shad






Shad Perwez

unread,
Mar 12, 2021, 9:35:32 PM3/12/21
to Repo and Gerrit Discussion, Luca Milanesio
++ Luca


--
--
To unsubscribe, email repo-discuss...@googlegroups.com
More info at http://groups.google.com/group/repo-discuss?hl=en

---
You received this message because you are subscribed to the Google Groups "Repo and Gerrit Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to repo-discuss...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/repo-discuss/ed19da73-2105-4cfb-8bb7-73c97a0ba91fn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages