UploadAPI fails with large files

26 views
Skip to first unread message

Elvis Valdes Ramirez

unread,
Aug 5, 2024, 4:07:55 PM8/5/24
to pyPreservica
Hi There,
I'm using the UploadAPI() simple_asset_package() to upload files from a folder, two small files and one of 10GB. It fails with a "s3transfer.exceptions.S3UploadFailedError" error after uploading the large 10GB file, and it doesn't ingest the small files. I have configured the UploadAPI() as follows:
GB = 1024 ** 3
upload_config().multipart_threshold = 20*GB
upload_config().use_threads = True
upload_config().max_concurrency = 5

It works fine when the files are small, though fails when the package contains a large one. Any idea of suggestion why is failing would be really appreciated.

Regards,
Elvis
Reply all
Reply to author
Forward
0 new messages