unable to upload large files (> 1gb ) into irods
91 views
Skip to first unread message
kovid bhardwaj
Aug 2, 2022, 7:19:36 AM8/2/22
to iRODS-Chat
Hi,
I am trying to upload files greater than 1GB into irods. But unable to succeed.
And getting error as below:
remote addresses: <IP > ERROR: connectToRhost Portal: connectTo Rhost <hostname> port 20198 error, status= 305110
remote addresses: <IP> ERROR: putUtil: put error for
/zone1/store/test/CON/NA_TestData/original_data/file1.txt, status=-305110 status=-305110 USER_SOCK_CONNECT_ERR, Connection timed out
remote addresses: <IP> ERROR: putUtil: put error for
/zone1/store/test/CON/NA_TestData/original_data/file1.txt, status=-305110 status=-305110 USER_SOCK_CONNECT_ERR, Connection timed out
small files are uploading without any error.
Can anyone suggest a solution or workaround?
Thanks
Terrell Russell
Aug 2, 2022, 7:59:51 AM8/2/22
to irod...@googlegroups.com
Hi Kovid,
You say small files are working... Is it possible that any file larger than 32MB is not working?
That suggests you need to have the higher ports opened through a firewall somewhere.
Default 20000-20199.
Terrell
--
--
The Integrated Rule-Oriented Data System (iRODS) - https://irods.org
iROD-Chat: http://groups.google.com/group/iROD-Chat
---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/b16813b5-28cc-4887-af31-9114f588ab7dn%40googlegroups.com.
Kovid Bhardwaj
Aug 11, 2022, 4:57:06 AM8/11/22
to iRODS-Chat
Hi,
The error above was somehow fixed after allowing the ports 20000-20199 on firewall, But now i got a new error message similar to what is mentioned below:
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 3877614, errno = 110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: putUtil: put error for /ABC Zone/ABCDataStr/testIC/NA_Test_8.2022/original_data/largeafut_47.txt, status = -27110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2338852, errno = 110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: putUtil: put error for /ABC Zone/ABCDataStr/testIC/NA_Test_8.2022/original_data/largeafut_116.txt, status = -27110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2467556, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 300838, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2409740, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4018076, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 3768416, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1231150, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2086632, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 0, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1354666, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 258586, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4011506, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 35410, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1164204, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 0, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 491300, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1592568, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: putUtil: put error for /ABC Zone/ABCDataStr/testIC/NA_Test_8.2022/original_data/largeafut_250.txt, status = -27104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: [-] /irods/lib/core/src/rcConnect.cpp:285:int rcDisconnect(rcComm_t *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/lib/core/src/sockComm.cpp:97:irods::error sockClientStop(irods::network_object_ptr, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/plugins/network/ssl/libssl.cpp:644:irods::error ssl_client_stop(irods::plugin_context &, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [error shutting down the SSL connection]
largeafut_250.txt has a file size of 0.
remote addresses: <irods server IP> ERROR: putUtil: put error for /ABC Zone/ABCDataStr/testIC/NA_Test_8.2022/original_data/largeafut_47.txt, status = -27110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2338852, errno = 110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: putUtil: put error for /ABC Zone/ABCDataStr/testIC/NA_Test_8.2022/original_data/largeafut_116.txt, status = -27110 status = -27110 SYS_COPY_LEN_ERR, Connection timed out
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2467556, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 300838, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2409740, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4018076, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 3768416, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1231150, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2086632, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 0, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1354666, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 258586, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4011506, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 35410, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1164204, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 0, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 491300, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1592568, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: putUtil: put error for /ABC Zone/ABCDataStr/testIC/NA_Test_8.2022/original_data/largeafut_250.txt, status = -27104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: [-] /irods/lib/core/src/rcConnect.cpp:285:int rcDisconnect(rcComm_t *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/lib/core/src/sockComm.cpp:97:irods::error sockClientStop(irods::network_object_ptr, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/plugins/network/ssl/libssl.cpp:644:irods::error ssl_client_stop(irods::plugin_context &, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [error shutting down the SSL connection]
largeafut_250.txt has a file size of 0.
Could you please help me to find what could be the reason behind this error?
Thanks
Terrell Russell
Aug 25, 2022, 7:15:57 PM8/25/22
to irod...@googlegroups.com
Did you get this to work? I expect the ports are being blocked in the other direction as well.
Terrell
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/b0865288-1781-4c83-886d-62583831ad04n%40googlegroups.com.
Kovid Bhardwaj
Sep 16, 2022, 11:08:36 PM9/16/22
to iRODS-Chat
Hi,
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 0, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: [-] /irods/lib/core/src/rcConnect.cpp:285:int rcDisconnect(rcComm_t *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/lib/core/src/sockComm.cpp:97:irods::error sockClientStop(irods::network_object_ptr, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/plugins/network/ssl/libssl.cpp:644:irods::error ssl_client_stop(irods::plugin_context &, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [error shutting down the SSL connection]
The file upload works well with small files (~ 30 MB) but fails when trying to upload large files (~1 GB)
The port range 20000 to 20199 is allowed bi-directionally on firewall ,wherein the log states - TCP reset from server.
Is there any other irods service apart from default port 1247 , which needs to run on server so as to open this port range?
Please find below error message :
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2166718, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2361190, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1960488, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1181218, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1066900, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 3175938, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1065450, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1846102, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 625464, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4183776, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4054936, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 923674, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1404598, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 350770, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 694902, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 2361190, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1960488, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1181218, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1066900, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 3175938, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1065450, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1846102, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 625464, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4183776, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 4054936, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 923674, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 1404598, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 350770, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 694902, errno = 104 status = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: rcPartialDataPut: toWrite 4194304, bytesWritten 0, errno = 32 status = -27032 SYS_COPY_LEN_ERR, Broken pipe
remote addresses: <irods server IP> ERROR: putUtil: put error for /AZone/ADataStore/21136/testdata_2022-09-08/original_data/BAY21136_16002 4102_6214101295_S2365_00052_R1_Totaltest_S27_R1_001.g.DAB, status = -27104 s tatus = -27104 SYS_COPY_LEN_ERR, Connection reset by peer
remote addresses: <irods server IP> ERROR: [-] /irods/lib/core/src/rcConnect.cpp:285:int rcDisconnect(rcComm_t *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/lib/core/src/sockComm.cpp:97:irods::error sockClientStop(irods::network_object_ptr, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [failed to call 'client stop']
[-] /irods/plugins/network/ssl/libssl.cpp:644:irods::error ssl_client_stop(irods::plugin_context &, rodsEnv *) : status [SSL_SHUTDOWN_ERROR] errno [] -- message [error shutting down the SSL connection]
remote addresses: <irods server IP> ERROR: putUtil: put error for /AZone/ADataStore/21136/testdata_2022-09-08/original_data/BAY21136_160024102_6214101295_S2365_00052_R1_Totaltest_S27_R1_001.g.DAB, status = -312000 status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: retry putUtil error status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: put error for /AZone/ADataStore/21136/testdata_2022-09-08/original_data/BAY21136_160024102_6214101295_S2365_00052_R1_Totaltest_S27_R1_001.g.DAB, status = -312000 status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: retry putUtil error status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: put error for /AZone/ADataStore/21136/testdata_2022-09-08/original_data/BAY21136_160024102_6214101295_S2365_00052_R1_Totaltest_S27_R1_001.g.DAB, status = -312000 status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: retry putUtil error status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
The command did not complete successfully. Please check input and output paths.
remote addresses: <irods server IP> ERROR: putUtil: retry putUtil error status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: put error for /AZone/ADataStore/21136/testdata_2022-09-08/original_data/BAY21136_160024102_6214101295_S2365_00052_R1_Totaltest_S27_R1_001.g.DAB, status = -312000 status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: retry putUtil error status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: put error for /AZone/ADataStore/21136/testdata_2022-09-08/original_data/BAY21136_160024102_6214101295_S2365_00052_R1_Totaltest_S27_R1_001.g.DAB, status = -312000 status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
remote addresses: <irods server IP> ERROR: putUtil: retry putUtil error status = -312000 OVERWRITE_WITHOUT_FORCE_FLAG
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
New restartFile /home/user1/.irods/wrapper.restart.13734 opened
The command did not complete successfully. Please check input and output paths.
Waiting for your reply.
Alan King
Sep 20, 2022, 9:46:13 PM9/20/22
to irod...@googlegroups.com
The OVERWRITE_WITHOUT_FORCE_FLAG errors and restart files suggest that an incomplete transfer is being restarted. There are also some SSL errors in the logs.
Can you confirm that you can iput a large file to a new logical path without SSL enabled? And if you could also share the iput invocation you are using, that could be helpful as well.
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/2a3c0d09-49e0-448d-b071-1c8375f63cedn%40googlegroups.com.
--
Alan King
Senior Software Developer | iRODS Consortium
Kovid Bhardwaj
Sep 21, 2022, 3:30:12 AM9/21/22
to iRODS-Chat
Hi,
We have current scenario as mentioned below:
There are actually two servers (source - to upload files with iput & destination - irods server). We are trying to upload large file from source to destination after loading irods modules. We are able to upload file (~32 MB) without any issues.
Can you please tell on which server SSL needs to be disabled? Is it the source or destination or both ?
Waiting for your reply.
Kovid Bhardwaj
Sep 21, 2022, 6:51:35 AM9/21/22
to iRODS-Chat
Hi,
We are using "iput -K " to upload large files into irods application.
Alan King
Sep 21, 2022, 10:40:14 AM9/21/22
to irod...@googlegroups.com
For the SSL question, I am just trying to remove some variables to narrow in on what may be happening. So, I was suggesting that we start by disabling SSL on the client and the server and seeing whether large files can transfer. This can be done by setting irods_client_server_policy to "CS_NEG_REFUSE" in the client's irods_environment.json as well as the irods_environment.json file for the service account on the server.
Thanks for providing the iput options you're using. If the SSL configuration changes don't have an effect, we could also try removing the -K option from iput to see if there's any interaction there, though I doubt this will make much difference. I think the SSL interaction will likely reveal something.
Thanks!
To view this discussion on the web visit https://groups.google.com/d/msgid/irod-chat/ec58b00e-1ade-465d-9065-042d796e6f90n%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages