Uploading big files fails via SFTP

[Ben Jago]

Greetings,

Uploading large files (movies) nearly always fails for me via SFTP. It seems that the destination sftp server gets an "unknown message" and stalls and the connection is closed a few minutes later.
I suspect this might be a tricky one to fix as the problem looks like something in SSH Tools (I'll check their bug history).

cheers
Ben


Details

Problem occurs during transfer of a 1.3GB file at around the 70-80% point, i.e. around the 1GB mark.

Client:

Galaxy S2 Android 4.0.3

Foldersync log:

FINER/dk.tacit.android.foldersync 1564 Nov 7, 2012 4:17:55 AM FileSyncEngine: Checking file: /mnt/sdcard/DCIM/Camera/20121105_204914.mp4 (20121105_204914.mp4) - Size: 1270078234 b
FINER/dk.tacit.android.foldersync 1565 Nov 7, 2012 4:17:55 AM FileSyncEngine: File not previously synced
FINER/dk.tacit.android.foldersync 1566 Nov 7, 2012 4:17:55 AM FileSyncEngine: File does not exist at target location
FINER/dk.tacit.android.foldersync 1567 Nov 7, 2012 4:17:55 AM FileSyncEngine: Added transfer task to work pool, continuing...
FINER/dk.tacit.android.foldersync 1568 Nov 7, 2012 4:17:55 AM SyncTransferFileTask: Syncing file: 20121105_204914.mp4
SEVERE/dk.tacit.android.foldersync 1569 Nov 7, 2012 4:41:58 AM SyncTransferFileTask: Exception when transferring file
java.io.IOException: The channel is closed [Unnamed Channel]
    at com.enterprisedt.net.j2ssh.connection.Channel.sendChannelData(SourceFile:236)
    at com.enterprisedt.net.j2ssh.subsystem.SubsystemChannel.sendMessage(SourceFile:72)
    at com.enterprisedt.net.j2ssh.sftp.SftpSubsystemClient.writeFileAsync(SourceFile:857)
    at com.enterprisedt.net.j2ssh.sftp.SftpFileOutputStream.write(SourceFile:130)
    at com.enterprisedt.net.j2ssh.SftpClient.a(SourceFile:637)
    at com.enterprisedt.net.j2ssh.SftpClient.put(SourceFile:1199)
    at com.enterprisedt.net.ftp.ssh.SSHFTPClient.put(SourceFile:1067)
    at yf.a(SourceFile:291)
    at tp.a(SourceFile:223)
    at tp.a(SourceFile:104)
    at tp.call(SourceFile:26)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:305)
    at java.util.concurrent.FutureTask.run(FutureTask.java:137)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:442)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:305)
    at java.util.concurrent.FutureTask.run(FutureTask.java:137)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1076)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:569)
    at java.lang.Thread.run(Thread.java:856)
 
FINER/dk.tacit.android.foldersync 1570 Nov 7, 2012 4:41:58 AM EdtFtpProvider2: Creating new connection client...
FINER/dk.tacit.android.foldersync 1571 Nov 7, 2012 4:42:00 AM EdtFtpProvider2: Mapping FTPFile to FileInfo:20121105_204914.mp4.tacitpart
FINER/dk.tacit.android.foldersync 1572 Nov 7, 2012 4:42:03 AM SyncTransferFileTask: Syncing file: 20121105_204914.mp4
FINER/dk.tacit.android.foldersync 1573 Nov 7, 2012 4:44:10 AM FolderSync.SyncManager: Sync cancelled
FINER/dk.tacit.android.foldersync 1574 Nov 7, 2012 4:44:11 AM FolderSync.SyncManager: Sync cancelled
SEVERE/dk.tacit.android.foldersync 1575 Nov 7, 2012 4:44:11 AM SyncTransferFileTask: Exception when transferring file
com.enterprisedt.net.ftp.FTPTransferCancelledException: Transfer was cancelled
    at com.enterprisedt.net.j2ssh.SftpClient.a(SourceFile:633)
    at com.enterprisedt.net.j2ssh.SftpClient.put(SourceFile:1199)
    at com.enterprisedt.net.ftp.ssh.SSHFTPClient.put(SourceFile:1067)
    at yf.a(SourceFile:291)
    at tp.a(SourceFile:223)
    at tp.a(SourceFile:104)
    at tp.call(SourceFile:26)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:305)
    at java.util.concurrent.FutureTask.run(FutureTask.java:137)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:442)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:305)
    at java.util.concurrent.FutureTask.run(FutureTask.java:137)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1076)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:569)
    at java.lang.Thread.run(Thread.java:856)
 
FINER/dk.tacit.android.foldersync 1576 Nov 7, 2012 4:44:12 AM EdtFtpProvider2: Mapping FTPFile to FileInfo:20121105_204914.mp4.tacitpart
FINER/dk.tacit.android.foldersync 1577 Nov 7, 2012 4:44:15 AM FileSyncEngine: Checking file: /mnt/sdcard/DCIM/Camera/20121105_210112.mp4 (20121105_210112.mp4) - Size: 298858 b
FINER/dk.tacit.android.foldersync 1578 Nov 7, 2012 4:44:15 AM FileSyncEngine: Syncing complete - status = SyncFailed
FINER/dk.tacit.android.foldersync 1579 Nov 7, 2012 4:44:15 AM FolderSync.SyncFolderTask: Saving folderpair state
FINER/dk.tacit.android.foldersync 1580 Nov 7, 2012 4:44:16 AM SyncServiceController: stopService
FINER/dk.tacit.android.foldersync 1581 Nov 7, 2012 4:44:16 AM WakeLockManager: Releasing wifiLock
FINER/dk.tacit.android.foldersync 1582 Nov 7, 2012 4:44:16 AM WakeLockManager: Releasing wakeLock




Server:
Fedora 16 Linux, openssh-server-5.8p2-25.fc16.x86_64
Server log:
Nov  6 04:30:29 study sftp-server[2970]: error: Unknown message 0
Nov  6 04:30:29 study sftp-server[2970]: error: bad message from 192.168.0.112 local user ben

[Support User]

To be honest I have no idea why it would fail, or how to go about fixing it. I do find it strange it happens around the 1 GB mark, but there is no limitation in that regard in Foldersync.

Best regards

Anders Carlsen

Software Developer

If you like our apps, please give them a 5-star rating. Thanks. :-)

 

Tacit Dynamics

www.tacit.dk - Android Market - Support