Slow transfer speed between EC2 and S3

[sushyad]

Hi,
I am transferring files from EC2 to S3, and the speeds I get are ~1MB/
s. 80MB payload takes around 60-80s. When I do the same thing from
curl, it takes 6-8s. Why an order of magnitude difference in speed? I
played around with the number of threads, https/http, and it did not
help.

Any ideas?

Thanks,

Susheel

[James Murty]

Hi Susheel,

Sorry for the late response, your email got buried amongst others while I was away on holiday.

Are you still seeing this problem? I have tested the 0.5.0 release of JetS3t on one of my EC2 instances using a Synchronize upload and it seems to run reasonably fast, with reported speeds up to 12MB/s though the speed tends to come in bursts. I completed a test 1.5GB upload in 2.5 minutes for an average speed of 10MB/s.

It is quite possible that JetS3t is being inefficient in its upload process as most of my testing has been from computers outside Amazon's network with limited upstream bandwidth, I'll check for potential slowdowns in the codebase.

Cheers,
James