What speeds do you guys get?

30 views
Skip to first unread message

AaronJAnderson

unread,
Jan 24, 2011, 10:35:48 AM1/24/11
to DataStorageUnit
I'm a new "test" user... Getting around 77.20kB/s upload and
download....

How about you guys?

chaumurky

unread,
Jan 24, 2011, 3:13:12 PM1/24/11
to DataStorageUnit
30kB/sec from Sydney, Australia. My ADSL upload capacity is about 125
kB/sec.

remke

unread,
Jan 24, 2011, 3:40:29 PM1/24/11
to DataStorageUnit
Using sshfs: 60KB/sec - 45 KB/sec (upload) :((
~remke
(using encfs wil slow down the upload even more ...)

John Wooton

unread,
Jan 24, 2011, 4:41:28 PM1/24/11
to datasto...@googlegroups.com
Current netstat output...  Just to contribute to the conversation.  I get better upload/download speeds than all those mentioned...but I'm in the same state of course.  I'm seeing 150+ upload and well over 500+ download.  Also, this amount of activity is higher than average as well.


Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode       PID/Program name
tcp        0      0 172.16.10.51:22         76.93.***.***:38949     ESTABLISHED 0          1108451     17711/sshd: jse*** 
tcp        0      0 172.16.10.51:22         203.153..***.***:56655   ESTABLISHED 0          702309      13365/sshd: api***
tcp        0      0 172.16.10.51:22         65.98..***.***:36250     ESTABLISHED 0          105672      23845/sshd: cap***
tcp        0      0 172.16.10.51:22         91.135..***.***:41950      ESTABLISHED 0          886602      14731/sshd: wil*****
tcp        0      0 172.16.10.51:22         91.135..***.***:53377      ESTABLISHED 0          526433      5292/sshd: wil*****
tcp        0     48 172.16.10.51:22         174.37..***.***:51829     ESTABLISHED 0          168233      10007/sshd: kin****
tcp        0      0 172.16.10.51:22         71.252..***.***:29968     ESTABLISHED 0          1094899     12749/sshd: rn****
tcp        0      0 172.16.10.51:22         203.153..***.***:40853   ESTABLISHED 0          712213      16172/sshd: api****
tcp        0      0 172.16.10.51:22         173.190..***.***:46871    ESTABLISHED 0          1109411     18002/sshd: admin [p
tcp        0      0 172.16.10.51:22         82.168..***.***:29134     ESTABLISHED 0          1101560     15984/sshd: rsc****
tcp        0      0 172.16.10.51:22         203.153..***.***:52251   ESTABLISHED 0          709026      15158/sshd: api***
tcp        0      0 172.16.10.51:22         98.217..***.***:44302      ESTABLISHED 0          712080      16092/sshd: emp****
tcp        0      0 172.16.10.51:22         173.9..***.***:17832     ESTABLISHED 0          1096018     13334/sshd: dlw***
tcp        0     64 172.16.10.51:22         80.202..***.***:58658     ESTABLISHED 0          1108871     17820/sshd: fre****
tcp        0      0 172.16.10.51:22         124.168..***.***:53839     ESTABLISHED 0          1100265     15352/sshd: cha****

Uncletall

unread,
Jan 24, 2011, 11:02:30 PM1/24/11
to DataStorageUnit
I think there are some issues with the server at the moment. The CPU
load is very high due to truecrypt running by root (230% cpu usage at
times)

I have been uploading some stuff over the last few days and have only
been able to upload 50-60MB/hr, that's around 15kB/s..

Just done a test by uploading a movie to my office in the Netherlands,
I can upload at around 180kB/s sustained from Singapore to the
Netherlands.
When I try the same with the datastorageunit server I only get 16kB/s.
For both uploads I used rsync

Also, when I try to run the du -sh command to check my usage it
doesn't return, I assume due to high CPU/Disk load..

Anybody else experiencing these issues?

Fish Kungfu

unread,
Jan 24, 2011, 11:30:05 PM1/24/11
to datasto...@googlegroups.com
Uncletall...

I get a quick response when I use "du -sh" if I give the path to my home folder.  You may want to try this:

$ du -sh /home/`whoami`

Cheers...Fish

Rusty Nejdl

unread,
Jan 31, 2011, 10:53:45 AM1/31/11
to DataStorageUnit
I am seeing pretty horrible speeds as well and this has me very
concerned that I won't be able to do backups with this service.

rnejdl/Downloads/scene.org/fr-041_debris.zip
183462 100% 121.38kB/s 0:00:01 (xfer#190196, to-
check=1062/213566)

That's pretty consistent across my rysnc operations. About 120KB/s
over SSH. I'm open to suggestions on if this is a network, server, or
protocol issue.

Rusty Nejdl

On Jan 24, 10:30 pm, Fish Kungfu <fish.kun...@gmail.com> wrote:
> Uncletall...
>
> I get a quick response when I use "du -sh" if I give the path to my home
> folder.  You may want to try this:
>
> $ du -sh /home/`whoami`
>
> Cheers...Fish
>

knnniggett

unread,
Jan 31, 2011, 4:21:39 PM1/31/11
to DataStorageUnit
I seem to recall 1xx KB/s transfer speeds to be pretty normal. That's
plenty fast for my purposes. I am in the Midwestern United Sates.

Transfers have been running great via cron job. Honestly, I have not
checked upload speeds recently. I have re-enabled some verbosity to my
upload script, but it won't be until Wednesday afternoon when I will
have some data.

knnniggett

unread,
Feb 4, 2011, 7:00:12 PM2/4/11
to DataStorageUnit
Here is a sample of one of my uploads:

bauerhaus/bauerhaus_full.02.03.2011.1.dar
2147483648 100% 95.23kB/s 6:07:00 (xfer#1, to-check=6/8)
bauerhaus/bauerhaus_full.02.03.2011.2.dar
2147483648 100% 75.79kB/s 7:41:08 (xfer#2, to-check=5/8)
bauerhaus/bauerhaus_full.02.03.2011.3.dar
2147483648 100% 79.44kB/s 7:20:00 (xfer#3, to-check=4/8)

In my experience, these rates are faster than Memopal and about the
same as Mozy Home Edition. Your mileage may vary.

My chosen transfer method is rsync -> encfs -> sshfs. Consequently,
these transfer rates are likely slower than what one could get via
other methods.

chaumurky

unread,
Feb 8, 2011, 6:35:20 PM2/8/11
to DataStorageUnit
My speeds have dropped down to between 13 and 25 kB/sec upload since
my last post.

My file deltas are too great for my overnight backups to keep up so I
might have to consider a more local service which is really
unfortunate. :(

John - DataStorageUnit - Owner

unread,
Feb 10, 2011, 11:04:14 AM2/10/11
to DataStorageUnit
Just a quick note:

Anyone using the DD-WRT firmware on their linksys router should be
suspicious of that. That has caused problems for at least 3 different
subscribers I know of. That being the case, it's worth bypassing your
router altogether just to be sure.

However, there may be some instances due to the number of hops between
the server and your end...it's just going to be slow. At least that's
my guess as to why some folks experience slow speeds when others
dont. Typically these are people coming from another country.
> > > > > > Anybody else experiencing these issues?- Hide quoted text -
>
> - Show quoted text -

Rusty Nejdl

unread,
Feb 10, 2011, 11:24:03 AM2/10/11
to datasto...@googlegroups.com
John,

My rates are fluctuating between 60 and 120 kbps and it looks like it will take over a month to transfer 300gb.  That isn't going to work.  I'm directly connected to verizon fios with no router.  How can I use rsync without ssh to see if that helps?  What speed can your server support?

Rusty Nejdl



-- Sent from my Palm Pre


John Wooton

unread,
Feb 10, 2011, 12:09:06 PM2/10/11
to datasto...@googlegroups.com

Those rates actually seem pretty decent to me.  Best case with the hosting datacenter would be in the neighborhood of 300-500 Kbps...and that would be rare.

On Feb 10, 2011 11:24 AM, "Rusty Nejdl" <rne...@gmail.com> wrote:
> John,
>
> My rates are fluctuating between 60 and 120 kbps and it looks like it will take over a month to transfer 300gb. &nbsp;That isn't going to work. &nbsp;I'm directly connected to verizon fios with no router. &nbsp;How can I use rsync without ssh to see if that helps? &nbsp;What speed can your server support?

>
> Rusty Nejdl
>
>
>
> -- Sent from my Palm Pre
> On Feb 10, 2011 10:04 AM, John - DataStorageUnit - Owner &lt;jo...@datastorageunit.com&gt; wrote:
>
> Just a quick note:
>
>
>
> Anyone using the DD-WRT firmware on their linksys router should be
>
> suspicious of that. That has caused problems for at least 3 different
>
> subscribers I know of. That being the case, it's worth bypassing your
>
> router altogether just to be sure.
>
>
>
> However, there may be some instances due to the number of hops between
>
> the server and your end...it's just going to be slow. At least that's
>
> my guess as to why some folks experience slow speeds when others
>
> dont. Typically these are people coming from another country.
>
>
>
> On Feb 8, 6:35&nbsp;pm, chaumurky &lt;gshcar...@gmail.com&gt; wrote:
>
> &gt; My speeds have dropped down to between 13 and 25 kB/sec upload since
>
> &gt; my last post.
>
> &gt;
>
> &gt; My file deltas are too great for my overnight backups to keep up so I
>
> &gt; might have to consider a more local service which is really
>
> &gt; unfortunate. :(
>
> &gt;
>
> &gt; On Feb 5, 11:00&nbsp;am, knnniggett &lt;knnnigg...@gmail.com&gt; wrote:
>
> &gt;
>
> &gt;
>
> &gt;
>
> &gt; &gt; Here is a sample of one of my uploads:
>
> &gt;
>
> &gt; &gt; bauerhaus/bauerhaus_full.02.03.2011.1.dar
>
> &gt; &gt; &nbsp; 2147483648 100% &nbsp; 95.23kB/s &nbsp; &nbsp;6:07:00 (xfer#1, to-check=6/8)
>
> &gt; &gt; bauerhaus/bauerhaus_full.02.03.2011.2.dar
>
> &gt; &gt; &nbsp; 2147483648 100% &nbsp; 75.79kB/s &nbsp; &nbsp;7:41:08 (xfer#2, to-check=5/8)
>
> &gt; &gt; bauerhaus/bauerhaus_full.02.03.2011.3.dar
>
> &gt; &gt; &nbsp; 2147483648 100% &nbsp; 79.44kB/s &nbsp; &nbsp;7:20:00 (xfer#3, to-check=4/8)
>
> &gt;
>
> &gt; &gt; In my experience, these rates are faster than Memopal and about the
>
> &gt; &gt; same as Mozy Home Edition. Your mileage may vary.
>
> &gt;
>
> &gt; &gt; My chosen transfer method is rsync -&gt; encfs -&gt; sshfs. Consequently,
>
> &gt; &gt; these transfer rates are likely slower than what one could get via
>
> &gt; &gt; other methods.
>
> &gt;
>
> &gt; &gt; On Jan 31, 3:21&nbsp;pm, knnniggett &lt;knnnigg...@gmail.com&gt; wrote:
>
> &gt;
>
> &gt; &gt; &gt; I seem to recall 1xx KB/s transfer speeds to be pretty normal. That's
>
> &gt; &gt; &gt; plenty fast for my purposes. I am in the Midwestern United Sates.
>
> &gt;
>
> &gt; &gt; &gt; Transfers have been running great via cron job. Honestly, I have not
>
> &gt; &gt; &gt; checked upload speeds recently. I have re-enabled some verbosity to my
>
> &gt; &gt; &gt; upload script, but it won't be until Wednesday afternoon when I will
>
> &gt; &gt; &gt; have some data.
>
> &gt;
>
> &gt; &gt; &gt; On Jan 31, 9:53&nbsp;am, Rusty Nejdl &lt;rne...@gmail.com&gt; wrote:
>
> &gt;
>
> &gt; &gt; &gt; &gt; I am seeing pretty horrible speeds as well and this has me very
>
> &gt; &gt; &gt; &gt; concerned that I won't be able to do backups with this service.
>
> &gt;
>
> &gt; &gt; &gt; &gt; rnejdl/Downloads/scene.org/fr-041_debris.zip
>
> &gt; &gt; &gt; &gt; &nbsp; &nbsp; &nbsp; 183462 100% &nbsp;121.38kB/s &nbsp; &nbsp;0:00:01 (xfer#190196, to-
>
> &gt; &gt; &gt; &gt; check=1062/213566)
>
> &gt;
>
> &gt; &gt; &gt; &gt; That's pretty consistent across my rysnc operations. &nbsp;About 120KB/s
>
> &gt; &gt; &gt; &gt; over SSH. &nbsp;I'm open to suggestions on if this is a network, server, or
>
> &gt; &gt; &gt; &gt; protocol issue.
>
> &gt;
>
> &gt; &gt; &gt; &gt; Rusty Nejdl
>
> &gt;
>
> &gt; &gt; &gt; &gt; On Jan 24, 10:30&nbsp;pm, Fish Kungfu &lt;fish.kun...@gmail.com&gt; wrote:
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; Uncletall...
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; I get a quick response when I use "du -sh" if I give the path to my home
>
> &gt; &gt; &gt; &gt; &gt; folder. &nbsp;You may want to try this:
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; $ du -sh /home/`whoami`
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; Cheers...Fish
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; On Mon, Jan 24, 2011 at 11:02 PM, Uncletall &lt;peter.br...@uncletall.com&gt;wrote:
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; &gt; I think there are some issues with the server at the moment. The CPU
>
> &gt; &gt; &gt; &gt; &gt; &gt; load is very high due to truecrypt running by root (230% cpu usage at
>
> &gt; &gt; &gt; &gt; &gt; &gt; times)
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; &gt; I have been uploading some stuff over the last few days and have only
>
> &gt; &gt; &gt; &gt; &gt; &gt; been able to upload 50-60MB/hr, that's around 15kB/s..
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; &gt; Just done a test by uploading a movie to my office in the Netherlands,
>
> &gt; &gt; &gt; &gt; &gt; &gt; I can upload at around 180kB/s sustained from Singapore to the
>
> &gt; &gt; &gt; &gt; &gt; &gt; Netherlands.
>
> &gt; &gt; &gt; &gt; &gt; &gt; When I try the same with the datastorageunit server I only get 16kB/s.
>
> &gt; &gt; &gt; &gt; &gt; &gt; For both uploads I used rsync
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; &gt; Also, when I try to run the du -sh command to check my usage it
>
> &gt; &gt; &gt; &gt; &gt; &gt; doesn't return, I assume due to high CPU/Disk load..
>
> &gt;
>
> &gt; &gt; &gt; &gt; &gt; &gt; Anybody else experiencing these issues?- Hide quoted text -
>
> &gt;
>
> &gt; - Show quoted text -

Rusty Nejdl

unread,
Feb 10, 2011, 1:43:37 PM2/10/11
to datasto...@googlegroups.com
John,

My rates have dropped to 38.88kB/s.  As I had asked, is there a way I can test data uploading without using SSH to see if that helps?  What is the available maximum bandwidth that your provide can support?  I am trying to figure out what the box I have to work within looks like to come up with solutions.

Rusty Nejdl

John Wooton

unread,
Feb 10, 2011, 3:37:16 PM2/10/11
to datasto...@googlegroups.com
All connections are handled via the openssh-server.
That gives you things like:   sshfs, sftp, scp, rsync. 
You can connect to the web interface  https://storage1.datastorageunit.com:20000 but I doubt it would be any better...I could be wrong.  I usually do my connection testing with sftp using filezilla, but you may have already tried that.

Keep in mind your transfer speed will fluctuate.  Activity often goes up and down...depending on the number of connections.  A week from now you may see drastically different results.  Also, I believe your geographical location can be a factor as well.
Reply all
Reply to author
Forward
0 new messages