Stitcher experiment result

[Raj Thakkar]

Respected Niky and Sarah,

                                                    I am trying an experiment to send a 50mb file from UTAH (pg-utah) to UKY (pg-uky) using stitcher. I was able to reserve the resources and login the nodes. The transfer process was successful, but i am able to get only 6.7 Mbps throughput. I have a 100Mb/s line reserved in the experiment still i am getting a low throughput. Is there any other way to perform the experiment to get a better throughput. Also attached with this experiment is the rspec used for the experiment and screen shot of the sliver reserved.

Experiment Details:
[omni]
default_cf=portal
users=kbx429
[kbx429]
urn=urn:publicid:IDN+ch.geni.net+user+kbx429

Slice name: tests

Thank you

Regards

Raj Thakkar

 

 

[Nicholas Bastin]

On Tue, Jan 21, 2014 at 1:32 PM, Raj Thakkar <Raj-T...@mocs.utc.edu> wrote:

                                                    I am trying an experiment to send a 50mb file from UTAH (pg-utah) to UKY (pg-uky) using stitcher. I was able to reserve the resources and login the nodes. The transfer process was successful, but i am able to get only 6.7 Mbps throughput. I have a 100Mb/s line reserved in the experiment still i am getting a low throughput. Is there any other way to perform the experiment to get a better throughput. 

How are you doing the transfer?  Have you tuned any network stack parameters on either the client or the server?

--

Nick 

[kbx...@mocs.utc.edu]

I wrote a Client-Server program for transferring files. Upload my Server code on Utah node and Client code on Uky node and then try to send file from Server to Client.

Thank you

Regards

Raj Thakkar

[Niky Riga]

Hi,

Can you please use iperf?

To do that :
* install iperf on both hosts (sudo apt-get install iperf for Ubuntu,
sudo yum install iperf for fedora)
* at the server run iperf -s
* at the client run iperf -c <dataplane_server_ip>

dataplane_server_ip: the ip of the server that is a private ip, if you
can't figure it out, send me the output of ifconfig at the server and i
can tell you what ip to use.

Cheers,
niky

kbx...@mocs.utc.edu wrote:
> I wrote a Client-Server program for transferring files. Upload my Server
> code on Utah node and Client code on Uky node and then try to send file
> from Server to Client.
>
>
> Thank you
>
>
> Regards
> Raj Thakkar
>
> On Tuesday, January 21, 2014 1:47:23 PM UTC-5, nick.bastin wrote:

>> On Tue, Jan 21, 2014 at 1:32 PM, Raj Thakkar<Raj-T...@mocs.utc.edu<javascript:>

[Raj Thakkar]

Hello Niky

                       I have installed iperf in both hosts. The attached files with this email are the screenshots of ifconfig of Server and Client. which one is the dataplane_server_ip?

Thank you

Regards

Raj Thakkar

--
GENI Users is a community supported mailing list, so please help by responding to questions you know the answer to.

If this is your first time posting a question to this list, please review http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to geni-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Leigh Stoller]

> I have installed iperf in both hosts. The attached files with this email are the screenshots of ifconfig of Server and Client. which one is the dataplane_server_ip?

Hi. The vlan858 interfaces are your data plane.

Lbs

[Raj Thakkar]

Thank you Leigh

--
GENI Users is a community supported mailing list, so please help by responding to questions you know the answer to.

If this is your first time posting a question to this list, please review http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
---
You received this message because you are subscribed to the Google Groups "GENI Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to geni-users+...@googlegroups.com.

[Raj Thakkar]

I have tried using iperf on both the hosts and i tried to get the output using etho address and vlan858 address. The outputs are in the attached screenshots. vlan858 took a lot of time for output. I got the client side output and waited a long time to get the server output but it didn't worked. Is there anything else we need to add with iperf?

Thank you

Regards

Raj Thakkar

[Alison Chan]

Just a note, you don't need to sudo iperf. It uses port 5001 for server port which non root users can bind to.

Cheers,

Alison Chan, Kettering University
+1 909 278 7753
(sent from my phone)

[Niky Riga]

You are hitting a known stitching problem with MTU size.

Try this on both client and server:

sudo ifconfig vlan858 mtu 1400

and then try iperf again.

--niky

[Raj Thakkar]

I tried to run MTU command on both the sides but it is giving an error. The attached files with this e-mail are the screen shots for the slice, mtu command with errors on Server and Client side. The error on the client side is

Connect Failed: No route to host. The details regarding the experiment is given below.

Slice name: ukyutah

[omni]
default_cf=portal
users=kbx429
[kbx429]
urn=urn:publicid:IDN+ch.geni.net+user+kbx429

Thank you

Regards

Raj Thakkar

Raj Thakkar wrote:

email to geni-users+unsubscribe@googlegroups.com.

[Niky Riga]

Sorry there is a -i missing from teh command, try:

sudo ifconfig -i vlan859 mtu 1400

--niky

Raj Thakkar wrote:
> I tried to run MTU command on both the sides but it is giving an error. The
> attached files with this e-mail are the screen shots for the slice, mtu
> command with errors on Server and Client side. The error on the client side
> is

> *Connect Failed: No route to host*. The details regarding the experiment is

>>>>> email to geni-users+...@googlegroups.com.

[Raj Thakkar]

Tried with the command with -i but it is showing the error option -i not recognized. The attached screenshots are the output for server and client after adding -i to the command.

Thank you

Regards

Raj Thakkar

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
GENI Users is a community supported mailing list, so please help by responding to questions you know the answer to.

If this is your first time posting a question to this list, please review http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google Groups "GENI Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to geni-users+unsubscribe@googlegroups.com.

[Niky Riga]

I am really sorry, I answered too quickly.

Looking at your previous screenshots setting the MTU succeeded,
the problem is that you do not have a connection between your hosts.

Are you using the same slice and before? In the screenshots you sent
with your interfaces you had vlan858 but now I see vlan859 and vlan857
which makes me believe that this is a different slice than the one we
have been working so far.

Before testing iperf you should make sure that ping at least works using
the 192.168.1.x addresses between your hosts.

--niky


Raj Thakkar wrote:
> Tried with the command with -i but it is showing the error *option -i not
> recognized*. The attached screenshots are the output for server and client

>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>>>
>>>>>>>
>>>>>>>
>> --
>> GENI Users is a community supported mailing list, so please help by
>> responding to questions you know the answer to.
>>
>> If this is your first time posting a question to this list, please review
>> http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
>> --- You received this message because you are subscribed to the Google
>> Groups "GENI Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an

>> email to geni-users+...@googlegroups.com.

[Raj Thakkar]

I will make sure ping works properly before i run the commands. i will check it and send the results.

Thank you

Regards

Raj Thakkar

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
GENI Users is a community supported mailing list, so please help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please review
http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it, send an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
GENI Users is a community supported mailing list, so please help by responding to questions you know the answer to.

If this is your first time posting a question to this list, please review http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google Groups "GENI Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to geni-users+unsubscribe@googlegroups.com.

[Raj Thakkar]

Hello Niky,

                              I have reserved new resources and tried to check the commands using -i but it is still showing the same error. Before running the command i check both the hosts using ping command and it was working fine. I also tried the command without using -i and it showed output. I also change my code i am using for transfer. I am putting vlan address of Server in Client program to do the transfer but it is still not getting a higher throughput. The throughput i am getting is near to 6Mbps. I have attached screen shots for the output of iperf command with this e-mail. Is there any thing else we can use to increase the throughput for the transfer process.

Thank you

Regards

Raj Thakkar

[Niky Riga]

Hi Raj,

Yes you should run the command *without* -i that was my mistake.

It seems to me that iperf is working and you are getting a bandwidth of
73.8Mbps which seems much better than what you are getting with your
program. One suggestion I have while you try to debug your program is to
verify that your traffic is going over the dataplane interface.

To do that you can do a tcpdump on interface vlan854 and on the control
interface and start your transfer, see which interface shows traffic and
what are the headers.

Good luck,
Niky

>>>>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>> GENI Users is a community supported mailing list, so please help by
>>>>> responding to questions you know the answer to.
>>>>>
>>>>> If this is your first time posting a question to this list, please
>>>>> review
>>>>> http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
>>>>> --- You received this message because you are subscribed to the Google
>>>>> Groups "GENI Users" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an

>>>>> email to geni-users+...@googlegroups.com.

>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>
>>>>>
>>> --
>>> GENI Users is a community supported mailing list, so please help by
>>> responding to questions you know the answer to.
>>>
>>> If this is your first time posting a question to this list, please review
>>> http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
>>> --- You received this message because you are subscribed to the Google
>>> Groups "GENI Users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an

>>> email to geni-users+...@googlegroups.com.

[Niky Riga]

After brainstorming a bit, another thing you might want to try is to
use scp, ftp, http to transfer your file instead of your program since
these are standard tools and see what performance you get.

ftpd and httpd are not installed in the node so you will have to install
them and configure them. SCP should be installed though.

To try it with scp you have to do the following:
1. from your local computer (your laptop) do
* ssh -A <username>@<client> -p <port>
2. once you are logged in to the client do
* scp <server_192.168_ip>:<path to the flie> ./

scp is also encrypting the transmission so it should be slower than your
program.

Good luck,
NIky

[Raj Thakkar]

Thank you Niky. I will the try it and let you know about the experiment updates.

Thank you

Regards'

Raj Thakkar 

Niky Riga wrote:

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit
https://groups.google.com/groups/opt_out.



--

GENI Users is a community supported mailing list, so please help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList

--- You received this message because you are subscribed to the
Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it,
send
an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
GENI Users is a community supported mailing list, so please help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it,
send an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
GENI Users is a community supported mailing list, so please help by responding to questions you know the answer to.

If this is your first time posting a question to this list, please review http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google Groups "GENI Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to geni-users+unsubscribe@googlegroups.com.

[Raj Thakkar]

Hello Niky,

                               I have tried the scp command to transfer file between remote hosts and there is an error in the output which is Host key verification failed Lost Connection. The command i am using to transfer the file is

scp -P 22 kbx...@pc5.instageni.illinios.edu:java/50mb.rar [Remote Server] kbx...@pc50.uky.emulab.net:java/ [Remote Client]. The screen shot of the output is attached with this e-mail. Let me know if i need to add something in the command for the transfer process.

Thank you

Regards

Raj Thakkar

[Niky Riga]

HI Raj,

You are trying to scp through the control interface after ssh-ing to the
client using the -A option (look at my previous email) then at the
client you should do:

scp <server_192.168_ip>:java/50mb.rar ./

notice that before the file you have to use the *dataplane server IP*
the one that starts with *192.168*

--niky

Raj Thakkar wrote:
> Hello Niky,
>

> I have tried the scp command to transfer

> file between remote hosts and there is an error in the output which is*
> Host key verification failed Lost Connection*. The command i am using to

>>>>>>>>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>>>>>>>>> For more options, visit
>>>>>>>>>>>>>> https://groups.google.com/groups/opt_out.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>
>>>>>>>>>>>>> GENI Users is a community supported mailing list, so please
>>>>>>>>> help by
>>>>>>>>> responding to questions you know the answer to.
>>>>>>>>>
>>>>>>>>> If this is your first time posting a question to this list, please
>>>>>>>>> review

>>>>>>>>> http://groups.geni.net/geni/wiki/GENIExperimenter/
>>>>>>>>> CommunityMailingList
>>>>>>>>>
>>>>>>>>> --- You received this message because you are subscribed to the
>>>>>>>>> Google
>>>>>>>>> Groups "GENI Users" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>>> send
>>>>>>>>> an

>>>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>> GENI Users is a community supported mailing list, so please help by
>>>>>>> responding to questions you know the answer to.
>>>>>>>
>>>>>>> If this is your first time posting a question to this list, please
>>>>>>> review

>>>>>>> http://groups.geni.net/geni/wiki/GENIExperimenter/
>>>>>>> CommunityMailingList
>>>>>>> --- You received this message because you are subscribed to the Google
>>>>>>> Groups "GENI Users" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>> send an

>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>>>
>>>>>>>
>>> --
>>> GENI Users is a community supported mailing list, so please help by
>>> responding to questions you know the answer to.
>>>
>>> If this is your first time posting a question to this list, please review
>>> http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
>>> --- You received this message because you are subscribed to the Google
>>> Groups "GENI Users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an

>>> email to geni-users+...@googlegroups.com.

[Raj Thakkar]

Hello Niky,

                                 I logged into client using ssh -A command and then i tried the command scp <server ip> and the output is given in the screenshot attached with this e-mail. So i need to mention the /users/kbx429 which is my current directory before the file path which is java/50mb.rar?

Thank you

Regards

Raj Thakkar

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit
https://groups.google.com/groups/opt_out.



--

GENI Users is a community supported mailing list, so please

help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/
CommunityMailingList

--- You received this message because you are subscribed to the
Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it,
send
an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.


  --

GENI Users is a community supported mailing list, so please help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/
CommunityMailingList
--- You received this message because you are subscribed to the Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it,
send an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
GENI Users is a community supported mailing list, so please help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please review
http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it, send an

email to geni-users+unsubscribe@googlegroups.com.

[Niky Riga]

Hi Raj,

This is great you made very good progress. You are basically missing the
local directory in your scp command (look for my earlier email):

scp <server_192.168_ip>:<path to the flie> ./

notice the "./" in the end of this command.

BTW, scp is a standard linux tool and there should be plenty of
documentation online in case you run into more problems (also the man
pages are usually very helpful, try "man scp").

Good luck and let us know how the performance looks like,

>>>>>>>>>>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>>>>>>>>>>> For more options, visit
>>>>>>>>>>>>>>>> https://groups.google.com/groups/opt_out.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> GENI Users is a community supported mailing list, so please
>>>>>>>>>>>>>> help by
>>>>>>>>>>> responding to questions you know the answer to.
>>>>>>>>>>>
>>>>>>>>>>> If this is your first time posting a question to this list, please
>>>>>>>>>>> review
>>>>>>>>>>> http://groups.geni.net/geni/wiki/GENIExperimenter/
>>>>>>>>>>> CommunityMailingList
>>>>>>>>>>>
>>>>>>>>>>> --- You received this message because you are subscribed to the
>>>>>>>>>>> Google
>>>>>>>>>>> Groups "GENI Users" group.
>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>>>>> send
>>>>>>>>>>> an

>>>>>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>> GENI Users is a community supported mailing list, so please help by
>>>>>>>>> responding to questions you know the answer to.
>>>>>>>>>
>>>>>>>>> If this is your first time posting a question to this list, please
>>>>>>>>> review
>>>>>>>>> http://groups.geni.net/geni/wiki/GENIExperimenter/
>>>>>>>>> CommunityMailingList
>>>>>>>>> --- You received this message because you are subscribed to the
>>>>>>>>> Google
>>>>>>>>> Groups "GENI Users" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>>> send an

>>>>>>>>> email to geni-users+...@googlegroups.com.

>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>> GENI Users is a community supported mailing list, so please help by
>>>>> responding to questions you know the answer to.
>>>>>
>>>>> If this is your first time posting a question to this list, please
>>>>> review
>>>>> http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
>>>>> --- You received this message because you are subscribed to the Google
>>>>> Groups "GENI Users" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an

>>>>> email to geni-users+...@googlegroups.com.

[Raj Thakkar]

Hello Niky,

                                    I tried the scp command and it worked fine. The transfer process is being done but the throughput is still 9.9 MBps. The attached file with this e-mail is the output of the transfer.

Thank you

Regards

Raj Thakkar

Niky

Raj Thakkar wrote:

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit
https://groups.google.com/groups/opt_out.



--

  GENI Users is a community supported mailing list, so please

help by

responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/
CommunityMailingList

--- You received this message because you are subscribed to the
Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it,
send
an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.


   --

GENI Users is a community supported mailing list, so please help by

responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/
CommunityMailingList
--- You received this message because you are subscribed to the
Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it,
send an

email to geni-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.


  --

GENI Users is a community supported mailing list, so please help by
responding to questions you know the answer to.

If this is your first time posting a question to this list, please
review
http://groups.geni.net/geni/wiki/GENIExperimenter/CommunityMailingList
--- You received this message because you are subscribed to the Google
Groups "GENI Users" group.
To unsubscribe from this group and stop receiving emails from it, send
an

email to geni-users+unsubscribe@googlegroups.com.

[Mark]

Hi Raj,

I think you have a bits v. bytes confusion here.

Your link is reserved at 100Mbps - that's 100 million _bits_ per second.

Your measured throughput in your experiment ranges from 9.9 to 11.8 MB/s - that's 9.9 to 11.8 million _bytes_ per second or 79.2 to 94.4 million _bits_ per second. Allowing for some overhead, I'd say you're getting in the neighborhood of what one would expect.

Mark

To unsubscribe from this group and stop receiving emails from it, send an email to geni-users+...@googlegroups.com.