pingall not working although links are OK

[Amir Mirzaeinia]

Hello

I am developing some experiments and suddenly faced a problem. the problem is that although my network links are shown to be OK, I cant pingall and nodes are unreachable. I wonder what could be the reason behind it? I did reinstall Mininet-wifi but still having the same issue. I appreciate any help .

thank you

Amir 

[Ramon Fontes]

Hello,

Is NM running? Are stations associated to the APs? Do you have useful information about the flow tables? Which troubleshooting steps did you try? Please describe the issue in details. Otherwise, we won't be able to help you.

Sent from my android

--
You received this message because you are subscribed to the Google Groups "mininet-wifi-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mininet-wifi-dis...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mininet-wifi-discuss/91c7d694-106f-4465-988b-d346fa1b7b8cn%40googlegroups.com.

[Amir Mirzaeinia]

Ramon

thank you for your reply, it seems everything is working fine with examples. I did test pingall on 4address example and see that its working well. the only difference with my topology is that I have a host connected to the ap1. when I add this host to the 4address example I see that the same problem happens again. 

it was working fine till yesterday but now it seems there is something wrong with having a host to my wifi network. I wonder how to fix it?

thank you

[Ramon Fontes]

Is network manager running??? 

Sent from my android

To view this discussion on the web visit https://groups.google.com/d/msgid/mininet-wifi-discuss/730b1737-5087-4095-ba57-0986608d8c3bn%40googlegroups.com.

[Amir Mirzaeinia]

Ramon

I see that nmcli respond and says that "sw disabled" for wifi (..hwsim).

I guess this is related and I may need to. enable it . I am not sure how it got disabled.

thank you

[Ramon Fontes]

Have you ever read the Readme file by any chance? 

https://github.com/intrig-unicamp/mininet-wifi#note

Sent from my android

To view this discussion on the web visit https://groups.google.com/d/msgid/mininet-wifi-discuss/5e572684-4a5f-484e-8ad6-1f335167f1f0n%40googlegroups.com.

[Amir Mirzaeinia]

Ramon

Yes and I also did test  on a VM OVA preconfiguraaed image, it did not worked as before.

I also stoped the network manager that did not also helped. 

By the way, I am working on a Ubuntu 20.04.3 LTS .

Thank you

[Ramon Fontes]

How can I reproduce the issue?

[Amir Mirzaeinia]

Ramon
I can share the topology part of my code but it seems there is something behind the scene, such as some miss configuration
Thank you

[Ramon Fontes]

Dear,

I just ran sample files at /examples and I didn't notice problem with them. I am afraid I cannot reproduce the issue reported by you.

[Amir Mirzaeinia]

Ramon

I can share my screen to show you that even a new image is not working well with its examples and pingall shows unreachable. is there any new update pushed to repo?

thank you

[Ramon Fontes]

Dear,

There is nothing to do unless stopping NM.

[Amir Mirzaeinia]

NM is stopped but nothing is changed. and nodes are unreachable.Do you see any issues with default controller? I am using default controller and I do not mind how routes are filled. I just need them to be reachable.

[Ramon Fontes]

Please run the code in debug mode and try to identify the reason for such a problem. As I said, there is no problem with the  mn-wifi code base. 

[Amir Mirzaeinia]

Ramon,

there is not much information about the debug mode. how I could run in debug mode? is there any documentation online available?

[Ramon Fontes]

http://mininet.org/api/classmininet_1_1log_1_1MininetLogger.html#addc3a56d69b16e86bbfd060da48ba0ac

[Amir Mirzaeinia]

Thank you I found some docs that hopefully will help to fix the issue.

[Amir Mirzaeinia]

Here is the log file I captured and found error messages, I am trying to resolve the issue. any help is appreciated.

thank you

*** errRun: ['which', 'controller'] 

/usr/local/bin/controller

  0*** errRun: ['grep', '-c', 'processor', '/proc/cpuinfo'] 

16

  0*** Setting resource limits

*** Adding stations:

*** errRun: ['which', 'mnexec'] 

/usr/bin/mnexec

  0*** errRun: ['which', 'ip', 'addr'] 

/usr/sbin/ip

  1_popen ['mnexec', '-cdn', 'env', 'PS1=\x7f', 'bash', '--norc', '--noediting', '-is', 'mininet:sta1'] 32996*** sta1 : ('unset HISTFILE; stty -echo; set +m',)

unset HISTFILE; stty -echo; set +m

sta1 _popen ['mnexec', '-cdn', 'env', 'PS1=\x7f', 'bash', '--norc', '--noediting', '-is', 'mininet:sta2'] 32998*** sta2 : ('unset HISTFILE; stty -echo; set +m',)

unset HISTFILE; stty -echo; set +m

sta2 

*** Adding access points:

*** errRun: ['which', 'ovs-vsctl'] 

/usr/bin/ovs-vsctl

  0*** errRun: ['ovs-vsctl', '-t', '1', 'show'] 

58a72e67-c7a3-45fb-a7b2-779cbd3675f9

    ovs_version: "2.13.3"

  0*** errRun: ['ovs-vsctl', '--version'] 

ovs-vsctl (Open vSwitch) 2.13.3

DB Schema 8.2.0

  0_popen ['mnexec', '-cd', 'env', 'PS1=\x7f', 'bash', '--norc', '--noediting', '-is', 'mininet:ap1'] 33003*** ap1 : ('unset HISTFILE; stty -echo; set +m',)

unset HISTFILE; stty -echo; set +m

added intf lo (0) to node ap1

*** ap1 : ('ifconfig', 'lo', 'up')

ap1 

*** Configuring wifi nodes...

Loading 3 virtual wifi interfaces

Created mac80211_hwsim device with ID 0

Created mac80211_hwsim device with ID 1

Created mac80211_hwsim device with ID 2

rfkill unblock 37

*** sta1 : ('ip link set wlan0 down',)

*** sta1 : ('ip link set wlan0 name sta1-wlan0',)

rfkill unblock 38

*** sta2 : ('ip link set wlan1 down',)

*** sta2 : ('ip link set wlan1 name sta2-wlan0',)

*** ap1 : ('ip link set wlan2 down',)

*** ap1 : ('ip link set wlan2 name ap1-wlan1',)

*** ap1 : ('ip link set ap1-wlan1 up',)

added intf sta1-wlan0 (0) to node sta1

getting mac address from sta1-wlan0

_popen ['mnexec', '-da', '32996', 'ip', 'addr', 'show', 'sta1-wlan0'] 33117

02:00:00:00:00:00*** sta1 : ('ip addr flush ', 'sta1-wlan0')

*** sta1 : ('ip addr add 10.0.0.1/8 brd + dev sta1-wlan0 && ip -6 addr add 2001:0:0:0:0:0:0:1/64 dev sta1-wlan0',)

*** sta1 : ('ip -6 addr flush ', 'sta1-wlan0')

*** sta1 : ('ip -6 addr add', '2001:0:0:0:0:0:0:1/64', 'dev', 'sta1-wlan0')

*** sta1 : ('ip link set lo up',)

added intf sta2-wlan0 (0) to node sta2

getting mac address from sta2-wlan0

_popen ['mnexec', '-da', '32998', 'ip', 'addr', 'show', 'sta2-wlan0'] 33131

02:00:00:00:01:00*** sta2 : ('ip addr flush ', 'sta2-wlan0')

*** sta2 : ('ip addr add 10.0.0.2/8 brd + dev sta2-wlan0 && ip -6 addr add 2001:0:0:0:0:0:0:2/64 dev sta2-wlan0',)

*** sta2 : ('ip -6 addr flush ', 'sta2-wlan0')

*** sta2 : ('ip -6 addr add', '2001:0:0:0:0:0:0:2/64', 'dev', 'sta2-wlan0')

*** sta2 : ('ip link set lo up',)

added intf ap1-wlan1 (1) to node ap1

*** ap1 : ('ip link set', 'ap1-wlan1', 'up')

*** ap1 : ('ethtool -K', <WirelessLink ap1-wlan1>, 'gro', 'off')

getting mac address from ap1-wlan1

_popen ['mnexec', '-da', '33003', 'ip', 'addr', 'show', 'ap1-wlan1'] 33140

02:00:00:00:02:00*** ap1 : ('ip link set', 'ap1-wlan1', 'down')

*** ap1 : ('ip link set', 'ap1-wlan1', 'address', '02:00:00:00:02:00')

*** ap1 : ('ip link set', 'ap1-wlan1', 'up')

*** ap1 : ("echo 'interface=ap1-wlan1\ndriver=nl80211\nssid=my-ssid\nwds_sta=1\nhw_mode=g\nchannel=1\nctrl_interface=/var/run/hostapd\nctrl_interface_group=0' > mn32973_ap1-wlan1.apconf",)

> > > > > > > *** ap1 : ('hostapd -B mn32973_ap1-wlan1.apconf ',)

ap1-wlan1: interface state UNINITIALIZED->ENABLED

ap1-wlan1: AP-ENABLED 

*** ap1 : ('ip link set', 'ap1-wlan1', 'down')

*** ap1 : ('ip link set', 'ap1-wlan1', 'address', '02:00:00:00:02:00')

*** ap1 : ('ip link set', 'ap1-wlan1', 'up')

_popen ['mnexec', '-da', '33003', 'tc', 'qdisc', 'replace', 'dev', 'ap1-wlan1', 'root', 'handle', '2:', 'netem', 'rate', '54.0000mbit', 'latency', '1.00ms'] 33153*** ap1 : ('tc qdisc add dev ap1-wlan1 parent 2:1 handle 10: pfifo limit 1000',)

*** sta1 : ('iw dev', 'sta1-wlan0 set txpower fixed 1400')

*** sta2 : ('iw dev', 'sta2-wlan0 set txpower fixed 1400')

*** ap1 : ('iw dev', 'ap1-wlan1 set txpower fixed 1400')

*** Creating network

*** Adding controller

*** errRun: ['which', 'mnexec'] 

/usr/bin/mnexec

  0*** errRun: ['which', 'ifconfig'] 

/usr/sbin/ifconfig

  0_popen ['mnexec', '-cd', 'env', 'PS1=\x7f', 'bash', '--norc', '--noediting', '-is', 'mininet:c0'] 33160*** c0 : ('unset HISTFILE; stty -echo; set +m',)

unset HISTFILE; stty -echo; set +m

*** errRun: ['which', 'telnet'] 

/usr/bin/telnet

  0*** c0 : ('echo A | telnet -e A 127.0.0.1 6653',)

Telnet escape character is 'A'.

Trying 127.0.0.1...

telnet: Unable to connect to remote host: Connection refused

*** Adding hosts:

*** Adding switches:

*** Adding links:

added intf sta1-wlan0 (0) to node sta1

*** sta1 : ('ip link set', 'sta1-wlan0', 'up')

*** sta1 : ('ethtool -K', <WirelessLink sta1-wlan0>, 'gro', 'off')

 *** executing command: tc qdisc show dev sta1-wlan0

*** sta1 : ('tc qdisc show dev sta1-wlan0',)

qdisc mq 0: root 

qdisc fq_codel 0: parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

qdisc fq_codel 0: parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

qdisc fq_codel 0: parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

qdisc fq_codel 0: parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

at map stage w/cmds: ['%s qdisc add dev %s root handle 5:0 htb default 1', '%s class add dev %s parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k']

 *** executing command: tc qdisc add dev sta1-wlan0 root handle 5:0 htb default 1

*** sta1 : ('tc qdisc add dev sta1-wlan0 root handle 5:0 htb default 1',)

 *** executing command: tc class add dev sta1-wlan0 parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k

*** sta1 : ('tc class add dev sta1-wlan0 parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k',)

cmds: ['%s qdisc add dev %s root handle 5:0 htb default 1', '%s class add dev %s parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k'] 

outputs: ['', ''] 

_popen ['mnexec', '-da', '32996', 'iwconfig', 'sta1-wlan0', 'essid', 'my-ssid', 'ap', '02:00:00:00:02:00'] 33170(sta1, ap1) 

added intf sta2-wlan0 (0) to node sta2

*** sta2 : ('ip link set', 'sta2-wlan0', 'up')

*** sta2 : ('ethtool -K', <WirelessLink sta2-wlan0>, 'gro', 'off')

 *** executing command: tc qdisc show dev sta2-wlan0

*** sta2 : ('tc qdisc show dev sta2-wlan0',)

qdisc mq 0: root 

qdisc fq_codel 0: parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

qdisc fq_codel 0: parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

qdisc fq_codel 0: parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

qdisc fq_codel 0: parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn 

at map stage w/cmds: ['%s qdisc add dev %s root handle 5:0 htb default 1', '%s class add dev %s parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k']

 *** executing command: tc qdisc add dev sta2-wlan0 root handle 5:0 htb default 1

*** sta2 : ('tc qdisc add dev sta2-wlan0 root handle 5:0 htb default 1',)

 *** executing command: tc class add dev sta2-wlan0 parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k

*** sta2 : ('tc class add dev sta2-wlan0 parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k',)

cmds: ['%s qdisc add dev %s root handle 5:0 htb default 1', '%s class add dev %s parent 5:0 classid 5:1 htb rate 11.000000Mbit burst 15k'] 

outputs: ['', ''] 

_popen ['mnexec', '-da', '32998', 'iwconfig', 'sta2-wlan0', 'essid', 'my-ssid', 'ap', '02:00:00:00:02:00'] 33176(sta2, ap1) 

*** Configuring nodes

added intf sta1-wlan0 (0) to node sta1

*** sta1 : ('ip link set', 'sta1-wlan0', 'up')

*** sta1 : ('ethtool -K', <WirelessLink sta1-wlan0>, 'gro', 'off')

added intf sta2-wlan0 (0) to node sta2

*** sta2 : ('ip link set', 'sta2-wlan0', 'up')

*** sta2 : ('ethtool -K', <WirelessLink sta2-wlan0>, 'gro', 'off')

*** Starting controller(s)

c0 *** errRun: ['which', 'controller'] 

/usr/local/bin/controller

  0*** c0 : ('controller ptcp:6653 1>/tmp/c0.log 2>/tmp/c0.log &',)

[1] 33182

*** Starting L2 nodes

ap1 ...*** errRun: ovs-vsctl -- --id=@ap1c0 create Controller target=\"tcp:127.0.0.1:6653\" max_backoff=1000 -- --id=@ap1-listen create Controller target=\"ptcp:6634\" max_backoff=1000 -- --if-exists del-br ap1 -- add-br ap1 -- set bridge ap1 controller=[@ap1c0,@ap1-listen] other_config:datapath-id=1000000000000001 fail_mode=secure other-config:disable-in-band=true other-config:dp-desc=ap1 -- add-port ap1 ap1-wlan1 -- set Interface ap1-wlan1 ofport_request=1 

afee6790-283d-4146-a4cd-dc49727361d2

ffcf0623-ed01-47e4-92e4-225a95529df2

  0

*** Starting CLI:

*** errRun: ['stty', 'echo', 'sane', 'intr', '^C'] 

  0mininet-wifi> 

[Amir Mirzaeinia]

here is the loss message.

mininet-wifi> pingall

*** Ping: testing ping reachability

sta1 -> *** sta1 : ('ping -c1  10.0.0.2',)

PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data.

From 10.0.0.1 icmp_seq=1 Destination Host Unreachable

--- 10.0.0.2 ping statistics ---

1 packets transmitted, 0 received, +1 errors, 100% packet loss, time 0ms

X 

sta2 -> *** sta2 : ('ping -c1  10.0.0.1',)

PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data.

From 10.0.0.2 icmp_seq=1 Destination Host Unreachable

--- 10.0.0.1 ping statistics ---

1 packets transmitted, 0 received, +1 errors, 100% packet loss, time 0ms

X 

*** Results: 100% dropped (0/2 received)

[Ramon Fontes]

Dear Amir,

You can also debug your experiment with wireless tools such as iw/iwconfig. If you run sta1 iw dev sta1-wlan0 will probably see that sta1 is not associated with ap1. You can also use "iw dev sta1-wlan0 scan" and see what happens. If you can see no ap this means that hostapd is not working property in your host - this means that network manager is causing problems with your hostapd instance.

[Ramon Fontes]

sta1 iw dev sta1-wlan0 link*

[Amir Mirzaeinia]

Thank you Ramon, I check them. 

[Amir Mirzaeinia]

it shows thats ta is connected as following :

ininet-wifi> sta1 iw dev sta1-wlan0 link

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Connected to 02:00:00:00:02:00 (on sta1-wlan0)

SSID: my-ssid

freq: 2412

RX: 507200 bytes (11602 packets)

TX: 525 bytes (20 packets)

signal: -36 dBm

tx bitrate: 1.0 MBit/s

bss flags: short-slot-time

dtim period: 2

beacon int: 100

[Ramon Fontes]

507200 bytes  (11602 packets) received???? Sorry, you should check your host. There is nothing I can do to help you. There is definitely something wrong with your host.

Sent from my android

--

You received this message because you are subscribed to the Google Groups "mininet-wifi-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mininet-wifi-dis...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/mininet-wifi-discuss/5bffedef-bc14-45d8-9686-0ac59ffb5ddan%40googlegroups.com.

[Amir Mirzaeinia]

thank you for your great point, I did not notice since I am trying my experiment on aa large number of flows. 

following capture shows that something is leaking to my host, maybe OVS issues.without running any traffic, RX is just increasing each time that I try the IW command.

mininet-wifi> sta1 iw dev sta1-wlan0 link

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Connected to 02:00:00:00:02:00 (on sta1-wlan0)

SSID: my-ssid

freq: 2412

RX: 12923 bytes (270 packets)

TX: 93 bytes (2 packets)

signal: -36 dBm

tx bitrate: 1.0 MBit/s

bss flags: short-slot-time

dtim period: 2

beacon int: 100

mininet-wifi> sta1 iw dev sta1-wlan0 link

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Connected to 02:00:00:00:02:00 (on sta1-wlan0)

SSID: my-ssid

freq: 2412

RX: 16665 bytes (355 packets)

TX: 93 bytes (2 packets)

signal: -36 dBm

tx bitrate: 1.0 MBit/s

bss flags: short-slot-time

dtim period: 2

beacon int: 100

mininet-wifi> sta1 iw dev sta1-wlan0 link

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Connected to 02:00:00:00:02:00 (on sta1-wlan0)

SSID: my-ssid

freq: 2412

RX: 40551 bytes (899 packets)

TX: 117 bytes (3 packets)

signal: -36 dBm

tx bitrate: 1.0 MBit/s

bss flags: short-slot-time

dtim period: 2

beacon int: 100

mininet-wifi> 

[Amir Mirzaeinia]

however, tshark is not able to capture any packets on sta1.

mininet-wifi> sta1 iw dev sta1-wlan0 link

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Connected to 02:00:00:00:02:00 (on sta1-wlan0)

SSID: my-ssid

freq: 2412

RX: 623643 bytes (14283 packets)

TX: 645 bytes (25 packets)

signal: -36 dBm

tx bitrate: 1.0 MBit/s

bss flags: short-slot-time

dtim period: 2

beacon int: 100

mininet-wifi> sta1 tshark -i sta1-wlan0

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Running as user "root" and group "root". This could be dangerous.

Capturing on 'sta1-wlan0'

^CsendInt: writing chr(3)

0 packets captured

mininet-wifi> sta1 iw dev sta1-wlan0 link

*** errRun: ['stty', '-icanon', 'min', '1'] 

  0Connected to 02:00:00:00:02:00 (on sta1-wlan0)

SSID: my-ssid

freq: 2412

RX: 644088 bytes (14753 packets)

TX: 669 bytes (26 packets)

signal: -36 dBm

tx bitrate: 1.0 MBit/s

bss flags: short-slot-time

dtim period: 2

beacon int: 100

mininet-wifi> 

[Amir Mirzaeinia]

I just learn that all those small packets are normal control packets. if testing some more cases I see that sometimes sta is not showing connection.

mininet-wifi> sta1 iw dev sta1-wlan0 link

Not connected.

I wonder what could be reason behind this?

thank you

[Ramon Fontes]

They are 802.11 frames. You should do the same with sta2.

Sent from my android

To view this discussion on the web visit https://groups.google.com/d/msgid/mininet-wifi-discuss/f19fc921-55d4-4932-92ab-97111f85fe28n%40googlegroups.com.

[Amir Mirzaeinia]

it looks like a automatic shutdown to control an attack when large number of flow request experiments is running on your system. 

[Amir Mirzaeinia]

Roman

I also noticed thats ip link shows "state DOWN and mode DORMANT"

I searched for the Dormant mode in Mininet-wifi but there is not much information. there. I wonder how this could be fixed in mininet wifi?

thank you

[Ramon Fontes]

Dear,

There is no dormant mode in Mininet-WiFi. This is not particular to mn-wifi. You are using the kernel stack! :(  I'm pretty sure you will find a lot of documentation on this on the Internet.

Sent from my android

To view this discussion on the web visit https://groups.google.com/d/msgid/mininet-wifi-discuss/a9a13a4b-c1e2-436a-86fc-4700a67cb4b0n%40googlegroups.com.

[Amir Mirzaeinia]

Dear after some more exploration, I see that there is not result for IWlist X scan.