ONOS-SONA -> error when creating a network

311 views
Skip to first unread message

Francesco Foresta

unread,
Dec 2, 2016, 3:23:56 PM12/2/16
to ONOS Discuss
Dear all,

I have deployed SONA over Devstack as described in: https://wiki.onosproject.org/display/ONOS/SONA+Installation+Guide
Everything has been done accordingly to the guide and it seems to be properly set.

The problem comes when I try to create a network: 

stack@controller $ neutron net-create netA
create_network_postcommit failed.
Neutron server returns request_ids: ['req-56888091-96be-4f18-83d5-4262eb00d521']

Checking the q-svc log it is shown that:

2016-12-02 21:17:53.693 ERROR neutron.plugins.ml2.managers [req-56888091-96be-4f18-83d5-4262eb00d521 admin ddc27190761d497fbf6e80b52879a680] Mechanism driver 'onos_ml2' failed in create_network_postcommit
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers   File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 407, in _call_on_drivers
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers   File "/usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers     return method(*args, **kwargs)
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers   File "/usr/local/lib/python2.7/dist-packages/networking_onos/plugins/ml2/driver.py", line 54, in create_network_postcommit
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers     entity_path, {'network': resource})
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers   File "/usr/local/lib/python2.7/dist-packages/networking_onos/common/utils.py", line 38, in send_msg
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers     req.raise_for_status()
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers   File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 840, in raise_for_status
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers     raise HTTPError(http_error_msg, response=self)
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers HTTPError: 404 Client Error: Not Found for url: http://10.134.231.29:8181/onos/openstacknetworking/networks
2016-12-02 21:17:53.693 TRACE neutron.plugins.ml2.managers 
2016-12-02 21:17:53.694 ERROR neutron.plugins.ml2.plugin [req-56888091-96be-4f18-83d5-4262eb00d521 admin ddc27190761d497fbf6e80b52879a680] mechanism_manager.create_network_postcommit failed, deleting network '7797abbc-5ef0-4df0-b2c7-9c34fb5efe9f'

But if I look for the ports listening in the ONOS-deployment machine, it is easy to see that there is the 8181 port open:

developer@sona:~$ sudo netstat -ntl
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State      
tcp        0      0 0.0.0.0:5005            0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN     
tcp        0      0 127.0.0.1:6010          0.0.0.0:*               LISTEN     
tcp6       0      0 :::6633                 :::*                    LISTEN     
tcp6       0      0 :::6640                 :::*                    LISTEN     
tcp6       0      0 :::9876                 :::*                    LISTEN     
tcp6       0      0 :::8181                 :::*                    LISTEN     
tcp6       0      0 :::22                   :::*                    LISTEN     
tcp6       0      0 :::35096                :::*                    LISTEN     
tcp6       0      0 ::1:6010                :::*                    LISTEN     
tcp6       0      0 127.0.0.1:42651         :::*                    LISTEN     
tcp6       0      0 :::6653                 :::*                    LISTEN     
tcp6       0      0 :::8101                 :::*                    LISTEN    

Moreover, the apps deployed by ONOS are those that are required:

onos> apps -a -s
*   4 org.onosproject.optical-model        1.8.0.SNAPSHOT Optical information model
*   6 org.onosproject.ovsdb-base           1.8.0.SNAPSHOT OVSDB Provider
*  13 org.onosproject.openstackinterface   1.8.0.SNAPSHOT OpenStack Interface App
*  16 org.onosproject.drivers.ovsdb        1.8.0.SNAPSHOT OVSDB Device Drivers
*  17 org.onosproject.openstacknode        1.8.0.SNAPSHOT OpenStack Node Bootstrap App
*  18 org.onosproject.scalablegateway      1.8.0.SNAPSHOT Scalable GW App
*  19 org.onosproject.openstackrouting     1.8.0.SNAPSHOT OpenStack Routing App
*  20 org.onosproject.dhcp                 1.8.0.SNAPSHOT DHCP Server App
*  21 org.onosproject.openstackswitching   1.8.0.SNAPSHOT OpenStack Switching App
*  30 org.onosproject.openflow-base        1.8.0.SNAPSHOT OpenFlow Provider
*  43 org.onosproject.drivers              1.8.0.SNAPSHOT Default device drivers

How can I proceed to try to fix this problem?

Thanks in advance!

Francesco

Hyunsun Moon

unread,
Dec 2, 2016, 5:40:51 PM12/2/16
to Francesco Foresta, ONOS Discuss
Hi Francesco,

Is your onos machine IP 10.134.231.29?
It’s exactly the same IP in the example configuration.

Hyunsun


--
You received this message because you are subscribed to the Google Groups "ONOS Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to onos-discuss...@onosproject.org.
To post to this group, send email to onos-d...@onosproject.org.
Visit this group at https://groups.google.com/a/onosproject.org/group/onos-discuss/.
To view this discussion on the web visit https://groups.google.com/a/onosproject.org/d/msgid/onos-discuss/a6ceb2fe-4593-4663-9a64-22c1b2522a0c%40onosproject.org.

Francesco Foresta

unread,
Dec 2, 2016, 6:33:43 PM12/2/16
to ONOS Discuss, inusu...@gmail.com
Hi Hyunsun,

yes, my onos machine IP is at 10.134.231.29, as in the guide. I did it like that to not make confusion.
The controller is able to ping it without any problem, but that problem continues to be present.

The log still says that: Error: Not Found for url: http://10.134.231.29:8181/onos/openstacknetworking/networks
Do you have any idea? May I check something else?

Thank you in advance.
Francesco

Hyunsun Moon

unread,
Dec 2, 2016, 8:07:04 PM12/2/16
to Francesco Foresta, ONOS Discuss
Hi Francesco,

I just found that your active application list does not have org.onosproject.openstacknetworking.
It is a bug. The switching and routing app should activate openstacknetworking app automatically since they have dependency on it.
We’ll fix it soon, thanks!

For now, try activate org.onosproject.openstacknetworking manually.
onos> app activate org.onosproject.openstacknetworking

Hyunsun


Hyunsun Moon

unread,
Dec 2, 2016, 8:20:24 PM12/2/16
to Francesco Foresta, ONOS Discuss
Hmm..I checked the source code but the web bundle is included in the features for both switching and routing.
So it should work without openstacknetworking app, which is just a wrapper app for the switching and routing modules.
Is there any errors or warnings from ONOS?

Hyunsun

Francesco Foresta

unread,
Dec 3, 2016, 5:23:53 AM12/3/16
to ONOS Discuss
Hi Hyunsun,

1) no changes even by adding manually the app (indeed, in the guide that app was not present inside those that have to be deployed once the stc setup finishes)

2) onos does not return any error or warning: the /opt/onos/logs/karaf.log does not contain anything useful.

How can I proceed to try to find where is the error?

Thank you,
Francesco

Hyunsun Moon

unread,
Dec 4, 2016, 2:43:35 AM12/4/16
to Francesco Foresta, ONOS Discuss
Hi Francesco,

Sounds like everything is fine.
One thing in my mind is that we made a change to URL path of SONA module from “/onos/openstackswitching” to “/onos/openstacknetworking” recently.
Could you double check your build has this change?
You can find it onos/apps/openstacknetworking/web/BUCK (or pom.xml) file, web_context field.
I also made a fix for the maven build, since I experienced something weird when I installed the SONA app with maven build oar.
Please Let me know if you have any updates.

Hyunsun
> --
> You received this message because you are subscribed to the Google Groups "ONOS Discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to onos-discuss...@onosproject.org.
> To post to this group, send email to onos-d...@onosproject.org.
> Visit this group at https://groups.google.com/a/onosproject.org/group/onos-discuss/.
> To view this discussion on the web visit https://groups.google.com/a/onosproject.org/d/msgid/onos-discuss/6062b168-c70f-41a0-ba86-2811bbf5ab03%40onosproject.org.

Francesco Foresta

unread,
Dec 4, 2016, 6:38:44 AM12/4/16
to ONOS Discuss, inusu...@gmail.com
Hi Hyunsun,

that was the issue! Now it works, in the sense that it is able to create a new network.
I will continue to go through the walkthrough.

Just a minor update, that may be useful to you to be patched: when dealing with the stc setup, after the buck build onos and the buck build package, I have found multiple times to have Check-Logs-1 failed; then, going to the logs, I have found that the issue was:

2016-12-04 12:17:51,351 | ERROR | FelixStartLevel  | apps-openstacknetworking-routing | 170 - org.onosproject.onos-apps-openstacknetworking-routing - 
1.8.0.SNAPSHOT | [org.onosproject.openstacknetworking.routing.OpenstackRoutingManager(126)] The activate method has thrown an exception
org.onlab.osgi.ServiceNotFoundException: Service org.onosproject.net.host.HostService not found
        at org.onlab.osgi.DefaultServiceDirectory.getService(DefaultServiceDirectory.java:45)
        at org.onlab.osgi.DefaultServiceDirectory.get(DefaultServiceDirectory.java:50)
        at org.onosproject.openstacknetworking.AbstractVmHandler.activate(AbstractVmHandler.java:60)
        at org.onosproject.openstacknetworking.routing.OpenstackRoutingManager.activate(OpenstackRoutingManager.java:107)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[:1.8.0_101]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)[:1.8.0_101]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.8.0_101]
        at java.lang.reflect.Method.invoke(Method.java:498)[:1.8.0_101]
        at org.apache.felix.scr.impl.helper.BaseMethod.invokeMethod(BaseMethod.java:231)[38:org.apache.felix.scr:1.8.2]
        at org.apache.felix.scr.impl.helper.BaseMethod.access$500(BaseMethod.java:39)[38:org.apache.felix.scr:1.8.2]
        at org.apache.felix.scr.impl.helper.BaseMethod$Resolved.invoke(BaseMethod.java:624)[38:org.apache.felix.scr:1.8.2]
        at org.apache.felix.scr.impl.helper.BaseMethod.invoke(BaseMethod.java:508)[38:org.apache.felix.scr:1.8.2]
        at org.apache.felix.scr.impl.helper.ActivateMethod.invoke(ActivateMethod.java:149)[38:org.apache.felix.scr:1.8.2]
        at org.apache.felix.scr.impl.manager.SingleComponentManager.createImplementationObject(SingleComponentManager.java:315)[38:org.apache.felix.sc
r:1.8.2]
(the exception goes on and on for a while...)

However, as I already encountered this in other deployments that I did in the past, by repeating the procedure, it will go properly sooner or later and the logs will note have the error. I do not know if it is something that may be fixed, but I wanted to tell you.

Thank you Hyunsun for your help!

Francesco

worku muluye

unread,
Dec 4, 2016, 10:37:31 AM12/4/16
to Francesco Foresta, ONOS Discuss
Hi all??? How can I solve this problem??
onos@onos-tutorial:~$ onos-install
lost connection
ssh: connect to host 10.0.3.101 port 22: Connection refused
ssh: connect to host 10.0.3.101 port 22: Connection timed out
lost connection
lost connection
ssh: connect to host 10.0.3.101 port 22: Connection timed out
onos@onos-tutorial:~$


To unsubscribe from this group and stop receiving emails from it, send an email to onos-discuss+unsubscribe@onosproject.org.

To post to this group, send email to onos-d...@onosproject.org.
Visit this group at https://groups.google.com/a/onosproject.org/group/onos-discuss/.
To view this discussion on the web visit https://groups.google.com/a/onosproject.org/d/msgid/onos-discuss/c99c405f-d753-4aaf-8f62-7e6e769e6c30%40onosproject.org.

Hyunsun Moon

unread,
Dec 5, 2016, 1:51:56 PM12/5/16
to Francesco Foresta, ONOS Discuss
Hi Francesco,

Glad you made it work. I updated the wiki page about this.
I haven’t seen this error so far and I believe we deprecated 'buck build package’ command a while ago.
Could you try build and package again with ‘onos-buck build onos’ -> ‘onos-package’ -> ‘stc setup’?

Hyunsun


Francesco Foresta

unread,
Dec 6, 2016, 9:37:23 AM12/6/16
to ONOS Discuss, inusu...@gmail.com
Hi Hyunsun,

it still fails sometime.
Thank you anyway.

Francesco

Hyunsun Moon

unread,
Dec 6, 2016, 3:15:46 PM12/6/16
to Francesco Foresta, ONOS Discuss
Hi Francesco,

Sounds like there’s a sort of race.
One way to work around the error until we patch it could be activating the application once the ONOS is stabilized instead of adding it to ONOS_APPS.
Thanks!

Hyunsun



Francesco Foresta

unread,
Dec 6, 2016, 3:19:17 PM12/6/16
to ONOS Discuss, inusu...@gmail.com
That is ok!
Thank you for the support!

Francesco

Francesco Foresta

unread,
Feb 2, 2017, 5:12:31 AM2/2/17
to ONOS Discuss, inusu...@gmail.com
Dear Hyunsun and all,

I had again the same problem regarding SONA not being able to provide neutron services.
My old cluster had to be shut down due to a scheduled blackout.
However, when I started all again even though I had no problem in the deployment, I have issues whenever my OpenStack controller tries to create a network. I have not changed anything from the configuration and files viewpoint.
I am running Mitaka as OpenStack branch as suggested in the installation guide; also the IP addresses are the same of the configuration proposed to not create confusion.

OpenStack controller:
stack@controller:/home/openstack/devstack$ source openrc admin admin
WARNING: setting legacy OS_TENANT_NAME to support cli tools.
stack@controller:/home/openstack/devstack$ neutron net-create netA
create_network_postcommit failed.
Neutron server returns request_ids: ['req-4cbb21b1-e755-4627-bd91-1ec2e897262f']

What I have found in the logs:

2017-02-02 10:27:56.043 DEBUG neutron.api.v2.base [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Request body: {u'network': {u'name': u'netA', u'admin_state_up': True}} from (pid=13696) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:662

2017-02-02 10:27:56.056 DEBUG neutron.db.quota.driver [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Resources subnetpool have unlimited quota limit. It is not required to calculated headroom from (pid=13696) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:170

2017-02-02 10:27:56.062 DEBUG neutron.quota.resource [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Usage tracker for resource:network and tenant:b0a3c67d349840c1aa857441c6b373a2 is out of sync, need to count used quota from (pid=13696) count /opt/stack/neutron/neutron/quota/resource.py:277

2017-02-02 10:27:56.069 DEBUG neutron.quota.resource [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Quota usage for network was recalculated. Used quota:0. from (pid=13696) count /opt/stack/neutron/neutron/quota/resource.py:296

2017-02-02 10:27:56.073 DEBUG neutron.db.quota.driver [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 10; headroom:10 from (pid=13696) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:202

2017-02-02 10:27:56.391 DEBUG neutron.plugins.ml2.drivers.helpers [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] vxlan segment allocate from pool started with {'vxlan_vni': 1071} from (pid=13696) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:142

2017-02-02 10:27:56.397 DEBUG neutron.plugins.ml2.drivers.helpers [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] vxlan segment allocate from pool success with {'vxlan_vni': 1071} from (pid=13696) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:150

2017-02-02 10:27:56.401 INFO neutron.plugins.ml2.db [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Added segment 0be548b7-aac0-45e3-8a37-c8c75e6ba708 of type vxlan for network ab61ea8a-26f6-4beb-8c99-b9466954238a

2017-02-02 10:27:56.458 DEBUG networking_onos.plugins.ml2.driver [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] networking_onos.plugins.ml2.driver.ONOSMechanismDriver method create_network_postcommit called with arguments (<neutron.plugins.ml2.driver_context.NetworkContext object at 0x7f4b64c77fd0>,) {} from (pid=13696) wrapper /usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py:45

2017-02-02 10:27:56.459 DEBUG networking_onos.common.utils [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Sending MSG_TYPE (post) URL (http://10.134.231.29:8181/onos/openstacknetworking/networks) OBJECT ({'network': {'status': 'ACTIVE', 'subnets': [], 'description': '', 'provider:physical_network': None, 'tags': [], 'updated_at': '2017-02-02T09:27:56', 'ipv6_address_scope': None, 'port_security_enabled': True, 'mtu': 1450, 'id': 'ab61ea8a-26f6-4beb-8c99-b9466954238a', 'provider:segmentation_id': 1071, 'router:external': False, 'availability_zone_hints': [], 'availability_zones': [], 'name': u'netA', 'admin_state_up': True, 'tenant_id': u'b0a3c67d349840c1aa857441c6b373a2', 'created_at': '2017-02-02T09:27:56', 'provider:network_type': u'vxlan', 'ipv4_address_scope': None, 'vlan_transparent': None, 'shared': False}}) BODY ({

"network": {

"status": "ACTIVE",

"subnets": [],

"description": "",

"provider:physical_network": null,

"tags": [],

"updated_at": "2017-02-02T09:27:56",

"ipv6_address_scope": null,

"port_security_enabled": true,

"mtu": 1450,

"id": "ab61ea8a-26f6-4beb-8c99-b9466954238a",

"provider:segmentation_id": 1071,

"router:external": false,

"availability_zone_hints": [],

"availability_zones": [],

"name": "netA",

"admin_state_up": true,

"tenant_id": "b0a3c67d349840c1aa857441c6b373a2",

"created_at": "2017-02-02T09:27:56",

"provider:network_type": "vxlan",

"ipv4_address_scope": null,

"vlan_transparent": null,

"shared": false

}

}) from (pid=13696) send_msg /usr/local/lib/python2.7/dist-packages/networking_onos/common/utils.py:33

2017-02-02 10:27:56.467 ERROR neutron.plugins.ml2.managers [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Mechanism driver 'onos_ml2' failed in create_network_postcommit

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 407, in _call_on_drivers

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers return method(*args, **kwargs)

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/networking_onos/plugins/ml2/driver.py", line 54, in create_network_postcommit

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers entity_path, {'network': resource})

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/networking_onos/common/utils.py", line 38, in send_msg

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers req.raise_for_status()

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 840, in raise_for_status

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers raise HTTPError(http_error_msg, response=self)

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers HTTPError: 404 Client Error: Not Found for url: http://10.134.231.29:8181/onos/openstacknetworking/networks

2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers

2017-02-02 10:27:56.468 ERROR neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] mechanism_manager.create_network_postcommit failed, deleting network 'ab61ea8a-26f6-4beb-8c99-b9466954238a'

2017-02-02 10:27:56.468 DEBUG neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Deleting network ab61ea8a-26f6-4beb-8c99-b9466954238a from (pid=13696) delete_network /opt/stack/neutron/neutron/plugins/ml2/plugin.py:801

2017-02-02 10:27:56.483 DEBUG neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Ports to auto-delete: [] from (pid=13696) delete_network /opt/stack/neutron/neutron/plugins/ml2/plugin.py:823

2017-02-02 10:27:56.487 DEBUG neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Subnets to auto-delete: [] from (pid=13696) delete_network /opt/stack/neutron/neutron/plugins/ml2/plugin.py:836

2017-02-02 10:27:56.569 DEBUG neutron.plugins.ml2.drivers.type_tunnel [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Releasing vxlan tunnel 1071 to pool from (pid=13696) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_tunnel.py:230

2017-02-02 10:27:56.637 DEBUG neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Deleting network record <neutron.db.models_v2.Network[object at 7f4b64a56b10] {tenant_id=u'b0a3c67d349840c1aa857441c6b373a2', id=u'ab61ea8a-26f6-4beb-8c99-b9466954238a', name=u'netA', status=u'ACTIVE', admin_state_up=True, mtu=1450, vlan_transparent=None, availability_zone_hints=u'[]', standard_attr_id=17}> from (pid=13696) delete_network /opt/stack/neutron/neutron/plugins/ml2/plugin.py:848

2017-02-02 10:27:56.638 DEBUG neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Committing transaction from (pid=13696) delete_network /opt/stack/neutron/neutron/plugins/ml2/plugin.py:853

2017-02-02 10:27:56.712 DEBUG networking_onos.plugins.ml2.driver [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] networking_onos.plugins.ml2.driver.ONOSMechanismDriver method delete_network_postcommit called with arguments (<neutron.plugins.ml2.driver_context.NetworkContext object at 0x7f4b648d2790>,) {} from (pid=13696) wrapper /usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py:45

2017-02-02 10:27:56.712 DEBUG networking_onos.common.utils [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Sending MSG_TYPE (delete) URL (http://10.134.231.29:8181/onos/openstacknetworking/networks/ab61ea8a-26f6-4beb-8c99-b9466954238a) OBJECT (None) BODY (None) from (pid=13696) send_msg /usr/local/lib/python2.7/dist-packages/networking_onos/common/utils.py:33

2017-02-02 10:27:56.719 ERROR neutron.plugins.ml2.managers [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] Mechanism driver 'onos_ml2' failed in delete_network_postcommit

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 407, in _call_on_drivers

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers return method(*args, **kwargs)

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/networking_onos/plugins/ml2/driver.py", line 67, in delete_network_postcommit

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers entity_path)

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/networking_onos/common/utils.py", line 38, in send_msg

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers req.raise_for_status()

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 840, in raise_for_status

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers raise HTTPError(http_error_msg, response=self)

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers HTTPError: 404 Client Error: Not Found for url: http://10.134.231.29:8181/onos/openstacknetworking/networks/ab61ea8a-26f6-4beb-8c99-b9466954238a

2017-02-02 10:27:56.719 TRACE neutron.plugins.ml2.managers

2017-02-02 10:27:56.720 ERROR neutron.plugins.ml2.plugin [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] mechanism_manager.delete_network_postcommit failed

2017-02-02 10:27:56.721 DEBUG oslo_messaging._drivers.amqpdriver [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] CAST unique_id: 8ab028167b4d4543a541c8c8287d2271 FANOUT topic 'q-agent-notifier-network-delete' from (pid=13696) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:443

2017-02-02 10:27:56.765 ERROR neutron.api.v2.resource [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] create failed

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource Traceback (most recent call last):

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/resource.py", line 84, in resource

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource result = method(request=request, **args)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/base.py", line 410, in create

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource return self._create(request, body, **kwargs)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource ectxt.value = e.inner_exc

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource self.force_reraise()

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource return f(*args, **kwargs)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/base.py", line 521, in _create

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource obj = do_create(body)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/base.py", line 503, in do_create

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource request.context, reservation.reservation_id)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource self.force_reraise()

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/base.py", line 496, in do_create

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource return obj_creator(request.context, **kwargs)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 702, in create_network

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource self.delete_network(context, result['id'])

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource self.force_reraise()

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 697, in create_network

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource self.mechanism_manager.create_network_postcommit(mech_context)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 456, in create_network_postcommit

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource self._call_on_drivers("create_network_postcommit", context)

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 424, in _call_on_drivers

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource method=method_name

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource MechanismDriverError: create_network_postcommit failed.

2017-02-02 10:27:56.765 TRACE neutron.api.v2.resource

2017-02-02 10:27:56.768 INFO neutron.wsgi [req-4cbb21b1-e755-4627-bd91-1ec2e897262f admin b0a3c67d349840c1aa857441c6b373a2] 10.134.231.28 - - [02/Feb/2017 10:27:56] "POST /v2.0/networks.json HTTP/1.1" 500 345 14.106371

2017-02-02 10:27:58.127 DEBUG neutron.db.agents_db [req-b9c20171-d037-4b40-92bf-f172746650fb None None] Agent healthcheck: found 0 active agents from (pid=13517) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:301

2017-02-02 10:28:35.128 DEBUG neutron.db.agents_db [req-b9c20171-d037-4b40-92bf-f172746650fb None None] Agent healthcheck: found 0 active agents from (pid=13517) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:301



Installed applications:

onos> apps -a -s
*   6 org.onosproject.optical-model        1.8.0.SNAPSHOT Optical information model
*  10 org.onosproject.ovsdb-base           1.8.0.SNAPSHOT OVSDB Provider
*  20 org.onosproject.openstackinterface   1.8.0.SNAPSHOT OpenStack Interface App
*  28 org.onosproject.drivers.ovsdb        1.8.0.SNAPSHOT OVSDB Device Drivers
*  29 org.onosproject.openstacknode        1.8.0.SNAPSHOT OpenStack Node Bootstrap App
*  30 org.onosproject.scalablegateway      1.8.0.SNAPSHOT Scalable Gateway App
*  31 org.onosproject.openstackrouting     1.8.0.SNAPSHOT Openstack Switching App
*  38 org.onosproject.openflow-base        1.8.0.SNAPSHOT OpenFlow Provider
*  46 org.onosproject.dhcp                 1.8.0.SNAPSHOT DHCP App
*  55 org.onosproject.drivers              1.8.0.SNAPSHOT Default Device Drivers
*  80 org.onosproject.openstackswitching   1.8.0.SNAPSHOT Openstack Switching App

The plugin is correctly configured:
stack@controller:/home/openstack/devstack$ cat /etc/neutron/plugins/ml2/conf_onos.ini 
# Configuration options for ONOS ML2 Mechanism driver
[onos]
# (StrOpt) ONOS ReST interface URL. This is a mandatory field.
# (StrOpt) Username for authentication. This is a mandatory field.
username = onos
# (StrOpt) Password for authentication. This is a mandatory field.
password = rocks

The problem last time was related to tha fact that the web context of openstacknetworking (I deploy with buck) was "openstackswitching" and not "openstacknetworking"; but now it happens also if this is correct:
developer@onos-dev:$ cat ~/onos/apps/openstacknetworking/web/BUCK
COMPILE_DEPS = [
    '//lib:CORE_DEPS',
    '//lib:jersey-client',
    '//lib:javax.ws.rs-api',
    '//utils/rest:onlab-rest',
    '//apps/openstackinterface/api:onos-apps-openstackinterface-api',
    '//apps/openstackinterface/app:onos-apps-openstackinterface-app',
    '//apps/openstacknetworking/api:onos-apps-openstacknetworking-api',
]

osgi_jar_with_tests (
    deps = COMPILE_DEPS,
    web_context = '/onos/openstacknetworking'
)

The ports are open:
developer@sona:~$ sudo netstat -ntl
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State      
tcp        0      0 0.0.0.0:5005            0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN     
tcp6       0      0 :::6633                 :::*                    LISTEN     
tcp6       0      0 :::1099                 :::*                    LISTEN     
tcp6       0      0 :::6640                 :::*                    LISTEN     
tcp6       0      0 :::9876                 :::*                    LISTEN     
tcp6       0      0 :::8181                 :::*                    LISTEN     
tcp6       0      0 :::22                   :::*                    LISTEN     
tcp6       0      0 127.0.0.1:42939         :::*                    LISTEN     
tcp6       0      0 :::44444                :::*                    LISTEN     
tcp6       0      0 :::6653                 :::*                    LISTEN     
tcp6       0      0 :::40861                :::*                    LISTEN     
tcp6       0      0 :::8101                 :::*                    LISTEN  

Connectivity among nodes is present:
stack@controller:/home/openstack/devstack$ ping -c 3 10.134.231.29
PING 10.134.231.29 (10.134.231.29) 56(84) bytes of data.
64 bytes from 10.134.231.29: icmp_seq=1 ttl=64 time=0.495 ms
64 bytes from 10.134.231.29: icmp_seq=2 ttl=64 time=0.468 ms
64 bytes from 10.134.231.29: icmp_seq=3 ttl=64 time=0.503 ms

No problems in recognition of openstack nodes:
onos> openstack-nodes
hostname=compute-01, type=COMPUTE, managementIp=10.134.231.30, dataIp=10.134.34.222, intBridge=of:00000000000000a1, routerBridge=Optional.empty init=COMPLETE
hostname=gateway-01, type=GATEWAY, managementIp=10.134.231.32, dataIp=10.134.34.224, intBridge=of:00000000000000a2, routerBridge=Optional[of:00000000000000b1] init=COMPLETE
Total 2 nodes

In practice, it seems that the OpenStack controller knows how to contact SONA properly in order to have Neutron services provided, but it has problems in doing it, as stated by the log line: 2017-02-02 10:27:56.467 TRACE neutron.plugins.ml2.managers HTTPError: 404 Client Error: Not Found for url: http://10.134.231.29:8181/onos/openstacknetworking/networks
Is there something else that has to be done in order to make it work? Any other change I have to do that were not updated in the guide?

Any help would be appreciated.
Thanks in advance.

Francesco

Hyunsun Moon

unread,
Feb 5, 2017, 8:12:43 PM2/5/17
to Francesco Foresta, ONOS Discuss
Hi Francesco,

Sorry for the late response.
As you pointed, everything looks okay for me.
I’ll setup SONA test environment with the latest codes today and then reach you back.

Thanks.

Hyunsun


Hyunsun Moon

unread,
Feb 6, 2017, 4:50:58 AM2/6/17
to Francesco Foresta, ONOS Discuss
Hi Francesco,

I checked with the latest master works fine.
Do you see any errors or warnings from ONOS?
If not, to make sure it’s not something with your environment issue, could you try the following command and check the result is 200 OK?

$ curl --verbose -X POST -H "Content-Type: application/json" -u onos:rocks -d '{"network": {"name": “net-test", "admin_state_up": true}}' http://localhost:8181/onos/openstacknetworking/networks

Hyunsun

Francesco Foresta

unread,
Feb 6, 2017, 10:06:18 AM2/6/17
to ONOS Discuss, inusu...@gmail.com
Dear Hyunsun,

Thank you for your help. Anyway, during the weekend I deployed everything again, but with ONOS 1.8.3 with respect to 1.8.0 that I used last month (and that was correctly working, that was the creepy thing! :) ); then, everything was up again and now it works.
Just for curiosity, in the last days before the redeployment I had tried a similar curl and the result was always a 404 not found; thus, there was inevitably a problem with the correct deployment of onos that the 1.8.3 solved. However, now it seems to work properly.

Thanks again,
Francesco 

David

unread,
Apr 11, 2017, 7:02:46 AM4/11/17
to ONOS Discuss
Hi all, I'am using ONOS 1.8.4 but I have the same issue. In Neutron server log I got the same message.

I installed ONOS by downloading it and typing ./onos-service start. I deployed the same apps as Francesco did. What could be the problem?
I installed networking-onos in this way:
git clone https://github.com/openstack/networking-onos.git
pip install ./networking-onos



I tried curl --verbose -X POST -H "Content-Type: application/json" -u onos:rocks -d '{"network": {"name": “net-test", "admin_state_up": true}}' http://localhost:8181/onos/openstacknetworking/networks but I get the 404 http error.
I walked through a problem when starting onos which said that the JAVA_HOME variable wasn't set, but I solved that.
Here my karaf log:


Apr 11, 2017 12:55:55 PM org.apache.karaf.main.lock.SimpleFileLock lock
INFO: Trying to lock /opt/onos/apache-karaf-3.0.5/lock
Apr 11, 2017 12:55:55 PM org.apache.karaf.main.lock.SimpleFileLock lock
INFO: Lock acquired
Apr 11, 2017 12:55:55 PM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2017-04-11 12:55:56,864 | INFO  | FelixStartLevel  | BlueprintContainerImpl           | 15 - org.apache.aries.blueprint.core - 1.4.4 | Bundle org.apache.karaf.features.command/3.0.5 is waiting for namespace handlers [http://karaf.apache.org/xmlns/shell/v1.1.0]
2017-04-11 12:55:56,925 | INFO  | FelixStartLevel  | BlueprintContainerImpl           | 15 - org.apache.aries.blueprint.core - 1.4.4 | Bundle org.apache.karaf.bundle.command/3.0.5 is waiting for namespace handlers [http://karaf.apache.org/xmlns/shell/v1.1.0]
2017-04-11 12:55:56,950 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.scope_bundle into service ACL configs [org.apache.karaf.service.acl.command.scope_bundle.packages, org.apache.karaf.service.acl.command.scope_bundle.shell, org.apache.karaf.service.acl.command.scope_bundle.admin, org.apache.karaf.service.acl.command.scope_bundle.ssh, org.apache.karaf.service.acl.command.scope_bundle.osgi, org.apache.karaf.service.acl.command.scope_bundle.config, org.apache.karaf.service.acl.command.scope_bundle.jaas, org.apache.karaf.service.acl.command.scope_bundle.features, org.apache.karaf.service.acl.command.scope_bundle.log]
2017-04-11 12:55:56,959 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.feature into service ACL configs [org.apache.karaf.service.acl.command.feature.uninstall, org.apache.karaf.service.acl.command.feature.install]
2017-04-11 12:55:56,961 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.shell into service ACL configs [org.apache.karaf.service.acl.command.shell.java, org.apache.karaf.service.acl.command.shell.edit, org.apache.karaf.service.acl.command.shell.new, org.apache.karaf.service.acl.command.shell.exec]
2017-04-11 12:55:56,964 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.system into service ACL configs [org.apache.karaf.service.acl.command.system.property, org.apache.karaf.service.acl.command.system.shutdown, org.apache.karaf.service.acl.command.system.start-level]
2017-04-11 12:55:56,966 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.config into service ACL configs [org.apache.karaf.service.acl.command.config.property-append, org.apache.karaf.service.acl.command.config.property-delete, org.apache.karaf.service.acl.command.config.property-set, org.apache.karaf.service.acl.command.config.edit, org.apache.karaf.service.acl.command.config.update, org.apache.karaf.service.acl.command.config.cancel, org.apache.karaf.service.acl.command.config.delete]
2017-04-11 12:55:56,970 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.jaas into service ACL configs [org.apache.karaf.service.acl.command.jaas.update]
2017-04-11 12:55:56,970 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.bundle into service ACL configs [org.apache.karaf.service.acl.command.bundle.watch, org.apache.karaf.service.acl.command.bundle.update, org.apache.karaf.service.acl.command.bundle.install, org.apache.karaf.service.acl.command.bundle.refresh, org.apache.karaf.service.acl.command.bundle.uninstall, org.apache.karaf.service.acl.command.bundle.restart, org.apache.karaf.service.acl.command.bundle.stop, org.apache.karaf.service.acl.command.bundle.start]
2017-04-11 12:55:56,975 | INFO  | FelixStartLevel  | SecuredCommandConfigTransformer  | 27 - org.apache.karaf.shell.console - 3.0.5 | Generating command ACL config org.apache.karaf.command.acl.kar into service ACL configs [org.apache.karaf.service.acl.command.kar.uninstall, org.apache.karaf.service.acl.command.kar.install]
2017-04-11 12:55:57,085 | INFO  | FelixStartLevel  | BlueprintContainerImpl           | 15 - org.apache.aries.blueprint.core - 1.4.4 | Bundle org.apache.karaf.jaas.modules/3.0.5 is waiting for namespace handlers [http://karaf.apache.org/xmlns/jaas/v1.0.0]
2017-04-11 12:55:57,568 | INFO  | FelixStartLevel  | ActivateCommandComponent         | 39 - org.apache.karaf.scr.command - 3.0.5 | Activating the Apache Karaf SCR Activate Command
2017-04-11 12:55:57,571 | INFO  | FelixStartLevel  | DeactivateCommandComponent       | 39 - org.apache.karaf.scr.command - 3.0.5 | Activating the Apache Karaf SCR Deactivate Command
2017-04-11 12:55:57,574 | INFO  | FelixStartLevel  | DetailsCommandComponent          | 39 - org.apache.karaf.scr.command - 3.0.5 | Activating the Apache Karaf SCR Details Command
2017-04-11 12:55:57,575 | INFO  | FelixStartLevel  | ListCommandComponent             | 39 - org.apache.karaf.scr.command - 3.0.5 | Activating the Apache Karaf SCR List Command
2017-04-11 12:55:57,613 | INFO  | FelixStartLevel  | Activator                        | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | EventAdmin support is not available, no servlet events will be posted!
2017-04-11 12:55:57,619 | INFO  | FelixStartLevel  | Activator                        | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | LogService support enabled, log events will be created.
2017-04-11 12:55:57,620 | INFO  | FelixStartLevel  | Activator                        | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Pax Web started
2017-04-11 12:55:57,879 | INFO  | pool-3-thread-1  | Server                           | 89 - org.eclipse.jetty.aggregate.jetty-all-server - 8.1.17.v20150415 | jetty-8.1.17.v20150415
2017-04-11 12:55:57,958 | INFO  | pool-3-thread-1  | AbstractConnector                | 89 - org.eclipse.jetty.aggregate.jetty-all-server - 8.1.17.v20150415 | Started SelectChann...@0.0.0.0:8181
2017-04-11 12:55:57,958 | INFO  | pool-3-thread-1  | JettyServerImpl                  | 98 - org.ops4j.pax.web.pax-web-jetty - 3.2.6 | Pax Web available at [0.0.0.0]:[8181]
2017-04-11 12:55:58,269 | INFO  | FelixStartLevel  | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.apache.karaf.webconsole.console [147]] to http service
2017-04-11 12:55:58,351 | INFO  | rafOsgiManager]) | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Unbinding bundle: [org.apache.karaf.webconsole.console [147]]
2017-04-11 12:55:58,354 | INFO  | rafOsgiManager]) | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.apache.karaf.webconsole.console [147]] to http service
2017-04-11 12:55:58,376 | WARN  | FelixStartLevel  | ServletTracker                   | 102 - org.ops4j.pax.web.pax-web-extender-whiteboard - 3.2.6 | Registered servlet [org.apache.felix.webconsole.plugins.ds.internal.WebConsolePlugin@4f857c28] did not contain a valid alias or url patterns property
2017-04-11 12:55:58,396 | INFO  | FelixStartLevel  | InstancePlugin                   | 149 - org.apache.karaf.webconsole.instance - 3.0.5 | Instance plugin activated
2017-04-11 12:55:58,402 | INFO  | FelixStartLevel  | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.apache.karaf.webconsole.instance [149]] to http service
2017-04-11 12:55:58,421 | INFO  | FelixStartLevel  | FeaturesPlugin                   | 150 - org.apache.karaf.webconsole.features - 3.0.5 | Features plugin activated
2017-04-11 12:55:58,424 | INFO  | FelixStartLevel  | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.apache.karaf.webconsole.features [150]] to http service
2017-04-11 12:55:58,442 | INFO  | FelixStartLevel  | GogoPlugin                       | 151 - org.apache.karaf.webconsole.gogo - 3.0.5 | Gogo plugin activated
2017-04-11 12:55:58,444 | INFO  | FelixStartLevel  | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.apache.karaf.webconsole.gogo [151]] to http service
2017-04-11 12:55:58,456 | INFO  | FelixStartLevel  | HttpPlugin                       | 152 - org.apache.karaf.webconsole.http - 3.0.5 | Http plugin activated
2017-04-11 12:55:58,460 | WARN  | FelixStartLevel  | ServletTracker                   | 102 - org.ops4j.pax.web.pax-web-extender-whiteboard - 3.2.6 | Registered servlet [org.apache.karaf.webconsole.http.HttpPlugin@65f19009] did not contain a valid alias or url patterns property
2017-04-11 12:55:58,540 | INFO  | FelixStartLevel  | SecurityUtils                    | 30 - org.apache.sshd.core - 0.14.0 | BouncyCastle not registered, using the default JCE provider
2017-04-11 12:55:58,943 | INFO  | spatch-topology0 | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Dispatch loop initiated
2017-04-11 12:55:58,943 | INFO  | tch-programming0 | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Dispatch loop initiated
2017-04-11 12:55:58,957 | INFO  | ispatch-default0 | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Dispatch loop initiated
2017-04-11 12:55:58,958 | INFO  | FelixStartLevel  | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Starting watchdog task for dispatcher topology
2017-04-11 12:55:58,969 | INFO  | FelixStartLevel  | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Starting watchdog task for dispatcher programming
2017-04-11 12:55:58,969 | INFO  | FelixStartLevel  | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Starting watchdog task for dispatcher default
2017-04-11 12:55:58,969 | INFO  | FelixStartLevel  | CoreEventDispatcher              | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:58,971 | INFO  | FelixStartLevel  | ClusterMetadataManager           | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:58,997 | INFO  | FelixStartLevel  | DefaultClusterMetadataProvider   | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:59,111 | INFO  | FelixStartLevel  | FileBasedClusterMetadataProvider | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:59,141 | INFO  | FelixStartLevel  | HybridLogicalClockManager        | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:59,206 | INFO  | FelixStartLevel  | CodecManager                     | 78 - org.onosproject.onos-core-common - 1.8.4 | Started
2017-04-11 12:55:59,274 | INFO  | FelixStartLevel  | NettyMessagingManager            | 79 - org.onosproject.onos-core-dist - 1.8.4 | enableNettyTLS = false
2017-04-11 12:55:59,469 | INFO  | FelixStartLevel  | NettyMessagingManager            | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:55:59,484 | INFO  | sagingEvt-nioS-0 | NettyMessagingManager            | 79 - org.onosproject.onos-core-dist - 1.8.4 | 192.168.48.129 accepting incoming connections on port 9876
2017-04-11 12:55:59,705 | INFO  | FelixStartLevel  | DistributedClusterStore          | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:55:59,751 | INFO  | FelixStartLevel  | ClusterManager                   | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:59,754 | INFO  | FelixStartLevel  | ComponentsMonitor                | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:55:59,764 | INFO  | FelixStartLevel  | ClusterCommunicationManager      | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:55:59,783 | INFO  | FelixStartLevel  | PersistenceManager               | 81 - org.onosproject.onos-core-persistence - 1.8.4 | A previous database file has been found.
2017-04-11 12:55:59,844 | INFO  | FelixStartLevel  | PersistenceManager               | 81 - org.onosproject.onos-core-persistence - 1.8.4 | Started
2017-04-11 12:56:00,157 | INFO  | 9876-partition-1 | ServerContext                    | 40 - io.atomix.all - 1.0.3 | /192.168.48.129:9876 - Transitioning to FOLLOWER
2017-04-11 12:56:01,526 | INFO  | 9876-partition-1 | ServerContext                    | 40 - io.atomix.all - 1.0.3 | /192.168.48.129:9876 - Transitioning to CANDIDATE
2017-04-11 12:56:01,530 | INFO  | 9876-partition-1 | CandidateState                   | 40 - io.atomix.all - 1.0.3 | /192.168.48.129:9876 - Starting election
2017-04-11 12:56:01,547 | INFO  | 9876-partition-1 | ServerContext                    | 40 - io.atomix.all - 1.0.3 | /192.168.48.129:9876 - Transitioning to LEADER
2017-04-11 12:56:01,551 | INFO  | 9876-partition-1 | ServerContext                    | 40 - io.atomix.all - 1.0.3 | /192.168.48.129:9876 - Found leader /192.168.48.129:9876
2017-04-11 12:56:01,566 | INFO  | 9876-partition-1 | ServerStateMachine               | 40 - io.atomix.all - 1.0.3 | /192.168.48.129:9876 - Installing snapshot 1
2017-04-11 12:56:01,930 | INFO  | 9876-partition-1 | CopycatServer                    | 40 - io.atomix.all - 1.0.3 | Server started successfully!
2017-04-11 12:56:01,930 | INFO  | 9876-partition-1 | StoragePartitionServer           | 80 - org.onosproject.onos-core-primitives - 1.8.4 | Successfully started server for partition 1
2017-04-11 12:56:02,372 | INFO  | ycat-client-io-1 | ClientSession                    | 40 - io.atomix.all - 1.0.3 | Registered session 3623
2017-04-11 12:56:02,373 | INFO  | t-client-event-1 | StoragePartitionClient           | 80 - org.onosproject.onos-core-primitives - 1.8.4 | Successfully started client for partition 1
2017-04-11 12:56:02,373 | INFO  | FelixStartLevel  | PartitionManager                 | 80 - org.onosproject.onos-core-primitives - 1.8.4 | Started
2017-04-11 12:56:02,436 | INFO  | FelixStartLevel  | StorageManager                   | 80 - org.onosproject.onos-core-primitives - 1.8.4 | Started
2017-04-11 12:56:02,442 | INFO  | FelixStartLevel  | LogicalClockManager              | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,486 | INFO  | FelixStartLevel  | DistributedApplicationIdStore    | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,498 | INFO  | FelixStartLevel  | DistributedDeviceKeyStore        | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,500 | INFO  | FelixStartLevel  | DeviceKeyManager                 | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,515 | INFO  | FelixStartLevel  | DistributedRegionStore           | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,516 | INFO  | FelixStartLevel  | RegionManager                    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,549 | INFO  | FelixStartLevel  | ConsistentResourceStore          | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,550 | INFO  | FelixStartLevel  | ResourceManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,552 | INFO  | FelixStartLevel  | DistributedIdBlockStore          | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,563 | INFO  | FelixStartLevel  | DistributedFlowObjectiveStore    | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,572 | INFO  | FelixStartLevel  | DistributedComponentConfigStore  | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,574 | INFO  | FelixStartLevel  | ComponentConfigManager           | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,574 | INFO  | FelixStartLevel  | ComponentConfigLoader            | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,618 | INFO  | FelixStartLevel  | DistributedHostStore             | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,638 | INFO  | FelixStartLevel  | DistributedNetworkConfigStore    | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,639 | INFO  | FelixStartLevel  | NetworkConfigManager             | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,658 | INFO  | FelixStartLevel  | DistributedLeadershipStore       | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,659 | INFO  | FelixStartLevel  | LeadershipManager                | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,667 | INFO  | FelixStartLevel  | ConsistentDeviceMastershipStore  | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,669 | INFO  | FelixStartLevel  | MastershipManager                | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,670 | INFO  | FelixStartLevel  | DistributedFlowStatisticStore    | 79 - org.onosproject.onos-core-dist - 1.8.4 | Setting: messageHandlerThreadPoolSize=4
2017-04-11 12:56:02,671 | INFO  | FelixStartLevel  | DistributedFlowStatisticStore    | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,673 | INFO  | FelixStartLevel  | ReplicaInfoManager               | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,705 | INFO  | FelixStartLevel  | DistributedGroupStore            | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,719 | INFO  | FelixStartLevel  | DeviceClockManager               | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,769 | INFO  | FelixStartLevel  | GossipDeviceStore                | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,779 | INFO  | FelixStartLevel  | DeviceManager                    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,781 | INFO  | FelixStartLevel  | GroupManager                     | 77 - org.onosproject.onos-core-net - 1.8.4 | Configured. PurgeOnDisconnection is disabled
2017-04-11 12:56:02,781 | INFO  | FelixStartLevel  | GroupManager                     | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,784 | INFO  | FelixStartLevel  | DriverManager                    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,794 | INFO  | FelixStartLevel  | ResourceRegistrar                | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,829 | INFO  | FelixStartLevel  | DistributedTopologyStore         | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,831 | INFO  | FelixStartLevel  | TopologyManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,836 | INFO  | FelixStartLevel  | ConsistentIntentSetMultimap      | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,839 | INFO  | FelixStartLevel  | DistributedStatisticStore        | 79 - org.onosproject.onos-core-dist - 1.8.4 | Setting: messageHandlerThreadPoolSize=4
2017-04-11 12:56:02,841 | INFO  | FelixStartLevel  | DistributedStatisticStore        | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,879 | INFO  | FelixStartLevel  | WorkPartitionManager             | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,910 | INFO  | FelixStartLevel  | GossipIntentStore                | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,913 | INFO  | FelixStartLevel  | DistributedPacketStore           | 79 - org.onosproject.onos-core-dist - 1.8.4 | Setting: messageHandlerThreadPoolSize=4
2017-04-11 12:56:02,921 | INFO  | FelixStartLevel  | DistributedPacketStore           | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,953 | INFO  | FelixStartLevel  | DistributedApplicationStore      | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:02,956 | INFO  | FelixStartLevel  | ApplicationManager               | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:02,977 | INFO  | FelixStartLevel  | BasicNetworkConfigs              | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:03,220 | INFO  | FelixStartLevel  | ECLinkStore                      | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:03,221 | INFO  | FelixStartLevel  | LinkManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:03,224 | INFO  | FelixStartLevel  | DefaultTopologyProvider          | 77 - org.onosproject.onos-core-net - 1.8.4 | Configured with maxEvents = 1000; maxBatchMs = 50; maxIdleMs = 10; accumulator=true
2017-04-11 12:56:03,227 | INFO  | FelixStartLevel  | DefaultTopologyProvider          | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:03,285 | INFO  | nos-topo-build-0 | TopologyManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Topology DefaultTopology{time=2763208984029, creationTime=1491908163233, computeCost=5792354, clusters=0, devices=0, links=0} changed
2017-04-11 12:56:03,304 | INFO  | FelixStartLevel  | DistributedFlowRuleStore         | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started with msgHandlerPoolSize = 8; backupEnabled = true, backupPeriod = 2000, backupCount = 2
2017-04-11 12:56:03,309 | INFO  | FelixStartLevel  | FlowRuleManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Configured. AllowExtraneousRules is disabled
2017-04-11 12:56:03,309 | INFO  | FelixStartLevel  | FlowRuleManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Configured. PurgeOnDisconnection is disabled
2017-04-11 12:56:03,322 | INFO  | FelixStartLevel  | FlowRuleManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:03,323 | INFO  | FelixStartLevel  | StatisticManager                 | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:03,327 | INFO  | FelixStartLevel  | FlowStatisticManager             | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:03,380 | INFO  | FelixStartLevel  | UiTopoLayoutManager              | 134 - org.onosproject.onos-gui - 1.8.4 | Initializing layout configurations...
2017-04-11 12:56:03,381 | INFO  | FelixStartLevel  | UiTopoLayoutManager              | 134 - org.onosproject.onos-gui - 1.8.4 | Updating Layout via config... _default_: null
2017-04-11 12:56:03,381 | INFO  | FelixStartLevel  | UiTopoLayoutManager              | 134 - org.onosproject.onos-gui - 1.8.4 | Started
2017-04-11 12:56:03,402 | INFO  | FelixStartLevel  | UiExtensionManager               | 134 - org.onosproject.onos-gui - 1.8.4 | Started
2017-04-11 12:56:03,694 | INFO  | FelixStartLevel  | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.onosproject.onos-gui [134]] to http service
2017-04-11 12:56:04,085 | INFO  | FelixStartLevel  | ApiDocManager                    | 145 - org.onosproject.onos-rest - 1.8.4 | Started
2017-04-11 12:56:04,273 | INFO  | FelixStartLevel  | HttpServiceFactoryImpl           | 97 - org.ops4j.pax.web.pax-web-runtime - 3.2.6 | Binding bundle: [org.onosproject.onos-rest [145]] to http service
2017-04-11 12:56:04,294 | INFO  | FelixStartLevel  | ExtraNetworkConfigs              | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,314 | INFO  | FelixStartLevel  | DpiStatisticsManager             | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,327 | INFO  | FelixStartLevel  | PortStatisticsManager            | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,331 | INFO  | dpi-dpi-listener | DpiStatisticsManager             | 155 - org.onosproject.onos-incubator-net - 1.8.4 | DpiStatisticsListener: Receiving thread started...
2017-04-11 12:56:04,332 | INFO  | dpi-dpi-listener | DpiStatisticsManager             | 155 - org.onosproject.onos-incubator-net - 1.8.4 | DpiStatisticsListener: Waiting for accepting from dpi client...
2017-04-11 12:56:04,344 | INFO  | FelixStartLevel  | InterfaceManager                 | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,352 | INFO  | FelixStartLevel  | IntentDomainManager              | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,384 | INFO  | FelixStartLevel  | ComponentManager                 | 156 - org.onosproject.onos-incubator-core - 1.8.4 | Started
2017-04-11 12:56:04,450 | INFO  | FelixStartLevel  | DistributedMeterStore            | 157 - org.onosproject.onos-incubator-store - 1.8.4 | Started
2017-04-11 12:56:04,457 | INFO  | FelixStartLevel  | MeterManager                     | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,511 | INFO  | FelixStartLevel  | DistributedTunnelStore           | 157 - org.onosproject.onos-incubator-store - 1.8.4 | Started
2017-04-11 12:56:04,513 | INFO  | FelixStartLevel  | TunnelManager                    | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,547 | INFO  | FelixStartLevel  | DistributedLabelResourceStore    | 157 - org.onosproject.onos-incubator-store - 1.8.4 | Started
2017-04-11 12:56:04,548 | INFO  | FelixStartLevel  | LabelResourceManager             | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,647 | INFO  | FelixStartLevel  | DistributedVirtualNetworkStore   | 157 - org.onosproject.onos-incubator-store - 1.8.4 | Started
2017-04-11 12:56:04,661 | INFO  | FelixStartLevel  | DistributedMcastStore            | 157 - org.onosproject.onos-incubator-store - 1.8.4 | Started
2017-04-11 12:56:04,662 | INFO  | FelixStartLevel  | MulticastRouteManager            | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,670 | INFO  | FelixStartLevel  | RemoteServiceManager             | 158 - org.onosproject.onos-incubator-rpc - 1.8.4 | Started
2017-04-11 12:56:04,671 | INFO  | FelixStartLevel  | LocalRemoteServiceProvider       | 158 - org.onosproject.onos-incubator-rpc - 1.8.4 | Started
2017-04-11 12:56:04,783 | INFO  | FelixStartLevel  | DefaultDriversLoader             | 75 - org.onosproject.onos-api - 1.8.4 | Started
2017-04-11 12:56:04,787 | INFO  | FelixStartLevel  | FlowObjectiveManager             | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,792 | INFO  | FelixStartLevel  | PacketManager                    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,812 | INFO  | FelixStartLevel  | EdgeManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,860 | INFO  | FelixStartLevel  | HostManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Configured. monitorHosts disabled
2017-04-11 12:56:04,862 | INFO  | FelixStartLevel  | HostManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Configured. probeRate 30000
2017-04-11 12:56:04,862 | INFO  | FelixStartLevel  | HostManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Removal of duplicate ip address is disabled
2017-04-11 12:56:04,863 | INFO  | FelixStartLevel  | HostManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,867 | INFO  | FelixStartLevel  | PathManager                      | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,890 | INFO  | FelixStartLevel  | ObjectiveTracker                 | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,909 | INFO  | FelixStartLevel  | IntentManager                    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,938 | INFO  | FelixStartLevel  | IntentConfigurableRegistrator    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,949 | INFO  | FelixStartLevel  | IntentCleanup                    | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:04,958 | INFO  | FelixStartLevel  | VirtualNetworkManager            | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:04,962 | INFO  | FelixStartLevel  | DefaultVirtualNetworkProvider    | 155 - org.onosproject.onos-incubator-net - 1.8.4 | Started
2017-04-11 12:56:05,010 | INFO  | FelixStartLevel  | UiSharedTopologyModel            | 134 - org.onosproject.onos-gui - 1.8.4 | Started
2017-04-11 12:56:05,033 | INFO  | FelixStartLevel  | DistributedProxyArpStore         | 79 - org.onosproject.onos-core-dist - 1.8.4 | Started
2017-04-11 12:56:05,041 | INFO  | FelixStartLevel  | ProxyArpManager                  | 77 - org.onosproject.onos-core-net - 1.8.4 | Started
2017-04-11 12:56:05,048 | INFO  | FelixStartLevel  | NeighbourResolutionManager       | 155 - org.onosproject.onos-incubator-net - 1.8.4 | IPv6 neighbor discovery is disabled
2017-04-11 12:56:05,073 | INFO  | FelixStartLevel  | DefaultCodecRegister             | 159 - org.onosproject.onos-drivers-default - 1.8.4 | Registered default driver codecs.

Thanks in advance,
David

David

unread,
Apr 11, 2017, 2:18:22 PM4/11/17
to ONOS Discuss
I also noticed that typing
netstat -ntl there's no one listening on Port 6640, although I deployed the ovsdb app within ONOS. There's no clue about any error inside ONOS, ovs and neutron log. Except for the 404 http error within neutron-server.log

Hyunsun Moon

unread,
Apr 11, 2017, 9:16:00 PM4/11/17
to David, ONOS Discuss
Hi David,

Did you activate openstacknetworking application?
And you’re supposed to send a network request to Neutron not directly to SONA.

About the question below, ONOS OVSDB southbound acts as an OVSDB client not server.
So, ONOS machine does not need to listen on port 6640(OVSDB service port).
Instead, you should set your OVS in your compute node passive mode so that it listens on port 6640.

This wiki page might help.

Hyunsun


On 12 Apr 2017, at 3:18 AM, David <davide.ma...@gmail.com> wrote:

I also noticed that typing
netstat -ntl there's no one listening on Port 6640, although I deployed the ovsdb app within ONOS. There's no clue about any error inside ONOS, ovs and neutron log. Except for the 404 http error within neutron-server.log

--
You received this message because you are subscribed to the Google Groups "ONOS Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to onos-discuss...@onosproject.org.
To post to this group, send email to onos-d...@onosproject.org.
Visit this group at https://groups.google.com/a/onosproject.org/group/onos-discuss/.

David

unread,
Apr 12, 2017, 3:33:10 AM4/12/17
to ONOS Discuss
Yes it's deployed. To be clear, here's the output about deployed apps within ONOS:

onos> apps -a -s
* 9 org.onosproject.optical-model 1.8.4 Optical information model* 15 org.onosproject.lldpprovider 1.8.4 LLDP Link Provider
* 21 org.onosproject.openflow-base 1.8.4 OpenFlow Provider
* 23 org.onosproject.scalablegateway 1.8.4 Scalable GW App
* 25 org.onosproject.hostprovider 1.8.4 Host Location Provider
* 26 org.onosproject.openflow 1.8.4 OpenFlow Meta App
* 35 org.onosproject.drivers 1.8.4 Default device drivers
* 37 org.onosproject.openstackinterface 1.8.4 OpenStack Interface App
* 38 org.onosproject.ovsdb-base 1.8.4 OVSDB Provider
* 39 org.onosproject.drivers.ovsdb 1.8.4 OVSDB Device Drivers
* 40 org.onosproject.openstacknode 1.8.4 OpenStack Node Bootstrap App
* 41 org.onosproject.dhcp 1.8.4 DHCP Server App
* 42 org.onosproject.openstackswitching 1.8.4 OpenStack Switching App
* 55 org.onosproject.ovsdbhostprovider 1.8.4 OVSDB host Provider
* 56 org.onosproject.ovsdb 1.8.4 OVSDB Southbound Meta App* 59 org.onosproject.openstackrouting 1.8.4 OpenStack Routing App
* 60 org.onosproject.openstacknetworking 1.8.4 OpenStack Networking App
onos>


Yes I know, I used curl just to check if the REST url works. So, this is the error that appears in neutron-server log:
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers [req-710e9fb9-e2d4-4380-853a-2991b18efe87 b390d113251141629c8d30e94bcb9ba7 1d9eb5623d704ceea17ace2be3920888 - - -] Mechanism driver 'onos_ml2' failed in create_network_postcommit
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers Traceback (most recent call last):
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 407, in _call_on_drivers
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers File "/usr/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers return method(*args, **kwargs)
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/networking_onos/plugins/ml2/driver.py", line 54, in create_network_postcommit
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers entity_path, {'network': resource})
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/networking_onos/common/utils.py", line 38, in send_msg
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers req.raise_for_status()
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 893, in raise_for_status
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers raise HTTPError(http_error_msg, response=self)
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers HTTPError: 404 Client Error: Not Found for url: http://127.0.0.1:8181/onos/openstacknetworking/networks
2017-04-12 09:22:18.392 15901 ERROR neutron.plugins.ml2.managers
2017-04-12 09:22:18.393 15901 ERROR neutron.plugins.ml2.plugin [req-710e9fb9-e2d4-4380-853a-2991b18efe87


About ovs, thanks a lot. I was a little bit confused because I'm new in those things.

David

Hyunsun Moon

unread,
Apr 12, 2017, 6:40:23 AM4/12/17
to David, ONOS Discuss
Hi David,

Was there any error or warnings when you activate openstacknetworking app?
BTW, org.onosproject.hostprovider and org.onosproject.ovsdbhostprovider conflict with openstackswitching app.
Please activate only drivers, openflow-base, openstackswitching, and openstackrouting.
Other dependent apps will be activated automatically.

Hyunsun
> --
> You received this message because you are subscribed to the Google Groups "ONOS Discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to onos-discuss...@onosproject.org.
> To post to this group, send email to onos-d...@onosproject.org.
> Visit this group at https://groups.google.com/a/onosproject.org/group/onos-discuss/.
> To view this discussion on the web visit https://groups.google.com/a/onosproject.org/d/msgid/onos-discuss/c00bb053-555d-46af-9686-63f185e69b02%40onosproject.org.

David

unread,
Apr 12, 2017, 9:19:25 AM4/12/17
to ONOS Discuss
Hi Hyunsun

First of all thanks a lot. So, actually It happened that I delete the karaf log at some point, and I've never tried to see it again; before and after the deployment of the various apps. So I launched a new clean ONOS instance, I deployed the apps again, without ovsdbhost as you said, and there's a warning and an error repeated few times in the log. Based on the error I launched ONOS with sudo and everything work. But I don't know why the error says I/O exception, permission denied. I should run ONOS without sudo. Here's the error, I'll try to understand why it's raised.

2017-04-12 15:10:41,010 | WARN | -message-handler | ApplicationArchive | 78 - org.onosproject.onos-core-common - 1.8.4 | Unable to mark app org.onosproject.openflow-base as active
java.io.IOException: Permission denied
at java.io.UnixFileSystem.createFileExclusively(Native Method)[:1.8.0_121]
at java.io.File.createNewFile(File.java:1012)[:1.8.0_121]
at org.onosproject.common.app.ApplicationArchive.setActive(ApplicationArchive.java:381)[78:org.onosproject.onos-core-common:1.8.4]
at org.onosproject.store.app.DistributedApplicationStore.access$400(DistributedApplicationStore.java:95)[79:org.onosproject.onos-core-dist:1.8.4]
at org.onosproject.store.app.DistributedApplicationStore$AppActivator.accept(DistributedApplicationStore.java:438)[79:org.onosproject.onos-core-dist:1.8.4]
at org.onosproject.store.app.DistributedApplicationStore$AppActivator.accept(DistributedApplicationStore.java:433)[79:org.onosproject.onos-core-dist:1.8.4]
at org.onosproject.store.primitives.impl.DefaultDistributedTopic.lambda$null$0(DefaultDistributedTopic.java:67)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_121]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_121]
2017-04-12 15:10:41,011 | ERROR | -message-handler | DistributedApplicationStore | 79 - org.onosproject.onos-core-dist - 1.8.4 | Uncaught exception on onos-store-app-message-handler
org.onosproject.app.ApplicationException: Unable to mark app as active
at org.onosproject.common.app.ApplicationArchive.setActive(ApplicationArchive.java:384)[78:org.onosproject.onos-core-common:1.8.4]
at org.onosproject.store.app.DistributedApplicationStore.access$400(DistributedApplicationStore.java:95)[79:org.onosproject.onos-core-dist:1.8.4]
at org.onosproject.store.app.DistributedApplicationStore$AppActivator.accept(DistributedApplicationStore.java:438)[79:org.onosproject.onos-core-dist:1.8.4]
at org.onosproject.store.app.DistributedApplicationStore$AppActivator.accept(DistributedApplicationStore.java:433)[79:org.onosproject.onos-core-dist:1.8.4]
at org.onosproject.store.primitives.impl.DefaultDistributedTopic.lambda$null$0(DefaultDistributedTopic.java:67)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_121]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_121]
Caused by: java.io.IOException: Permission denied
at java.io.UnixFileSystem.createFileExclusively(Native Method)[:1.8.0_121]
at java.io.File.createNewFile(File.java:1012)[:1.8.0_121]
at org.onosproject.common.app.ApplicationArchive.setActive(ApplicationArchive.java:381)[78:org.onosproject.onos-core-common:1.8.4]
... 7 more

David

David

unread,
Apr 12, 2017, 10:03:31 AM4/12/17
to ONOS Discuss
Ok solved. I changed the owner of the onos folder, who was root. Thanks a lot for your help.

David

Reply all
Reply to author
Forward
0 new messages