Re: ONOS Ping for simple leaf spine architecture

28 views
Skip to first unread message

Charles Chan

unread,
Aug 14, 2019, 7:00:05 PM8/14/19
to ONOS Discuss, badr...@gmail.com, trellis-dev
(+trellis-dev)

Hi,

I believe it is caused by subnet misconfiguration. Trellis doesn't allow one subnet to span across multiple leaves (with an only exception when these two leaves are paired).
For example, 10.6.1.254/24 is configured on both switches.

Thanks,
Charles

On Tuesday, August 13, 2019 at 8:14:57 AM UTC-7, badr...@gmail.com wrote:
TOPOLOGY DESCRIPTION:
I have ONOS in a leaf/spine architecture. 
Here is the diagram of this -

Host 1 ==> Leaf1 (Whitebox switch) ==> Spine (Whitebox switch) ==> Leaf 2 (Whitebox switch) ==> Host 2 and Host 3

Between leaf1, spine and Leaf 2 we are running Segmented routing -
onos> apps -a -s
*   5 org.onosproject.optical-model        1.13.3   Optical Network Model
*   6 org.onosproject.openflow-base        1.13.3   OpenFlow Base Provider
*  22 org.onosproject.netcfghostprovider   1.13.3   Network Config Host Provider
*  23 org.onosproject.drivers              1.13.3   Default Drivers
*  39 org.onosproject.route-service        1.13.3   Route Service Server
*  41 org.onosproject.hostprovider         1.13.3   Host Location Provider
*  42 org.onosproject.lldpprovider         1.13.3   LLDP Link Provider
*  43 org.onosproject.openflow             1.13.3   OpenFlow Provider Suite
*  59 org.onosproject.netcfglinksprovider  1.13.3   Network Config Link Provider
*  76 org.onosproject.mcast                1.13.3   Multicast traffic control
*  77 org.onosproject.segmentrouting       1.13.3   Segment Routing
Here is configuration of hosts - 

onos> hosts
id=F8:F2:1E:35:AC:01/None, mac=F8:F2:1E:35:AC:01, locations=[of:00003c2c99ea91b7/2], vlan=None, ip(s)=[10.6.2.3], locType=none, name=-, innerVlan=None, outerTPID=vlan, provider=host:org.onosproject.netcfghost, configured=true - Host-2 - Leaf-2

id=F8:F2:1E:35:AC:71/None, mac=F8:F2:1E:35:AC:71, locations=[of:00003c2c99ea91b7/1], vlan=None, ip(s)=[10.6.1.2], gridX=null, gridY=null, latitude=null, locType=none, longitude=null, name=-, innerVlan=None, outerTPID=vlan, provider=host:org.onosproject.netcfghost, configured=true Host-3 - Leaf-2

id=F8:F2:1E:35:AF:11/None, mac=F8:F2:1E:35:AF:11, locations=[of:00003c2c99ea8b1d/1], vlan=None, ip(s)=[10.6.1.1], locType=none, name=-, innerVlan=None, outerTPID=vlan, provider=host:org.onosproject.netcfghost, configured=true ===> Host-1 - Leaf-1


List of devices:
onos> devices
id=of:00003c2c99ea8b1d, available=true, local-status=connected 30m13s ago, role=MASTER, type=SWITCH, mfr=Accton Corp., hw=x86-64-accton-as6812-32x-r0, sw=ofdpa 3.0.5.5+accton2.3-1, serial=681232X1826021, chassis=3c2c99ea8b1d, driver=accton-ofdpa3, channelId=10.209.173.72:55386, locType=none, managementAddress=10.209.173.72, name=Leaf-1, protocol=OF_13
id=of:00003c2c99ea8b9f, available=true, local-status=connected 30m13s ago, role=MASTER, type=SWITCH, mfr=Accton Corp., hw=x86-64-accton-as6812-32x-r0, sw=ofdpa 3.0.5.5+accton2.3-1, serial=681232X1826022, chassis=3c2c99ea8b9f, driver=accton-ofdpa3, channelId=10.209.173.71:36570, locType=none, managementAddress=10.209.173.71, name=Spine-1, protocol=OF_13
id=of:00003c2c99ea91b7, available=true, local-status=connected 30m12s ago, role=MASTER, type=SWITCH, mfr=Accton Corp., hw=x86-64-accton-as6812-32x-r0, sw=ofdpa 3.0.5.5+accton2.3-1, serial=681232X1826034, chassis=3c2c99ea91b7, driver=accton-ofdpa3, channelId=10.209.173.73:41348, locType=none, managementAddress=10.209.173.73, name=Leaf-2, protocol=OF_13

ONOS configuration -
onos> netcfg
{
  "devices" : {
    "of:00003c2c99ea8b1d" : {
      "basic" : {
        "name" : "Leaf-1"
      },
      "segmentrouting" : {
        "name" : "Leaf-R1",
        "ipv4NodeSid" : 101,
        "ipv4Loopback" : "10.209.173.72",
        "routerMac" : "3c:2c:99:ea:8b:1d",
        "isEdgeRouter" : true,
        "adjacencySids" : [ ]
      }
    },
    "of:00003c2c99ea8b9f" : {
      "basic" : {
        "name" : "Spine-1"
      },
      "segmentrouting" : {
        "name" : "Spine-R1",
        "ipv4NodeSid" : 201,
        "ipv4Loopback" : "10.209.173.71",
        "routerMac" : "3c:2c:99:ea:8b:9f",
        "isEdgeRouter" : false,
        "adjacencySids" : [ ]
      }
    },
    "of:00003c2c99ea91b7" : {
      "segmentrouting" : {
        "name" : "Leaf-R2",
        "ipv4NodeSid" : 102,
        "ipv4Loopback" : "10.209.173.73",
        "routerMac" : "3c:2c:99:ea:91:b7",
        "isEdgeRouter" : true,
        "adjacencySids" : [ ]
      },
      "basic" : {
        "name" : "Leaf-2"
      }
    }
  },
  "layouts" : { },
  "apps" : {
    "org.onosproject.provider.lldp" : {
      "suppression" : {
        "deviceTypes" : [ "ROADM", "OTN", "FIBER_SWITCH", "OPTICAL_AMPLIFIER" ],
        "annotation" : "{\"no-lldp\":null}"
      }
    }
  },
  "ports" : {
    "of:00003c2c99ea91b7/2" : {
      "interfaces" : [ {
        "ips" : [ "10.6.2.254/24" ],
        "vlan-untagged" : 20,
        "mac" : "3C:2C:99:EA:91:B7"
      } ]
    },
    "of:00003c2c99ea8b1d/1" : {
      "interfaces" : [ {
        "ips" : [ "10.6.1.254/24" ],
        "vlan-untagged" : 10,
        "mac" : "3C:2C:99:EA:8B:1D"
      } ]
    },
    "of:00003c2c99ea91b7/1" : {
      "interfaces" : [ {
        "ips" : [ "10.6.1.254/24" ],
        "vlan-untagged" : 10,
        "mac" : "3C:2C:99:EA:91:B7"
      } ]
    }
  },
  "links" : { },
  "regions" : { },
  "hosts" : {
    "F8:F2:1E:35:AC:71/None" : {
      "basic" : {
        "ips" : [ "10.6.1.2" ],
        "locations" : [ "of:00003c2c99ea91b7/1" ]
      }
    },
    "F8:F2:1E:35:AC:01/None" : {
      "basic" : {
        "ips" : [ "10.6.2.3" ],
        "locations" : [ "of:00003c2c99ea91b7/2" ]
      }
    },
    "F8:F2:1E:35:AF:11/None" : {
      "basic" : {
        "ips" : [ "10.6.1.1" ],
        "locations" : [ "of:00003c2c99ea8b1d/1" ]
      }
    }
  }
}

Logs messages -

2019-08-13 11:42:03,217 | ERROR | ldpLinkProvider) | onos-providers-lldp              | 237 - org.onosproject.onos-providers-lldp - 1.13.3 | [org.onosproject.provider.lldp.impl.LldpLinkProvider(164)] Failed creating the component instance; see log for reason



PROBLEM DESCRIPTION:

I am not able to ping between host-1 and Host-2
I am able to ping between host-2 and host-3 - in the same Leaf-2

Logs when the ping fail is -
"No Matching Batch for this error xid =0"

Not sure why this is happening

Need Help.

ROUTING TABLE IN HOSTS:

I have a default route point to the management interface and another specifc route to interface gateway of 10.6.1.254 - for leaf-1 GW.


Please help.


Charles Chan

unread,
Aug 15, 2019, 7:01:20 PM8/15/19
to badr...@gmail.com, ONOS Discuss, trellis-dev
I suspect that is due to the conflict between lldpprovider and netcfglinkprovider - you can have one at a time. You can try to remove netcfglinkprovider and see if the issue persists. There should be some other log (near this one) that provides more details. A full karaf.log will help.

Thanks,
Charles Chan, Ph.D.
Member of Technical Staff, Open Networking Foundation


On Thu, Aug 15, 2019 at 9:35 AM <badr...@gmail.com> wrote:
Hi Charles,

Thanks for that confirmation.
One question what is the impact of this error message -
Logs messages -

2019-08-13 11:42:03,217 | ERROR | ldpLinkProvider) | onos-providers-lldp              | 237 - org.onosproject.onos-providers-lldp - 1.13.3 | [org.onosproject.provider.lldp.impl.LldpLinkProvider(164)] Failed creating the component instance; see log for reason


Thanks

--
You received this message because you are subscribed to a topic in the Google Groups "ONOS Discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/a/onosproject.org/d/topic/onos-discuss/C_iiMHaV3eM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to onos-discuss...@onosproject.org.
To view this discussion on the web visit https://groups.google.com/a/onosproject.org/d/msgid/onos-discuss/a59d97d0-36e2-4e5c-a76f-51bd34e8c2cb%40onosproject.org.
Reply all
Reply to author
Forward
0 new messages