Indigo controller on ONL(unsupported output port)

[saji]

I've installed ONL linux on Edge-core bare metal switch(as4600-54t-r0). After running ofdpa(./ofdpa-2.0-ea2-powerpc-as4600-54t-r0) tried to connect to indigo controller( brcm-indigo-ofdpa-ofagent --controller 10.176.46.73:6633).

Need to add port to controller? kindly help.

Regards

Saji

Log:

root@onl-powerpc:~# brcm-indigo-ofdpa-ofagent --controller 10.176.46.73:6633

Aug 26 14:24:46.028 ofagent: MSG:

version 0.0.0.0 -- Built on Fri Jun 5 2015 at 00:53:20 UTC

OF Datapath ID: 0x000000000000DA7A

Initializing the system.

Aug 26 14:24:46.127 socketmanager: INFO: Initializing socket manager

Aug 26 14:24:46.130 ofstatemanager: INFO: Registered gentable "test" with table id 0

Aug 26 14:24:46.131 socketmanager: INFO: Enabling OF socket mgr

Aug 26 14:24:46.131 ofconnectionmanager: INFO: Enabling OF connection mgr

Aug 26 14:24:46.131 ofstatemanager: INFO: Enabling OF state mgr

Aug 26 14:24:46.131 ofagent: MSG: Adding controller 10.176.46.73:6633

Aug 26 14:24:46.132 ofconnectionmanager: INFO: Added remote connection: 10.176.46.73:6633

Aug 26 14:24:46.134 ofconnectionmanager: INFO: cxn 10.176.46.73:6633: DISCONNECTED->CONNECTING

Aug 26 14:24:46.134 indigo_ofdpa_driver: ERROR: indigo_fwd_expiration_enable_set() unsupported.

Aug 26 14:24:46.201 ofconnectionmanager: INFO: cxn 10.176.46.73:6633: CONNECTING->HANDSHAKE_COMPLETE

Aug 26 14:24:46.247 ofstatemanager: WARN: Unhandled message of_table_features_stats_request from cxn 0.

Aug 26 14:24:46.248 ofconnectionmanager: INFO: Upgrading cxn 10.176.46.73:6633 to master

Aug 26 14:24:46.255 indigo_ofdpa_driver: ERROR: Upsupported output port action (OFPP_CONTROLLER) for Table: 0

Aug 26 14:24:46.256 indigo_ofdpa_driver: ERROR: Failed to get flow instructions. (err = -5)

Aug 26 14:24:46.256 ofstatemanager: ERROR: Error from Forwarding while inserting flow: Incompatible assignment

Aug 26 14:24:46.256 indigo_ofdpa_driver: ERROR: Invalid table id 1

Aug 26 14:24:46.256 indigo_ofdpa_driver: ERROR: Error getting match fields and masks. (err = -2)

Aug 26 14:24:46.256 ofstatemanager: ERROR: Error from Forwarding while inserting flow: Bad parameter

[Rob Sherwood]

Hi Saji,

Thanks for the mail.  We ran into this issue ourselves and have not had a chance to fix it.  The root of the problem seems to be that the API has changed between OFDPA EA1 code and the OFDPA EA2 code, which is resulting in this problem.  In other words, the Indigo OF-DPA driver interface (the code here: https://github.com/opennetworklinux/ofdpa-2.0/tree/master/modules/indigo_ofdpa_driver/module/src) has to be updated to meet the new OFDPA EA2 API.  The catch is that some of the platforms (e.g., LY2) still have only have OFDPA EA1 support, so those would have to be updated as well.

The good news is that your specific problem is fixable strictly via open source code (that is, without needing to involve me), so if you're interested, you can try to take a pass at getting it to work.  If that's of interest, let me know and I can point you in the right direction.

Other wise, know that we're looking into it and are woking on a fix.

- Rob

.

--
You received this message because you are subscribed to the Google Groups "opennetworklinux" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opennetworklin...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Rob Sherwood]

FYI, filed as https://github.com/opennetworklinux/ONL/issues/135

- Rob

.

[Liang-Wei Kang]

Hi,

    I just added brcm-indigo-ofdpa-ofagent binary to https://github.com/opennetworklinux/ofdpa-2.0-closed-accton. 

    Hope it helps.

/Lewis

[Nathania PS]

Hi,

I can not execute the brcm-indigo-ofdpa-ofagent binary on powerpc architecture as it for Intel 64.

Please update ofagent

Saji

[Liang-Wei Kang]

Hi,

adding powerpc version done.

/Lewis
saji於 2015年9月1日星期二 UTC+8下午1時01分22秒寫道：

[Nathania PS]

I have executed the powerpc version, still the same log repeats.

Also 'client_flowtable_dump' command shows the message 'No flow entries found.'

Is there any way to test broadcom driver capabilities to add/delete/update flow table on the chip?

Thanks,

Saji

Log:

root@onl-powerpc:/usr/ofdpa-2.0-closed-accton-master# ./brcm-indigo-ofdpa-ofagent_powerpc --controller=10.176.46.73:6633

09-07 13:15:54.307699 [ofagent]

version 0.0.0.0 -- Built on Mon Aug 31 2015 at 03:41:55 UTC

OF Datapath ID: 0x000000000000DA7A

Initializing the system.

09-07 13:15:54.398726 [socketmanager] Initializing socket manager

09-07 13:15:54.402518 [ofstatemanager] Registered gentable "test" with table id 0

09-07 13:15:54.402724 [socketmanager] Enabling OF socket mgr

09-07 13:15:54.402803 [ofconnectionmanager] Enabling OF connection mgr

09-07 13:15:54.402888 [ofstatemanager] Enabling OF state mgr

09-07 13:15:54.402968 [ofagent] Adding controller 10.176.46.73:6633

09-07 13:15:54.403159 [ofconnectionmanager] Added remote connection: 10.176.46.73:6633

09-07 13:15:54.409547 [ofconnectionmanager] cxn 10.176.46.73:6633: DISCONNECTED->CONNECTING

09-07 13:15:54.409661 [indigo_ofdpa_driver] indigo_fwd_expiration_enable_set() unsupported.

09-07 13:15:54.411093 [ofconnectionmanager] cxn 10.176.46.73:6633: CONNECTING->HANDSHAKE_COMPLETE

09-07 13:15:54.466567 [ofstatemanager] Unhandled message of_table_features_stats_request from cxn 0.

09-07 13:15:54.467799 [ofconnectionmanager] Upgrading cxn 10.176.46.73:6633 to master

09-07 13:15:54.469922 [indigo_ofdpa_driver] Upsupported output port action (OFPP_CONTROLLER) for Table: 0

09-07 13:15:54.470095 [indigo_ofdpa_driver] Failed to get flow instructions. (err = -5)

09-07 13:15:54.470222 [ofstatemanager] Error from Forwarding while inserting flow: Incompatible assignment

09-07 13:15:54.470500 [indigo_ofdpa_driver] Invalid table id 1

09-07 13:15:54.470635 [indigo_ofdpa_driver] Error getting match fields and masks. (err = -2)

09-07 13:15:54.470767 [ofstatemanager] Error from Forwarding while inserting flow: Bad parameter

[Kang]

09-07 13:15:54.469922 [indigo_ofdpa_driver] Upsupported output port action (OFPP_CONTROLLER) for Table: 0

 

As the above shows, it doesn’t support output to CONTROLLER for Table 0. As I know, it’s ASIC limitation. Table 20/50/60 can support it.

 

Best regards,

/Lewis Kang

--

[Vitaliy Ivanov]

Hey,

On Mon, Sep 7, 2015 at 9:25 AM, Kang <ka...@accton.com> wrote:

09-07 13:15:54.469922 [indigo_ofdpa_driver] Upsupported output port action (OFPP_CONTROLLER) for Table: 0

 

As the above shows, it doesn’t support output to CONTROLLER for Table 0. As I know, it’s ASIC limitation. Table 20/50/60 can support it.

It's not ASIC limitation but OF-DPA pipeline specific.


​

Every table in OF-DPA has a set of rules that you can install into it. There is TTP defined for OF-DPA.

You can find more details in latest OF-DPA spec:
https://github.com/Broadcom-Switch/of-dpa/commit/a09e978b1004ecfdb58b2241bdd9808a7ad8dd5e

Vitaliy

[Kang]

OFDPA pipeline is based on the underline ASIC. Isn’t it?

 

Best regards,

/Lewis Kang

[Vitaliy Ivanov]

Hi Lewis,

From OF-DPA 2.0 spec, page 22:

"Remember that OF-DPA tables are programming abstractions and do not necessary directly correspond
one-to-one with hardware tables. However, they are designed to faithfully capture both use-case
requirements and the hardware packet flow semantics, while being straightforward to program from
standard controllers."

Vitaliy

[Rob Sherwood]

Kind of jumping in here, whether you want to describe this as an ASIC limitation or a pipeline limitation, you're both right in that this is not how OF-DPA is intended to be used.  

@Nathania: I'm quite certain that OF-DPA is capable of accomplishing what you would like to do, but probably not all from Table 0.  If you could describe what packet forwarding policy you're trying to program, we can probably point you in the right direction to accomplish that.

Hope that helps,

- Rob

.

[Saji PC]

While building ofdap_tools for accton as4600 bare metal switch, 'ofdpa_api.h directory is not found'. I have taken api headers from broadcom switch git, but this is not match with accton board ofdapa-2.0.
Please share link for api headers(ofdpa_api.h, ofpda_datatypes.h).

Regards

Saji

[Rob Sherwood]

HI Saji,

Those headers are available from the ofdpa-2.0-closed package that's installed by default in the powerpc architecture, but the big caveat is that these are the EA1 headers -- EA3 has just been released and we're going to try to update to that.

FYI, if for some reason you don't have the ofdpa-2.0-closed package, you can install it from ONL via `apt-get update; apt-get install ofdpa-2.0-closed` or manually after downloading it from the apt repository:

http://apt.opennetlinux.org/debian/dists/unstable/main/binary-powerpc/ofdpa-2.0-closed_0.1.5bsn1~ubuntu1_powerpc.deb

Hope that helps,

- Rob

.