RE: Need information about understanding PCIE non-transparent bridge

42 views
Skip to first unread message

Allen Hubbe

unread,
May 6, 2016, 9:06:24 AM5/6/16
to sridhar T S, linu...@googlegroups.com
Hi Sridhar,

If you have NTB hardware already physically connected and
configured in your BIOS, then you can build and load the
linux ntb modules.

Here is the documentation on linux ntb modules. It says
what the modules do, and how to use them.

http://lxr.free-electrons.com/source/Documentation/ntb.txt

If you are interested in testing or demonstrating basic NTB
functionality, try ntb_tool and ntb_pingpong. There is
also a network device over NTB supported by ntb_transport
and ntb_netdev together.

Please let me know if you have any questions not answered in
the documentation. I am happy to help.

Allen

From: sridhar T S
>
> Hi allen,
>
> myself sridhar, working as senior software engineer.
> i wanted to understand about PCIE non-transparent bridge.
>
> i will be testing the linux device driver for NTB, for now
> i have a very fair understanding about the architecture.
>
> need some ideas about how to test the NTB device driver
> across NTB systems for proper system operations with
> respect to NTB device driver for linux
>
> your inputs and information will be helpful.
>
> thanks in advance.
>
> regards,
> Sridhar



sridhar T S

unread,
May 9, 2016, 5:23:20 AM5/9/16
to Allen Hubbe, linu...@googlegroups.com
hi Allen,

yes, am interested in testing the ntb functionality using Linux mainly our test OS will be Ubuntu.
i would welcome your suggestions and ideas upon the system configuration, tools/applications, server setup between the primary and secondary machines.

below is my queries:

1. Can you let me know how to use the tools ntb_tool and ntb_pingpong to test the ntb connection.
2. NTB setup configuration i.e how to configure the two systems for NTB data access
            a. which file system server to create for testing between platforms.
            b. third party tools to verify the ntb bandwidth 
3. How to access non bar0 data transactions between ntb machines? 
            a. can you suggest any tools or applications that can be used to verfiy from operating system perspective
4. how can we initiate data transfer using the system DMA?

i will keep you posted on any more queries in this thread

regards,
Sridhar 

Jon Mason

unread,
May 9, 2016, 8:11:34 AM5/9/16
to sridhar T S, Allen Hubbe, linu...@googlegroups.com
On Mon, May 9, 2016 at 5:23 AM, sridhar T S <sridha...@gmail.com> wrote:
> hi Allen,
>
> yes, am interested in testing the ntb functionality using Linux mainly our
> test OS will be Ubuntu.
> i would welcome your suggestions and ideas upon the system configuration,
> tools/applications, server setup between the primary and secondary machines.
>
> below is my queries:
>
> 1. Can you let me know how to use the tools ntb_tool and ntb_pingpong to
> test the ntb connection.

See Documentation/ntb.txt

> 2. NTB setup configuration i.e how to configure the two systems for NTB data
> access
> a. which file system server to create for testing between
> platforms.

Not sure what you mean here. Are you referring to NFS?

> b. third party tools to verify the ntb bandwidth

None are known to exist

> 3. How to access non bar0 data transactions between ntb machines?
> a. can you suggest any tools or applications that can be used to
> verfiy from operating system perspective

Each BAR is exposed as a separate memory window. If you have > 1 BAR,
then you will have a separate MW that the client can use (unless it is
being used by the kernel to workaround HW issues).

> 4. how can we initiate data transfer using the system DMA?

This will happen automatically if the DMA engine is enabled in the kernel
> --
> You received this message because you are subscribed to the Google Groups
> "linux-ntb" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to linux-ntb+...@googlegroups.com.
> To post to this group, send email to linu...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/linux-ntb/CAO%2B9SsM2z8QW_RVBaw3g7%3DnOehppq98zQ_1Zw10a7gofiBBgFA%40mail.gmail.com.
>
> For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages