New installation: RDMA or TCP/IP

45 views
Skip to first unread message

axel

unread,
Jun 23, 2022, 4:55:33 AM6/23/22
to fhgfs...@googlegroups.com
Hello,


i made a new installation with opensuse 15.3 and openhpc 2.0.

After several problems i managed to install everything.

The Storage, meta and managment-server are on the same computer as one
client.

Everything works finde -


Management
==========
nuku [ID: 1]: reachable at 192.168.200.250:8008 (protocol: TCP)

Metadata
==========
nuku [ID: 1]: reachable at 192.168.5.250:8005 (protocol: RDMA)

Storage
==========
nuku [ID: 3]: reachable at 192.168.5.250:8003 (protocol: RDMA)


But on the nodes it looks little bit different - or isn't there a problem?

beegfs-check-servers shows only tcpip connections while beegfs-net not.



qn01:~ # beegfs-check-servers
Management
==========
nuku [ID: 1]: reachable at 192.168.200.250:8008 (protocol: TCP)

Metadata
==========
nuku [ID: 1]: reachable at 192.168.200.250:8005 (protocol: TCP)

Storage
==========
nuku [ID: 3]: reachable at 192.168.200.250:8003 (protocol: TCP)

qn01:~ # beegfs-net

mgmt_nodes
=============
nuku [ID: 1]
   Connections: TCP: 1 (192.168.200.250:8008);

meta_nodes
=============
nuku [ID: 1]
   Connections: RDMA: 1 (192.168.5.250:8005);

storage_nodes
=============
nuku [ID: 3]
   Connections: RDMA: 1 (192.168.5.250:8003);


First test with dd status=progress if=/dev/zero of=test.img bs=1024m
shows better performance as the tcp/ip interface can do.


How i can change something that beegfs-check-servers shows correct things?


Best regards,

Axel



Reply all
Reply to author
Forward
0 new messages