creating a Multi-Node fails

[Meikel Jagsen]

Tested the Multinode configuration on two fresh and empty installations (ova):

how to from your https://github.com/opendedup/sdfs

Step 1: Create a DSE on Server1 using a 4K block size and 200GB of capacity and cluster node id of "1"

	mkdse --dse-name=sdfs --dse-capacity=200GB --cluster-node-id=1

Step 2: Edit the /etc/sdfs/jgroups.cfg.xml and add the bind_addr attribute with Server1's IP address to the <UDP> tag.

	<UDP         
	mcast_port="${jgroups.udp.mcast_port:45588}"         
	tos="8"         
	ucast_recv_buf_size="5M"       
	 ucast_send_buf_size="640K"         
	mcast_recv_buf_size="5M"       
	 mcast_send_buf_size="640K"         
	loopback="true"         
	max_bundle_size="64K"         
	bind_addr="192.168.1.191"

Step 3: Start the DSE service on Server1

	startDSEService.sh -c /etc/sdfs/sdfs-dse-cfg.xml &

Step 4: Create a DSE on Server1 using a 4K block size and 200GB of capacity and cluster node id of "2"

	mkdse --dse-name=sdfs --dse-capacity=200GB --cluster-node-id=2

Step 5: Edit the /etc/sdfs/jgroups.cfg.xml and add the bind_addr attribute with Server1's (I'm sure you mean Server2!) IP address to the <UDP> tag.

	<UDP
	mcast_port="${jgroups.udp.mcast_port:45588}"
	tos="8"
	ucast_recv_buf_size="5M"
	ucast_send_buf_size="640K"
	mcast_recv_buf_size="5M"
	mcast_send_buf_size="640K"
	loopback="true"
	max_bundle_size="64K"
	bind_addr="192.168.1.192"

Step 6: Start the DSE service on Server1 (I'm sure you mean Server2!)

	startDSEService.sh -c /etc/sdfs/sdfs-dse-cfg.xml &

runs but:


# sdfscli --dse-info
0 [main] INFO org.apache.commons.httpclient.HttpMethodDirector  - I/O exception (java.net.ConnectException) caught when processing request: Connection refused
2 [main] INFO org.apache.commons.httpclient.HttpMethodDirector  - Retrying request
18 [main] INFO org.apache.commons.httpclient.HttpMethodDirector  - I/O exception (java.net.ConnectException) caught when processing request: Connection refused
18 [main] INFO org.apache.commons.httpclient.HttpMethodDirector  - Retrying request
20 [main] INFO org.apache.commons.httpclient.HttpMethodDirector  - I/O exception (java.net.ConnectException) caught when processing request: Connection refused
20 [main] INFO org.apache.commons.httpclient.HttpMethodDirector  - Retrying request
java.io.IOException: java.net.ConnectException: Connection refused
        at org.opendedup.sdfs.mgmt.cli.MgmtServerConnection.getResponse(MgmtServerConnection.java:77)
        at org.opendedup.sdfs.mgmt.cli.ProcessDSEInfo.runCmd(ProcessDSEInfo.java:18)
        at org.opendedup.sdfs.mgmt.cli.SDFSCmdline.parseCmdLine(SDFSCmdline.java:65)
        at org.opendedup.sdfs.mgmt.cli.SDFSCmdline.main(SDFSCmdline.java:578)
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:668)
        at org.opendedup.util.EasySSLProtocolSocketFactory.createSocket(EasySSLProtocolSocketFactory.java:196)
        at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
        at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:                                  1361)
        at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
        at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
        at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
        at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
        at org.opendedup.sdfs.mgmt.cli.MgmtServerConnection.getResponse(MgmtServerConnection.java:65)
        ... 3 more

AND:

:~# mount.sdfs pool0 /media/pool0
Running Program SDFS Version 3.3.6
reading config file = /etc/sdfs/pool0-volume-cfg.xml
Mar 29, 2017 4:00:43 AM org.jgroups.stack.Configurator resolveAndAssignField
WARNING: JGRP000014: TP.loopback has been deprecated: enabled by default
Mar 29, 2017 4:00:43 AM org.jgroups.stack.Configurator resolveAndAssignField
WARNING: JGRP000014: Discovery.timeout has been deprecated: GMS.join_timeout should be used instead
Mar 29, 2017 4:00:43 AM org.jgroups.stack.Configurator resolveAndAssignField
WARNING: JGRP000014: Discovery.num_initial_members has been deprecated: will be ignored
Mar 29, 2017 4:00:43 AM org.jgroups.protocols.UDP setBufferSize
WARNING: JGRP000015: the send buffer of socket DatagramSocket was set to 640KB, but the OS only allocated 212.99KB. This might lead to performance problems. Please set your max send buffer in the OS correctly (e.g. net.core.wmem_max on Linux)
Mar 29, 2017 4:00:43 AM org.jgroups.protocols.UDP setBufferSize
WARNING: JGRP000015: the receive buffer of socket DatagramSocket was set to 5MB, but the OS only allocated 212.99KB. This might lead to performance problems. Please set your max receive buffer in the OS correctly (e.g. net.core.rmem_max on Linux)
Mar 29, 2017 4:00:43 AM org.jgroups.protocols.UDP setBufferSize
WARNING: JGRP000015: the send buffer of socket MulticastSocket was set to 640KB, but the OS only allocated 212.99KB. This might lead to performance problems. Please set your max send buffer in the OS correctly (e.g. net.core.wmem_max on Linux)
Mar 29, 2017 4:00:43 AM org.jgroups.protocols.UDP setBufferSize
WARNING: JGRP000015: the receive buffer of socket MulticastSocket was set to 5MB, but the OS only allocated 212.99KB. This might lead to performance problems. Please set your max receive buffer in the OS correctly (e.g. net.core.rmem_max on Linux)

-------------------------------------------------------------------
GMS: address=Unknown-17307, cluster=sdfs-cluster, physical address=192.168.1.191:51565
-------------------------------------------------------------------
Unable to initialize HashChunkService
java.io.IOException: No DSE Servers found
        at org.opendedup.sdfs.cluster.DSEClientSocket.start(DSEClientSocket.java:130)
        at org.opendedup.sdfs.cluster.DSEClientSocket.<init>(DSEClientSocket.java:103)
        at org.opendedup.sdfs.servers.HCServiceProxy.init(HCServiceProxy.java:229)
        at org.opendedup.sdfs.servers.SDFSService.start(SDFSService.java:75)
        at fuse.SDFS.MountSDFS.setup(MountSDFS.java:203)
        at fuse.SDFS.MountSDFS.init(MountSDFS.java:242)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:207)
Service exit with a return value of 255

[Meikel Jagsen]

~# ifconfig
ens160    Link encap:Ethernet  HWaddr 00:50:56:9a:0e:6f
          inet addr:192.168.1.191  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::250:56ff:fe9a:e6f/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:20963 errors:0 dropped:0 overruns:0 frame:0
          TX packets:18245 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2192528 (2.1 MB)  TX bytes:5378091 (5.3 MB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:20 errors:0 dropped:0 overruns:0 frame:0
          TX packets:20 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:1288 (1.2 KB)  TX bytes:1288 (1.2 KB)
~# netstat -tulpen |grep jsvc
tcp        0      0 127.0.1.1:2222          0.0.0.0:*               LISTEN      0          32061       1466/jsvc.exec
tcp        0      0 192.168.1.191:40419     0.0.0.0:*               LISTEN      0          32055       1466/jsvc.exec
udp        0      0 0.0.0.0:7500            0.0.0.0:*                           0          32049       1466/jsvc.exec
udp        0      0 228.8.8.8:45588         0.0.0.0:*                           0          32048       1466/jsvc.exec
udp        0      0 192.168.1.191:58079     0.0.0.0:*                           0          32047       1466/jsvc.exec

~# ifconfig
ens160    Link encap:Ethernet  HWaddr 00:50:56:9a:24:86
          inet addr:192.168.1.192  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::250:56ff:fe9a:2486/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:32600 errors:0 dropped:0 overruns:0 frame:0
          TX packets:28826 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:3390479 (3.3 MB)  TX bytes:8768316 (8.7 MB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:10 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1
          RX bytes:480 (480.0 B)  TX bytes:480 (480.0 B)

~# netstat -tulpen |grep jsvc
tcp        0      0 127.0.1.1:2222          0.0.0.0:*               LISTEN      0          37139       1524/jsvc.exec
tcp        0      0 192.168.1.192:39316     0.0.0.0:*               LISTEN      0          37137       1524/jsvc.exec
udp        0      0 192.168.1.192:47113     0.0.0.0:*                           0          35967       1524/jsvc.exec
udp        0      0 0.0.0.0:7500            0.0.0.0:*                           0          35969       1524/jsvc.exec
udp        0      0 228.8.8.8:45588         0.0.0.0:*                           0          35968       1524/jsvc.exec