Replication not working for two volumes and one redis based filer

337 views
Skip to first unread message

sachin walia

unread,
Aug 6, 2015, 1:30:10 AM8/6/15
to Seaweed File System
I have a following topology:

1. One master server

2. Two volume servers

3. One Filer using redis as a backend

Following is the command line used to start these servers:

1. Master Server

 /usr/bin/weed master -mdir=/opt/bin/weedfs/mdata/ -port=9333 -volumeSizeLimitMB=30000 -defaultReplication="001" -ip="192.168.0.15"

2. Volume Server I

/usr/bin/weed volume -port=9444 -dir=/opt/bin/weedfs/vdata1 -max=5 -dataCenter=pixDC -rack=pixRack -mserver="192.168.0.15:9333" -pulseSeconds=3 -ip="192.168.0.15"

3. Volume Server II

/usr/bin/weed volume -port=9555 -dir=/opt/bin/weedfs/vdata2 -max=5 -dataCenter=pixDC -rack=pixRack -mserver="192.168.0.15:9333" -pulseSeconds=3 -ip="192.168.0.15"

4. Filer Server

/usr/bin/weed filer -port=9666 -dir=/opt/bin/weedfs/fdata -master="192.168.0.15:9333" -redis.server="192.168.0.15:6379" -redis.database=1


From my Java client code I upload to Filer server by providing complete path and it gets correctly copied as I can access it from browser. Also it shows up in redis as well.

However the problem seems to be that file is stored in only one volume server. Can somebody point me out what am I doing incorrectly.

FYI, I am using version weed_0.70beta_amd64.deb.

thanks in advance.

Chris Lu

unread,
Aug 6, 2015, 1:43:46 AM8/6/15
to seaw...@googlegroups.com
It should work since SeaweedFS is actually fail fast. How does it seem "that file is stored in only one volume server"?

Tip: you can take a look with browser to check the master's admin page: http://192.168.0.15:9333

Chris

--
You received this message because you are subscribed to the Google Groups "Seaweed File System" group.
To unsubscribe from this group and stop receiving emails from it, send an email to seaweedfs+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

sachin walia

unread,
Aug 6, 2015, 1:52:36 AM8/6/15
to Seaweed File System
I checked dashboard on both volume servers and second one shows no usage:

Master Server








As you can see the third image shows that the files are not replicated in second instance of volume server. Is the command line correct?

thanks,

Sachin Walia

Chris Lu

unread,
Aug 6, 2015, 7:33:21 PM8/6/15
to seaw...@googlegroups.com
When starting filer, you would also need

-defaultReplicaPlacement=001


You can skip the same setting on master server.

Chris

sachin walia

unread,
Aug 6, 2015, 10:11:27 PM8/6/15
to Seaweed File System
Thanks it works perfectly. I think it might be a good idea to mention this in the wiki because it's not mentioned anywhere.

prem

unread,
Feb 6, 2023, 2:58:10 AM2/6/23
to Seaweed File System
Hi Sachi,

I have the similar setup (Except filer)
Master : 
./weed master -defaultReplication=001

Volume:
./weed volume -port=8081 -dir=/volumes/vol1 -max=100 -mserver="master_address:9333" -dataCenter=dc1 -rack=rack1 pulseSeconds=3
./weed volume -port=8082 -dir=/volumes/vol2 -max=100 -mserver="master_address:9333" -dataCenter=dc1 -rack=rack1 pulseSeconds=3

I am uploading to 8081 which corresponds to /volumes/vol1. And I observe that files are replicated in 8082 corresponding to /volumes/vol2
My problem is, replication is happening, but the file sizes are varying.  

A thought on this or help would be appreciated.

Regards
M K Prem Kumar
Reply all
Reply to author
Forward
0 new messages