getting lot of replication related messages

29 views
Skip to first unread message

Vinod Chandran

unread,
Mar 23, 2021, 7:57:12 AM3/23/21
to mogile
Hi all ,
  when I do a telnet localHost 7001  and insert command "! watch" I am only getting below messages , i am not seeing any kind success messages like file successfully read or write , do i need to worry , what is th emeaning of the below messages .

:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545836071139049
:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545835864509881
:: [replicate(29036)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545836151911769
:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 152363540
:: [replicate(29036)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545835943380521
:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545835856583238
:: [replicate(29036)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545835455340696
:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545835853421510
:: [replicate(29036)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545835120673158
:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545836034994812
:: [replicate(29038)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545836117582603
:: [replicate(29036)] policy_no_suggestions: replication policy ran out of suggestions for us replicating fid 64545836033855578
}

Thanks & Regards
   Vinod Chandran  

dave000

unread,
Mar 23, 2021, 10:03:17 AM3/23/21
to mog...@googlegroups.com
Looks like you might be out of storage on some of your devices, or your replication policy is set to high. Can you post the output of: mogadm check ?

--

---
You received this message because you are subscribed to the Google Groups "mogile" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mogile+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mogile/a8545f80-0124-415a-88cb-a4fa0eba690bn%40googlegroups.com.

Eric Wong

unread,
Mar 23, 2021, 11:08:01 PM3/23/21
to mog...@googlegroups.com
Vinod Chandran <vin...@endurance.com> wrote:
> :: [replicate(29038)] policy_no_suggestions: replication policy ran out of
> suggestions for us replicating fid 64545836071139049

What dave said about "mogadm check". Also, mogfiledebug
on these FIDs would be useful: mogfiledebug --paths=stat --fid $FID

Vinod Chandran

unread,
Mar 24, 2021, 5:48:59 AM3/24/21
to mog...@googlegroups.com
Hi ,
the below command thrown error , guessing a version issue , hoping the second output will throw some light .

~# mogfiledebug --paths=stat --fid 64545836145707731
Unknown option: paths
Usage: /usr/bin/mogfiledebug --trackers=host --domain=foo --key='/hello.jpg'
If FID is known, but domain/key are not known:
--trackers=host --domain=anything --fid=123456


# mogfiledebug --trackers=10.22.35.20 --domain=anything --fid=64545836145707731
Fetching and summing paths...

Results for path: http://10.22.31.54:7502/dev781/6/454/583/64545836145707731.fid
 - MD5 Hash: 1568f63865fd45e9214a8149c75fdd55
 - Length: 2158
 - HTTP result: 200 OK

Results for path: http://10.22.31.53:7502/dev766/6/454/583/64545836145707731.fid
 - MD5 Hash: 1568f63865fd45e9214a8149c75fdd55
 - Length: 2158
 - HTTP result: 200 OK

Tempfile and/or queue rows...
-    replqueue
             fromdevid:                    
                 flags:                    0
               nexttry:           1616674469
                   fid:    64545836145707731
             failcount:                   76

- File Row:
     class:            alternate
   classid:                    3
  devcount:                    2
      dkey: file:115685324235314955
      dmid:                    3
    domain:            phenotype
       fid:    64545836145707731
    length:                 2158

- Raw devids: 766,781
*** STOP USING ROOT *** [03/24-02:43 PDT

Thanks & regards
   Vinod Chandran 

--

---
You received this message because you are subscribed to a topic in the Google Groups "mogile" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mogile/bfSFELIoOWI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to mogile+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mogile/20210324030759.GA5718%40dcvr.

Eric Wong

unread,
Mar 24, 2021, 3:20:47 PM3/24/21
to mog...@googlegroups.com
Vinod Chandran <vin...@endurance.com> wrote:
> Hi ,
> the below command thrown error , guessing a version issue , hoping the
> second output will throw some light .
>
> ~# mogfiledebug --paths=stat --fid 64545836145707731
> Unknown option: paths

Ah, yes, old version; but your files are tiny so not much difference

> # mogfiledebug --trackers=10.22.35.20 --domain=anything
> --fid=64545836145707731

> Tempfile and/or queue rows...
> - replqueue
> fromdevid:
> flags: 0
> nexttry: 1616674469
> fid: 64545836145707731
> failcount: 76

OK, so something is causing this to repeatedly fail..

> - File Row:
> class: alternate
> classid: 3
> devcount: 2
> dkey: file:115685324235314955
> dmid: 3
> domain: phenotype
> fid: 64545836145707731
> length: 2158

What's the replication policy of alternate?
"mogadm class list" should tell you.
Then, "mogadm check" as dave suggested to check for down/dead hosts

Vinod Chandran

unread,
Mar 29, 2021, 5:28:22 PM3/29/21
to mog...@googlegroups.com
Hi ,
  thanks for looking in to it , please find the mogadm output .
*** STOP USING ROOT *** [03/23-08:39 PDT]oak-tp-tracker004:~# mogadm check
Checking trackers...
  127.0.0.1:7001 ... OK

Checking hosts...
  [ 1] s21 ... OK
  [ 2] s22 ... OK
  [ 3] s43 ... OK
  [ 4] s44 ... OK

Checking devices...
  host device         size(G)    used(G)    free(G)   use%   ob state   I/O%
  ---- ------------ ---------- ---------- ---------- ------ ---------- -----
  [ 1] dev700       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev701       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev702       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev703       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev704       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev705       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev706       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev707       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev708       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev709       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev710       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev711       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev712       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev713       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev714       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev715       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev716       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev717       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev718       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev719       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev720       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev721       44706.006  44704.248      1.758 100.00%  writeable  42.0
  [ 1] dev722       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev723       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 1] dev724       44706.006  44704.248      1.758 100.00%  writeable  51.5
  [ 2] dev725       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev726       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev727       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev728       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev729       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev730       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev731       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev732       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev733       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev734       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev735       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev736       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev737       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev738       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev739       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev740       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev741       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev742       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev743       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev744       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev745       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev746       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev747       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev748       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 2] dev749       44706.006  24697.114  20008.892  55.24%  writeable  69.5
  [ 3] dev750       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev751       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev752       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev753       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev754       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev755       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev756       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev757       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev758       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev759       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev760       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev761       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev762       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev763       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev764       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev765       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev766       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev767       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev768       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev769       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev770       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev771       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev772       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev773       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 3] dev774       44706.006  24697.111  20008.895  55.24%  writeable  61.4
  [ 4] dev775       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev776       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev777       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev778       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev779       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev780       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev781       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev782       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev783       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev784       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev785       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev786       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev787       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev788       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev789       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev790       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev791       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev792       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev793       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev794       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev795       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev796       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev797       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev798       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev799       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  [ 4] dev800       44706.006  24697.113  20008.893  55.24%  writeable  56.4
  ---- ------------ ---------- ---------- ---------- ------
             total:4515306.592 2994586.750 1520719.841  66.32%

thanks & Regards
   Vinod Chandran


You received this message because you are subscribed to a topic in the Google Groups "mogile" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mogile/bfSFELIoOWI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to mogile+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mogile/CAFm0x_9EOn8DDu1T02Xq30i4kbhMmYki1FPRi4Q6t3XMo3P-sg%40mail.gmail.com.

Vinod Chandran

unread,
Mar 29, 2021, 5:28:31 PM3/29/21
to mog...@googlegroups.com
Hi Eric ,
  Please find the details below . I dont see a dead device in mogadm check. I can see one storage node disk is 100% .

*** STOP USING ROOT *** [03/25-06:08 PDT]oak-tp-tracker004:~# mogadm class list
 domain               class                mindevcount   replpolicy   hashtype
-------------------- -------------------- ------------- ------------ -------
 creatives            default                   2        MultipleHosts()        
 creatives            original                  3        MultipleHosts()        

 orion:me015432d17142860c default                   2        MultipleHosts()        
 orion:me015432d17142860c derived                   3        MultipleHosts()        
 orion:me015432d17142860c original                  3        MultipleHosts()        

 orion:me015434393179860e default                   2        MultipleHosts()        
 orion:me015434393179860e derived                   3        MultipleHosts()        
 orion:me015434393179860e original                  3        MultipleHosts()        

 orion:me0158ae1fa2ac860b default                   2        MultipleHosts()        
 orion:me0158ae1fa2ac860b derived                   3        MultipleHosts()        
 orion:me0158ae1fa2ac860b original                  3        MultipleHosts()        

 orion:me015f987bb43c860d default                   2        MultipleHosts()        
 orion:me015f987bb43c860d derived                   3        MultipleHosts()        
 orion:me015f987bb43c860d original                  3        MultipleHosts()        

 orion:me016852316255860c default                   2        MultipleHosts()        
 orion:me016852316255860c derived                   3        MultipleHosts()        
 orion:me016852316255860c original                  3        MultipleHosts()        

 orion:me0168552bd4bc860e default                   2        MultipleHosts()        
 orion:me0168552bd4bc860e derived                   3        MultipleHosts()        
 orion:me0168552bd4bc860e original                  3        MultipleHosts()        

 orion:me016bb0b83d2f860f default                   2        MultipleHosts()        
 orion:me016bb0b83d2f860f derived                   3        MultipleHosts()        
 orion:me016bb0b83d2f860f original                  3        MultipleHosts()        

 orion:me016bb0b83f05860f default                   2        MultipleHosts()        
 orion:me016bb0b83f05860f derived                   3        MultipleHosts()        
 orion:me016bb0b83f05860f original                  3        MultipleHosts()        

 orion:me016cd8eb143e860b default                   2        MultipleHosts()        
 orion:me016cd8eb143e860b derived                   3        MultipleHosts()        
 orion:me016cd8eb143e860b original                  3        MultipleHosts()        

 orion:me016cd8eb17db860b default                   2        MultipleHosts()        
 orion:me016cd8eb17db860b derived                   3        MultipleHosts()        
 orion:me016cd8eb17db860b original                  3        MultipleHosts()        

 orion:me016cd8eb27ae860b default                   2        MultipleHosts()        
 orion:me016cd8eb27ae860b derived                   3        MultipleHosts()        
 orion:me016cd8eb27ae860b original                  3        MultipleHosts()        

 orion:me01801fa67b1c860f default                   2        MultipleHosts()        
 orion:me01801fa67b1c860f derived                   3        MultipleHosts()        
 orion:me01801fa67b1c860f original                  3        MultipleHosts()        

 orion:me0180e55a918a860b default                   2        MultipleHosts()        
 orion:me0180e55a918a860b derived                   3        MultipleHosts()        
 orion:me0180e55a918a860b original                  3        MultipleHosts()        

 orion:me0189333c1c08860f default                   2        MultipleHosts()        
 orion:me0189333c1c08860f derived                   3        MultipleHosts()        
 orion:me0189333c1c08860f original                  3        MultipleHosts()        

 phenotype            alternate                 2        HostsPerNetwork(houston=2,provo=1)        
 phenotype            default                   2        MultipleHosts()        
 phenotype            original                  2        HostsPerNetwork(houston=2,provo=1)        
 phenotype            post                      2        HostsPerNetwork(houston=2,provo=1)        


*** STOP USING ROOT *** [03/25-06:09 PDT]oak-tp-tracker004:~# mogadm check

Checking trackers...
  127.0.0.1:7001 ... OK

Checking hosts...
  [ 1] s21 ... OK
  [ 2] s22 ... OK
  [ 3] s43 ... OK
  [ 4] s44 ... OK

Checking devices...
  host device         size(G)    used(G)    free(G)   use%   ob state   I/O%
  ---- ------------ ---------- ---------- ---------- ------ ---------- -----
  [ 1] dev700       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev701       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev702       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev703       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev704       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev705       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev706       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev707       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev708       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev709       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev710       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev711       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev712       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev713       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev714       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev715       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev716       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev717       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev718       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev719       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev720       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev721       44706.006  44704.248      1.758 100.00%  writeable  68.6
  [ 1] dev722       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev723       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 1] dev724       44706.006  44704.248      1.758 100.00%  writeable  50.8
  [ 2] dev725       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev726       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev727       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev728       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev729       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev730       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev731       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev732       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev733       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev734       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev735       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev736       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev737       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev738       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev739       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev740       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev741       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev742       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev743       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev744       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev745       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev746       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev747       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev748       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 2] dev749       44706.006  24701.409  20004.597  55.25%  writeable  34.3
  [ 3] dev750       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev751       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev752       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev753       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev754       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev755       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev756       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev757       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev758       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev759       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev760       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev761       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev762       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev763       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev764       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev765       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev766       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev767       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev768       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev769       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev770       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev771       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev772       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev773       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 3] dev774       44706.006  24701.416  20004.590  55.25%  writeable  15.0
  [ 4] dev775       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev776       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev777       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev778       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev779       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev780       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev781       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev782       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev783       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev784       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev785       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev786       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev787       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev788       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev789       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev790       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev791       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev792       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev793       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev794       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev795       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev796       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev797       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev798       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev799       44706.006  24701.410  20004.596  55.25%  writeable  25.4
  [ 4] dev800       44706.006  24701.410  20004.596  55.25%  writeable  25.4

  ---- ------------ ---------- ---------- ---------- ------
             total:4515306.592 2994913.490 1520393.102  66.33%
*** STOP USING ROOT *** [03/25-06:11 PDT]oak-tp-tracker004:~# 

Thanks & regards
   Vinod Chandran
--

---
You received this message because you are subscribed to a topic in the Google Groups "mogile" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mogile/bfSFELIoOWI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to mogile+un...@googlegroups.com.

dave000

unread,
Mar 30, 2021, 8:48:05 AM3/30/21
to mog...@googlegroups.com
Cool, I'm guessing that s21 is "provo"? And since it is full, mogile can't honor the replication policy of 2 copies in houston and 1 in provo:

phenotype            alternate                 2        HostsPerNetwork(houston=2,provo=1) 


You received this message because you are subscribed to the Google Groups "mogile" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mogile+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mogile/CABiEQJFbyN01VuDAdQR5QcaC5E6AsKDkKdMxAYWGzSPjr_eYvw%40mail.gmail.com.

Vinod Chandran

unread,
Mar 31, 2021, 7:31:29 AM3/31/21
to mog...@googlegroups.com
Hi ,
  Thanks for the info , is it anyway we can find out which server or IP configured as houston or provo , when I went through mogadm documentation its points to MultipleHosts(3) only , I can't locate any conf file in server which is related to replication policy .

Thanks & Regards
  Vinod Chandran 

Eric Wong

unread,
Apr 3, 2021, 3:18:08 AM4/3/21
to mog...@googlegroups.com
Vinod Chandran <vin...@endurance.com> wrote:
> Hi ,
> Thanks for the info , is it anyway we can find out which server or IP
> configured as houston or provo , when I went through mogadm documentation
> its points to MultipleHosts(3) only , I can't locate any conf file in
> server which is related to replication policy .

Replication policies like MultipleHosts are configured via
mogadm (the actual info is stored in MySQL). You can use
--replpolicy=$VAL to change via mogadm. See:
mogadm class modify -h # for more details

Vinod Chandran

unread,
Apr 7, 2021, 11:03:16 AM4/7/21
to mog...@googlegroups.com
Hi ,
  When I checked the database table server_settings ,  its configured as network_zones and Houston is having  two subnets and provo is one IP , I have masked the IP's with X for security reasons . I am wondering how I can change these ip's especially the provo one , it doesn't exist and can we do it without any downtime ?

field: network_zones
value: houston,provo

field: zone_houston
value: 10.X2.X1.0/24,10.X2.X2.0/21
*************************** 25. row ***************************
field: zone_oak
value: 10.17.0.0/16
*************************** 26. row ***************************
field: zone_provo
value: 50.8X.2X0.XX5/32

Thanks & regards
   Vinod Chandran 
--

---
You received this message because you are subscribed to a topic in the Google Groups "mogile" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mogile/bfSFELIoOWI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to mogile+un...@googlegroups.com.

Eric Wong

unread,
Apr 7, 2021, 2:33:02 PM4/7/21
to mog...@googlegroups.com
Vinod Chandran <vin...@endurance.com> wrote:
> Hi ,
> When I checked the database table server_settings , its configured as
> network_zones and Houston is having two subnets and provo is one IP , I
> have masked the IP's with X for security reasons . I am wondering how I can
> change these ip's especially the provo one , it doesn't exist and can we do
> it without any downtime ?

It's been years since I dealt with network zones, but changing
anything in server_settings can be done hot via:

mogadm settings set $field $value

It should take effect within a few seconds, though sometimes
queues get backed up and it might take some minutes for workers
to see the change.

Vinod Chandran

unread,
Nov 17, 2022, 9:34:51 AM11/17/22
to mogile
Hi Eric ,
  if I want to delete one network zone , if I do like below is it work ? I didnt find any delete option in settings  .
mogadm settings set zone_provo 0

Thanks & regards
   Vinod Chandran 

Eric Wong

unread,
Nov 25, 2022, 2:00:26 AM11/25/22
to mog...@googlegroups.com
Vinod Chandran <vinodch...@gmail.com> wrote:
> Hi Eric ,
> if I want to delete one network zone , if I do like below is it work ? I
> didnt find any delete option in settings .
> mogadm settings set zone_provo 0

I just checked the code, and I don't see a way for the tracker
protocol to represent `undef' to trigger a DELETE via
MogileFS::Store::{SQLite,MySQL,Postgres}*->set_server_setting.

I think if you stop using `zone_provo' in `network_zones',
then it's as good as deleted.

I don't think you need to delete the setting, but if you
manually go into the DB to delete a setting, then you should
restart any trackers to ensure the tracker caches get cleared.

Disclaimer: I haven't touched MogileFS internals in years and
cannot be responsible for anything you break.
Reply all
Reply to author
Forward
0 new messages