4s-client.c:309 kb=demo waiting for lock on segment 0 when import freebase

[Pengjun Xie]

hi,all

    

     i have tried to import the freebase into my 4store cluster which include 4 nodes,each one with 4 cores. 

     i split the freebase data into tiny file whose size is about 1G.

     i have imported about 100G freebase files,but as time goes on,the speed of importing get more and more slowly.

     most of the time shows

    "4store[5791]: 4s-client.c:309 kb=demo waiting for lock on segment 0 on fe80::9a4b:e1ff:fe08:92bc%bond0 port 6734".   

  who knows what's wrong with this? thx.

   and when i use the command 4s-query or 4s-info ,the same information shows.

 

[swh]

You will get that message when there's already a client connected to the 4store backends, e.g. an import process.

Have you checked how large the indexes are getting? they will be in /var/lib/4store/<kb-name> normally. Once they get towards the size of the RAM in each machine it will get very slow.

You can mitigate this by using SSDs.

[Pengjun Xie]

yes，it must be the reason.  

 the time the speed become slowly is exactly when the size of indexes exceed the size of the RAM.thx.

i will try using SSDs.

在 2014年4月22日星期二UTC+8下午9时33分01秒，swh写道：