Solr crashes with any job / data source over ~1000 docs

37 views
Skip to first unread message

N Dom

unread,
May 30, 2018, 6:20:38 PM5/30/18
to Datafari
Hi All,

Ive been having trouble with most of my SMB Shares - I have one small one that I've been testing on which runs through successfully with only 842 Docs.

Any other share with a large amount of documents will go for about 2000 then always tell me "no solr instance to be found at http://localhost:8983/solr" in the status cell.

Is this normal? 

I am literally just running the docker image with no changes other than the addition of the jicfs.jar connector for Windows Shares. 

Any idea whats happening here?

Nico

cedric...@francelabs.com

unread,
May 31, 2018, 9:49:23 AM5/31/18
to Datafari
Hi Nico,

a bit like for your other question, please provide the context (same questions apply except for the one about the tutorial).

Regards,

Cedric

Olivier Tavard

unread,
Jun 1, 2018, 3:51:22 PM6/1/18
to Datafari
Hello,

It seems related to your another issue.
Consider to increase the amount of RAM globally for the container and increase the amout of RAM for Solr : in order to do it edit /opt/datafari/solr/bin/solr.in.sh and change the line :
SOLR_JAVA_MEM="-Xms256m -Xmx1024m"
to SOLR_JAVA_MEM="-Xms4096m -Xmx4096m"
Of course you need to increase first the RAM allocated to the container before increase the RAM for Solr.

Best regards,

Olivier Tavard

Le jeudi 31 mai 2018 00:20:38 UTC+2, N Dom a écrit :

Nico D

unread,
Jun 26, 2018, 4:42:25 AM6/26/18
to Datafari
Hi All,

Was able to dig out a more powerful server and run it natively on there. Everything seems to be working well now. Looks like it was just a lack of resources to the docker container.

Nico
Reply all
Reply to author
Forward
0 new messages