elasticsearch and stromcrawler with injector flux file

52 views
Skip to first unread message

ch...@allthemoocs.com

unread,
Mar 17, 2018, 8:18:26 AM3/17/18
to DigitalPebble
Hi,

I have the stormcrawler and elasticsearch setup as in the git repo (with elasticsearch external), and am trying to inject a lot of urls from a seed file using the es-injector.flux config. It appears to be doing nothing (0 counts for spout and bolt, acked or failed) and the only error log message is this (repeated a few times):

2018-03-17 10:51:21.637 c.d.s.e.m.MetricsConsumer Thread-19 [ERROR] Found data point value __recv-iconnection of class class java.util.HashMap

Unfortunately I can't decipher this... any hints as to what needs changing?

Regards,
Chris

DigitalPebble

unread,
Mar 17, 2018, 12:49:24 PM3/17/18
to DigitalPebble
Hi Chris

See https://github.com/DigitalPebble/storm-crawler/issues/526, the ERROR is not a real problem. Did you follow the tutorial on http://digitalpebble.blogspot.co.uk/2017/04/video-tutorial-stormcrawler.html? Have you checked that the flux file mentioned the right file? If you are in local mode, specify a large value for the sleep parameter. 

Please use StackOverflow for questions, you'll get a larger audience

Thanks

Julien



--
You received this message because you are subscribed to the Google Groups "DigitalPebble" group.
To unsubscribe from this group and stop receiving emails from it, send an email to digitalpebble+unsubscribe@googlegroups.com.
To post to this group, send email to digita...@googlegroups.com.
Visit this group at https://groups.google.com/group/digitalpebble.
For more options, visit https://groups.google.com/d/optout.



--
Reply all
Reply to author
Forward
0 new messages