Multimachine installation.

[Евгений]

Hi. I have an indexer and a searcher on
the server, and searcher on an a remote machine.

Crawler configuration is:

#use host when the rmiIndexer is in the default baseport, or otherwise
use host:basePort
indexer.node.mapper=com.flaptor.hounder.crawler.UrlHashMapper
indexer.node.list=71.123.(hide).(hide)

remoteRmiIndexer.host=71.123.(hide).(hide):47000

When i start crawler i get:
ERROR [FetchdataProcessorJob(http://ar.yahoo.com/)]
com.flaptor.hounder.indexer.RmiIndexerStub -
[java.rmi.ConnectException: Connection refused to host: 127.0.0.1;
nested exception is:
 java.net.ConnectException: Connection refused] 2010-11-08 02:59:11,607
java.rmi.ConnectException: Connection refused to host: 127.0.0.1;
nested exception is:
 java.net.ConnectException: Connection refused
 at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
 at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
 at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
 at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:128)
 at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:194)
 at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:148)
 at $Proxy4.index(Unknown Source)
 at com.flaptor.hounder.indexer.RmiIndexerStub.index(RmiIndexerStub.java:75)
 at com.flaptor.hounder.crawler.modules.IndexerModule.addToIndex(IndexerModule.java:404)
 at com.flaptor.hounder.crawler.modules.IndexerModule.internalProcess(IndexerModule.java:163)
 at com.flaptor.hounder.crawler.modules.AProcessorModule.process(AProcessorModule.java:114)
 at com.flaptor.hounder.crawler.modules.ModulesManager.process(ModulesManager.java:147)
 at com.flaptor.hounder.crawler.FetchdataProcessor$ProcessorJob.run(FetchdataProcessor.java:211)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
 at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection refused
 at java.net.PlainSocketImpl.socketConnect(Native Method)
 at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
 at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
 at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
 at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
 at java.net.Socket.connect(Socket.java:546)
 at java.net.Socket.connect(Socket.java:495)
 at java.net.Socket.<init>(Socket.java:392)
 at java.net.Socket.<init>(Socket.java:206)
 at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
 at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
 at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
 ... 15 more

[Jorge Handl]

Hi,

It looks like the indexerModule didn't get the change in configuration. 

I would check to see if the indexerModule.properties file is in the crawler's classpath, and make sure that the crawler is restarted after the file was changed.

- Jorge

--
You received this message because you are subscribed to the Google Groups "hounder" group.
To post to this group, send email to hou...@googlegroups.com.
To unsubscribe from this group, send email to hounder+u...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/hounder?hl=en.

[Cassius]

Hi.
I've added to start.sh: echo ${CLASSPATH}
When i get:
evgeny@evgeny-laptop:~/tmp/hounder/crawler$ ./start.sh
./conf:.:../lib/hounder-trunk.jar:../lib/hounder-trunk-deps.jar:../
plugins/lib-http/lib-http.jar:../plugins/protocol-httpclient/protocol-
httpclient.jar:..

crawler path: /home/evgeny/tmp/hounder/crawler

> > java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocation Handler.java:148)

> >  at $Proxy4.index(Unknown Source)
> >  at
> > com.flaptor.hounder.indexer.RmiIndexerStub.index(RmiIndexerStub.java:75)
> >  at
> > com.flaptor.hounder.crawler.modules.IndexerModule.addToIndex(IndexerModule. java:404)
> >  at
> > com.flaptor.hounder.crawler.modules.IndexerModule.internalProcess(IndexerMo dule.java:163)
> >  at
> > com.flaptor.hounder.crawler.modules.AProcessorModule.process(AProcessorModu le.java:114)
> >  at
> > com.flaptor.hounder.crawler.modules.ModulesManager.process(ModulesManager.j ava:147)
> >  at
> > com.flaptor.hounder.crawler.FetchdataProcessor$ProcessorJob.run(FetchdataPr ocessor.java:211)
> >  at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1 110)
> >  at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java: 603)
> >  at java.lang.Thread.run(Thread.java:636)
> > Caused by: java.net.ConnectException: Connection refused
> >  at java.net.PlainSocketImpl.socketConnect(Native Method)
> >  at
> > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310 )
> >  at

> > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.j ava:176)

> >  at
> > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> >  at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> >  at java.net.Socket.connect(Socket.java:546)
> >  at java.net.Socket.connect(Socket.java:495)
> >  at java.net.Socket.<init>(Socket.java:392)
> >  at java.net.Socket.<init>(Socket.java:206)
> >  at
> > sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocket Factory.java:40)
> >  at

> > sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocket Factory.java:146)

> >  at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> >  ... 15 more
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "hounder" group.
> > To post to this group, send email to hou...@googlegroups.com.
> > To unsubscribe from this group, send email to

> > hounder+u...@googlegroups.com<hounder%2Bunsu...@googlegroups.com >
> > .

[Cassius]

Hi.
I tried to restart the crawler. Just for a test, I set a different
port:
ERROR [FetchdataProcessorJob(http://en.wikipedia.org/wiki/Main_Page)]
com.flaptor.hounder.indexer.RmiIndexerStub -
[java.rmi.RemoteException: Could not get remote service: default
ser...@71.123.55.67:47042] 2010-11-10 21:46:36,387
java.rmi.RemoteException: Could not get remote service: default
ser...@71.123.55.67:47042
at com.flaptor.util.remote.ARmiClientStub.connect(ARmiClientStub.java:
63)
at
com.flaptor.util.remote.ARmiClientStub.checkConnection(ARmiClientStub.java:
75)
at
com.flaptor.hounder.indexer.RmiIndexerStub.index(RmiIndexerStub.java:
74)

at
com.flaptor.hounder.crawler.modules.IndexerModule.addToIndex(IndexerModule.java:
404)
at
com.flaptor.hounder.crawler.modules.IndexerModule.internalProcess(IndexerModule.java:
163)
at
com.flaptor.hounder.crawler.modules.AProcessorModule.process(AProcessorModule.java:
114)
at
com.flaptor.hounder.crawler.modules.ModulesManager.process(ModulesManager.java:
147)
at com.flaptor.hounder.crawler.FetchdataProcessor
$ProcessorJob.run(FetchdataProcessor.java:211)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

On Nov 9, 10:45 pm, Jorge Handl <jha...@flaptor.com> wrote:

> > java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObje ctInvocationHandler.java:194)
> >  at
> > java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocation Handler.java:148)

> >  at $Proxy4.index(Unknown Source)
> >  at
> > com.flaptor.hounder.indexer.RmiIndexerStub.index(RmiIndexerStub.java:75)
> >  at

> > com.flaptor.hounder.crawler.modules.IndexerModule.addToIndex(IndexerModule. java:404)
> >  at
> > com.flaptor.hounder.crawler.modules.IndexerModule.internalProcess(IndexerMo dule.java:163)
> >  at
> > com.flaptor.hounder.crawler.modules.AProcessorModule.process(AProcessorModu le.java:114)
> >  at
> > com.flaptor.hounder.crawler.modules.ModulesManager.process(ModulesManager.j ava:147)
> >  at
> > com.flaptor.hounder.crawler.FetchdataProcessor$ProcessorJob.run(FetchdataPr ocessor.java:211)
> >  at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1 110)

> >  at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java: 603)
> >  at java.lang.Thread.run(Thread.java:636)
> > Caused by: java.net.ConnectException: Connection refused
> >  at java.net.PlainSocketImpl.socketConnect(Native Method)
> >  at

> > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310 )
> >  at
> > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.j ava:176)

> >  at
> > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> >  at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> >  at java.net.Socket.connect(Socket.java:546)
> >  at java.net.Socket.connect(Socket.java:495)
> >  at java.net.Socket.<init>(Socket.java:392)
> >  at java.net.Socket.<init>(Socket.java:206)
> >  at

> > sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocket Factory.java:40)
> >  at
> > sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocket Factory.java:146)

> >  at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> >  ... 15 more
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "hounder" group.
> > To post to this group, send email to hou...@googlegroups.com.
> > To unsubscribe from this group, send email to

> > hounder+u...@googlegroups.com<hounder%2Bunsu...@googlegroups.com >
> > .

[Jorge Handl]

What happens if you try to connect to it from the machine the crawler is running on?

Try the command:  telnet <indexer's IP> <indexer's port>

To unsubscribe from this group, send email to hounder+u...@googlegroups.com.