One last question please - do I need to set up triplestore along with solr for external search?
118 views
Skip to first unread message
Jeevan Patnaik
Apr 3, 2016, 6:11:48 AM4/3/16
to Fedora Community
Hi ,
I have setup solr, camel-toolbox:fcrepo-indexing-solr and added the indexable property to the repository objects.
So, do I need to setup fuseki or sesame also or solr alone is just fine?
I am doing some transactions, creating new objects or updating. But I can't find any indexed objects in solr query page.
From netstat, I can see communication from 61616 (JMS port) 44863 & 44862 (camel-solr-indexing ports) and vice-versa.
But no communication to solr standalone server. So, I guess indexed objects are not being created in solr at all.
What am I missing here? Trust me. I have gone through all the documentation.
I want to test this in vagrant too. But I just want to give it a try once like this. If it still doesn't work, I will use vagrant and the reason for delaying this is I don't know what is vagrant, and I am afraid I need to start from scratch again.
I know too many questions from me. But trust me, I am really trying my best to understand the environment myself and do debugging. I am only asking questions when I really have no clue what's going on.
And again coming to camel-toolbox, I can find two logs: transaction.log and velocity.log. I thought of getting information if there is any entry of the recent transaction I have done on fedora objects. But nothing I could find. And for your information, the velocity.log ends like this:
.
.
.
2016-04-03 16:50:25,230 - ResourceManager : found /views/mode-root.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,230 - ResourceManager : found /views/mode-root.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,231 - Could not load resource '/views/mode-repository.vsl' from ResourceLoader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader:
ClasspathResourceLoader Error: cannot find resource /views/mode-repository.vsl
2016-04-03 16:50:25,231 - Could not load resource '/views/mode-repository.vsl' from ResourceLoader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader:
ClasspathResourceLoader Error: cannot find resource /views/mode-repository.vsl
2016-04-03 16:50:25,231 - Could not load resource '/views/nt-base.vsl' from ResourceLoader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader: Classpat
hResourceLoader Error: cannot find resource /views/nt-base.vsl
2016-04-03 16:50:25,231 - Could not load resource '/views/nt-base.vsl' from ResourceLoader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader: Classpat
hResourceLoader Error: cannot find resource /views/nt-base.vsl
2016-04-03 16:50:25,232 - Could not load resource '/views/mix-created.vsl' from ResourceLoader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader: Clas
spathResourceLoader Error: cannot find resource /views/mix-created.vsl
2016-04-03 16:50:25,232 - Could not load resource '/views/mix-created.vsl' from ResourceLoader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader: Clas
spathResourceLoader Error: cannot find resource /views/mix-created.vsl
2016-04-03 16:50:25,235 - ResourceManager : found /views/jcr-nodetypes.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,235 - ResourceManager : found /views/jcr-nodetypes.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,238 - ResourceManager : found /views/node.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,238 - ResourceManager : found /views/node.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,241 - ResourceManager : found /views/fcr-versions.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,241 - ResourceManager : found /views/fcr-versions.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,243 - ResourceManager : found /views/fcr-fixity.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
2016-04-03 16:50:25,243 - ResourceManager : found /views/fcr-fixity.vsl with loader org.apache.velocity.runtime.resource.loader.ClasspathResourceLoader
and transaction.log only contains this:
2016-04-03 16:50:18,286 [main] INFO com.arjuna.ats.arjuna - ARJUNA012163: Starting service com.arjuna.ats.arjuna.recovery.ActionStatusService on port 35848
2016-04-03 16:50:18,298 [main] INFO com.arjuna.ats.arjuna - ARJUNA012337: TransactionStatusManagerItem host: 127.0.0.1 port: 35848
2016-04-03 16:50:18,328 [main] INFO com.arjuna.ats.arjuna - ARJUNA012170: TransactionStatusManager started on port 35848 and host 127.0.0.1 with service com.arjuna.ats
.arjuna.recovery.ActionStatusService
But no running service in netstat output on port 35848.
Regards,
Jeevan.
Message has been deleted
Jeevan Patnaik
Apr 3, 2016, 7:11:49 AM4/3/16
to Fedora Community
Hi,
At least here is what I am confused: what should be the solr.baseUrl while fedora is my core name.
solr.baseUrl=localhost:8983/solr/#/fedora
or
solr.baseUrl=localhost:8983/solr/fedora
Aaron Coburn
Apr 3, 2016, 9:28:14 AM4/3/16
to fedora-c...@googlegroups.com
Hello Jeevan,
The latter value is what should be used:
> solr.baseUrl=localhost:8983/solr/fedora
The two logfiles you mention are not related to the camel toolbox: you won't find any relevant information there.
The log location will depend on how you are deploying the camel toolbox routes. If you are using Karaf, the log file would be in $KARAF_HOME/data/log/karaf.log.
Regards,
Aaron
> --
> You received this message because you are subscribed to the Google Groups "Fedora Community" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
The latter value is what should be used:
> solr.baseUrl=localhost:8983/solr/fedora
The two logfiles you mention are not related to the camel toolbox: you won't find any relevant information there.
The log location will depend on how you are deploying the camel toolbox routes. If you are using Karaf, the log file would be in $KARAF_HOME/data/log/karaf.log.
Regards,
Aaron
> You received this message because you are subscribed to the Google Groups "Fedora Community" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
Jeevan Patnaik
Apr 3, 2016, 9:42:14 AM4/3/16
to Fedora Community
Hi Aaron,
Thanks, I have tested with localhost:8983/solr/fedora. But, still I can't find any records in solr.
I have deployed only camel-indexing-solr in the following way:
cd fcrepo-indexing-solr; MAVEN_OPTS="-Xmx1024m" mvn clean install; mvn camel:run &
Regards,
Jeevan,
Aaron Coburn
Apr 3, 2016, 1:10:56 PM4/3/16
to fedora-c...@googlegroups.com
I definitely wouldn't recommend using mvn camel:run. Instead, I would suggest using a full JVM container. I use Karaf, though with a little work with Spring configurations, you can also run these in Tomcat or Jetty.
Aaron
Sent from my iPhone
Sent from my iPhone
Jeevan Patnaik
Apr 3, 2016, 8:48:49 PM4/3/16
to Fedora Community
Hi Aron,
Thanks. I have tried it in karaf as you said. And now I can find the log from karaf.log. So, now I see there are errors while creating any objects and also no errors if I do deletion of any objects. It says credentials may not be null. But I do give credentials in $KARAF_HOME/etc/org.fcrepo.camel.indexing.solr.cfg. Please let me know where else I could be making mistake.
2016-04-04 08:42:00,664 | ERROR | Consumer[fedora] | DefaultErrorHandler | 62 - org.apache.camel.camel-core - 2.16.2 | Failed delivery for (MessageId: ID-eslxarv-test-emea-nsn-net-net-42159-1459729846394-0-7 on ExchangeId: ID-eslxarv-test-emea-nsn-net-net-42159-1459729846394-0-6). Exhausted after delivery attempt: 11 caught: java.lang.IllegalArgumentException: Credentials may not be null. Processed by failure processor: FatalFallbackErrorHandler[Channel[Log(FcrepoSolrIndexer)[Index Routing Error: ${routeId}]]]
Message History
---------------------------------------------------------------------------------------------------------------------------------------
RouteId ProcessorId Processor Elapsed (ms)
[FcrepoSolrRouter ] [FcrepoSolrRouter ] [activemq://topic:fedora ] [ 10028]
[FcrepoSolrRouter ] [choice1 ] [when[{header{header(org.fcrepo.jms.eventType)} == http://fedora.info/definitio] [ 10029]
[FcrepoSolrRouter ] [to2 ] [direct:index.solr ] [ 10028]
[FcrepoSolrIndexer ] [removeHeaders1 ] [removeHeaders[CamelHttp*] ] [ 0]
[FcrepoSolrIndexer ] [filter1 ] [filter[{not ((header{header(org.fcrepo.jms.identifier)} startsWith Simple: {{a] [ 10029]
[FcrepoSolrIndexer ] [to4 ] [fcrepo:{{fcrepo.baseUrl}}?preferOmit=PreferContainment ] [ 10026]
[ ] [log1 ] [log ] [ 1]
Exchange
---------------------------------------------------------------------------------------------------------------------------------------
Exchange[
Id ID-eslxarv-test-emea-nsn-net-net-42159-1459729846394-0-6
ExchangePattern InOnly
Headers {breadcrumbId=ID:myservername.net-57410-1459689911951-3:1:1:1:5, CamelRedelivered=true, CamelRedeliveryCounter=10, CamelRedeliveryMaxCounter=10, JMSCorrelationID=null, JMSCorrelationIDAsBytes=null, JMSDeliveryMode=2, JMSDestination=topic://fedora, JMSExpiration=0, JMSMessageID=ID:myservername.net-57410-1459689911951-3:1:1:1:5, JMSPriority=4, JMSRedelivered=false, JMSReplyTo=null, JMSTimestamp=1459730500591, JMSType=null, JMSXGroupID=null, JMSXUserID=null, org.fcrepo.jms.baseURL=http://fedoraserver.net:8080/fedora/rest, org.fcrepo.jms.eventID=d4/68/eb/03/d468eb03-7f4a-4d1e-a843-71f85c01911e, org.fcrepo.jms.eventType=http://fedora.info/definitions/v4/repository#NODE_ADDED,http://fedora.info/definitions/v4/repository#PROPERTY_ADDED, org.fcrepo.jms.identifier=/6c/bf/93/c0/6cbf93c0-c686-41fb-96fd-9ed7257ce0ab/f0/2b/fc/46/f02bfc46-5f36-4fc1-969d-b54a8c8fc087, org.fcrepo.jms.properties=http://fedora.info/definitions/v4/repository#lastModified,http://fedora.info/definitions/v4/repository#primaryType,http://fedora.info/definitions/v4/repository#lastModifiedBy,http://fedora.info/definitions/v4/repository#created,http://fedora.info/definitions/v4/repository#mixinTypes,http://fedora.info/definitions/v4/repository#createdBy,http://fedora.info/definitions/v4/repository#uuid, org.fcrepo.jms.timestamp=1459730500485, org.fcrepo.jms.user=fedoraAdmin, org.fcrepo.jms.userAgent=Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36}
BodyType null
Body [Body is null]
]
Stacktrace
---------------------------------------------------------------------------------------------------------------------------------------
java.lang.IllegalArgumentException: Credentials may not be null
at org.apache.http.util.Args.notNull(Args.java:54)[78:org.apache.httpcomponents.httpcore:4.4.4]
at org.apache.http.auth.AuthState.update(AuthState.java:113)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.fcrepo.client.FcrepoHttpClientBuilder$PreemptiveAuthInterceptor.process(FcrepoHttpClientBuilder.java:117)[97:org.fcrepo.client.fcrepo-java-client:0.1.2]
at org.apache.http.protocol.ImmutableHttpProcessor.process(ImmutableHttpProcessor.java:132)[78:org.apache.httpcomponents.httpcore:4.4.4]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:182)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.fcrepo.client.FcrepoClient.executeRequest(FcrepoClient.java:268)[97:org.fcrepo.client.fcrepo-java-client:0.1.2]
at org.fcrepo.client.FcrepoClient.head(FcrepoClient.java:96)[97:org.fcrepo.client.fcrepo-java-client:0.1.2]
at org.fcrepo.camel.FcrepoProducer.getMetadataUri(FcrepoProducer.java:158)[95:org.fcrepo.camel.fcrepo-camel:4.4.1]
at org.fcrepo.camel.FcrepoProducer.doRequest(FcrepoProducer.java:141)[95:org.fcrepo.camel.fcrepo-camel:4.4.1]
at org.fcrepo.camel.FcrepoProducer.process(FcrepoProducer.java:99)[95:org.fcrepo.camel.fcrepo-camel:4.4.1]
at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:141)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:121)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:83)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.FilterProcessor.process(FilterProcessor.java:57)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:121)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:83)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:62)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:141)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:109)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:87)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.component.jms.EndpointMessageListener.onMessage(EndpointMessageListener.java:112)[65:org.apache.camel.camel-jms:2.16.2]
at org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:544)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:504)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:474)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.doReceiveAndExecute(AbstractPollingMessageListenerContainer.java:325)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.receiveAndExecute(AbstractPollingMessageListenerContainer.java:263)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.invokeListener(DefaultMessageListenerContainer.java:1103)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.executeOngoingLoop(DefaultMessageListenerContainer.java:1095)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.run(DefaultMessageListenerContainer.java:992)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_71]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_71]
2016-04-04 08:42:00,669 | WARN | Consumer[fedora] | EndpointMessageListener | 62 - org.apache.camel.camel-core - 2.16.2 | Execution of JMS message listener failed. Caused by: [org.apache.camel.RuntimeCamelException - java.lang.IllegalArgumentException: Credentials may not be null]
org.apache.camel.RuntimeCamelException: java.lang.IllegalArgumentException: Credentials may not be null
at org.apache.camel.util.ObjectHelper.wrapRuntimeCamelException(ObjectHelper.java:1642)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.component.jms.EndpointMessageListener$EndpointMessageListenerAsyncCallback.done(EndpointMessageListener.java:195)[65:org.apache.camel.camel-jms:2.16.2]
at org.apache.camel.component.jms.EndpointMessageListener.onMessage(EndpointMessageListener.java:116)[65:org.apache.camel.camel-jms:2.16.2]
at org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:544)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:504)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:474)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.doReceiveAndExecute(AbstractPollingMessageListenerContainer.java:325)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.AbstractPollingMessageListenerContainer.receiveAndExecute(AbstractPollingMessageListenerContainer.java:263)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.invokeListener(DefaultMessageListenerContainer.java:1103)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.executeOngoingLoop(DefaultMessageListenerContainer.java:1095)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at org.springframework.jms.listener.DefaultMessageListenerContainer$AsyncMessageListenerInvoker.run(DefaultMessageListenerContainer.java:992)[91:org.apache.servicemix.bundles.spring-jms:3.2.14.RELEASE_1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_71]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_71]
Caused by: java.lang.IllegalArgumentException: Credentials may not be null
at org.apache.http.util.Args.notNull(Args.java:54)[78:org.apache.httpcomponents.httpcore:4.4.4]
at org.apache.http.auth.AuthState.update(AuthState.java:113)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.fcrepo.client.FcrepoHttpClientBuilder$PreemptiveAuthInterceptor.process(FcrepoHttpClientBuilder.java:117)[97:org.fcrepo.client.fcrepo-java-client:0.1.2]
at org.apache.http.protocol.ImmutableHttpProcessor.process(ImmutableHttpProcessor.java:132)[78:org.apache.httpcomponents.httpcore:4.4.4]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:182)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)[77:org.apache.httpcomponents.httpclient:4.5.1]
at org.fcrepo.client.FcrepoClient.executeRequest(FcrepoClient.java:268)[97:org.fcrepo.client.fcrepo-java-client:0.1.2]
at org.fcrepo.client.FcrepoClient.head(FcrepoClient.java:96)[97:org.fcrepo.client.fcrepo-java-client:0.1.2]
at org.fcrepo.camel.FcrepoProducer.getMetadataUri(FcrepoProducer.java:158)[95:org.fcrepo.camel.fcrepo-camel:4.4.1]
at org.fcrepo.camel.FcrepoProducer.doRequest(FcrepoProducer.java:141)[95:org.fcrepo.camel.fcrepo-camel:4.4.1]
at org.fcrepo.camel.FcrepoProducer.process(FcrepoProducer.java:99)[95:org.fcrepo.camel.fcrepo-camel:4.4.1]
at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:141)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:121)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:83)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.FilterProcessor.process(FilterProcessor.java:57)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:121)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.Pipeline.process(Pipeline.java:83)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:62)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:141)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:460)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:190)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:109)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:87)[62:org.apache.camel.camel-core:2.16.2]
at org.apache.camel.component.jms.EndpointMessageListener.onMessage(EndpointMessageListener.java:112)[65:org.apache.camel.camel-jms:2.16.2]
... 11 more
On Sunday, April 3, 2016 at 3:41:48 PM UTC+5:30, Jeevan Patnaik wrote:
Jeevan Patnaik
Apr 3, 2016, 8:49:58 PM4/3/16
to Fedora Community
Hi,
Also, could you please tell me how to exit from karaf console without stopping the running indexing service.
Aaron Coburn
Apr 4, 2016, 7:49:25 AM4/4/16
to fedora-c...@googlegroups.com
Hello Jeevan,
You will find some information on this page under "Deployment": https://wiki.duraspace.org/display/FEDORA4x/Setup+Camel+Message+Integrations
Basically, though, the first time you start Karaf, you use $KARAF_HOME/bin/karaf
From within the console, you install the "service wrapper":
$> feature:install wrapper
$> wrapper:install
Then, you can quit the karaf session (CTRL-d). From there, Karaf can be started either as a system service:
service karaf-service start
or manually:
$KARAF_HOME/bin/karaf-service start
Now, in order to connect to Karaf, you can either use SSH:
ssh -p8101 -lkaraf localhost (the default pw is 'karaf')
or simply:
$KARAF_HOME/bin/client
For more details, I would recommend the Karaf documentation: http://karaf.apache.org/documentation.html
Regards,
Aaron
You will find some information on this page under "Deployment": https://wiki.duraspace.org/display/FEDORA4x/Setup+Camel+Message+Integrations
Basically, though, the first time you start Karaf, you use $KARAF_HOME/bin/karaf
From within the console, you install the "service wrapper":
$> feature:install wrapper
$> wrapper:install
Then, you can quit the karaf session (CTRL-d). From there, Karaf can be started either as a system service:
service karaf-service start
or manually:
$KARAF_HOME/bin/karaf-service start
Now, in order to connect to Karaf, you can either use SSH:
ssh -p8101 -lkaraf localhost (the default pw is 'karaf')
or simply:
$KARAF_HOME/bin/client
For more details, I would recommend the Karaf documentation: http://karaf.apache.org/documentation.html
Regards,
Aaron
Jeevan Patnaik
Apr 8, 2016, 2:03:50 AM4/8/16
to Fedora Community
Hi Aron,
I have tried several ways using Karaf. But still not able to resolve the issue. I am not able to figure about what it's mentioning about the credentials. And I have installed only reindexing and solr-index features.
Plese find the following errror that is generated while creating a datastream:
2016-04-08 09:47:52,185 | INFO | Consumer[fedora] | FcrepoSolrIndexer | 62 - org.apache.camel.camel-core - 2.16.2 | Index Routing Error: FcrepoSolrIndex
er
2016-04-08 09:47:52,190 | ERROR | Consumer[fedora] | DefaultErrorHandler | 62 - org.apache.camel.camel-core - 2.16.2 | Failed delivery for (MessageId: ID-e
slxarv2-emea-nsn-net-net-41141-1460079859216-0-6 on ExchangeId: ID-myserver.net-41141-1460079859216-0-5). Exhausted after delivery attempt: 11 caught: java
.lang.IllegalArgumentException: Credentials may not be null. Processed by failure processor: FatalFallbackErrorHandler[Channel[Log(FcrepoSolrIndexer)[Index Routing Erro
r: ${routeId}]]]
Message History
---------------------------------------------------------------------------------------------------------------------------------------
RouteId ProcessorId Processor Elapsed (ms)
[FcrepoSolrRouter ] [FcrepoSolrRouter ] [activemq://topic:fedora ] [ 10025]
[FcrepoSolrRouter ] [choice1 ] [when[{header{header(org.fcrepo.jms.eventType)} == http://fedora.info/definitio] [ 10025]
[FcrepoSolrRouter ] [to2 ] [direct:index.solr ] [ 10025]
[FcrepoSolrIndexer ] [removeHeaders1 ] [removeHeaders[CamelHttp*] ] [ 1]
[FcrepoSolrIndexer ] [filter1 ] [filter[{not ((header{header(org.fcrepo.jms.identifier)} startsWith Simple: {{a] [ 10025]
[FcrepoSolrIndexer ] [to4 ] [fcrepo:{{fcrepo.baseUrl}}?preferOmit=PreferContainment ] [ 10023]
[ ] [log1 ] [log ] [ 2]
Exchange
---------------------------------------------------------------------------------------------------------------------------------------
Exchange[
Id ID-myserver.net-41141-1460079859216-0-5
ExchangePattern InOnly
Headers {breadcrumbId=ID:myserver.net-45354-1460074255092-3:1:1:1:11, CamelRedelivered=true, CamelRedeliveryCounter=10, CamelRedelivery
MaxCounter=10, JMSCorrelationID=null, JMSCorrelationIDAsBytes=null, JMSDeliveryMode=2, JMSDestination=topic://fedora, JMSExpiration=0, JMSMessageID=ID:eslxarv2.emea.nsn
-net.net-45354-1460074255092-3:1:1:1:11, JMSPriority=4, JMSRedelivered=false, JMSReplyTo=null, JMSTimestamp=1460080041921, JMSType=null, JMSXGroupID=null, JMSXUserID=nu
ll, org.fcrepo.jms.baseURL=http://myserver.net:8080/fedora/rest, org.fcrepo.jms.eventID=39/3f/da/75/393fda75-a526-4725-9fcb-250d87d53451, org.fcrepo.jms.ev
entType=http://fedora.info/definitions/v4/repository#PROPERTY_CHANGED,http://fedora.info/definitions/v4/repository#PROPERTY_ADDED, org.fcrepo.jms.identifier=/nsn-ee/2/m
era_tobearchived_20121214.tar.gz_2of36, org.fcrepo.jms.properties=http://purl.org/dc/elements/1.1/title,http://fedora.info/definitions/v4/repository#lastModified,http:/
sitory#lastModifiedBy,http://fedora.info/definitions/v4/repository#mixinTypes,http://namespaces.info/nokia#controlGroup,http://namespaces.info/nokia#objState,http://fed
ora.info/definitions/v4/indexing#hasIndexingTransformation, org.fcrepo.jms.timestamp=1460080041904, org.fcrepo.jms.user=fedoraAdmin, org.fcrepo.jms.userAgent=python-req
uests/2.9.1}
BodyType null
Body [Body is null]
]
Also I do found the following errors too, which says "No SPI Provide Manifest header" Could this be related?
Thanks & Regards,
Jeevan.
Andrew Woods
Apr 8, 2016, 9:28:55 AM4/8/16
to fedora-community
Hello Jeevan,
If you have not already done so, you will want to add the credentials for Fedora in your $KARAF_HOME/etc/org.fcrepo.camel.indexing.solr.cfg
Regards,
Andrew
Aaron Coburn
Apr 8, 2016, 9:46:20 AM4/8/16
to fedora-c...@googlegroups.com
Hello Jeevan,
The message about a 'SPI-Provider' manifest header is entirely unrelated. Most OSGi bundles don't include an SPI-Provider header, and you can ignore that (it's only an informational statement, not a warning).
Your particular error appears to be due to an incorrectly configured set of routes, particularly with regard to authentication to Fedora. I would suggest reviewing the documentation here:
https://github.com/fcrepo4-exts/fcrepo-camel-toolbox/tree/master/fcrepo-indexing-solr
Note that if your Fedora requires authentication for HTTP requests, all of the fcrepo-based applications (features) in karaf will need to be configured to use these credentials. The configuration is found in $KARAF_HOME/etc, and each relevant file will begin with org.fcrepo.camel
Regards,
Aaron
The message about a 'SPI-Provider' manifest header is entirely unrelated. Most OSGi bundles don't include an SPI-Provider header, and you can ignore that (it's only an informational statement, not a warning).
Your particular error appears to be due to an incorrectly configured set of routes, particularly with regard to authentication to Fedora. I would suggest reviewing the documentation here:
https://github.com/fcrepo4-exts/fcrepo-camel-toolbox/tree/master/fcrepo-indexing-solr
Note that if your Fedora requires authentication for HTTP requests, all of the fcrepo-based applications (features) in karaf will need to be configured to use these credentials. The configuration is found in $KARAF_HOME/etc, and each relevant file will begin with org.fcrepo.camel
Regards,
Aaron
Jeevan Patnaik
Apr 8, 2016, 6:00:01 PM4/8/16
to Fedora Community
Hi Aaron,
hmm..I have tried the same. Actually, I am also mentioning fcrepo.authHost=fcrepo (realm name. I will try not mentioning it once.
But thank, if it's the error is due to improper credentials, I will try different ways and will also disable authentication once and test it tomorrow.
Thanks again!
Regards,
Jeevan.
Aaron Coburn
Apr 8, 2016, 6:29:36 PM4/8/16
to fedora-c...@googlegroups.com
Jeevan,
fcrepo.authHost should be a hostname or IP address. Typically, I leave it blank. I am fairly certain that it should not be "fcrepo".
Regards, Aaron
fcrepo.authHost should be a hostname or IP address. Typically, I leave it blank. I am fairly certain that it should not be "fcrepo".
Regards, Aaron
Jeevan Patnaik
Apr 9, 2016, 7:13:23 AM4/9/16
to Fedora Community
Hi Aaron.,
Thanks. Yes, its working :D...I have removed the host. I read somewhere wrongly that hostname should be the realm name.
Now, I can see the results in solr index too.
1. But, I can see that old data is not reindexing. I have installed reindexing module too in karaf and edited the configuration file.
Do we need to run anything for reindexing or does it happen in background at a certain time interval?
2. And adding to that, I don't know if it is bug, when I replace an already existing resource with PUT, it should generate a message right. But the following is the case:
-> I have 5 resources which I replaced through a script (actually replaced with same resources again using PUT), before starting my solr.
-> As I haven't started my solr, it generated an error: Exhausted after delivery attempt: 11 caught: org.apache.http.conn.HttpHostConnectException: Connect to myserver.net:8983 [myserver.net/127.0.0.1, myserver.net/0:0:0:0:0:0:0:1] failed: Connection refused.
-> I have stopped running the update script after 2nd resource. And I started my solr.
-> Now ran the script again to replace all the 5 resources.
-> But the message has not generated in karaf until 3rd one (so no messages for 1st and 2nd). So, I can see only 3,4,5 resources indexed in solr.
-> So, for testing, I ran the update script again, but no messages for any resource this time.
-> I can't say that indexing is not working when updating resources. Because, for 3,4 and 5 it worked. So, it seems to be that once a resource is in records of karaf or solr, it won't reindex it again., even after an update event occurs.
Regards,
Jeevan.
Jeevan Patnaik
Apr 9, 2016, 9:09:42 AM4/9/16
to Fedora Community
Hi,
Ok, I found this in confluence for reindexing:
curl -XPOST http://myserver.net:9080/reindexing/ -H"Content-Type: application/json" -d '["activemq:queue:solr.reindex"]'
Enter host password for user 'feodraAdmin':
java.net.MalformedURLException: no protocol: /reindexing
at java.net.URL.<init>(URL.java:593)
at java.net.URL.<init>(URL.java:490)
at java.net.URL.<init>(URL.java:439)
I have checked the karaf org.fcrepo.camel.reindexing.cfg. rest end point is correctly configured to /reindexing.
And no issue with GET output either:
$curl -u fedoraAdmin -X GET http://myserver.net:9080/reindexing
Enter host password for user 'fedoraAdmin':
Fedora Reindexing Service
Configured Fedora Location: myserver.net:8080/fedora/rest
Configured REST endpoint: myserver.net:9080/reindexing
You can POST to the defined re-indexing endpoint, and it
will begin to traverse the Fedora repository at that point,
sending "re-indexing" hints to the specified services
(there are no default services defined).
For example:
curl -XPOST myserver.net:9080/reindexing/objects \
-d "CamelFcrepoReindexingRecipients=activemq:queue:solr.reindex,activemq:queue:fixity,activemq:queue:triplestore.reindex"
Or (as JSON)
curl -XPOST myserver:9080/reindexing/objects -H"Content-Type: application/json" \
-d '["activemq:queue:solr.reindex","activemq:queue:fixity","activemq:queue:triplestore.reindex"]'
This will reindex both Solr and the external triplestore,
starting at the /objects node in fedora.
What I am doing wrong here?
Regards,
Jeevan.
...
Reply all
Reply to author
Forward
0 new messages