error while indexing purl-data
52 views
Skip to first unread message
matthia...@gmail.com
Jul 16, 2013, 9:18:13 AM7/16/13
to persist...@googlegroups.com
Hello everybody,
i've got several problems running a clean instance of the purlz-resolver version 1.6.4.
here my console output:
Running job [Index the PURL Data]
WARNING Exception whilst running job in urn:org:ten60:netkernel:util:cron
WARNING <ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:module+resource@active%3Apurl-entries-reindex+module@urn%3Aorg%3Apurl%3Aadmin+version@version%3A0.0.1799 in urn:org:ten60:netkernel:util:cron as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.handleException() line:161</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.issueCallback() line:134</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.innerReceive() line:123</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.receiveAsyncException() line:107</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:purl-entries-reindex in urn:org:purl:admin as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>com.ten60.netkernel.scheduler.RequestState.setException() line:132</level>
<level>com.ten60.netkernel.scheduler.Scheduler.receiveAsyncException() line:346</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:118</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
</stack>
<ex>
<id>Unhandled Exception in Accessor</id>
<message>org.purl.accessor.IndexAccessor</message>
<requestid>[SOURCE active:purl-search-index+importType@delta-import in urn:org:purl:search as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:115</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
<level>com.ten60.netkernel.scheduler.Scheduler.innerRequestAsynch() line:148</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE ffcpl:/solr/conf/solrconfig.xml in urn:org:purl:search as com.ten60.netkernel.urii.aspect.IAspectReadableBinaryStream]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFHelperImpl.issueSubRequest() line:273</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFHelperImpl.source() line:355</level>
<level>org.purl.accessor.SolrIndexManager.<init>() line:36</level>
<level>org.purl.accessor.SolrIndexManager.getInstance() line:24</level>
</stack>
<ex>
<id>Error sourcing resource</id>
<message>resource ffcpl:/solr/conf/solrconfig.xml not found in module urn:org:purl:search</message>
<requestid>ffcpl:/solr/conf/solrconfig.xml</requestid>
<stack>
<level>com.ten60.netkernel.module.accessor.ModuleResourceAccessor.source() line:108</level>
<level>com.ten60.netkernel.module.accessor.ModuleResourceAccessor.requestAsync() line:70</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
</stack>
</ex>
</ex>
</ex>
</ex>
</ex>
in urn:org:ten60:netkernel:util:cron
I think my other problems are more or less inherit from the indexing problem, cause i got no update after editing a purl.
and i have trouble managing purl records beyond the 3.5 million entries.
i'm running purlz on a suse enterprise 11, on a VM
is anybody there could give me a hint, what to do?
so far,
Matthias
Developer at the state library to Berlin, Germany
David Wood
Jul 16, 2013, 2:35:32 PM7/16/13
to persist...@googlegroups.com
Hi Matthias,
The error says:
[[
resource ffcpl:/solr/conf/solrconfig.xml not found in module urn:org:purl:search
]]
Did you review the contents of that file to make sure that it matches your configuration? Just grep through the source tree to find solrconfig.xml. In my local copy, it is in modules/mod-purl-search-1.6.4.jar.
Did you perhaps unzip the JAR file? If so, you will need to change the reference in etc/deployedModules.xml.
Regards,
Dave
matthia...@gmail.com
Jul 17, 2013, 2:59:49 AM7/17/13
to persist...@googlegroups.com
Hello David,
first of all thx for the fast reply.
I've installed PURLZ-Server from the jar file you created local and unattended on the server.
if i look for mod-purl-search-1.6.4.jar, i find it at the specific location. Inside the jar is all content for solr-search, but i don't get it running. below my output when starting the purlz-server.
I always get trouble with the databses, cause it neither will be created at installation time, nor at running. You provided my the structure in former times already.
1060 NetKernel BootLoader - v1.1.2 ...
bootloader.basepath=/srv/purls
bootloader.jarDir=/srv/purls/lib/ext
additional jar found at /srv/purls/lib/ext/dcp-1.0.0.jar
bootloader.nativeDir=/srv/purls/lib/native
bootloader invoking kernel from file:/srv/purls/lib/1060netkernel-2.8.5.jar
************************************************************
* 1060(R) NetKernel(TM) version 2.8.5
* Copyright (C) 2002-2008, 1060 Research Limited
* Licensed under the 1060 Public License v1.0
* To review this license or to obtain alternative licenses
* please visit www.1060research.com
************************************************************
Basepath URI: file:/srv/purls/
Persistence File: file:/srv/purls/scratch/modules_util_cron_1_1_1/persistence.xml
Starting container...
Starting com.ten60.netkernel.container.Config
System Configuration read from [file:/file:/srv/purls/etc/system.xml]
Starting com.ten60.netkernel.cache.Cache
Starting com.ten60.netkernel.module.ModuleManager
Using [com.ten60.netkernel.dcp.JavacProvider] to provide dynamic Java classes
[0] source files to be compiled in [urn:org:purl:admin]
[0] source files to be compiled in [urn:org:purl:gatekeeper]
[0] source files to be compiled in [urn:org:purl:virtual:host]
[0] source files to be compiled in [urn:org:ten60:workbench]
[0] source files to be compiled in [urn:org:ten60:tutorial]
Starting com.ten60.netkernel.scheduler.Scheduler
Starting com.ten60.netkernel.transport.TransportManager
Jul 17, 2013 8:49:06 AM org.mortbay.http.HttpServer doStart
INFO: Version Jetty/5.1.x
Jul 17, 2013 8:49:06 AM org.mortbay.util.Container start
INFO: Started HttpContext[/,/]
Jul 17, 2013 8:49:06 AM org.mortbay.http.SocketListener start
INFO: Started SocketListener on 0.0.0.0:1060
Jul 17, 2013 8:49:06 AM org.mortbay.util.Container start
INFO: Started org.mortbay.jetty.Server@5489708c
Installed transport [BackendHTTPTransport HTTP server on port 1060]
Jul 17, 2013 8:49:06 AM org.mortbay.http.HttpServer doStart
INFO: Version Jetty/5.1.x
Jul 17, 2013 8:49:06 AM org.mortbay.util.Container start
INFO: Started HttpContext[/,/]
Jul 17, 2013 8:49:06 AM org.mortbay.http.SocketListener start
INFO: Started SocketListener on 0.0.0.0:8080
Jul 17, 2013 8:49:06 AM org.mortbay.util.Container start
INFO: Started org.mortbay.jetty.Server@5f1843c0
Installed transport [PublicHTTPTransport HTTP server on port 8080]
Installed transport [Cron]
Starting com.ten60.netkernel.container.HouseKeeper
Commissioning module [urn:org:ten60:demo:xml:tech v1.0.0]
Commissioning module [urn:org:ten60:netkernel:tpt:jms v1.1.0]
Commissioning module [urn:org:ten60:netkernel:ext:xrl v1.5.3]
Commissioning module [urn:org:purl:documentation v0.0.11]
Commissioning module [urn:org:ten60:netkernel:mod:docxter v2.0.0]
Commissioning module [urn:org:ten60:netkernel:doc:netkernel v4.1.0]
Commissioning module [urn:org:ten60:netkernel:util:cron v1.1.1]
Commissioning module [urn:org:ten60:netkernel:ext:session v1.1.3]
Commissioning module [urn:org:ten60:netkernel:mod:developer v1.1.1]
Commissioning module [urn:org:ten60:tutorial v1.3.0]
Commissioning module [urn:org:ten60:netkernel:mod:db v2.1.5]
Commissioning module [urn:org:ten60:netkernel:ext:install v1.2.4]
Commissioning module [urn:org:ten60:netkernel:tpt:http v2.2.2]
Commissioning module [urn:org:pinkypipes:mod:pinky v0.2.0]
Commissioning module [urn:org:purl:admin v0.0.1799]
Commissioning module [urn:org:ten60:netkernel:ext:script v1.4.0]
Commissioning module [urn:org:ten60:workbench v1.1.9]
Commissioning module [urn:org:purl:storage v0.0.1]
Commissioning module [urn:org:ten60:netkernel:ext:entrypoint v1.1.4]
Commissioning module [urn:org:ten60:netkernel:ext:dpml v1.2.5]
Commissioning module [urn:org:ten60:netkernel:ext:sys v1.2.10]
Commissioning module [urn:org:ten60:util:image v2.0.0]
Commissioning module [urn:org:ten60:netkernel:ext:xsecurity v1.2.3]
Commissioning module [urn:org:ten60:netkernel:mod:ws:test v1.0.2]
Commissioning module [urn:org:ten60:netkernel:lang:ruby v1.0.1]
Commissioning module [urn:org:ten60:netkernel:ext:xml:ura v1.3.4]
Commissioning module [urn:org:ten60:netkernel:cache:standard v1.2.1]
Commissioning module [urn:org:ten60:netkernel:mod:ldap v1.0.1]
Commissioning module [urn:org:ten60:netkernel:mod:dbxml v1.0.2]
Commissioning module [urn:org:ten60:mod:json v1.0.1]
Commissioning module [urn:org:ten60:netkernel:ext:xml:core v1.5.2]
Commissioning module [urn:org:ten60:netkernel:fulcrum:backend v1.1.8]
Commissioning module [urn:org:purl:session v0.0.5]
Commissioning module [urn:org:purl:virtual:host v1.0.75]
Commissioning module [urn:org:ten60:netkernel:mod:docxter:legacy v1.2.0]
Commissioning module [urn:org:ten60:netkernel:ext:kernel v1.1.0]
Commissioning module [urn:org:purl:search v0.0.100]
Commissioning module [urn:org:ten60:util:aspell v1.0.1]
Commissioning module [urn:org:ten60:netkernel:ext:xquery v2.4.3]
Commissioning module [urn:org:ten60:netkernel:ext:http:client v1.2.1]
Commissioning module [urn:org:ten60:netkernel:mod:smtp v1.1.2]
Commissioning module [urn:org:ten60:netkernel:mod:webdav v1.0.0]
Commissioning module [urn:org:ten60:netkernel:ext:xhtml v1.1.2]
Commissioning module [urn:org:purl:gatekeeper v0.0.48]
Commissioning module [urn:org:ten60:netkernel:ext:xunit v2.1.4]
Commissioning module [urn:org:ten60:netkernel:tpt:intray v1.0.3]
Commissioning module [urn:org:ten60:netkernel:doc:books v2.1.0]
Commissioning module [urn:org:ten60:netkernel:ext:layer1 v1.3.5]
Commissioning module [urn:org:ten60:netkernel:mod:ws v1.1.2]
Commissioning module [urn:org:ten60:netkernel:fulcrum:frontend v2.1.6]
Commissioning module [urn:org:ten60:netkernel:lib:xlib v1.0.9]
Commissioning module [urn:org:ten60:netkernel:ext:introspect v1.3.1]
Commissioning module [urn:org:ten60:netkernel:mod:lucene v1.1.10]
Commissioning module [urn:org:ten60:netkernel:ext:debugger v1.1.6]
Container started sucessfully
Init process started...
Starting [Module Install/Uninstall Detection]
Starting [Module Deployment Verification]
Starting [Entrypoint Maintainance]
Starting [Post-Install Scripts]
Init process complete
Accepting external requests...
17.07.2013 08:46:33 org.quartz.core.QuartzScheduler <init>
INFO: Quartz Scheduler v.1.5.0 created.
17.07.2013 08:46:33 org.quartz.simpl.RAMJobStore initialize
INFO: RAMJobStore initialized.
17.07.2013 08:46:33 org.quartz.impl.StdSchedulerFactory instantiate
INFO: Quartz scheduler 'NetKernel' initialized from an externally opened InputStream.
17.07.2013 08:46:33 org.quartz.impl.StdSchedulerFactory instantiate
INFO: Quartz scheduler version: 1.5.0
Persistence File: file:/srv/purls/scratch/modules_util_cron_1_1_1/persistence.xml
Initialising Cron
Restoring persisted jobs
WARNING Job [Index the PURL Data] misfired due to downtime - running now in urn:org:ten60:netkernel:util:cron
Added Job [Index the PURL Data-misfire] of type [misfire]
Locating jobs defined in Cron entrypoints
Added Job [Initialize Documentation] of type [ep]
Added Job [Initialize the PURL accessor] of type [ep]
Added Job [Index the PURL Data] of type [ep]
Starting Scheduler
17.07.2013 08:46:33 org.quartz.core.QuartzScheduler start
INFO: Scheduler NetKernel_$_1 started.
Running job [Index the PURL Data-misfire]
Running job [Initialize Documentation]
Running job [Initialize the PURL accessor]
<requestid>[SOURCE active:module+resource@active%3Apurl-initialize+module@urn%3Aorg%3Apurl%3Aadmin+version@version%3A0.0.1799 in urn:org:ten60:netkernel:util:cron as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.handleException() line:161</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.issueCallback() line:134</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.innerReceive() line:123</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAsyncRequestHandleImpl.receiveAsyncException() line:107</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:purl-initialize in urn:org:purl:admin as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>com.ten60.netkernel.scheduler.RequestState.setException() line:132</level>
<level>com.ten60.netkernel.scheduler.Scheduler.receiveAsyncException() line:346</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:118</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
</stack>
<ex>
<id>Unhandled Exception in Accessor</id>
<message>org.ten60.netkernel.script.accessor.ScriptEngineNKFAccessor</message>
<requestid>[SOURCE active:beanshell+operator@ffcpl:/scripts/initialize.bsh in urn:org:ten60:netkernel:ext:script as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:115</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
<level>com.ten60.netkernel.scheduler.Scheduler.innerRequestAsynch() line:148</level>
</stack>
<ex>
<id>Unhandled Exception in BeanShellEngine</id>
<message>Sourced file: inline evaluation of: ``main();'' : Method Invocation context.issueSubRequest</message>
<requestid>line: 13</requestid>
<stack>
<level>org.ten60.netkernel.script.engine.BeanShellEngine2.execute() line:66</level>
<level>org.ten60.netkernel.script.accessor.ScriptEngineNKFAccessor.processRequest() line:82</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:107</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:purl-storage-initialize in urn:org:ten60:netkernel:ext:script as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFHelperImpl.issueSubRequest() line:273</level>
<level>sun.reflect.NativeMethodAccessorImpl.invoke0()</level>
<level>sun.reflect.NativeMethodAccessorImpl.invoke() line:39</level>
<level>sun.reflect.DelegatingMethodAccessorImpl.invoke() line:25</level>
</stack>
<ex>
<id>Unhandled Exception in Accessor</id>
<message>org.ten60.netkernel.script.accessor.ScriptEngineNKFAccessor</message>
<requestid>[SOURCE active:beanshell+operator@ffcpl:/resources/initdb.bsh in urn:org:ten60:netkernel:ext:script as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:115</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
<level>com.ten60.netkernel.scheduler.Scheduler.innerRequestAsynch() line:148</level>
</stack>
<ex>
<id>Unhandled Exception in BeanShellEngine</id>
<message>Sourced file: inline evaluation of: ``main();'' : Method Invocation context.issueSubRequest</message>
<requestid>line: 32</requestid>
<stack>
<level>org.ten60.netkernel.script.engine.BeanShellEngine2.execute() line:66</level>
<level>org.ten60.netkernel.script.accessor.ScriptEngineNKFAccessor.processRequest() line:82</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:107</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:purl-storage-create-db in urn:org:ten60:netkernel:ext:script as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFHelperImpl.issueSubRequest() line:273</level>
<level>sun.reflect.GeneratedMethodAccessor11.invoke()</level>
<level>sun.reflect.DelegatingMethodAccessorImpl.invoke() line:25</level>
<level>java.lang.reflect.Method.invoke() line:597</level>
</stack>
<ex>
<id>Unhandled Exception in Accessor</id>
<message>org.ten60.docxter2.XRLMapper</message>
<requestid>[SOURCE active:mapper+operator@ffcpl:/sql/db/links.xml+operand@ffcpl:/xrl/create-db in urn:org:ten60:netkernel:ext:xrl as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:115</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
<level>com.ten60.netkernel.scheduler.Scheduler.innerRequestAsynch() line:148</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:dpml+operand@ffcpl%3A/xrl/create-db+operand@ffcpl%3A/sql/db/createDB.idoc+operator@ffcpl%3A/sql/db/links.xml in urn:org:ten60:netkernel:ext:xrl as com.ten60.netkernel.urii.IURAspect]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFHelperImpl.issueSubRequest() line:273</level>
<level>org.ten60.docxter2.GTPUtils.resolveLink() line:115</level>
<level>org.ten60.docxter2.XRLMapper.processRequest() line:85</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:107</level>
</stack>
<ex>
<id>Unhandled exception in DPML</id>
<message> INSTR: sqlBatch operand=sql</message>
<requestid>ffcpl:/sql/db/createDB.idoc</requestid>
<stack>
<level>org.ten60.netkernel.dpml.DPMLAccessor.stateException() line:110</level>
<level>org.ten60.netkernel.dpml.DPMLAccessor.requestAsync() line:102</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
</stack>
<ex>
<id>Exception during request processing</id>
<message>whilst waiting for result...</message>
<requestid>[SOURCE active:sqlBatch+operand@var%3Asql in urn:org:ten60:netkernel:ext:dpml as java.lang.Object]</requestid>
<stack>
<level>com.ten60.netkernel.scheduler.RequestState.setException() line:132</level>
<level>com.ten60.netkernel.scheduler.Scheduler.receiveAsyncException() line:346</level>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:118</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
</stack>
<ex>
<id>Unhandled Exception in Accessor</id>
<message>org.ten60.rdbms.accessor.RDBMSAccessorImpl2</message>
<requestid>[SOURCE active:sqlBatch+operand@var%3Asql in urn:org:ten60:netkernel:mod:db as java.lang.Object]</requestid>
<stack>
<level>org.ten60.netkernel.layer1.nkf.impl.NKFAccessorImpl.requestAsync() line:115</level>
<level>com.ten60.netkernel.scheduler.Scheduler.stateRequestRepresentation() line:439</level>
<level>com.ten60.netkernel.scheduler.Scheduler.processRequest() line:253</level>
<level>com.ten60.netkernel.scheduler.Scheduler.innerRequestAsynch() line:148</level>
</stack>
<ex>
<id>java.sql.BatchUpdateException</id>
<message>Specified key was too long; max key length is 765 bytes</message>
<stack>
<level>com.mysql.jdbc.StatementImpl.executeBatch() line:1054</level>
<level>org.ten60.rdbms.accessor.RDBMSAccessorImpl2.sqlBatch() line:276</level>
<level>org.ten60.rdbms.accessor.RDBMSAccessorImpl2.execute() line:143</level>
<level>org.ten60.rdbms.accessor.RDBMSAccessorImpl2.processRequest() line:104</level>
</stack>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
</ex>
in urn:org:ten60:netkernel:util:cron
Matthias
Reply all
Reply to author
Forward
0 new messages