DSPACE / tomcat hanging / Solr issue ?
333 views
Skip to first unread message
Monika Mevenkamp
Jan 21, 2016, 9:39:16 AM1/21/16
to DSpace Tech
Looking at the output of jstack I see 7 blocks of
Looking at the Solr Admin UI I see
"ajp-bio-8009-exec-224" daemon prio=10 tid=0x00007f159c9ad000 nid=0x5076 runnable [0x00007f14a3343000]
java.lang.Thread.State: RUNNABLE
….
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.dspace.statistics.SolrLogger.postView(SolrLogger.java:229)
at org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:42)
at org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:144)
at org.dspace.services.events.SystemEventService.fireEvent(SystemEventService.java:86)
at org.dspace.app.webui.servlet.BitstreamServlet.doDSGet(BitstreamServlet.java:116)
at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:130)
at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:75)
...
at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78)
….
Theses are the only dspace related entries in the stack dump
JVM 35% full 351.18 MB of 989.88 MBPhysical Mem 95.8% 1.72GB of 1.79GB
The JVM args shown in the solr admin UI are
- -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
- -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties
- -Djava.io.tmpdir=/var/cache/tomcat/temp
- -Djava.endorsed.dirs=
- -Dcatalina.home=/usr/share/tomcat
- -Dcatalina.base=/usr/share/tomcat
- -Dfile.encoding=UTF-8
- -XX:MaxPermSize=128M
- -Xmx1024M
- -Xms1024M
To give you a sense of the solr index; running a du -hm on the /dspace/solr dir I get
du -s -hm solr
3495 solr
So that is about 5.5GB
The stats core has 3579463 docs
The search core has 70372 docs
I am not sure what solr means with physical memory here
I probably should increase it - but how ?
Monika
________________
Monika Mevenkamp
mo.m...@gmail.com
http://mo-meven.tumblr.com/
http://mcmprogramming.com/mo.meven/
Monika Mevenkamp
mo.m...@gmail.com
http://mo-meven.tumblr.com/
http://mcmprogramming.com/mo.meven/
Tim Donohue
Jan 21, 2016, 9:48:00 AM1/21/16
to dspac...@googlegroups.com
Hi Monika,
You didn't mention what version of DSpace you are using, nor what activities (if any) were going on at the time (if you can narrow that down at all).
If you are not yet on 5.4, there were two significant Solr memory leaks/spikes resolved in 5.4:
https://jira.duraspace.org/browse/DS-2869
https://jira.duraspace.org/browse/DS-2832
(Though these were both on the search/browse side of things, not on Solr Statistics)
There was also a Solr logging issue resolved, which seemed to be causing Solr to do odd things with its logs:
https://jira.duraspace.org/browse/DS-2790
Anything appear in your DSpace or Solr logs during this time? I'm assuming you are likely seeing an OutOfMemory error in one/both?
- Tim
You didn't mention what version of DSpace you are using, nor what activities (if any) were going on at the time (if you can narrow that down at all).
If you are not yet on 5.4, there were two significant Solr memory leaks/spikes resolved in 5.4:
https://jira.duraspace.org/browse/DS-2869
https://jira.duraspace.org/browse/DS-2832
(Though these were both on the search/browse side of things, not on Solr Statistics)
There was also a Solr logging issue resolved, which seemed to be causing Solr to do odd things with its logs:
https://jira.duraspace.org/browse/DS-2790
Anything appear in your DSpace or Solr logs during this time? I'm assuming you are likely seeing an OutOfMemory error in one/both?
- Tim
--
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To post to this group, send email to dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.
-- Tim Donohue Technical Lead for DSpace & DSpaceDirect DuraSpace.org | DSpace.org | DSpaceDirect.org
|
This email has been sent from a virus-free computer protected by Avast. www.avast.com |
Monika Mevenkamp
Jan 21, 2016, 11:48:22 AM1/21/16
to DSpace Tech
Tim
thanks for your quick answer
the instance is at 5.5
I did quite a few modifications but nothing related to solr
I checked; I do have the duplicate solr configs - i doubt that is it unless the double config means solr may have lost some messages
Is that the effect ?
I am most worried about the 92% usage of physical memory shown in the solr ADMIN UI
Sounds like that could easily be a problem
My filesystem is 15% full - that’s not it
DrGoogle hasn’t given me answer yet
Does anybody know how this is defined ?
Monika
Below an excerpt of the solr log - the system choked at 8:20
search queries before that
2016-01-21 07:51:27,097 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 07:54:40,778 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 07:54:40,779 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 07:54:40,780 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 07:54:40,780 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
then update / optimize
2016-01-21 07:58:18,939 INFO org.apache.solr.update.UpdateHandler @ start commit{,optimize=false,openSearcher=true,waitSearcher=true,expung
2016-01-21 07:58:18,985 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onCommit: commits: num=2
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
2016-01-21 07:58:18,985 INFO org.apache.solr.core.SolrCore @ newest commit generation = 49343
2016-01-21 07:58:28,803 INFO org.apache.solr.search.SolrIndexSearcher @ Opening Searcher@3189d1aa[statistics] main
2016-01-21 07:58:28,803 INFO org.apache.solr.update.UpdateHandler @ end_commit_flush
I have no idea where that might come from - its not from my nightly cronjob that calls the optimizer at around 1am
the nightly cronjob left this ,message at 1am
2016-01-21 01:01:49,252 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onCommit: commits: num=2
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
then lots of queries to search and stats core
2016-01-21 07:58:28,804 INFO org.apache.solr.core.SolrCore @ QuerySenderListener sending requests to Searcher@3189d1aa[statistics] main{Sta
2016-01-21 07:58:29,129 INFO org.apache.solr.core.SolrCore @ QuerySenderListener done.
2016-01-21 07:58:29,131 INFO org.apache.solr.core.SolrCore @ [statistics] Registered new searcher Searcher@3189d1aa[statistics] main{Standa
2016-01-21 07:59:03,485 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:00:06,055 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:00:11,976 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:00:16,620 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:04:27,350 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:04:55,776 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:06:54,274 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:07:53,345 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:07:56,265 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:07:56,269 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:07:56,275 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:08:01,748 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:08:01,752 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:08:01,757 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:08:05,690 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:08:05,695 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:08:05,701 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:08:12,179 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:08:12,184 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:08:12,189 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:08:14,675 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={fl=handle,search.resourcetype,searc
2016-01-21 08:08:17,982 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={fl=handle,search.resourcetype,searc
2016-01-21 08:12:19,030 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:12:19,035 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:12:19,042 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:12:23,700 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:12:23,705 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:12:23,709 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:12:28,701 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:12:28,706 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:12:28,711 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:13:33,049 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:13:33,054 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:13:33,060 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:13:38,138 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:13:38,143 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:13:38,148 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:13:43,162 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:13:43,167 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:13:43,174 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:14:03,485 INFO org.apache.solr.update.UpdateHandler @ start commit{,optimize=false,openSearcher=true,waitSearcher=true,expung
2016-01-21 08:20:45,181 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:20:45,187 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:20:45,194 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:20:50,236 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:20:50,240 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:20:50,245 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
2016-01-21 08:20:55,265 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+asc&fl=da
2016-01-21 08:20:55,270 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=dateIssued.year_sort+desc&fl=d
2016-01-21 08:20:55,275 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={spellcheck=true&facet=true&sort=sco
now the restart - the log messages for that is attached at the end
then searching again
2016-01-21 08:54:48,039 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/select params={q=type:2+AND+id:1&wt=javabin&ve
2016-01-21 08:54:48,630 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:54:49,619 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:54:52,352 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:54:55,633 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:55:51,080 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:03,663 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={fl=search.resourcetype,search.resou
2016-01-21 08:56:03,870 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={fl=handle,search.resourcetype,searc
2016-01-21 08:56:04,243 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=bi_sort_4_sort+desc&fl=handle,
2016-01-21 08:56:04,284 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:14,696 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:20,715 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:51,653 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:51,676 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:54,008 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:56:54,619 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:57:11,532 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:57:12,272 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:57:23,367 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:57:25,643 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:57:25,905 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:58:08,033 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:58:25,226 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:58:41,551 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:59:27,661 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 08:59:38,373 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={fl=handle,search.resourcetype,searc
2016-01-21 08:59:38,389 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={sort=bi_sort_4_sort+desc&fl=handle,
2016-01-21 08:59:38,401 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:12,492 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:13,372 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:13,647 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:13,710 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:16,358 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:18,270 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:20,061 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:24,269 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
2016-01-21 09:00:29,931 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/update params={wt=javabin&version=2} status=0
restart log messages
2016-01-21 08:54:02,260 INFO org.apache.solr.servlet.SolrDispatchFilter @ SolrDispatchFilter.init()
2016-01-21 08:54:02,268 INFO org.apache.solr.core.SolrResourceLoader @ Using JNDI solr.home: /dspace/solr
2016-01-21 08:54:02,269 INFO org.apache.solr.core.SolrResourceLoader @ new SolrResourceLoader for directory: '/dspace/solr/'
2016-01-21 08:54:02,399 INFO org.apache.solr.core.ConfigSolr @ Loading container configuration from /dspace/solr/solr.xml
2016-01-21 08:54:02,849 INFO org.apache.solr.core.CoreContainer @ New CoreContainer 928485477
2016-01-21 08:54:02,849 INFO org.apache.solr.core.CoreContainer @ Loading cores into CoreContainer [instanceDir=/dspace/solr/]
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting socketTimeout to: 0
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting urlScheme to: null
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting connTimeout to: 0
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting maxConnectionsPerHost to: 20
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting corePoolSize to: 0
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting maximumPoolSize to: 2147483647
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting maxThreadIdleTime to: 5
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting sizeOfQueue to: -1
2016-01-21 08:54:02,859 INFO org.apache.solr.handler.component.HttpShardHandlerFactory @ Setting fairnessPolicy to: false
2016-01-21 08:54:02,891 INFO org.apache.solr.update.UpdateShardHandler @ Creating UpdateShardHandler HTTP client with params: socketTimeout
2016-01-21 08:54:02,892 INFO org.apache.solr.logging.LogWatcher @ SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
2016-01-21 08:54:02,893 INFO org.apache.solr.logging.LogWatcher @ Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
2016-01-21 08:54:02,893 INFO org.apache.solr.core.CoreContainer @ Host Name: null
2016-01-21 08:54:02,946 INFO org.apache.solr.core.SolrResourceLoader @ new SolrResourceLoader for directory: '/dspace/solr/search/'
2016-01-21 08:54:02,946 INFO org.apache.solr.core.SolrResourceLoader @ new SolrResourceLoader for directory: '/dspace/solr/statistics/'
2016-01-21 08:54:02,955 INFO org.apache.solr.core.SolrResourceLoader @ new SolrResourceLoader for directory: '/dspace/solr/oai/'
2016-01-21 08:54:03,734 INFO org.apache.solr.update.SolrIndexConfig @ IndexWriter infoStream solr logging is enabled
2016-01-21 08:54:03,751 INFO org.apache.solr.update.SolrIndexConfig @ IndexWriter infoStream solr logging is enabled
2016-01-21 08:54:03,756 INFO org.apache.solr.core.SolrConfig @ Using Lucene MatchVersion: 4.10.0
2016-01-21 08:54:03,762 INFO org.apache.solr.update.SolrIndexConfig @ IndexWriter infoStream solr logging is enabled
2016-01-21 08:54:03,768 INFO org.apache.solr.core.SolrConfig @ Using Lucene MatchVersion: 4.10.0
2016-01-21 08:54:03,766 INFO org.apache.solr.core.SolrConfig @ Using Lucene MatchVersion: 4.10.0
2016-01-21 08:54:04,400 INFO org.apache.solr.core.Config @ Loaded SolrConfig: solrconfig.xml
2016-01-21 08:54:04,408 INFO org.apache.solr.core.Config @ Loaded SolrConfig: solrconfig.xml
2016-01-21 08:54:04,416 INFO org.apache.solr.core.Config @ Loaded SolrConfig: solrconfig.xml
2016-01-21 08:54:04,419 INFO org.apache.solr.schema.IndexSchema @ Reading Solr Schema from /dspace/solr/search/conf/schema.xml
2016-01-21 08:54:04,420 INFO org.apache.solr.schema.IndexSchema @ Reading Solr Schema from /dspace/solr/statistics/conf/schema.xml
2016-01-21 08:54:04,420 INFO org.apache.solr.schema.IndexSchema @ Reading Solr Schema from /dspace/solr/oai/conf/schema.xml
2016-01-21 08:54:04,517 INFO org.apache.solr.schema.IndexSchema @ [statistics] Schema name=example
2016-01-21 08:54:04,520 INFO org.apache.solr.schema.IndexSchema @ [oai] Schema name=xoai
2016-01-21 08:54:04,575 INFO org.apache.solr.schema.IndexSchema @ [search] Schema name=example
2016-01-21 08:54:04,605 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.IntField]. Plea
2016-01-21 08:54:04,706 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.LongField]. Ple
2016-01-21 08:54:04,709 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.FloatField]. Pl
2016-01-21 08:54:04,712 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.DoubleField]. P
2016-01-21 08:54:04,715 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.SortableIntFiel
2016-01-21 08:54:04,762 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.SortableLongFie
2016-01-21 08:54:04,765 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.SortableFloatFi
2016-01-21 08:54:04,768 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleF
2016-01-21 08:54:04,770 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.DateField]. Ple
2016-01-21 08:54:04,968 INFO org.apache.solr.schema.IndexSchema @ default search field in schema is id
2016-01-21 08:54:04,969 INFO org.apache.solr.schema.IndexSchema @ query parser default operator is AND
2016-01-21 08:54:04,969 INFO org.apache.solr.schema.IndexSchema @ unique key field: uid
2016-01-21 08:54:05,073 INFO org.apache.solr.schema.IndexSchema @ default search field in schema is item.handle
2016-01-21 08:54:05,073 INFO org.apache.solr.schema.IndexSchema @ query parser default operator is OR
2016-01-21 08:54:05,074 INFO org.apache.solr.schema.IndexSchema @ unique key field: item.handle
2016-01-21 08:54:05,095 INFO org.apache.solr.schema.IndexSchema @ default search field in schema is search_text
2016-01-21 08:54:05,096 INFO org.apache.solr.schema.IndexSchema @ query parser default operator is OR
2016-01-21 08:54:05,096 INFO org.apache.solr.schema.IndexSchema @ unique key field: search.uniqueid
2016-01-21 08:54:05,436 INFO org.apache.solr.core.CoreContainer @ Creating SolrCore 'statistics' using configuration from instancedir /dspa
2016-01-21 08:54:05,454 INFO org.apache.solr.core.CoreContainer @ Creating SolrCore 'search' using configuration from instancedir /dspace/s
2016-01-21 08:54:05,447 INFO org.apache.solr.core.CoreContainer @ Creating SolrCore 'oai' using configuration from instancedir /dspace/solr
2016-01-21 08:54:05,470 INFO org.apache.solr.core.SolrCore @ solr.NRTCachingDirectoryFactory
2016-01-21 08:54:05,476 INFO org.apache.solr.core.SolrCore @ [statistics] Opening new SolrCore at /dspace/solr/statistics/, dataDir=/dspace
2016-01-21 08:54:05,477 INFO org.apache.solr.core.JmxMonitoredMap @ JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jm
2016-01-21 08:54:05,480 INFO org.apache.solr.core.SolrCore @ solr.NRTCachingDirectoryFactory
2016-01-21 08:54:05,480 INFO org.apache.solr.core.SolrCore @ solr.NRTCachingDirectoryFactory
2016-01-21 08:54:05,497 INFO org.apache.solr.core.SolrCore @ [statistics] Added SolrEventListener for newSearcher: org.apache.solr.core.Que
2016-01-21 08:54:05,497 INFO org.apache.solr.core.SolrCore @ [statistics] Added SolrEventListener for firstSearcher: org.apache.solr.core.Q
2016-01-21 08:54:05,510 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/statistics/data
2016-01-21 08:54:05,511 INFO org.apache.solr.core.SolrCore @ New index directory detected: old=null new=/dspace/solr/statistics/data/index/
2016-01-21 08:54:05,511 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/statistics/data/index
2016-01-21 08:54:05,513 INFO org.apache.solr.core.SolrCore @ [oai] Opening new SolrCore at /dspace/solr/oai/, dataDir=/dspace/solr/oai/data
2016-01-21 08:54:05,513 INFO org.apache.solr.core.SolrCore @ [search] Opening new SolrCore at /dspace/solr/search/, dataDir=/dspace/solr/se
2016-01-21 08:54:05,513 INFO org.apache.solr.core.JmxMonitoredMap @ JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jm
2016-01-21 08:54:05,513 INFO org.apache.solr.core.JmxMonitoredMap @ JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jm
2016-01-21 08:54:05,524 INFO org.apache.solr.core.SolrCore @ created json: solr.JSONResponseWriter
2016-01-21 08:54:05,524 INFO org.apache.solr.core.SolrCore @ adding lazy queryResponseWriter: solr.VelocityResponseWriter
2016-01-21 08:54:05,524 INFO org.apache.solr.core.SolrCore @ created velocity: solr.VelocityResponseWriter
2016-01-21 08:54:05,527 INFO org.apache.solr.core.SolrCore @ created xslt: solr.XSLTResponseWriter
2016-01-21 08:54:05,527 INFO org.apache.solr.response.XSLTResponseWriter @ xsltCacheLifetimeSeconds=5
2016-01-21 08:54:05,591 INFO org.apache.solr.core.SolrCore @ [oai] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySende
2016-01-21 08:54:05,591 INFO org.apache.solr.core.SolrCore @ [oai] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySen
2016-01-21 08:54:05,591 INFO org.apache.solr.core.SolrCore @ [search] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySe
2016-01-21 08:54:05,591 INFO org.apache.solr.core.SolrCore @ [search] Added SolrEventListener for firstSearcher: org.apache.solr.core.Query
2016-01-21 08:54:05,591 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/oai/data
2016-01-21 08:54:05,592 INFO org.apache.solr.core.SolrCore @ New index directory detected: old=null new=/dspace/solr/oai/data/index/
2016-01-21 08:54:05,592 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/search/data
2016-01-21 08:54:05,592 INFO org.apache.solr.core.SolrCore @ New index directory detected: old=null new=/dspace/solr/search/data/index/
2016-01-21 08:54:05,604 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/oai/data/index
2016-01-21 08:54:05,604 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/search/data/index
2016-01-21 08:54:05,624 INFO org.apache.solr.update.processor.UpdateRequestProcessorChain @ creating updateRequestProcessorChain "uuid"
2016-01-21 08:54:05,632 INFO org.apache.solr.update.processor.UpdateRequestProcessorChain @ inserting DistributedUpdateProcessorFactory int
2016-01-21 08:54:05,632 INFO org.apache.solr.core.SolrCore @ no updateRequestProcessorChain defined as default, creating implicit default
2016-01-21 08:54:05,637 INFO org.apache.solr.core.RequestHandlers @ created /update: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ created json: solr.JSONResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ adding lazy queryResponseWriter: solr.VelocityResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ created velocity: solr.VelocityResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ created xslt: solr.XSLTResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ created json: solr.JSONResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ adding lazy queryResponseWriter: solr.VelocityResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ created velocity: solr.VelocityResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.core.SolrCore @ created xslt: solr.XSLTResponseWriter
2016-01-21 08:54:05,637 INFO org.apache.solr.response.XSLTResponseWriter @ xsltCacheLifetimeSeconds=5
2016-01-21 08:54:05,640 INFO org.apache.solr.core.SolrCore @ no updateRequestProcessorChain defined as default, creating implicit default
2016-01-21 08:54:05,637 INFO org.apache.solr.response.XSLTResponseWriter @ xsltCacheLifetimeSeconds=5
2016-01-21 08:54:05,643 INFO org.apache.solr.core.SolrCore @ no updateRequestProcessorChain defined as default, creating implicit default
2016-01-21 08:54:05,648 INFO org.apache.solr.core.RequestHandlers @ created /update/json: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,649 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,649 INFO org.apache.solr.core.RequestHandlers @ created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,654 INFO org.apache.solr.core.RequestHandlers @ created /select: solr.SearchHandler
2016-01-21 08:54:05,655 INFO org.apache.solr.core.RequestHandlers @ created /query: solr.SearchHandler
2016-01-21 08:54:05,656 INFO org.apache.solr.core.RequestHandlers @ created /get: solr.RealTimeGetHandler
2016-01-21 08:54:05,657 INFO org.apache.solr.core.RequestHandlers @ created /browse: solr.SearchHandler
2016-01-21 08:54:05,658 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update ignoring:
2016-01-21 08:54:05,658 INFO org.apache.solr.core.RequestHandlers @ created /update: solr.UpdateRequestHandler
2016-01-21 08:54:05,641 INFO org.apache.solr.core.RequestHandlers @ created /update: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,659 INFO org.apache.solr.core.RequestHandlers @ created /update/json: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,660 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,660 INFO org.apache.solr.core.RequestHandlers @ created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,644 INFO org.apache.solr.core.RequestHandlers @ created /update: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,661 INFO org.apache.solr.core.RequestHandlers @ created /update/json: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,661 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,662 INFO org.apache.solr.core.RequestHandlers @ created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:05,669 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.JsonUpdateReque
2016-01-21 08:54:05,669 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/json ignor
2016-01-21 08:54:05,669 INFO org.apache.solr.core.RequestHandlers @ created /update/json: solr.JsonUpdateRequestHandler
2016-01-21 08:54:05,671 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.CSVRequestHandl
2016-01-21 08:54:05,671 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/csv ignori
2016-01-21 08:54:05,671 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: solr.CSVRequestHandler
2016-01-21 08:54:05,671 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
2016-01-21 08:54:05,672 INFO org.apache.solr.core.RequestHandlers @ created /update/extract: solr.extraction.ExtractingRequestHandler
2016-01-21 08:54:05,672 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:05,672 INFO org.apache.solr.core.RequestHandlers @ created /analysis/field: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:05,672 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:05,672 INFO org.apache.solr.core.RequestHandlers @ created /analysis/document: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:05,674 INFO org.apache.solr.core.RequestHandlers @ created /admin/: solr.admin.AdminHandlers
2016-01-21 08:54:05,676 INFO org.apache.solr.core.RequestHandlers @ created /admin/ping: solr.PingRequestHandler
2016-01-21 08:54:05,677 INFO org.apache.solr.core.RequestHandlers @ created /debug/dump: solr.DumpRequestHandler
2016-01-21 08:54:05,686 INFO org.apache.solr.core.RequestHandlers @ created /replication: solr.ReplicationHandler
2016-01-21 08:54:05,686 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ created tvrh: org.apache.solr.handler.component.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,687 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /spell ignoring: o
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ created /tvrh: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ created /terms: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,687 INFO org.apache.solr.core.RequestHandlers @ created /elevate: solr.SearchHandler
2016-01-21 08:54:05,694 INFO org.apache.solr.core.RequestHandlers @ created /select: solr.SearchHandler
2016-01-21 08:54:05,695 INFO org.apache.solr.core.RequestHandlers @ created /query: solr.SearchHandler
2016-01-21 08:54:05,695 INFO org.apache.solr.core.RequestHandlers @ created /get: solr.RealTimeGetHandler
2016-01-21 08:54:05,696 INFO org.apache.solr.core.RequestHandlers @ created /browse: solr.SearchHandler
2016-01-21 08:54:05,696 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update ignoring:
2016-01-21 08:54:05,697 INFO org.apache.solr.core.RequestHandlers @ created /update: solr.UpdateRequestHandler
2016-01-21 08:54:05,697 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/json ignor
2016-01-21 08:54:05,697 INFO org.apache.solr.core.RequestHandlers @ created /update/json: solr.JsonUpdateRequestHandler
2016-01-21 08:54:05,697 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/csv ignori
2016-01-21 08:54:05,697 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: solr.CSVRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ created /update/extract: solr.extraction.ExtractingRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ created /analysis/field: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ created /analysis/document: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ created /admin/: solr.admin.AdminHandlers
2016-01-21 08:54:05,698 INFO org.apache.solr.core.RequestHandlers @ created /admin/ping: solr.PingRequestHandler
2016-01-21 08:54:05,699 INFO org.apache.solr.core.RequestHandlers @ created /debug/dump: solr.DumpRequestHandler
2016-01-21 08:54:05,699 INFO org.apache.solr.core.RequestHandlers @ created /replication: solr.ReplicationHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ created tvrh: org.apache.solr.handler.component.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,700 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /spell ignoring: o
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ created /tvrh: solr.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ created /terms: solr.SearchHandler
2016-01-21 08:54:05,700 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,701 INFO org.apache.solr.core.RequestHandlers @ created /elevate: solr.SearchHandler
2016-01-21 08:54:05,697 INFO org.apache.solr.core.RequestHandlers @ created /select: solr.SearchHandler
2016-01-21 08:54:05,701 INFO org.apache.solr.core.RequestHandlers @ created /query: solr.SearchHandler
2016-01-21 08:54:05,701 INFO org.apache.solr.core.RequestHandlers @ created /get: solr.RealTimeGetHandler
2016-01-21 08:54:05,702 INFO org.apache.solr.core.RequestHandlers @ created /browse: solr.SearchHandler
2016-01-21 08:54:05,702 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update ignoring:
2016-01-21 08:54:05,702 INFO org.apache.solr.core.RequestHandlers @ created /update: solr.UpdateRequestHandler
2016-01-21 08:54:05,703 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/json ignor
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ created /update/json: solr.JsonUpdateRequestHandler
2016-01-21 08:54:05,703 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/csv ignori
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: solr.CSVRequestHandler
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ created /update/extract: solr.extraction.ExtractingRequestHandler
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ created /analysis/field: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:05,703 INFO org.apache.solr.core.RequestHandlers @ created /analysis/document: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:05,704 INFO org.apache.solr.core.RequestHandlers @ created /admin/: solr.admin.AdminHandlers
2016-01-21 08:54:05,704 INFO org.apache.solr.core.RequestHandlers @ created /admin/ping: solr.PingRequestHandler
2016-01-21 08:54:05,704 INFO org.apache.solr.core.RequestHandlers @ created /debug/dump: solr.DumpRequestHandler
2016-01-21 08:54:05,705 INFO org.apache.solr.core.RequestHandlers @ created /replication: solr.ReplicationHandler
2016-01-21 08:54:05,705 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ created tvrh: org.apache.solr.handler.component.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,706 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /spell ignoring: o
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ created /tvrh: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ created /terms: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:05,706 INFO org.apache.solr.core.RequestHandlers @ created /elevate: solr.SearchHandler
2016-01-21 08:54:05,713 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,714 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,714 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,715 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,715 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,715 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,715 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,717 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,739 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,739 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,739 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,739 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,739 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,740 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,717 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,742 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,742 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,743 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,743 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,743 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,743 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:05,785 INFO org.apache.solr.core.SolrCore @ Hard AutoCommit: if uncommited for 900000ms; if 10000 uncommited docs
2016-01-21 08:54:05,785 INFO org.apache.solr.core.SolrCore @ Soft AutoCommit: disabled
2016-01-21 08:54:05,849 INFO org.apache.solr.core.SolrCore @ Hard AutoCommit: if uncommited for 10000ms; if 10000 uncommited docs
2016-01-21 08:54:05,849 INFO org.apache.solr.core.SolrCore @ Soft AutoCommit: disabled
2016-01-21 08:54:05,908 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onInit: commits: num=1
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/search/data/index lockFactory=NativeFSLockFactory@/dspace/solr/search/data/index;
2016-01-21 08:54:05,909 INFO org.apache.solr.core.SolrCore @ newest commit generation = 102490
2016-01-21 08:54:05,956 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onInit: commits: num=1
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
2016-01-21 08:54:05,956 INFO org.apache.solr.core.SolrCore @ newest commit generation = 49343
2016-01-21 08:54:06,113 INFO org.apache.solr.core.SolrCore @ Hard AutoCommit: if uncommited for 10000ms; if 10000 uncommited docs
2016-01-21 08:54:06,113 INFO org.apache.solr.core.SolrCore @ Soft AutoCommit: disabled
2016-01-21 08:54:06,125 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onInit: commits: num=1
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/oai/data/index lockFactory=NativeFSLockFactory@/dspace/solr/oai/data/index; maxCa
2016-01-21 08:54:06,125 INFO org.apache.solr.core.SolrCore @ newest commit generation = 1313
2016-01-21 08:54:06,146 INFO org.apache.solr.search.SolrIndexSearcher @ Opening Searcher@6c77e089[search] main
2016-01-21 08:54:06,159 INFO org.apache.solr.rest.ManagedResourceStorage @ File-based storage initialized to use dir: /dspace/solr/search/c
2016-01-21 08:54:06,159 INFO org.apache.solr.rest.RestManager @ Initializing RestManager with initArgs: {storageDir=/dspace/solr/search/con
2016-01-21 08:54:06,168 INFO org.apache.solr.rest.ManagedResourceStorage @ Reading _rest_managed.json using file:dir=/dspace/solr/search/co
2016-01-21 08:54:06,179 INFO org.apache.solr.search.SolrIndexSearcher @ Opening Searcher@2e7de6c2[oai] main
2016-01-21 08:54:06,190 INFO org.apache.solr.rest.ManagedResourceStorage @ File-based storage initialized to use dir: /dspace/solr/oai/conf
2016-01-21 08:54:06,190 INFO org.apache.solr.rest.RestManager @ Initializing RestManager with initArgs: {storageDir=/dspace/solr/oai/conf}
2016-01-21 08:54:06,191 INFO org.apache.solr.rest.ManagedResourceStorage @ Reading _rest_managed.json using file:dir=/dspace/solr/oai/conf
2016-01-21 08:54:06,198 INFO org.apache.solr.rest.ManagedResourceStorage @ Loaded LinkedHashMap at path _rest_managed.json using file:dir=/
2016-01-21 08:54:06,198 INFO org.apache.solr.rest.ManagedResource @ Loaded initArgs {} for /rest/managed
2016-01-21 08:54:06,198 INFO org.apache.solr.rest.RestManager @ Initializing 0 registered ManagedResources
2016-01-21 08:54:06,198 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:06,196 INFO org.apache.solr.rest.ManagedResourceStorage @ Loaded LinkedHashMap at path _rest_managed.json using file:dir=/
2016-01-21 08:54:06,200 INFO org.apache.solr.rest.ManagedResource @ Loaded initArgs {} for /rest/managed
2016-01-21 08:54:06,208 INFO org.apache.solr.rest.RestManager @ Initializing 0 registered ManagedResources
2016-01-21 08:54:06,210 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:06,218 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:06,219 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:06,223 INFO org.apache.solr.spelling.DirectSolrSpellChecker @ init: {name=default,field=item.handle,classname=solr.DirectS
2016-01-21 08:54:06,229 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:06,230 INFO org.apache.solr.handler.component.QueryElevationComponent @ Loading QueryElevation from: /dspace/solr/oai/conf
2016-01-21 08:54:06,274 INFO org.apache.solr.handler.ReplicationHandler @ Commits will be reserved for 10000
2016-01-21 08:54:06,279 INFO org.apache.solr.core.SolrCore @ QuerySenderListener sending requests to Searcher@2e7de6c2[oai] main{StandardDi
2016-01-21 08:54:06,348 INFO org.apache.solr.core.SolrCore @ [oai] webapp=null path=null params={event=firstSearcher&q=static+firstSearcher
2016-01-21 08:54:06,348 INFO org.apache.solr.core.SolrCore @ QuerySenderListener done.
2016-01-21 08:54:06,349 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:06,349 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:06,349 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: wordbreak
2016-01-21 08:54:06,351 INFO org.apache.solr.core.SolrCore @ [oai] Registered new searcher Searcher@2e7de6c2[oai] main{StandardDirectoryRea
2016-01-21 08:54:06,354 INFO org.apache.solr.core.CoreContainer @ registering core: oai
2016-01-21 08:54:06,354 INFO org.apache.solr.core.SolrResourceLoader @ new SolrResourceLoader for directory: '/dspace/solr/authority/'
2016-01-21 08:54:06,430 INFO org.apache.solr.update.SolrIndexConfig @ IndexWriter infoStream solr logging is enabled
2016-01-21 08:54:06,432 INFO org.apache.solr.core.SolrConfig @ Using Lucene MatchVersion: 4.10.0
2016-01-21 08:54:06,556 INFO org.apache.solr.core.Config @ Loaded SolrConfig: solrconfig.xml
2016-01-21 08:54:06,556 INFO org.apache.solr.schema.IndexSchema @ Reading Solr Schema from /dspace/solr/authority/conf/schema.xml
2016-01-21 08:54:06,592 INFO org.apache.solr.schema.IndexSchema @ [authority] Schema name=example
2016-01-21 08:54:06,675 INFO org.apache.solr.schema.IndexSchema @ default search field in schema is value
2016-01-21 08:54:06,675 INFO org.apache.solr.schema.IndexSchema @ query parser default operator is OR
2016-01-21 08:54:06,676 INFO org.apache.solr.schema.IndexSchema @ unique key field: id
2016-01-21 08:54:06,706 INFO org.apache.solr.core.CoreContainer @ Creating SolrCore 'authority' using configuration from instancedir /dspac
2016-01-21 08:54:06,706 INFO org.apache.solr.core.SolrCore @ solr.StandardDirectoryFactory
2016-01-21 08:54:06,711 INFO org.apache.solr.core.SolrCore @ [authority] Opening new SolrCore at /dspace/solr/authority/, dataDir=/dspace/s
2016-01-21 08:54:06,711 INFO org.apache.solr.core.JmxMonitoredMap @ JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jm
2016-01-21 08:54:06,712 INFO org.apache.solr.core.SolrCore @ [authority] Added SolrEventListener for newSearcher: org.apache.solr.core.Quer
2016-01-21 08:54:06,712 INFO org.apache.solr.core.SolrCore @ [authority] Added SolrEventListener for firstSearcher: org.apache.solr.core.Qu
2016-01-21 08:54:06,712 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/authority/data
2016-01-21 08:54:06,712 INFO org.apache.solr.core.SolrCore @ New index directory detected: old=null new=/dspace/solr/authority/data/index/
2016-01-21 08:54:06,712 INFO org.apache.solr.core.CachingDirectoryFactory @ return new directory for /dspace/solr/authority/data/index
2016-01-21 08:54:06,712 INFO org.apache.solr.core.SolrCore @ created xslt: solr.XSLTResponseWriter
2016-01-21 08:54:06,712 INFO org.apache.solr.response.XSLTResponseWriter @ xsltCacheLifetimeSeconds=5
2016-01-21 08:54:06,715 INFO org.apache.solr.core.SolrCore @ no updateRequestProcessorChain defined as default, creating implicit default
2016-01-21 08:54:06,716 INFO org.apache.solr.core.RequestHandlers @ created /update: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:06,716 INFO org.apache.solr.core.RequestHandlers @ created /update/json: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:06,716 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:06,717 INFO org.apache.solr.core.RequestHandlers @ created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
2016-01-21 08:54:06,717 INFO org.apache.solr.core.RequestHandlers @ created standard: solr.SearchHandler
2016-01-21 08:54:06,718 INFO org.apache.solr.core.RequestHandlers @ created dismax: solr.SearchHandler
2016-01-21 08:54:06,718 INFO org.apache.solr.core.RequestHandlers @ created partitioned: solr.SearchHandler
2016-01-21 08:54:06,719 INFO org.apache.solr.core.RequestHandlers @ created /spell: solr.SearchHandler
2016-01-21 08:54:06,719 INFO org.apache.solr.core.RequestHandlers @ created tvrh: org.apache.solr.handler.component.SearchHandler
2016-01-21 08:54:06,719 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: org.apache.solr.handler.extraction.Extracti
2016-01-21 08:54:06,720 INFO org.apache.solr.core.RequestHandlers @ created /update/extract: org.apache.solr.handler.extraction.ExtractingR
2016-01-21 08:54:06,720 INFO org.apache.solr.core.RequestHandlers @ created /terms: org.apache.solr.handler.component.SearchHandler
2016-01-21 08:54:06,720 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.SearchHandler
2016-01-21 08:54:06,720 INFO org.apache.solr.core.RequestHandlers @ created /elevate: solr.SearchHandler
2016-01-21 08:54:06,722 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.XmlUpdateReques
2016-01-21 08:54:06,754 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update ignoring:
2016-01-21 08:54:06,754 INFO org.apache.solr.core.RequestHandlers @ created /update: solr.XmlUpdateRequestHandler
2016-01-21 08:54:06,756 WARN org.apache.solr.core.SolrResourceLoader @ Solr loaded a deprecated plugin/analysis class [solr.BinaryUpdateReq
2016-01-21 08:54:06,756 INFO org.apache.solr.core.RequestHandlers @ created /update/javabin: solr.BinaryUpdateRequestHandler
2016-01-21 08:54:06,760 INFO org.apache.solr.core.RequestHandlers @ created /analysis/document: solr.DocumentAnalysisRequestHandler
2016-01-21 08:54:06,762 INFO org.apache.solr.core.RequestHandlers @ created /analysis/field: solr.FieldAnalysisRequestHandler
2016-01-21 08:54:06,762 INFO org.apache.solr.core.RequestHandlers @ adding lazy requestHandler: solr.CSVRequestHandler
2016-01-21 08:54:06,762 WARN org.apache.solr.core.RequestHandlers @ Multiple requestHandler registered to the same name: /update/csv ignori
2016-01-21 08:54:06,762 INFO org.apache.solr.core.RequestHandlers @ created /update/csv: solr.CSVRequestHandler
2016-01-21 08:54:06,762 INFO org.apache.solr.core.RequestHandlers @ created /admin/: org.apache.solr.handler.admin.AdminHandlers
2016-01-21 08:54:06,763 INFO org.apache.solr.core.RequestHandlers @ created /admin/ping: PingRequestHandler
2016-01-21 08:54:06,764 INFO org.apache.solr.core.RequestHandlers @ created /debug/dump: solr.DumpRequestHandler
2016-01-21 08:54:06,764 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:06,764 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:06,764 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:06,764 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:06,764 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:06,765 WARN org.apache.solr.handler.UpdateRequestHandler @ Using deprecated class: XmlUpdateRequestHandler -- replace with
2016-01-21 08:54:06,765 INFO org.apache.solr.handler.loader.XMLLoader @ xsltCacheLifetimeSeconds=60
2016-01-21 08:54:06,765 WARN org.apache.solr.handler.UpdateRequestHandler @ Using deprecated class: BinaryUpdateRequestHandler -- replace w
2016-01-21 08:54:06,791 INFO org.apache.solr.core.SolrCore @ Hard AutoCommit: if uncommited for 10000ms; if 10000 uncommited docs
2016-01-21 08:54:06,791 INFO org.apache.solr.core.SolrCore @ Soft AutoCommit: disabled
2016-01-21 08:54:06,826 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onInit: commits: num=1
commit{dir=/dspace/solr/authority/data/index,segFN=segments_1,generation=1}
2016-01-21 08:54:06,826 INFO org.apache.solr.core.SolrCore @ newest commit generation = 1
2016-01-21 08:54:06,826 INFO org.apache.solr.search.SolrIndexSearcher @ Opening Searcher@2d1bd913[authority] main
2016-01-21 08:54:06,827 INFO org.apache.solr.rest.ManagedResourceStorage @ File-based storage initialized to use dir: /dspace/solr/authorit
2016-01-21 08:54:06,827 INFO org.apache.solr.rest.RestManager @ Initializing RestManager with initArgs: {storageDir=/dspace/solr/authority/
2016-01-21 08:54:06,827 INFO org.apache.solr.rest.ManagedResourceStorage @ Reading _rest_managed.json using file:dir=/dspace/solr/authority
2016-01-21 08:54:06,798 INFO org.apache.solr.search.SolrIndexSearcher @ Opening Searcher@730d91de[statistics] main
2016-01-21 08:54:06,828 INFO org.apache.solr.rest.ManagedResourceStorage @ File-based storage initialized to use dir: /dspace/solr/statisti
2016-01-21 08:54:06,828 INFO org.apache.solr.rest.RestManager @ Initializing RestManager with initArgs: {storageDir=/dspace/solr/statistics
2016-01-21 08:54:06,828 INFO org.apache.solr.rest.ManagedResourceStorage @ Reading _rest_managed.json using file:dir=/dspace/solr/statistic
2016-01-21 08:54:06,828 INFO org.apache.solr.rest.ManagedResourceStorage @ Loaded LinkedHashMap at path _rest_managed.json using file:dir=/
2016-01-21 08:54:06,828 INFO org.apache.solr.rest.ManagedResource @ Loaded initArgs {} for /rest/managed
2016-01-21 08:54:06,828 INFO org.apache.solr.rest.RestManager @ Initializing 0 registered ManagedResources
2016-01-21 08:54:06,828 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:06,829 INFO org.apache.solr.handler.component.SpellCheckComponent @ Registering newSearcher listener for spellchecker: def
2016-01-21 08:54:06,829 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:06,829 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:06,829 INFO org.apache.solr.spelling.DirectSolrSpellChecker @ init: {name=default,field=search_text,classname=solr.DirectS
2016-01-21 08:54:06,830 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:06,830 INFO org.apache.solr.handler.component.QueryElevationComponent @ Loading QueryElevation from: /dspace/solr/search/c
2016-01-21 08:54:06,840 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:06,840 INFO org.apache.solr.handler.component.QueryElevationComponent @ Loading QueryElevation from: /dspace/solr/authorit
2016-01-21 08:54:06,841 INFO org.apache.solr.rest.ManagedResourceStorage @ Loaded LinkedHashMap at path _rest_managed.json using file:dir=/
2016-01-21 08:54:06,841 INFO org.apache.solr.rest.ManagedResource @ Loaded initArgs {} for /rest/managed
2016-01-21 08:54:06,841 INFO org.apache.solr.rest.RestManager @ Initializing 0 registered ManagedResources
2016-01-21 08:54:06,841 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:06,839 INFO org.apache.solr.handler.ReplicationHandler @ Commits will be reserved for 10000
2016-01-21 08:54:06,846 INFO org.apache.solr.core.SolrCore @ QuerySenderListener sending requests to Searcher@6c77e089[search] main{Standar
2016-01-21 08:54:06,851 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:06,851 INFO org.apache.solr.handler.component.SpellCheckComponent @ Initializing spell checkers
2016-01-21 08:54:07,112 INFO org.apache.solr.spelling.DirectSolrSpellChecker @ init: {name=default,field=id,classname=solr.DirectSolrSpellC
2016-01-21 08:54:07,112 INFO org.apache.solr.handler.component.SpellCheckComponent @ No queryConverter defined, using default converter
2016-01-21 08:54:07,112 INFO org.apache.solr.handler.component.QueryElevationComponent @ Loading QueryElevation from: /dspace/solr/statisti
2016-01-21 08:54:07,121 INFO org.apache.solr.core.CoreContainer @ registering core: authority
2016-01-21 08:54:07,121 INFO org.apache.solr.core.SolrCore @ QuerySenderListener sending requests to Searcher@2d1bd913[authority] main{Stan
2016-01-21 08:54:07,122 INFO org.apache.solr.core.SolrCore @ [authority] webapp=null path=null params={start=0&event=firstSearcher&q=solr+r
2016-01-21 08:54:07,128 INFO org.apache.solr.core.SolrCore @ [authority] webapp=null path=null params={event=firstSearcher&q=static+firstSe
2016-01-21 08:54:07,128 INFO org.apache.solr.core.SolrCore @ QuerySenderListener done.
2016-01-21 08:54:07,128 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:07,130 INFO org.apache.solr.core.SolrCore @ [authority] Registered new searcher Searcher@2d1bd913[authority] main{Standard
2016-01-21 08:54:07,198 INFO org.apache.solr.handler.ReplicationHandler @ Commits will be reserved for 10000
2016-01-21 08:54:07,203 INFO org.apache.solr.core.SolrCore @ QuerySenderListener sending requests to Searcher@730d91de[statistics] main{Sta
2016-01-21 08:54:07,207 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=null path=null params={event=firstSearcher&q=static+firstS
2016-01-21 08:54:07,207 INFO org.apache.solr.core.SolrCore @ QuerySenderListener done.
2016-01-21 08:54:07,207 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:07,208 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:07,208 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: wordbreak
2016-01-21 08:54:07,209 INFO org.apache.solr.core.SolrCore @ [statistics] Registered new searcher Searcher@730d91de[statistics] main{Standa
2016-01-21 08:54:07,218 INFO org.apache.solr.core.CoreContainer @ registering core: statistics
2016-01-21 08:54:07,218 WARN org.apache.solr.update.UpdateLog @ Starting log replay tlog{file=/dspace/solr/statistics/data/tlog/tlog.000000
2016-01-21 08:54:07,288 INFO org.apache.solr.update.UpdateHandler @ start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true
2016-01-21 08:54:07,379 INFO org.apache.solr.core.SolrCore @ [search] webapp=null path=null params={event=firstSearcher&q=static+firstSearc
2016-01-21 08:54:07,572 INFO org.apache.solr.core.SolrCore @ QuerySenderListener done.
2016-01-21 08:54:07,573 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:07,598 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: default
2016-01-21 08:54:07,598 INFO org.apache.solr.handler.component.SpellCheckComponent @ Loading spell index for spellchecker: wordbreak
2016-01-21 08:54:07,599 INFO org.apache.solr.core.SolrCore @ [search] Registered new searcher Searcher@6c77e089[search] main{StandardDirect
2016-01-21 08:54:07,610 INFO org.apache.solr.core.SolrCore @ SolrDeletionPolicy.onCommit: commits: num=2
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
commit{dir=NRTCachingDirectory(MMapDirectory@/dspace/solr/statistics/data/index lockFactory=NativeFSLockFactory@/dspace/solr/statistics/dat
2016-01-21 08:54:07,610 INFO org.apache.solr.core.SolrCore @ newest commit generation = 49344
2016-01-21 08:54:07,612 INFO org.apache.solr.core.CoreContainer @ registering core: search
2016-01-21 08:54:07,617 INFO org.apache.solr.search.SolrIndexSearcher @ Opening Searcher@151f8a5a[statistics] main
2016-01-21 08:54:07,618 INFO org.apache.solr.update.UpdateHandler @ end_commit_flush
2016-01-21 08:54:07,619 INFO org.apache.solr.core.SolrCore @ QuerySenderListener sending requests to Searcher@151f8a5a[statistics] main{Sta
2016-01-21 08:54:07,619 INFO org.apache.solr.core.SolrCore @ QuerySenderListener done.
2016-01-21 08:54:07,620 INFO org.apache.solr.core.SolrCore @ [statistics] Registered new searcher Searcher@151f8a5a[statistics] main{Standa
2016-01-21 08:54:07,627 INFO org.apache.solr.servlet.SolrDispatchFilter @ user.dir=/usr/share/tomcat
2016-01-21 08:54:07,627 INFO org.apache.solr.servlet.SolrDispatchFilter @ SolrDispatchFilter.init() done
2016-01-21 08:54:07,633 INFO org.apache.solr.update.processor.LogUpdateProcessor @ [statistics] {add=[9ea311a6-c9cc-475a-9f09-1cc163e5ec57
2016-01-21 08:54:07,633 WARN org.apache.solr.update.UpdateLog @ Log replay finished. recoveryInfo=RecoveryInfo{adds=8 deletes=0 deleteByQue
—
Monika Mevenkamp
Digital Repository Infrastructure Developer
Princeton University
Phone: 609-258-4161
Skype: mo-meven
Tim Donohue
Jan 21, 2016, 12:33:08 PM1/21/16
to dspac...@googlegroups.com
Hi Monika,
DSpace 5.5 doesn't exist, so I'm assuming you likely mean you are using the 5.x branch (which is essentially 5.4) :)
For this Solr bug:
https://jira.duraspace.org/browse/DS-2790
The result was often that Solr essentially "swallowed" its logs (or most of them). Without fixing it, Solr may not be giving you much info on what is going on. At least on my end, I found that Solr was logging very little to [dspace]/log/ until I cleaned up those duplicative log4j settings.
As for the Solr physical memory thing...at least based on this StackOverflow question, it sounds like it may not necessarily be of high concern (i.e. it *might* be a red herring):
http://stackoverflow.com/questions/22149296/solr-always-use-more-than-90-of-physical-memory
Though that being said, if your entire application is crashing (or hitting an OutOfMemory error), then it may be the memory allocated to DSpace in general. It's still unclear to me what you mean by "the system choked". Do you mean it becomes unresponsive? Does it actually "crash" (shutdown completely)? When it "chokes" are you seeing OutOfMemory errors in any of the logs under [dspace]/log/? Does the JVM do a memory dump?
I guess I'm trying to still narrow down if your problem definitely is Solr related, or if Solr just starts to choke because something else is grabbing all the available memory? Nothing in the logs you've passed along so far shows any actual ERROR messages being logged (which is odd). So, you might want to double check all your logs (DSpace, Solr, Tomcat, etc) to see if any error messages are appearing elsewhere that could provide additional clues. You also might want to look closer at DS-2790 just in case Solr is "swallowing" the actual errors and not logging them properly.
- Tim
DSpace 5.5 doesn't exist, so I'm assuming you likely mean you are using the 5.x branch (which is essentially 5.4) :)
For this Solr bug:
https://jira.duraspace.org/browse/DS-2790
The result was often that Solr essentially "swallowed" its logs (or most of them). Without fixing it, Solr may not be giving you much info on what is going on. At least on my end, I found that Solr was logging very little to [dspace]/log/ until I cleaned up those duplicative log4j settings.
As for the Solr physical memory thing...at least based on this StackOverflow question, it sounds like it may not necessarily be of high concern (i.e. it *might* be a red herring):
http://stackoverflow.com/questions/22149296/solr-always-use-more-than-90-of-physical-memory
Though that being said, if your entire application is crashing (or hitting an OutOfMemory error), then it may be the memory allocated to DSpace in general. It's still unclear to me what you mean by "the system choked". Do you mean it becomes unresponsive? Does it actually "crash" (shutdown completely)? When it "chokes" are you seeing OutOfMemory errors in any of the logs under [dspace]/log/? Does the JVM do a memory dump?
I guess I'm trying to still narrow down if your problem definitely is Solr related, or if Solr just starts to choke because something else is grabbing all the available memory? Nothing in the logs you've passed along so far shows any actual ERROR messages being logged (which is odd). So, you might want to double check all your logs (DSpace, Solr, Tomcat, etc) to see if any error messages are appearing elsewhere that could provide additional clues. You also might want to look closer at DS-2790 just in case Solr is "swallowing" the actual errors and not logging them properly.
- Tim
Reply all
Reply to author
Forward
0 new messages