[Dspace-tech] [SPAM] DSpace 3.2 SOLR doesn't work with previous version index

[damanzano]

Hello i'm almost done migrating Dspace from 1.7.2 to 3.2.0 but i'm having
problems with the SOLR server, it simply doesnt work with the previous data
(from 1.7.2). When i left de index folder empy it works but when i put in
the index files from previous versions it ahow me an exception.

For test purposes I commented the localhost restriction and i get this
http://prntscr.com/1rp9g2 when i execute
http://localhost:8080/solr/statistics/select?q=*:*

I checked the index with with both lucene-core-2.9.3.jar and
lucene-core-3.5.0 and i got a "No problem were detected with this index"
result.

Here the check result:

java -cp <path to solr>/WEB-INF/lib/lucene-core-3.5.0.jar
-ea:org.apache.lucene... org.apache.lucene.index.CheckIndex
/dspace/solr/search/data/index

Opening index @ /dspace/solr/search/data/index

Segments file=segments_pyi numSegments=10 version=2.x
format=FORMAT_DIAGNOSTICS [Lucene 2.9]
1 of 10: name=_ged docCount=58973
compound=false
hasProx=true
numFiles=9
size (MB)=850.235
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.16.60-0.54.5-b igsmp, os=Linux,
mergeDocStores=true, lucene.version=2.9.3 951790 - 2010-06-06 0
1:30:55, source=merge, os.arch=i386, java.version=1.6.0_24, java.vendor=Sun
Micr osystems Inc.}
has deletions [delFileName=_ged_2xi.del]
test: open reader.........OK [38762 deleted docs]
test: fields..............OK [100 fields]
test: field norms.........OK [73 fields]
test: terms, freq, prox...OK [1165228 terms; 65623665 terms/docs pairs;
55583646 tokens]
test: stored fields.......OK [2816554 total field count; avg 139.357
fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

2 of 10: name=_hfb docCount=13137
compound=false
hasProx=true
numFiles=9
size (MB)=189.339
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.16.60-0.54.5-bigsmp, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=i386, java.version=1.6.0_24, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_hfb_12.del]
test: open reader.........OK [38 deleted docs]
test: fields..............OK [79 fields]
test: field norms.........OK [52 fields]
test: terms, freq, prox...OK [360654 terms; 14512992 terms/docs pairs;
36073449 tokens]
test: stored fields.......OK [1829050 total field count; avg 139.633
fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

3 of 10: name=_ie2 docCount=12676
compound=false
hasProx=true
numFiles=9
size (MB)=182.686
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.16.60-0.54.5-bigsmp, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=i386, java.version=1.6.0_24, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_ie2_l.del]
test: open reader.........OK [21 deleted docs]
test: fields..............OK [79 fields]
test: field norms.........OK [52 fields]
test: terms, freq, prox...OK [340943 terms; 13970993 terms/docs pairs;
34816148 tokens]
test: stored fields.......OK [1783668 total field count; avg 140.946
fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

4 of 10: name=_jdn docCount=10591
compound=false
hasProx=true
numFiles=9
size (MB)=190.793
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.16.60-0.54.5-bigsmp, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=i386, java.version=1.6.0_24, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_jdn_1.del]
test: open reader.........OK [1 deleted docs]
test: fields..............OK [78 fields]
test: field norms.........OK [51 fields]
test: terms, freq, prox...OK [294200 terms; 14297575 terms/docs pairs;
36267870 tokens]
test: stored fields.......OK [1539466 total field count; avg 145.37
fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

5 of 10: name=_rqi docCount=5239
compound=false
hasProx=true
numFiles=9
size (MB)=117.114
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.32.12-0.7-default, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=amd64, java.version=1.6.0_37, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_rqi_bl.del]
test: open reader.........OK [419 deleted docs]
test: fields..............OK [156 fields]
test: field norms.........OK [125 fields]
test: terms, freq, prox...OK [800140 terms; 10058845 terms/docs pairs;
25766723 tokens]
test: stored fields.......OK [639791 total field count; avg 132.737
fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

6 of 10: name=_sey docCount=340
compound=false
hasProx=true
numFiles=9
size (MB)=14.543
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.32.12-0.7-default, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=amd64, java.version=1.6.0_37, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_sey_h.del]
test: open reader.........OK [17 deleted docs]
test: fields..............OK [115 fields]
test: field norms.........OK [90 fields]
test: terms, freq, prox...OK [248265 terms; 1409738 terms/docs pairs;
4839904 tokens]
test: stored fields.......OK [41331 total field count; avg 127.96 fields
per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

7 of 10: name=_sh6 docCount=38
compound=false
hasProx=true
numFiles=8
size (MB)=1.658
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.32.12-0.7-default, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=amd64, java.version=1.6.0_37, java.vendor=Sun Microsystems Inc.}
no deletions
test: open reader.........OK
test: fields..............OK [102 fields]
test: field norms.........OK [77 fields]
test: terms, freq, prox...OK [50617 terms; 144769 terms/docs pairs;
475975 tokens]
test: stored fields.......OK [4866 total field count; avg 128.053 fields
per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

8 of 10: name=_skj docCount=51
compound=false
hasProx=true
numFiles=9
size (MB)=1.858
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.32.12-0.7-default, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=amd64, java.version=1.6.0_37, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_skj_b.del]
test: open reader.........OK [11 deleted docs]
test: fields..............OK [103 fields]
test: field norms.........OK [78 fields]
test: terms, freq, prox...OK [50203 terms; 159413 terms/docs pairs;
476410 tokens]
test: stored fields.......OK [4880 total field count; avg 122 fields per
doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

9 of 10: name=_sm8 docCount=35
compound=false
hasProx=true
numFiles=9
size (MB)=1.638
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.32.12-0.7-default, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=amd64, java.version=1.6.0_37, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_sm8_1.del]
test: open reader.........OK [1 deleted docs]
test: fields..............OK [94 fields]
test: field norms.........OK [69 fields]
test: terms, freq, prox...OK [48233 terms; 137808 terms/docs pairs;
443432 tokens]
test: stored fields.......OK [4482 total field count; avg 131.824 fields
per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

10 of 10: name=_spb docCount=43
compound=false
hasProx=true
numFiles=9
size (MB)=0.97
diagnostics = {optimize=false, mergeFactor=10,
os.version=2.6.32.12-0.7-default, os=Linux, mergeDocStores=true,
lucene.version=2.9.3 951790 - 2010-06-06 01:30:55, source=merge,
os.arch=amd64, java.version=1.6.0_37, java.vendor=Sun Microsystems Inc.}
has deletions [delFileName=_spb_1.del]
test: open reader.........OK [1 deleted docs]
test: fields..............OK [108 fields]
test: field norms.........OK [81 fields]
test: terms, freq, prox...OK [30154 terms; 72346 terms/docs pairs;
255949 tokens]
test: stored fields.......OK [4064 total field count; avg 96.762 fields
per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

No problems were detected with this index.


Full exception

Estado HTTP 500 - Severe errors in solr configuration. Check your log files
for more detailed information on what may be wrong. If you want solr to
continue after configuration errors, change:
<abortOnConfigurationError>false</abortOnConfigurationError> in solr.xml
-------------------------------------------------------------
java.lang.RuntimeException: java.io.IOException: Map failed at
org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1103) at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:587) at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:463) at
org.apache.solr.core.CoreContainer.load(CoreContainer.java:316) at
org.apache.solr.core.CoreContainer.load(CoreContainer.java:207) at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
at
org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:115)
at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4072)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4726)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601) at
org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1079)
at
org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:1002)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:506) at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317) at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1065) at
org.apache.catalina.core.StandardHost.start(StandardHost.java:840) at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1057) at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) at
org.apache.catalina.core.StandardService.start(StandardService.java:525) at
org.apache.catalina.core.StandardServer.start(StandardServer.java:754) at
org.apache.catalina.startup.Catalina.start(Catalina.java:595) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597) at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) Caused by:
java.io.IOException: Map failed at
sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:748) at
org.apache.lucene.store.MMapDirectory$MMapIndexInput.<init>(MMapDirectory.java:265)
at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:216)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:131) at
org.apache.lucene.index.SegmentCoreReaders.openDocStores(SegmentCoreReaders.java:212)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:117) at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:93) at
org.apache.lucene.index.DirectoryReader.<init>(DirectoryReader.java:113) at
org.apache.lucene.index.ReadOnlyDirectoryReader.<init>(ReadOnlyDirectoryReader.java:29)
at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:81)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:754)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:75) at
org.apache.lucene.index.IndexReader.open(IndexReader.java:462) at
org.apache.lucene.index.IndexReader.open(IndexReader.java:405) at
org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1092) ... 33 more
Caused by: java.lang.OutOfMemoryError: Map failed at
sun.nio.ch.FileChannelImpl.map0(Native Method) at
sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:745) ... 48 more
-------------------------------------------------------------
java.lang.RuntimeException: java.io.FileNotFoundException:
/home/dspace/bibdigital/solr/statistics/data/index/_182g.fnm (No such file
or directory) at
org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1103) at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:587) at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:463) at
org.apache.solr.core.CoreContainer.load(CoreContainer.java:316) at
org.apache.solr.core.CoreContainer.load(CoreContainer.java:207) at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
at
org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:115)
at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4072)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4726)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601) at
org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1079)
at
org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:1002)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:506) at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317) at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1065) at
org.apache.catalina.core.StandardHost.start(StandardHost.java:840) at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1057) at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) at
org.apache.catalina.core.StandardService.start(StandardService.java:525) at
org.apache.catalina.core.StandardServer.start(StandardServer.java:754) at
org.apache.catalina.startup.Catalina.start(Catalina.java:595) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597) at
org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at
org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) Caused by:
java.io.FileNotFoundException:
/home/dspace/bibdigital/solr/statistics/data/index/_182g.fnm (No such file
or directory) at java.io.RandomAccessFile.open(Native Method) at
java.io.RandomAccessFile.<init>(RandomAccessFile.java:216) at
org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:214) at
org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) at
org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:74) at
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:73)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:115) at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:93) at
org.apache.lucene.index.DirectoryReader.<init>(DirectoryReader.java:113) at
org.apache.lucene.index.ReadOnlyDirectoryReader.<init>(ReadOnlyDirectoryReader.java:29)
at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:81)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:754)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:75) at
org.apache.lucene.index.IndexReader.open(IndexReader.java:462) at
org.apache.lucene.index.IndexReader.open(IndexReader.java:405) at
org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1092) ... 33 more



--
View this message in context: http://dspace.2283337.n4.nabble.com/DSpace-3-2-SOLR-doesn-t-work-with-previous-version-index-tp4667313.html
Sent from the DSpace - Tech mailing list archive at Nabble.com.

[helix84]

On Mon, Sep 16, 2013 at 10:25 PM, damanzano <dama...@icesi.edu.co> wrote:
> java.lang.RuntimeException: java.io.FileNotFoundException:
> /home/dspace/bibdigital/solr/statistics/data/index/_182g.fnm (No such file
> or directory) at

Hi damanzano,

here's your error. That file is missing. Was Tomcat stopped while you
copied the index data from the old instance?


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[damanzano]

Hi Helix thanks for your advise,

The index back up was done with the tomcat down, but in fact my solr
statistic core index was broken. I repair it using the lucene CheckIndex
utility with the -fix option but noe i'm getting and
java.lang.outOfMemoryException the complete stack trace is at the end of
this post. Our repository has around 67700 items, what should be the ideal
memory allocation for an dspace instance in order to get SOLR working fine?

--
View this message in context: http://dspace.2283337.n4.nabble.com/DSpace-3-2-SOLR-doesn-t-work-with-previous-version-index-tp4667313p4667333.html

[helix84]

On Tue, Sep 17, 2013 at 4:20 PM, damanzano <dama...@icesi.edu.co> wrote:
> The index back up was done with the tomcat down, but in fact my solr
> statistic core index was broken. I repair it using the lucene CheckIndex
> utility with the -fix option but noe i'm getting and
> java.lang.outOfMemoryException the complete stack trace is at the end of
> this post. Our repository has around 67700 items, what should be the ideal
> memory allocation for an dspace instance in order to get SOLR working fine?

See:

https://wiki.duraspace.org/display/DSDOC3x/Performance+Tuning+DSpace

http://wiki.apache.org/solr/SolrPerformanceFactors#OutOfMemoryErrors

[helix84]

You can unsubscribe here:

https://lists.sourceforge.net/lists/listinfo/dspace-tech

[damanzano]

Hi helix,

I change the memory profile in the
CATALINA_OPTS=-Xmx2048m -Xms512m and JAVA_OPTS=-Xmx2048m -Xms512m but i'm
still having the following exception initiating the solr app, some other
thing i should have in mind?

GRAVE: java.lang.RuntimeException: java.io.IOException: Map failed

at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1103)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:587)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:463)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:316)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:207)
at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94)
at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:295)
at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:422)
at
org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:115)
at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4072)
at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4726)
at

org.apache.catalina.manager.ManagerServlet.start(ManagerServlet.java:1276)
at
org.apache.catalina.manager.HTMLManagerServlet.start(HTMLManagerServlet.java:625)
at
org.apache.catalina.manager.HTMLManagerServlet.doGet(HTMLManagerServlet.java:136)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.filters.CsrfPreventionFilter.doFilter(CsrfPreventionFilter.java:186)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:563)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:662)

Caused by: java.io.IOException: Map failed
at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:748)
at
org.apache.lucene.store.MMapDirectory$MMapIndexInput.<init>(MMapDirectory.java:265)
at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:216)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:131)
at
org.apache.lucene.index.SegmentCoreReaders.openDocStores(SegmentCoreReaders.java:212)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:117)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:93)
at org.apache.lucene.index.DirectoryReader.<init>(DirectoryReader.java:113)
at
org.apache.lucene.index.ReadOnlyDirectoryReader.<init>(ReadOnlyDirectoryReader.java:29)
at
org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:81)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:754)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:75)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:462)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:405)
at
org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1092)

... 32 more

Caused by: java.lang.OutOfMemoryError: Map failed
at sun.nio.ch.FileChannelImpl.map0(Native Method)
at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:745)

... 47 more



--
View this message in context: http://dspace.2283337.n4.nabble.com/DSpace-3-2-SOLR-doesn-t-work-with-previous-version-index-tp4667313p4667380.html

[helix84]

Are you testing this with all of the indexes or just one of them
(search, statistics, oai)? Try one index at a time. Especially the
"statistics" core could get very large. What are the sizes of your
indexes?

Try to force solr.NIOFSDirectoryFactory on the following line for the
core that's causing problems (or for all cores) and see if it helps.
solrconfig for the "search" core is here:

https://github.com/DSpace/DSpace/blob/dspace-3.2/dspace/solr/search/conf/solrconfig.xml#L102

[damanzano]

Hi Helix,

thank you very much for your help!

Forcing the solr directory factory to NIOFS on each core solves the problem.
To answer your question, if it is useful for you, the size of our search
index is 1.5Gb and the statistics index is 7.64Gb





--
View this message in context: http://dspace.2283337.n4.nabble.com/DSpace-3-2-SOLR-doesn-t-work-with-previous-version-index-tp4667313p4667481.html