Problem with curl -X POST http://localhost:8983/solr/jateCore/termRecogniser

[Mika Naumanen]

Hello,

For some reason I cannot get the curl command running. The error message is as follows:

<response>

<lst name="responseHeader"><int name="status">500</int><int name="QTime">1</int></lst><lst name="error"><str name="msg">Error while creating field 'jate_cterms{type=jate_text_2_terms,properties=indexed,tokenized,termVectors}' from value 'null'</str><str name="trace">org.apache.solr.common.SolrException: Error while creating field 'jate_cterms{type=jate_text_2_terms,properties=indexed,tokenized,termVectors}' from value 'null'

at org.apache.solr.schema.FieldType.createField(FieldType.java:263)

at org.apache.solr.schema.SchemaField.createField(SchemaField.java:114)

at uk.ac.shef.dcs.jate.util.SolrUtil.copyFields(SolrUtil.java:53)

....

I am using Cygwin64 at Windows 7. Any ideas?

Best wishes, Mika

[Jie Gao]

Hi, Mika,

This errors happens in plugin mode when you want to re-extract and re-index candidate terms for your existing index (i.e., 'extraction' is set to true in the request handler). This needs to copy text into 'jate_cterms' fields in order to extract and index candidate terms, which is done automatically in the term recognition request handler. Note that the 'jate_cterms' field name is not fixed. The request handler is simply to pick up any copy

First, you need to make sure you are using latest version of jate. Then, you need to check whether you have schema configured properly. It may happen you don't have any document indexed in Solr or document is not indexed properly.

To check whether your content is indexed properly, you can have a check in Solr console http://localhost:8983/solr/#/jateCore/query, for example.

If everything looks fine, you can try to clean your index and re-index your corpus. You can use Solr POST tool, for example.

We have a sample setting of plugin mode in github.

If you have further problems, please attach your schema & solrconfig.xml setting. Also, please let us know which version of Solr you are using.

Please feel free to ask if you have any problem.

Thanks for your interests in JATE2.

Jerry

[Mika Naumanen]

Thanks, cleaning the index solved the problem. Now, I am running out of memory but keep on studying the topic :)

Mika

 

[lotu...@gmail.com]

Hello i m also trying to run the cmd 

curl -X POST http://localhost:8983/solr/jateCore/termRecogniser

 

 

but i get this message on my terminal

Sonja@Sonja MINGW64 ~/jateSolrPluginDemo-master

$ curl -X POST http://localhost:8983/solr/jateCore/termRecogniser

{

  "responseHeader":{

    "status":500,

    "QTime":13342},

  "error":{

    "msg":"this IndexReader is closed",

    "trace":"org.apache.lucene.store.AlreadyClosedException: this IndexReader is closed\r\n\tat org.apache.lucene.index.IndexReader.ensureOpen(IndexReader.java:268)\r\n\tat org.apache.lucene.index.StandardDirectoryReader.getIndexCommit(StandardDirectoryReader.java:401)\r\n\tat org.apache.lucene.index.FilterDirectoryReader.getIndexCommit(FilterDirectoryReader.java:129)\r\n\tat org.apache.lucene.index.FilterDirectoryReader.getIndexCommit(FilterDirectoryReader.java:129)\r\n\tat org.apache.solr.search.SolrIndexSearcher.close(SolrIndexSearcher.java:478)\r\n\tat uk.ac.shef.dcs.jate.solr.TermRecognitionRequestHandler.handleRequestBody(TermRecognitionRequestHandler.java:250)\r\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\r\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2503)\r\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)\r\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)\r\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\r\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\r\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1751)\r\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\r\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\r\n\tat org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\r\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\r\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\r\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\r\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\r\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\r\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\r\n\tat org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\r\n\tat org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\r\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\r\n\tat org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\r\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\r\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\r\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\r\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\r\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\r\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\r\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\r\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\r\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\r\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\r\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\r\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\r\n\tat java.lang.Thread.run(Thread.java:748)\r\n",

    "code":500}}

I m using jate-2.0-beta.11 Solr-7.2.1  and this is my file solrconfig.xmk only the part for termRecogniser ... 

   <requestHandler name="/termRecogniser" class="uk.ac.shef.dcs.jate.solr.TermRecognitionRequestHandler">

    <lst name="defaults">

     <str name="algorithm">TTF-IDF</str>

     <bool name="extraction">true</bool>

<bool name="indexTerm">true</bool>

<bool name="boosting">true</bool>

     <str name="-o">../TFIDF-terms-plus.json</str>

     </lst>

    </requestHandler>