Lily indexer logs pointing to wrong field in logs in case of Error

[Navjot Bhardwaj]

Using Lily Indexer [CDH 5.4.4]

In case a document fails I get an entry in logs but the entry points to wrong field name.

Using this morphline to index everything in Hbase to SOLR

morphlines : [

{

id : raw_morph

importCommands : ["com.cloudera.cdk.morphline.**", "com.ngdata.**"]

commands : [

  {

    extractHBaseCells {

      mappings : [

                {

          inputColumn : "data:*"

          outputField : "*"

          type : string

          source : value

        }

                  ]

          }

        }

]

}

]

Error Logs below:

Feb 9, 9:45:54.888 AM ERROR com.ngdata.hbaseindexer.indexer.DirectSolrInputDocumentWriter

Error updating Solr

org.apache.solr.client.solrj.impl.CloudSolrServer$RouteException: ERROR: [doc=696992281031811072] unknown field 'field12'

at org.apache.solr.client.solrj.impl.CloudSolrServer.directUpdate(CloudSolrServer.java:363)

at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:539)

at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)

at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)

at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)

at com.ngdata.hbaseindexer.indexer.DirectSolrInputDocumentWriter.retryAddsIndividually(DirectSolrInputDocumentWriter.java:123)

at com.ngdata.hbaseindexer.indexer.DirectSolrInputDocumentWriter.add(DirectSolrInputDocumentWriter.java:108)

at com.ngdata.hbaseindexer.indexer.Indexer.indexRowData(Indexer.java:156)

at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:99)

at com.ngdata.sep.impl.SepEventExecutor$1.run(SepEventExecutor.java:97)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

at java.util.concurrent.FutureTask.run(FutureTask.java:262)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: ERROR: [doc=696992281031811072] unknown field 'field12'

at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:621)

at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:229)

at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:225)

at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:345)

at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:306)

at org.apache.solr.client.solrj.impl.CloudSolrServer$1.call(CloudSolrServer.java:341)

at org.apache.solr.client.solrj.impl.CloudSolrServer$1.call(CloudSolrServer.java:338)

... 4 more

Please suggest what might be wrong here.

Thanks,

Navjot Bhardwaj

[Gabriel Reid]

Hi Navjot,

Could you give an example of the data that you're adding to HBase when
you encounter this, as well as the field name that you would expect
for the given data?

Thanks,

Gabriel

> --
> You received this message because you are subscribed to the Google Groups
> "HBase Indexer Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to hbase-indexer-u...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.