Concurrent merge failed, ErrorLoggingConcurrentMergeScheduler

[maria abreu]

I am getting this warning every few seconds 

Message

Concurrent merge failed

Exception

Lucene.Net.Index.MergePolicy+MergeException: Exception of type 'Lucene.Net.Index.MergePolicy+MergeException' was thrown. ---> Lucene.Net.Index.CorruptIndexException: docs out of order (0 <= 0 )

   at Lucene.Net.Index.IndexWriter.HandleMergeException(Exception t, OneMerge merge)

   at Lucene.Net.Index.IndexWriter.Merge(OneMerge merge)

   at Lucene.Net.Index.ConcurrentMergeScheduler.MergeThread.Run()

   --- End of inner exception stack trace ---

   at Lucene.Net.Index.ConcurrentMergeScheduler.HandleMergeException(Exception exc)

   at Raven.Database.Indexing.ErrorLoggingConcurrentMergeScheduler.HandleMergeException(Exception exc) in C:\Builds\RavenDB-Stable-3.5\Raven.Database\Indexing\ErrorLoggingConcurrentMergeScheduler.cs:line 15

Logged

a minute ago (01/09/18, 2:13pm)

Level

Warn

Logger

Raven.Database.Indexing.ErrorLoggingConcurrentMergeScheduler

- We are using RavenDB-Build-35215, can someone please tell me what does the warning mean, how is affecting the server and how to fix it ?

[Oren Eini (Ayende Rahien)]

Try reset the index, it should fix this issue

Hibernating Rhinos Ltd  

Oren Eini l CEO l Mobile: + 972-52-548-6969

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

 

--
You received this message because you are subscribed to the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[maria abreu]

The logs don't show me the database or the index and I enable admin logging to get more info and this is what I got.

  {

    "Level": "Warn",

    "Database": null,

    "TimeStamp": "2018-01-11T02:23:21.8103973Z",

    "Message": "Concurrent merge failed",

    "LoggerName": "Raven.Database.Indexing.ErrorLoggingConcurrentMergeScheduler",

    "Exception": "Lucene.Net.Index.MergePolicy+MergeException: Exception of type 'Lucene.Net.Index.MergePolicy+MergeException' was thrown. ---> Lucene.Net.Index.CorruptIndexException: docs out of order (0 <= 0 )\r\n   at Lucene.Net.Index.IndexWriter.HandleMergeException(Exception t, OneMerge merge)\r\n   at Lucene.Net.Index.IndexWriter.Merge(OneMerge merge)\r\n   at Lucene.Net.Index.ConcurrentMergeScheduler.MergeThread.Run()\r\n   --- End of inner exception stack trace ---\r\n   at Lucene.Net.Index.ConcurrentMergeScheduler.HandleMergeException(Exception exc)\r\n   at Raven.Database.Indexing.ErrorLoggingConcurrentMergeScheduler.HandleMergeException(Exception exc) in C:\\Builds\\RavenDB-Stable-3.5\\Raven.Database\\Indexing\\ErrorLoggingConcurrentMergeScheduler.cs:line 15",

    "StackTrace": "   at Raven.Database.Server.Connections.AdminLogsConnectionState.Send(LogEventInfo logEvent)\r\n   at Raven.Database.Server.Connections.AdminLogsTarget.Write(LogEventInfo logEvent)\r\n   at Raven.Abstractions.Logging.LoggerExecutionWrapper.Log[TException](LogLevel logLevel, Func`1 messageFunc, TException exception)\r\n   at Raven.Database.Indexing.ErrorLoggingConcurrentMergeScheduler.HandleMergeException(Exception exc)\r\n   at Lucene.Net.Index.ConcurrentMergeScheduler.MergeThread.Run()\r\n   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)\r\n   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)\r\n   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)\r\n   at System.Threading.ThreadHelper.ThreadStart()\r\n"

To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+u...@googlegroups.com.

[Oren Eini (Ayende Rahien)]

How many indexes do you have?

To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.

[maria abreu]

191 databases each with 32 indexes, 1 database with 17 indexes, and 13 databases each with 4 indexes.

[Tal Weiss]

i'm checking what is the best approach to locate the faulty index.

To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Hibernating Rhinos Ltd  

Tal Weiss l Core Team Developer l Mobile:+972-54-802-4849

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811l Skype: talweiss1982

RavenDB paving the way to "Data Made Simple" http://ravendb.net/ 

[Tal Weiss]

Can you check in the studio if any of your databases are showing stale indexes under Status->State->Stale Indexes

And then out of those indexes check per database if there is an index that is lagging behind the others in term of its Last indexed Etag (in the bottom of the stats there is a list of index stats).

I would expect the erroring index to have much smaller Last indexed Etag compare to its sibling stale indexes.