RavenDB 4 - NRE after upgrade to latest nightly

38 views

Skip to first unread message

Andrej Krivulčík

unread,

Nov 15, 2017, 10:42:55 AM11/15/17

to RavenDB - 2nd generation document database

After upgrading from Build 40, Version 4.0, SemVer 4.0.0-nightly-20171106-0501, Commit f3d54f9 to Build 40, Version 4.0, SemVer 4.0.0-nightly-20171115-0501, Commit 0b091da, I get the exception below on one of my databases (the production one, data-prod). I suspect it's related to the checks done as a result of this issue [ https://groups.google.com/forum/#!topic/ravendb/5y2C5fdJq-c ]. However, the VoronUnrecoverableErrorException masks the location where the original error occurred.

Since sending the database to the support for investigation for the earlier issue, I recovered it (as per Maxim's instructions) and it ran for some time, there were imports running, data manipulation so quite a lot of data manipulation. I have one other database, holding around 1 % of the data of the production database and this database started up correctly.

Nothing relevant in the logs (with "Logs.Mode": "Information").

Any thoughts about how to make the database work?

Exception:

Raven.Client.Exceptions.Database.DatabaseLoadFailureException: Failed to start database data-prod

At D:\Raven\Databases\data-prod ---> Voron.Exceptions.VoronUnrecoverableErrorException: Object reference not set to an instance of an object.

at Voron.Exceptions.VoronUnrecoverableErrorException.Raise(StorageEnvironment env, String message) in C:\Builds\RavenDB-4.0-Nightly\src\Voron\Exceptions\VoronUnrecoverableErrorException.cs:line 23

at Voron.StorageEnvironment.UpgradeSchemaIfRequired() in C:\Builds\RavenDB-4.0-Nightly\src\Voron\StorageEnvironment.cs:line 350

at Voron.StorageEnvironment.LoadExistingDatabase() in C:\Builds\RavenDB-4.0-Nightly\src\Voron\StorageEnvironment.cs:line 313

at Voron.StorageEnvironment..ctor(StorageEnvironmentOptions options) in C:\Builds\RavenDB-4.0-Nightly\src\Voron\StorageEnvironment.cs:line 145

at Raven.Server.Documents.DocumentsStorage.Initialize(StorageEnvironmentOptions options) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Documents\DocumentsStorage.cs:line 308

at Raven.Server.Documents.DocumentsStorage.Initialize(Boolean generateNewDatabaseId) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Documents\DocumentsStorage.cs:line 236

at Raven.Server.Documents.DocumentDatabase.Initialize(InitializeOptions options) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Documents\DocumentDatabase.cs:line 264

at Raven.Server.Documents.DatabasesLandlord.CreateDocumentsStorage(StringSegment databaseName, RavenConfiguration config) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Documents\DatabasesLandlord.cs:line 480

--- End of inner exception stack trace ---

at Raven.Server.Documents.DatabasesLandlord.ActuallyCreateDatabase(StringSegment databaseName, RavenConfiguration config) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Documents\DatabasesLandlord.cs:line 454

at Raven.Server.Documents.DatabasesLandlord.<>c__DisplayClass27_0.<CreateDatabaseUnderResourceSemaphore>b__0() in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Documents\DatabasesLandlord.cs:line 406

at System.Threading.Tasks.Task`1.InnerInvoke()

at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)

at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)

--- End of stack trace from previous location where exception was thrown ---

at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

at Raven.Server.Routing.RouteInformation.<UnlikelyWaitForDatabaseToLoad>d__14.MoveNext() in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Routing\RouteInformation.cs:line 111

--- End of stack trace from previous location where exception was thrown ---

at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

at Raven.Server.Routing.RouteInformation.<WaitForDb>d__18.MoveNext() in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Routing\RouteInformation.cs:line 144

--- End of stack trace from previous location where exception was thrown ---

at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

at Raven.Server.Routing.RequestRouter.<HandlePath>d__5.MoveNext() in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Routing\RequestRouter.cs:line 73

--- End of stack trace from previous location where exception was thrown ---

at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()

at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()

at Raven.Server.RavenServerStartup.<RequestHandler>d__11.MoveNext() in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\RavenServerStartup.cs:line 159

Grisha Kotler

unread,

Nov 15, 2017, 12:06:08 PM11/15/17

to rav...@googlegroups.com

Hi Andrej,

Please try using the newest build: 4.0.0-nightly-20171115-1607

This will provide a better error.

Hibernating Rhinos Ltd cid:image001.png@01CF95E2.8ED1B7D0

Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

RavenDB paving the way to "Data Made Simple" http://ravendb.net/

--
You received this message because you are subscribed to the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Andrej Krivulčík

unread,

Nov 15, 2017, 2:57:34 PM11/15/17

to RavenDB - 2nd generation document database

Thanks Grisha for the fix and build.

The new exception suggests that either step or step.DocumentsStorage is null here: https://github.com/ravendb/ravendb/blob/v4.0/src/Raven.Server/Storage/Schema/Updates/Documents/From13.cs .

The takeaway for me is that my database is corrupted in the same way as before and I'll need to recover it again.

It will probably take the better part of this night and I'll import it to a new database tomorrow. If it would be useful for you to test fixed error reporting on it, I can try it but I'll need to delete the old database before importing it tomorrow because of disk space.

Raven.Client.Exceptions.Database.DatabaseLoadFailureException: Failed to start database data-prod

At D:\Raven\Databases\data-prod ---> Voron.Exceptions.VoronUnrecoverableErrorException: Object reference not set to an instance of an object. ---> System.NullReferenceException: Object reference not set to an instance of an object.

at Voron.Exceptions.VoronUnrecoverableErrorException.Raise(StorageEnvironment env, String message, Exception inner) in C:\Builds\RavenDB-4.0-Nightly\src\Voron\Exceptions\VoronUnrecoverableErrorException.cs:line 48

at Raven.Server.Storage.Schema.Updates.Documents.From13.Update(UpdateStep step) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Storage\Schema\Updates\Documents\From13.cs:line 41

at Raven.Server.Storage.Schema.SchemaUpgrader.InternalUpgrader.Upgrade(Transaction readTx, Transaction writeTx, Int32 currentVersion, Int32& versionAfterUpgrade) in C:\Builds\RavenDB-4.0-Nightly\src\Raven.Server\Storage\Schema\SchemaUpgrader.cs:line 87

at Voron.StorageEnvironment.UpgradeSchema(Int32 schemaVersionVal, UpgraderDelegate upgrader) in C:\Builds\RavenDB-4.0-Nightly\src\Voron\StorageEnvironment.cs:line 366

at Voron.StorageEnvironment.UpgradeSchemaIfRequired() in C:\Builds\RavenDB-4.0-Nightly\src\Voron\StorageEnvironment.cs:line 344