Production RavenDB 3690 not starting after upgrade

[Morten Brix Pedersen]

Last night we wanted to upgrade our production RavenDB from 3.0.3660 to 3.0.3690. Unfortunately, even though RavenDB service started, it did not respond to any requests. And this appeared in the event log:

"Startup for RavenDB service seems to be taking longer than usual, moving initialization to a background thread"

We waited a while (15 minutes), but the process seemed to idle. We tried adding debug logging, but nothing of interest showed up.

So we downgraded to 3660 again, and the database server started immediately and without problems.

We had previously done this on our development/test server, without problems.

Today we tried taking our database backup from production and spin up a 3690 build locally. This worked flawlessly, so we are very much in the blind on how to debug our production issue? Any hints?

 - Morten.

[Oren Eini (Ayende Rahien)]

Can you enable the debug log.? Or run in console mode?

--
You received this message because you are subscribed to the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Morten Brix Pedersen]

Hello Ayende,

We enabled debug logging, and you can find the output here: https://gist.github.com/mbp/9a2cad84d552fc009f81

We can try running it in console mode the next time we will plan a maintenance window for our systems, but since it is production, I cannot do it right now.

 - Morten.

[Oren Eini (Ayende Rahien)]

This is on the new version that didn't start?

Hibernating Rhinos Ltd  

Oren Eini l CEO l Mobile: + 972-52-548-6969

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

 

[Morten Brix Pedersen]

Yes. It seemed to only load the system database but not the others.

[Oren Eini (Ayende Rahien)]

Did you _access_ any of the other databases?

If they aren't access, they aren't loaded.

[Morten Brix Pedersen]

The web interface never started responding. So I could not send requests to any of the databases.

[Oren Eini (Ayende Rahien)]

Okay, so that is something else.

Do you have a local.config there? 

[Morten Brix Pedersen]

We have "Raven.Server.exe.config" with the following content:

<?xml version="1.0" encoding="utf-8"?>

<configuration>

  <appSettings>

    <add key="Raven/Port" value="8080"/>

    <add key="Raven/DataDir" value="~\Database\System"/>

    <add key="Raven/AnonymousAccess" value="Admin"/>

    <add key="Raven/Licensing/AllowAdminAnonymousAccessForCommercialUse" value="true"/>

  <add key="Raven/LicensePath" value="XXXX.xml"/></appSettings>

<runtime>

<loadFromRemoteSources enabled="true"/>

<assemblyBinding xmlns="urn:schemas-microsoft-com:asm.v1">

<probing privatePath="Analyzers;Plugins"/>

</assemblyBinding>

</runtime>

</configuration>

[Oren Eini (Ayende Rahien)]

Try copying the db, then running it with the 3690 in console mode.