RC stops responding

[marcus]

I'm using the Docker version of RavenDB RC 4 but after a while this happens.

       _____                       _____  ____ 

      |  __ \                     |  __ \|  _ \ 

      | |__) |__ ___   _____ _ __ | |  | | |_) |

      |  _  // _` \ \ / / _ \ '_ \| |  | |  _ < 

      | | \ \ (_| |\ V /  __/ | | | |__| | |_) |

      |_|  \_\__,_| \_/ \___|_| |_|_____/|____/ 

      Safe by default, optimized for efficiency

 Build 40019, Version 4.0, SemVer 4.0.0-rc-40019, Commit 20e7fb1

 PID 9, 64 bits, 4 Cores, Phys Mem 1.952 GBytes, Arch: X64

 Source Code (git repo): https://github.com/ravendb/ravendb

 Built with love by Hibernating Rhinos and awesome contributors!

+---------------------------------------------------------------+

Server ID is 2ca51cb5-2fda-47d3-aa4e-2f7af0db7f1a.

Using GC in server concurrent mode retaining memory from the OS.

Node A in cluster 1cafd7cd-22a8-4e54-aff3-f2d4c06043f8

Server available on: http://localhost:8080

Tcp listening on 0.0.0.0:38888

Server started, listening to requests...

Running as Service

Will try to connect to discovered Raven.Server process : 9...

?1h=Connected to RavenDB server. Tailing logs...

2017-09-17T20:24:22.2522186Z, 31, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, In rehabilitation because the last report status was "Timeout", 

2017-09-17T20:24:22.9866008Z, 46, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:23.4642835Z, 34, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:24.1133282Z, 41, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:24.5199300Z, 34, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:24.9426159Z, 31, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:25.4557357Z, 31, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:25.9446653Z, 44, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:26.4287056Z, 42, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:26.8888936Z, 46, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, the database is not reachable, 

2017-09-17T20:24:27.3735491Z, 44, Operations, A, Raven.Server.ServerWide.Maintenance.ClusterObserver, It appears that all nodes of the canvas database are not responding to the supervisor, promoting A from rehab to avoid making the database completely unreachable, 

Any idea what's going on?

[Oren Eini (Ayende Rahien)]

Can you enable the debug log and see what it says?

Hibernating Rhinos Ltd  

Oren Eini l CEO l Mobile: + 972-52-548-6969

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

 

--
You received this message because you are subscribed to the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Grzegorz Lachowski]

Marcus,

Server inside the container should be bound to 0.0.0.0, yet yours is bound to localhost:8080 for some reason. Can you tell us how did you manage to bind to localhost:8080? Can you paste your full docker run command please?

To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+u...@googlegroups.com.

[marcus]

I'm running Docker for Mac and this is what my environment variables look like. I have set the public server url to localhost:8080 my self because otherwise the studio was inaccessible.

[Oren Eini (Ayende Rahien)]

Why would it be inaccessible otherwise?

To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.

[marcus]

Not sure, I might be wrong. If I clear the public server url, should the studio be accessible anyways?

[Oren Eini (Ayende Rahien)]

yes

To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+unsubscribe@googlegroups.com.

[Grzegorz Lachowski]

OK so it's not bound to it after all.

I believe Docker for Mac works in a similar way to Docker for Windows - using a VM if the image is not native to the platform. I think you'd need to leave PublicServerUrl empty and try using docker machines's VM's address to access it. On Windows when running Ubuntu image it usually is 10.0.75.2, not sure how it works on Mac though.

You received this message because you are subscribed to a topic in the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ravendb/lkJsHnCT7cI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ravendb+u...@googlegroups.com.

[marcus]

If I leave the PublicServerUrl empty I get this exception.

fail: Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddleware[0]

      An unhandled exception has occurred while executing the request

Raven.Client.Exceptions.AllTopologyNodesDownException: Tried to send 'QueryCommand' request via `POST /databases/canvas/queries?query-hash=839256870694480133` to all configured nodes in the topology, all of them seem to be down or not responding. I've tried to access the following nodes: http://931eb8b110fb:8080 ---> System.Net.Http.HttpRequestException: An error occurred while sending the request. ---> System.Net.Http.CurlException: Couldn't resolve host name

   at System.Net.Http.CurlHandler.ThrowIfCURLEError(CURLcode error)

   at System.Net.Http.CurlHandler.MultiAgent.FinishRequest(StrongToWeakReference`1 easyWrapper, CURLcode messageResult)

   --- End of inner exception stack trace ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()

   at System.Net.Http.HttpClient.<FinishSendAsync>d__58.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Raven.Client.Http.RequestExecutor.<ExecuteAsync>d__65`1.MoveNext()

   --- End of inner exception stack trace ---

   at Raven.Client.Http.RequestExecutor.ThrowFailedToContactAllNodes[TResult](RavenCommand`1 command, HttpRequestMessage request, Exception e, Exception timeoutException)

   at Raven.Client.Http.RequestExecutor.<ExecuteAsync>d__65`1.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Raven.Client.Documents.Session.AsyncDocumentQuery`1.<ExecuteActualQueryAsync>d__108.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Raven.Client.Documents.Session.AsyncDocumentQuery`1.<InitAsync>d__107.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Raven.Client.Documents.Session.AsyncDocumentQuery`1.<ToListAsync>d__97.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()

   at Aperture.Controllers.FileController.<Get>d__8.MoveNext() in /Users/maqe/temp/canvas/web/src/Controllers/FileController.cs:line 34

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Mvc.Internal.ObjectMethodExecutor.<CastToObject>d__40`1.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.<InvokeActionMethodAsync>d__27.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.<InvokeNextActionFilterAsync>d__25.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.Rethrow(ActionExecutedContext context)

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.<InvokeNextResourceFilter>d__22.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.Rethrow(ResourceExecutedContext context)

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)

   at Microsoft.AspNetCore.Mvc.Internal.ControllerActionInvoker.<InvokeAsync>d__20.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Builder.RouterMiddleware.<Invoke>d__4.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Session.SessionMiddleware.<Invoke>d__9.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at Microsoft.AspNetCore.Session.SessionMiddleware.<Invoke>d__9.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Builder.Extensions.MapMiddleware.<Invoke>d__3.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddleware.<Invoke>d__7.MoveNext()

This is the containers startup log

       _____                       _____  ____ 

      |  __ \                     |  __ \|  _ \ 

      | |__) |__ ___   _____ _ __ | |  | | |_) |

      |  _  // _` \ \ / / _ \ '_ \| |  | |  _ < 

      | | \ \ (_| |\ V /  __/ | | | |__| | |_) |

      |_|  \_\__,_| \_/ \___|_| |_|_____/|____/ 

      Safe by default, optimized for efficiency

 Build 40019, Version 4.0, SemVer 4.0.0-rc-40019, Commit 20e7fb1

 PID 9, 64 bits, 4 Cores, Phys Mem 1.952 GBytes, Arch: X64

 Source Code (git repo): https://github.com/ravendb/ravendb

 Built with love by Hibernating Rhinos and awesome contributors!

+---------------------------------------------------------------+

Will try to connect to discovered Raven.Server process : 9...

?1h=Connected to RavenDB server. Tailing logs...

Server ID is fb87636f-2c9b-4f3e-bd17-0a12cb151bf1.

Using GC in server concurrent mode retaining memory from the OS.

Node A in cluster 2afab852-b31d-4813-8d9b-636f51409660

Server available on: http://931eb8b110fb:8080

Tcp listening on 0.0.0.0:38888

Server started, listening to requests...

Running as Service

The studio is accessibel via http://localhost:8080 but it complains about the license. I registered and added a free license but it still complains with this screen.

[marcus]

When I use the powershell script you provide and start ravendb using the command below it works both on Linux Ubuntu and on Mac. What is the equivalent command for starting the conatiner manually without powershell?

./run-ravendb.ps1 -AuthenticationDisabled -PublicServerUrl "http://localhost:8080"

Den måndag 18 september 2017 kl. 12:57:36 UTC+2 skrev Grzegorz Lachowski:

[Grzegorz Lachowski]

Try ./run-ravendb.ps1 -AuthenticationDisabled -PublicServerUrl "http://localhost:8080" -DryRun

[marcus]

This is the command. But if I understand it shouldn't work with localhost:8080 but that is the only way it works for me?

docker run -d -e UNSECURED_ACCESS_ALLOWED=PublicNetwork -e PUBLIC_SERVER_URL=http://localhost:8080 -p 8080:8080 -p 38888:38888 ravendb/ravendb:ubuntu-latest

What is the recommended startup command for Docker?

[Grzegorz Lachowski]

I usually start Ubuntu image on Windows with .\run-ubuntu1604.ps1 -AuthenticationDisabled to run it on my local. It's then available under docker VM's address, usually 10.0.75.2:8080.

Powershell script exposes 8080 and 38888 ports by default with -p docker option.

As I mentioned I think since Ubuntu image is not native to MacOS, docker runs Ubuntu images on a VM. I would check the VM's IP address on which the docker container runs and try to access RavenDB under 8080 port on that IP address. All that is just for running it locally.

If you however like to forward it to your private network (e.g. 192.168.x.x) or further outside, you would need to use machine's external IP or name. For example considering my PC is known as gregolsky-pc in the local network, I would set PUBLIC_SERVER_URL  to http://gregolsky-pc:8080 and PUBLIC_TCP_SERVER_URL to tcp://gregolsky-pc:38888. This way it's going to be accessible in my local network under http://gregolsky-pc:8080.