losing connection to remote actor with akka 2.2.3

[OlegYch]

Hi

i've recently upgraded an app at https://github.com/OlegYch/scastie/ from akka 2.1.1 to akka 2.2.3 and been experiencing some weird behavior since then
now, i'm not sure that it's caused by upgrade, since the network topology is not really a reliable one (a host on t1.micro in US and a host at corporate network in Europe connected through VPN), but thought you guys can shed some light
every couple of days connection seems to break and from that point all messages end up in deadLetter, and i don't think i've seen this before upgrade for a year or so

here is the log of the host in US:

16:35:57.885 [DEBUG] c.Progress - received handled message StopMonitorProgress(MonitorChannel(2876,null,play.api.libs.iteratee.Concurrent$$anon$6@c96f1a))
16:44:55.727 [DEBUG] c.Progress - received handled message StopMonitorProgress(MonitorChannel(2873,null,play.api.libs.iteratee.Concurrent$$anon$6@1185d74))
17:07:45.389 [DEBUG] a.r.t.ProtocolStateActor - stopped
17:07:45.389 [DEBUG] a.r.EndpointReader - stopped
17:07:45.391 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.AssociationHandle$Disassociated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2#-727682821] was not delivered. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.397 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.ActorTransportAdapter$DisassociateUnderlying] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2#-727682821] was not delivered. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.398 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A15001-4#303518442]
17:07:45.398 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@6fcbee)
17:07:45.782 [WARN] a.r.RemoteWatcher - Detected unreachable: [akka.tcp://act...@192.168.11.3:15001]
17:07:45.789 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(AddressTerminated(akka.tcp://act...@192.168.11.3:15001),Actor[akka://actors/deadLetters])
17:07:45.791 [DEBUG] a.r.EndpointReader - stopped monitoring Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-1#-1744510284]
17:07:45.792 [INFO] Remoting - Address [akka.tcp://act...@192.168.11.3:15001] is now quarantined, all messages to this address will be delivered to dead letters.
17:07:45.792 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(AddressTerminated(akka.tcp://act...@192.168.11.3:15001),Actor[akka://actors/deadLetters])
17:07:45.795 [DEBUG] a.r.EndpointReader - stopped
17:07:45.796 [DEBUG] a.r.t.ProtocolStateActor - stopped
17:07:45.796 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.AssociationHandle$Disassociated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-1/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-0#2100395010] was not delivered. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.797 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.AssociationHandle$Disassociated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A43430-3#1767828858] was not delivered. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.798 [DEBUG] a.r.ReliableDeliverySupervisor - stopping
17:07:45.800 [DEBUG] a.r.ReliableDeliverySupervisor - stopped
17:07:45.800 [DEBUG] a.r.EndpointManager - received AutoReceiveMessage Envelope(Terminated(Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-1#-1744510284]),Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-1#-1744510284])
17:07:45.800 [DEBUG] a.r.EndpointManager - received AutoReceiveMessage Envelope(Terminated(Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-0#-599333485]),Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-0#-599333485])
17:07:45.802 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/user/pastes/renderer#824112780] from channel class akka.actor.AddressTerminated
17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194])
17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169])
17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/remote-watcher#1916649759] from channel class akka.actor.AddressTerminated
17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/remote-deployment-watcher#14048132] from channel class akka.actor.AddressTerminated
17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194])
17:07:45.808 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015])
17:07:45.808 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151])
17:07:45.809 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789])
17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169])
17:07:45.809 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [10] dead letters encountered, no more dead letters will be logged. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
17:07:45.809 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/deadLetterListener#-36858977] from all channels
17:07:45.809 [DEBUG] a.e.DeadLetterListener - stopped
17:07:46.071 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@1803780)
17:07:46.073 [DEBUG] a.r.t.ProtocolStateActor - stopped
17:07:46.073 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A43438-5#1564591647]
17:50:14.536 [DEBUG] a.r.t.ProtocolStateActor - stopped
17:50:14.675 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@75df1)
17:50:14.676 [DEBUG] Remoting - Associated [akka.tcp://act...@192.168.11.1:15000] <- [akka.tcp://act...@192.168.11.3:15001]
17:50:14.676 [DEBUG] a.r.EndpointManager - now supervising Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2#-527643721]
17:50:14.677 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@2d228c)
17:50:14.677 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2/endpointWriter#-151223580]
17:50:14.678 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A43439-6#1784686539]
17:50:14.678 [DEBUG] a.r.ReliableDeliverySupervisor - started (akka.remote.ReliableDeliverySupervisor@1373745)
17:50:14.678 [DEBUG] a.r.ReliableDeliverySupervisor - now monitoring Actor[akka://actors/system/endpointManager#-577518865]
17:50:14.678 [DEBUG] a.r.ReliableDeliverySupervisor - now supervising Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2/endpointWriter#-151223580]
17:50:14.816 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.819 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.820 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.821 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.822 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.822 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.954 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:50:14.989 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/user/pastes/renderer#824112780] failed
17:55:21.670 [DEBUG] a.r.EndpointReader - stopped
17:55:21.671 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A15001-7#634233434]
17:55:21.671 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@1763f29)
17:55:21.673 [DEBUG] a.r.t.ProtocolStateActor - stopped
17:55:21.884 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A43440-8#-35490938]
17:55:21.884 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@cb5e96)
17:55:22.021 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@1a66e6b)
17:55:22.022 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2/endpointWriter#-151223580]
17:55:22.022 [DEBUG] Remoting - Associated [akka.tcp://act...@192.168.11.1:15000] <- [akka.tcp://act...@192.168.11.3:15001]
17:55:22.022 [DEBUG] a.r.EndpointManager - now supervising Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-3#1040198932]
17:55:22.023 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@9f1a77)
17:55:22.023 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-3#1040198932]
17:57:21.623 [DEBUG] c.o.s.PastesActor - received handled message GetPaste(1644)
18:03:08.013 [DEBUG] a.r.t.ProtocolStateActor - stopped
18:03:08.013 [DEBUG] a.r.EndpointReader - stopped
18:03:08.016 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@d8af5c)
18:03:08.016 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A15001-9#-1533493943]
18:03:08.284 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@fe970f)
18:03:08.284 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-2/endpointWriter#-151223580]
18:55:01.869 [DEBUG] c.o.s.PastesActor - received handled message GetPaste(2087)
19:02:23.675 [DEBUG] a.r.t.ProtocolStateActor - stopped
19:02:23.675 [DEBUG] a.r.EndpointReader - stopped
19:02:23.677 [DEBUG] a.r.EndpointManager - received AutoReceiveMessage Envelope(Terminated(Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-3#1040198932]),Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-3#1040198932])
19:02:23.809 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.3%3A43441-10#625465592]
19:02:23.810 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@c5f44e)
19:02:23.811 [DEBUG] Remoting - Associated [akka.tcp://act...@192.168.11.1:15000] <- [akka.tcp://act...@192.168.11.3:15001]
19:02:23.811 [DEBUG] a.r.EndpointManager - now supervising Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-4#791510516]
19:02:23.811 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@24cc6)
19:02:23.811 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.3%3A15001-4#791510516]


here is the log from the host in Europe at about the same time, where remote actors are deployed:

20:08:33.711 [DEBUG] a.r.t.ProtocolStateActor - stopped
20:08:33.713 [DEBUG] a.r.EndpointReader - stopped
20:08:33.713 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-1/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#-1884705295] failed
20:08:33.718 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.ActorTransportAdapter$DisassociateUnderlying] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A55459-3#131580945] was not delivered. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:33.718 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-1#-244078323] failed
20:08:33.718 [DEBUG] a.r.EndpointManager - received AutoReceiveMessage Envelope(Terminated(Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-1#-244078323]),Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-1#-244078323])
20:08:33.718 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.AssociationHandle$Disassociated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A55459-3#131580945] was not delivered. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:34.254 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.AssociationHandle$Disassociated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2#-2057389453] was not delivered. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:34.254 [DEBUG] a.r.EndpointReader - stopped
20:08:34.255 [DEBUG] a.r.t.ProtocolStateActor - stopped
20:08:34.255 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0/endpointWriter/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#22005184] failed
20:08:34.256 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.ActorTransportAdapter$DisassociateUnderlying] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2#-2057389453] was not delivered. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:34.258 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-4#1150735840]
20:08:34.258 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@5ea8d94)
20:08:34.826 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@5041a39c)
20:08:34.826 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0/endpointWriter#1290847877]
20:08:34.963 [DEBUG] a.r.t.ProtocolStateActor - stopped
20:08:34.965 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.AssociationHandle$Disassociated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-4#1150735840] was not delivered. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:34.976 [WARN] Remoting - Tried to associate with unreachable remote address [akka.tcp://act...@192.168.11.1:15000]. Address is now gated for 60000 ms, all messages to this address will be delivered to dead letters.
20:08:34.976 [DEBUG] a.s.Serialization(akka://actors) - Using serializer[akka.serialization.JavaSerializer] for message [akka.actor.AddressTerminated]
20:08:34.979 [DEBUG] c.o.s.RendererActor - received AutoReceiveMessage Envelope(AddressTerminated(akka.tcp://act...@192.168.11.1:15000),Actor[akka://actors/deadLetters])
20:08:34.979 [DEBUG] c.o.s.RendererActor - received AutoReceiveMessage Envelope(AddressTerminated(akka.tcp://act...@192.168.11.1:15000),Actor[akka://actors/deadLetters])
20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
20:08:34.983 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A55460-5#53750381]
20:08:34.984 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:34.985 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@396fe335)
20:08:34.986 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:34.986 [INFO] c.o.s.RendererActor - stopping sbt
20:08:34.986 [DEBUG] a.r.ReliableDeliverySupervisor - stopping
20:08:34.986 [INFO] c.o.s.RendererActor - Executing exit
20:08:34.999 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.001 [INFO] c.o.s.RendererActor - stopping sbt
20:08:35.001 [INFO] c.o.s.RendererActor - Executing exit
20:08:35.001 [INFO] c.o.s.RendererActor - stopping sbt
20:08:35.001 [INFO] c.o.s.RendererActor - Executing exit
20:08:35.002 [DEBUG] Remoting - Associated [akka.tcp://act...@192.168.11.3:15001] <- [akka.tcp://act...@192.168.11.1:15000]
20:08:35.002 [DEBUG] a.r.EndpointManager - now supervising Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2#1379722065]
20:08:35.002 [DEBUG] a.r.ReliableDeliverySupervisor - started (akka.remote.ReliableDeliverySupervisor@732566c1)
20:08:35.002 [DEBUG] a.r.ReliableDeliverySupervisor - now monitoring Actor[akka://actors/system/endpointManager#809700788]
20:08:35.003 [DEBUG] a.r.ReliableDeliverySupervisor - now supervising Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter#-28956401]
20:08:35.006 [DEBUG] a.r.EndpointReader - stopped monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0/endpointWriter#1290847877]
20:08:35.007 [DEBUG] a.r.EndpointReader - stopped
20:08:35.007 [INFO] a.a.LocalActorRef - Message [akka.remote.transport.ActorTransportAdapter$DisassociateUnderlying] from Actor[akka://actors/deadLetters] to Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-4#1150735840] was not delivered. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:35.007 [DEBUG] a.r.ReliableDeliverySupervisor - stopped
20:08:35.007 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@72ba8430)
20:08:35.007 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter#-28956401]
20:08:35.010 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194] from channel class akka.actor.AddressTerminated
20:08:35.011 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#-2076065278] failed
20:08:35.011 [DEBUG] a.r.EndpointManager - received AutoReceiveMessage Envelope(Terminated(Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#-2076065278]),Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#-2076065278])
20:08:35.018 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.019 [DEBUG] c.o.s.RendererActor - stopping
20:08:35.019 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.019 [INFO] c.o.s.RendererActor - stopping sbt
20:08:35.019 [INFO] c.o.s.RendererActor - Executing exit
20:08:35.054 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015] from channel class akka.actor.AddressTerminated
20:08:35.054 [DEBUG] c.o.s.RendererActor - stopping
20:08:35.055 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.055 [DEBUG] c.o.s.TimeoutActor - stopped
20:08:35.064 [INFO] c.o.s.RendererActor - stopping sbt
20:08:35.071 [INFO] c.o.s.RendererActor - Executing exit
20:08:35.675 [INFO] a.a.LocalActorRef - Message [akka.actor.AddressTerminated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169] was not delivered. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:35.677 [DEBUG] a.s.Serialization(akka://actors) - Using serializer[akka.serialization.JavaSerializer] for message [akka.dispatch.sysmsg.DeathWatchNotification]
20:08:35.681 [INFO] a.a.LocalActorRef - Message [akka.actor.AddressTerminated] from Actor[akka://actors/deadLetters] to Actor[akka://actors/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789] was not delivered. [10] dead letters encountered, no more dead letters will be logged. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
20:08:35.681 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/deadLetterListener#-738175643] from all channels
20:08:35.681 [DEBUG] a.e.DeadLetterListener - stopped
20:08:35.682 [DEBUG] c.o.s.RendererActor - stopped
20:08:35.688 [DEBUG] c.o.s.RendererActor - stopped
20:08:35.693 [DEBUG] c.o.s.RendererActor - stopped
20:08:35.701 [DEBUG] c.o.s.RendererActor - stopped
20:08:35.716 [DEBUG] c.o.s.RendererActor - stopped
20:51:03.001 [DEBUG] a.r.t.ProtocolStateActor - stopped
20:51:03.001 [DEBUG] a.r.EndpointReader - stopped
20:51:03.001 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#2056074427] failed
20:51:03.005 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-6#-178261807]
20:51:03.006 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@2a565937)
20:51:03.276 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@40e16993)
20:51:03.276 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter#-28956401]
20:56:10.151 [DEBUG] a.r.t.ProtocolStateActor - stopped
20:56:10.151 [DEBUG] a.r.EndpointReader - stopped
20:56:10.151 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#1925879238] failed
20:56:10.155 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-7#1960326694]
20:56:10.155 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@707ddb77)
20:56:10.500 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A55461-8#-13123452]
20:56:10.501 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@2b394d3)
20:56:10.503 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@6928de56)
20:56:10.503 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter#-28956401]
20:56:10.503 [DEBUG] Remoting - Associated [akka.tcp://act...@192.168.11.3:15001] <- [akka.tcp://act...@192.168.11.1:15000]
20:56:10.505 [DEBUG] a.r.EndpointManager - now supervising Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-3#2084472824]
20:56:10.507 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@3d953a4e)
20:56:10.508 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-3#2084472824]
21:03:56.520 [DEBUG] a.r.t.ProtocolStateActor - stopped
21:03:56.521 [DEBUG] a.r.EndpointReader - stopped
21:03:56.521 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-3/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#1135086655] failed
21:03:56.522 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-3#2084472824] failed
21:03:56.523 [DEBUG] a.r.EndpointManager - received AutoReceiveMessage Envelope(Terminated(Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-3#2084472824]),Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-3#2084472824])
21:03:56.790 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A55462-9#-1255691636]
21:03:56.790 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@4bcc2c10)
21:03:56.791 [DEBUG] Remoting - Associated [akka.tcp://act...@192.168.11.3:15001] <- [akka.tcp://act...@192.168.11.1:15000]
21:03:56.793 [DEBUG] a.r.EndpointManager - now supervising Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-4#-925141615]
21:03:56.795 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@6d4f6dfa)
21:03:56.795 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/endpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-4#-925141615]
22:03:12.381 [DEBUG] a.r.t.ProtocolStateActor - stopped
22:03:12.381 [DEBUG] a.r.EndpointReader - stopped
22:03:12.381 [DEBUG] LocalActorRefProvider(akka://actors) - resolve of path sequence [/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter/endpointReader-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-0#-657086995] failed
22:03:12.386 [DEBUG] a.r.t.AkkaProtocolManager - now supervising Actor[akka://actors/system/transports/akkaprotocolmanager.tcp0/akkaProtocol-tcp%3A%2F%2Factors%40192.168.11.1%3A15000-10#1424889682]
22:03:12.386 [DEBUG] a.r.t.ProtocolStateActor - started (akka.remote.transport.ProtocolStateActor@37b2b0d4)
22:03:12.663 [DEBUG] a.r.EndpointReader - started (akka.remote.EndpointReader@9d16b98)
22:03:12.663 [DEBUG] a.r.EndpointReader - now monitoring Actor[akka://actors/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2Factors%40192.168.11.1%3A15000-2/endpointWriter#-28956401]


Thanks, Aleh

[OlegYch]

Ok, so i reverted back to 2.1.4 and did not experience this sudden connection losses for several days.
Anyone have an idea what's wrong with 2.2.3 ?

Thanks Aleh

17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c4#951807194])
17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c5#918797169])

17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/remote-watcher#1916649759] from channel class akka.actor.AddressTerminated
17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/remote-deployment-watcher#14048132] from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c4#951807194])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151])

17:07:45.809 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789])
17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]),Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c5#918797169])

[Björn Antonsson]

Hi Aleh,

On Saturday, 2 November 2013 at 04:37, OlegYch wrote:

Ok, so i reverted back to 2.1.4 and did not experience this sudden connection losses for several days.
Anyone have an idea what's wrong with 2.2.3 ?

You said that every couple of days the connection seems to break? Is there some hiccups on the network with packet loss, or big lags?

What is different in Akka 2.2 is that it has a reliable remote death watch and if system A thinks that system B is dead (if it doesn’t respond for an extended period of time) then DeathWatch will be triggered on system A for the actors watched on System B. That was not the case for 2.1.

There are several changes noted in the migration guide, but two that sticks out and can affect how your application behaves are "ActorRef equality and sending to remote actors” and "DeathPactException is now Fatal”. 

Hope that helps.

B/

--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ: http://akka.io/faq/
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+...@googlegroups.com.
To post to this group, send email to akka...@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/groups/opt_out.

-- 

Björn Antonsson

Typesafe – Reactive Apps on the JVM

twitter: @bantonsson

[Prashant Sharma]

Hi Björn,

Can we somehow configure the time which 

On Tue, Nov 5, 2013 at 3:26 AM, Björn Antonsson <bjorn.a...@typesafe.com> wrote:

Hi Aleh,

On Saturday, 2 November 2013 at 04:37, OlegYch wrote:

Ok, so i reverted back to 2.1.4 and did not experience this sudden connection losses for several days.
Anyone have an idea what's wrong with 2.2.3 ?

You said that every couple of days the connection seems to break? Is there some hiccups on the network with packet loss, or big lags?

What is different in Akka 2.2 is that it has a reliable remote death watch and if system A thinks that system B is dead (if it doesn’t respond for an extended period of time) then DeathWatch will be

Can we somehow configure this timeout ?

 

triggered on system A for the actors watched on System B. That was not the case for 2.1.

There are several changes noted in the migration guide, but two that sticks out and can affect how your application behaves are "ActorRef equality and sending to remote actors” and "DeathPactException is now Fatal”. 

Is there a way something close to older behaviour can be simulated, in the situation pointed out by Aleh.

--
s

[Björn Antonsson]

Hi,

On Tuesday, 5 November 2013 at 04:41, Prashant Sharma wrote:

Hi Björn,

Can we somehow configure the time which 

On Tue, Nov 5, 2013 at 3:26 AM, Björn Antonsson <bjorn.a...@typesafe.com> wrote:

Hi Aleh,

On Saturday, 2 November 2013 at 04:37, OlegYch wrote:

Ok, so i reverted back to 2.1.4 and did not experience this sudden connection losses for several days.
Anyone have an idea what's wrong with 2.2.3 ?

You said that every couple of days the connection seems to break? Is there some hiccups on the network with packet loss, or big lags?

What is different in Akka 2.2 is that it has a reliable remote death watch and if system A thinks that system B is dead (if it doesn’t respond for an extended period of time) then DeathWatch will be

Can we somehow configure this timeout ?

The failure detector of the remoting is described here. It has several knobs, but one thing that is easily configured if you expect big “pauses” is the acceptable-heartbeat-pause, which is 3 seconds by default.

 

 

triggered on system A for the actors watched on System B. That was not the case for 2.1.

There are several changes noted in the migration guide, but two that sticks out and can affect how your application behaves are "ActorRef equality and sending to remote actors” and "DeathPactException is now Fatal”. 

Is there a way something close to older behaviour can be simulated, in the situation pointed out by Aleh.

Which part? Those are two distinct things. We have not even established exactly what goes wrong for Aleh.

If you watch another actor, you should most likely handle the Terminated message for that actor. That’s just good practice.

Another thing is that if you look in the  the migration guide you will see that you should use actorSelection instead of actorFor when sending to actors, and this behaves a lot more like remote actor refs used to do in 2.1.x and 2.0.x.

B/

[OlegYch]

Hi Bjorn

Yes, it's certainly possible that there are network hiccups.
However i'm not sure how do i make the application resilient to that.
Shouldn't Akka be able to restore the connection to remote actor automatically?
http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html#DeathPactException_is_now_Fatal seems to imply that previously on disconnect the actors would restart, and in 2.2 i need to override the default strategy, right?
However i don't see anything about Terminated or DeathPactException in logs for 2.1.

Thanks, Aleh

Hope that helps.

B/

17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c4#951807194]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c4#951807194])
17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789])
17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c5#918797169]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c5#918797169])

17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/remote-watcher#1916649759] from channel class akka.actor.AddressTerminated
17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing Actor[akka://actors/system/remote-deployment-watcher#14048132] from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c4#951807194]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c4#951807194])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151])

17:07:45.809 [INFO] a.r.RoutedActorRef - Message [akka.dispatch.sysmsg.DeathWatchNotification] from Actor[akka://actors/user/pastes/renderer#824112780] to Actor[akka://actors/user/pastes/renderer#824112780] was not delivered. [9] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789])
17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received AutoReceiveMessage Envelope(Terminated(Actor[akka.tcp://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c5#918797169]),Actor[akka.tcp://actors@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c5#918797169])

--
s

[Björn Antonsson]

Hi Aleh,

On Tuesday, 5 November 2013 at 17:37, OlegYch wrote:

Hi Bjorn

Yes, it's certainly possible that there are network hiccups.
However i'm not sure how do i make the application resilient to that.
Shouldn't Akka be able to restore the connection to remote actor automatically?
http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html#DeathPactException_is_now_Fatal seems to imply that previously on disconnect the actors would restart, and in 2.2 i need to override the default strategy, right?

So the difference I was trying to explain was that before (in 2.1.x) the death watch was unreliable in the sense that the connection just being flaky or going down would not trigger the sending of Terminated messages, and you would need a graceful shutdown from the remote system to get  Terminated messages, while now (in 2.2.x) when the remoting failure detector deems this node as unreachable we send Terminated messages.

This means that the behaviour over flaky/unreliable connections have changed quite a bit, and your application will probably have to take that into account.

B/

[OlegYch]

Lets say the remote system got disconnected for reals, how do i connect it back?

Aleh

[Björn Antonsson]

Hi Aleh,

On Wednesday, 6 November 2013 at 14:54, OlegYch wrote:

Lets say the remote system got disconnected for reals, how do i connect it back?

Connecting the systems will happen automatically if they send messages to each other. There can be a Gated period where the system won’t try to open a connection to the other system or a Quarantined period where the system will refuse to talk to the other system. These can be configured in the remote config. 

What is fundamentally different is that if you had remote deployed actors, they have now died, and any actorRefs you have to those actors are no longer valid even if you restart the actors. To overcome this problem you should use actor selection, which you can read about here “Use actorSelection instead of actorFor”.

As I said. There are several things that have changed between 2.1 and 2.2, and you need to look through the migration guide and check if the assumptions in your code are still valid.

B/

[Aleh Aleshka]

On Wednesday, November 6, 2013 11:29:34 PM, Björn Antonsson wrote:
> Hi Aleh,
>

> On Wednesday, 6 November 2013 at 14:54, OlegYch wrote:
>
>> Lets say the remote system got disconnected for reals, how do i
>> connect it back?
>>
>
> Connecting the systems will happen automatically if they send messages
> to each other. There can be a Gated period where the system won’t try
> to open a connection to the other system or a Quarantined period where
> the system will refuse to talk to the other system. These can be
> configured in the remote config.
>
> What is fundamentally different is that if you had remote deployed
> actors, they have now died, and any actorRefs you have to those actors
> are no longer valid even if you restart the actors. To overcome this
> problem you should use actor selection, which you can read about here
> “Use actorSelection instead of actorFor”

> <http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html#Use_actorSelection_instead_of_actorFor>.

>
> As I said. There are several things that have changed between 2.1 and
> 2.2, and you need to look through the migration guide

> <http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html> and

>>>>> <http://doc.akka.io/docs/akka/2.2.3/scala/remoting.html#Failure_Detector>.

>>>>> It has several knobs, but one thing that is easily configured if
>>>>> you expect big “pauses” is the acceptable-heartbeat-pause, which
>>>>> is 3 seconds by default.
>>>>>>> triggered on system A for the actors watched on System B. That
>>>>>>> was not the case for 2.1.
>>>>>>>
>>>>>>> There are several changes noted in the migration guide

>>>>>>> <http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html>,

>>>>>>> but two that sticks out and can affect how your application
>>>>>>> behaves are "ActorRef equality and sending to remote actors”

>>>>>>> <http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html#ActorRef_equality_and_sending_to_remote_actors> and
>>>>>>> "DeathPactException is now Fatal”
>>>>>>> <http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html#DeathPactException_is_now_Fatal>.

>>>>>>>
>>>>>>>
>>>>>>
>>>>>> Is there a way something close to older behaviour can be
>>>>>> simulated, in the situation pointed out by Aleh.
>>>>>
>>>>> Which part? Those are two distinct things. We have not even
>>>>> established exactly what goes wrong for Aleh.
>>>>>
>>>>> If you watch another actor, you should most likely handle the
>>>>> Terminated message for that actor. That’s just good practice.
>>>>>
>>>>> Another thing is that if you look in the the migration guide

>>>>> <http://doc.akka.io/docs/akka/current/project/migration-guide-2.1.x-2.2.x.html> you

>>>>> will see that you should use actorSelection instead of actorFor
>>>>> when sending to actors, and this behaves a lot more like remote
>>>>> actor refs used to do in 2.1.x and 2.0.x.
>>>>>
>>>>> B/
>>>>>>> Hope that helps.
>>>>>>>
>>>>>>> B/
>>>>>>>
>>>>>>>> Thanks Aleh
>>>>>>>>
>>>>>>>> On Wednesday, October 30, 2013 2:10:28 AM UTC+3, OlegYch wrote:
>>>>>>>>
>>>>>>>> Hi
>>>>>>>>
>>>>>>>> i've recently upgraded an app at

>>>>>>>> https://github.com/OlegYch/__scastie/

>>>>>>>> <https://github.com/OlegYch/scastie/> from akka 2.1.1 to
>>>>>>>> akka 2.2.3 and been experiencing some weird behavior since then
>>>>>>>> now, i'm not sure that it's caused by upgrade, since the
>>>>>>>> network topology is not really a reliable one (a host on
>>>>>>>> t1.micro in US and a host at corporate network in Europe
>>>>>>>> connected through VPN), but thought you guys can shed some
>>>>>>>> light
>>>>>>>> every couple of days connection seems to break and from
>>>>>>>> that point all messages end up in deadLetter, and i don't
>>>>>>>> think i've seen this before upgrade for a year or so
>>>>>>>>
>>>>>>>> here is the log of the host in US:
>>>>>>>>
>>>>>>>> 16:35:57.885 [DEBUG] c.Progress - received handled message

>>>>>>>> StopMonitorProgress(__MonitorChannel(2876,null,play.__api.libs.iteratee.Concurrent$$__anon$6@c96f1a))

>>>>>>>> 16:44:55.727 [DEBUG] c.Progress - received handled message

>>>>>>>> StopMonitorProgress(__MonitorChannel(2873,null,play.__api.libs.iteratee.Concurrent$$__anon$6@1185d74))

>>>>>>>> 17:07:45.389 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 17:07:45.389 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 17:07:45.391 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__AssociationHandle$__Disassociated]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-2#-727682821]

>>>>>>>> was not delivered. [3] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.397 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__ActorTransportAdapter$__DisassociateUnderlying]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-2#-727682821]

>>>>>>>> was not delivered. [4] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.398 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-4#303518442]

>>>>>>>> 17:07:45.398 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@6fcbee)

>>>>>>>> 17:07:45.782 [WARN] a.r.RemoteWatcher - Detected

>>>>>>>> unreachable: [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>]

>>>>>>>> 17:07:45.789 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>),Actor[akka://actors/__deadLetters])

>>>>>>>> 17:07:45.791 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-1#-1744510284]

>>>>>>>> 17:07:45.792 [INFO] Remoting - Address

>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>] is now quarantined, all

>>>>>>>> messages to this address will be delivered to dead letters.
>>>>>>>> 17:07:45.792 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>),Actor[akka://actors/__deadLetters])

>>>>>>>> 17:07:45.795 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 17:07:45.796 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 17:07:45.796 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__AssociationHandle$__Disassociated]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-1/endpointReader-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-0#2100395010]

>>>>>>>> was not delivered. [5] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.797 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__AssociationHandle$__Disassociated]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A43430-3#1767828858]

>>>>>>>> was not delivered. [6] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.798 [DEBUG] a.r.ReliableDeliverySupervisor - stopping
>>>>>>>> 17:07:45.800 [DEBUG] a.r.ReliableDeliverySupervisor - stopped
>>>>>>>> 17:07:45.800 [DEBUG] a.r.EndpointManager - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-1#-1744510284]),Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-1#-1744510284])

>>>>>>>> 17:07:45.800 [DEBUG] a.r.EndpointManager - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-0#-599333485]),__Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-0#-599333485])

>>>>>>>> 17:07:45.802 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] from

>>>>>>>> channel class akka.actor.AddressTerminated
>>>>>>>> 17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c4#__951807194]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c4#951807194
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

>>>>>>>> 17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c1#__589081789]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c1#589081789
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c5#__918797169]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c5#918797169
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])

>>>>>>>> 17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/system/__remote-watcher#1916649759]

>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>> 17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
>>>>>>>> 17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/system/__remote-deployment-watcher#__14048132]

>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c4#__951807194]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c4#951807194
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message

>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was

>>>>>>>> not delivered. [7] dead letters encountered. This logging
>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>> 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message

>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was

>>>>>>>> not delivered. [8] dead letters encountered. This logging
>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>> 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

>>>>>>>> 17:07:45.809 [INFO] a.r.RoutedActorRef - Message

>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was

>>>>>>>> not delivered. [9] dead letters encountered. This logging
>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>> 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c1#__589081789]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c1#589081789
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__act...@192.168.11.1:15000/__user/pastes/renderer/c5#__918797169]
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c5#918797169
>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])

>>>>>>>> 17:07:45.809 [INFO] a.r.RoutedActorRef - Message

>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was

>>>>>>>> not delivered. [10] dead letters encountered, no more dead
>>>>>>>> letters will be logged. This logging can be turned off or
>>>>>>>> adjusted with configuration settings
>>>>>>>> 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 17:07:45.809 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/system/__deadLetterListener#-36858977]

>>>>>>>> from all channels
>>>>>>>> 17:07:45.809 [DEBUG] a.e.DeadLetterListener - stopped
>>>>>>>> 17:07:46.071 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@1803780)

>>>>>>>> 17:07:46.073 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 17:07:46.073 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A43438-5#1564591647]

>>>>>>>> 17:50:14.536 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 17:50:14.675 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@75df1)

>>>>>>>> 17:50:14.676 [DEBUG] Remoting - Associated

>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>]

>>>>>>>> 17:50:14.676 [DEBUG] a.r.EndpointManager - now supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-2#-527643721]

>>>>>>>> 17:50:14.677 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__2d228c)

>>>>>>>> 17:50:14.677 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-2/endpointWriter#__-151223580]

>>>>>>>> 17:50:14.678 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A43439-6#1784686539]

>>>>>>>> 17:50:14.678 [DEBUG] a.r.ReliableDeliverySupervisor -

>>>>>>>> started (akka.remote.__ReliableDeliverySupervisor@__1373745)

>>>>>>>> 17:50:14.678 [DEBUG] a.r.ReliableDeliverySupervisor - now
>>>>>>>> monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager#-577518865]

>>>>>>>> 17:50:14.678 [DEBUG] a.r.ReliableDeliverySupervisor - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-2/endpointWriter#__-151223580]
>>>>>>>> 17:50:14.816 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.819 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.820 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.821 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.822 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.822 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.954 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed
>>>>>>>> 17:50:14.989 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/user/pastes/renderer#__824112780] failed

>>>>>>>> 17:55:21.670 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 17:55:21.671 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-7#634233434]

>>>>>>>> 17:55:21.671 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@1763f29)

>>>>>>>> 17:55:21.673 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 17:55:21.884 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A43440-8#-35490938]

>>>>>>>> 17:55:21.884 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@cb5e96)

>>>>>>>> 17:55:22.021 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__1a66e6b)

>>>>>>>> 17:55:22.022 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-2/endpointWriter#__-151223580]

>>>>>>>> 17:55:22.022 [DEBUG] Remoting - Associated

>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>]

>>>>>>>> 17:55:22.022 [DEBUG] a.r.EndpointManager - now supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-3#1040198932]

>>>>>>>> 17:55:22.023 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__9f1a77)

>>>>>>>> 17:55:22.023 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-3#1040198932]

>>>>>>>> 17:57:21.623 [DEBUG] c.o.s.PastesActor - received handled
>>>>>>>> message GetPaste(1644)
>>>>>>>> 18:03:08.013 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 18:03:08.013 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 18:03:08.016 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@d8af5c)

>>>>>>>> 18:03:08.016 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-9#-1533493943]

>>>>>>>> 18:03:08.284 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__fe970f)

>>>>>>>> 18:03:08.284 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.3%3A15001-2/endpointWriter#__-151223580]

>>>>>>>> 18:55:01.869 [DEBUG] c.o.s.PastesActor - received handled
>>>>>>>> message GetPaste(2087)
>>>>>>>> 19:02:23.675 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 19:02:23.675 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 19:02:23.677 [DEBUG] a.r.EndpointManager - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-3#1040198932]),Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-3#1040198932])

>>>>>>>> 19:02:23.809 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.3%__3A43441-10#625465592]

>>>>>>>> 19:02:23.810 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@c5f44e)

>>>>>>>> 19:02:23.811 [DEBUG] Remoting - Associated

>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>]

>>>>>>>> 19:02:23.811 [DEBUG] a.r.EndpointManager - now supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-4#791510516]

>>>>>>>> 19:02:23.811 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__24cc6)

>>>>>>>> 19:02:23.811 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-4#791510516]

>>>>>>>>
>>>>>>>>
>>>>>>>> here is the log from the host in Europe at about the same
>>>>>>>> time, where remote actors are deployed:
>>>>>>>>
>>>>>>>> 20:08:33.711 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 20:08:33.713 [DEBUG] a.r.EndpointReader - stopped

>>>>>>>> 20:08:33.713 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-1/endpointReader-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-1884705295]

>>>>>>>> failed
>>>>>>>> 20:08:33.718 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__ActorTransportAdapter$__DisassociateUnderlying]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A55459-3#131580945]

>>>>>>>> was not delivered. [3] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>> 20:08:33.718 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-1#-244078323]

>>>>>>>> failed
>>>>>>>> 20:08:33.718 [DEBUG] a.r.EndpointManager - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-1#-244078323]),Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-1#-244078323])

>>>>>>>> 20:08:33.718 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__AssociationHandle$__Disassociated]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A55459-3#131580945]

>>>>>>>> was not delivered. [4] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 20:08:34.254 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__AssociationHandle$__Disassociated]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-2#-2057389453]

>>>>>>>> was not delivered. [5] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 20:08:34.254 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 20:08:34.255 [DEBUG] a.r.t.ProtocolStateActor - stopped

>>>>>>>> 20:08:34.255 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0/endpointWriter/__endpointReader-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-0#22005184]

>>>>>>>> failed
>>>>>>>> 20:08:34.256 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__ActorTransportAdapter$__DisassociateUnderlying]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-2#-2057389453]

>>>>>>>> was not delivered. [6] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 20:08:34.258 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-4#1150735840]

>>>>>>>> 20:08:34.258 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@5ea8d94)

>>>>>>>> 20:08:34.826 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__5041a39c)

>>>>>>>> 20:08:34.826 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0/endpointWriter#__1290847877]

>>>>>>>> 20:08:34.963 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 20:08:34.965 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__AssociationHandle$__Disassociated]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-4#1150735840]

>>>>>>>> was not delivered. [7] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 20:08:34.976 [WARN] Remoting - Tried to associate with
>>>>>>>> unreachable remote address

>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>]. Address is now gated

>>>>>>>> for 60000 ms, all messages to this address will be
>>>>>>>> delivered to dead letters.

>>>>>>>> 20:08:34.976 [DEBUG] a.s.Serialization(akka://__actors) -
>>>>>>>> Using serializer[akka.serialization.__JavaSerializer] for

>>>>>>>> message [akka.actor.AddressTerminated]
>>>>>>>> 20:08:34.979 [DEBUG] c.o.s.RendererActor - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>),Actor[akka://actors/__deadLetters])

>>>>>>>> 20:08:34.979 [DEBUG] c.o.s.RendererActor - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>),Actor[akka://actors/__deadLetters])

>>>>>>>> 20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>> 20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>> 20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>> 20:08:34.983 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A55460-5#53750381]

>>>>>>>> 20:08:34.984 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:34.985 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@396fe335)

>>>>>>>> 20:08:34.986 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:34.986 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>> 20:08:34.986 [DEBUG] a.r.ReliableDeliverySupervisor - stopping
>>>>>>>> 20:08:34.986 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>> 20:08:34.999 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>> 20:08:35.002 [DEBUG] Remoting - Associated

>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>]

>>>>>>>> 20:08:35.002 [DEBUG] a.r.EndpointManager - now supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2#1379722065]

>>>>>>>> 20:08:35.002 [DEBUG] a.r.ReliableDeliverySupervisor -

>>>>>>>> started (akka.remote.__ReliableDeliverySupervisor@__732566c1)

>>>>>>>> 20:08:35.002 [DEBUG] a.r.ReliableDeliverySupervisor - now
>>>>>>>> monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager#809700788]

>>>>>>>> 20:08:35.003 [DEBUG] a.r.ReliableDeliverySupervisor - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter#__-28956401]

>>>>>>>> 20:08:35.006 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0/endpointWriter#__1290847877]

>>>>>>>> 20:08:35.007 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>> 20:08:35.007 [INFO] a.a.LocalActorRef - Message

>>>>>>>> [akka.remote.transport.__ActorTransportAdapter$__DisassociateUnderlying]
>>>>>>>> from Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-4#1150735840]

>>>>>>>> was not delivered. [8] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 20:08:35.007 [DEBUG] a.r.ReliableDeliverySupervisor - stopped
>>>>>>>> 20:08:35.007 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__72ba8430)

>>>>>>>> 20:08:35.007 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter#__-28956401]

>>>>>>>> 20:08:35.010 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1:__15000/user/pastes/renderer/c4#__951807194
>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>]
>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>> 20:08:35.011 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-2076065278]

>>>>>>>> failed
>>>>>>>> 20:08:35.011 [DEBUG] a.r.EndpointManager - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-2076065278]),__Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-2076065278])

>>>>>>>> 20:08:35.018 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.019 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>> 20:08:35.019 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.019 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>> 20:08:35.019 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>> 20:08:35.054 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1:__15000/user/pastes/renderer/c2#__1229200015
>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>]

>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>> 20:08:35.054 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>> 20:08:35.055 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.055 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>> 20:08:35.064 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>> 20:08:35.071 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>> 20:08:35.675 [INFO] a.a.LocalActorRef - Message
>>>>>>>> [akka.actor.AddressTerminated] from

>>>>>>>> Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1:__15000/user/pastes/renderer/c5#__918797169
>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>]

>>>>>>>> was not delivered. [9] dead letters encountered. This
>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>> settings 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>> 20:08:35.677 [DEBUG] a.s.Serialization(akka://__actors) -
>>>>>>>> Using serializer[akka.serialization.__JavaSerializer] for
>>>>>>>> message [akka.dispatch.sysmsg.__DeathWatchNotification]

>>>>>>>> 20:08:35.681 [INFO] a.a.LocalActorRef - Message
>>>>>>>> [akka.actor.AddressTerminated] from

>>>>>>>> Actor[akka://actors/__deadLetters] to
>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1:__15000/user/pastes/renderer/c1#__589081789
>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>]

>>>>>>>> was not delivered. [10] dead letters encountered, no more
>>>>>>>> dead letters will be logged. This logging can be turned off
>>>>>>>> or adjusted with configuration settings
>>>>>>>> 'akka.log-dead-letters' and

>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.

>>>>>>>> 20:08:35.681 [DEBUG] a.e.EventStream - unsubscribing

>>>>>>>> Actor[akka://actors/system/__deadLetterListener#-738175643]

>>>>>>>> from all channels
>>>>>>>> 20:08:35.681 [DEBUG] a.e.DeadLetterListener - stopped
>>>>>>>> 20:08:35.682 [DEBUG] c.o.s.RendererActor - stopped
>>>>>>>> 20:08:35.688 [DEBUG] c.o.s.RendererActor - stopped
>>>>>>>> 20:08:35.693 [DEBUG] c.o.s.RendererActor - stopped
>>>>>>>> 20:08:35.701 [DEBUG] c.o.s.RendererActor - stopped
>>>>>>>> 20:08:35.716 [DEBUG] c.o.s.RendererActor - stopped
>>>>>>>> 20:51:03.001 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 20:51:03.001 [DEBUG] a.r.EndpointReader - stopped

>>>>>>>> 20:51:03.001 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter/__endpointReader-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-0#2056074427]

>>>>>>>> failed
>>>>>>>> 20:51:03.005 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-6#-178261807]

>>>>>>>> 20:51:03.006 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@2a565937)

>>>>>>>> 20:51:03.276 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__40e16993)

>>>>>>>> 20:51:03.276 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter#__-28956401]

>>>>>>>> 20:56:10.151 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 20:56:10.151 [DEBUG] a.r.EndpointReader - stopped

>>>>>>>> 20:56:10.151 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter/__endpointReader-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-0#1925879238]

>>>>>>>> failed
>>>>>>>> 20:56:10.155 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-7#1960326694]

>>>>>>>> 20:56:10.155 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@707ddb77)

>>>>>>>> 20:56:10.500 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A55461-8#-13123452]

>>>>>>>> 20:56:10.501 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@2b394d3)

>>>>>>>> 20:56:10.503 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__6928de56)

>>>>>>>> 20:56:10.503 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter#__-28956401]

>>>>>>>> 20:56:10.503 [DEBUG] Remoting - Associated

>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>]

>>>>>>>> 20:56:10.505 [DEBUG] a.r.EndpointManager - now supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-3#2084472824]

>>>>>>>> 20:56:10.507 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__3d953a4e)

>>>>>>>> 20:56:10.508 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-3#2084472824]

>>>>>>>> 21:03:56.520 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 21:03:56.521 [DEBUG] a.r.EndpointReader - stopped

>>>>>>>> 21:03:56.521 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-3/endpointReader-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#1135086655]
>>>>>>>> failed
>>>>>>>> 21:03:56.522 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-3#2084472824]

>>>>>>>> failed
>>>>>>>> 21:03:56.523 [DEBUG] a.r.EndpointManager - received
>>>>>>>> AutoReceiveMessage

>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-3#2084472824]),Actor[__akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-3#2084472824])

>>>>>>>> 21:03:56.790 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A55462-9#-1255691636]

>>>>>>>> 21:03:56.790 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@4bcc2c10)

>>>>>>>> 21:03:56.791 [DEBUG] Remoting - Associated

>>>>>>>> [akka.tcp://act...@192.168.11.__3:15001
>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>> [akka.tcp://act...@192.168.11.__1:15000
>>>>>>>> <http://act...@192.168.11.1:15000>]

>>>>>>>> 21:03:56.793 [DEBUG] a.r.EndpointManager - now supervising

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-4#-925141615]

>>>>>>>> 21:03:56.795 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__6d4f6dfa)

>>>>>>>> 21:03:56.795 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-4#-925141615]

>>>>>>>> 22:03:12.381 [DEBUG] a.r.t.ProtocolStateActor - stopped
>>>>>>>> 22:03:12.381 [DEBUG] a.r.EndpointReader - stopped

>>>>>>>> 22:03:12.381 [DEBUG] LocalActorRefProvider(akka://__actors)

>>>>>>>> - resolve of path sequence

>>>>>>>> [/system/endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter/__endpointReader-akka.tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-0#-657086995]

>>>>>>>> failed
>>>>>>>> 22:03:12.386 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>> supervising

>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A15000-10#1424889682]

>>>>>>>> 22:03:12.386 [DEBUG] a.r.t.ProtocolStateActor - started

>>>>>>>> (akka.remote.transport.__ProtocolStateActor@37b2b0d4)

>>>>>>>> 22:03:12.663 [DEBUG] a.r.EndpointReader - started

>>>>>>>> (akka.remote.EndpointReader@__9d16b98)

>>>>>>>> 22:03:12.663 [DEBUG] a.r.EndpointReader - now monitoring

>>>>>>>> Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-2/endpointWriter#__-28956401]

>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks, Aleh
>>>>>>>>
>>>>>>>> --
>>>>>>>> >>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>>> >>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>>> >>>>>>>>>> Search the archives:https://groups.google.com/group/akka-user
>>>>>>>> <https://groups.google.com/group/akka-user>
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the
>>>>>>>> Google Groups "Akka User List" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from
>>>>>>>> it, send an email to akka-user+...@googlegroups.com.
>>>>>>>> To post to this group, send email to akka...@googlegroups.com.
>>>>>>>> Visit this group at http://groups.google.com/group/akka-user

>>>>>>>> <http://groups.google.com/group/akka-user>.

>>>>>>>> For more options, visit
>>>>>>>> https://groups.google.com/groups/opt_out

>>>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>>>
>>>>>>> --
>>>>>>> Björn Antonsson
>>>>>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
>>>>>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson>

>>>>>>>
>>>>>>> --
>>>>>>> >>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>> >>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>> >>>>>>>>>> Search the archives:https://groups.google.com/group/akka-user
>>>>>>> <https://groups.google.com/group/akka-user>
>>>>>>> ---
>>>>>>> You received this message because you are subscribed to the
>>>>>>> Google Groups "Akka User List" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from
>>>>>>> it, send an email to akka-user+...@googlegroups.com.
>>>>>>> To post to this group, send email to akka...@googlegroups.com.
>>>>>>> Visit this group at http://groups.google.com/group/akka-user

>>>>>>> <http://groups.google.com/group/akka-user>.

>>>>>>> For more options, visit https://groups.google.com/groups/opt_out

>>>>>>> <https://groups.google.com/groups/opt_out>.

>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> s
>>>>>>
>>>>>> --
>>>>>> >>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>> >>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>> >>>>>>>>>> Search the archives:https://groups.google.com/group/akka-user

>>>>>> <https://groups.google.com/group/akka-user>
>>>>>> ---
>>>>>> You received this message because you are subscribed to the
>>>>>> Google Groups "Akka User List" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to akka-user+...@googlegroups.com.
>>>>>> To post to this group, send email to akka...@googlegroups.com.
>>>>>> Visit this group at http://groups.google.com/group/akka-user

>>>>>> <http://groups.google.com/group/akka-user>.

>>>>>> For more options, visit https://groups.google.com/groups/opt_out

>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>
>>>>> --
>>>>> Björn Antonsson
>>>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
>>>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson>

>>>>>
>>>> --
>>>> >>>>>>>>>> Read the docs:http://akka.io/docs/
>>>> >>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>> >>>>>>>>>> Search the archives:https://groups.google.com/group/akka-user
>>>> <https://groups.google.com/group/akka-user>
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Akka User List" group.
>>>> To unsubscribe from this group and stop receiving emails from it,

>>>> send an email to akka-user+...@googlegroups.com <javascript:>.

>>>> To post to this group, send email to akka...@googlegroups.com

>>>> <javascript:>.

>>>> Visit this group at http://groups.google.com/group/akka-user

>>>> <http://groups.google.com/group/akka-user>.

>>>> For more options, visit https://groups.google.com/groups/opt_out

>>>> <https://groups.google.com/groups/opt_out>.
>>>
>>> --
>>> Björn Antonsson
>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson>

>>>
>> --
>> >>>>>>>>>> Read the docs:http://akka.io/docs/
>> >>>>>>>>>> Check the FAQ:http://akka.io/faq/
>> >>>>>>>>>> Search the archives:https://groups.google.com/group/akka-user
>> ---
>> You received this message because you are subscribed to the Google
>> Groups "Akka User List" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to akka-user+...@googlegroups.com

>> <mailto:akka-user+...@googlegroups.com>.

>> To post to this group, send email to akka...@googlegroups.com

>> <mailto:akka...@googlegroups.com>.

>> Visit this group at http://groups.google.com/group/akka-user.
>> For more options, visit https://groups.google.com/groups/opt_out.
>
> --
> Björn Antonsson

> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
> twitter: @bantonsson <http://twitter.com/#!/bantonsson>

>
> --
> >>>>>>>>>> Read the docs: http://akka.io/docs/
> >>>>>>>>>> Check the FAQ: http://akka.io/faq/
> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
> ---

> You received this message because you are subscribed to a topic in the

> Google Groups "Akka User List" group.

> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/akka-user/5iQuWP_zBKI/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to

> akka-user+...@googlegroups.com.
> To post to this group, send email to akka...@googlegroups.com.
> Visit this group at http://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/groups/opt_out.

Hi Bjorn

I'm not using actorFor anywhere in my app
https://github.com/OlegYch/scastie/

Aleh

[Björn Antonsson]

Hi Aleh

Hope that helps.

B/

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c5#__918797169]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c5#918797169

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])

17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-watcher#1916649759]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped

17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-deployment-watcher#__14048132]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [7] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [8] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.809 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [9] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3:15001/__remote/akka.tcp/actors@192.__168.11.1:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3:15001/remote/akka.tcp/__ac...@192.168.11.1:15000/__user/pastes/renderer/c5#__918797169]

From looking at you logs it seems like you have remote deployed actors, and they have now died. Your application needs to handle that and restart them. If you had an actorRef to one of those actors it is no longer valid since the actor has died. That is a difference from the behavior in 2.1.x.

B/

 

Aleh

--

Read the docs: http://akka.io/docs/

Check the FAQ: http://akka.io/faq/

Search the archives: https://groups.google.com/group/akka-user

---

You received this message because you are subscribed to the Google Groups "Akka User List" group.

To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+...@googlegroups.com.

To post to this group, send email to akka...@googlegroups.com.

Visit this group at http://groups.google.com/group/akka-user.

For more options, visit https://groups.google.com/groups/opt_out.

-- 

Björn Antonsson

Typesafe – Reactive Apps on the JVM

twitter: @bantonsson

[Aleh Aleshka]

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <http://act...@192.168.11.3:15001>]
>>>>>>>>>> 17:07:45.789 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <http://act...@192.168.11.3:15001>),Actor[akka://actors/__deadLetters])
>>>>>>>>>> 17:07:45.791 [DEBUG] a.r.EndpointReader - stopped
>>>>>>>>>> monitoring
>>>>>>>>>> Actor[akka://actors/system/__endpointManager/__endpointWriter-akka.tcp%3A%2F%__2Factors%40192.168.11.3%__3A15001-1#-1744510284]
>>>>>>>>>> 17:07:45.792 [INFO] Remoting - Address
>>>>>>>>>> [akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <http://act...@192.168.11.3:15001>] is now quarantined, all
>>>>>>>>>> messages to this address will be delivered to dead letters.
>>>>>>>>>> 17:07:45.792 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>> 17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3

>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])
>>>>>>>>>> 17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>> Actor[akka://actors/system/__remote-watcher#1916649759]
>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
>>>>>>>>>> 17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>> Actor[akka://actors/system/__remote-deployment-watcher#__14048132]
>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>> not delivered. [7] dead letters encountered. This logging
>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>> not delivered. [8] dead letters encountered. This logging
>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>> 17:07:45.809 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>> not delivered. [9] dead letters encountered. This logging
>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3

>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>>>> [akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>>>> [akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>>>> [akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://act...@192.168.11.1:15000>]. Address is now gated
>>>>>>>>>> for 60000 ms, all messages to this address will be
>>>>>>>>>> delivered to dead letters.
>>>>>>>>>> 20:08:34.976 [DEBUG] a.s.Serialization(akka://__actors) -
>>>>>>>>>> Using serializer[akka.serialization.__JavaSerializer] for
>>>>>>>>>> message [akka.actor.AddressTerminated]
>>>>>>>>>> 20:08:34.979 [DEBUG] c.o.s.RendererActor - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__1

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://act...@192.168.11.1:15000>),Actor[akka://actors/__deadLetters])
>>>>>>>>>> 20:08:34.979 [DEBUG] c.o.s.RendererActor - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(AddressTerminated(__akka.tcp://act...@192.168.11.__1

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://act...@192.168.11.1:15000>),Actor[akka://actors/__deadLetters])
>>>>>>>>>> 20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>>>> 20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>>>> 20:08:34.983 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>>>> 20:08:34.983 [DEBUG] a.r.t.AkkaProtocolManager - now
>>>>>>>>>> supervising
>>>>>>>>>> Actor[akka://actors/system/__transports/__akkaprotocolmanager.tcp0/__akkaProtocol-tcp%3A%2F%__2Factors%40192.168.11.1%__3A55460-5#53750381]
>>>>>>>>>> 20:08:34.984 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:34.985 [DEBUG] a.r.t.ProtocolStateActor - started
>>>>>>>>>> (akka.remote.transport.__ProtocolStateActor@396fe335)
>>>>>>>>>> 20:08:34.986 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:34.986 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>>>> 20:08:34.986 [DEBUG] a.r.ReliableDeliverySupervisor - stopping
>>>>>>>>>> 20:08:34.986 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>>>> 20:08:34.999 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.000 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>>>> 20:08:35.001 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>>>> 20:08:35.002 [DEBUG] Remoting - Associated
>>>>>>>>>> [akka.tcp://act...@192.168.11.__3

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>>>> [akka.tcp://act...@192.168.11.__1

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <mailto:act...@192.168.11.1>:__15000/user/pastes/renderer/c4#__951807194

>>>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>]
>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>> 20:08:35.011 [DEBUG] LocalActorRefProvider(akka://__actors)
>>>>>>>>>> - resolve of path sequence
>>>>>>>>>> [/system/endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-2076065278]
>>>>>>>>>> failed
>>>>>>>>>> 20:08:35.011 [DEBUG] a.r.EndpointManager - received
>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>> Envelope(Terminated(Actor[__akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-2076065278]),__Actor[akka://actors/system/__endpointManager/__reliableEndpointWriter-akka.__tcp%3A%2F%2Factors%40192.168.__11.1%3A15000-0#-2076065278])
>>>>>>>>>> 20:08:35.018 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.019 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>>>> 20:08:35.019 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.019 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>>>> 20:08:35.019 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>>>> 20:08:35.054 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1

>>>>>>>>>> <mailto:act...@192.168.11.1>:__15000/user/pastes/renderer/c2#__1229200015

>>>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>]
>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>> 20:08:35.054 [DEBUG] c.o.s.RendererActor - stopping
>>>>>>>>>> 20:08:35.055 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.055 [DEBUG] c.o.s.TimeoutActor - stopped
>>>>>>>>>> 20:08:35.064 [INFO] c.o.s.RendererActor - stopping sbt
>>>>>>>>>> 20:08:35.071 [INFO] c.o.s.RendererActor - Executing exit
>>>>>>>>>> 20:08:35.675 [INFO] a.a.LocalActorRef - Message
>>>>>>>>>> [akka.actor.AddressTerminated] from
>>>>>>>>>> Actor[akka://actors/__deadLetters] to
>>>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1

>>>>>>>>>> <mailto:act...@192.168.11.1>:__15000/user/pastes/renderer/c5#__918797169

>>>>>>>>>> <http://act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>]
>>>>>>>>>> was not delivered. [9] dead letters encountered. This
>>>>>>>>>> logging can be turned off or adjusted with configuration
>>>>>>>>>> settings 'akka.log-dead-letters' and
>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>> 20:08:35.677 [DEBUG] a.s.Serialization(akka://__actors) -
>>>>>>>>>> Using serializer[akka.serialization.__JavaSerializer] for
>>>>>>>>>> message [akka.dispatch.sysmsg.__DeathWatchNotification]
>>>>>>>>>> 20:08:35.681 [INFO] a.a.LocalActorRef - Message
>>>>>>>>>> [akka.actor.AddressTerminated] from
>>>>>>>>>> Actor[akka://actors/__deadLetters] to
>>>>>>>>>> Actor[akka://actors/remote/__akka.tcp/act...@192.168.11.1

>>>>>>>>>> <mailto:act...@192.168.11.1>:__15000/user/pastes/renderer/c1#__589081789

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>>>> [akka.tcp://act...@192.168.11.__1

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001

>>>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>>>> [akka.tcp://act...@192.168.11.__1

>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000

>>>>>>>>>> <http://googlegroups.com>.

>>>>>>>>>> To post to this group, send email to akka...@googlegroups.com

>>>>>>>>>> <http://googlegroups.com>.

>>>>>>>>>> Visit this group at http://groups.google.com/group/akka-user
>>>>>>>>>> <http://groups.google.com/group/akka-user>.
>>>>>>>>>> For more options, visit
>>>>>>>>>> https://groups.google.com/groups/opt_out
>>>>>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Björn Antonsson
>>>>>>>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
>>>>>>>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>>>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>>>>>>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>>>>>>>>>>>>>> Search the
>>>>>>>>>>>>>>>>>>> archives:https://groups.google.com/group/akka-user

>>>>>>>>> <https://groups.google.com/group/akka-user>
>>>>>>>>> ---
>>>>>>>>> You received this message because you are subscribed to the
>>>>>>>>> Google Groups "Akka User List" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from
>>>>>>>>> it, send an email to akka-user+...@googlegroups.com

>>>>>>>>> <http://googlegroups.com>.

>>>>>>>>> To post to this group, send email to akka...@googlegroups.com

>>>>>>>>> <http://googlegroups.com>.

>>>>>>>>> Visit this group at http://groups.google.com/group/akka-user
>>>>>>>>> <http://groups.google.com/group/akka-user>.
>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out
>>>>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --

>>>>>>>> s
>>>>>>>>
>>>>>>>> --
>>>>>>>>>>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>>>>>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>>>>>>>>>>>>> Search the
>>>>>>>>>>>>>>>>>> archives:https://groups.google.com/group/akka-user
>>>>>>>> <https://groups.google.com/group/akka-user>
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the
>>>>>>>> Google Groups "Akka User List" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to akka-user+...@googlegroups.com

>>>>>>>> <http://googlegroups.com>.

>>>>>>>> To post to this group, send email to akka...@googlegroups.com

>>>>>>>> <http://googlegroups.com>.

>>>>>>>> Visit this group at http://groups.google.com/group/akka-user
>>>>>>>> <http://groups.google.com/group/akka-user>.
>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out
>>>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>>>
>>>>>>> --
>>>>>>> Björn Antonsson
>>>>>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
>>>>>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson>
>>>>>> --
>>>>>>>>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>>>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>>>>>>>>>>> Search the
>>>>>>>>>>>>>>>> archives:https://groups.google.com/group/akka-user

>>>>>> <https://groups.google.com/group/akka-user>
>>>>>> ---
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "Akka User List" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to akka-user+...@googlegroups.com

>>>>>> <http://googlegroups.com> <javascript:>.

>>>>>> To post to this group, send email to akka...@googlegroups.com

>>>>>> <http://googlegroups.com>

I'm not sure how do i handle that.
i tried adding override def supervisorStrategy: SupervisorStrategy =
OneForOneStrategy(){case _ => Restart} to PastesActor, but that doesn't
change the behavior.

Aleh

[Björn Antonsson]

Hi Aleh,

Hope that helps.

B/

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])

17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-watcher#1916649759]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped

17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-deployment-watcher#__14048132]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [7] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [8] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.809 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [9] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

Would you mind taking a step back and try to describe your application instead? That might shed some light on what is going wrong and how it can be fixed.

I see from your project description that you have something called PastesActor and RendererActor and a router, but it would be great if you could give some more information here, by answering some of the following questions.

What actors do you have?

How are they related (parent/child)?

Which actors live on which system?

Which actors communicate with each other?

Also, a more resilient approach than using a router would be to use work pulling, as described here:

http://letitcrash.com/post/29044669086/balancing-workload-across-nodes-with-akka-2

http://www.michaelpollmeier.com/akka-work-pulling-pattern/

B/

Aleh

--

Read the docs: http://akka.io/docs/

Check the FAQ: http://akka.io/faq/

Search the archives: https://groups.google.com/group/akka-user

---

You received this message because you are subscribed to the Google Groups "Akka User List" group.

To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+...@googlegroups.com.

To post to this group, send email to akka...@googlegroups.com.

Visit this group at http://groups.google.com/group/akka-user.

For more options, visit https://groups.google.com/groups/opt_out.

-- 

Björn Antonsson

Typesafe – Reactive Apps on the JVM

twitter: @bantonsson

[Aleh Aleshka]

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>>>> 17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])
>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>>>> Actor[akka://actors/system/__remote-watcher#1916649759]
>>>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>>>> Actor[akka://actors/system/__remote-deployment-watcher#__14048132]
>>>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>> not delivered. [7] dead letters encountered. This logging
>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>> not delivered. [8] dead letters encountered. This logging
>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>>>> 17:07:45.809 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>> not delivered. [9] dead letters encountered. This logging
>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789
>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000
>>>>>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>>>>>> [akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001
>>>>>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>>>>>> [akka.tcp://act...@192.168.11.__1
>>>>>>>>>>>> <mailto:act...@192.168.11.__1>

>>>>>>>>>>> <http://googlegroups.com>.
>>>>>>>>>>> Visit this group at http://groups.google.com/group/akka-user
>>>>>>>>>>> <http://groups.google.com/group/akka-user>.
>>>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out
>>>>>>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> s
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>>>>>>>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>>>>>>>>>>>>>>> Search the
>>>>>>>>>>>>>>>>>>>> archives:https://groups.google.com/group/akka-user
>>>>>>>>>> <https://groups.google.com/group/akka-user>
>>>>>>>>>> ---
>>>>>>>>>> You received this message because you are subscribed to the
>>>>>>>>>> Google Groups "Akka User List" group.
>>>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>>>> send an email to akka-user+...@googlegroups.com
>>>>>>>>>> <http://googlegroups.com>

>>>>>>>>>> <http://googlegroups.com>.
>>>>>>>>>> To post to this group, send email to akka...@googlegroups.com
>>>>>>>>>> <http://googlegroups.com>
>>>>>>>>>> <http://googlegroups.com>.
>>>>>>>>>> Visit this group at http://groups.google.com/group/akka-user
>>>>>>>>>> <http://groups.google.com/group/akka-user>.
>>>>>>>>>> For more options, visit https://groups.google.com/groups/opt_out
>>>>>>>>>> <https://groups.google.com/groups/opt_out>.
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Björn Antonsson
>>>>>>>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM
>>>>>>>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson>
>>>>>>>> --
>>>>>>>>>>>>>>>>>> Read the docs:http://akka.io/docs/
>>>>>>>>>>>>>>>>>> Check the FAQ:http://akka.io/faq/
>>>>>>>>>>>>>>>>>> Search the
>>>>>>>>>>>>>>>>>> archives:https://groups.google.com/group/akka-user
>>>>>>>> <https://groups.google.com/group/akka-user>
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>> Groups "Akka User List" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to akka-user+...@googlegroups.com
>>>>>>>> <http://googlegroups.com>

Hi Bjorn
The app is pretty trivial and opensource.
As you have noticed there is a PastesActor which creates a bunch of
RendererActors with router from config (actors.conf) . The web
application sends messages to PastesActor which relays them to and back
from RendererActors. There is a couple of other actors, but they are
all locally deployed and communicate inside local system.

Aleh

[Björn Antonsson]

Hope that helps.

B/

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])

17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-watcher#1916649759]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped

17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-deployment-watcher#__14048132]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [7] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [8] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.809 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [9] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3 <mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

So which of these actors live on which system? Are the PastesActor on System A together with the router, and the RenderActors remote deployed on System B?

B/

 

Aleh

--

Read the docs: http://akka.io/docs/

Check the FAQ: http://akka.io/faq/

Search the archives: https://groups.google.com/group/akka-user

---

You received this message because you are subscribed to the Google Groups "Akka User List" group.

To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+...@googlegroups.com.

To post to this group, send email to akka...@googlegroups.com.

Visit this group at http://groups.google.com/group/akka-user.

For more options, visit https://groups.google.com/groups/opt_out.

-- 

Björn Antonsson

Typesafe – Reactive Apps on the JVM

twitter: @bantonsson

[Aleh Aleshka]

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>>>>>> 17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])
>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>>>>>> Actor[akka://actors/system/__remote-watcher#1916649759]
>>>>>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>>>>>> Actor[akka://actors/system/__remote-deployment-watcher#__14048132]
>>>>>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>>>> not delivered. [7] dead letters encountered. This logging
>>>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>>>> not delivered. [8] dead letters encountered. This logging
>>>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>>>>>> 17:07:45.809 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>>>> not delivered. [9] dead letters encountered. This logging
>>>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000
>>>>>>>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>>>>>>>> [akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001
>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>>>>>>>> [akka.tcp://act...@192.168.11.__1
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>
>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>

Exactly

[Björn Antonsson]

Hope that helps.

B/

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])

17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-watcher#1916649759]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped

17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing

Actor[akka://actors/system/__remote-deployment-watcher#__14048132]

from channel class akka.actor.AddressTerminated

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [7] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.808 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [8] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__ac...@192.168.11.3

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>

<mailto:__ac...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.809 [INFO] a.r.RoutedActorRef - Message

[akka.dispatch.sysmsg.__DeathWatchNotification] from

Actor[akka://actors/user/__pastes/renderer#824112780] to

Actor[akka://actors/user/__pastes/renderer#824112780] was

not delivered. [9] dead letters encountered. This logging

can be turned off or adjusted with configuration settings

'akka.log-dead-letters' and

'akka.log-dead-letters-during-__shutdown'.

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>

<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>

<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])

17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received

AutoReceiveMessage

Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3

<mailto:act...@192.168.11.__3>

<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__ac...@192.168.11.1

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>

<mailto:__ac...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

Exactly

So as I said, a big difference between Akka 2.1.x and 2.2.x in the remoting is that remotee actor refs are not valid after a network “outage”. This is the price for reliable death watch, which is a new feature in 2.2.x.

What happens is that your remote deployed actors on System B are stopped, and presumably the router on system A as well when all of its routees have died. You either have to restart the router when the systems connect again or turn the thing around using work pulling where the renderers would register with a master actor (taking the role of the router) and ask for work items.

Here are links to two work pulling blog posts:

http://letitcrash.com/post/29044669086/balancing-workload-across-nodes-with-akka-2

http://www.michaelpollmeier.com/akka-work-pulling-pattern/

B/

--

Read the docs: http://akka.io/docs/

Check the FAQ: http://akka.io/faq/

Search the archives: https://groups.google.com/group/akka-user

---

You received this message because you are subscribed to the Google Groups "Akka User List" group.

To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+...@googlegroups.com.

To post to this group, send email to akka...@googlegroups.com.

Visit this group at http://groups.google.com/group/akka-user.

For more options, visit https://groups.google.com/groups/opt_out.

-- 

Björn Antonsson

Typesafe – Reactive Apps on the JVM

twitter: @bantonsson

[Aleh Aleshka]

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>>>>>>>> 17:07:45.802 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c5#918797169
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169>])
>>>>>>>>>>>>>>>> 17:07:45.806 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>>>>>>>> Actor[akka://actors/system/__remote-watcher#1916649759]
>>>>>>>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RouterConfig$$anon$1 - stopped
>>>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.e.EventStream - unsubscribing
>>>>>>>>>>>>>>>> Actor[akka://actors/system/__remote-deployment-watcher#__14048132]
>>>>>>>>>>>>>>>> from channel class akka.actor.AddressTerminated
>>>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c4#__951807194]

>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c4#951807194
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c4#951807194>])
>>>>>>>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>>>>>> not delivered. [7] dead letters encountered. This logging
>>>>>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])
>>>>>>>>>>>>>>>> 17:07:45.808 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>>>>>> not delivered. [8] dead letters encountered. This logging
>>>>>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>>>>>> 17:07:45.808 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])
>>>>>>>>>>>>>>>> 17:07:45.809 [INFO] a.r.RoutedActorRef - Message
>>>>>>>>>>>>>>>> [akka.dispatch.sysmsg.__DeathWatchNotification] from
>>>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] to
>>>>>>>>>>>>>>>> Actor[akka://actors/user/__pastes/renderer#824112780] was
>>>>>>>>>>>>>>>> not delivered. [9] dead letters encountered. This logging
>>>>>>>>>>>>>>>> can be turned off or adjusted with configuration settings
>>>>>>>>>>>>>>>> 'akka.log-dead-letters' and
>>>>>>>>>>>>>>>> 'akka.log-dead-letters-during-__shutdown'.
>>>>>>>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c1#589081789>])
>>>>>>>>>>>>>>>> 17:07:45.809 [DEBUG] a.r.RemoteDeploymentWatcher - received
>>>>>>>>>>>>>>>> AutoReceiveMessage
>>>>>>>>>>>>>>>> Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>
>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>

>>>>>>>>>>>>>>>> <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c5#__918797169]

>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001/remote/akka.tcp/act...@192.168.11.1:15000/user/pastes/renderer/c5#918797169]>),Actor[akka.tcp://a__c...@192.168.11.3
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>
>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>

>>>>>>>>>>>>>>>> <mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>
>>>>>>>>>>>>>>>> <mailto:actors@192.__168.11.1>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>:15000
>>>>>>>>>>>>>>>> <http://act...@192.168.11.1:15000>] <-
>>>>>>>>>>>>>>>> [akka.tcp://act...@192.168.11.__3
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>

>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__3>:15001
>>>>>>>>>>>>>>>> <http://act...@192.168.11.3:15001>] <-
>>>>>>>>>>>>>>>> [akka.tcp://act...@192.168.11.__1
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>
>>>>>>>>>>>>>>>> <mailto:act...@192.168.11.__1>

Yeah, i guess contacting master from slaves should work.
To be clear - the same thing was happening with 2.1, i.e. if i kill
remote system, the master will not see it when it comes back. With 2.2
i tried to change supervisor strategy in PastesActor (which creates the
router) to always restart, but it didn't change a thing.
Can you confirm that router with remotely deployed routees is not
expected to be able to handle restarts of the remote system?

Thanks, Aleh

[Akka Team]

Hi Aleh,

I'd like to help you but my email client is unable to display this monstrous message. Could you maybe start a new thread with a concise description of the problem?

Thanks,

Roland

Hope that helps.

B/

<mail <mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c2#__1229200015]
<http://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015]>),Actor[akka.tcp://__act...@192.168.11.3

<mailto:__act...@192.168.11.3>
<mailto:__act...@192.168.11.3>
<mailto:__act...@192.168.11.3>
<mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c2#1229200015

<http://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c2#1229200015>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
AutoReceiveMessage
Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
<mailto:act...@192.168.11.__3>
<mailto:act...@192.168.11.__3>
<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
<mailto:__act...@192.168.11.1>
<mailto:__act...@192.168.11.1>
<mailto:__act...@192.168.11.1>
<mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c3#__1625932151]

<http://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151]>),Actor[akka.tcp://__act...@192.168.11.3

<mailto:__act...@192.168.11.3>
<mailto:__act...@192.168.11.3>
<mailto:__act...@192.168.11.3>
<mailto:__act...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c3#1625932151

<http://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c3#1625932151>])

17:07:45.806 [DEBUG] a.r.RouterConfig$$anon$1 - received
AutoReceiveMessage
Envelope(Terminated(Actor[__akka.tcp://act...@192.168.11.__3
<mailto:act...@192.168.11.__3>
<mailto:act...@192.168.11.__3>
<mailto:act...@192.168.11.__3>:15001/remote/akka.tcp/__act...@192.168.11.1
<mailto:__act...@192.168.11.1>
<mailto:__act...@192.168.11.1>
<mailto:__act...@192.168.11.1>
<mailto:__act...@192.168.11.1>:15000/__user/pastes/renderer/c1#__589081789]

<http://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user/pastes/renderer/c1#589081789]>),Actor[akka.tcp://a__c...@192.168.11.3

<mailto:a__c...@192.168.11.3>
<mailto:a__c...@192.168.11.3>
<mailto:a__c...@192.168.11.3>
<mailto:a__c...@192.168.11.3>:15001/__remote/akka.tcp/actors@192.__168.11.1
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>
<mailto:actors@192.__168.11.1>:15000/user/pastes/__renderer/c1#589081789

<http://act...@192.168.11.3:15001/remote/akka.tcp/actors@192.168.11.1:15000/user

--

Akka Team

Typesafe - The software stack for applications that scale

Blog: letitcrash.com
Twitter: @akkateam

[Björn Antonsson]

Hi Aleh,

On Monday, 11 November 2013 at 19:13, Aleh Aleshka wrote:

Yeah, i guess contacting master from slaves should work.

To be clear - the same thing was happening with 2.1, i.e. if i kill

remote system, the master will not see it when it comes back. With 2.2

i tried to change supervisor strategy in PastesActor (which creates the

router) to always restart, but it didn't change a thing.

Can you confirm that router with remotely deployed routees is not

expected to be able to handle restarts of the remote system?

That is correct. The remote deployed routees of a router will not magically survive the death of the remote system. When the death watch triggers for the remote deployed routees they will be removed from the router. The difference here is that in 2.2 the death watch is more reliable and triggers when the local system decides that the remote system is “dead” and not only when you kill the remote process.

B/

Thanks, Aleh

-- 

Björn Antonsson

Typesafe – Reactive Apps on the JVM

twitter: @bantonsson

[OlegYch]

Thanks, Bjorn

I guess it's worth pointing out in docs.
Aleh

[Akka Team]

Hi Aleh,

see the note below http://doc.akka.io/docs/akka/current/scala/routing.html#Routers_and_Supervision

Regards,

Roland

--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ: http://akka.io/faq/
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka User List" group.

To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+...@googlegroups.com.

To post to this group, send email to akka...@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/groups/opt_out.