Subscriber stop receiving messages

[Nuno Agapito]

Hi,

My subscriber is connected to the german relay (relay-eu-germany-1.eve-emdr.com) and when I start it, all works fine but after an hour or two, it stops receiving messages!
If I restart it, it starts working again.

Anyone experiencing similar issues?

I also noted the EMDR Map (http://map.eve-emdr.com/) is also not showing any order. Maybe suffering from the same problem?

Thanks
Naga

[Gregory Taylor]

That realtime map can be flakey at times, it's pretty old and unmaintained at this point. Check out the monitoring dash for a more accurate picture of the network: http://monitor.eve-emdr.com/

You'll want to share which ZeroMQ bindings you are using and under which language. Not all ZeroMQ bindings are created equally.

--
You received this message because you are subscribed to the Google Groups "EVE Market Data Relay" group.
To unsubscribe from this group and stop receiving emails from it, send an email to eve-emdr+u...@googlegroups.com.
To post to this group, send email to eve-...@googlegroups.com.
Visit this group at http://groups.google.com/group/eve-emdr.
For more options, visit https://groups.google.com/d/optout.

--

Greg Taylor

(864) 888-7964

http://gc-taylor.com

[Nuno Agapito]

Yeah... Once I posted the map started working :(

The monitor doesnt show any problem with the german server but for some reason, I stop receiving messages after a while.
No errors, nothing. The thread just sits there at the Recv() waiting.... It worked fine for days and now always stops after 1-2 hours.
I switched to the us-east, lets see what happens now.

Naga

[Gregory Taylor]

Again, unless you provide some of the details I mentioned, we can't help you.

[Nuno Agapito]

Ohhh, I failed reading the whole post...

I had some problems to get a working library, dont remember why now, was a couple weeks ago, so I dont remember where I got them.
Visual Studio tells me that I am using the ZeroMQ .NET bindings from iMatrix Corporation, version 2.2.12202.5

[Gregory Taylor]

Might be worth checking out clrzmq, as per the EMDR code samples: http://www.eve-emdr.com/en/latest/using.html#c

I don't know much about C#, but that was submitted by an EMDR user.

[Nuno Agapito]

And you just reminded me which ones I used!

I had some problems with the x86 and x64 on my server but ended up solving it and using the libs referenced on the page, more specifically the 2.2.5 version since the 3 is still RC1.

Well, I just wanted to confirm there was no problem with the German server so I dont end up losing time trying to figure out why I stop receiving messages when it could be a server problem.
Since the server seems to be working perfectly, I will properly investigate what is happening on my side.

[Fuzzysteve]

Is there a specific time of day it stops working?

(I think that's my relay)

If it's around 11gmt, then it may be because I'm restarting the server once per day.  (clears up any potential leaks, and so on)

[Nuno Agapito]

I notice it happening around 23 gmt on December 26 and yesterday it happened again twice but I dont remember the hours.
One of it was at night.

But, if the server restarts, the socket would close and the service would stop.
It kept waiting to receive data, so the connection was still open.

I'm going to see how the US East relay behaves. If it fails, its a problem on my side, if it doenst fail, I will try again the German relay and see if I still have the same problem.

[Drapko Nitzhonot]

Nuno, I think your IP address is 67.x.x.x.

If it is your connection, this is netstat output (I run US East relay):
myserverip  yourip ESTABLISHED 17216/emdr-relay-go unkn-4 (5.56/0/0)

I had problems in the past with some connections with that state (my relay was crashing because out of memory). tcpdump shows there are no/little traffic to your IP address.

IIRC, I solved the problem upgrading to ZMQ 3.x (we will see with your unkn-4 state :P)

[Drapko Nitzhonot]

From ZeroMQ website: http://zeromq.org/bindings:clr
There is an official package through nuget with version 3.3: http://www.nuget.org/packages/NetMQ/

I recommend you to try this version.

PD: my relay restarts everyday at 6:25 CET (GMT+1)

[Nuno Agapito]

No, that is not my IP.
My server is running on Microsoft Azure Servers, 137.117.x.x

Currently, I'm having no problems with the US East server but I was not aware of servers restarting every day.

Once I have some time I will update to NetMQ 3.3 and take in consideration the fact that servers might go down and I might need to reconnect although I think the library does that for me.

[Drapko Nitzhonot]

Oh, so someone is having problems and it's not you :P

At least the Python library reconnects automatically.

[Nuno Agapito]

And it also happened with the US east relay.

My last received order is at 04:33 AM GMT so it stopped somewhere near this hour.
I runned a netstat and there isnt any open connection to the relay, so its probably a ZQM bug, failing to reconnect and not raising some kind of exception...

Going to try to update to the newest version over the weekend and see if I can also detect this "reconnect moments" so I can have more control when the server restarts.
Now that I know where the .net source is, it will be much easier.

[Daniel Barnes]

     I have found ZMQ to always have some kind of connection issues, while not reading this whole thread my suggestion is that you pick at least 3 nodes and swap every so often. I swapped every 10 minutes when i was running my app, and then republished to a redis server for pub/sub with the app server. The app server then never lost a beat. redis overhead is extremely low.

--

You received this message because you are subscribed to the Google Groups "EVE Market Data Relay" group.
To unsubscribe from this group and stop receiving emails from it, send an email to eve-emdr+u...@googlegroups.com.
To post to this group, send email to eve-...@googlegroups.com.
Visit this group at http://groups.google.com/group/eve-emdr.
For more options, visit https://groups.google.com/d/optout.

--

Daniel Barnes